2023-11-28T11:38:57.347 INFO:root:teuthology version: 0.0.1.dev209+g5ae09a5 2023-11-28T11:38:57.348 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} --owner scheduled_neesingh@teuthology --archive /home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469963 --name neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi --verbose -- /home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469963/orig.config.yaml 2023-11-28T11:38:57.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T11:38:57.484 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469963 branch: wip-neesingh-testing-231123 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} email: neesingh@redhat.com first_in_suite: false job_id: '7469963' kernel: client: branch: testing kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-neesingh-testing-231123 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - inode wrongly marked free - bad backtrace on inode - inode table repaired for inode - Scrub error on inode - Scrub error on dir - Metadata damage detected sha1: 2f5f6028b893ad41357cd06e827373f0fe2a1232 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 2f5f6028b893ad41357cd06e827373f0fe2a1232 kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: issue_54557 sha1: 17c45c858c4cb3105f973d12c6c74f8d5037aa89 owner: scheduled_neesingh@teuthology priority: 10 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 4140 sha1: 2f5f6028b893ad41357cd06e827373f0fe2a1232 sleep_before_teardown: 0 suite: fs suite_branch: issue_54557 suite_path: /home/teuthworker/src/github.com_neesingh-rh_ceph_17c45c858c4cb3105f973d12c6c74f8d5037aa89/qa suite_relpath: qa suite_repo: https://github.com/neesingh-rh/ceph suite_sha1: 17c45c858c4cb3105f973d12c6c74f8d5037aa89 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi039.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi184.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_forward_scrub teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 5ae09a5cc7064ca2bf994df19f3006b79794789a timestamp: 2023-11-28_11:27:19 tube: smithi user: neesingh verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-28T11:38:57.485 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_neesingh-rh_ceph_17c45c858c4cb3105f973d12c6c74f8d5037aa89/qa; will attempt to use it 2023-11-28T11:38:57.485 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_neesingh-rh_ceph_17c45c858c4cb3105f973d12c6c74f8d5037aa89/qa/tasks 2023-11-28T11:38:57.486 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-28T11:38:57.487 INFO:teuthology.task.internal:Checking packages... 2023-11-28T11:38:57.510 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '2f5f6028b893ad41357cd06e827373f0fe2a1232' 2023-11-28T11:38:57.510 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-28T11:38:57.510 INFO:teuthology.packaging:ref: None 2023-11-28T11:38:57.510 INFO:teuthology.packaging:tag: None 2023-11-28T11:38:57.510 INFO:teuthology.packaging:branch: wip-neesingh-testing-231123 2023-11-28T11:38:57.510 INFO:teuthology.packaging:sha1: 2f5f6028b893ad41357cd06e827373f0fe2a1232 2023-11-28T11:38:57.510 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-neesingh-testing-231123 2023-11-28T11:38:57.725 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-2697-g2f5f6028-1focal 2023-11-28T11:38:57.725 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-28T11:38:57.732 INFO:teuthology.task.internal:no buildpackages task found 2023-11-28T11:38:57.732 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-28T11:38:57.770 INFO:teuthology.task.internal:Saving configuration 2023-11-28T11:38:57.786 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-28T11:38:57.795 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T11:38:57.819 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi039.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469963', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 11:31:58.296412', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-11-28T11:38:57.842 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469963', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 11:31:58.294434', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-11-28T11:38:57.842 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-28T11:38:57.849 INFO:teuthology.task.internal:roles: ubuntu@smithi039.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-28T11:38:57.849 INFO:teuthology.task.internal:roles: ubuntu@smithi184.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-28T11:38:57.849 INFO:teuthology.run_tasks:Running task console_log... 2023-11-28T11:38:57.943 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f926cdc2160>, signals=[15]) 2023-11-28T11:38:57.943 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-28T11:38:57.949 INFO:teuthology.task.internal:Opening connections... 2023-11-28T11:38:57.950 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi039.front.sepia.ceph.com 2023-11-28T11:38:57.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T11:38:58.000 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi184.front.sepia.ceph.com 2023-11-28T11:38:58.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T11:38:58.050 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-28T11:38:58.061 DEBUG:teuthology.orchestra.run.smithi039:> uname -m 2023-11-28T11:38:58.080 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64 2023-11-28T11:38:58.080 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release 2023-11-28T11:38:58.128 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="Ubuntu" 2023-11-28T11:38:58.128 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-28T11:38:58.128 INFO:teuthology.orchestra.run.smithi039.stdout:ID=ubuntu 2023-11-28T11:38:58.128 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE=debian 2023-11-28T11:38:58.128 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-28T11:38:58.128 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="20.04" 2023-11-28T11:38:58.129 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-28T11:38:58.129 INFO:teuthology.orchestra.run.smithi039.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-28T11:38:58.129 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-28T11:38:58.129 INFO:teuthology.orchestra.run.smithi039.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-28T11:38:58.129 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_CODENAME=focal 2023-11-28T11:38:58.129 INFO:teuthology.orchestra.run.smithi039.stdout:UBUNTU_CODENAME=focal 2023-11-28T11:38:58.130 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2023-11-28T11:38:58.151 DEBUG:teuthology.orchestra.run.smithi184:> uname -m 2023-11-28T11:38:58.158 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64 2023-11-28T11:38:58.158 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2023-11-28T11:38:58.208 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="Ubuntu" 2023-11-28T11:38:58.208 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-28T11:38:58.208 INFO:teuthology.orchestra.run.smithi184.stdout:ID=ubuntu 2023-11-28T11:38:58.208 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE=debian 2023-11-28T11:38:58.208 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-28T11:38:58.208 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="20.04" 2023-11-28T11:38:58.208 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-28T11:38:58.208 INFO:teuthology.orchestra.run.smithi184.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-28T11:38:58.208 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-28T11:38:58.208 INFO:teuthology.orchestra.run.smithi184.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-28T11:38:58.209 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_CODENAME=focal 2023-11-28T11:38:58.209 INFO:teuthology.orchestra.run.smithi184.stdout:UBUNTU_CODENAME=focal 2023-11-28T11:38:58.209 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2023-11-28T11:38:58.233 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-28T11:38:58.248 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-28T11:38:58.271 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-28T11:38:58.271 DEBUG:teuthology.orchestra.run.smithi039:> test '!' -e /home/ubuntu/cephtest 2023-11-28T11:38:58.274 DEBUG:teuthology.orchestra.run.smithi184:> test '!' -e /home/ubuntu/cephtest 2023-11-28T11:38:58.279 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-28T11:38:58.298 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-28T11:38:58.298 DEBUG:teuthology.orchestra.run.smithi039:> test -z $(ls -A /var/lib/ceph) 2023-11-28T11:38:58.320 DEBUG:teuthology.orchestra.run.smithi184:> test -z $(ls -A /var/lib/ceph) 2023-11-28T11:38:58.342 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-28T11:38:58.396 INFO:teuthology.run_tasks:Running task kernel... 2023-11-28T11:38:58.413 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-11-28T11:38:58.413 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-11-28T11:38:58.413 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-11-28T11:38:58.413 DEBUG:teuthology.orchestra.run.smithi039:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-28T11:38:58.414 DEBUG:teuthology.orchestra.run.smithi184:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-28T11:38:58.419 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:38:58.420 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=testing 2023-11-28T11:38:58.423 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:38:58.423 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=testing 2023-11-28T11:38:58.648 DEBUG:teuthology.task.kernel:sha1 for client.1 is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T11:38:58.648 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-11-28T11:38:58.648 DEBUG:teuthology.orchestra.run.smithi184:> uname -r 2023-11-28T11:38:58.655 INFO:teuthology.orchestra.run.smithi184.stdout:5.4.0-124-generic 2023-11-28T11:38:58.655 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T11:38:58.655 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-28T11:38:58.655 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2023-11-28T11:38:58.656 DEBUG:teuthology.orchestra.run.smithi184:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-11-28T11:38:58.716 INFO:teuthology.orchestra.run.smithi184.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2023-11-28T11:38:58.729 DEBUG:teuthology.task.kernel:sha1 for client.0 is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T11:38:58.730 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-11-28T11:38:58.730 DEBUG:teuthology.orchestra.run.smithi039:> uname -r 2023-11-28T11:38:58.737 INFO:teuthology.orchestra.run.smithi039.stdout:5.4.0-124-generic 2023-11-28T11:38:58.737 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T11:38:58.737 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-28T11:38:58.737 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2023-11-28T11:38:58.738 DEBUG:teuthology.orchestra.run.smithi039:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-11-28T11:38:58.792 INFO:teuthology.orchestra.run.smithi039.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2023-11-28T11:38:58.835 INFO:teuthology.orchestra.run.smithi184.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-11-28T11:38:58.837 DEBUG:teuthology.orchestra.run.smithi184:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-11-28T11:38:58.867 DEBUG:teuthology.orchestra.run.smithi184:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-11-28T11:38:58.882 DEBUG:teuthology.orchestra.run.smithi184:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-11-28T11:38:58.896 INFO:teuthology.orchestra.run.smithi039.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-11-28T11:38:58.898 DEBUG:teuthology.orchestra.run.smithi039:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-11-28T11:38:58.928 DEBUG:teuthology.orchestra.run.smithi039:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-11-28T11:38:58.943 DEBUG:teuthology.orchestra.run.smithi039:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-11-28T11:39:51.066 INFO:teuthology.orchestra.run.smithi184.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-11-28T11:39:51.067 INFO:teuthology.orchestra.run.smithi184.stderr: * [new branch] main -> origin/main 2023-11-28T11:39:51.127 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20190312 -> 20190312 2023-11-28T11:39:51.127 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20190416 -> 20190416 2023-11-28T11:39:51.127 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20190514 -> 20190514 2023-11-28T11:39:51.127 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20190618 -> 20190618 2023-11-28T11:39:51.127 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20190717 -> 20190717 2023-11-28T11:39:51.127 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20190815 -> 20190815 2023-11-28T11:39:51.127 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20190923 -> 20190923 2023-11-28T11:39:51.128 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20191022 -> 20191022 2023-11-28T11:39:51.128 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20191215 -> 20191215 2023-11-28T11:39:51.128 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20200122 -> 20200122 2023-11-28T11:39:51.128 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20200316 -> 20200316 2023-11-28T11:39:51.128 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20200421 -> 20200421 2023-11-28T11:39:51.128 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20200519 -> 20200519 2023-11-28T11:39:51.128 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20200619 -> 20200619 2023-11-28T11:39:51.128 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20200721 -> 20200721 2023-11-28T11:39:51.128 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20200817 -> 20200817 2023-11-28T11:39:51.128 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20200918 -> 20200918 2023-11-28T11:39:51.128 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20201022 -> 20201022 2023-11-28T11:39:51.128 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20201118 -> 20201118 2023-11-28T11:39:51.129 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20201218 -> 20201218 2023-11-28T11:39:51.129 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20210208 -> 20210208 2023-11-28T11:39:51.129 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20210315 -> 20210315 2023-11-28T11:39:51.129 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20210511 -> 20210511 2023-11-28T11:39:51.129 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20210716 -> 20210716 2023-11-28T11:39:51.129 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20210818 -> 20210818 2023-11-28T11:39:51.131 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20210919 -> 20210919 2023-11-28T11:39:51.131 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20211027 -> 20211027 2023-11-28T11:39:51.131 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20211216 -> 20211216 2023-11-28T11:39:51.132 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20220209 -> 20220209 2023-11-28T11:39:51.132 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20220310 -> 20220310 2023-11-28T11:39:51.132 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20220411 -> 20220411 2023-11-28T11:39:51.132 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20220509 -> 20220509 2023-11-28T11:39:51.132 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20220610 -> 20220610 2023-11-28T11:39:51.132 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20220708 -> 20220708 2023-11-28T11:39:51.132 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20220815 -> 20220815 2023-11-28T11:39:51.132 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20220913 -> 20220913 2023-11-28T11:39:51.132 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20221012 -> 20221012 2023-11-28T11:39:51.132 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20221109 -> 20221109 2023-11-28T11:39:51.132 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20221214 -> 20221214 2023-11-28T11:39:51.132 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20230117 -> 20230117 2023-11-28T11:39:51.133 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20230210 -> 20230210 2023-11-28T11:39:51.133 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20230310 -> 20230310 2023-11-28T11:39:51.133 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20230404 -> 20230404 2023-11-28T11:39:51.133 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20230515 -> 20230515 2023-11-28T11:39:51.133 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20230625 -> 20230625 2023-11-28T11:39:51.133 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20230804 -> 20230804 2023-11-28T11:39:51.133 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20230919 -> 20230919 2023-11-28T11:39:51.133 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20231030 -> 20231030 2023-11-28T11:39:51.133 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20231111 -> 20231111 2023-11-28T11:39:55.050 INFO:teuthology.orchestra.run.smithi039.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-11-28T11:39:55.050 INFO:teuthology.orchestra.run.smithi039.stderr: * [new branch] main -> origin/main 2023-11-28T11:39:55.078 INFO:teuthology.orchestra.run.smithi184.stderr:Updating files: 51% (1671/3250) Updating files: 52% (1690/3250) Updating files: 53% (1723/3250) Updating files: 54% (1755/3250) Updating files: 55% (1788/3250) Updating files: 56% (1820/3250) Updating files: 57% (1853/3250) Updating files: 58% (1885/3250) Updating files: 59% (1918/3250) Updating files: 60% (1950/3250) Updating files: 61% (1983/3250) Updating files: 62% (2015/3250) Updating files: 63% (2048/3250) Updating files: 64% (2080/3250) Updating files: 65% (2113/3250) Updating files: 65% (2123/3250) Updating files: 66% (2145/3250) Updating files: 67% (2178/3250) Updating files: 68% (2210/3250) Updating files: 69% (2243/3250) Updating files: 70% (2275/3250) Updating files: 71% (2308/3250) Updating files: 72% (2340/3250) Updating files: 73% (2373/3250) Updating files: 74% (2405/3250) Updating files: 75% (2438/3250) Updating files: 76% (2470/3250) Updating files: 77% (2503/3250) Updating files: 78% (2535/3250) Updating files: 79% (2568/3250) Updating files: 80% (2600/3250) Updating files: 81% (2633/3250) Updating files: 81% (2656/3250) Updating files: 82% (2665/3250) Updating files: 83% (2698/3250) Updating files: 84% (2730/3250) Updating files: 85% (2763/3250) Updating files: 86% (2795/3250) Updating files: 87% (2828/3250) Updating files: 88% (2860/3250) Updating files: 89% (2893/3250) Updating files: 90% (2925/3250) Updating files: 91% (2958/3250) Updating files: 92% (2990/3250) Updating files: 93% (3023/3250) Updating files: 94% (3055/3250) Updating files: 95% (3088/3250) Updating files: 96% (3120/3250) Updating files: 97% (3153/3250) Updating files: 98% (3185/3250) Updating files: 99% (3218/3250) Updating files: 100% (3250/3250) Updating files: 100% (3250/3250), done. 2023-11-28T11:39:55.083 INFO:teuthology.orchestra.run.smithi184.stdout:HEAD is now at 4fab4e51 Merge branch 'rdfind-opt' into 'main' 2023-11-28T11:39:55.100 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.1... 2023-11-28T11:39:55.101 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T11:39:55.108 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20190312 -> 20190312 2023-11-28T11:39:55.108 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20190416 -> 20190416 2023-11-28T11:39:55.108 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20190514 -> 20190514 2023-11-28T11:39:55.108 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20190618 -> 20190618 2023-11-28T11:39:55.108 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20190717 -> 20190717 2023-11-28T11:39:55.108 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20190815 -> 20190815 2023-11-28T11:39:55.109 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20190923 -> 20190923 2023-11-28T11:39:55.110 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20191022 -> 20191022 2023-11-28T11:39:55.110 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20191215 -> 20191215 2023-11-28T11:39:55.110 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20200122 -> 20200122 2023-11-28T11:39:55.110 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20200316 -> 20200316 2023-11-28T11:39:55.110 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20200421 -> 20200421 2023-11-28T11:39:55.110 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20200519 -> 20200519 2023-11-28T11:39:55.110 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20200619 -> 20200619 2023-11-28T11:39:55.110 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20200721 -> 20200721 2023-11-28T11:39:55.110 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20200817 -> 20200817 2023-11-28T11:39:55.110 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20200918 -> 20200918 2023-11-28T11:39:55.110 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20201022 -> 20201022 2023-11-28T11:39:55.112 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20201118 -> 20201118 2023-11-28T11:39:55.112 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20201218 -> 20201218 2023-11-28T11:39:55.112 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20210208 -> 20210208 2023-11-28T11:39:55.112 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20210315 -> 20210315 2023-11-28T11:39:55.112 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20210511 -> 20210511 2023-11-28T11:39:55.112 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20210716 -> 20210716 2023-11-28T11:39:55.112 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20210818 -> 20210818 2023-11-28T11:39:55.112 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20210919 -> 20210919 2023-11-28T11:39:55.112 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20211027 -> 20211027 2023-11-28T11:39:55.112 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20211216 -> 20211216 2023-11-28T11:39:55.115 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20220209 -> 20220209 2023-11-28T11:39:55.115 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20220310 -> 20220310 2023-11-28T11:39:55.115 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20220411 -> 20220411 2023-11-28T11:39:55.115 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20220509 -> 20220509 2023-11-28T11:39:55.115 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20220610 -> 20220610 2023-11-28T11:39:55.115 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20220708 -> 20220708 2023-11-28T11:39:55.115 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20220815 -> 20220815 2023-11-28T11:39:55.115 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20220913 -> 20220913 2023-11-28T11:39:55.115 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20221012 -> 20221012 2023-11-28T11:39:55.115 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20221109 -> 20221109 2023-11-28T11:39:55.115 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20221214 -> 20221214 2023-11-28T11:39:55.116 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20230117 -> 20230117 2023-11-28T11:39:55.116 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20230210 -> 20230210 2023-11-28T11:39:55.116 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20230310 -> 20230310 2023-11-28T11:39:55.116 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20230404 -> 20230404 2023-11-28T11:39:55.116 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20230515 -> 20230515 2023-11-28T11:39:55.116 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20230625 -> 20230625 2023-11-28T11:39:55.116 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20230804 -> 20230804 2023-11-28T11:39:55.116 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20230919 -> 20230919 2023-11-28T11:39:55.116 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20231030 -> 20231030 2023-11-28T11:39:55.116 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20231111 -> 20231111 2023-11-28T11:39:55.340 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ 2023-11-28T11:39:55.340 DEBUG:teuthology.orchestra.run.smithi184:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ --input-file=- 2023-11-28T11:39:55.343 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi184.front.sepia.ceph.com to complete... 2023-11-28T11:39:57.129 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28 11:39:56 URL:https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb [38939496/38939496] -> "/tmp/linux-image.deb" [1] 2023-11-28T11:39:57.129 INFO:teuthology.orchestra.run.smithi184.stderr:FINISHED --2023-11-28 11:39:56-- 2023-11-28T11:39:57.130 INFO:teuthology.orchestra.run.smithi184.stderr:Total wall clock time: 1.8s 2023-11-28T11:39:57.130 INFO:teuthology.orchestra.run.smithi184.stderr:Downloaded: 1 files, 37M in 1.6s (23.2 MB/s) 2023-11-28T11:39:57.131 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.1... 2023-11-28T11:39:57.131 DEBUG:teuthology.orchestra.run.smithi184:> sudo dpkg -i /tmp/linux-image.deb 2023-11-28T11:39:57.413 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package linux-image-6.6.0-g8247bbb5b470. 2023-11-28T11:39:59.203 INFO:teuthology.orchestra.run.smithi184.stdout:(Reading database ... 104373 files and directories currently installed.) 2023-11-28T11:39:59.208 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-11-28T11:39:59.260 INFO:teuthology.orchestra.run.smithi039.stderr:Updating files: 49% (1613/3250) Updating files: 50% (1625/3250) Updating files: 51% (1658/3250) Updating files: 52% (1690/3250) Updating files: 53% (1723/3250) Updating files: 54% (1755/3250) Updating files: 55% (1788/3250) Updating files: 56% (1820/3250) Updating files: 57% (1853/3250) Updating files: 58% (1885/3250) Updating files: 59% (1918/3250) Updating files: 60% (1950/3250) Updating files: 61% (1983/3250) Updating files: 62% (2015/3250) Updating files: 63% (2048/3250) Updating files: 64% (2080/3250) Updating files: 64% (2083/3250) Updating files: 65% (2113/3250) Updating files: 66% (2145/3250) Updating files: 67% (2178/3250) Updating files: 68% (2210/3250) Updating files: 69% (2243/3250) Updating files: 70% (2275/3250) Updating files: 71% (2308/3250) Updating files: 72% (2340/3250) Updating files: 73% (2373/3250) Updating files: 74% (2405/3250) Updating files: 75% (2438/3250) Updating files: 76% (2470/3250) Updating files: 77% (2503/3250) Updating files: 78% (2535/3250) Updating files: 79% (2568/3250) Updating files: 80% (2600/3250) Updating files: 81% (2633/3250) Updating files: 81% (2644/3250) Updating files: 82% (2665/3250) Updating files: 83% (2698/3250) Updating files: 84% (2730/3250) Updating files: 85% (2763/3250) Updating files: 86% (2795/3250) Updating files: 87% (2828/3250) Updating files: 88% (2860/3250) Updating files: 89% (2893/3250) Updating files: 90% (2925/3250) Updating files: 91% (2958/3250) Updating files: 92% (2990/3250) Updating files: 93% (3023/3250) Updating files: 94% (3055/3250) Updating files: 95% (3088/3250) Updating files: 95% (3114/3250) Updating files: 96% (3120/3250) Updating files: 97% (3153/3250) Updating files: 98% (3185/3250) Updating files: 99% (3218/3250) Updating files: 100% (3250/3250) Updating files: 100% (3250/3250), done. 2023-11-28T11:39:59.265 INFO:teuthology.orchestra.run.smithi039.stdout:HEAD is now at 4fab4e51 Merge branch 'rdfind-opt' into 'main' 2023-11-28T11:39:59.283 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.0... 2023-11-28T11:39:59.283 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T11:39:59.302 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-28T11:39:59.443 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ 2023-11-28T11:39:59.444 DEBUG:teuthology.orchestra.run.smithi039:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ --input-file=- 2023-11-28T11:39:59.446 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi039.front.sepia.ceph.com to complete... 2023-11-28T11:40:01.254 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28 11:40:01 URL:https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb [38939496/38939496] -> "/tmp/linux-image.deb" [1] 2023-11-28T11:40:01.255 INFO:teuthology.orchestra.run.smithi039.stderr:FINISHED --2023-11-28 11:40:01-- 2023-11-28T11:40:01.255 INFO:teuthology.orchestra.run.smithi039.stderr:Total wall clock time: 1.8s 2023-11-28T11:40:01.255 INFO:teuthology.orchestra.run.smithi039.stderr:Downloaded: 1 files, 37M in 1.6s (23.4 MB/s) 2023-11-28T11:40:01.256 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.0... 2023-11-28T11:40:01.256 DEBUG:teuthology.orchestra.run.smithi039:> sudo dpkg -i /tmp/linux-image.deb 2023-11-28T11:40:01.537 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package linux-image-6.6.0-g8247bbb5b470. 2023-11-28T11:40:02.257 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-28T11:40:02.369 INFO:teuthology.orchestra.run.smithi184.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T11:40:03.282 INFO:teuthology.orchestra.run.smithi039.stdout:(Reading database ... 104373 files and directories currently installed.) 2023-11-28T11:40:03.287 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-11-28T11:40:03.426 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-28T11:40:06.231 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-28T11:40:06.354 INFO:teuthology.orchestra.run.smithi039.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T11:40:28.384 INFO:teuthology.orchestra.run.smithi184.stderr:Sourcing file `/etc/default/grub' 2023-11-28T11:40:28.396 INFO:teuthology.orchestra.run.smithi184.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-28T11:40:28.415 INFO:teuthology.orchestra.run.smithi184.stderr:Generating grub configuration file ... 2023-11-28T11:40:28.729 INFO:teuthology.orchestra.run.smithi184.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T11:40:28.754 INFO:teuthology.orchestra.run.smithi184.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T11:40:29.121 INFO:teuthology.orchestra.run.smithi184.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-11-28T11:40:29.135 INFO:teuthology.orchestra.run.smithi184.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-11-28T11:40:31.547 INFO:teuthology.orchestra.run.smithi184.stderr:done 2023-11-28T11:40:31.722 DEBUG:teuthology.orchestra.run.smithi184:> dpkg-deb -c /tmp/linux-image.deb 2023-11-28T11:40:31.731 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./ 2023-11-28T11:40:31.732 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./boot/ 2023-11-28T11:40:31.732 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 4415617 2023-11-23 04:11 ./boot/System.map-6.6.0-g8247bbb5b470 2023-11-28T11:40:31.745 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 169214 2023-11-23 04:11 ./boot/config-6.6.0-g8247bbb5b470 2023-11-28T11:40:31.746 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11352832 2023-11-23 04:11 ./boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T11:40:31.772 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./etc/ 2023-11-28T11:40:31.773 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./etc/kernel/ 2023-11-28T11:40:31.773 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./etc/kernel/postinst.d/ 2023-11-28T11:40:31.773 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./etc/kernel/postrm.d/ 2023-11-28T11:40:31.773 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./etc/kernel/preinst.d/ 2023-11-28T11:40:31.773 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./etc/kernel/prerm.d/ 2023-11-28T11:40:31.774 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/ 2023-11-28T11:40:31.774 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/ 2023-11-28T11:40:31.775 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/ 2023-11-28T11:40:31.775 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/ 2023-11-28T11:40:31.775 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/ 2023-11-28T11:40:31.775 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/ 2023-11-28T11:40:31.775 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ 2023-11-28T11:40:31.775 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 490233 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/aesni-intel.ko 2023-11-28T11:40:31.775 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-28T11:40:31.775 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29529 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-28T11:40:31.775 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30313 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-28T11:40:31.776 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 93113 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-28T11:40:31.776 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 106729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-28T11:40:31.776 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 152241 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-28T11:40:31.776 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12553 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-28T11:40:31.776 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13777 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-28T11:40:31.776 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 83889 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-28T11:40:31.776 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-28T11:40:31.776 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 47225 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-28T11:40:31.776 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 47209 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-28T11:40:31.776 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 51801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-28T11:40:31.776 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 38937 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-28T11:40:31.777 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 40529 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-28T11:40:31.777 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 58585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-28T11:40:31.777 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 50497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-28T11:40:31.777 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 32065 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-28T11:40:31.777 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-28T11:40:31.777 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/ 2023-11-28T11:40:31.777 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/ 2023-11-28T11:40:31.777 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/ 2023-11-28T11:40:31.777 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 40113 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-28T11:40:31.777 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13353 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpuid.ko 2023-11-28T11:40:31.777 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17937 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/msr.ko 2023-11-28T11:40:31.777 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/ 2023-11-28T11:40:31.777 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 354433 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-28T11:40:31.778 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 881625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-28T11:40:31.778 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 2275865 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-11-28T11:40:31.854 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ 2023-11-28T11:40:31.854 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 53697 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/af_alg.ko 2023-11-28T11:40:31.854 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23097 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_hash.ko 2023-11-28T11:40:31.854 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_skcipher.ko 2023-11-28T11:40:31.854 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17209 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-11-28T11:40:31.854 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19641 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-11-28T11:40:31.854 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10145 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-11-28T11:40:31.854 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/ 2023-11-28T11:40:31.854 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10185 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-11-28T11:40:31.855 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/ 2023-11-28T11:40:31.855 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11249 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-11-28T11:40:31.855 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19473 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-11-28T11:40:31.855 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21561 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-28T11:40:31.855 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-11-28T11:40:31.855 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17745 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-11-28T11:40:31.855 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17921 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-11-28T11:40:31.855 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20489 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-11-28T11:40:31.855 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22577 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-11-28T11:40:31.855 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-11-28T11:40:31.855 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-11-28T11:40:31.855 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-11-28T11:40:31.856 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 38809 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-11-28T11:40:31.856 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-11-28T11:40:31.856 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17745 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-11-28T11:40:31.856 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-11-28T11:40:31.856 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 35097 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-11-28T11:40:31.856 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14769 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-11-28T11:40:31.856 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-11-28T11:40:31.856 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 47505 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cryptd.ko 2023-11-28T11:40:31.856 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 39505 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-11-28T11:40:31.856 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26953 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_simd.ko 2023-11-28T11:40:31.856 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-11-28T11:40:31.857 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-11-28T11:40:31.857 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10913 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-11-28T11:40:31.857 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15681 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-11-28T11:40:31.857 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11001 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-11-28T11:40:31.857 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-11-28T11:40:31.857 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17993 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-11-28T11:40:31.857 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26897 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-11-28T11:40:31.857 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15649 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lrw.ko 2023-11-28T11:40:31.857 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11513 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-11-28T11:40:31.857 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11529 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-11-28T11:40:31.857 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11697 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-11-28T11:40:31.857 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-11-28T11:40:31.858 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10673 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-11-28T11:40:31.858 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18745 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-11-28T11:40:31.858 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16049 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-11-28T11:40:31.858 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29393 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-11-28T11:40:31.858 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27081 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-11-28T11:40:31.858 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 149193 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-11-28T11:40:31.858 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10881 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-11-28T11:40:31.858 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28777 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-11-28T11:40:31.858 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13169 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-11-28T11:40:31.858 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17401 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-11-28T11:40:31.858 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 36185 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-11-28T11:40:31.859 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14105 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-11-28T11:40:31.859 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26665 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-11-28T11:40:31.859 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18713 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xts.ko 2023-11-28T11:40:31.859 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9481 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-11-28T11:40:31.859 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ 2023-11-28T11:40:31.859 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ 2023-11-28T11:40:31.859 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18249 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_extlog.ko 2023-11-28T11:40:31.859 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-28T11:40:31.859 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28793 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-11-28T11:40:31.859 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/ 2023-11-28T11:40:31.860 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 31241 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/einj.ko 2023-11-28T11:40:31.860 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-11-28T11:40:31.860 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14937 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-11-28T11:40:31.860 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24401 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-11-28T11:40:31.860 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-11-28T11:40:31.860 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 103025 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-11-28T11:40:31.860 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ 2023-11-28T11:40:31.860 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21601 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-11-28T11:40:31.860 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 88865 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci.ko 2023-11-28T11:40:31.860 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-11-28T11:40:31.861 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 88289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci.ko 2023-11-28T11:40:31.861 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-11-28T11:40:31.861 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17137 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-11-28T11:40:31.861 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30433 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-11-28T11:40:31.861 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33505 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-11-28T11:40:31.861 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21265 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-11-28T11:40:31.861 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21121 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-11-28T11:40:31.861 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24945 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-11-28T11:40:31.861 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17657 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-11-28T11:40:31.861 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25185 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-11-28T11:40:31.861 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15049 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-11-28T11:40:31.861 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17849 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-11-28T11:40:31.862 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21945 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-11-28T11:40:31.862 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33977 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-11-28T11:40:31.862 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23129 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-28T11:40:31.862 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16921 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-28T11:40:31.862 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16993 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-11-28T11:40:31.862 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 35273 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-11-28T11:40:31.862 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12889 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-11-28T11:40:31.862 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 51481 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_legacy.ko 2023-11-28T11:40:31.862 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15185 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-11-28T11:40:31.862 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16281 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-11-28T11:40:31.862 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12833 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-11-28T11:40:31.862 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-11-28T11:40:31.863 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15105 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-11-28T11:40:31.863 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17361 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-11-28T11:40:31.863 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16569 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-11-28T11:40:31.863 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15377 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-11-28T11:40:31.863 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20681 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-11-28T11:40:31.863 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 32585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-11-28T11:40:31.863 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 37793 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-28T11:40:31.863 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20561 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-28T11:40:31.863 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14225 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-11-28T11:40:31.863 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_radisys.ko 2023-11-28T11:40:31.863 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-11-28T11:40:31.863 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rz1000.ko 2023-11-28T11:40:31.864 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13937 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-11-28T11:40:31.864 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23097 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-11-28T11:40:31.864 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23457 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-11-28T11:40:31.864 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19697 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-11-28T11:40:31.864 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16009 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-11-28T11:40:31.864 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30433 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-11-28T11:40:31.864 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22793 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-11-28T11:40:31.864 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29121 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-11-28T11:40:31.864 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 83345 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-11-28T11:40:31.864 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 70393 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-11-28T11:40:31.864 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 37377 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-11-28T11:40:31.864 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23041 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-11-28T11:40:31.865 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29273 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-11-28T11:40:31.865 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 38337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-11-28T11:40:31.865 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17945 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-11-28T11:40:31.865 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20441 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-11-28T11:40:31.865 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 44793 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-11-28T11:40:31.865 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15601 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-11-28T11:40:31.865 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 35065 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-11-28T11:40:31.865 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20065 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-11-28T11:40:31.865 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ 2023-11-28T11:40:31.866 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-11-28T11:40:31.866 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/ 2023-11-28T11:40:31.866 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 124473 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-11-28T11:40:31.866 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/ 2023-11-28T11:40:31.866 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/ 2023-11-28T11:40:31.866 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 113665 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-11-28T11:40:31.866 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/ 2023-11-28T11:40:31.866 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 965585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-11-28T11:40:31.866 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 173225 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-11-28T11:40:31.866 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/ 2023-11-28T11:40:31.867 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 94297 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-28T11:40:31.867 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 115793 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-11-28T11:40:31.867 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/ 2023-11-28T11:40:31.867 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 110385 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-11-28T11:40:31.867 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 98193 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-11-28T11:40:31.867 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 263769 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-11-28T11:40:31.867 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/ 2023-11-28T11:40:31.867 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 98145 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-28T11:40:31.867 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/ 2023-11-28T11:40:31.867 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 60217 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-11-28T11:40:31.867 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ 2023-11-28T11:40:31.868 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30705 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/applicom.ko 2023-11-28T11:40:31.868 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12009 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-11-28T11:40:31.868 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/ 2023-11-28T11:40:31.868 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13889 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-28T11:40:31.868 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18809 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-28T11:40:31.868 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13169 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-28T11:40:31.868 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10673 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-11-28T11:40:31.868 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15633 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-28T11:40:31.869 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ 2023-11-28T11:40:31.869 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30713 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-28T11:40:31.869 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 148601 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-28T11:40:31.869 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26569 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-28T11:40:31.869 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 139313 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-28T11:40:31.869 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 70921 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-28T11:40:31.869 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 53513 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-28T11:40:31.869 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 36321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-11-28T11:40:31.869 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/ 2023-11-28T11:40:31.869 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 84097 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-11-28T11:40:31.870 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25873 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/nvram.ko 2023-11-28T11:40:31.870 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 32169 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-11-28T11:40:31.870 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 51113 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-11-28T11:40:31.870 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/ 2023-11-28T11:40:31.870 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16401 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-28T11:40:31.870 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15881 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-11-28T11:40:31.870 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23473 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-11-28T11:40:31.870 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 32985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-11-28T11:40:31.870 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30121 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-28T11:40:31.871 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22697 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-28T11:40:31.871 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23561 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-11-28T11:40:31.871 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/ 2023-11-28T11:40:31.871 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17001 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_class.ko 2023-11-28T11:40:31.871 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 50945 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_core.ko 2023-11-28T11:40:31.871 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12393 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-11-28T11:40:31.871 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/ 2023-11-28T11:40:31.871 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12489 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-palmas.ko 2023-11-28T11:40:31.871 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 47849 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-si5351.ko 2023-11-28T11:40:31.871 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11457 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-twl6040.ko 2023-11-28T11:40:31.871 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19249 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-wm831x.ko 2023-11-28T11:40:31.871 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/ 2023-11-28T11:40:31.872 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10097 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-28T11:40:31.872 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16833 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-28T11:40:31.872 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25297 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-28T11:40:31.872 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ 2023-11-28T11:40:31.872 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ 2023-11-28T11:40:31.872 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 70801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-28T11:40:31.872 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 243025 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-11-28T11:40:31.872 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/ 2023-11-28T11:40:31.872 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/ 2023-11-28T11:40:31.873 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/ 2023-11-28T11:40:31.873 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 438761 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-28T11:40:31.873 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-11-28T11:40:31.873 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24081 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-28T11:40:31.873 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19937 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-11-28T11:40:31.873 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-11-28T11:40:31.873 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/ 2023-11-28T11:40:31.873 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 70273 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-28T11:40:31.873 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/ 2023-11-28T11:40:31.873 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29785 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-11-28T11:40:31.874 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ 2023-11-28T11:40:31.874 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/ 2023-11-28T11:40:31.874 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15857 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-28T11:40:31.874 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ 2023-11-28T11:40:31.874 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 122569 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-28T11:40:31.874 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ 2023-11-28T11:40:31.874 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 79953 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-11-28T11:40:31.874 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 35769 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-11-28T11:40:31.875 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 63617 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-11-28T11:40:31.875 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18105 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-11-28T11:40:31.875 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18065 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-11-28T11:40:31.875 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-11-28T11:40:31.875 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25657 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-11-28T11:40:31.875 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24913 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-11-28T11:40:31.875 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 52041 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-11-28T11:40:31.875 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18433 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-11-28T11:40:31.876 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20017 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-11-28T11:40:31.876 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 56825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-11-28T11:40:31.876 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17529 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-11-28T11:40:31.876 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/ 2023-11-28T11:40:31.876 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12673 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-gpio.ko 2023-11-28T11:40:31.876 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27185 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max14577.ko 2023-11-28T11:40:31.876 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29569 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max77693.ko 2023-11-28T11:40:31.876 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24745 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max8997.ko 2023-11-28T11:40:31.877 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-palmas.ko 2023-11-28T11:40:31.877 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23713 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-rt8973a.ko 2023-11-28T11:40:31.877 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27785 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-sm5502.ko 2023-11-28T11:40:31.877 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/ 2023-11-28T11:40:31.877 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34977 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/dmi-sysfs.ko 2023-11-28T11:40:31.877 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/ 2023-11-28T11:40:31.877 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/efi-pstore.ko 2023-11-28T11:40:31.877 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-28T11:40:31.878 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/ 2023-11-28T11:40:31.878 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12305 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-adp5520.ko 2023-11-28T11:40:31.878 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20153 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-amd8111.ko 2023-11-28T11:40:31.878 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14993 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-arizona.ko 2023-11-28T11:40:31.878 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13841 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9052.ko 2023-11-28T11:40:31.878 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11921 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9055.ko 2023-11-28T11:40:31.879 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22065 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-dln2.ko 2023-11-28T11:40:31.879 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 77849 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-f7188x.ko 2023-11-28T11:40:31.879 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28937 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-generic.ko 2023-11-28T11:40:31.879 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19569 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-11-28T11:40:31.879 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11905 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-11-28T11:40:31.879 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14113 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-kempld.ko 2023-11-28T11:40:31.879 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-lp3943.ko 2023-11-28T11:40:31.879 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9505 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max7300.ko 2023-11-28T11:40:31.879 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11905 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max730x.ko 2023-11-28T11:40:31.879 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max732x.ko 2023-11-28T11:40:31.880 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25145 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-11-28T11:40:31.880 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 47073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pca953x.ko 2023-11-28T11:40:31.880 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pcf857x.ko 2023-11-28T11:40:31.880 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14377 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-rdc321x.ko 2023-11-28T11:40:31.880 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20593 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch.ko 2023-11-28T11:40:31.880 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19505 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch311x.ko 2023-11-28T11:40:31.880 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12145 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-tps65912.ko 2023-11-28T11:40:31.880 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21057 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl4030.ko 2023-11-28T11:40:31.880 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl6040.ko 2023-11-28T11:40:31.880 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20601 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-28T11:40:31.880 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15377 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-vx855.ko 2023-11-28T11:40:31.881 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16281 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm831x.ko 2023-11-28T11:40:31.881 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11617 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8350.ko 2023-11-28T11:40:31.881 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16753 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8994.ko 2023-11-28T11:40:31.881 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/ 2023-11-28T11:40:31.881 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11577 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-a4tech.ko 2023-11-28T11:40:31.881 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 39169 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-apple.ko 2023-11-28T11:40:31.881 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14481 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-11-28T11:40:31.881 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8353 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-11-28T11:40:31.881 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15169 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-11-28T11:40:31.881 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11049 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-belkin.ko 2023-11-28T11:40:31.881 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10313 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cherry.ko 2023-11-28T11:40:31.881 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16041 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-chicony.ko 2023-11-28T11:40:31.882 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 60649 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cp2112.ko 2023-11-28T11:40:31.882 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11049 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cypress.ko 2023-11-28T11:40:31.882 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16385 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-11-28T11:40:31.882 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10697 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-11-28T11:40:31.882 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17665 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-11-28T11:40:31.882 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13457 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-11-28T11:40:31.882 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10105 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ezkey.ko 2023-11-28T11:40:31.882 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14305 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-11-28T11:40:31.882 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9225 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-generic.ko 2023-11-28T11:40:31.882 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17129 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-11-28T11:40:31.882 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12681 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-11-28T11:40:31.883 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10161 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-28T11:40:31.883 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10457 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-28T11:40:31.883 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-11-28T11:40:31.883 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19105 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-11-28T11:40:31.883 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10489 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-11-28T11:40:31.883 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9241 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kensington.ko 2023-11-28T11:40:31.883 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8545 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-11-28T11:40:31.883 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17201 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-11-28T11:40:31.883 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10809 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-11-28T11:40:31.883 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-11-28T11:40:31.884 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 42297 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-11-28T11:40:31.884 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30697 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lg-g15.ko 2023-11-28T11:40:31.884 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 58185 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-28T11:40:31.884 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 101481 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-28T11:40:31.884 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 80993 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech.ko 2023-11-28T11:40:31.884 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-magicmouse.ko 2023-11-28T11:40:31.884 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21969 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-microsoft.ko 2023-11-28T11:40:31.884 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10361 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-monterey.ko 2023-11-28T11:40:31.884 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 50161 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-11-28T11:40:31.884 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 32593 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ntrig.ko 2023-11-28T11:40:31.885 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8857 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-11-28T11:40:31.885 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9121 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-11-28T11:40:31.885 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-11-28T11:40:31.885 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 72937 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-11-28T11:40:31.885 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14225 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-11-28T11:40:31.885 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15105 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-11-28T11:40:31.885 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8417 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-11-28T11:40:31.885 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 35393 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-11-28T11:40:31.885 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20833 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-28T11:40:31.885 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14065 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-11-28T11:40:31.885 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 31425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-28T11:40:31.886 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-28T11:40:31.886 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 31129 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-28T11:40:31.886 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21137 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-28T11:40:31.886 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29489 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-28T11:40:31.886 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13305 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-28T11:40:31.886 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29313 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-28T11:40:31.886 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27937 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-28T11:40:31.886 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-28T11:40:31.886 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-11-28T11:40:31.886 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13681 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-11-28T11:40:31.887 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15193 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-11-28T11:40:31.887 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 36817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-28T11:40:31.887 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13601 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-11-28T11:40:31.887 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 51249 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-11-28T11:40:31.887 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8313 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-11-28T11:40:31.887 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25297 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-11-28T11:40:31.887 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-11-28T11:40:31.887 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16993 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-28T11:40:31.887 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-11-28T11:40:31.888 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15089 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-11-28T11:40:31.888 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14385 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-11-28T11:40:31.888 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16473 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-11-28T11:40:31.888 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 71073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-11-28T11:40:31.888 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10921 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-11-28T11:40:31.888 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 143473 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-11-28T11:40:31.888 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8153 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-11-28T11:40:31.888 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-11-28T11:40:31.888 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16665 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-11-28T11:40:31.888 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 267825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid.ko 2023-11-28T11:40:31.889 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 32321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-11-28T11:40:31.889 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/ 2023-11-28T11:40:31.889 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 125721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbhid.ko 2023-11-28T11:40:31.889 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19137 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbkbd.ko 2023-11-28T11:40:31.889 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14953 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbmouse.ko 2023-11-28T11:40:31.889 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 217873 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-11-28T11:40:31.889 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/ 2023-11-28T11:40:31.889 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 64201 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-11-28T11:40:31.889 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 89625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-11-28T11:40:31.889 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 305465 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-11-28T11:40:31.889 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ 2023-11-28T11:40:31.889 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 66521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-11-28T11:40:31.890 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 61393 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-11-28T11:40:31.890 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34745 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-28T11:40:31.890 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17505 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-11-28T11:40:31.890 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19313 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-11-28T11:40:31.890 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25257 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-11-28T11:40:31.890 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 31729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-11-28T11:40:31.890 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 97977 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-11-28T11:40:31.890 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19745 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-11-28T11:40:31.890 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 45553 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-11-28T11:40:31.890 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-11-28T11:40:31.890 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14769 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-11-28T11:40:31.890 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10769 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-11-28T11:40:31.891 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22049 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-11-28T11:40:31.891 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 74433 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-11-28T11:40:31.891 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 39585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-11-28T11:40:31.891 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 67929 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-11-28T11:40:31.891 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-11-28T11:40:31.891 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 39073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-11-28T11:40:31.891 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 55201 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-11-28T11:40:31.891 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 49913 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-11-28T11:40:31.891 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 58617 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-11-28T11:40:31.891 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 40825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-28T11:40:31.891 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17225 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-11-28T11:40:31.891 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28281 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-11-28T11:40:31.891 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24593 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9052-hwmon.ko 2023-11-28T11:40:31.892 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17265 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9055-hwmon.ko 2023-11-28T11:40:31.892 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 44465 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-28T11:40:31.892 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 99601 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-11-28T11:40:31.892 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19489 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-11-28T11:40:31.892 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-11-28T11:40:31.892 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29777 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-11-28T11:40:31.892 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33185 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc2103.ko 2023-11-28T11:40:31.892 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-11-28T11:40:31.892 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 66985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-11-28T11:40:31.892 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 94457 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-11-28T11:40:31.892 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 41401 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-11-28T11:40:31.892 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21305 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-11-28T11:40:31.892 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 55449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-11-28T11:40:31.893 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14481 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-11-28T11:40:31.893 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24017 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-11-28T11:40:31.893 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 46801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-11-28T11:40:31.893 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 45529 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-11-28T11:40:31.893 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13273 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hih6130.ko 2023-11-28T11:40:31.893 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9745 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-28T11:40:31.893 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11553 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-11-28T11:40:31.893 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22601 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-11-28T11:40:31.893 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34529 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-11-28T11:40:31.893 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21257 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-11-28T11:40:31.893 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24873 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-11-28T11:40:31.893 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13401 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-11-28T11:40:31.893 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 130449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-11-28T11:40:31.894 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18841 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/jc42.ko 2023-11-28T11:40:31.894 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-11-28T11:40:31.894 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13553 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-11-28T11:40:31.894 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18929 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-11-28T11:40:31.894 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 48601 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-11-28T11:40:31.894 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16697 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-11-28T11:40:31.894 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 36777 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-11-28T11:40:31.894 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-11-28T11:40:31.894 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34593 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-11-28T11:40:31.894 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 31745 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-11-28T11:40:31.894 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16889 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-11-28T11:40:31.894 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 72833 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-11-28T11:40:31.895 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 46153 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-11-28T11:40:31.895 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 37913 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-11-28T11:40:31.895 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19745 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-11-28T11:40:31.895 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 108841 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-11-28T11:40:31.895 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33393 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-11-28T11:40:31.895 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16201 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-11-28T11:40:31.895 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18113 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-11-28T11:40:31.895 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24017 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-11-28T11:40:31.895 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13793 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-11-28T11:40:31.895 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15193 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-11-28T11:40:31.895 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14889 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-11-28T11:40:31.895 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-11-28T11:40:31.895 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13249 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-11-28T11:40:31.896 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14993 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-11-28T11:40:31.896 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33489 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-11-28T11:40:31.896 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18433 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-11-28T11:40:31.896 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24353 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-11-28T11:40:31.896 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19969 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-11-28T11:40:31.896 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27129 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-11-28T11:40:31.896 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-11-28T11:40:31.896 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 35777 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-11-28T11:40:31.896 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mc13783-adc.ko 2023-11-28T11:40:31.896 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-11-28T11:40:31.896 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15937 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-11-28T11:40:31.896 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 44129 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-11-28T11:40:31.897 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 119817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-11-28T11:40:31.897 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 60705 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-11-28T11:40:31.897 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 59737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-11-28T11:40:31.897 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 82337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-11-28T11:40:31.897 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 54433 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-11-28T11:40:31.897 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18473 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-11-28T11:40:31.897 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ 2023-11-28T11:40:31.897 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21353 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-28T11:40:31.897 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17065 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-28T11:40:31.897 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-28T11:40:31.897 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9577 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-28T11:40:31.897 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17657 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-28T11:40:31.897 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10169 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-28T11:40:31.898 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15505 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-28T11:40:31.898 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 82577 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-28T11:40:31.898 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-28T11:40:31.898 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-28T11:40:31.898 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-28T11:40:31.898 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20681 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-28T11:40:31.898 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13017 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-11-28T11:40:31.898 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18705 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-11-28T11:40:31.898 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-11-28T11:40:31.898 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27145 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-28T11:40:31.898 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 32137 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-11-28T11:40:31.899 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13505 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-11-28T11:40:31.899 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16833 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-11-28T11:40:31.899 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 40105 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-11-28T11:40:31.899 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19577 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-11-28T11:40:31.899 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 39193 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-11-28T11:40:31.899 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 37385 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-11-28T11:40:31.899 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26553 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-11-28T11:40:31.899 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17057 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-11-28T11:40:31.899 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14097 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-11-28T11:40:31.899 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21257 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-11-28T11:40:31.900 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-11-28T11:40:31.900 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-11-28T11:40:31.900 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 41945 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-11-28T11:40:31.900 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 52457 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-11-28T11:40:31.900 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 51545 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-11-28T11:40:31.900 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 57449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-11-28T11:40:31.900 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 78873 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-11-28T11:40:31.900 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 71345 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-11-28T11:40:31.900 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 63225 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-11-28T11:40:31.900 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 71321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-11-28T11:40:31.901 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 101473 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-11-28T11:40:31.901 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 119505 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-11-28T11:40:31.901 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17313 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-11-28T11:40:31.901 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 35625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-11-28T11:40:31.901 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-11-28T11:40:31.901 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-11-28T11:40:31.901 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/ 2023-11-28T11:40:31.901 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/ 2023-11-28T11:40:31.901 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20049 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-28T11:40:31.901 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19345 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-28T11:40:31.902 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/ 2023-11-28T11:40:31.902 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27969 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-11-28T11:40:31.902 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-11-28T11:40:31.902 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27777 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-11-28T11:40:31.902 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17937 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-28T11:40:31.902 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26193 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-28T11:40:31.902 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16201 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-28T11:40:31.902 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15153 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-11-28T11:40:31.902 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 6929 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-28T11:40:31.902 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13961 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-11-28T11:40:31.902 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 50201 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-28T11:40:31.903 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23905 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-28T11:40:31.903 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20001 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-28T11:40:31.903 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-28T11:40:31.903 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-11-28T11:40:31.903 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-11-28T11:40:31.903 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 62817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-28T11:40:31.903 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22433 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-28T11:40:31.903 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 47889 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-28T11:40:31.903 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-11-28T11:40:31.903 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17881 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-28T11:40:31.904 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-28T11:40:31.904 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26265 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-11-28T11:40:31.904 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25145 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-28T11:40:31.904 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-28T11:40:31.904 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 47241 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-28T11:40:31.904 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-11-28T11:40:31.904 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18649 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-28T11:40:31.904 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11809 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-28T11:40:31.904 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22313 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-11-28T11:40:31.904 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29361 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-11-28T11:40:31.905 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-28T11:40:31.905 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19241 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-11-28T11:40:31.905 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19809 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-28T11:40:31.905 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-28T11:40:31.905 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26081 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-28T11:40:31.905 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19041 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-28T11:40:31.905 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 47657 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-11-28T11:40:31.905 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-11-28T11:40:31.905 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-11-28T11:40:31.905 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-11-28T11:40:31.906 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/ 2023-11-28T11:40:31.906 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14921 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-11-28T11:40:31.906 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13457 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-11-28T11:40:31.906 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-11-28T11:40:31.906 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ 2023-11-28T11:40:31.906 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ 2023-11-28T11:40:31.906 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 273609 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-28T11:40:31.906 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 879969 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-11-28T11:40:31.906 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 69273 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-28T11:40:31.907 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 324217 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-28T11:40:31.907 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 97985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-28T11:40:31.907 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 282273 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-28T11:40:31.907 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 66201 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-28T11:40:31.907 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ 2023-11-28T11:40:31.907 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/ 2023-11-28T11:40:31.907 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 493073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-28T11:40:31.907 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/ 2023-11-28T11:40:31.907 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 419737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-28T11:40:31.907 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/ 2023-11-28T11:40:31.908 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 739025 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-28T11:40:31.908 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ 2023-11-28T11:40:31.908 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 296625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-28T11:40:31.908 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ 2023-11-28T11:40:31.908 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 153697 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-11-28T11:40:31.908 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/ 2023-11-28T11:40:31.908 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 168969 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-11-28T11:40:31.908 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ 2023-11-28T11:40:31.908 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ 2023-11-28T11:40:31.908 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 263081 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-28T11:40:31.908 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ 2023-11-28T11:40:31.908 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 100241 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-28T11:40:31.909 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ 2023-11-28T11:40:31.909 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 111425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-28T11:40:31.909 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ 2023-11-28T11:40:31.909 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 128753 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-28T11:40:31.909 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ 2023-11-28T11:40:31.909 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 129529 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-28T11:40:31.909 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ 2023-11-28T11:40:31.909 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10745 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/evbug.ko 2023-11-28T11:40:31.909 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24129 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ff-memless.ko 2023-11-28T11:40:31.909 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/ 2023-11-28T11:40:31.909 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11881 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-28T11:40:31.909 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12145 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-28T11:40:31.910 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 41241 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-11-28T11:40:31.910 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 41801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-11-28T11:40:31.910 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/ 2023-11-28T11:40:31.910 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13313 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-11-28T11:40:31.910 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-11-28T11:40:31.910 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26841 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-11-28T11:40:31.910 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24761 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-11-28T11:40:31.910 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 36665 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-28T11:40:31.910 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-11-28T11:40:31.910 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21257 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lkkbd.ko 2023-11-28T11:40:31.911 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26473 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8323.ko 2023-11-28T11:40:31.911 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14409 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8333.ko 2023-11-28T11:40:31.911 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24265 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-11-28T11:40:31.911 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18217 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-11-28T11:40:31.911 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15929 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-11-28T11:40:31.911 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16489 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-11-28T11:40:31.911 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/newtonkbd.ko 2023-11-28T11:40:31.911 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10673 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-11-28T11:40:31.911 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14161 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt1070.ko 2023-11-28T11:40:31.911 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17929 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt2160.ko 2023-11-28T11:40:31.911 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-11-28T11:40:31.911 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11481 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/stowaway.ko 2023-11-28T11:40:31.912 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/sunkbd.ko 2023-11-28T11:40:31.912 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-11-28T11:40:31.912 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16177 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-11-28T11:40:31.912 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-11-28T11:40:31.912 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11753 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/xtkbd.ko 2023-11-28T11:40:31.912 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11465 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/matrix-keymap.ko 2023-11-28T11:40:31.912 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/ 2023-11-28T11:40:31.912 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-11-28T11:40:31.912 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34177 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-11-28T11:40:31.912 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 123681 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-11-28T11:40:31.912 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 89449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-28T11:40:31.912 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13961 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/gpio_mouse.ko 2023-11-28T11:40:31.913 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 335929 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/psmouse.ko 2023-11-28T11:40:31.913 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14681 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-11-28T11:40:31.913 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23881 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-28T11:40:31.913 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22569 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-28T11:40:31.913 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15665 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-28T11:40:31.913 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/ 2023-11-28T11:40:31.913 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 109873 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-28T11:40:31.913 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ 2023-11-28T11:40:31.913 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11665 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-11-28T11:40:31.913 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-11-28T11:40:31.913 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ct82c710.ko 2023-11-28T11:40:31.914 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16953 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-28T11:40:31.914 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15833 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/parkbd.ko 2023-11-28T11:40:31.914 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13225 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/pcips2.ko 2023-11-28T11:40:31.914 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20153 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ps2mult.ko 2023-11-28T11:40:31.914 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24153 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-11-28T11:40:31.914 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17977 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serport.ko 2023-11-28T11:40:31.914 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-11-28T11:40:31.914 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/ 2023-11-28T11:40:31.914 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/ 2023-11-28T11:40:31.914 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 39289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-28T11:40:31.915 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/ 2023-11-28T11:40:31.915 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-88pm860x.ko 2023-11-28T11:40:31.915 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11385 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-adp5520.ko 2023-11-28T11:40:31.915 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 59753 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-bd2802.ko 2023-11-28T11:40:31.915 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24785 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-11-28T11:40:31.915 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10473 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da903x.ko 2023-11-28T11:40:31.915 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12241 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da9052.ko 2023-11-28T11:40:31.916 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16561 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-gpio.ko 2023-11-28T11:40:31.916 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15793 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-11-28T11:40:31.916 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30505 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3533.ko 2023-11-28T11:40:31.916 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19353 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm355x.ko 2023-11-28T11:40:31.916 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19961 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3642.ko 2023-11-28T11:40:31.916 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16241 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-11-28T11:40:31.916 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11233 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp8788.ko 2023-11-28T11:40:31.916 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14929 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-max8997.ko 2023-11-28T11:40:31.917 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12545 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-mc13783.ko 2023-11-28T11:40:31.917 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13385 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-menf21bmc.ko 2023-11-28T11:40:31.917 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca9532.ko 2023-11-28T11:40:31.917 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20481 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca955x.ko 2023-11-28T11:40:31.917 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17857 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca963x.ko 2023-11-28T11:40:31.917 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34433 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-11-28T11:40:31.917 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24865 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-tca6507.ko 2023-11-28T11:40:31.918 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15665 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm831x-status.ko 2023-11-28T11:40:31.918 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11841 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm8350.ko 2023-11-28T11:40:31.918 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ 2023-11-28T11:40:31.918 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-28T11:40:31.918 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10873 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-28T11:40:31.918 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9089 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-28T11:40:31.918 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7617 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-28T11:40:31.918 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14249 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-28T11:40:31.918 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-28T11:40:31.918 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11889 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-28T11:40:31.919 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-28T11:40:31.919 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/ 2023-11-28T11:40:31.919 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/ 2023-11-28T11:40:31.919 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 654969 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-11-28T11:40:31.919 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 40577 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-11-28T11:40:31.919 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 89601 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bufio.ko 2023-11-28T11:40:31.919 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 47529 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-11-28T11:40:31.919 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 156009 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-11-28T11:40:31.919 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 106897 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-11-28T11:40:31.919 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21545 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-11-28T11:40:31.919 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 53857 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-era.ko 2023-11-28T11:40:31.920 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28465 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-11-28T11:40:31.920 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 41529 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-11-28T11:40:31.920 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 32737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log.ko 2023-11-28T11:40:31.920 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 49545 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-mirror.ko 2023-11-28T11:40:31.920 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 78033 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-11-28T11:40:31.920 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16473 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-11-28T11:40:31.920 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 70825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-11-28T11:40:31.920 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 36297 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-region-hash.ko 2023-11-28T11:40:31.920 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15873 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-11-28T11:40:31.920 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-11-28T11:40:31.920 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 109529 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-snapshot.ko 2023-11-28T11:40:31.920 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19361 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-11-28T11:40:31.921 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 181865 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-11-28T11:40:31.921 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 51737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-11-28T11:40:31.921 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8561 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-zero.ko 2023-11-28T11:40:31.921 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15345 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-11-28T11:40:31.921 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-11-28T11:40:31.921 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 32417 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-11-28T11:40:31.921 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/ 2023-11-28T11:40:31.921 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 199937 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-28T11:40:31.921 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 37337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-11-28T11:40:31.921 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 113073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-11-28T11:40:31.921 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 158681 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-11-28T11:40:31.921 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 395721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-11-28T11:40:31.922 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/ 2023-11-28T11:40:31.922 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/ 2023-11-28T11:40:31.922 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 178137 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-11-28T11:40:31.922 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 63385 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-11-28T11:40:31.922 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 44665 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-11-28T11:40:31.922 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 37225 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-11-28T11:40:31.922 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 123321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-11-28T11:40:31.922 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 79041 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-11-28T11:40:31.922 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 53017 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-11-28T11:40:31.922 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ 2023-11-28T11:40:31.922 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17305 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm800.ko 2023-11-28T11:40:31.923 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12761 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm805.ko 2023-11-28T11:40:31.923 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11193 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm80x.ko 2023-11-28T11:40:31.923 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11865 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona-i2c.ko 2023-11-28T11:40:31.923 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 123721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona.ko 2023-11-28T11:40:31.923 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11961 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/bcm590xx.ko 2023-11-28T11:40:31.923 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17465 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/cros_ec_dev.ko 2023-11-28T11:40:31.923 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34961 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/dln2.ko 2023-11-28T11:40:31.923 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16689 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/janz-cmodio.ko 2023-11-28T11:40:31.923 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 53585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/kempld-core.ko 2023-11-28T11:40:31.923 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27529 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-core.ko 2023-11-28T11:40:31.923 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14993 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-11-28T11:40:31.923 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13009 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lp3943.ko 2023-11-28T11:40:31.923 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 54569 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-11-28T11:40:31.924 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12113 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-11-28T11:40:31.924 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17409 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/max8907.ko 2023-11-28T11:40:31.924 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29857 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-core.ko 2023-11-28T11:40:31.924 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-11-28T11:40:31.924 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11593 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/menf21bmc.ko 2023-11-28T11:40:31.924 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-adc.ko 2023-11-28T11:40:31.924 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9153 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-gpio.ko 2023-11-28T11:40:31.924 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34873 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633.ko 2023-11-28T11:40:31.924 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10105 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-11-28T11:40:31.924 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/retu-mfd.ko 2023-11-28T11:40:31.924 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 80425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/si476x-core.ko 2023-11-28T11:40:31.924 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 48457 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-11-28T11:40:31.925 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-11-28T11:40:31.925 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 51137 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps65010.ko 2023-11-28T11:40:31.925 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10353 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps6507x.ko 2023-11-28T11:40:31.925 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-11-28T11:40:31.925 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-11-28T11:40:31.925 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17953 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-11-28T11:40:31.925 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 44345 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wm8994.ko 2023-11-28T11:40:31.925 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ 2023-11-28T11:40:31.925 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13833 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-11-28T11:40:31.925 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 48489 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot.ko 2023-11-28T11:40:31.925 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/ 2023-11-28T11:40:31.925 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 46585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-28T11:40:31.926 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18393 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-11-28T11:40:31.926 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 36729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-11-28T11:40:31.926 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 45593 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-11-28T11:40:31.926 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/ 2023-11-28T11:40:31.926 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11145 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-11-28T11:40:31.926 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 35281 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/core.ko 2023-11-28T11:40:31.926 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/ 2023-11-28T11:40:31.926 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25161 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-11-28T11:40:31.926 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ds1682.ko 2023-11-28T11:40:31.926 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8897 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/dummy-irq.ko 2023-11-28T11:40:31.926 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/ 2023-11-28T11:40:31.926 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13657 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/echo.ko 2023-11-28T11:40:31.927 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/ 2023-11-28T11:40:31.927 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 37849 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-11-28T11:40:31.927 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-28T11:40:31.927 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14769 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-28T11:40:31.927 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-11-28T11:40:31.927 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33009 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-11-28T11:40:31.927 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/ 2023-11-28T11:40:31.927 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 152201 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-11-28T11:40:31.927 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14129 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hmc6352.ko 2023-11-28T11:40:31.927 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 31257 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-11-28T11:40:31.927 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ 2023-11-28T11:40:31.928 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 72129 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-11-28T11:40:31.928 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19785 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ics932s401.ko 2023-11-28T11:40:31.928 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21681 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-11-28T11:40:31.928 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15753 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-11-28T11:40:31.928 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/ 2023-11-28T11:40:31.928 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 42513 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-28T11:40:31.928 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13857 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-28T11:40:31.928 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/ 2023-11-28T11:40:31.928 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 125209 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-11-28T11:40:31.928 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 56521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-11-28T11:40:31.928 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 310113 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-11-28T11:40:31.928 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 31329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/phantom.ko 2023-11-28T11:40:31.928 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/ 2023-11-28T11:40:31.929 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 74265 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/st_drv.ko 2023-11-28T11:40:31.929 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24305 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-11-28T11:40:31.929 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28785 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-11-28T11:40:31.929 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-11-28T11:40:31.929 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 48697 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-11-28T11:40:31.929 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/ 2023-11-28T11:40:31.929 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 183609 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-28T11:40:31.929 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ 2023-11-28T11:40:31.929 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/ 2023-11-28T11:40:31.929 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 490129 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-11-28T11:40:31.929 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/ 2023-11-28T11:40:31.929 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/ 2023-11-28T11:40:31.930 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 106033 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-28T11:40:31.930 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 40417 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-28T11:40:31.930 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16041 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-28T11:40:31.930 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/ 2023-11-28T11:40:31.930 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 453737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-28T11:40:31.930 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16929 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-11-28T11:40:31.930 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17961 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-11-28T11:40:31.930 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ 2023-11-28T11:40:31.930 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/ 2023-11-28T11:40:31.930 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 45785 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-28T11:40:31.930 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 42105 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-28T11:40:31.931 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 130553 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-28T11:40:31.931 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 68849 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-28T11:40:31.931 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ 2023-11-28T11:40:31.931 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 37649 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-28T11:40:31.931 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 59689 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-28T11:40:31.931 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27201 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-28T11:40:31.931 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 99049 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-28T11:40:31.931 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/ 2023-11-28T11:40:31.931 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 54521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-28T11:40:31.931 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/ 2023-11-28T11:40:31.931 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 69137 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-28T11:40:31.931 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/ 2023-11-28T11:40:31.932 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 59585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-28T11:40:31.932 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/ 2023-11-28T11:40:31.932 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 41409 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-28T11:40:31.932 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/ 2023-11-28T11:40:31.932 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 54609 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-28T11:40:31.932 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 49289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-28T11:40:31.932 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 87297 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-28T11:40:31.932 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/ 2023-11-28T11:40:31.932 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/ 2023-11-28T11:40:31.932 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 97337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-28T11:40:31.932 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-11-28T11:40:31.932 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 104673 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-28T11:40:31.933 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-11-28T11:40:31.933 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 90257 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-28T11:40:31.933 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/ 2023-11-28T11:40:31.933 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 81569 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-28T11:40:31.933 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 69729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-28T11:40:31.933 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/ 2023-11-28T11:40:31.933 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 78401 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-28T11:40:31.933 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 176761 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-28T11:40:31.933 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-11-28T11:40:31.933 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 1421497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-28T11:40:31.933 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 128569 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-28T11:40:31.933 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/ 2023-11-28T11:40:31.933 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 132089 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-28T11:40:31.934 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 312081 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-28T11:40:31.934 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/ 2023-11-28T11:40:31.934 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/ 2023-11-28T11:40:31.934 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 323513 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-28T11:40:31.934 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/ 2023-11-28T11:40:31.934 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-11-28T11:40:31.934 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 193497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-28T11:40:31.934 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-11-28T11:40:31.934 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 347417 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-28T11:40:31.934 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-11-28T11:40:31.934 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 1044497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-28T11:40:31.934 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-11-28T11:40:31.935 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 166193 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-28T11:40:31.935 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-11-28T11:40:31.935 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34881 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-28T11:40:31.935 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/ 2023-11-28T11:40:31.935 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/ 2023-11-28T11:40:31.935 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 204345 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-28T11:40:31.935 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/ 2023-11-28T11:40:31.935 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/ 2023-11-28T11:40:31.935 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 69449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-28T11:40:31.935 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 61489 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-28T11:40:31.935 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 141225 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-28T11:40:31.935 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 51497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-28T11:40:31.936 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 62817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-28T11:40:31.936 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 31369 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-28T11:40:31.936 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/ 2023-11-28T11:40:31.936 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 60873 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-28T11:40:31.936 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 62833 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-28T11:40:31.936 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 45721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-11-28T11:40:31.936 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25185 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ec_bhf.ko 2023-11-28T11:40:31.936 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/ 2023-11-28T11:40:31.936 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/ 2023-11-28T11:40:31.936 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 281137 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-28T11:40:31.936 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 49457 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-11-28T11:40:31.936 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 51737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-11-28T11:40:31.937 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/ 2023-11-28T11:40:31.937 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 45345 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-11-28T11:40:31.937 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ 2023-11-28T11:40:31.937 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 90465 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-28T11:40:31.937 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/ 2023-11-28T11:40:31.937 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 295577 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-28T11:40:31.937 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/ 2023-11-28T11:40:31.937 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 584497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-28T11:40:31.937 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/ 2023-11-28T11:40:31.937 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 246209 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-28T11:40:32.005 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/ 2023-11-28T11:40:32.005 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 925825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-28T11:40:32.005 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/ 2023-11-28T11:40:32.005 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 302937 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-28T11:40:32.005 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/ 2023-11-28T11:40:32.005 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 514641 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-28T11:40:32.005 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/ 2023-11-28T11:40:32.005 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 93593 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-28T11:40:32.006 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-11-28T11:40:32.006 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 734305 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-28T11:40:32.006 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-11-28T11:40:32.006 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 151769 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-28T11:40:32.006 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 86921 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-11-28T11:40:32.006 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/ 2023-11-28T11:40:32.006 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20977 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-28T11:40:32.006 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 102289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-28T11:40:32.006 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 122649 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-28T11:40:32.006 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/ 2023-11-28T11:40:32.006 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-11-28T11:40:32.007 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 727601 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-28T11:40:32.007 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 278937 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-28T11:40:32.007 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-11-28T11:40:32.007 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-11-28T11:40:32.007 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 1113681 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-28T11:40:32.007 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ 2023-11-28T11:40:32.007 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 53041 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-11-28T11:40:32.007 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 40993 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-11-28T11:40:32.007 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19489 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-11-28T11:40:32.007 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 95665 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-28T11:40:32.008 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/ 2023-11-28T11:40:32.008 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-11-28T11:40:32.008 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 108649 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-28T11:40:32.008 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ 2023-11-28T11:40:32.008 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 73441 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-28T11:40:32.008 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 47777 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-28T11:40:32.008 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/ 2023-11-28T11:40:32.008 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 150905 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-28T11:40:32.008 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/ 2023-11-28T11:40:32.008 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 136721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-28T11:40:32.009 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/ 2023-11-28T11:40:32.009 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 50481 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-28T11:40:32.009 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 43145 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-28T11:40:32.009 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/ 2023-11-28T11:40:32.009 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-11-28T11:40:32.009 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 227897 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-28T11:40:32.009 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 87081 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-28T11:40:32.009 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-11-28T11:40:32.009 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 672049 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-28T11:40:32.009 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/ 2023-11-28T11:40:32.010 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 43017 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-28T11:40:32.010 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/ 2023-11-28T11:40:32.010 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 67385 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-28T11:40:32.010 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 83985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-28T11:40:32.010 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-28T11:40:32.010 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 189801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-28T11:40:32.010 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/ 2023-11-28T11:40:32.010 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-11-28T11:40:32.010 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 104241 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-11-28T11:40:32.010 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/ 2023-11-28T11:40:32.011 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 1052497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-28T11:40:32.011 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/ 2023-11-28T11:40:32.011 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 47097 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-28T11:40:32.011 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/ 2023-11-28T11:40:32.011 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 54817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-28T11:40:32.011 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 63337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-28T11:40:32.011 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/ 2023-11-28T11:40:32.011 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 61537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-28T11:40:32.011 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 67193 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-28T11:40:32.012 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 73409 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-28T11:40:32.012 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 68177 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-28T11:40:32.012 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/ 2023-11-28T11:40:32.012 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-11-28T11:40:32.012 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13441 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-11-28T11:40:32.012 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 39905 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-28T11:40:32.012 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20657 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-11-28T11:40:32.012 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 487025 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-28T11:40:32.013 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/ 2023-11-28T11:40:32.013 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 103337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-28T11:40:32.013 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 166097 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-28T11:40:32.013 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 66329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-28T11:40:32.013 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 78801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-28T11:40:32.013 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/ 2023-11-28T11:40:32.013 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 50057 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-28T11:40:32.013 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/ 2023-11-28T11:40:32.013 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 86529 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-28T11:40:32.013 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/ 2023-11-28T11:40:32.014 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 80273 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-28T11:40:32.014 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 83633 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-28T11:40:32.014 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/ 2023-11-28T11:40:32.014 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 46241 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-28T11:40:32.014 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30849 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-28T11:40:32.014 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/ 2023-11-28T11:40:32.014 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 59993 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-28T11:40:32.014 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/ 2023-11-28T11:40:32.014 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 41001 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/defxx.ko 2023-11-28T11:40:32.015 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/ 2023-11-28T11:40:32.015 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 216985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/skfp.ko 2023-11-28T11:40:32.015 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 77345 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-11-28T11:40:32.015 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/ 2023-11-28T11:40:32.015 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 235521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-28T11:40:32.015 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/ 2023-11-28T11:40:32.015 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18273 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-28T11:40:32.015 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25065 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-11-28T11:40:32.015 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ 2023-11-28T11:40:32.016 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 83769 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-28T11:40:32.016 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 62145 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-11-28T11:40:32.016 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15865 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-11-28T11:40:32.016 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/ 2023-11-28T11:40:32.016 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20569 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-28T11:40:32.016 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14185 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-28T11:40:32.016 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13681 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-gpio.ko 2023-11-28T11:40:32.016 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-28T11:40:32.016 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16025 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-11-28T11:40:32.017 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20513 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-11-28T11:40:32.017 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 43953 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-11-28T11:40:32.017 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13145 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-11-28T11:40:32.017 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/ 2023-11-28T11:40:32.017 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-28T11:40:32.017 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 38977 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-28T11:40:32.017 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ 2023-11-28T11:40:32.017 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-11-28T11:40:32.017 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 50033 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-28T11:40:32.018 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 44721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-28T11:40:32.018 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-11-28T11:40:32.018 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 42241 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-11-28T11:40:32.018 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-11-28T11:40:32.018 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13025 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-11-28T11:40:32.018 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-11-28T11:40:32.018 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24969 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-11-28T11:40:32.018 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15849 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-11-28T11:40:32.019 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 82049 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-11-28T11:40:32.019 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 76113 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-11-28T11:40:32.019 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12033 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-11-28T11:40:32.019 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 97857 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-11-28T11:40:32.019 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10065 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-11-28T11:40:32.019 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 50065 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-11-28T11:40:32.019 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-11-28T11:40:32.019 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10857 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-11-28T11:40:32.019 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-11-28T11:40:32.019 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/ 2023-11-28T11:40:32.020 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 43505 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/plip.ko 2023-11-28T11:40:32.020 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ 2023-11-28T11:40:32.020 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15857 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-28T11:40:32.020 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29713 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-11-28T11:40:32.020 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17665 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-28T11:40:32.020 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-28T11:40:32.020 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-28T11:40:32.020 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 42545 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-11-28T11:40:32.020 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13441 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-11-28T11:40:32.020 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 32689 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-11-28T11:40:32.020 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sb1000.ko 2023-11-28T11:40:32.020 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/ 2023-11-28T11:40:32.021 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 42465 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-11-28T11:40:32.021 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26929 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-11-28T11:40:32.021 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 64449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-11-28T11:40:32.021 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/ 2023-11-28T11:40:32.021 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 106169 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-11-28T11:40:32.021 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-28T11:40:32.021 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10209 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-28T11:40:32.021 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28881 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-28T11:40:32.021 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9641 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-11-28T11:40:32.021 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-28T11:40:32.022 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 87017 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-11-28T11:40:32.022 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/ 2023-11-28T11:40:32.022 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 144297 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-28T11:40:32.022 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/ 2023-11-28T11:40:32.022 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 297329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-11-28T11:40:32.022 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/ 2023-11-28T11:40:32.022 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 144585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-28T11:40:32.022 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ 2023-11-28T11:40:32.022 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20969 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-11-28T11:40:32.023 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/ 2023-11-28T11:40:32.023 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/ 2023-11-28T11:40:32.023 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 265121 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-11-28T11:40:32.023 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 102209 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-11-28T11:40:32.023 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/ 2023-11-28T11:40:32.023 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 133841 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-11-28T11:40:32.023 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14561 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-11-28T11:40:32.023 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 84465 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-11-28T11:40:32.023 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26121 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-11-28T11:40:32.023 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/ 2023-11-28T11:40:32.024 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/ 2023-11-28T11:40:32.024 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25009 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-28T11:40:32.024 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17849 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-11-28T11:40:32.024 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20137 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-11-28T11:40:32.024 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11857 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pci-stub.ko 2023-11-28T11:40:32.024 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 46465 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-11-28T11:40:32.024 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/ 2023-11-28T11:40:32.024 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26793 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-11-28T11:40:32.024 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 145809 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia.ko 2023-11-28T11:40:32.024 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 62137 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_core.ko 2023-11-28T11:40:32.024 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34345 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-11-28T11:40:32.024 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34265 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-11-28T11:40:32.025 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 112889 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-28T11:40:32.025 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/ 2023-11-28T11:40:32.025 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/ 2023-11-28T11:40:32.025 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10841 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-11-28T11:40:32.025 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/ 2023-11-28T11:40:32.025 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8441 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-11-28T11:40:32.025 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/ 2023-11-28T11:40:32.025 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/ 2023-11-28T11:40:32.025 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 70153 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-28T11:40:32.025 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/ 2023-11-28T11:40:32.025 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/ 2023-11-28T11:40:32.026 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 50889 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-11-28T11:40:32.026 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20849 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec.ko 2023-11-28T11:40:32.026 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-11-28T11:40:32.026 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25417 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-11-28T11:40:32.026 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26201 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-11-28T11:40:32.026 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18201 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-11-28T11:40:32.026 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17361 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-11-28T11:40:32.026 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ 2023-11-28T11:40:32.026 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 67097 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-28T11:40:32.026 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 39145 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-11-28T11:40:32.027 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 37025 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-28T11:40:32.027 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 59665 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-28T11:40:32.027 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 31161 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-28T11:40:32.027 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 127441 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-28T11:40:32.027 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 36849 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-28T11:40:32.027 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 49121 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-28T11:40:32.027 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13961 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-28T11:40:32.027 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 40265 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-28T11:40:32.027 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-28T11:40:32.027 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 36593 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-11-28T11:40:32.027 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ibm_rtl.ko 2023-11-28T11:40:32.027 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/ 2023-11-28T11:40:32.027 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-28T11:40:32.028 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-11-28T11:40:32.028 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 43497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-11-28T11:40:32.028 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20273 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-28T11:40:32.028 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10377 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-28T11:40:32.028 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-28T11:40:32.028 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 42329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-28T11:40:32.028 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14169 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-28T11:40:32.028 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-28T11:40:32.028 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-28T11:40:32.028 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17081 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-28T11:40:32.029 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10129 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-28T11:40:32.029 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 57569 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-11-28T11:40:32.029 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/ 2023-11-28T11:40:32.029 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ 2023-11-28T11:40:32.029 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30281 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_battery.ko 2023-11-28T11:40:32.029 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_charger.ko 2023-11-28T11:40:32.029 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 55057 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq2415x_charger.ko 2023-11-28T11:40:32.029 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 54081 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24190_charger.ko 2023-11-28T11:40:32.029 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21553 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24735-charger.ko 2023-11-28T11:40:32.029 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-11-28T11:40:32.029 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19609 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9030_battery.ko 2023-11-28T11:40:32.029 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19841 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9052-battery.ko 2023-11-28T11:40:32.030 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29281 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2760_battery.ko 2023-11-28T11:40:32.030 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23217 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2780_battery.ko 2023-11-28T11:40:32.030 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23353 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2781_battery.ko 2023-11-28T11:40:32.030 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23649 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2782_battery.ko 2023-11-28T11:40:32.030 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20353 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/gpio-charger.ko 2023-11-28T11:40:32.030 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18041 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/isp1704_charger.ko 2023-11-28T11:40:32.030 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20273 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/lp8727_charger.ko 2023-11-28T11:40:32.030 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12577 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max14577_charger.ko 2023-11-28T11:40:32.030 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25897 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17040_battery.ko 2023-11-28T11:40:32.030 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17042_battery.ko 2023-11-28T11:40:32.031 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8903_charger.ko 2023-11-28T11:40:32.031 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8925_power.ko 2023-11-28T11:40:32.031 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21657 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/pcf50633-charger.ko 2023-11-28T11:40:32.031 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 38009 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/sbs-battery.ko 2023-11-28T11:40:32.031 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28385 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/test_power.ko 2023-11-28T11:40:32.031 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18865 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/tps65090-charger.ko 2023-11-28T11:40:32.031 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11969 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_backup.ko 2023-11-28T11:40:32.031 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_power.ko 2023-11-28T11:40:32.031 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22417 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm8350_power.ko 2023-11-28T11:40:32.031 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/ 2023-11-28T11:40:32.031 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 57729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-28T11:40:32.031 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17345 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-28T11:40:32.032 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/ 2023-11-28T11:40:32.032 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/ 2023-11-28T11:40:32.032 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-28T11:40:32.032 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13249 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-28T11:40:32.032 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15913 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-11-28T11:40:32.032 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 41873 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-11-28T11:40:32.032 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ 2023-11-28T11:40:32.032 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 66385 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-11-28T11:40:32.032 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-11-28T11:40:32.032 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/ 2023-11-28T11:40:32.032 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm80x.ko 2023-11-28T11:40:32.033 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm860x.ko 2023-11-28T11:40:32.033 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15393 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-28T11:40:32.033 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20105 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9052.ko 2023-11-28T11:40:32.033 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18505 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9055.ko 2023-11-28T11:40:32.033 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9063.ko 2023-11-28T11:40:32.033 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16457 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-28T11:40:32.033 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 68577 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-28T11:40:32.033 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-28T11:40:32.033 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18217 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-28T11:40:32.033 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-28T11:40:32.034 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13953 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-28T11:40:32.034 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13369 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-28T11:40:32.034 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14697 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-28T11:40:32.034 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23705 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-28T11:40:32.034 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11081 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-11-28T11:40:32.034 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-28T11:40:32.034 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-28T11:40:32.034 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 35969 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-28T11:40:32.034 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14673 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-lp8788.ko 2023-11-28T11:40:32.035 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 38097 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-28T11:40:32.035 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12089 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-28T11:40:32.035 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25945 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-28T11:40:32.035 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14841 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t86.ko 2023-11-28T11:40:32.035 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11633 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-11-28T11:40:32.035 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14673 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8907.ko 2023-11-28T11:40:32.035 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15345 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8925.ko 2023-11-28T11:40:32.035 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25809 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8997.ko 2023-11-28T11:40:32.035 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16681 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8998.ko 2023-11-28T11:40:32.035 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18513 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-11-28T11:40:32.035 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11409 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-28T11:40:32.035 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-palmas.ko 2023-11-28T11:40:32.035 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 46633 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-28T11:40:32.036 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17977 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf50633.ko 2023-11-28T11:40:32.036 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26993 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-28T11:40:32.036 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-28T11:40:32.036 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-28T11:40:32.036 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12441 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-28T11:40:32.036 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18033 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rc5t583.ko 2023-11-28T11:40:32.036 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13049 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-28T11:40:32.036 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33753 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-28T11:40:32.036 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27833 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-28T11:40:32.036 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25257 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-28T11:40:32.036 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20113 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-28T11:40:32.037 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21617 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-s35390a.ko 2023-11-28T11:40:32.037 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-28T11:40:32.037 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17889 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps6586x.ko 2023-11-28T11:40:32.037 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps65910.ko 2023-11-28T11:40:32.037 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20545 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm831x.ko 2023-11-28T11:40:32.037 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21089 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm8350.ko 2023-11-28T11:40:32.037 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27873 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-11-28T11:40:32.037 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ 2023-11-28T11:40:32.037 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 77617 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-11-28T11:40:32.037 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 57665 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-11-28T11:40:32.037 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 55105 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-11-28T11:40:32.038 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 135185 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-11-28T11:40:32.038 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26657 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-11-28T11:40:32.038 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/ 2023-11-28T11:40:32.038 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 272305 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-28T11:40:32.038 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 100617 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-11-28T11:40:32.038 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/ 2023-11-28T11:40:32.038 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 356201 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-28T11:40:32.038 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 295801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-28T11:40:32.038 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/ 2023-11-28T11:40:32.038 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 189185 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-11-28T11:40:32.038 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-11-28T11:40:32.038 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/ 2023-11-28T11:40:32.039 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 106881 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-28T11:40:32.039 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 38185 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-11-28T11:40:32.039 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/ 2023-11-28T11:40:32.039 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 246985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-28T11:40:32.039 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/ 2023-11-28T11:40:32.039 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 1171945 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-11-28T11:40:32.039 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/ 2023-11-28T11:40:32.039 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 237273 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-28T11:40:32.039 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/ 2023-11-28T11:40:32.039 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 115369 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-28T11:40:32.039 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 40585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-11-28T11:40:32.039 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/ 2023-11-28T11:40:32.039 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 308921 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-28T11:40:32.040 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/ 2023-11-28T11:40:32.040 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-11-28T11:40:32.040 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 76145 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-28T11:40:32.040 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-11-28T11:40:32.040 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 101449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-28T11:40:32.040 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 146689 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-28T11:40:32.040 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 75553 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-11-28T11:40:32.040 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 38073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-11-28T11:40:32.040 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/ 2023-11-28T11:40:32.040 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 212425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-28T11:40:32.040 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 60505 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-11-28T11:40:32.040 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/ 2023-11-28T11:40:32.040 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 78209 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-28T11:40:32.041 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 158505 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-28T11:40:32.041 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18945 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fdomain.ko 2023-11-28T11:40:32.041 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/ 2023-11-28T11:40:32.041 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 263489 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-11-28T11:40:32.041 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 201817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-11-28T11:40:32.041 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 51209 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-11-28T11:40:32.041 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 49041 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-11-28T11:40:32.041 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 35337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/imm.ko 2023-11-28T11:40:32.041 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 44057 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-11-28T11:40:32.042 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 266537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-11-28T11:40:32.042 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 101881 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-11-28T11:40:32.042 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/ 2023-11-28T11:40:32.042 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 317153 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-11-28T11:40:32.042 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26385 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-28T11:40:32.042 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 52961 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-28T11:40:32.042 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/ 2023-11-28T11:40:32.042 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 314865 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-11-28T11:40:32.042 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 145585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-11-28T11:40:32.042 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 53521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-28T11:40:32.042 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/ 2023-11-28T11:40:32.042 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 216665 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-11-28T11:40:32.043 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/ 2023-11-28T11:40:32.043 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 2197249 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-28T11:40:32.043 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/ 2023-11-28T11:40:32.043 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 73569 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-28T11:40:32.043 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33529 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-28T11:40:32.043 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 310617 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-28T11:40:32.043 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 84721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-11-28T11:40:32.043 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/ 2023-11-28T11:40:32.043 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 659825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-28T11:40:32.043 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/ 2023-11-28T11:40:32.044 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 119561 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-28T11:40:32.044 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 78129 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-11-28T11:40:32.044 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/ 2023-11-28T11:40:32.044 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 81625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-11-28T11:40:32.044 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11713 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-11-28T11:40:32.044 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20865 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-11-28T11:40:32.044 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23857 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-11-28T11:40:32.044 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/ 2023-11-28T11:40:32.044 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 364105 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-28T11:40:32.044 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 123617 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-11-28T11:40:32.044 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34513 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ppa.ko 2023-11-28T11:40:32.044 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 55361 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-11-28T11:40:32.045 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/ 2023-11-28T11:40:32.045 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 1876689 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-28T11:40:32.045 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 85289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-28T11:40:32.045 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/ 2023-11-28T11:40:32.045 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 559033 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-28T11:40:32.045 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19025 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qlogicfas408.ko 2023-11-28T11:40:32.045 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15993 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-11-28T11:40:32.045 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 238761 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-11-28T11:40:32.045 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 173937 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-28T11:40:32.045 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 279313 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-28T11:40:32.046 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 97729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-28T11:40:32.046 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 73881 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-28T11:40:32.046 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 44993 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-28T11:40:32.046 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26249 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-11-28T11:40:32.046 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 115889 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-11-28T11:40:32.046 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 46825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-11-28T11:40:32.046 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/ 2023-11-28T11:40:32.046 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 162121 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-28T11:40:32.046 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 42297 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-11-28T11:40:32.046 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 50321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-28T11:40:32.046 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 39961 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-11-28T11:40:32.047 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 50025 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/xen-scsifront.ko 2023-11-28T11:40:32.047 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ 2023-11-28T11:40:32.047 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 129441 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-11-28T11:40:32.047 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/ 2023-11-28T11:40:32.047 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/ 2023-11-28T11:40:32.047 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 736601 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-28T11:40:32.047 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/ 2023-11-28T11:40:32.047 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 49985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-28T11:40:32.047 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 39713 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-11-28T11:40:32.047 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 43025 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-11-28T11:40:32.048 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 930257 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-11-28T11:40:32.048 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 44305 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-11-28T11:40:32.048 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 122521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-11-28T11:40:32.048 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/ 2023-11-28T11:40:32.048 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 75593 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-28T11:40:32.048 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/ 2023-11-28T11:40:32.048 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/ 2023-11-28T11:40:32.048 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/ 2023-11-28T11:40:32.048 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23481 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-28T11:40:32.048 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-28T11:40:32.049 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9953 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-28T11:40:32.049 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10257 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-28T11:40:32.049 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15081 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-28T11:40:32.049 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-28T11:40:32.049 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26809 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-28T11:40:32.049 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20281 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-28T11:40:32.049 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14865 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-28T11:40:32.049 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14393 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-28T11:40:32.049 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13001 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-28T11:40:32.050 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 37065 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-28T11:40:32.050 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-11-28T11:40:32.050 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18937 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-28T11:40:32.050 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-28T11:40:32.050 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-28T11:40:32.050 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ 2023-11-28T11:40:32.050 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ 2023-11-28T11:40:32.050 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 78425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-28T11:40:32.050 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 57865 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/moxa.ko 2023-11-28T11:40:32.051 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 50953 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/mxser.ko 2023-11-28T11:40:32.051 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 108601 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-11-28T11:40:32.051 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 31961 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-11-28T11:40:32.051 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 67929 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-11-28T11:40:32.051 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/ 2023-11-28T11:40:32.051 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/ 2023-11-28T11:40:32.051 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 35753 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-11-28T11:40:32.051 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 59497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-28T11:40:32.051 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18097 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-11-28T11:40:32.051 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22577 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_uart.ko 2023-11-28T11:40:32.051 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-11-28T11:40:32.051 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 72425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-11-28T11:40:32.051 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/ 2023-11-28T11:40:32.052 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 103073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-28T11:40:32.052 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28785 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/rp2.ko 2023-11-28T11:40:32.052 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 52817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/sc16is7xx.ko 2023-11-28T11:40:32.052 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/ 2023-11-28T11:40:32.052 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ 2023-11-28T11:40:32.052 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 531265 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-28T11:40:32.052 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ 2023-11-28T11:40:32.052 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28481 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-28T11:40:32.052 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14601 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-11-28T11:40:32.052 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/ 2023-11-28T11:40:32.052 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 44513 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-11-28T11:40:32.052 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12241 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-11-28T11:40:32.052 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11281 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-11-28T11:40:32.053 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_dmem_genirq.ko 2023-11-28T11:40:32.053 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12937 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_mf624.ko 2023-11-28T11:40:32.053 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12177 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_netx.ko 2023-11-28T11:40:32.053 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10601 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-11-28T11:40:32.053 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16057 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-11-28T11:40:32.053 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13633 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-11-28T11:40:32.053 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/ 2023-11-28T11:40:32.053 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/ 2023-11-28T11:40:32.053 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 73297 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/c67x00.ko 2023-11-28T11:40:32.053 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ 2023-11-28T11:40:32.053 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 144377 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-11-28T11:40:32.054 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18505 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-11-28T11:40:32.054 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12713 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-11-28T11:40:32.054 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13057 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-11-28T11:40:32.054 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/ 2023-11-28T11:40:32.054 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 87089 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-11-28T11:40:32.054 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 51345 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-28T11:40:32.054 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 47305 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-11-28T11:40:32.054 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 89857 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-11-28T11:40:32.054 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ 2023-11-28T11:40:32.054 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22953 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ulpi.ko 2023-11-28T11:40:32.054 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/ 2023-11-28T11:40:32.055 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11529 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-11-28T11:40:32.055 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/ 2023-11-28T11:40:32.055 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12089 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-11-28T11:40:32.055 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30041 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-11-28T11:40:32.055 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 448505 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3.ko 2023-11-28T11:40:32.055 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/ 2023-11-28T11:40:32.055 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/ 2023-11-28T11:40:32.055 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 60177 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_ether.ko 2023-11-28T11:40:32.055 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 51881 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_serial.ko 2023-11-28T11:40:32.055 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28841 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-11-28T11:40:32.055 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 42449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-11-28T11:40:32.055 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27953 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-11-28T11:40:32.055 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 36513 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-11-28T11:40:32.056 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 92489 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-11-28T11:40:32.056 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 51049 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-11-28T11:40:32.056 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 122081 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-11-28T11:40:32.056 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 57681 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-11-28T11:40:32.056 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22185 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-11-28T11:40:32.056 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 31265 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-11-28T11:40:32.056 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 57729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-11-28T11:40:32.056 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 85609 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-11-28T11:40:32.056 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19273 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-11-28T11:40:32.056 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 58113 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-11-28T11:40:32.056 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 67337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-11-28T11:40:32.056 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/ 2023-11-28T11:40:32.057 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21265 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-11-28T11:40:32.057 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18057 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-11-28T11:40:32.057 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18465 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-11-28T11:40:32.057 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21657 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-11-28T11:40:32.057 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28401 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-11-28T11:40:32.057 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19009 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-11-28T11:40:32.057 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20409 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-11-28T11:40:32.057 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16977 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-11-28T11:40:32.057 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 32073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-11-28T11:40:32.057 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16793 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-11-28T11:40:32.057 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19393 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-11-28T11:40:32.057 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27201 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-11-28T11:40:32.057 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 62185 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-11-28T11:40:32.057 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15201 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-11-28T11:40:32.058 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 161225 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/libcomposite.ko 2023-11-28T11:40:32.058 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/ 2023-11-28T11:40:32.058 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17705 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-11-28T11:40:32.058 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/ 2023-11-28T11:40:32.058 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 157681 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-11-28T11:40:32.058 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 36089 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-11-28T11:40:32.058 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 52721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-11-28T11:40:32.058 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 69705 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-11-28T11:40:32.058 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 56033 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-11-28T11:40:32.058 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 76057 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2272.ko 2023-11-28T11:40:32.058 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 75073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2280.ko 2023-11-28T11:40:32.058 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 73169 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-11-28T11:40:32.058 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 65809 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-11-28T11:40:32.059 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 66097 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-11-28T11:40:32.059 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 81505 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-11-28T11:40:32.059 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 156073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-11-28T11:40:32.059 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ 2023-11-28T11:40:32.059 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/bcma-hcd.ko 2023-11-28T11:40:32.059 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 80113 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/isp116x-hcd.ko 2023-11-28T11:40:32.059 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 87353 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-11-28T11:40:32.059 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 78873 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-11-28T11:40:32.059 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 51329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-28T11:40:32.059 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15593 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811_cs.ko 2023-11-28T11:40:32.059 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13305 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ssb-hcd.ko 2023-11-28T11:40:32.059 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25945 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-11-28T11:40:32.059 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/ 2023-11-28T11:40:32.059 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-11-28T11:40:32.060 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21081 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-11-28T11:40:32.060 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ 2023-11-28T11:40:32.060 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 41721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-11-28T11:40:32.060 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20713 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-11-28T11:40:32.060 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-11-28T11:40:32.060 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23049 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cytherm.ko 2023-11-28T11:40:32.060 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ehset.ko 2023-11-28T11:40:32.060 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15057 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-11-28T11:40:32.060 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-11-28T11:40:32.060 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11433 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-11-28T11:40:32.060 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19297 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-11-28T11:40:32.060 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 36553 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-11-28T11:40:32.060 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11593 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-28T11:40:32.061 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 36529 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-11-28T11:40:32.061 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 36265 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-11-28T11:40:32.061 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27793 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/lvstest.ko 2023-11-28T11:40:32.061 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/ 2023-11-28T11:40:32.061 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 64841 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-28T11:40:32.061 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12937 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-28T11:40:32.061 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20473 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-11-28T11:40:32.061 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25145 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-11-28T11:40:32.061 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22753 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-28T11:40:32.061 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 70809 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbtest.ko 2023-11-28T11:40:32.061 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 41905 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-11-28T11:40:32.061 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27617 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-11-28T11:40:32.061 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/ 2023-11-28T11:40:32.062 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 72953 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/usbmon.ko 2023-11-28T11:40:32.062 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/ 2023-11-28T11:40:32.062 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 301697 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/musb_hdrc.ko 2023-11-28T11:40:32.062 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/ 2023-11-28T11:40:32.062 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21105 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-11-28T11:40:32.062 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20177 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-11-28T11:40:32.062 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12257 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-isp1301.ko 2023-11-28T11:40:32.062 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21745 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-tahvo.ko 2023-11-28T11:40:32.062 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ 2023-11-28T11:40:32.062 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13209 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-11-28T11:40:32.062 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-11-28T11:40:32.062 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26633 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-28T11:40:32.062 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 38105 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-11-28T11:40:32.063 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 70257 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-11-28T11:40:32.063 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 31057 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-11-28T11:40:32.063 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 58217 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-28T11:40:32.063 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 49817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-28T11:40:32.063 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9617 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-11-28T11:40:32.063 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 44273 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/f81232.ko 2023-11-28T11:40:32.063 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 175137 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-28T11:40:32.063 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 53113 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-28T11:40:32.063 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 137081 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-28T11:40:32.063 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 124833 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-11-28T11:40:32.063 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 67769 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-11-28T11:40:32.063 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19161 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-11-28T11:40:32.063 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26897 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-11-28T11:40:32.064 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 58233 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-28T11:40:32.064 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 107521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-11-28T11:40:32.064 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 35617 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-28T11:40:32.064 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25665 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-28T11:40:32.064 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33689 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-28T11:40:32.064 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 32953 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-11-28T11:40:32.064 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22033 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/metro-usb.ko 2023-11-28T11:40:32.064 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 66449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-11-28T11:40:32.064 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 78217 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-11-28T11:40:32.064 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 56337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mxuport.ko 2023-11-28T11:40:32.064 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14025 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-11-28T11:40:32.064 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12009 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-11-28T11:40:32.064 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24633 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-11-28T11:40:32.064 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 191137 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-11-28T11:40:32.065 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 39073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-11-28T11:40:32.065 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 54353 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-11-28T11:40:32.065 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-11-28T11:40:32.065 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 37825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-11-28T11:40:32.065 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-11-28T11:40:32.065 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15393 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-11-28T11:40:32.065 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 51625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-11-28T11:40:32.065 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21673 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-28T11:40:32.065 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29993 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-11-28T11:40:32.065 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17265 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-11-28T11:40:32.065 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 61489 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-28T11:40:32.065 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-28T11:40:32.065 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10241 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-11-28T11:40:32.065 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33201 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-28T11:40:32.066 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 125609 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usbserial.ko 2023-11-28T11:40:32.066 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28753 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-11-28T11:40:32.066 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 37409 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-11-28T11:40:32.066 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/wishbone-serial.ko 2023-11-28T11:40:32.066 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-28T11:40:32.066 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ 2023-11-28T11:40:32.066 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 52913 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-11-28T11:40:32.066 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26017 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-28T11:40:32.066 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13049 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-28T11:40:32.066 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22049 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-28T11:40:32.066 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-28T11:40:32.066 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13745 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-28T11:40:32.067 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19769 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-28T11:40:32.067 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19361 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-28T11:40:32.067 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13713 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-11-28T11:40:32.067 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17841 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-28T11:40:32.067 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28441 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-28T11:40:32.067 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28905 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-28T11:40:32.067 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-28T11:40:32.067 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 35337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-28T11:40:32.067 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 179969 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-11-28T11:40:32.067 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/ 2023-11-28T11:40:32.067 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 67481 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-28T11:40:32.067 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 72177 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-28T11:40:32.067 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 107001 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-28T11:40:32.068 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/ 2023-11-28T11:40:32.068 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/ 2023-11-28T11:40:32.068 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 154297 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-28T11:40:32.068 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-28T11:40:32.068 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 108737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-11-28T11:40:32.068 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 77609 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-28T11:40:32.068 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/ 2023-11-28T11:40:32.068 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 113785 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-11-28T11:40:32.068 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17009 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-28T11:40:32.068 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 58089 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-11-28T11:40:32.068 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 89249 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-11-28T11:40:32.068 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/ 2023-11-28T11:40:32.068 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/ 2023-11-28T11:40:32.069 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15417 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-11-28T11:40:32.069 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12393 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/aat2870_bl.ko 2023-11-28T11:40:32.069 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23305 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp5520_bl.ko 2023-11-28T11:40:32.069 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 32609 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8860_bl.ko 2023-11-28T11:40:32.069 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 39993 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8870_bl.ko 2023-11-28T11:40:32.069 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16921 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-11-28T11:40:32.069 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16777 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/as3711_bl.ko 2023-11-28T11:40:32.069 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12033 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/bd6107.ko 2023-11-28T11:40:32.069 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11409 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da903x_bl.ko 2023-11-28T11:40:32.069 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11273 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da9052_bl.ko 2023-11-28T11:40:32.069 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11753 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/gpio_backlight.ko 2023-11-28T11:40:32.069 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14769 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/kb3886_bl.ko 2023-11-28T11:40:32.069 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22017 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-11-28T11:40:32.069 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23657 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3533_bl.ko 2023-11-28T11:40:32.070 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3639_bl.ko 2023-11-28T11:40:32.070 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lv5207lp.ko 2023-11-28T11:40:32.070 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14345 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/max8925_bl.ko 2023-11-28T11:40:32.070 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11313 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pandora_bl.ko 2023-11-28T11:40:32.070 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10865 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-11-28T11:40:32.070 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10897 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-28T11:40:32.070 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/wm831x_bl.ko 2023-11-28T11:40:32.070 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/ 2023-11-28T11:40:32.070 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ 2023-11-28T11:40:32.070 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18785 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-11-28T11:40:32.070 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 38985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-11-28T11:40:32.070 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11265 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/matrox_w1.ko 2023-11-28T11:40:32.070 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12417 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/w1-gpio.ko 2023-11-28T11:40:32.071 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/ 2023-11-28T11:40:32.071 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12041 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-28T11:40:32.071 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22745 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-28T11:40:32.071 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15113 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-28T11:40:32.071 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-28T11:40:32.071 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14153 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-28T11:40:32.071 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11929 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-28T11:40:32.071 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14049 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-28T11:40:32.071 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14049 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-28T11:40:32.071 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17921 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-28T11:40:32.071 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7385 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-28T11:40:32.071 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 56425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-28T11:40:32.071 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 102673 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-11-28T11:40:32.072 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ 2023-11-28T11:40:32.072 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18793 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/acquirewdt.ko 2023-11-28T11:40:32.072 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19977 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/advantechwdt.ko 2023-11-28T11:40:32.072 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18561 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-28T11:40:32.072 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22969 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-28T11:40:32.072 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19113 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/cpu5wdt.ko 2023-11-28T11:40:32.072 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13617 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9052_wdt.ko 2023-11-28T11:40:32.072 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12777 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9055_wdt.ko 2023-11-28T11:40:32.072 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17409 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9063_wdt.ko 2023-11-28T11:40:32.072 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20169 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/dw_wdt.ko 2023-11-28T11:40:32.072 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20265 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/eurotechwdt.ko 2023-11-28T11:40:32.072 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23865 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-28T11:40:32.072 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27401 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-11-28T11:40:32.072 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15577 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-11-28T11:40:32.073 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10833 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-28T11:40:32.073 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21913 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-28T11:40:32.073 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19241 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-11-28T11:40:32.073 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18689 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-11-28T11:40:32.073 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19713 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-28T11:40:32.073 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21225 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-28T11:40:32.073 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13841 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-11-28T11:40:32.073 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21489 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/kempld_wdt.ko 2023-11-28T11:40:32.073 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18617 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-11-28T11:40:32.073 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/mena21_wdt.ko 2023-11-28T11:40:32.073 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13217 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-11-28T11:40:32.073 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24673 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-11-28T11:40:32.073 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-11-28T11:40:32.074 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22265 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pc87413_wdt.ko 2023-11-28T11:40:32.074 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 38657 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-28T11:40:32.074 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 31825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-28T11:40:32.074 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13065 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/retu_wdt.ko 2023-11-28T11:40:32.074 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-11-28T11:40:32.074 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14129 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-11-28T11:40:32.074 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-28T11:40:32.074 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23809 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sc1200wdt.ko 2023-11-28T11:40:32.074 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-28T11:40:32.074 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21577 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-11-28T11:40:32.074 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17273 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-11-28T11:40:32.074 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22273 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-28T11:40:32.075 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/twl4030_wdt.ko 2023-11-28T11:40:32.075 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17649 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-11-28T11:40:32.075 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19161 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-28T11:40:32.075 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20681 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-28T11:40:32.075 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25409 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-28T11:40:32.075 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wafer5823wdt.ko 2023-11-28T11:40:32.075 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28089 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-11-28T11:40:32.075 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16257 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm831x_wdt.ko 2023-11-28T11:40:32.075 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13785 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm8350_wdt.ko 2023-11-28T11:40:32.075 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15697 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-11-28T11:40:32.075 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/ 2023-11-28T11:40:32.075 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-11-28T11:40:32.075 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26769 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-11-28T11:40:32.075 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 47865 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-11-28T11:40:32.076 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/ 2023-11-28T11:40:32.076 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 176377 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-28T11:40:32.076 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 40121 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-11-28T11:40:32.076 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 71249 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-scsiback.ko 2023-11-28T11:40:32.076 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/ 2023-11-28T11:40:32.076 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-28T11:40:32.076 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ 2023-11-28T11:40:32.076 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/ 2023-11-28T11:40:32.076 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 166425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-11-28T11:40:32.076 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/ 2023-11-28T11:40:32.076 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 61073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/adfs.ko 2023-11-28T11:40:32.076 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/ 2023-11-28T11:40:32.077 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 163593 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-11-28T11:40:32.077 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/ 2023-11-28T11:40:32.077 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 932817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/kafs.ko 2023-11-28T11:40:32.077 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/ 2023-11-28T11:40:32.077 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 101057 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/autofs4.ko 2023-11-28T11:40:32.077 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/ 2023-11-28T11:40:32.077 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 64545 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-11-28T11:40:32.077 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/ 2023-11-28T11:40:32.077 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 41257 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/bfs.ko 2023-11-28T11:40:32.078 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-11-28T11:40:32.078 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/ 2023-11-28T11:40:32.078 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 3402729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-11-28T11:40:32.078 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/ 2023-11-28T11:40:32.078 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 306009 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-11-28T11:40:32.078 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ 2023-11-28T11:40:32.078 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 1333017 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-11-28T11:40:32.078 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/ 2023-11-28T11:40:32.078 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 100801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-11-28T11:40:32.078 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/ 2023-11-28T11:40:32.078 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 108393 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/configfs.ko 2023-11-28T11:40:32.079 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/ 2023-11-28T11:40:32.079 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-11-28T11:40:32.079 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/ 2023-11-28T11:40:32.079 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 642513 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-11-28T11:40:32.079 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/ 2023-11-28T11:40:32.079 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 36649 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/efs.ko 2023-11-28T11:40:32.079 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/ 2023-11-28T11:40:32.079 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 1505025 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-11-28T11:40:32.079 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/ 2023-11-28T11:40:32.079 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27929 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-11-28T11:40:32.080 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/ 2023-11-28T11:40:32.080 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 42545 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/freevxfs.ko 2023-11-28T11:40:32.080 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/ 2023-11-28T11:40:32.080 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 226481 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-11-28T11:40:32.080 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/ 2023-11-28T11:40:32.080 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24489 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-11-28T11:40:32.080 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/ 2023-11-28T11:40:32.080 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 1231529 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-11-28T11:40:32.080 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/ 2023-11-28T11:40:32.080 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 141209 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-11-28T11:40:32.080 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/ 2023-11-28T11:40:32.081 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 222817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-11-28T11:40:32.081 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/ 2023-11-28T11:40:32.081 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 192329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/hpfs.ko 2023-11-28T11:40:32.081 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/ 2023-11-28T11:40:32.081 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 74065 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-11-28T11:40:32.081 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/ 2023-11-28T11:40:32.081 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 419497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-11-28T11:40:32.081 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/ 2023-11-28T11:40:32.081 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 280313 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-11-28T11:40:32.081 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/ 2023-11-28T11:40:32.081 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 89193 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-11-28T11:40:32.082 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/ 2023-11-28T11:40:32.082 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 124649 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-11-28T11:40:32.082 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/ 2023-11-28T11:40:32.082 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/ 2023-11-28T11:40:32.082 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 81449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-28T11:40:32.082 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/ 2023-11-28T11:40:32.082 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 59449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-28T11:40:32.082 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/ 2023-11-28T11:40:32.082 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 117465 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-28T11:40:32.082 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 1055721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-11-28T11:40:32.083 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 66441 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv2.ko 2023-11-28T11:40:32.083 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 120177 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-11-28T11:40:32.083 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 2042137 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-11-28T11:40:32.083 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/ 2023-11-28T11:40:32.083 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16929 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-11-28T11:40:32.083 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16145 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-11-28T11:40:32.083 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/ 2023-11-28T11:40:32.083 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 1516873 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-11-28T11:40:32.083 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/ 2023-11-28T11:40:32.083 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 592833 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-11-28T11:40:32.083 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/ 2023-11-28T11:40:32.083 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13793 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-11-28T11:40:32.084 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13169 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-11-28T11:40:32.084 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13793 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-11-28T11:40:32.084 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12865 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-11-28T11:40:32.084 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13481 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-11-28T11:40:32.084 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12857 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-11-28T11:40:32.084 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13793 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-11-28T11:40:32.084 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13169 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-11-28T11:40:32.084 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14097 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-11-28T11:40:32.084 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13793 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-11-28T11:40:32.085 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13793 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-11-28T11:40:32.085 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11297 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ascii.ko 2023-11-28T11:40:32.085 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-11-28T11:40:32.085 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12233 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-11-28T11:40:32.085 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12921 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-11-28T11:40:32.085 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-11-28T11:40:32.085 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-11-28T11:40:32.085 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12225 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-11-28T11:40:32.086 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12225 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-11-28T11:40:32.086 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12225 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-11-28T11:40:32.086 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11913 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-11-28T11:40:32.086 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12849 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-11-28T11:40:32.086 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13161 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-11-28T11:40:32.086 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13473 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-11-28T11:40:32.086 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13161 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-11-28T11:40:32.086 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12849 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-11-28T11:40:32.086 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13161 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-11-28T11:40:32.087 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-11-28T11:40:32.087 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12225 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-11-28T11:40:32.087 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-11-28T11:40:32.087 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 94137 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-11-28T11:40:32.087 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 142673 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-11-28T11:40:32.087 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 165745 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-11-28T11:40:32.087 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 118121 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-11-28T11:40:32.087 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12457 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-11-28T11:40:32.087 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11305 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-11-28T11:40:32.087 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11929 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-11-28T11:40:32.087 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11929 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-11-28T11:40:32.087 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11929 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-11-28T11:40:32.087 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11921 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-11-28T11:40:32.088 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11921 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-11-28T11:40:32.088 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11921 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-11-28T11:40:32.088 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11921 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-11-28T11:40:32.088 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11617 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-11-28T11:40:32.088 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12233 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-11-28T11:40:32.088 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11617 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-11-28T11:40:32.088 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-11-28T11:40:32.088 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8017 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-11-28T11:40:32.088 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-11-28T11:40:32.088 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7569 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-28T11:40:32.088 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-11-28T11:40:32.088 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ 2023-11-28T11:40:32.088 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 219417 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ntfs.ko 2023-11-28T11:40:32.089 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ 2023-11-28T11:40:32.089 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ 2023-11-28T11:40:32.089 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 244409 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-28T11:40:32.089 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ 2023-11-28T11:40:32.089 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 440737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-28T11:40:32.089 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ 2023-11-28T11:40:32.089 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 54049 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-28T11:40:32.089 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 2592433 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-11-28T11:40:32.089 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17905 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-28T11:40:32.089 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 31729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-28T11:40:32.089 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 35897 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-28T11:40:32.089 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/ 2023-11-28T11:40:32.089 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 53433 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/omfs.ko 2023-11-28T11:40:32.089 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/ 2023-11-28T11:40:32.090 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 352161 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-11-28T11:40:32.090 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ 2023-11-28T11:40:32.090 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 54809 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-11-28T11:40:32.090 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/ 2023-11-28T11:40:32.090 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26865 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/qnx4.ko 2023-11-28T11:40:32.090 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/ 2023-11-28T11:40:32.090 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 46689 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/qnx6.ko 2023-11-28T11:40:32.090 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/ 2023-11-28T11:40:32.090 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30881 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_tree.ko 2023-11-28T11:40:32.090 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14297 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v1.ko 2023-11-28T11:40:32.090 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22017 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v2.ko 2023-11-28T11:40:32.090 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/ 2023-11-28T11:40:32.090 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 532673 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-11-28T11:40:32.091 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/ 2023-11-28T11:40:32.091 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28641 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-11-28T11:40:32.091 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/ 2023-11-28T11:40:32.091 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/ 2023-11-28T11:40:32.091 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 2668401 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-11-28T11:40:32.091 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/ 2023-11-28T11:40:32.091 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7161 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-11-28T11:40:32.091 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11257 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-11-28T11:40:32.091 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/ 2023-11-28T11:40:32.091 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 134641 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-11-28T11:40:32.091 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/ 2023-11-28T11:40:32.091 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 90721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-11-28T11:40:32.091 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/ 2023-11-28T11:40:32.092 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 247737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-11-28T11:40:32.092 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ 2023-11-28T11:40:32.092 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 162497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-11-28T11:40:32.092 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/ 2023-11-28T11:40:32.092 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 4011017 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-11-28T11:40:32.123 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/ 2023-11-28T11:40:32.123 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/ 2023-11-28T11:40:32.123 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 75489 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/locktorture.ko 2023-11-28T11:40:32.123 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/ 2023-11-28T11:40:32.123 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/test_udelay.ko 2023-11-28T11:40:32.123 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 60553 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-11-28T11:40:32.123 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ 2023-11-28T11:40:32.123 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 6833 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-11-28T11:40:32.124 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 6529 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc7.ko 2023-11-28T11:40:32.124 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7025 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-11-28T11:40:32.124 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/ 2023-11-28T11:40:32.124 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7097 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-11-28T11:40:32.124 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 37081 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-11-28T11:40:32.124 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13313 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/interval_tree_test.ko 2023-11-28T11:40:32.124 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-11-28T11:40:32.124 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24953 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-11-28T11:40:32.124 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/ 2023-11-28T11:40:32.124 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-11-28T11:40:32.124 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22633 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-11-28T11:40:32.124 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/ 2023-11-28T11:40:32.124 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 6617 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-11-28T11:40:32.125 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8233 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/memory-notifier-error-inject.ko 2023-11-28T11:40:32.125 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10865 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/notifier-error-inject.ko 2023-11-28T11:40:32.125 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14089 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/percpu_test.ko 2023-11-28T11:40:32.125 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8305 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/pm-notifier-error-inject.ko 2023-11-28T11:40:32.125 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/ 2023-11-28T11:40:32.125 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 143433 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-11-28T11:40:32.125 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21105 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/rbtree_test.ko 2023-11-28T11:40:32.125 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/ 2023-11-28T11:40:32.125 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18753 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-28T11:40:32.125 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 38841 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-kstrtox.ko 2023-11-28T11:40:32.125 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-string_helpers.ko 2023-11-28T11:40:32.125 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 4760425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_bpf.ko 2023-11-28T11:40:32.125 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 49089 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_firmware.ko 2023-11-28T11:40:32.126 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 6369 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_module.ko 2023-11-28T11:40:32.126 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_user_copy.ko 2023-11-28T11:40:32.126 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-11-28T11:40:32.126 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11121 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-11-28T11:40:32.126 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-11-28T11:40:32.126 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/ 2023-11-28T11:40:32.126 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13545 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/xz_dec_test.ko 2023-11-28T11:40:32.126 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/ 2023-11-28T11:40:32.126 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-11-28T11:40:32.126 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ 2023-11-28T11:40:32.126 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/ 2023-11-28T11:40:32.126 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 55737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-11-28T11:40:32.126 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7049 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-11-28T11:40:32.127 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7065 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-11-28T11:40:32.127 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7049 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-11-28T11:40:32.127 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 6985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-28T11:40:32.127 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7065 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-11-28T11:40:32.127 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7001 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-11-28T11:40:32.127 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-11-28T11:40:32.127 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/ 2023-11-28T11:40:32.127 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30385 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-11-28T11:40:32.127 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34809 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-11-28T11:40:32.127 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8545 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-11-28T11:40:32.127 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16345 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-11-28T11:40:32.129 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-11-28T11:40:32.129 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/ 2023-11-28T11:40:32.129 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 81737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-11-28T11:40:32.129 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/ 2023-11-28T11:40:32.129 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 198337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-11-28T11:40:32.129 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 35977 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-11-28T11:40:32.129 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26345 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-11-28T11:40:32.129 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 32337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-11-28T11:40:32.129 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/ 2023-11-28T11:40:32.129 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 649297 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-11-28T11:40:32.130 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/ 2023-11-28T11:40:32.130 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 63809 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-11-28T11:40:32.130 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 777689 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-11-28T11:40:32.130 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ 2023-11-28T11:40:32.130 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7657 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-28T11:40:32.130 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12385 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-28T11:40:32.130 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9169 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-28T11:40:32.130 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-28T11:40:32.130 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-28T11:40:32.130 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-28T11:40:32.130 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9145 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-28T11:40:32.130 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-28T11:40:32.131 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13217 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-28T11:40:32.131 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-28T11:40:32.131 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7593 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-28T11:40:32.131 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8385 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-28T11:40:32.131 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-28T11:40:32.131 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9593 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-28T11:40:32.131 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8649 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-28T11:40:32.131 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-28T11:40:32.131 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12401 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-28T11:40:32.131 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11529 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-28T11:40:32.131 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-28T11:40:32.131 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9793 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-28T11:40:32.131 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 55929 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-11-28T11:40:32.131 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14041 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-28T11:40:32.132 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13945 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-28T11:40:32.132 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/ 2023-11-28T11:40:32.132 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 1046833 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-11-28T11:40:32.132 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/ 2023-11-28T11:40:32.132 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 125993 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-11-28T11:40:32.132 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/ 2023-11-28T11:40:32.132 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 194209 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-11-28T11:40:32.132 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8665 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-11-28T11:40:32.132 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 57881 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-11-28T11:40:32.132 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 60337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-11-28T11:40:32.132 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/ 2023-11-28T11:40:32.132 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 390473 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-11-28T11:40:32.133 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-11-28T11:40:32.133 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12577 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-11-28T11:40:32.133 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-11-28T11:40:32.133 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8953 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-11-28T11:40:32.133 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/ 2023-11-28T11:40:32.133 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 99729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/hsr.ko 2023-11-28T11:40:32.133 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ 2023-11-28T11:40:32.133 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ 2023-11-28T11:40:32.133 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 45233 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-28T11:40:32.133 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 254625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-11-28T11:40:32.133 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 47289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-28T11:40:32.133 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ 2023-11-28T11:40:32.134 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-11-28T11:40:32.134 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 38905 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-11-28T11:40:32.134 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 48337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-11-28T11:40:32.134 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18121 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-11-28T11:40:32.134 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 48657 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-11-28T11:40:32.134 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 60633 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-11-28T11:40:32.134 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 61225 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-11-28T11:40:32.134 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34505 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-11-28T11:40:32.134 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14001 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-11-28T11:40:32.134 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28841 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-11-28T11:40:32.134 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ 2023-11-28T11:40:32.134 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 37641 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-28T11:40:32.134 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8873 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-28T11:40:32.135 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10409 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-28T11:40:32.135 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 41609 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ip_tables.ko 2023-11-28T11:40:32.135 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10057 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-28T11:40:32.135 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9681 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-11-28T11:40:32.135 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14121 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-28T11:40:32.135 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11177 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-28T11:40:32.135 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14881 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-28T11:40:32.135 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11305 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-11-28T11:40:32.135 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11649 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-28T11:40:32.135 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14905 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-28T11:40:32.135 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11545 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-28T11:40:32.135 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10409 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-28T11:40:32.135 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-28T11:40:32.135 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-28T11:40:32.136 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-28T11:40:32.136 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18161 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-28T11:40:32.136 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-28T11:40:32.136 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20561 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-11-28T11:40:32.136 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-28T11:40:32.136 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15177 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-28T11:40:32.136 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9961 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-28T11:40:32.136 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17113 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-28T11:40:32.136 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9009 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-28T11:40:32.136 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-11-28T11:40:32.136 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-11-28T11:40:32.136 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15369 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-11-28T11:40:32.136 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-11-28T11:40:32.137 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12401 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-11-28T11:40:32.137 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-11-28T11:40:32.137 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11473 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-11-28T11:40:32.137 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10433 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-11-28T11:40:32.137 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-11-28T11:40:32.137 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-11-28T11:40:32.137 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10089 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-11-28T11:40:32.137 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10953 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-11-28T11:40:32.137 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10185 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-11-28T11:40:32.137 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22601 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-11-28T11:40:32.137 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17097 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-11-28T11:40:32.137 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 41665 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-11-28T11:40:32.137 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11361 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-28T11:40:32.137 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ 2023-11-28T11:40:32.138 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26377 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-11-28T11:40:32.138 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 39537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-11-28T11:40:32.138 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-11-28T11:40:32.138 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 80897 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_gre.ko 2023-11-28T11:40:32.138 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 93577 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-11-28T11:40:32.138 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-28T11:40:32.138 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 53273 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-11-28T11:40:32.138 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13785 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-11-28T11:40:32.138 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19017 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/mip6.ko 2023-11-28T11:40:32.138 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ 2023-11-28T11:40:32.138 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 42169 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-28T11:40:32.138 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11753 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-11-28T11:40:32.138 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9753 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-28T11:40:32.139 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14137 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-28T11:40:32.139 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14273 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-28T11:40:32.139 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-28T11:40:32.139 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16209 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-28T11:40:32.139 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16033 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-28T11:40:32.139 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8913 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-28T11:40:32.139 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9897 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-28T11:40:32.139 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10937 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-28T11:40:32.139 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10897 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-28T11:40:32.139 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-28T11:40:32.139 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11121 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-28T11:40:32.139 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15009 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-28T11:40:32.139 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11553 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-28T11:40:32.140 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10433 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-28T11:40:32.140 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 39113 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-28T11:40:32.140 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-28T11:40:32.140 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25945 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-28T11:40:32.140 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-28T11:40:32.140 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15393 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-28T11:40:32.140 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9633 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-28T11:40:32.140 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16025 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-28T11:40:32.140 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9009 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-28T11:40:32.140 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 74073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-11-28T11:40:32.140 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24193 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-11-28T11:40:32.140 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23297 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-28T11:40:32.140 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/ 2023-11-28T11:40:32.141 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 82833 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-11-28T11:40:32.141 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/ 2023-11-28T11:40:32.141 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 125281 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-11-28T11:40:32.141 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20177 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-28T11:40:32.141 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25953 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-11-28T11:40:32.141 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 35569 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-11-28T11:40:32.141 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 36713 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-11-28T11:40:32.141 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33001 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-11-28T11:40:32.141 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 53241 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-11-28T11:40:32.141 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/ 2023-11-28T11:40:32.141 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 47977 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/lapb.ko 2023-11-28T11:40:32.141 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/ 2023-11-28T11:40:32.142 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23193 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-11-28T11:40:32.142 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 267913 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc2.ko 2023-11-28T11:40:32.142 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/ 2023-11-28T11:40:32.142 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 290417 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-11-28T11:40:32.142 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/ 2023-11-28T11:40:32.142 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9393 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-11-28T11:40:32.142 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ 2023-11-28T11:40:32.142 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ 2023-11-28T11:40:32.142 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 119585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-11-28T11:40:32.142 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28353 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-28T11:40:32.142 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26913 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-28T11:40:32.143 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26369 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-28T11:40:32.143 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 100297 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-28T11:40:32.143 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 101441 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-28T11:40:32.143 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 102817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-28T11:40:32.143 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 103417 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-28T11:40:32.143 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 112849 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-28T11:40:32.143 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 60329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-28T11:40:32.143 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 109593 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-28T11:40:32.143 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 113129 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-28T11:40:32.143 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 112585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-28T11:40:32.143 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 111585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-28T11:40:32.144 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 114465 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-28T11:40:32.144 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30025 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-28T11:40:32.144 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ 2023-11-28T11:40:32.144 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 411729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-28T11:40:32.144 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11961 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-28T11:40:32.144 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-28T11:40:32.144 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-28T11:40:32.144 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17905 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-28T11:40:32.144 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20673 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-28T11:40:32.144 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7689 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-28T11:40:32.144 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7689 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-28T11:40:32.144 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10681 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-28T11:40:32.144 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9233 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-28T11:40:32.145 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7697 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-28T11:40:32.145 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-28T11:40:32.145 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7697 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-28T11:40:32.145 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10993 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-28T11:40:32.145 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 49257 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-11-28T11:40:32.145 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 408257 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-11-28T11:40:32.145 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-28T11:40:32.145 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10177 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-28T11:40:32.145 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33761 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-28T11:40:32.145 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 118145 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-28T11:40:32.145 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22185 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-28T11:40:32.145 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-28T11:40:32.145 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 107233 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-28T11:40:32.145 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33633 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-28T11:40:32.146 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17401 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-28T11:40:32.146 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 66641 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-28T11:40:32.146 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11233 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-28T11:40:32.146 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19185 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-28T11:40:32.146 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10113 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-28T11:40:32.146 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 89425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-11-28T11:40:32.146 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9593 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-28T11:40:32.146 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 37129 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-11-28T11:40:32.146 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 95353 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-11-28T11:40:32.146 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10129 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-28T11:40:32.146 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-28T11:40:32.146 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11857 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-11-28T11:40:32.146 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28929 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-11-28T11:40:32.147 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8809 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-28T11:40:32.147 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 44065 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-28T11:40:32.147 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 615649 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-11-28T11:40:32.147 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 42561 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-11-28T11:40:32.147 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30233 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-28T11:40:32.147 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30569 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-11-28T11:40:32.147 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 39785 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-11-28T11:40:32.147 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22921 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-28T11:40:32.147 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 49377 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-28T11:40:32.147 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10457 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-11-28T11:40:32.147 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33209 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-11-28T11:40:32.148 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 40721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-11-28T11:40:32.148 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9601 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-28T11:40:32.148 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11401 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-11-28T11:40:32.148 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13745 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-28T11:40:32.148 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14185 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-11-28T11:40:32.148 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20065 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-11-28T11:40:32.148 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15401 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-11-28T11:40:32.148 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-11-28T11:40:32.148 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-11-28T11:40:32.148 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13673 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-11-28T11:40:32.149 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11841 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_osf.ko 2023-11-28T11:40:32.149 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-11-28T11:40:32.149 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14193 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-11-28T11:40:32.149 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-11-28T11:40:32.149 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10081 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-11-28T11:40:32.149 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-11-28T11:40:32.149 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20369 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_synproxy.ko 2023-11-28T11:40:32.149 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14849 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tproxy.ko 2023-11-28T11:40:32.149 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 89313 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/x_tables.ko 2023-11-28T11:40:32.149 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12097 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-11-28T11:40:32.149 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9633 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-28T11:40:32.149 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-28T11:40:32.149 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-28T11:40:32.150 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18169 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-11-28T11:40:32.150 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-11-28T11:40:32.150 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9465 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-11-28T11:40:32.150 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13369 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-11-28T11:40:32.150 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 38873 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-28T11:40:32.150 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13889 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-11-28T11:40:32.150 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11489 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-11-28T11:40:32.150 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11753 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-28T11:40:32.150 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11657 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-11-28T11:40:32.151 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9473 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-11-28T11:40:32.151 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-28T11:40:32.151 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19665 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-11-28T11:40:32.151 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-28T11:40:32.151 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-11-28T11:40:32.151 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16057 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-28T11:40:32.151 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10433 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-28T11:40:32.151 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17361 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-11-28T11:40:32.151 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16785 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-11-28T11:40:32.151 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-11-28T11:40:32.151 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13897 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-11-28T11:40:32.152 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13897 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-11-28T11:40:32.152 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15529 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-11-28T11:40:32.152 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11209 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-11-28T11:40:32.152 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7505 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-11-28T11:40:32.152 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10465 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-11-28T11:40:32.152 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11081 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-11-28T11:40:32.152 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9401 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-11-28T11:40:32.152 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13129 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-11-28T11:40:32.152 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12401 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-11-28T11:40:32.152 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-11-28T11:40:32.153 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10969 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-11-28T11:40:32.153 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7865 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-11-28T11:40:32.153 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-11-28T11:40:32.153 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10657 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-11-28T11:40:32.153 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11473 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-11-28T11:40:32.153 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 43289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-11-28T11:40:32.153 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11313 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-11-28T11:40:32.153 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7865 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-11-28T11:40:32.153 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11921 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-11-28T11:40:32.153 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11473 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-11-28T11:40:32.154 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11785 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-11-28T11:40:32.154 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16041 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-11-28T11:40:32.154 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8001 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-11-28T11:40:32.154 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10209 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-11-28T11:40:32.154 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7545 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-11-28T11:40:32.154 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8577 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-11-28T11:40:32.154 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-11-28T11:40:32.154 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-11-28T11:40:32.154 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10105 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-11-28T11:40:32.154 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8297 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-11-28T11:40:32.154 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9553 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-11-28T11:40:32.155 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-11-28T11:40:32.155 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7633 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-11-28T11:40:32.155 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-11-28T11:40:32.155 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9473 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-11-28T11:40:32.155 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10409 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-11-28T11:40:32.155 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8257 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-11-28T11:40:32.155 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 36433 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-11-28T11:40:32.155 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-11-28T11:40:32.155 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30089 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-11-28T11:40:32.155 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16089 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-11-28T11:40:32.156 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9505 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-11-28T11:40:32.156 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9473 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-11-28T11:40:32.156 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8809 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-11-28T11:40:32.156 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8553 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-11-28T11:40:32.156 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15777 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpudp.ko 2023-11-28T11:40:32.156 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11065 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-11-28T11:40:32.156 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9401 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-11-28T11:40:32.156 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/ 2023-11-28T11:40:32.157 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13969 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-11-28T11:40:32.157 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/ 2023-11-28T11:40:32.157 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-11-28T11:40:32.157 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/ 2023-11-28T11:40:32.157 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 380033 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-11-28T11:40:32.157 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10257 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-11-28T11:40:32.157 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-11-28T11:40:32.157 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11793 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-11-28T11:40:32.158 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/ 2023-11-28T11:40:32.158 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13057 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-11-28T11:40:32.158 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/ 2023-11-28T11:40:32.158 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 110201 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/phonet.ko 2023-11-28T11:40:32.158 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 54721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/pn_pep.ko 2023-11-28T11:40:32.158 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/ 2023-11-28T11:40:32.158 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 251481 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-11-28T11:40:32.158 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 164937 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-11-28T11:40:32.158 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 67377 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-11-28T11:40:32.158 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/ 2023-11-28T11:40:32.159 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 819657 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/rxrpc.ko 2023-11-28T11:40:32.159 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/ 2023-11-28T11:40:32.159 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 32241 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-11-28T11:40:32.159 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23577 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-11-28T11:40:32.159 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26873 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-11-28T11:40:32.159 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34097 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-11-28T11:40:32.159 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23401 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-11-28T11:40:32.159 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 43449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-11-28T11:40:32.159 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 31961 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-11-28T11:40:32.159 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-11-28T11:40:32.159 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 35297 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-11-28T11:40:32.159 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 36665 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-11-28T11:40:32.159 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26169 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-11-28T11:40:32.160 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33961 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-11-28T11:40:32.160 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19169 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_cgroup.ko 2023-11-28T11:40:32.160 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 31401 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-11-28T11:40:32.160 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 31769 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-11-28T11:40:32.160 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 38425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-11-28T11:40:32.160 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 61409 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-11-28T11:40:32.160 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7441 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-11-28T11:40:32.160 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13409 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-11-28T11:40:32.160 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-11-28T11:40:32.160 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7897 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-11-28T11:40:32.160 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-11-28T11:40:32.160 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7249 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-11-28T11:40:32.160 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21649 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-11-28T11:40:32.161 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20849 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-11-28T11:40:32.161 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34633 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-11-28T11:40:32.161 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33609 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-11-28T11:40:32.161 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 31617 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq_codel.ko 2023-11-28T11:40:32.161 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 35433 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-11-28T11:40:32.161 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 49817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-11-28T11:40:32.161 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22089 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-11-28T11:40:32.161 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 66393 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-11-28T11:40:32.161 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-11-28T11:40:32.161 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30273 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-11-28T11:40:32.161 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10793 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-11-28T11:40:32.161 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26065 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-11-28T11:40:32.161 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 36137 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-11-28T11:40:32.161 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-11-28T11:40:32.162 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-11-28T11:40:32.162 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-11-28T11:40:32.162 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 48729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-11-28T11:40:32.162 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 32905 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-11-28T11:40:32.162 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26881 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-11-28T11:40:32.162 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 31353 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-11-28T11:40:32.162 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28897 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-11-28T11:40:32.162 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28105 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-11-28T11:40:32.162 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/ 2023-11-28T11:40:32.162 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 929745 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-11-28T11:40:32.162 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19033 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-11-28T11:40:32.162 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/ 2023-11-28T11:40:32.163 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/ 2023-11-28T11:40:32.163 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 336529 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-28T11:40:32.163 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 54737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-28T11:40:32.163 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 1520097 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-11-28T11:40:32.163 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/ 2023-11-28T11:40:32.163 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 707657 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-28T11:40:32.163 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/ 2023-11-28T11:40:32.163 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10025 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-11-28T11:40:32.163 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 862665 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-11-28T11:40:32.163 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/ 2023-11-28T11:40:32.163 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-11-28T11:40:32.163 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/ 2023-11-28T11:40:32.163 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 85409 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-28T11:40:32.163 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 68049 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-28T11:40:32.164 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 96193 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-11-28T11:40:32.164 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10705 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-28T11:40:32.164 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-28T11:40:32.164 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/ 2023-11-28T11:40:32.164 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 125177 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/x25.ko 2023-11-28T11:40:32.164 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/ 2023-11-28T11:40:32.164 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22657 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_algo.ko 2023-11-28T11:40:32.164 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20649 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-28T11:40:32.164 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 102257 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_user.ko 2023-11-28T11:40:32.164 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/ 2023-11-28T11:40:32.164 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/ 2023-11-28T11:40:32.164 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-11-28T11:40:32.164 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 640081 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-11-28T11:40:32.165 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 624107 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-28T11:40:32.165 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7663 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-11-28T11:40:32.165 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23428 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-28T11:40:32.165 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9821 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-28T11:40:32.165 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 70004 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-11-28T11:40:32.165 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 146313 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-11-28T11:40:32.165 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 232548 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-28T11:40:32.165 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 210 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-11-28T11:40:32.165 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 72606 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-11-28T11:40:32.165 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 879 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-11-28T11:40:32.165 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 254438 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-11-28T11:40:32.165 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 309363 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-28T11:40:32.165 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./usr/ 2023-11-28T11:40:32.166 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./usr/share/ 2023-11-28T11:40:32.166 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./usr/share/doc/ 2023-11-28T11:40:32.166 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/ 2023-11-28T11:40:32.166 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 172 2023-11-23 04:11 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/changelog.Debian.gz 2023-11-28T11:40:32.166 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 691 2023-11-23 04:11 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/copyright 2023-11-28T11:40:32.167 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-11-28T11:40:32.167 INFO:teuthology.task.kernel:searching for kernel 6.6.0-g8247bbb5b470 2023-11-28T11:40:32.167 DEBUG:teuthology.orchestra.run.smithi184:> egrep '(submenu|menuentry.*6.6.0-g8247bbb5b470).*{' /boot/grub/grub.cfg 2023-11-28T11:40:32.176 INFO:teuthology.orchestra.run.smithi184.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-11-28T11:40:32.176 INFO:teuthology.orchestra.run.smithi184.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-11-28T11:40:32.176 INFO:teuthology.orchestra.run.smithi184.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-11-28T11:40:32.176 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-11-28T11:40:32.177 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-g8247bbb5b470 2023-11-28T11:40:32.177 DEBUG:teuthology.orchestra.run.smithi184:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-11-28T11:40:32.179 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi184.front.sepia.ceph.com to complete... 2023-11-28T11:40:32.639 INFO:teuthology.orchestra.run.smithi039.stderr:Sourcing file `/etc/default/grub' 2023-11-28T11:40:32.645 INFO:teuthology.orchestra.run.smithi039.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-28T11:40:32.692 INFO:teuthology.orchestra.run.smithi039.stderr:Generating grub configuration file ... 2023-11-28T11:40:32.827 INFO:teuthology.orchestra.run.smithi184.stderr:Sourcing file `/etc/default/grub' 2023-11-28T11:40:32.837 INFO:teuthology.orchestra.run.smithi184.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-28T11:40:32.856 INFO:teuthology.orchestra.run.smithi184.stderr:Generating grub configuration file ... 2023-11-28T11:40:33.008 INFO:teuthology.orchestra.run.smithi039.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T11:40:33.029 INFO:teuthology.orchestra.run.smithi039.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T11:40:33.123 INFO:teuthology.orchestra.run.smithi184.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T11:40:33.135 INFO:teuthology.orchestra.run.smithi184.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T11:40:33.391 INFO:teuthology.orchestra.run.smithi039.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-11-28T11:40:33.404 INFO:teuthology.orchestra.run.smithi039.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-11-28T11:40:33.488 INFO:teuthology.orchestra.run.smithi184.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-11-28T11:40:33.499 INFO:teuthology.orchestra.run.smithi184.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-11-28T11:40:34.997 INFO:teuthology.orchestra.run.smithi184.stderr:done 2023-11-28T11:40:35.435 INFO:teuthology.orchestra.run.smithi039.stderr:done 2023-11-28T11:40:35.586 DEBUG:teuthology.orchestra.run.smithi039:> dpkg-deb -c /tmp/linux-image.deb 2023-11-28T11:40:35.596 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./ 2023-11-28T11:40:35.596 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./boot/ 2023-11-28T11:40:35.596 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 4415617 2023-11-23 04:11 ./boot/System.map-6.6.0-g8247bbb5b470 2023-11-28T11:40:35.611 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 169214 2023-11-23 04:11 ./boot/config-6.6.0-g8247bbb5b470 2023-11-28T11:40:35.612 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11352832 2023-11-23 04:11 ./boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T11:40:35.635 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./etc/ 2023-11-28T11:40:35.635 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./etc/kernel/ 2023-11-28T11:40:35.635 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./etc/kernel/postinst.d/ 2023-11-28T11:40:35.636 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./etc/kernel/postrm.d/ 2023-11-28T11:40:35.636 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./etc/kernel/preinst.d/ 2023-11-28T11:40:35.636 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./etc/kernel/prerm.d/ 2023-11-28T11:40:35.636 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/ 2023-11-28T11:40:35.636 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/ 2023-11-28T11:40:35.636 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/ 2023-11-28T11:40:35.636 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/ 2023-11-28T11:40:35.636 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/ 2023-11-28T11:40:35.636 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/ 2023-11-28T11:40:35.636 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ 2023-11-28T11:40:35.637 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 490233 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/aesni-intel.ko 2023-11-28T11:40:35.637 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-28T11:40:35.637 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29529 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-28T11:40:35.637 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30313 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-28T11:40:35.637 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 93113 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-28T11:40:35.637 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 106729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-28T11:40:35.639 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 152241 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-28T11:40:35.639 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12553 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-28T11:40:35.639 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13777 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-28T11:40:35.640 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 83889 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-28T11:40:35.640 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-28T11:40:35.640 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 47225 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-28T11:40:35.640 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 47209 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-28T11:40:35.640 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 51801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-28T11:40:35.640 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38937 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-28T11:40:35.640 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40529 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-28T11:40:35.640 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 58585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-28T11:40:35.640 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 50497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-28T11:40:35.640 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32065 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-28T11:40:35.640 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-28T11:40:35.640 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/ 2023-11-28T11:40:35.640 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/ 2023-11-28T11:40:35.641 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/ 2023-11-28T11:40:35.641 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40113 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-28T11:40:35.641 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13353 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpuid.ko 2023-11-28T11:40:35.641 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17937 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/msr.ko 2023-11-28T11:40:35.641 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/ 2023-11-28T11:40:35.641 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 354433 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-28T11:40:35.641 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 881625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-28T11:40:35.641 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 2275865 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-11-28T11:40:35.688 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ 2023-11-28T11:40:35.688 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 53697 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/af_alg.ko 2023-11-28T11:40:35.688 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23097 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_hash.ko 2023-11-28T11:40:35.688 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_skcipher.ko 2023-11-28T11:40:35.688 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17209 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-11-28T11:40:35.688 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19641 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-11-28T11:40:35.688 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10145 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-11-28T11:40:35.688 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/ 2023-11-28T11:40:35.689 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10185 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-11-28T11:40:35.689 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/ 2023-11-28T11:40:35.689 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11249 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-11-28T11:40:35.689 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19473 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-11-28T11:40:35.689 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21561 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-28T11:40:35.689 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-11-28T11:40:35.689 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17745 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-11-28T11:40:35.689 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17921 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-11-28T11:40:35.689 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20489 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-11-28T11:40:35.689 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22577 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-11-28T11:40:35.689 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-11-28T11:40:35.689 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-11-28T11:40:35.690 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-11-28T11:40:35.690 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38809 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-11-28T11:40:35.690 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-11-28T11:40:35.690 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17745 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-11-28T11:40:35.690 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-11-28T11:40:35.690 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35097 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-11-28T11:40:35.690 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14769 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-11-28T11:40:35.690 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-11-28T11:40:35.690 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 47505 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cryptd.ko 2023-11-28T11:40:35.690 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39505 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-11-28T11:40:35.690 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26953 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_simd.ko 2023-11-28T11:40:35.690 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-11-28T11:40:35.691 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-11-28T11:40:35.691 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10913 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-11-28T11:40:35.691 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15681 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-11-28T11:40:35.691 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11001 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-11-28T11:40:35.691 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-11-28T11:40:35.691 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17993 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-11-28T11:40:35.691 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26897 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-11-28T11:40:35.691 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15649 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lrw.ko 2023-11-28T11:40:35.691 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11513 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-11-28T11:40:35.691 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11529 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-11-28T11:40:35.691 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11697 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-11-28T11:40:35.691 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-11-28T11:40:35.692 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10673 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-11-28T11:40:35.692 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18745 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-11-28T11:40:35.692 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16049 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-11-28T11:40:35.692 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29393 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-11-28T11:40:35.692 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27081 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-11-28T11:40:35.692 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 149193 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-11-28T11:40:35.692 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10881 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-11-28T11:40:35.692 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28777 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-11-28T11:40:35.692 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13169 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-11-28T11:40:35.692 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17401 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-11-28T11:40:35.692 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36185 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-11-28T11:40:35.693 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14105 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-11-28T11:40:35.693 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26665 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-11-28T11:40:35.693 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18713 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xts.ko 2023-11-28T11:40:35.693 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9481 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-11-28T11:40:35.693 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ 2023-11-28T11:40:35.693 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ 2023-11-28T11:40:35.693 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18249 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_extlog.ko 2023-11-28T11:40:35.693 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-28T11:40:35.693 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28793 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-11-28T11:40:35.693 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/ 2023-11-28T11:40:35.693 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31241 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/einj.ko 2023-11-28T11:40:35.693 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-11-28T11:40:35.694 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14937 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-11-28T11:40:35.694 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24401 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-11-28T11:40:35.694 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-11-28T11:40:35.694 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 103025 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-11-28T11:40:35.694 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ 2023-11-28T11:40:35.694 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21601 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-11-28T11:40:35.694 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 88865 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci.ko 2023-11-28T11:40:35.694 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-11-28T11:40:35.694 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 88289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci.ko 2023-11-28T11:40:35.694 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-11-28T11:40:35.694 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17137 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-11-28T11:40:35.695 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30433 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-11-28T11:40:35.695 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33505 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-11-28T11:40:35.695 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21265 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-11-28T11:40:35.695 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21121 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-11-28T11:40:35.695 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24945 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-11-28T11:40:35.695 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17657 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-11-28T11:40:35.695 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25185 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-11-28T11:40:35.695 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15049 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-11-28T11:40:35.695 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17849 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-11-28T11:40:35.695 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21945 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-11-28T11:40:35.695 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33977 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-11-28T11:40:35.695 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23129 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-28T11:40:35.696 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16921 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-28T11:40:35.696 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16993 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-11-28T11:40:35.696 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35273 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-11-28T11:40:35.696 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12889 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-11-28T11:40:35.696 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 51481 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_legacy.ko 2023-11-28T11:40:35.696 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15185 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-11-28T11:40:35.696 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16281 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-11-28T11:40:35.696 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12833 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-11-28T11:40:35.696 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-11-28T11:40:35.696 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15105 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-11-28T11:40:35.696 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17361 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-11-28T11:40:35.696 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16569 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-11-28T11:40:35.696 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15377 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-11-28T11:40:35.697 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20681 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-11-28T11:40:35.697 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-11-28T11:40:35.697 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37793 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-28T11:40:35.697 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20561 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-28T11:40:35.697 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14225 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-11-28T11:40:35.697 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_radisys.ko 2023-11-28T11:40:35.697 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-11-28T11:40:35.697 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rz1000.ko 2023-11-28T11:40:35.697 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13937 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-11-28T11:40:35.698 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23097 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-11-28T11:40:35.698 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23457 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-11-28T11:40:35.698 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19697 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-11-28T11:40:35.698 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16009 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-11-28T11:40:35.698 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30433 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-11-28T11:40:35.698 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22793 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-11-28T11:40:35.698 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29121 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-11-28T11:40:35.698 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 83345 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-11-28T11:40:35.698 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 70393 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-11-28T11:40:35.698 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37377 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-11-28T11:40:35.698 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23041 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-11-28T11:40:35.698 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29273 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-11-28T11:40:35.698 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-11-28T11:40:35.699 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17945 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-11-28T11:40:35.699 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20441 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-11-28T11:40:35.699 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 44793 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-11-28T11:40:35.699 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15601 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-11-28T11:40:35.699 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35065 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-11-28T11:40:35.699 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20065 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-11-28T11:40:35.699 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ 2023-11-28T11:40:35.699 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-11-28T11:40:35.699 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/ 2023-11-28T11:40:35.699 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 124473 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-11-28T11:40:35.699 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/ 2023-11-28T11:40:35.699 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/ 2023-11-28T11:40:35.700 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 113665 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-11-28T11:40:35.700 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/ 2023-11-28T11:40:35.700 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 965585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-11-28T11:40:35.700 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 173225 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-11-28T11:40:35.700 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/ 2023-11-28T11:40:35.700 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 94297 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-28T11:40:35.700 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 115793 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-11-28T11:40:35.700 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/ 2023-11-28T11:40:35.700 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 110385 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-11-28T11:40:35.700 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 98193 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-11-28T11:40:35.700 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 263769 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-11-28T11:40:35.700 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/ 2023-11-28T11:40:35.700 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 98145 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-28T11:40:35.701 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/ 2023-11-28T11:40:35.701 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 60217 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-11-28T11:40:35.701 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ 2023-11-28T11:40:35.701 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30705 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/applicom.ko 2023-11-28T11:40:35.701 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12009 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-11-28T11:40:35.701 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/ 2023-11-28T11:40:35.701 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13889 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-28T11:40:35.701 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18809 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-28T11:40:35.701 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13169 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-28T11:40:35.701 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10673 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-11-28T11:40:35.701 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15633 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-28T11:40:35.701 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ 2023-11-28T11:40:35.702 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30713 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-28T11:40:35.702 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 148601 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-28T11:40:35.702 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26569 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-28T11:40:35.702 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 139313 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-28T11:40:35.702 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 70921 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-28T11:40:35.702 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 53513 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-28T11:40:35.702 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-11-28T11:40:35.702 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/ 2023-11-28T11:40:35.702 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 84097 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-11-28T11:40:35.702 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25873 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/nvram.ko 2023-11-28T11:40:35.702 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32169 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-11-28T11:40:35.703 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 51113 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-11-28T11:40:35.703 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/ 2023-11-28T11:40:35.703 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16401 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-28T11:40:35.703 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15881 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-11-28T11:40:35.703 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23473 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-11-28T11:40:35.703 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-11-28T11:40:35.703 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30121 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-28T11:40:35.703 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22697 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-28T11:40:35.703 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23561 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-11-28T11:40:35.703 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/ 2023-11-28T11:40:35.703 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17001 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_class.ko 2023-11-28T11:40:35.704 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 50945 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_core.ko 2023-11-28T11:40:35.704 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12393 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-11-28T11:40:35.704 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/ 2023-11-28T11:40:35.704 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12489 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-palmas.ko 2023-11-28T11:40:35.704 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 47849 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-si5351.ko 2023-11-28T11:40:35.704 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11457 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-twl6040.ko 2023-11-28T11:40:35.704 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19249 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-wm831x.ko 2023-11-28T11:40:35.704 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/ 2023-11-28T11:40:35.704 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10097 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-28T11:40:35.704 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16833 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-28T11:40:35.704 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25297 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-28T11:40:35.704 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ 2023-11-28T11:40:35.704 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ 2023-11-28T11:40:35.705 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 70801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-28T11:40:35.705 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 243025 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-11-28T11:40:35.705 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/ 2023-11-28T11:40:35.705 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/ 2023-11-28T11:40:35.705 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/ 2023-11-28T11:40:35.705 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 438761 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-28T11:40:35.705 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-11-28T11:40:35.705 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24081 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-28T11:40:35.705 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19937 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-11-28T11:40:35.705 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-11-28T11:40:35.705 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/ 2023-11-28T11:40:35.706 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 70273 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-28T11:40:35.706 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/ 2023-11-28T11:40:35.706 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29785 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-11-28T11:40:35.706 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ 2023-11-28T11:40:35.706 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/ 2023-11-28T11:40:35.706 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15857 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-28T11:40:35.706 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ 2023-11-28T11:40:35.706 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 122569 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-28T11:40:35.706 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ 2023-11-28T11:40:35.706 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 79953 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-11-28T11:40:35.706 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35769 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-11-28T11:40:35.707 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 63617 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-11-28T11:40:35.707 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18105 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-11-28T11:40:35.707 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18065 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-11-28T11:40:35.707 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-11-28T11:40:35.707 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25657 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-11-28T11:40:35.707 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24913 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-11-28T11:40:35.707 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 52041 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-11-28T11:40:35.707 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18433 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-11-28T11:40:35.707 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20017 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-11-28T11:40:35.707 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 56825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-11-28T11:40:35.707 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17529 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-11-28T11:40:35.707 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/ 2023-11-28T11:40:35.707 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12673 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-gpio.ko 2023-11-28T11:40:35.708 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27185 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max14577.ko 2023-11-28T11:40:35.708 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29569 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max77693.ko 2023-11-28T11:40:35.708 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24745 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max8997.ko 2023-11-28T11:40:35.708 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-palmas.ko 2023-11-28T11:40:35.708 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23713 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-rt8973a.ko 2023-11-28T11:40:35.708 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27785 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-sm5502.ko 2023-11-28T11:40:35.708 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/ 2023-11-28T11:40:35.708 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34977 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/dmi-sysfs.ko 2023-11-28T11:40:35.708 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/ 2023-11-28T11:40:35.708 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/efi-pstore.ko 2023-11-28T11:40:35.708 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-28T11:40:35.708 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/ 2023-11-28T11:40:35.709 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12305 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-adp5520.ko 2023-11-28T11:40:35.709 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20153 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-amd8111.ko 2023-11-28T11:40:35.709 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14993 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-arizona.ko 2023-11-28T11:40:35.709 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13841 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9052.ko 2023-11-28T11:40:35.709 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11921 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9055.ko 2023-11-28T11:40:35.709 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22065 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-dln2.ko 2023-11-28T11:40:35.709 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 77849 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-f7188x.ko 2023-11-28T11:40:35.709 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28937 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-generic.ko 2023-11-28T11:40:35.709 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19569 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-11-28T11:40:35.709 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11905 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-11-28T11:40:35.709 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14113 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-kempld.ko 2023-11-28T11:40:35.709 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-lp3943.ko 2023-11-28T11:40:35.710 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9505 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max7300.ko 2023-11-28T11:40:35.710 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11905 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max730x.ko 2023-11-28T11:40:35.710 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max732x.ko 2023-11-28T11:40:35.710 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25145 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-11-28T11:40:35.710 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 47073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pca953x.ko 2023-11-28T11:40:35.710 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pcf857x.ko 2023-11-28T11:40:35.710 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14377 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-rdc321x.ko 2023-11-28T11:40:35.710 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20593 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch.ko 2023-11-28T11:40:35.710 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19505 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch311x.ko 2023-11-28T11:40:35.710 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12145 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-tps65912.ko 2023-11-28T11:40:35.710 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21057 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl4030.ko 2023-11-28T11:40:35.710 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl6040.ko 2023-11-28T11:40:35.711 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20601 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-28T11:40:35.711 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15377 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-vx855.ko 2023-11-28T11:40:35.711 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16281 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm831x.ko 2023-11-28T11:40:35.711 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11617 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8350.ko 2023-11-28T11:40:35.711 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16753 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8994.ko 2023-11-28T11:40:35.711 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/ 2023-11-28T11:40:35.711 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11577 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-a4tech.ko 2023-11-28T11:40:35.711 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39169 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-apple.ko 2023-11-28T11:40:35.711 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14481 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-11-28T11:40:35.711 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8353 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-11-28T11:40:35.711 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15169 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-11-28T11:40:35.711 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11049 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-belkin.ko 2023-11-28T11:40:35.711 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10313 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cherry.ko 2023-11-28T11:40:35.712 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16041 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-chicony.ko 2023-11-28T11:40:35.712 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 60649 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cp2112.ko 2023-11-28T11:40:35.712 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11049 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cypress.ko 2023-11-28T11:40:35.712 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16385 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-11-28T11:40:35.712 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10697 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-11-28T11:40:35.712 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17665 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-11-28T11:40:35.712 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13457 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-11-28T11:40:35.712 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10105 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ezkey.ko 2023-11-28T11:40:35.712 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14305 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-11-28T11:40:35.712 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9225 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-generic.ko 2023-11-28T11:40:35.713 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17129 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-11-28T11:40:35.713 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12681 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-11-28T11:40:35.713 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10161 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-28T11:40:35.713 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10457 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-28T11:40:35.713 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-11-28T11:40:35.713 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19105 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-11-28T11:40:35.713 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10489 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-11-28T11:40:35.713 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9241 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kensington.ko 2023-11-28T11:40:35.713 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8545 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-11-28T11:40:35.713 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17201 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-11-28T11:40:35.713 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10809 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-11-28T11:40:35.713 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-11-28T11:40:35.714 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 42297 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-11-28T11:40:35.714 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30697 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lg-g15.ko 2023-11-28T11:40:35.714 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 58185 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-28T11:40:35.714 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 101481 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-28T11:40:35.714 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 80993 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech.ko 2023-11-28T11:40:35.714 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-magicmouse.ko 2023-11-28T11:40:35.714 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21969 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-microsoft.ko 2023-11-28T11:40:35.714 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10361 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-monterey.ko 2023-11-28T11:40:35.714 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 50161 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-11-28T11:40:35.714 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32593 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ntrig.ko 2023-11-28T11:40:35.714 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8857 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-11-28T11:40:35.714 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9121 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-11-28T11:40:35.715 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-11-28T11:40:35.715 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 72937 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-11-28T11:40:35.715 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14225 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-11-28T11:40:35.715 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15105 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-11-28T11:40:35.715 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8417 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-11-28T11:40:35.715 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35393 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-11-28T11:40:35.715 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20833 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-28T11:40:35.715 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14065 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-11-28T11:40:35.715 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-28T11:40:35.715 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-28T11:40:35.715 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31129 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-28T11:40:35.716 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21137 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-28T11:40:35.716 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29489 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-28T11:40:35.716 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13305 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-28T11:40:35.716 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29313 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-28T11:40:35.716 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27937 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-28T11:40:35.716 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-28T11:40:35.716 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-11-28T11:40:35.716 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13681 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-11-28T11:40:35.716 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15193 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-11-28T11:40:35.716 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-28T11:40:35.716 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13601 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-11-28T11:40:35.716 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 51249 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-11-28T11:40:35.717 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8313 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-11-28T11:40:35.717 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25297 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-11-28T11:40:35.717 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-11-28T11:40:35.717 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16993 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-28T11:40:35.717 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-11-28T11:40:35.717 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15089 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-11-28T11:40:35.717 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14385 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-11-28T11:40:35.717 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16473 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-11-28T11:40:35.717 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 71073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-11-28T11:40:35.717 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10921 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-11-28T11:40:35.717 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 143473 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-11-28T11:40:35.718 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8153 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-11-28T11:40:35.718 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-11-28T11:40:35.718 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16665 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-11-28T11:40:35.718 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 267825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid.ko 2023-11-28T11:40:35.718 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-11-28T11:40:35.718 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/ 2023-11-28T11:40:35.718 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 125721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbhid.ko 2023-11-28T11:40:35.718 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19137 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbkbd.ko 2023-11-28T11:40:35.718 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14953 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbmouse.ko 2023-11-28T11:40:35.718 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 217873 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-11-28T11:40:35.718 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/ 2023-11-28T11:40:35.718 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 64201 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-11-28T11:40:35.719 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 89625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-11-28T11:40:35.719 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 305465 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-11-28T11:40:35.719 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ 2023-11-28T11:40:35.719 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 66521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-11-28T11:40:35.719 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 61393 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-11-28T11:40:35.719 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34745 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-28T11:40:35.719 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17505 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-11-28T11:40:35.719 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19313 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-11-28T11:40:35.719 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25257 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-11-28T11:40:35.719 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-11-28T11:40:35.719 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 97977 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-11-28T11:40:35.720 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19745 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-11-28T11:40:35.720 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 45553 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-11-28T11:40:35.720 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-11-28T11:40:35.720 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14769 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-11-28T11:40:35.720 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10769 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-11-28T11:40:35.720 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22049 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-11-28T11:40:35.720 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 74433 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-11-28T11:40:35.720 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-11-28T11:40:35.720 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 67929 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-11-28T11:40:35.720 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-11-28T11:40:35.720 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-11-28T11:40:35.720 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 55201 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-11-28T11:40:35.720 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 49913 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-11-28T11:40:35.721 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 58617 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-11-28T11:40:35.721 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-28T11:40:35.721 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17225 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-11-28T11:40:35.721 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28281 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-11-28T11:40:35.721 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24593 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9052-hwmon.ko 2023-11-28T11:40:35.721 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17265 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9055-hwmon.ko 2023-11-28T11:40:35.721 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 44465 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-28T11:40:35.721 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 99601 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-11-28T11:40:35.721 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19489 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-11-28T11:40:35.721 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-11-28T11:40:35.721 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29777 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-11-28T11:40:35.722 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33185 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc2103.ko 2023-11-28T11:40:35.722 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-11-28T11:40:35.722 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 66985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-11-28T11:40:35.722 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 94457 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-11-28T11:40:35.722 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41401 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-11-28T11:40:35.722 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21305 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-11-28T11:40:35.722 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 55449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-11-28T11:40:35.722 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14481 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-11-28T11:40:35.722 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24017 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-11-28T11:40:35.722 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 46801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-11-28T11:40:35.722 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 45529 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-11-28T11:40:35.722 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13273 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hih6130.ko 2023-11-28T11:40:35.723 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9745 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-28T11:40:35.723 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11553 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-11-28T11:40:35.723 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22601 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-11-28T11:40:35.723 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34529 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-11-28T11:40:35.723 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21257 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-11-28T11:40:35.723 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24873 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-11-28T11:40:35.723 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13401 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-11-28T11:40:35.723 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 130449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-11-28T11:40:35.723 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18841 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/jc42.ko 2023-11-28T11:40:35.723 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-11-28T11:40:35.723 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13553 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-11-28T11:40:35.723 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18929 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-11-28T11:40:35.724 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 48601 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-11-28T11:40:35.724 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16697 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-11-28T11:40:35.724 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36777 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-11-28T11:40:35.724 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-11-28T11:40:35.724 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34593 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-11-28T11:40:35.724 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31745 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-11-28T11:40:35.724 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16889 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-11-28T11:40:35.724 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 72833 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-11-28T11:40:35.724 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 46153 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-11-28T11:40:35.724 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37913 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-11-28T11:40:35.725 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19745 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-11-28T11:40:35.725 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 108841 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-11-28T11:40:35.725 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33393 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-11-28T11:40:35.725 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16201 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-11-28T11:40:35.725 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18113 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-11-28T11:40:35.725 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24017 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-11-28T11:40:35.725 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13793 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-11-28T11:40:35.725 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15193 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-11-28T11:40:35.725 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14889 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-11-28T11:40:35.725 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-11-28T11:40:35.725 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13249 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-11-28T11:40:35.725 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14993 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-11-28T11:40:35.726 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33489 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-11-28T11:40:35.726 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18433 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-11-28T11:40:35.726 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24353 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-11-28T11:40:35.726 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19969 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-11-28T11:40:35.726 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27129 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-11-28T11:40:35.726 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-11-28T11:40:35.726 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35777 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-11-28T11:40:35.726 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mc13783-adc.ko 2023-11-28T11:40:35.726 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-11-28T11:40:35.726 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15937 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-11-28T11:40:35.726 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 44129 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-11-28T11:40:35.726 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 119817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-11-28T11:40:35.727 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 60705 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-11-28T11:40:35.727 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 59737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-11-28T11:40:35.727 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 82337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-11-28T11:40:35.727 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 54433 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-11-28T11:40:35.727 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18473 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-11-28T11:40:35.727 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ 2023-11-28T11:40:35.727 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21353 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-28T11:40:35.727 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17065 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-28T11:40:35.727 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-28T11:40:35.727 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9577 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-28T11:40:35.727 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17657 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-28T11:40:35.728 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10169 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-28T11:40:35.728 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15505 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-28T11:40:35.728 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 82577 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-28T11:40:35.728 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-28T11:40:35.728 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-28T11:40:35.728 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-28T11:40:35.728 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20681 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-28T11:40:35.728 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13017 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-11-28T11:40:35.728 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18705 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-11-28T11:40:35.728 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-11-28T11:40:35.728 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27145 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-28T11:40:35.728 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32137 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-11-28T11:40:35.729 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13505 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-11-28T11:40:35.729 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16833 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-11-28T11:40:35.729 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40105 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-11-28T11:40:35.729 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19577 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-11-28T11:40:35.729 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39193 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-11-28T11:40:35.729 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37385 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-11-28T11:40:35.729 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26553 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-11-28T11:40:35.729 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17057 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-11-28T11:40:35.729 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14097 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-11-28T11:40:35.729 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21257 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-11-28T11:40:35.729 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-11-28T11:40:35.729 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-11-28T11:40:35.729 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41945 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-11-28T11:40:35.730 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 52457 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-11-28T11:40:35.730 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 51545 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-11-28T11:40:35.730 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 57449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-11-28T11:40:35.730 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 78873 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-11-28T11:40:35.730 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 71345 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-11-28T11:40:35.730 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 63225 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-11-28T11:40:35.730 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 71321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-11-28T11:40:35.730 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 101473 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-11-28T11:40:35.730 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 119505 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-11-28T11:40:35.730 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17313 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-11-28T11:40:35.730 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-11-28T11:40:35.731 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-11-28T11:40:35.731 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-11-28T11:40:35.731 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/ 2023-11-28T11:40:35.731 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/ 2023-11-28T11:40:35.731 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20049 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-28T11:40:35.731 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19345 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-28T11:40:35.731 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/ 2023-11-28T11:40:35.731 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27969 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-11-28T11:40:35.731 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-11-28T11:40:35.731 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27777 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-11-28T11:40:35.732 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17937 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-28T11:40:35.732 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26193 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-28T11:40:35.732 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16201 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-28T11:40:35.732 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15153 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-11-28T11:40:35.732 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 6929 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-28T11:40:35.732 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13961 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-11-28T11:40:35.732 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 50201 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-28T11:40:35.732 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23905 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-28T11:40:35.732 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20001 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-28T11:40:35.732 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-28T11:40:35.732 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-11-28T11:40:35.732 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-11-28T11:40:35.733 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 62817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-28T11:40:35.733 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22433 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-28T11:40:35.733 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 47889 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-28T11:40:35.733 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-11-28T11:40:35.733 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17881 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-28T11:40:35.733 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-28T11:40:35.733 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26265 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-11-28T11:40:35.733 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25145 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-28T11:40:35.733 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-28T11:40:35.733 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 47241 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-28T11:40:35.733 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-11-28T11:40:35.733 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18649 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-28T11:40:35.733 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11809 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-28T11:40:35.734 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22313 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-11-28T11:40:35.734 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29361 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-11-28T11:40:35.734 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-28T11:40:35.734 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19241 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-11-28T11:40:35.734 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19809 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-28T11:40:35.734 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-28T11:40:35.734 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26081 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-28T11:40:35.734 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19041 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-28T11:40:35.734 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 47657 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-11-28T11:40:35.734 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-11-28T11:40:35.734 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-11-28T11:40:35.735 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-11-28T11:40:35.735 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/ 2023-11-28T11:40:35.735 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14921 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-11-28T11:40:35.735 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13457 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-11-28T11:40:35.735 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-11-28T11:40:35.735 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ 2023-11-28T11:40:35.735 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ 2023-11-28T11:40:35.735 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 273609 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-28T11:40:35.735 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 879969 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-11-28T11:40:35.735 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 69273 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-28T11:40:35.735 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 324217 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-28T11:40:35.735 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 97985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-28T11:40:35.736 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 282273 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-28T11:40:35.736 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 66201 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-28T11:40:35.736 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ 2023-11-28T11:40:35.736 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/ 2023-11-28T11:40:35.736 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 493073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-28T11:40:35.736 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/ 2023-11-28T11:40:35.736 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 419737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-28T11:40:35.736 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/ 2023-11-28T11:40:35.736 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 739025 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-28T11:40:35.736 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ 2023-11-28T11:40:35.736 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 296625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-28T11:40:35.782 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ 2023-11-28T11:40:35.782 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 153697 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-11-28T11:40:35.782 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/ 2023-11-28T11:40:35.782 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 168969 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-11-28T11:40:35.782 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ 2023-11-28T11:40:35.782 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ 2023-11-28T11:40:35.783 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 263081 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-28T11:40:35.783 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ 2023-11-28T11:40:35.783 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 100241 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-28T11:40:35.783 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ 2023-11-28T11:40:35.783 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 111425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-28T11:40:35.783 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ 2023-11-28T11:40:35.783 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 128753 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-28T11:40:35.783 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ 2023-11-28T11:40:35.783 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 129529 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-28T11:40:35.783 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ 2023-11-28T11:40:35.784 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10745 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/evbug.ko 2023-11-28T11:40:35.784 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24129 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ff-memless.ko 2023-11-28T11:40:35.784 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/ 2023-11-28T11:40:35.784 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11881 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-28T11:40:35.784 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12145 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-28T11:40:35.784 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41241 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-11-28T11:40:35.784 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-11-28T11:40:35.784 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/ 2023-11-28T11:40:35.784 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13313 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-11-28T11:40:35.784 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-11-28T11:40:35.784 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26841 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-11-28T11:40:35.784 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24761 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-11-28T11:40:35.785 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36665 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-28T11:40:35.785 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-11-28T11:40:35.785 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21257 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lkkbd.ko 2023-11-28T11:40:35.785 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26473 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8323.ko 2023-11-28T11:40:35.785 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14409 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8333.ko 2023-11-28T11:40:35.785 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24265 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-11-28T11:40:35.785 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18217 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-11-28T11:40:35.785 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15929 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-11-28T11:40:35.785 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16489 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-11-28T11:40:35.785 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/newtonkbd.ko 2023-11-28T11:40:35.785 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10673 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-11-28T11:40:35.786 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14161 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt1070.ko 2023-11-28T11:40:35.786 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17929 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt2160.ko 2023-11-28T11:40:35.786 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-11-28T11:40:35.786 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11481 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/stowaway.ko 2023-11-28T11:40:35.786 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/sunkbd.ko 2023-11-28T11:40:35.786 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-11-28T11:40:35.786 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16177 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-11-28T11:40:35.786 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-11-28T11:40:35.786 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11753 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/xtkbd.ko 2023-11-28T11:40:35.786 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11465 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/matrix-keymap.ko 2023-11-28T11:40:35.786 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/ 2023-11-28T11:40:35.787 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-11-28T11:40:35.787 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34177 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-11-28T11:40:35.787 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 123681 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-11-28T11:40:35.787 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 89449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-28T11:40:35.787 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13961 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/gpio_mouse.ko 2023-11-28T11:40:35.787 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 335929 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/psmouse.ko 2023-11-28T11:40:35.787 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14681 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-11-28T11:40:35.787 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23881 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-28T11:40:35.787 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22569 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-28T11:40:35.787 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15665 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-28T11:40:35.787 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/ 2023-11-28T11:40:35.788 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 109873 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-28T11:40:35.788 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ 2023-11-28T11:40:35.788 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11665 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-11-28T11:40:35.788 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-11-28T11:40:35.788 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ct82c710.ko 2023-11-28T11:40:35.788 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16953 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-28T11:40:35.788 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15833 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/parkbd.ko 2023-11-28T11:40:35.788 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13225 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/pcips2.ko 2023-11-28T11:40:35.788 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20153 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ps2mult.ko 2023-11-28T11:40:35.788 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24153 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-11-28T11:40:35.788 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17977 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serport.ko 2023-11-28T11:40:35.789 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-11-28T11:40:35.789 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/ 2023-11-28T11:40:35.789 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/ 2023-11-28T11:40:35.789 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-28T11:40:35.789 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/ 2023-11-28T11:40:35.789 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-88pm860x.ko 2023-11-28T11:40:35.789 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11385 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-adp5520.ko 2023-11-28T11:40:35.789 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 59753 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-bd2802.ko 2023-11-28T11:40:35.789 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24785 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-11-28T11:40:35.789 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10473 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da903x.ko 2023-11-28T11:40:35.790 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12241 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da9052.ko 2023-11-28T11:40:35.790 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16561 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-gpio.ko 2023-11-28T11:40:35.790 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15793 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-11-28T11:40:35.790 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30505 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3533.ko 2023-11-28T11:40:35.790 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19353 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm355x.ko 2023-11-28T11:40:35.790 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19961 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3642.ko 2023-11-28T11:40:35.791 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16241 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-11-28T11:40:35.791 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11233 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp8788.ko 2023-11-28T11:40:35.791 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14929 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-max8997.ko 2023-11-28T11:40:35.791 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12545 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-mc13783.ko 2023-11-28T11:40:35.791 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13385 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-menf21bmc.ko 2023-11-28T11:40:35.791 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca9532.ko 2023-11-28T11:40:35.791 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20481 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca955x.ko 2023-11-28T11:40:35.791 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17857 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca963x.ko 2023-11-28T11:40:35.791 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34433 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-11-28T11:40:35.792 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24865 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-tca6507.ko 2023-11-28T11:40:35.792 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15665 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm831x-status.ko 2023-11-28T11:40:35.792 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11841 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm8350.ko 2023-11-28T11:40:35.792 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ 2023-11-28T11:40:35.792 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-28T11:40:35.792 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10873 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-28T11:40:35.792 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9089 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-28T11:40:35.792 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7617 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-28T11:40:35.793 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14249 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-28T11:40:35.793 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-28T11:40:35.793 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11889 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-28T11:40:35.793 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-28T11:40:35.793 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/ 2023-11-28T11:40:35.793 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/ 2023-11-28T11:40:35.793 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 654969 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-11-28T11:40:35.793 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40577 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-11-28T11:40:35.794 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 89601 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bufio.ko 2023-11-28T11:40:35.794 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 47529 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-11-28T11:40:35.794 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 156009 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-11-28T11:40:35.794 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 106897 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-11-28T11:40:35.794 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21545 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-11-28T11:40:35.794 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 53857 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-era.ko 2023-11-28T11:40:35.794 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28465 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-11-28T11:40:35.794 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41529 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-11-28T11:40:35.794 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log.ko 2023-11-28T11:40:35.795 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 49545 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-mirror.ko 2023-11-28T11:40:35.795 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 78033 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-11-28T11:40:35.795 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16473 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-11-28T11:40:35.795 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 70825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-11-28T11:40:35.795 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36297 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-region-hash.ko 2023-11-28T11:40:35.795 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15873 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-11-28T11:40:35.795 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-11-28T11:40:35.795 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 109529 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-snapshot.ko 2023-11-28T11:40:35.796 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19361 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-11-28T11:40:35.796 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 181865 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-11-28T11:40:35.796 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 51737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-11-28T11:40:35.796 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8561 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-zero.ko 2023-11-28T11:40:35.796 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15345 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-11-28T11:40:35.796 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-11-28T11:40:35.796 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32417 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-11-28T11:40:35.796 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/ 2023-11-28T11:40:35.797 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 199937 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-28T11:40:35.797 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-11-28T11:40:35.797 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 113073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-11-28T11:40:35.797 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 158681 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-11-28T11:40:35.797 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 395721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-11-28T11:40:35.797 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/ 2023-11-28T11:40:35.798 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/ 2023-11-28T11:40:35.798 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 178137 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-11-28T11:40:35.798 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 63385 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-11-28T11:40:35.798 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 44665 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-11-28T11:40:35.798 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37225 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-11-28T11:40:35.798 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 123321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-11-28T11:40:35.798 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 79041 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-11-28T11:40:35.798 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 53017 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-11-28T11:40:35.799 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ 2023-11-28T11:40:35.799 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17305 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm800.ko 2023-11-28T11:40:35.799 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12761 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm805.ko 2023-11-28T11:40:35.799 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11193 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm80x.ko 2023-11-28T11:40:35.799 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11865 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona-i2c.ko 2023-11-28T11:40:35.799 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 123721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona.ko 2023-11-28T11:40:35.799 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11961 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/bcm590xx.ko 2023-11-28T11:40:35.799 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17465 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/cros_ec_dev.ko 2023-11-28T11:40:35.800 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34961 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/dln2.ko 2023-11-28T11:40:35.800 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16689 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/janz-cmodio.ko 2023-11-28T11:40:35.800 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 53585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/kempld-core.ko 2023-11-28T11:40:35.800 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27529 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-core.ko 2023-11-28T11:40:35.800 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14993 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-11-28T11:40:35.800 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13009 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lp3943.ko 2023-11-28T11:40:35.800 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 54569 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-11-28T11:40:35.801 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12113 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-11-28T11:40:35.801 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17409 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/max8907.ko 2023-11-28T11:40:35.801 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29857 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-core.ko 2023-11-28T11:40:35.801 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-11-28T11:40:35.801 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11593 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/menf21bmc.ko 2023-11-28T11:40:35.801 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-adc.ko 2023-11-28T11:40:35.801 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9153 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-gpio.ko 2023-11-28T11:40:35.801 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34873 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633.ko 2023-11-28T11:40:35.802 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10105 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-11-28T11:40:35.802 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/retu-mfd.ko 2023-11-28T11:40:35.802 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 80425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/si476x-core.ko 2023-11-28T11:40:35.802 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 48457 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-11-28T11:40:35.802 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-11-28T11:40:35.802 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 51137 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps65010.ko 2023-11-28T11:40:35.802 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10353 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps6507x.ko 2023-11-28T11:40:35.802 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-11-28T11:40:35.802 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-11-28T11:40:35.802 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17953 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-11-28T11:40:35.802 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 44345 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wm8994.ko 2023-11-28T11:40:35.803 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ 2023-11-28T11:40:35.803 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13833 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-11-28T11:40:35.803 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 48489 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot.ko 2023-11-28T11:40:35.803 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/ 2023-11-28T11:40:35.803 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 46585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-28T11:40:35.803 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18393 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-11-28T11:40:35.803 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-11-28T11:40:35.803 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 45593 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-11-28T11:40:35.803 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/ 2023-11-28T11:40:35.803 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11145 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-11-28T11:40:35.803 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35281 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/core.ko 2023-11-28T11:40:35.804 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/ 2023-11-28T11:40:35.804 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25161 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-11-28T11:40:35.804 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ds1682.ko 2023-11-28T11:40:35.804 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8897 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/dummy-irq.ko 2023-11-28T11:40:35.804 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/ 2023-11-28T11:40:35.804 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13657 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/echo.ko 2023-11-28T11:40:35.804 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/ 2023-11-28T11:40:35.804 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37849 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-11-28T11:40:35.804 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-28T11:40:35.804 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14769 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-28T11:40:35.804 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-11-28T11:40:35.805 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33009 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-11-28T11:40:35.805 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/ 2023-11-28T11:40:35.805 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 152201 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-11-28T11:40:35.805 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14129 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hmc6352.ko 2023-11-28T11:40:35.805 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31257 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-11-28T11:40:35.805 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ 2023-11-28T11:40:35.805 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 72129 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-11-28T11:40:35.805 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19785 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ics932s401.ko 2023-11-28T11:40:35.805 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21681 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-11-28T11:40:35.805 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15753 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-11-28T11:40:35.805 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/ 2023-11-28T11:40:35.806 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 42513 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-28T11:40:35.806 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13857 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-28T11:40:35.806 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/ 2023-11-28T11:40:35.806 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 125209 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-11-28T11:40:35.806 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 56521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-11-28T11:40:35.806 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 310113 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-11-28T11:40:35.806 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/phantom.ko 2023-11-28T11:40:35.806 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/ 2023-11-28T11:40:35.806 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 74265 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/st_drv.ko 2023-11-28T11:40:35.806 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24305 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-11-28T11:40:35.807 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28785 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-11-28T11:40:35.807 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-11-28T11:40:35.807 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 48697 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-11-28T11:40:35.807 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/ 2023-11-28T11:40:35.807 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 183609 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-28T11:40:35.807 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ 2023-11-28T11:40:35.807 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/ 2023-11-28T11:40:35.807 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 490129 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-11-28T11:40:35.807 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/ 2023-11-28T11:40:35.807 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/ 2023-11-28T11:40:35.808 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 106033 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-28T11:40:35.808 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40417 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-28T11:40:35.808 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16041 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-28T11:40:35.808 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/ 2023-11-28T11:40:35.808 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 453737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-28T11:40:35.808 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16929 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-11-28T11:40:35.808 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17961 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-11-28T11:40:35.808 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ 2023-11-28T11:40:35.808 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/ 2023-11-28T11:40:35.808 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 45785 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-28T11:40:35.808 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 42105 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-28T11:40:35.809 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 130553 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-28T11:40:35.809 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 68849 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-28T11:40:35.809 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ 2023-11-28T11:40:35.809 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37649 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-28T11:40:35.809 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 59689 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-28T11:40:35.809 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27201 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-28T11:40:35.809 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 99049 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-28T11:40:35.809 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/ 2023-11-28T11:40:35.809 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 54521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-28T11:40:35.809 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/ 2023-11-28T11:40:35.809 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 69137 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-28T11:40:35.810 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/ 2023-11-28T11:40:35.810 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 59585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-28T11:40:35.810 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/ 2023-11-28T11:40:35.810 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41409 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-28T11:40:35.810 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/ 2023-11-28T11:40:35.810 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 54609 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-28T11:40:35.810 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 49289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-28T11:40:35.810 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 87297 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-28T11:40:35.810 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/ 2023-11-28T11:40:35.810 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/ 2023-11-28T11:40:35.810 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 97337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-28T11:40:35.810 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-11-28T11:40:35.810 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 104673 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-28T11:40:35.811 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-11-28T11:40:35.811 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 90257 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-28T11:40:35.811 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/ 2023-11-28T11:40:35.811 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 81569 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-28T11:40:35.811 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 69729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-28T11:40:35.811 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/ 2023-11-28T11:40:35.811 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 78401 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-28T11:40:35.811 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 176761 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-28T11:40:35.811 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-11-28T11:40:35.811 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1421497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-28T11:40:35.811 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 128569 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-28T11:40:35.812 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/ 2023-11-28T11:40:35.812 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 132089 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-28T11:40:35.812 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 312081 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-28T11:40:35.812 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/ 2023-11-28T11:40:35.812 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/ 2023-11-28T11:40:35.812 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 323513 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-28T11:40:35.812 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/ 2023-11-28T11:40:35.812 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-11-28T11:40:35.812 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 193497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-28T11:40:35.812 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-11-28T11:40:35.812 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 347417 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-28T11:40:35.812 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-11-28T11:40:35.813 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1044497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-28T11:40:35.813 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-11-28T11:40:35.813 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 166193 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-28T11:40:35.813 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-11-28T11:40:35.813 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34881 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-28T11:40:35.813 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/ 2023-11-28T11:40:35.813 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/ 2023-11-28T11:40:35.813 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 204345 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-28T11:40:35.813 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/ 2023-11-28T11:40:35.813 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/ 2023-11-28T11:40:35.813 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 69449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-28T11:40:35.813 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 61489 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-28T11:40:35.813 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 141225 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-28T11:40:35.814 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 51497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-28T11:40:35.814 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 62817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-28T11:40:35.814 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31369 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-28T11:40:35.814 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/ 2023-11-28T11:40:35.814 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 60873 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-28T11:40:35.814 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 62833 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-28T11:40:35.814 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 45721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-11-28T11:40:35.814 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25185 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ec_bhf.ko 2023-11-28T11:40:35.814 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/ 2023-11-28T11:40:35.814 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/ 2023-11-28T11:40:35.814 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 281137 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-28T11:40:35.815 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 49457 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-11-28T11:40:35.815 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 51737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-11-28T11:40:35.815 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/ 2023-11-28T11:40:35.815 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 45345 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-11-28T11:40:35.815 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ 2023-11-28T11:40:35.815 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 90465 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-28T11:40:35.815 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/ 2023-11-28T11:40:35.815 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 295577 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-28T11:40:35.815 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/ 2023-11-28T11:40:35.815 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 584497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-28T11:40:35.815 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/ 2023-11-28T11:40:35.816 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 246209 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-28T11:40:35.816 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/ 2023-11-28T11:40:35.816 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 925825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-28T11:40:35.816 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/ 2023-11-28T11:40:35.816 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 302937 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-28T11:40:35.816 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/ 2023-11-28T11:40:35.816 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 514641 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-28T11:40:35.816 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/ 2023-11-28T11:40:35.816 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 93593 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-28T11:40:35.816 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-11-28T11:40:35.816 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 734305 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-28T11:40:35.816 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-11-28T11:40:35.817 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 151769 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-28T11:40:35.817 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 86921 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-11-28T11:40:35.817 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/ 2023-11-28T11:40:35.817 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20977 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-28T11:40:35.817 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 102289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-28T11:40:35.817 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 122649 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-28T11:40:35.817 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/ 2023-11-28T11:40:35.817 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-11-28T11:40:35.817 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 727601 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-28T11:40:35.817 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 278937 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-28T11:40:35.817 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-11-28T11:40:35.817 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-11-28T11:40:35.818 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1113681 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-28T11:40:35.818 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ 2023-11-28T11:40:35.818 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 53041 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-11-28T11:40:35.818 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40993 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-11-28T11:40:35.818 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19489 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-11-28T11:40:35.818 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 95665 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-28T11:40:35.818 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/ 2023-11-28T11:40:35.818 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-11-28T11:40:35.818 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 108649 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-28T11:40:35.818 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ 2023-11-28T11:40:35.818 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 73441 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-28T11:40:35.818 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 47777 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-28T11:40:35.819 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/ 2023-11-28T11:40:35.819 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 150905 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-28T11:40:35.819 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/ 2023-11-28T11:40:35.819 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 136721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-28T11:40:35.819 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/ 2023-11-28T11:40:35.819 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 50481 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-28T11:40:35.819 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 43145 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-28T11:40:35.819 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/ 2023-11-28T11:40:35.819 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-11-28T11:40:35.819 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 227897 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-28T11:40:35.819 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 87081 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-28T11:40:35.819 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-11-28T11:40:35.820 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 672049 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-28T11:40:35.820 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/ 2023-11-28T11:40:35.820 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 43017 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-28T11:40:35.820 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/ 2023-11-28T11:40:35.820 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 67385 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-28T11:40:35.820 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 83985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-28T11:40:35.820 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-28T11:40:35.820 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 189801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-28T11:40:35.820 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/ 2023-11-28T11:40:35.820 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-11-28T11:40:35.820 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 104241 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-11-28T11:40:35.820 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/ 2023-11-28T11:40:35.820 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1052497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-28T11:40:35.821 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/ 2023-11-28T11:40:35.821 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 47097 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-28T11:40:35.821 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/ 2023-11-28T11:40:35.821 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 54817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-28T11:40:35.821 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 63337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-28T11:40:35.821 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/ 2023-11-28T11:40:35.821 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 61537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-28T11:40:35.821 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 67193 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-28T11:40:35.821 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 73409 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-28T11:40:35.821 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 68177 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-28T11:40:35.821 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/ 2023-11-28T11:40:35.821 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-11-28T11:40:35.821 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13441 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-11-28T11:40:35.822 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39905 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-28T11:40:35.822 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20657 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-11-28T11:40:35.822 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 487025 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-28T11:40:35.822 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/ 2023-11-28T11:40:35.822 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 103337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-28T11:40:35.822 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 166097 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-28T11:40:35.822 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 66329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-28T11:40:35.822 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 78801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-28T11:40:35.822 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/ 2023-11-28T11:40:35.822 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 50057 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-28T11:40:35.823 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/ 2023-11-28T11:40:35.823 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 86529 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-28T11:40:35.823 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/ 2023-11-28T11:40:35.823 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 80273 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-28T11:40:35.823 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 83633 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-28T11:40:35.823 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/ 2023-11-28T11:40:35.823 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 46241 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-28T11:40:35.823 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30849 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-28T11:40:35.823 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/ 2023-11-28T11:40:35.823 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 59993 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-28T11:40:35.823 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/ 2023-11-28T11:40:35.823 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41001 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/defxx.ko 2023-11-28T11:40:35.824 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/ 2023-11-28T11:40:35.824 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 216985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/skfp.ko 2023-11-28T11:40:35.824 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 77345 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-11-28T11:40:35.824 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/ 2023-11-28T11:40:35.824 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 235521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-28T11:40:35.824 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/ 2023-11-28T11:40:35.824 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18273 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-28T11:40:35.824 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25065 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-11-28T11:40:35.824 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ 2023-11-28T11:40:35.824 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 83769 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-28T11:40:35.824 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 62145 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-11-28T11:40:35.824 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15865 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-11-28T11:40:35.825 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/ 2023-11-28T11:40:35.825 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20569 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-28T11:40:35.825 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14185 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-28T11:40:35.825 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13681 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-gpio.ko 2023-11-28T11:40:35.825 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-28T11:40:35.825 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16025 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-11-28T11:40:35.825 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20513 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-11-28T11:40:35.825 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 43953 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-11-28T11:40:35.825 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13145 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-11-28T11:40:35.825 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/ 2023-11-28T11:40:35.825 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-28T11:40:35.825 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38977 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-28T11:40:35.826 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ 2023-11-28T11:40:35.826 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-11-28T11:40:35.826 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 50033 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-28T11:40:35.826 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 44721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-28T11:40:35.826 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-11-28T11:40:35.826 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 42241 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-11-28T11:40:35.826 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-11-28T11:40:35.826 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13025 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-11-28T11:40:35.826 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-11-28T11:40:35.826 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24969 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-11-28T11:40:35.826 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15849 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-11-28T11:40:35.826 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 82049 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-11-28T11:40:35.826 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 76113 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-11-28T11:40:35.827 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12033 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-11-28T11:40:35.827 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 97857 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-11-28T11:40:35.827 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10065 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-11-28T11:40:35.827 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 50065 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-11-28T11:40:35.827 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-11-28T11:40:35.827 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10857 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-11-28T11:40:35.827 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-11-28T11:40:35.827 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/ 2023-11-28T11:40:35.827 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 43505 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/plip.ko 2023-11-28T11:40:35.827 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ 2023-11-28T11:40:35.827 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15857 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-28T11:40:35.827 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29713 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-11-28T11:40:35.827 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17665 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-28T11:40:35.828 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-28T11:40:35.828 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-28T11:40:35.828 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 42545 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-11-28T11:40:35.828 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13441 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-11-28T11:40:35.828 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32689 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-11-28T11:40:35.828 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sb1000.ko 2023-11-28T11:40:35.828 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/ 2023-11-28T11:40:35.828 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 42465 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-11-28T11:40:35.828 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26929 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-11-28T11:40:35.828 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 64449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-11-28T11:40:35.828 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/ 2023-11-28T11:40:35.829 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 106169 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-11-28T11:40:35.829 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-28T11:40:35.829 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10209 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-28T11:40:35.829 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28881 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-28T11:40:35.829 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9641 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-11-28T11:40:35.829 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-28T11:40:35.829 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 87017 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-11-28T11:40:35.829 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/ 2023-11-28T11:40:35.829 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 144297 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-28T11:40:35.829 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/ 2023-11-28T11:40:35.829 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 297329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-11-28T11:40:35.830 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/ 2023-11-28T11:40:35.830 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 144585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-28T11:40:35.830 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ 2023-11-28T11:40:35.830 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20969 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-11-28T11:40:35.830 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/ 2023-11-28T11:40:35.830 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/ 2023-11-28T11:40:35.830 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 265121 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-11-28T11:40:35.830 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 102209 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-11-28T11:40:35.830 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/ 2023-11-28T11:40:35.830 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 133841 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-11-28T11:40:35.830 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14561 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-11-28T11:40:35.831 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 84465 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-11-28T11:40:35.831 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26121 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-11-28T11:40:35.831 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/ 2023-11-28T11:40:35.831 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/ 2023-11-28T11:40:35.831 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25009 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-28T11:40:35.831 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17849 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-11-28T11:40:35.831 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20137 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-11-28T11:40:35.831 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11857 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pci-stub.ko 2023-11-28T11:40:35.831 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 46465 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-11-28T11:40:35.831 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/ 2023-11-28T11:40:35.831 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26793 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-11-28T11:40:35.832 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 145809 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia.ko 2023-11-28T11:40:35.832 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 62137 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_core.ko 2023-11-28T11:40:35.832 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34345 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-11-28T11:40:35.832 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34265 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-11-28T11:40:35.832 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 112889 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-28T11:40:35.832 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/ 2023-11-28T11:40:35.832 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/ 2023-11-28T11:40:35.832 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10841 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-11-28T11:40:35.832 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/ 2023-11-28T11:40:35.832 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8441 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-11-28T11:40:35.832 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/ 2023-11-28T11:40:35.833 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/ 2023-11-28T11:40:35.833 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 70153 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-28T11:40:35.833 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/ 2023-11-28T11:40:35.833 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/ 2023-11-28T11:40:35.833 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 50889 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-11-28T11:40:35.833 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20849 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec.ko 2023-11-28T11:40:35.833 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-11-28T11:40:35.833 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25417 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-11-28T11:40:35.833 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26201 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-11-28T11:40:35.833 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18201 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-11-28T11:40:35.833 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17361 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-11-28T11:40:35.833 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ 2023-11-28T11:40:35.834 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 67097 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-28T11:40:35.834 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39145 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-11-28T11:40:35.834 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37025 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-28T11:40:35.834 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 59665 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-28T11:40:35.834 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31161 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-28T11:40:35.834 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 127441 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-28T11:40:35.834 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36849 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-28T11:40:35.834 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 49121 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-28T11:40:35.834 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13961 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-28T11:40:35.834 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40265 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-28T11:40:35.835 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-28T11:40:35.835 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36593 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-11-28T11:40:35.835 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ibm_rtl.ko 2023-11-28T11:40:35.835 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/ 2023-11-28T11:40:35.835 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-28T11:40:35.835 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-11-28T11:40:35.835 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 43497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-11-28T11:40:35.835 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20273 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-28T11:40:35.835 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10377 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-28T11:40:35.835 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-28T11:40:35.835 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 42329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-28T11:40:35.836 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14169 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-28T11:40:35.836 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-28T11:40:35.836 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-28T11:40:35.836 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17081 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-28T11:40:35.836 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10129 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-28T11:40:35.836 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 57569 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-11-28T11:40:35.836 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/ 2023-11-28T11:40:35.836 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ 2023-11-28T11:40:35.836 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30281 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_battery.ko 2023-11-28T11:40:35.836 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_charger.ko 2023-11-28T11:40:35.836 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 55057 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq2415x_charger.ko 2023-11-28T11:40:35.837 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 54081 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24190_charger.ko 2023-11-28T11:40:35.837 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21553 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24735-charger.ko 2023-11-28T11:40:35.837 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-11-28T11:40:35.837 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19609 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9030_battery.ko 2023-11-28T11:40:35.837 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19841 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9052-battery.ko 2023-11-28T11:40:35.837 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29281 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2760_battery.ko 2023-11-28T11:40:35.837 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23217 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2780_battery.ko 2023-11-28T11:40:35.837 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23353 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2781_battery.ko 2023-11-28T11:40:35.837 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23649 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2782_battery.ko 2023-11-28T11:40:35.837 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20353 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/gpio-charger.ko 2023-11-28T11:40:35.837 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18041 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/isp1704_charger.ko 2023-11-28T11:40:35.838 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20273 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/lp8727_charger.ko 2023-11-28T11:40:35.838 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12577 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max14577_charger.ko 2023-11-28T11:40:35.838 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25897 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17040_battery.ko 2023-11-28T11:40:35.838 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17042_battery.ko 2023-11-28T11:40:35.838 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8903_charger.ko 2023-11-28T11:40:35.838 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8925_power.ko 2023-11-28T11:40:35.838 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21657 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/pcf50633-charger.ko 2023-11-28T11:40:35.838 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38009 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/sbs-battery.ko 2023-11-28T11:40:35.838 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28385 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/test_power.ko 2023-11-28T11:40:35.838 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18865 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/tps65090-charger.ko 2023-11-28T11:40:35.838 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11969 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_backup.ko 2023-11-28T11:40:35.839 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_power.ko 2023-11-28T11:40:35.839 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22417 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm8350_power.ko 2023-11-28T11:40:35.839 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/ 2023-11-28T11:40:35.839 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 57729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-28T11:40:35.839 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17345 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-28T11:40:35.839 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/ 2023-11-28T11:40:35.839 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/ 2023-11-28T11:40:35.839 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-28T11:40:35.839 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13249 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-28T11:40:35.839 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15913 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-11-28T11:40:35.839 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41873 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-11-28T11:40:35.840 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ 2023-11-28T11:40:35.840 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 66385 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-11-28T11:40:35.840 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-11-28T11:40:35.840 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/ 2023-11-28T11:40:35.840 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm80x.ko 2023-11-28T11:40:35.840 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm860x.ko 2023-11-28T11:40:35.840 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15393 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-28T11:40:35.840 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20105 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9052.ko 2023-11-28T11:40:35.840 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18505 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9055.ko 2023-11-28T11:40:35.840 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9063.ko 2023-11-28T11:40:35.840 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16457 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-28T11:40:35.841 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 68577 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-28T11:40:35.841 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-28T11:40:35.841 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18217 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-28T11:40:35.841 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-28T11:40:35.841 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13953 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-28T11:40:35.841 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13369 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-28T11:40:35.841 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14697 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-28T11:40:35.841 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23705 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-28T11:40:35.841 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11081 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-11-28T11:40:35.841 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-28T11:40:35.841 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-28T11:40:35.842 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35969 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-28T11:40:35.842 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14673 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-lp8788.ko 2023-11-28T11:40:35.842 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38097 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-28T11:40:35.842 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12089 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-28T11:40:35.842 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25945 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-28T11:40:35.842 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14841 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t86.ko 2023-11-28T11:40:35.842 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11633 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-11-28T11:40:35.842 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14673 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8907.ko 2023-11-28T11:40:35.842 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15345 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8925.ko 2023-11-28T11:40:35.842 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25809 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8997.ko 2023-11-28T11:40:35.843 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16681 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8998.ko 2023-11-28T11:40:35.843 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18513 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-11-28T11:40:35.843 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11409 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-28T11:40:35.843 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-palmas.ko 2023-11-28T11:40:35.843 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 46633 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-28T11:40:35.843 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17977 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf50633.ko 2023-11-28T11:40:35.843 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26993 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-28T11:40:35.843 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-28T11:40:35.843 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-28T11:40:35.843 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12441 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-28T11:40:35.843 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18033 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rc5t583.ko 2023-11-28T11:40:35.843 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13049 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-28T11:40:35.844 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33753 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-28T11:40:35.844 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27833 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-28T11:40:35.844 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25257 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-28T11:40:35.844 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20113 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-28T11:40:35.844 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21617 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-s35390a.ko 2023-11-28T11:40:35.844 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-28T11:40:35.844 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17889 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps6586x.ko 2023-11-28T11:40:35.844 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps65910.ko 2023-11-28T11:40:35.844 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20545 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm831x.ko 2023-11-28T11:40:35.844 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21089 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm8350.ko 2023-11-28T11:40:35.844 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27873 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-11-28T11:40:35.844 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ 2023-11-28T11:40:35.845 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 77617 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-11-28T11:40:35.845 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 57665 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-11-28T11:40:35.845 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 55105 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-11-28T11:40:35.845 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 135185 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-11-28T11:40:35.845 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26657 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-11-28T11:40:35.845 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/ 2023-11-28T11:40:35.845 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 272305 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-28T11:40:35.845 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 100617 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-11-28T11:40:35.845 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/ 2023-11-28T11:40:35.845 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 356201 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-28T11:40:35.845 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 295801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-28T11:40:35.846 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/ 2023-11-28T11:40:35.846 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 189185 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-11-28T11:40:35.846 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-11-28T11:40:35.846 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/ 2023-11-28T11:40:35.846 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 106881 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-28T11:40:35.846 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38185 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-11-28T11:40:35.846 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/ 2023-11-28T11:40:35.846 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 246985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-28T11:40:35.846 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/ 2023-11-28T11:40:35.846 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1171945 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-11-28T11:40:35.847 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/ 2023-11-28T11:40:35.847 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 237273 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-28T11:40:35.847 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/ 2023-11-28T11:40:35.847 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 115369 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-28T11:40:35.847 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-11-28T11:40:35.847 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/ 2023-11-28T11:40:35.847 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 308921 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-28T11:40:35.847 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/ 2023-11-28T11:40:35.847 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-11-28T11:40:35.847 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 76145 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-28T11:40:35.847 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-11-28T11:40:35.848 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 101449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-28T11:40:35.848 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 146689 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-28T11:40:35.848 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 75553 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-11-28T11:40:35.848 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-11-28T11:40:35.848 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/ 2023-11-28T11:40:35.848 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 212425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-28T11:40:35.848 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 60505 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-11-28T11:40:35.848 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/ 2023-11-28T11:40:35.848 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 78209 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-28T11:40:35.848 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 158505 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-28T11:40:35.849 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18945 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fdomain.ko 2023-11-28T11:40:35.849 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/ 2023-11-28T11:40:35.849 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 263489 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-11-28T11:40:35.849 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 201817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-11-28T11:40:35.849 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 51209 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-11-28T11:40:35.849 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 49041 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-11-28T11:40:35.849 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/imm.ko 2023-11-28T11:40:35.849 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 44057 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-11-28T11:40:35.849 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 266537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-11-28T11:40:35.849 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 101881 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-11-28T11:40:35.849 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/ 2023-11-28T11:40:35.849 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 317153 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-11-28T11:40:35.895 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26385 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-28T11:40:35.895 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 52961 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-28T11:40:35.895 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/ 2023-11-28T11:40:35.895 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 314865 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-11-28T11:40:35.895 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 145585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-11-28T11:40:35.895 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 53521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-28T11:40:35.895 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/ 2023-11-28T11:40:35.895 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 216665 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-11-28T11:40:35.895 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/ 2023-11-28T11:40:35.895 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 2197249 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-28T11:40:35.896 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/ 2023-11-28T11:40:35.896 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 73569 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-28T11:40:35.896 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33529 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-28T11:40:35.896 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 310617 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-28T11:40:35.896 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 84721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-11-28T11:40:35.896 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/ 2023-11-28T11:40:35.896 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 659825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-28T11:40:35.896 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/ 2023-11-28T11:40:35.896 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 119561 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-28T11:40:35.896 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 78129 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-11-28T11:40:35.896 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/ 2023-11-28T11:40:35.897 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 81625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-11-28T11:40:35.897 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11713 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-11-28T11:40:35.897 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20865 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-11-28T11:40:35.897 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23857 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-11-28T11:40:35.897 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/ 2023-11-28T11:40:35.897 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 364105 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-28T11:40:35.897 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 123617 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-11-28T11:40:35.897 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34513 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ppa.ko 2023-11-28T11:40:35.897 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 55361 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-11-28T11:40:35.897 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/ 2023-11-28T11:40:35.897 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1876689 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-28T11:40:35.897 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 85289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-28T11:40:35.898 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/ 2023-11-28T11:40:35.898 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 559033 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-28T11:40:35.898 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19025 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qlogicfas408.ko 2023-11-28T11:40:35.898 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15993 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-11-28T11:40:35.898 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 238761 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-11-28T11:40:35.898 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 173937 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-28T11:40:35.898 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 279313 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-28T11:40:35.898 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 97729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-28T11:40:35.899 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 73881 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-28T11:40:35.899 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 44993 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-28T11:40:35.899 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26249 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-11-28T11:40:35.899 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 115889 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-11-28T11:40:35.899 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 46825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-11-28T11:40:35.899 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/ 2023-11-28T11:40:35.899 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 162121 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-28T11:40:35.899 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 42297 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-11-28T11:40:35.899 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 50321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-28T11:40:35.899 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39961 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-11-28T11:40:35.899 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 50025 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/xen-scsifront.ko 2023-11-28T11:40:35.900 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ 2023-11-28T11:40:35.900 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 129441 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-11-28T11:40:35.900 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/ 2023-11-28T11:40:35.900 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/ 2023-11-28T11:40:35.900 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 736601 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-28T11:40:35.900 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/ 2023-11-28T11:40:35.900 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 49985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-28T11:40:35.900 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39713 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-11-28T11:40:35.900 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 43025 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-11-28T11:40:35.900 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 930257 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-11-28T11:40:35.901 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 44305 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-11-28T11:40:35.901 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 122521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-11-28T11:40:35.901 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/ 2023-11-28T11:40:35.901 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 75593 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-28T11:40:35.901 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/ 2023-11-28T11:40:35.901 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/ 2023-11-28T11:40:35.901 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/ 2023-11-28T11:40:35.901 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23481 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-28T11:40:35.901 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-28T11:40:35.901 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9953 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-28T11:40:35.901 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10257 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-28T11:40:35.901 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15081 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-28T11:40:35.902 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-28T11:40:35.902 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26809 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-28T11:40:35.902 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20281 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-28T11:40:35.902 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14865 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-28T11:40:35.902 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14393 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-28T11:40:35.902 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13001 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-28T11:40:35.902 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37065 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-28T11:40:35.902 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-11-28T11:40:35.902 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18937 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-28T11:40:35.902 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-28T11:40:35.902 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-28T11:40:35.902 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ 2023-11-28T11:40:35.903 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ 2023-11-28T11:40:35.903 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 78425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-28T11:40:35.903 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 57865 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/moxa.ko 2023-11-28T11:40:35.903 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 50953 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/mxser.ko 2023-11-28T11:40:35.903 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 108601 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-11-28T11:40:35.903 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31961 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-11-28T11:40:35.903 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 67929 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-11-28T11:40:35.903 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/ 2023-11-28T11:40:35.903 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/ 2023-11-28T11:40:35.903 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35753 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-11-28T11:40:35.903 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 59497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-28T11:40:35.903 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18097 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-11-28T11:40:35.904 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22577 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_uart.ko 2023-11-28T11:40:35.904 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-11-28T11:40:35.904 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 72425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-11-28T11:40:35.904 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/ 2023-11-28T11:40:35.904 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 103073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-28T11:40:35.904 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28785 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/rp2.ko 2023-11-28T11:40:35.904 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 52817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/sc16is7xx.ko 2023-11-28T11:40:35.904 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/ 2023-11-28T11:40:35.904 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ 2023-11-28T11:40:35.904 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 531265 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-28T11:40:35.904 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ 2023-11-28T11:40:35.904 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28481 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-28T11:40:35.905 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14601 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-11-28T11:40:35.905 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/ 2023-11-28T11:40:35.905 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 44513 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-11-28T11:40:35.905 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12241 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-11-28T11:40:35.905 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11281 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-11-28T11:40:35.905 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_dmem_genirq.ko 2023-11-28T11:40:35.905 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12937 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_mf624.ko 2023-11-28T11:40:35.905 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12177 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_netx.ko 2023-11-28T11:40:35.905 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10601 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-11-28T11:40:35.905 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16057 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-11-28T11:40:35.905 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13633 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-11-28T11:40:35.905 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/ 2023-11-28T11:40:35.905 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/ 2023-11-28T11:40:35.906 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 73297 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/c67x00.ko 2023-11-28T11:40:35.906 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ 2023-11-28T11:40:35.906 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 144377 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-11-28T11:40:35.906 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18505 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-11-28T11:40:35.906 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12713 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-11-28T11:40:35.906 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13057 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-11-28T11:40:35.906 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/ 2023-11-28T11:40:35.906 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 87089 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-11-28T11:40:35.906 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 51345 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-28T11:40:35.906 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 47305 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-11-28T11:40:35.906 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 89857 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-11-28T11:40:35.906 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ 2023-11-28T11:40:35.906 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22953 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ulpi.ko 2023-11-28T11:40:35.907 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/ 2023-11-28T11:40:35.907 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11529 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-11-28T11:40:35.907 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/ 2023-11-28T11:40:35.907 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12089 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-11-28T11:40:35.907 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30041 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-11-28T11:40:35.907 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 448505 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3.ko 2023-11-28T11:40:35.907 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/ 2023-11-28T11:40:35.907 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/ 2023-11-28T11:40:35.907 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 60177 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_ether.ko 2023-11-28T11:40:35.907 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 51881 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_serial.ko 2023-11-28T11:40:35.907 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28841 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-11-28T11:40:35.907 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 42449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-11-28T11:40:35.907 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27953 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-11-28T11:40:35.908 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36513 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-11-28T11:40:35.908 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 92489 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-11-28T11:40:35.908 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 51049 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-11-28T11:40:35.908 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 122081 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-11-28T11:40:35.908 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 57681 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-11-28T11:40:35.908 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22185 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-11-28T11:40:35.908 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31265 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-11-28T11:40:35.908 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 57729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-11-28T11:40:35.908 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 85609 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-11-28T11:40:35.908 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19273 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-11-28T11:40:35.908 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 58113 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-11-28T11:40:35.908 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 67337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-11-28T11:40:35.908 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/ 2023-11-28T11:40:35.909 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21265 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-11-28T11:40:35.909 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18057 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-11-28T11:40:35.909 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18465 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-11-28T11:40:35.909 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21657 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-11-28T11:40:35.909 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28401 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-11-28T11:40:35.909 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19009 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-11-28T11:40:35.909 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20409 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-11-28T11:40:35.909 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16977 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-11-28T11:40:35.909 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-11-28T11:40:35.909 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16793 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-11-28T11:40:35.909 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19393 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-11-28T11:40:35.909 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27201 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-11-28T11:40:35.910 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 62185 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-11-28T11:40:35.910 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15201 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-11-28T11:40:35.910 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 161225 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/libcomposite.ko 2023-11-28T11:40:35.910 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/ 2023-11-28T11:40:35.910 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17705 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-11-28T11:40:35.910 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/ 2023-11-28T11:40:35.910 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 157681 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-11-28T11:40:35.910 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36089 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-11-28T11:40:35.910 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 52721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-11-28T11:40:35.910 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 69705 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-11-28T11:40:35.910 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 56033 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-11-28T11:40:35.910 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 76057 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2272.ko 2023-11-28T11:40:35.910 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 75073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2280.ko 2023-11-28T11:40:35.911 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 73169 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-11-28T11:40:35.911 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 65809 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-11-28T11:40:35.911 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 66097 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-11-28T11:40:35.911 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 81505 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-11-28T11:40:35.911 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 156073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-11-28T11:40:35.911 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ 2023-11-28T11:40:35.911 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/bcma-hcd.ko 2023-11-28T11:40:35.911 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 80113 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/isp116x-hcd.ko 2023-11-28T11:40:35.911 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 87353 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-11-28T11:40:35.911 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 78873 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-11-28T11:40:35.911 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 51329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-28T11:40:35.911 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15593 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811_cs.ko 2023-11-28T11:40:35.911 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13305 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ssb-hcd.ko 2023-11-28T11:40:35.912 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25945 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-11-28T11:40:35.912 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/ 2023-11-28T11:40:35.912 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-11-28T11:40:35.912 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21081 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-11-28T11:40:35.912 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ 2023-11-28T11:40:35.912 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-11-28T11:40:35.912 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20713 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-11-28T11:40:35.912 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-11-28T11:40:35.912 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23049 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cytherm.ko 2023-11-28T11:40:35.912 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ehset.ko 2023-11-28T11:40:35.912 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15057 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-11-28T11:40:35.912 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-11-28T11:40:35.912 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11433 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-11-28T11:40:35.913 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19297 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-11-28T11:40:35.913 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36553 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-11-28T11:40:35.913 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11593 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-28T11:40:35.913 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36529 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-11-28T11:40:35.913 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36265 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-11-28T11:40:35.913 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27793 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/lvstest.ko 2023-11-28T11:40:35.913 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/ 2023-11-28T11:40:35.913 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 64841 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-28T11:40:35.913 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12937 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-28T11:40:35.913 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20473 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-11-28T11:40:35.913 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25145 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-11-28T11:40:35.913 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22753 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-28T11:40:35.913 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 70809 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbtest.ko 2023-11-28T11:40:35.914 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41905 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-11-28T11:40:35.914 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27617 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-11-28T11:40:35.914 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/ 2023-11-28T11:40:35.914 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 72953 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/usbmon.ko 2023-11-28T11:40:35.914 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/ 2023-11-28T11:40:35.914 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 301697 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/musb_hdrc.ko 2023-11-28T11:40:35.914 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/ 2023-11-28T11:40:35.914 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21105 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-11-28T11:40:35.914 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20177 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-11-28T11:40:35.914 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12257 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-isp1301.ko 2023-11-28T11:40:35.914 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21745 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-tahvo.ko 2023-11-28T11:40:35.914 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ 2023-11-28T11:40:35.914 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13209 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-11-28T11:40:35.915 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-11-28T11:40:35.915 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26633 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-28T11:40:35.915 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38105 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-11-28T11:40:35.915 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 70257 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-11-28T11:40:35.915 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31057 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-11-28T11:40:35.915 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 58217 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-28T11:40:35.915 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 49817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-28T11:40:35.915 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9617 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-11-28T11:40:35.915 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 44273 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/f81232.ko 2023-11-28T11:40:35.915 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 175137 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-28T11:40:35.915 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 53113 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-28T11:40:35.915 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 137081 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-28T11:40:35.915 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 124833 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-11-28T11:40:35.916 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 67769 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-11-28T11:40:35.916 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19161 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-11-28T11:40:35.916 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26897 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-11-28T11:40:35.916 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 58233 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-28T11:40:35.916 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 107521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-11-28T11:40:35.916 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35617 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-28T11:40:35.916 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25665 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-28T11:40:35.916 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33689 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-28T11:40:35.916 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32953 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-11-28T11:40:35.916 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22033 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/metro-usb.ko 2023-11-28T11:40:35.916 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 66449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-11-28T11:40:35.916 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 78217 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-11-28T11:40:35.917 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 56337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mxuport.ko 2023-11-28T11:40:35.917 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14025 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-11-28T11:40:35.917 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12009 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-11-28T11:40:35.917 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24633 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-11-28T11:40:35.917 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 191137 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-11-28T11:40:35.917 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-11-28T11:40:35.917 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 54353 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-11-28T11:40:35.917 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-11-28T11:40:35.917 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-11-28T11:40:35.917 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-11-28T11:40:35.917 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15393 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-11-28T11:40:35.917 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 51625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-11-28T11:40:35.918 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21673 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-28T11:40:35.918 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29993 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-11-28T11:40:35.918 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17265 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-11-28T11:40:35.918 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 61489 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-28T11:40:35.918 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-28T11:40:35.918 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10241 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-11-28T11:40:35.919 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33201 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-28T11:40:35.919 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 125609 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usbserial.ko 2023-11-28T11:40:35.919 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28753 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-11-28T11:40:35.919 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37409 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-11-28T11:40:35.919 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/wishbone-serial.ko 2023-11-28T11:40:35.919 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-28T11:40:35.920 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ 2023-11-28T11:40:35.920 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 52913 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-11-28T11:40:35.920 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26017 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-28T11:40:35.920 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13049 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-28T11:40:35.920 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22049 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-28T11:40:35.920 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-28T11:40:35.920 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13745 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-28T11:40:35.920 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19769 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-28T11:40:35.920 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19361 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-28T11:40:35.920 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13713 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-11-28T11:40:35.920 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17841 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-28T11:40:35.920 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28441 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-28T11:40:35.920 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28905 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-28T11:40:35.920 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-28T11:40:35.921 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-28T11:40:35.921 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 179969 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-11-28T11:40:35.921 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/ 2023-11-28T11:40:35.921 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 67481 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-28T11:40:35.921 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 72177 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-28T11:40:35.921 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 107001 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-28T11:40:35.921 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/ 2023-11-28T11:40:35.921 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/ 2023-11-28T11:40:35.921 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 154297 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-28T11:40:35.921 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-28T11:40:35.921 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 108737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-11-28T11:40:35.921 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 77609 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-28T11:40:35.921 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/ 2023-11-28T11:40:35.922 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 113785 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-11-28T11:40:35.922 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17009 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-28T11:40:35.922 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 58089 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-11-28T11:40:35.922 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 89249 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-11-28T11:40:35.922 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/ 2023-11-28T11:40:35.922 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/ 2023-11-28T11:40:35.922 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15417 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-11-28T11:40:35.922 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12393 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/aat2870_bl.ko 2023-11-28T11:40:35.922 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23305 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp5520_bl.ko 2023-11-28T11:40:35.922 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32609 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8860_bl.ko 2023-11-28T11:40:35.922 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39993 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8870_bl.ko 2023-11-28T11:40:35.922 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16921 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-11-28T11:40:35.922 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16777 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/as3711_bl.ko 2023-11-28T11:40:35.923 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12033 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/bd6107.ko 2023-11-28T11:40:35.923 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11409 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da903x_bl.ko 2023-11-28T11:40:35.923 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11273 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da9052_bl.ko 2023-11-28T11:40:35.923 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11753 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/gpio_backlight.ko 2023-11-28T11:40:35.923 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14769 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/kb3886_bl.ko 2023-11-28T11:40:35.923 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22017 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-11-28T11:40:35.923 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23657 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3533_bl.ko 2023-11-28T11:40:35.923 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3639_bl.ko 2023-11-28T11:40:35.923 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lv5207lp.ko 2023-11-28T11:40:35.923 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14345 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/max8925_bl.ko 2023-11-28T11:40:35.923 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11313 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pandora_bl.ko 2023-11-28T11:40:35.923 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10865 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-11-28T11:40:35.923 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10897 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-28T11:40:35.924 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/wm831x_bl.ko 2023-11-28T11:40:35.924 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/ 2023-11-28T11:40:35.924 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ 2023-11-28T11:40:35.924 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18785 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-11-28T11:40:35.924 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-11-28T11:40:35.924 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11265 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/matrox_w1.ko 2023-11-28T11:40:35.924 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12417 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/w1-gpio.ko 2023-11-28T11:40:35.924 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/ 2023-11-28T11:40:35.924 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12041 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-28T11:40:35.924 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22745 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-28T11:40:35.924 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15113 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-28T11:40:35.924 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-28T11:40:35.924 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14153 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-28T11:40:35.925 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11929 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-28T11:40:35.925 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14049 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-28T11:40:35.925 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14049 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-28T11:40:35.925 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17921 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-28T11:40:35.925 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7385 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-28T11:40:35.925 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 56425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-28T11:40:35.925 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 102673 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-11-28T11:40:35.925 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ 2023-11-28T11:40:35.925 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18793 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/acquirewdt.ko 2023-11-28T11:40:35.925 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19977 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/advantechwdt.ko 2023-11-28T11:40:35.925 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18561 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-28T11:40:35.925 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22969 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-28T11:40:35.925 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19113 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/cpu5wdt.ko 2023-11-28T11:40:35.925 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13617 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9052_wdt.ko 2023-11-28T11:40:35.926 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12777 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9055_wdt.ko 2023-11-28T11:40:35.926 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17409 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9063_wdt.ko 2023-11-28T11:40:35.926 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20169 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/dw_wdt.ko 2023-11-28T11:40:35.926 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20265 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/eurotechwdt.ko 2023-11-28T11:40:35.926 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23865 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-28T11:40:35.926 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27401 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-11-28T11:40:35.926 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15577 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-11-28T11:40:35.926 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10833 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-28T11:40:35.926 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21913 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-28T11:40:35.926 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19241 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-11-28T11:40:35.926 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18689 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-11-28T11:40:35.926 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19713 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-28T11:40:35.926 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21225 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-28T11:40:35.927 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13841 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-11-28T11:40:35.927 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21489 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/kempld_wdt.ko 2023-11-28T11:40:35.927 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18617 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-11-28T11:40:35.927 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/mena21_wdt.ko 2023-11-28T11:40:35.927 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13217 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-11-28T11:40:35.927 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24673 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-11-28T11:40:35.927 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-11-28T11:40:35.927 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22265 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pc87413_wdt.ko 2023-11-28T11:40:35.927 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38657 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-28T11:40:35.927 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-28T11:40:35.927 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13065 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/retu_wdt.ko 2023-11-28T11:40:35.927 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-11-28T11:40:35.927 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14129 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-11-28T11:40:35.928 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-28T11:40:35.928 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23809 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sc1200wdt.ko 2023-11-28T11:40:35.928 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-28T11:40:35.928 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21577 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-11-28T11:40:35.928 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17273 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-11-28T11:40:35.928 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22273 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-28T11:40:35.928 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/twl4030_wdt.ko 2023-11-28T11:40:35.928 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17649 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-11-28T11:40:35.928 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19161 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-28T11:40:35.928 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20681 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-28T11:40:35.928 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25409 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-28T11:40:35.928 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wafer5823wdt.ko 2023-11-28T11:40:35.928 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28089 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-11-28T11:40:35.929 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16257 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm831x_wdt.ko 2023-11-28T11:40:35.929 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13785 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm8350_wdt.ko 2023-11-28T11:40:35.929 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15697 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-11-28T11:40:35.929 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/ 2023-11-28T11:40:35.929 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-11-28T11:40:35.929 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26769 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-11-28T11:40:35.929 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 47865 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-11-28T11:40:35.929 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/ 2023-11-28T11:40:35.929 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 176377 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-28T11:40:35.930 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40121 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-11-28T11:40:35.930 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 71249 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-scsiback.ko 2023-11-28T11:40:35.930 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/ 2023-11-28T11:40:35.930 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-28T11:40:35.930 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ 2023-11-28T11:40:35.930 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/ 2023-11-28T11:40:35.930 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 166425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-11-28T11:40:35.930 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/ 2023-11-28T11:40:35.930 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 61073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/adfs.ko 2023-11-28T11:40:35.930 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/ 2023-11-28T11:40:35.930 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 163593 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-11-28T11:40:35.930 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/ 2023-11-28T11:40:35.931 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 932817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/kafs.ko 2023-11-28T11:40:35.931 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/ 2023-11-28T11:40:35.931 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 101057 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/autofs4.ko 2023-11-28T11:40:35.931 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/ 2023-11-28T11:40:35.931 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 64545 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-11-28T11:40:35.931 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/ 2023-11-28T11:40:35.931 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41257 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/bfs.ko 2023-11-28T11:40:35.931 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-11-28T11:40:35.931 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/ 2023-11-28T11:40:35.931 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 3402729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-11-28T11:40:35.931 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/ 2023-11-28T11:40:35.931 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 306009 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-11-28T11:40:35.931 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ 2023-11-28T11:40:35.932 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1333017 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-11-28T11:40:35.932 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/ 2023-11-28T11:40:35.932 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 100801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-11-28T11:40:35.932 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/ 2023-11-28T11:40:35.932 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 108393 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/configfs.ko 2023-11-28T11:40:35.932 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/ 2023-11-28T11:40:35.932 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-11-28T11:40:35.932 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/ 2023-11-28T11:40:35.932 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 642513 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-11-28T11:40:35.932 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/ 2023-11-28T11:40:35.932 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36649 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/efs.ko 2023-11-28T11:40:35.932 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/ 2023-11-28T11:40:35.932 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1505025 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-11-28T11:40:35.933 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/ 2023-11-28T11:40:35.933 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27929 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-11-28T11:40:35.933 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/ 2023-11-28T11:40:35.933 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 42545 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/freevxfs.ko 2023-11-28T11:40:35.933 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/ 2023-11-28T11:40:35.933 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 226481 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-11-28T11:40:35.933 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/ 2023-11-28T11:40:35.933 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24489 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-11-28T11:40:35.933 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/ 2023-11-28T11:40:35.933 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1231529 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-11-28T11:40:35.933 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/ 2023-11-28T11:40:35.933 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 141209 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-11-28T11:40:35.933 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/ 2023-11-28T11:40:35.934 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 222817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-11-28T11:40:35.934 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/ 2023-11-28T11:40:35.934 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 192329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/hpfs.ko 2023-11-28T11:40:35.934 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/ 2023-11-28T11:40:35.934 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 74065 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-11-28T11:40:35.934 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/ 2023-11-28T11:40:35.934 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 419497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-11-28T11:40:35.934 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/ 2023-11-28T11:40:35.934 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 280313 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-11-28T11:40:35.934 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/ 2023-11-28T11:40:35.934 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 89193 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-11-28T11:40:35.934 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/ 2023-11-28T11:40:35.934 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 124649 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-11-28T11:40:35.935 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/ 2023-11-28T11:40:35.935 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/ 2023-11-28T11:40:35.935 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 81449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-28T11:40:35.935 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/ 2023-11-28T11:40:35.935 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 59449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-28T11:40:35.935 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/ 2023-11-28T11:40:35.935 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 117465 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-28T11:40:35.935 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1055721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-11-28T11:40:35.935 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 66441 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv2.ko 2023-11-28T11:40:35.935 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 120177 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-11-28T11:40:35.935 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 2042137 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-11-28T11:40:35.935 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/ 2023-11-28T11:40:35.935 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16929 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-11-28T11:40:35.936 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16145 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-11-28T11:40:35.936 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/ 2023-11-28T11:40:35.936 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1516873 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-11-28T11:40:35.936 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/ 2023-11-28T11:40:35.936 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 592833 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-11-28T11:40:35.936 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/ 2023-11-28T11:40:35.936 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13793 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-11-28T11:40:35.936 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13169 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-11-28T11:40:35.936 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13793 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-11-28T11:40:35.936 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12865 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-11-28T11:40:35.936 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13481 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-11-28T11:40:35.936 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12857 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-11-28T11:40:35.937 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13793 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-11-28T11:40:35.937 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13169 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-11-28T11:40:35.937 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14097 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-11-28T11:40:35.937 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13793 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-11-28T11:40:35.937 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13793 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-11-28T11:40:35.937 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11297 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ascii.ko 2023-11-28T11:40:35.937 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-11-28T11:40:35.937 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12233 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-11-28T11:40:35.937 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12921 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-11-28T11:40:35.937 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-11-28T11:40:35.937 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-11-28T11:40:35.937 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12225 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-11-28T11:40:35.937 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12225 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-11-28T11:40:35.938 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12225 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-11-28T11:40:35.938 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11913 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-11-28T11:40:35.938 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12849 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-11-28T11:40:35.938 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13161 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-11-28T11:40:35.938 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13473 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-11-28T11:40:35.938 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13161 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-11-28T11:40:35.938 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12849 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-11-28T11:40:35.938 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13161 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-11-28T11:40:35.938 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-11-28T11:40:35.938 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12225 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-11-28T11:40:35.938 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-11-28T11:40:35.938 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 94137 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-11-28T11:40:35.938 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 142673 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-11-28T11:40:35.939 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 165745 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-11-28T11:40:35.939 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 118121 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-11-28T11:40:35.939 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12457 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-11-28T11:40:35.939 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11305 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-11-28T11:40:35.939 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11929 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-11-28T11:40:35.939 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11929 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-11-28T11:40:35.939 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11929 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-11-28T11:40:35.939 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11921 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-11-28T11:40:35.939 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11921 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-11-28T11:40:35.939 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11921 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-11-28T11:40:35.939 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11921 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-11-28T11:40:35.939 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11617 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-11-28T11:40:35.940 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12233 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-11-28T11:40:35.940 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11617 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-11-28T11:40:35.940 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-11-28T11:40:35.940 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8017 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-11-28T11:40:35.940 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-11-28T11:40:35.940 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7569 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-28T11:40:35.940 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-11-28T11:40:35.940 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ 2023-11-28T11:40:35.940 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 219417 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ntfs.ko 2023-11-28T11:40:35.940 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ 2023-11-28T11:40:35.940 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ 2023-11-28T11:40:35.940 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 244409 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-28T11:40:35.940 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ 2023-11-28T11:40:35.941 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 440737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-28T11:40:35.941 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ 2023-11-28T11:40:35.941 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 54049 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-28T11:40:35.941 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 2592433 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-11-28T11:40:35.941 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17905 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-28T11:40:35.941 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-28T11:40:35.941 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35897 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-28T11:40:35.941 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/ 2023-11-28T11:40:35.941 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 53433 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/omfs.ko 2023-11-28T11:40:35.941 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/ 2023-11-28T11:40:35.941 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 352161 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-11-28T11:40:35.941 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ 2023-11-28T11:40:35.941 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 54809 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-11-28T11:40:35.942 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/ 2023-11-28T11:40:35.942 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26865 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/qnx4.ko 2023-11-28T11:40:35.942 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/ 2023-11-28T11:40:35.942 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 46689 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/qnx6.ko 2023-11-28T11:40:35.942 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/ 2023-11-28T11:40:35.942 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30881 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_tree.ko 2023-11-28T11:40:35.942 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14297 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v1.ko 2023-11-28T11:40:35.942 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22017 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v2.ko 2023-11-28T11:40:35.942 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/ 2023-11-28T11:40:35.942 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 532673 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-11-28T11:40:35.942 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/ 2023-11-28T11:40:35.942 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28641 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-11-28T11:40:35.943 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/ 2023-11-28T11:40:35.943 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/ 2023-11-28T11:40:35.943 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 2668401 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-11-28T11:40:35.943 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/ 2023-11-28T11:40:35.943 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7161 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-11-28T11:40:35.943 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11257 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-11-28T11:40:35.943 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/ 2023-11-28T11:40:35.943 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 134641 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-11-28T11:40:35.943 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/ 2023-11-28T11:40:35.943 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 90721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-11-28T11:40:35.943 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/ 2023-11-28T11:40:35.943 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 247737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-11-28T11:40:35.943 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ 2023-11-28T11:40:35.944 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 162497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-11-28T11:40:35.944 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/ 2023-11-28T11:40:35.944 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 4011017 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-11-28T11:40:35.944 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/ 2023-11-28T11:40:35.944 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/ 2023-11-28T11:40:35.944 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 75489 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/locktorture.ko 2023-11-28T11:40:35.944 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/ 2023-11-28T11:40:35.944 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/test_udelay.ko 2023-11-28T11:40:35.944 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 60553 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-11-28T11:40:35.944 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ 2023-11-28T11:40:35.944 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 6833 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-11-28T11:40:35.944 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 6529 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc7.ko 2023-11-28T11:40:35.944 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7025 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-11-28T11:40:35.945 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/ 2023-11-28T11:40:35.945 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7097 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-11-28T11:40:35.945 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37081 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-11-28T11:40:35.945 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13313 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/interval_tree_test.ko 2023-11-28T11:40:35.945 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-11-28T11:40:35.945 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24953 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-11-28T11:40:35.945 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/ 2023-11-28T11:40:35.945 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-11-28T11:40:35.945 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22633 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-11-28T11:40:35.945 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/ 2023-11-28T11:40:35.945 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 6617 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-11-28T11:40:35.945 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8233 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/memory-notifier-error-inject.ko 2023-11-28T11:40:35.946 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10865 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/notifier-error-inject.ko 2023-11-28T11:40:35.946 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14089 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/percpu_test.ko 2023-11-28T11:40:35.946 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8305 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/pm-notifier-error-inject.ko 2023-11-28T11:40:35.946 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/ 2023-11-28T11:40:35.946 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 143433 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-11-28T11:40:35.946 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21105 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/rbtree_test.ko 2023-11-28T11:40:35.946 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/ 2023-11-28T11:40:35.946 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18753 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-28T11:40:35.946 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38841 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-kstrtox.ko 2023-11-28T11:40:35.946 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-string_helpers.ko 2023-11-28T11:40:35.946 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 4760425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_bpf.ko 2023-11-28T11:40:35.946 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 49089 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_firmware.ko 2023-11-28T11:40:35.946 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 6369 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_module.ko 2023-11-28T11:40:35.947 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_user_copy.ko 2023-11-28T11:40:35.947 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-11-28T11:40:35.947 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11121 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-11-28T11:40:35.947 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-11-28T11:40:35.947 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/ 2023-11-28T11:40:35.947 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13545 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/xz_dec_test.ko 2023-11-28T11:40:35.947 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/ 2023-11-28T11:40:35.947 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-11-28T11:40:35.947 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ 2023-11-28T11:40:35.947 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/ 2023-11-28T11:40:35.947 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 55737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-11-28T11:40:35.947 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7049 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-11-28T11:40:35.947 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7065 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-11-28T11:40:35.948 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7049 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-11-28T11:40:35.948 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 6985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-28T11:40:35.948 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7065 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-11-28T11:40:35.948 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7001 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-11-28T11:40:35.948 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-11-28T11:40:35.948 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/ 2023-11-28T11:40:35.948 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30385 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-11-28T11:40:35.948 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34809 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-11-28T11:40:35.948 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8545 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-11-28T11:40:35.948 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16345 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-11-28T11:40:35.948 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-11-28T11:40:35.948 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/ 2023-11-28T11:40:35.949 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 81737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-11-28T11:40:35.949 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/ 2023-11-28T11:40:35.949 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 198337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-11-28T11:40:35.949 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35977 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-11-28T11:40:35.949 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26345 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-11-28T11:40:35.949 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-11-28T11:40:35.949 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/ 2023-11-28T11:40:35.949 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 649297 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-11-28T11:40:35.977 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/ 2023-11-28T11:40:35.977 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 63809 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-11-28T11:40:35.977 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 777689 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-11-28T11:40:35.977 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ 2023-11-28T11:40:35.977 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7657 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-28T11:40:35.977 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12385 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-28T11:40:35.977 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9169 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-28T11:40:35.977 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-28T11:40:35.977 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-28T11:40:35.977 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-28T11:40:35.977 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9145 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-28T11:40:35.978 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-28T11:40:35.978 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13217 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-28T11:40:35.978 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-28T11:40:35.978 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7593 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-28T11:40:35.978 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8385 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-28T11:40:35.978 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-28T11:40:35.978 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9593 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-28T11:40:35.978 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8649 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-28T11:40:35.978 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-28T11:40:35.978 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12401 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-28T11:40:35.978 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11529 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-28T11:40:35.978 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-28T11:40:35.979 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9793 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-28T11:40:35.979 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 55929 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-11-28T11:40:35.979 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14041 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-28T11:40:35.979 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13945 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-28T11:40:35.979 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/ 2023-11-28T11:40:35.979 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1046833 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-11-28T11:40:35.979 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/ 2023-11-28T11:40:35.979 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 125993 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-11-28T11:40:35.979 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/ 2023-11-28T11:40:35.979 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 194209 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-11-28T11:40:35.979 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8665 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-11-28T11:40:35.979 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 57881 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-11-28T11:40:35.979 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 60337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-11-28T11:40:35.980 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/ 2023-11-28T11:40:35.980 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 390473 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-11-28T11:40:35.980 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-11-28T11:40:35.980 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12577 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-11-28T11:40:35.980 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-11-28T11:40:35.980 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8953 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-11-28T11:40:35.980 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/ 2023-11-28T11:40:35.980 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 99729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/hsr.ko 2023-11-28T11:40:35.980 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ 2023-11-28T11:40:35.980 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ 2023-11-28T11:40:35.980 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 45233 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-28T11:40:35.980 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 254625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-11-28T11:40:35.981 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 47289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-28T11:40:35.981 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ 2023-11-28T11:40:35.981 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-11-28T11:40:35.981 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38905 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-11-28T11:40:35.981 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 48337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-11-28T11:40:35.981 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18121 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-11-28T11:40:35.981 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 48657 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-11-28T11:40:35.981 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 60633 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-11-28T11:40:35.981 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 61225 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-11-28T11:40:35.981 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34505 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-11-28T11:40:35.981 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14001 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-11-28T11:40:35.981 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28841 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-11-28T11:40:35.981 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ 2023-11-28T11:40:35.982 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37641 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-28T11:40:35.982 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8873 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-28T11:40:35.982 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10409 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-28T11:40:35.982 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41609 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ip_tables.ko 2023-11-28T11:40:35.982 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10057 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-28T11:40:35.982 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9681 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-11-28T11:40:35.982 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14121 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-28T11:40:35.982 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11177 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-28T11:40:35.982 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14881 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-28T11:40:35.982 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11305 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-11-28T11:40:35.982 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11649 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-28T11:40:35.982 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14905 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-28T11:40:35.983 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11545 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-28T11:40:35.983 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10409 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-28T11:40:35.983 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-28T11:40:35.983 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-28T11:40:35.983 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-28T11:40:35.983 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18161 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-28T11:40:35.983 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-28T11:40:35.983 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20561 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-11-28T11:40:35.983 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-28T11:40:35.983 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15177 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-28T11:40:35.983 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9961 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-28T11:40:35.983 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17113 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-28T11:40:35.983 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9009 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-28T11:40:35.984 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-11-28T11:40:35.984 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-11-28T11:40:35.984 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15369 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-11-28T11:40:35.984 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-11-28T11:40:35.984 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12401 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-11-28T11:40:35.984 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-11-28T11:40:35.984 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11473 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-11-28T11:40:35.984 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10433 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-11-28T11:40:35.984 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-11-28T11:40:35.984 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-11-28T11:40:35.984 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10089 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-11-28T11:40:35.984 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10953 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-11-28T11:40:35.984 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10185 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-11-28T11:40:35.985 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22601 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-11-28T11:40:35.985 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17097 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-11-28T11:40:35.985 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41665 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-11-28T11:40:35.985 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11361 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-28T11:40:35.985 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ 2023-11-28T11:40:35.985 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26377 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-11-28T11:40:35.985 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-11-28T11:40:35.985 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-11-28T11:40:35.985 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 80897 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_gre.ko 2023-11-28T11:40:35.985 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 93577 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-11-28T11:40:35.985 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-28T11:40:35.985 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 53273 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-11-28T11:40:35.986 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13785 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-11-28T11:40:35.986 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19017 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/mip6.ko 2023-11-28T11:40:35.986 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ 2023-11-28T11:40:35.986 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 42169 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-28T11:40:35.986 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11753 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-11-28T11:40:35.986 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9753 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-28T11:40:35.986 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14137 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-28T11:40:35.986 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14273 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-28T11:40:35.986 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-28T11:40:35.986 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16209 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-28T11:40:35.986 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16033 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-28T11:40:35.986 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8913 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-28T11:40:35.986 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9897 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-28T11:40:35.987 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10937 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-28T11:40:35.987 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10897 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-28T11:40:35.987 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-28T11:40:35.987 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11121 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-28T11:40:35.987 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15009 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-28T11:40:35.987 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11553 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-28T11:40:35.987 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10433 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-28T11:40:35.987 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39113 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-28T11:40:35.987 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-28T11:40:35.987 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25945 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-28T11:40:35.987 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-28T11:40:35.987 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15393 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-28T11:40:35.988 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9633 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-28T11:40:35.988 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16025 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-28T11:40:35.988 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9009 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-28T11:40:35.988 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 74073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-11-28T11:40:35.988 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24193 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-11-28T11:40:35.988 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23297 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-28T11:40:35.988 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/ 2023-11-28T11:40:35.988 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 82833 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-11-28T11:40:35.988 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/ 2023-11-28T11:40:35.988 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 125281 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-11-28T11:40:35.988 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20177 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-28T11:40:35.988 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25953 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-11-28T11:40:35.988 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35569 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-11-28T11:40:35.989 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36713 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-11-28T11:40:35.989 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33001 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-11-28T11:40:35.989 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 53241 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-11-28T11:40:35.989 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/ 2023-11-28T11:40:35.989 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 47977 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/lapb.ko 2023-11-28T11:40:35.989 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/ 2023-11-28T11:40:35.989 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23193 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-11-28T11:40:35.989 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 267913 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc2.ko 2023-11-28T11:40:35.989 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/ 2023-11-28T11:40:35.989 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 290417 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-11-28T11:40:35.989 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/ 2023-11-28T11:40:35.989 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9393 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-11-28T11:40:35.989 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ 2023-11-28T11:40:35.990 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ 2023-11-28T11:40:35.990 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 119585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-11-28T11:40:35.990 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28353 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-28T11:40:35.990 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26913 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-28T11:40:35.990 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26369 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-28T11:40:35.990 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 100297 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-28T11:40:35.990 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 101441 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-28T11:40:35.990 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 102817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-28T11:40:35.990 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 103417 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-28T11:40:35.990 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 112849 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-28T11:40:35.990 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 60329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-28T11:40:35.990 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 109593 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-28T11:40:35.990 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 113129 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-28T11:40:35.991 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 112585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-28T11:40:35.991 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 111585 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-28T11:40:35.991 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 114465 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-28T11:40:35.991 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30025 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-28T11:40:35.991 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ 2023-11-28T11:40:35.991 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 411729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-28T11:40:35.991 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11961 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-28T11:40:35.991 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-28T11:40:35.991 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-28T11:40:35.991 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17905 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-28T11:40:35.991 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20673 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-28T11:40:35.991 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7689 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-28T11:40:35.991 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7689 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-28T11:40:35.992 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10681 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-28T11:40:35.992 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9233 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-28T11:40:35.992 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7697 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-28T11:40:35.992 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-28T11:40:35.992 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7697 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-28T11:40:35.992 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10993 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-28T11:40:35.992 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 49257 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-11-28T11:40:35.992 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 408257 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-11-28T11:40:35.992 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-28T11:40:35.992 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10177 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-28T11:40:35.992 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33761 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-28T11:40:35.992 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 118145 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-28T11:40:35.993 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22185 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-28T11:40:35.993 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-28T11:40:35.993 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 107233 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-28T11:40:35.993 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33633 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-28T11:40:35.993 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17401 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-28T11:40:35.993 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 66641 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-28T11:40:35.993 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11233 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-28T11:40:35.993 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19185 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-28T11:40:35.993 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10113 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-28T11:40:35.993 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 89425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-11-28T11:40:35.993 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9593 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-28T11:40:35.993 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37129 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-11-28T11:40:35.993 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 95353 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-11-28T11:40:35.994 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10129 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-28T11:40:35.994 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-28T11:40:35.994 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11857 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-11-28T11:40:35.994 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28929 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-11-28T11:40:35.994 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8809 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-28T11:40:35.994 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 44065 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-28T11:40:35.994 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 615649 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-11-28T11:40:35.994 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 42561 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-11-28T11:40:35.994 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30233 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-28T11:40:35.994 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30569 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-11-28T11:40:35.994 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39785 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-11-28T11:40:35.994 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22921 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-28T11:40:35.995 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 49377 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-28T11:40:35.995 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10457 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-11-28T11:40:35.995 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33209 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-11-28T11:40:35.995 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-11-28T11:40:35.995 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9601 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-28T11:40:35.995 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11401 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-11-28T11:40:35.995 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13745 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-28T11:40:35.995 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14185 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-11-28T11:40:35.995 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20065 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-11-28T11:40:35.995 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15401 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-11-28T11:40:35.995 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-11-28T11:40:35.995 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-11-28T11:40:35.995 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13673 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-11-28T11:40:35.996 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11841 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_osf.ko 2023-11-28T11:40:35.996 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-11-28T11:40:35.996 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14193 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-11-28T11:40:35.996 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-11-28T11:40:35.996 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10081 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-11-28T11:40:35.996 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-11-28T11:40:35.996 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20369 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_synproxy.ko 2023-11-28T11:40:35.996 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14849 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tproxy.ko 2023-11-28T11:40:35.996 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 89313 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/x_tables.ko 2023-11-28T11:40:35.996 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12097 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-11-28T11:40:35.996 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9633 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-28T11:40:35.996 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-28T11:40:35.996 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-28T11:40:35.997 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18169 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-11-28T11:40:35.997 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-11-28T11:40:35.997 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9465 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-11-28T11:40:35.997 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13369 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-11-28T11:40:35.997 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38873 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-28T11:40:35.997 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13889 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-11-28T11:40:35.997 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11489 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-11-28T11:40:35.997 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11753 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-28T11:40:35.997 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11657 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-11-28T11:40:35.997 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9473 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-11-28T11:40:35.997 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-28T11:40:35.998 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19665 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-11-28T11:40:35.998 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-28T11:40:35.998 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14337 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-11-28T11:40:35.998 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16057 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-28T11:40:35.998 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10433 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-28T11:40:35.998 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17361 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-11-28T11:40:35.998 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16785 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-11-28T11:40:35.998 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8321 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-11-28T11:40:35.998 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13897 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-11-28T11:40:35.998 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13897 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-11-28T11:40:35.998 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15529 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-11-28T11:40:35.998 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11209 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-11-28T11:40:35.999 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7505 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-11-28T11:40:35.999 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10465 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-11-28T11:40:35.999 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11081 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-11-28T11:40:35.999 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9401 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-11-28T11:40:35.999 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13129 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-11-28T11:40:35.999 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12401 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-11-28T11:40:35.999 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-11-28T11:40:35.999 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10969 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-11-28T11:40:35.999 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7865 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-11-28T11:40:35.999 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8801 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-11-28T11:40:35.999 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10657 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-11-28T11:40:35.999 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11473 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-11-28T11:40:36.000 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 43289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-11-28T11:40:36.000 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11313 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-11-28T11:40:36.000 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7865 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-11-28T11:40:36.000 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11921 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-11-28T11:40:36.000 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11473 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-11-28T11:40:36.000 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11785 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-11-28T11:40:36.000 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16041 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-11-28T11:40:36.000 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8001 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-11-28T11:40:36.000 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10209 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-11-28T11:40:36.000 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7545 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-11-28T11:40:36.000 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8577 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-11-28T11:40:36.000 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11825 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-11-28T11:40:36.000 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-11-28T11:40:36.001 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10105 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-11-28T11:40:36.001 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8297 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-11-28T11:40:36.001 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9553 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-11-28T11:40:36.001 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-11-28T11:40:36.001 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7633 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-11-28T11:40:36.001 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11985 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-11-28T11:40:36.001 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9473 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-11-28T11:40:36.001 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10409 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-11-28T11:40:36.001 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8257 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-11-28T11:40:36.001 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36433 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-11-28T11:40:36.001 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13329 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-11-28T11:40:36.001 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30089 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-11-28T11:40:36.002 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16089 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-11-28T11:40:36.002 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9505 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-11-28T11:40:36.002 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9473 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-11-28T11:40:36.002 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8809 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-11-28T11:40:36.002 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8553 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-11-28T11:40:36.002 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15777 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpudp.ko 2023-11-28T11:40:36.002 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11065 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-11-28T11:40:36.002 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9401 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-11-28T11:40:36.002 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/ 2023-11-28T11:40:36.002 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13969 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-11-28T11:40:36.002 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/ 2023-11-28T11:40:36.003 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-11-28T11:40:36.003 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/ 2023-11-28T11:40:36.003 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 380033 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-11-28T11:40:36.003 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10257 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-11-28T11:40:36.003 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-11-28T11:40:36.003 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11793 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-11-28T11:40:36.003 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/ 2023-11-28T11:40:36.003 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13057 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-11-28T11:40:36.003 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/ 2023-11-28T11:40:36.003 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 110201 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/phonet.ko 2023-11-28T11:40:36.003 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 54721 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/pn_pep.ko 2023-11-28T11:40:36.004 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/ 2023-11-28T11:40:36.004 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 251481 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-11-28T11:40:36.004 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 164937 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-11-28T11:40:36.004 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 67377 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-11-28T11:40:36.004 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/ 2023-11-28T11:40:36.004 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 819657 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/rxrpc.ko 2023-11-28T11:40:36.004 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/ 2023-11-28T11:40:36.004 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32241 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-11-28T11:40:36.004 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23577 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-11-28T11:40:36.004 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26873 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-11-28T11:40:36.004 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34097 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-11-28T11:40:36.004 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23401 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-11-28T11:40:36.005 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 43449 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-11-28T11:40:36.005 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31961 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-11-28T11:40:36.005 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-11-28T11:40:36.005 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35297 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-11-28T11:40:36.005 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36665 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-11-28T11:40:36.005 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26169 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-11-28T11:40:36.005 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33961 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-11-28T11:40:36.005 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19169 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_cgroup.ko 2023-11-28T11:40:36.005 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31401 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-11-28T11:40:36.005 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31769 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-11-28T11:40:36.005 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38425 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-11-28T11:40:36.005 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 61409 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-11-28T11:40:36.006 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7441 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-11-28T11:40:36.006 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13409 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-11-28T11:40:36.006 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33289 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-11-28T11:40:36.006 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7897 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-11-28T11:40:36.006 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-11-28T11:40:36.006 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7249 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-11-28T11:40:36.006 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21649 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-11-28T11:40:36.006 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20849 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-11-28T11:40:36.006 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34633 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-11-28T11:40:36.006 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33609 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-11-28T11:40:36.006 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31617 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq_codel.ko 2023-11-28T11:40:36.006 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35433 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-11-28T11:40:36.007 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 49817 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-11-28T11:40:36.007 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22089 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-11-28T11:40:36.007 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 66393 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-11-28T11:40:36.007 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26073 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-11-28T11:40:36.007 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30273 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-11-28T11:40:36.007 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10793 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-11-28T11:40:36.007 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26065 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-11-28T11:40:36.007 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36137 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-11-28T11:40:36.007 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27497 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-11-28T11:40:36.007 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10625 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-11-28T11:40:36.007 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-11-28T11:40:36.007 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 48729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-11-28T11:40:36.008 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32905 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-11-28T11:40:36.008 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26881 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-11-28T11:40:36.008 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31353 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-11-28T11:40:36.008 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28897 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-11-28T11:40:36.008 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28105 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-11-28T11:40:36.008 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/ 2023-11-28T11:40:36.008 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 929745 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-11-28T11:40:36.008 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19033 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-11-28T11:40:36.008 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/ 2023-11-28T11:40:36.008 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/ 2023-11-28T11:40:36.008 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 336529 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-28T11:40:36.008 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 54737 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-28T11:40:36.009 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1520097 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-11-28T11:40:36.009 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/ 2023-11-28T11:40:36.009 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 707657 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-28T11:40:36.009 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/ 2023-11-28T11:40:36.009 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10025 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-11-28T11:40:36.009 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 862665 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-11-28T11:40:36.009 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/ 2023-11-28T11:40:36.009 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15729 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-11-28T11:40:36.009 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/ 2023-11-28T11:40:36.009 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 85409 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-28T11:40:36.009 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 68049 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-28T11:40:36.009 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 96193 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-11-28T11:40:36.010 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10705 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-28T11:40:36.010 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17521 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-28T11:40:36.010 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/ 2023-11-28T11:40:36.010 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 125177 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/x25.ko 2023-11-28T11:40:36.010 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/ 2023-11-28T11:40:36.010 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22657 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_algo.ko 2023-11-28T11:40:36.010 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20649 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-28T11:40:36.010 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 102257 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_user.ko 2023-11-28T11:40:36.010 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/ 2023-11-28T11:40:36.010 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/ 2023-11-28T11:40:36.010 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15537 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-11-28T11:40:36.010 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 640081 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-11-28T11:40:36.011 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 624107 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-28T11:40:36.011 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7663 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-11-28T11:40:36.011 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23428 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-28T11:40:36.011 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9821 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-28T11:40:36.011 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 70004 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-11-28T11:40:36.011 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 146313 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-11-28T11:40:36.011 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 232548 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-28T11:40:36.011 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 210 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-11-28T11:40:36.011 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 72606 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-11-28T11:40:36.011 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 879 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-11-28T11:40:36.011 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 254438 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-11-28T11:40:36.011 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 309363 2023-11-23 04:11 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-28T11:40:36.012 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./usr/ 2023-11-28T11:40:36.012 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./usr/share/ 2023-11-28T11:40:36.012 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./usr/share/doc/ 2023-11-28T11:40:36.012 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-11-23 04:11 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/ 2023-11-28T11:40:36.012 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 172 2023-11-23 04:11 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/changelog.Debian.gz 2023-11-28T11:40:36.012 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 691 2023-11-23 04:11 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/copyright 2023-11-28T11:40:36.013 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-11-28T11:40:36.013 INFO:teuthology.task.kernel:searching for kernel 6.6.0-g8247bbb5b470 2023-11-28T11:40:36.013 DEBUG:teuthology.orchestra.run.smithi039:> egrep '(submenu|menuentry.*6.6.0-g8247bbb5b470).*{' /boot/grub/grub.cfg 2023-11-28T11:40:36.022 INFO:teuthology.orchestra.run.smithi039.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-11-28T11:40:36.022 INFO:teuthology.orchestra.run.smithi039.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-11-28T11:40:36.022 INFO:teuthology.orchestra.run.smithi039.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-11-28T11:40:36.022 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-11-28T11:40:36.022 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-g8247bbb5b470 2023-11-28T11:40:36.023 DEBUG:teuthology.orchestra.run.smithi039:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-11-28T11:40:36.064 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi039.front.sepia.ceph.com to complete... 2023-11-28T11:40:36.686 INFO:teuthology.orchestra.run.smithi039.stderr:Sourcing file `/etc/default/grub' 2023-11-28T11:40:36.696 INFO:teuthology.orchestra.run.smithi039.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-28T11:40:36.716 INFO:teuthology.orchestra.run.smithi039.stderr:Generating grub configuration file ... 2023-11-28T11:40:37.091 INFO:teuthology.orchestra.run.smithi039.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T11:40:37.103 INFO:teuthology.orchestra.run.smithi039.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T11:40:37.471 INFO:teuthology.orchestra.run.smithi039.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-11-28T11:40:37.483 INFO:teuthology.orchestra.run.smithi039.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-11-28T11:40:38.445 INFO:teuthology.orchestra.run.smithi039.stderr:done 2023-11-28T11:41:06.134 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-11-28T11:41:06.135 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-11-28T11:41:06.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T11:41:09.614 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-11-28T11:41:09.614 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2023-11-28T11:41:09.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T11:41:44.166 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-11-28T11:41:53.174 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2023-11-28T11:41:53.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T11:41:56.226 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-11-28T11:42:06.146 DEBUG:teuthology.orchestra.remote:timed out 2023-11-28T11:42:08.229 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2023-11-28T11:42:08.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T11:42:15.154 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-11-28T11:42:15.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T11:42:15.842 DEBUG:teuthology.orchestra.run.smithi184:> true 2023-11-28T11:42:16.933 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-11-28T11:42:16.933 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.6.0-g8247bbb5b470"... 2023-11-28T11:42:16.933 DEBUG:teuthology.orchestra.run.smithi184:> uname -r 2023-11-28T11:42:16.989 INFO:teuthology.orchestra.run.smithi184.stdout:6.6.0-g8247bbb5b470 2023-11-28T11:42:16.989 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-11-28T11:42:16.989 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-28T11:42:16.989 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-28T11:42:17.991 DEBUG:teuthology.parallel:result is None 2023-11-28T11:43:08.232 DEBUG:teuthology.orchestra.remote:timed out 2023-11-28T11:43:23.233 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2023-11-28T11:43:23.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T11:43:23.481 DEBUG:teuthology.orchestra.run.smithi039:> true 2023-11-28T11:43:24.251 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com' 2023-11-28T11:43:24.252 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-g8247bbb5b470"... 2023-11-28T11:43:24.252 DEBUG:teuthology.orchestra.run.smithi039:> uname -r 2023-11-28T11:43:24.311 INFO:teuthology.orchestra.run.smithi039.stdout:6.6.0-g8247bbb5b470 2023-11-28T11:43:24.312 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-11-28T11:43:24.312 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-28T11:43:24.312 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-28T11:43:25.314 DEBUG:teuthology.parallel:result is None 2023-11-28T11:43:25.314 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-28T11:43:25.322 INFO:teuthology.task.internal:Creating test directory... 2023-11-28T11:43:25.323 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-28T11:43:25.330 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-28T11:43:25.351 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-28T11:43:25.365 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-28T11:43:25.398 INFO:teuthology.task.internal:Creating archive directory... 2023-11-28T11:43:25.398 DEBUG:teuthology.orchestra.run.smithi039:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-28T11:43:25.405 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-28T11:43:25.437 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-28T11:43:25.443 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-28T11:43:25.444 DEBUG:teuthology.orchestra.run.smithi039:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-28T11:43:25.477 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-28T11:43:25.592 INFO:teuthology.orchestra.run.smithi039.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T11:43:25.615 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T11:43:25.617 INFO:teuthology.orchestra.run.smithi039.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T11:43:25.651 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T11:43:25.656 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-28T11:43:25.663 INFO:teuthology.task.internal:Configuring sudo... 2023-11-28T11:43:25.663 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-28T11:43:25.671 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-28T11:43:25.707 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-28T11:43:25.716 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-28T11:43:25.716 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-28T11:43:25.749 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-28T11:43:25.768 DEBUG:teuthology.orchestra.run.smithi039:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-28T11:43:25.828 DEBUG:teuthology.orchestra.run.smithi039:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-28T11:43:25.893 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:43:25.893 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-28T11:43:25.978 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-28T11:43:25.996 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-28T11:43:26.061 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:43:26.061 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-28T11:43:26.153 DEBUG:teuthology.orchestra.run.smithi039:> sudo service rsyslog restart 2023-11-28T11:43:26.160 DEBUG:teuthology.orchestra.run.smithi184:> sudo service rsyslog restart 2023-11-28T11:43:26.331 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-28T11:43:26.338 INFO:teuthology.task.internal:Starting timer... 2023-11-28T11:43:26.338 INFO:teuthology.run_tasks:Running task pcp... 2023-11-28T11:43:26.376 INFO:teuthology.run_tasks:Running task selinux... 2023-11-28T11:43:26.407 DEBUG:teuthology.task.selinux:Excluding smithi039: OS 'ubuntu' does not support SELinux 2023-11-28T11:43:26.407 DEBUG:teuthology.task.selinux:Excluding smithi184: OS 'ubuntu' does not support SELinux 2023-11-28T11:43:26.408 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-28T11:43:26.408 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-11-28T11:43:26.408 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-28T11:43:26.408 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-28T11:43:26.441 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-11-28T11:43:26.447 INFO:teuthology.repo_utils:Fetching main from origin 2023-11-28T11:43:26.579 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-28T11:43:26.595 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-28T11:43:26.596 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi039.front.sepia.ceph.com,smithi184.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-28T11:51:40.897 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi039.front.sepia.ceph.com'), Remote(name='ubuntu@smithi184.front.sepia.ceph.com')] 2023-11-28T11:51:40.898 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2023-11-28T11:51:40.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T11:51:41.005 DEBUG:teuthology.orchestra.run.smithi039:> true 2023-11-28T11:51:41.255 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com' 2023-11-28T11:51:41.256 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-11-28T11:51:41.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T11:51:41.357 DEBUG:teuthology.orchestra.run.smithi184:> true 2023-11-28T11:51:41.573 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-11-28T11:51:41.573 INFO:teuthology.run_tasks:Running task clock... 2023-11-28T11:51:41.583 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-28T11:51:41.583 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-28T11:51:41.584 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T11:51:41.591 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-28T11:51:41.592 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T11:51:41.666 INFO:teuthology.orchestra.run.smithi039.stdout:28 Nov 11:51:41 ntpd[23360]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-11-28T11:51:41.667 INFO:teuthology.orchestra.run.smithi039.stdout:28 Nov 11:51:41 ntpd[23360]: Command line: ntpd -gq 2023-11-28T11:51:41.668 INFO:teuthology.orchestra.run.smithi039.stdout:28 Nov 11:51:41 ntpd[23360]: proto: precision = 0.058 usec (-24) 2023-11-28T11:51:41.668 INFO:teuthology.orchestra.run.smithi039.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T11:51:41.668 INFO:teuthology.orchestra.run.smithi039.stdout:28 Nov 11:51:41 ntpd[23360]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T11:51:41.669 INFO:teuthology.orchestra.run.smithi039.stdout:28 Nov 11:51:41 ntpd[23360]: restrict ::: KOD does nothing without LIMITED. 2023-11-28T11:51:41.669 INFO:teuthology.orchestra.run.smithi039.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-28T11:51:41.670 INFO:teuthology.orchestra.run.smithi039.stdout:28 Nov 11:51:41 ntpd[23360]: Listen and drop on 0 v6wildcard [::]:123 2023-11-28T11:51:41.670 INFO:teuthology.orchestra.run.smithi039.stdout:28 Nov 11:51:41 ntpd[23360]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-28T11:51:41.670 INFO:teuthology.orchestra.run.smithi039.stdout:28 Nov 11:51:41 ntpd[23360]: Listen normally on 2 lo 127.0.0.1:123 2023-11-28T11:51:41.670 INFO:teuthology.orchestra.run.smithi039.stdout:28 Nov 11:51:41 ntpd[23360]: Listen normally on 3 ens1f0 172.21.15.39:123 2023-11-28T11:51:41.670 INFO:teuthology.orchestra.run.smithi039.stdout:28 Nov 11:51:41 ntpd[23360]: Listen normally on 4 lo [::1]:123 2023-11-28T11:51:41.670 INFO:teuthology.orchestra.run.smithi039.stdout:28 Nov 11:51:41 ntpd[23360]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1370%3]:123 2023-11-28T11:51:41.670 INFO:teuthology.orchestra.run.smithi039.stdout:28 Nov 11:51:41 ntpd[23360]: Listening on routing socket on fd #22 for interface updates 2023-11-28T11:51:41.694 INFO:teuthology.orchestra.run.smithi184.stdout:28 Nov 11:51:41 ntpd[23439]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-11-28T11:51:41.694 INFO:teuthology.orchestra.run.smithi184.stdout:28 Nov 11:51:41 ntpd[23439]: Command line: ntpd -gq 2023-11-28T11:51:41.695 INFO:teuthology.orchestra.run.smithi184.stdout:28 Nov 11:51:41 ntpd[23439]: proto: precision = 0.051 usec (-24) 2023-11-28T11:51:41.695 INFO:teuthology.orchestra.run.smithi184.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T11:51:41.696 INFO:teuthology.orchestra.run.smithi184.stdout:28 Nov 11:51:41 ntpd[23439]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T11:51:41.696 INFO:teuthology.orchestra.run.smithi184.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-28T11:51:41.697 INFO:teuthology.orchestra.run.smithi184.stdout:28 Nov 11:51:41 ntpd[23439]: restrict ::: KOD does nothing without LIMITED. 2023-11-28T11:51:41.697 INFO:teuthology.orchestra.run.smithi184.stdout:28 Nov 11:51:41 ntpd[23439]: Listen and drop on 0 v6wildcard [::]:123 2023-11-28T11:51:41.697 INFO:teuthology.orchestra.run.smithi184.stdout:28 Nov 11:51:41 ntpd[23439]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-28T11:51:41.697 INFO:teuthology.orchestra.run.smithi184.stdout:28 Nov 11:51:41 ntpd[23439]: Listen normally on 2 lo 127.0.0.1:123 2023-11-28T11:51:41.697 INFO:teuthology.orchestra.run.smithi184.stdout:28 Nov 11:51:41 ntpd[23439]: Listen normally on 3 enp3s0f1 172.21.15.184:123 2023-11-28T11:51:41.697 INFO:teuthology.orchestra.run.smithi184.stdout:28 Nov 11:51:41 ntpd[23439]: Listen normally on 4 lo [::1]:123 2023-11-28T11:51:41.697 INFO:teuthology.orchestra.run.smithi184.stdout:28 Nov 11:51:41 ntpd[23439]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7b8f%5]:123 2023-11-28T11:51:41.697 INFO:teuthology.orchestra.run.smithi184.stdout:28 Nov 11:51:41 ntpd[23439]: Listening on routing socket on fd #22 for interface updates 2023-11-28T11:51:42.667 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:42 ntpd[23360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:42.668 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:42 ntpd[23360]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:42.668 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:42 ntpd[23360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:42.668 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:42 ntpd[23360]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:42.668 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:42 ntpd[23360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:42.668 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:42 ntpd[23360]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:42.669 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:42 ntpd[23360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:42.669 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:42 ntpd[23360]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:42.669 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:42 ntpd[23360]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T11:51:42.669 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:42 ntpd[23360]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T11:51:42.669 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:42 ntpd[23360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:42.669 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:42 ntpd[23360]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:42.669 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:42 ntpd[23360]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T11:51:42.670 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:42 ntpd[23360]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T11:51:42.695 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:42 ntpd[23439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:42.695 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:42 ntpd[23439]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:42.695 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:42 ntpd[23439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:42.695 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:42 ntpd[23439]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:42.696 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:42 ntpd[23439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:42.696 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:42 ntpd[23439]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:42.696 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:42 ntpd[23439]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T11:51:42.697 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:42 ntpd[23439]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T11:51:42.697 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:42 ntpd[23439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:42.697 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:42 ntpd[23439]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:42.697 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:42 ntpd[23439]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T11:51:42.697 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:42 ntpd[23439]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T11:51:43.695 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:43 ntpd[23439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:43.695 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:43 ntpd[23439]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:43.695 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:43 ntpd[23439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:43.695 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:43 ntpd[23439]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:43.695 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:43 ntpd[23439]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T11:51:43.695 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:43 ntpd[23439]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T11:51:44.668 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:44 ntpd[23360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:44.668 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:44 ntpd[23360]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:44.668 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:44 ntpd[23360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:44.669 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:44 ntpd[23360]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:44.669 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:44 ntpd[23360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:44.669 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:44 ntpd[23360]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:44.669 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:44 ntpd[23360]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T11:51:44.669 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:44 ntpd[23360]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T11:51:44.669 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:44 ntpd[23360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:44.669 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:44 ntpd[23360]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:44.669 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:44 ntpd[23360]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T11:51:44.669 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:44 ntpd[23360]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T11:51:44.696 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:44 ntpd[23439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:44.696 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:44 ntpd[23439]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:44.696 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:44 ntpd[23439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:44.697 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:44 ntpd[23439]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:44.697 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:44 ntpd[23439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:44.697 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:44 ntpd[23439]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:44.697 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:44 ntpd[23439]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T11:51:44.697 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:44 ntpd[23439]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T11:51:44.697 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:44 ntpd[23439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:44.697 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:44 ntpd[23439]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:44.698 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:44 ntpd[23439]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T11:51:44.698 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:44 ntpd[23439]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T11:51:45.667 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:45 ntpd[23360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:45.668 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:45 ntpd[23360]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:45.668 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:45 ntpd[23360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:45.668 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:45 ntpd[23360]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:45.668 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:45 ntpd[23360]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T11:51:45.668 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:45 ntpd[23360]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T11:51:45.695 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:45 ntpd[23439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:45.695 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:45 ntpd[23439]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:45.695 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:45 ntpd[23439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:45.695 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:45 ntpd[23439]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:45.695 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:45 ntpd[23439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:45.696 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:45 ntpd[23439]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:45.696 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:45 ntpd[23439]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T11:51:45.696 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:45 ntpd[23439]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T11:51:46.667 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:46 ntpd[23360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:46.668 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:46 ntpd[23360]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:46.668 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:46 ntpd[23360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:46.668 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:46 ntpd[23360]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:46.668 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:46 ntpd[23360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:46.668 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:46 ntpd[23360]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:46.668 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:46 ntpd[23360]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T11:51:46.668 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:46 ntpd[23360]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T11:51:46.668 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:46 ntpd[23360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:46.668 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:46 ntpd[23360]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:46.668 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:46 ntpd[23360]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T11:51:46.669 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:46 ntpd[23360]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T11:51:46.699 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:46 ntpd[23439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:46.700 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:46 ntpd[23439]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:46.700 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:46 ntpd[23439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:46.700 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:46 ntpd[23439]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:46.700 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:46 ntpd[23439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:46.700 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:46 ntpd[23439]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:46.700 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:46 ntpd[23439]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T11:51:46.700 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:46 ntpd[23439]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T11:51:46.700 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:46 ntpd[23439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:46.700 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:46 ntpd[23439]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:46.700 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:46 ntpd[23439]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T11:51:46.701 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:46 ntpd[23439]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T11:51:47.667 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:47 ntpd[23360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:47.668 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:47 ntpd[23360]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:47.668 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:47 ntpd[23360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:47.668 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:47 ntpd[23360]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:47.668 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:47 ntpd[23360]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T11:51:47.668 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:47 ntpd[23360]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T11:51:47.695 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:47 ntpd[23439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:47.695 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:47 ntpd[23439]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:47.695 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:47 ntpd[23439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:47.695 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:47 ntpd[23439]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:47.695 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:47 ntpd[23439]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T11:51:47.695 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:47 ntpd[23439]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T11:51:48.668 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:48 ntpd[23360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:48.668 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:48 ntpd[23360]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:48.668 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:48 ntpd[23360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:48.668 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:48 ntpd[23360]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:48.669 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:48 ntpd[23360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:48.669 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:48 ntpd[23360]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:48.669 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:48 ntpd[23360]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T11:51:48.669 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:48 ntpd[23360]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T11:51:48.669 INFO:teuthology.orchestra.run.smithi039.stdout:28 Nov 11:51:48 ntpd[23360]: ntpd: time slew +0.000280 s 2023-11-28T11:51:48.670 INFO:teuthology.orchestra.run.smithi039.stdout:ntpd: time slew +0.000280s 2023-11-28T11:51:48.670 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:48 ntpd[23360]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-28T11:51:48.671 INFO:teuthology.orchestra.run.smithi039.stderr:28 Nov 11:51:48 ntpd[23360]: can't open /var/log/ntpstats/loopstats.20231128: Permission denied 2023-11-28T11:51:48.695 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:48 ntpd[23439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:48.695 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:48 ntpd[23439]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:48.695 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:48 ntpd[23439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:48.696 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:48 ntpd[23439]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:48.696 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:48 ntpd[23439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:51:48.696 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:48 ntpd[23439]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:51:48.696 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:48 ntpd[23439]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T11:51:48.696 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:48 ntpd[23439]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T11:51:48.697 INFO:teuthology.orchestra.run.smithi184.stdout:28 Nov 11:51:48 ntpd[23439]: ntpd: time slew +0.000583 s 2023-11-28T11:51:48.697 INFO:teuthology.orchestra.run.smithi184.stdout:ntpd: time slew +0.000583s 2023-11-28T11:51:48.697 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:48 ntpd[23439]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-28T11:51:48.698 INFO:teuthology.orchestra.run.smithi184.stderr:28 Nov 11:51:48 ntpd[23439]: can't open /var/log/ntpstats/loopstats.20231128: Permission denied 2023-11-28T11:51:48.824 INFO:teuthology.orchestra.run.smithi039.stdout: remote refid st t when poll reach delay offset jitter 2023-11-28T11:51:48.824 INFO:teuthology.orchestra.run.smithi039.stdout:============================================================================== 2023-11-28T11:51:48.824 INFO:teuthology.orchestra.run.smithi039.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-28T11:51:48.824 INFO:teuthology.orchestra.run.smithi039.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-28T11:51:48.824 INFO:teuthology.orchestra.run.smithi039.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-28T11:51:48.824 INFO:teuthology.orchestra.run.smithi039.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-28T11:51:48.849 INFO:teuthology.orchestra.run.smithi184.stdout: remote refid st t when poll reach delay offset jitter 2023-11-28T11:51:48.849 INFO:teuthology.orchestra.run.smithi184.stdout:============================================================================== 2023-11-28T11:51:48.849 INFO:teuthology.orchestra.run.smithi184.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-28T11:51:48.849 INFO:teuthology.orchestra.run.smithi184.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-28T11:51:48.849 INFO:teuthology.orchestra.run.smithi184.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-28T11:51:48.849 INFO:teuthology.orchestra.run.smithi184.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-28T11:51:48.851 INFO:teuthology.run_tasks:Running task install... 2023-11-28T11:51:48.859 DEBUG:teuthology.task.install:project ceph 2023-11-28T11:51:48.860 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f5f6028b893ad41357cd06e827373f0fe2a1232'}} 2023-11-28T11:51:48.860 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f5f6028b893ad41357cd06e827373f0fe2a1232'} 2023-11-28T11:51:48.860 INFO:teuthology.task.install:Using flavor: default 2023-11-28T11:51:48.867 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-28T11:51:48.867 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-28T11:51:48.868 DEBUG:teuthology.orchestra.run.smithi039:> sudo apt-key list | grep Ceph 2023-11-28T11:51:48.869 DEBUG:teuthology.orchestra.run.smithi184:> sudo apt-key list | grep Ceph 2023-11-28T11:51:49.112 INFO:teuthology.orchestra.run.smithi039.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-11-28T11:51:49.126 INFO:teuthology.orchestra.run.smithi184.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-11-28T11:51:49.255 INFO:teuthology.orchestra.run.smithi039.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-28T11:51:49.255 INFO:teuthology.orchestra.run.smithi039.stdout:uid [ unknown] Ceph.com (release key) 2023-11-28T11:51:49.257 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-28T11:51:49.257 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-28T11:51:49.257 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2f5f6028b893ad41357cd06e827373f0fe2a1232 2023-11-28T11:51:49.268 INFO:teuthology.orchestra.run.smithi184.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-28T11:51:49.268 INFO:teuthology.orchestra.run.smithi184.stdout:uid [ unknown] Ceph.com (release key) 2023-11-28T11:51:49.270 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-28T11:51:49.270 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-28T11:51:49.270 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2f5f6028b893ad41357cd06e827373f0fe2a1232 2023-11-28T11:51:49.408 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default/ 2023-11-28T11:51:49.408 INFO:teuthology.task.install.deb:Package version is 18.0.0-2697-g2f5f6028-1focal 2023-11-28T11:51:49.482 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default/ 2023-11-28T11:51:49.483 INFO:teuthology.task.install.deb:Package version is 18.0.0-2697-g2f5f6028-1focal 2023-11-28T11:51:49.525 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:51:49.525 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-28T11:51:49.562 DEBUG:teuthology.orchestra.run.smithi039:> sudo apt-get update 2023-11-28T11:51:49.588 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:51:49.588 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-28T11:51:49.624 DEBUG:teuthology.orchestra.run.smithi184:> sudo apt-get update 2023-11-28T11:51:49.878 INFO:teuthology.orchestra.run.smithi039.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-11-28T11:51:49.879 INFO:teuthology.orchestra.run.smithi039.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-11-28T11:51:49.887 INFO:teuthology.orchestra.run.smithi039.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-11-28T11:51:49.913 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-11-28T11:51:49.952 INFO:teuthology.orchestra.run.smithi184.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal InRelease 2023-11-28T11:51:49.973 INFO:teuthology.orchestra.run.smithi039.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal InRelease 2023-11-28T11:51:49.977 INFO:teuthology.orchestra.run.smithi184.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-11-28T11:51:49.977 INFO:teuthology.orchestra.run.smithi039.stdout:Hit:5 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-11-28T11:51:49.998 INFO:teuthology.orchestra.run.smithi184.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal Release.gpg 2023-11-28T11:51:50.010 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2023-11-28T11:51:50.010 INFO:teuthology.orchestra.run.smithi039.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-11-28T11:51:50.020 INFO:teuthology.orchestra.run.smithi184.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-11-28T11:51:50.050 INFO:teuthology.orchestra.run.smithi039.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal Release.gpg 2023-11-28T11:51:50.062 INFO:teuthology.orchestra.run.smithi184.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main i386 Packages [3,418 B] 2023-11-28T11:51:50.086 INFO:teuthology.orchestra.run.smithi039.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-11-28T11:51:50.091 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-11-28T11:51:50.147 INFO:teuthology.orchestra.run.smithi039.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main i386 Packages [3,418 B] 2023-11-28T11:51:50.173 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-11-28T11:51:51.298 INFO:teuthology.orchestra.run.smithi184.stdout:Fetched 28.4 kB in 1s (21.4 kB/s) 2023-11-28T11:51:51.365 INFO:teuthology.orchestra.run.smithi039.stdout:Fetched 28.4 kB in 1s (19.7 kB/s) 2023-11-28T11:51:52.520 INFO:teuthology.orchestra.run.smithi184.stdout:Reading package lists... 2023-11-28T11:51:52.564 DEBUG:teuthology.orchestra.run.smithi184:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-2697-g2f5f6028-1focal cephadm=18.0.0-2697-g2f5f6028-1focal ceph-mds=18.0.0-2697-g2f5f6028-1focal ceph-mgr=18.0.0-2697-g2f5f6028-1focal ceph-common=18.0.0-2697-g2f5f6028-1focal ceph-fuse=18.0.0-2697-g2f5f6028-1focal ceph-test=18.0.0-2697-g2f5f6028-1focal ceph-volume=18.0.0-2697-g2f5f6028-1focal radosgw=18.0.0-2697-g2f5f6028-1focal python3-rados=18.0.0-2697-g2f5f6028-1focal python3-rgw=18.0.0-2697-g2f5f6028-1focal python3-cephfs=18.0.0-2697-g2f5f6028-1focal python3-rbd=18.0.0-2697-g2f5f6028-1focal libcephfs2=18.0.0-2697-g2f5f6028-1focal libcephfs-dev=18.0.0-2697-g2f5f6028-1focal librados2=18.0.0-2697-g2f5f6028-1focal librbd1=18.0.0-2697-g2f5f6028-1focal rbd-fuse=18.0.0-2697-g2f5f6028-1focal python3-cephfs=18.0.0-2697-g2f5f6028-1focal cephfs-shell=18.0.0-2697-g2f5f6028-1focal cephfs-top=18.0.0-2697-g2f5f6028-1focal cephfs-mirror=18.0.0-2697-g2f5f6028-1focal 2023-11-28T11:51:52.661 INFO:teuthology.orchestra.run.smithi039.stdout:Reading package lists... 2023-11-28T11:51:52.691 INFO:teuthology.orchestra.run.smithi184.stdout:Reading package lists... 2023-11-28T11:51:52.701 DEBUG:teuthology.orchestra.run.smithi039:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-2697-g2f5f6028-1focal cephadm=18.0.0-2697-g2f5f6028-1focal ceph-mds=18.0.0-2697-g2f5f6028-1focal ceph-mgr=18.0.0-2697-g2f5f6028-1focal ceph-common=18.0.0-2697-g2f5f6028-1focal ceph-fuse=18.0.0-2697-g2f5f6028-1focal ceph-test=18.0.0-2697-g2f5f6028-1focal ceph-volume=18.0.0-2697-g2f5f6028-1focal radosgw=18.0.0-2697-g2f5f6028-1focal python3-rados=18.0.0-2697-g2f5f6028-1focal python3-rgw=18.0.0-2697-g2f5f6028-1focal python3-cephfs=18.0.0-2697-g2f5f6028-1focal python3-rbd=18.0.0-2697-g2f5f6028-1focal libcephfs2=18.0.0-2697-g2f5f6028-1focal libcephfs-dev=18.0.0-2697-g2f5f6028-1focal librados2=18.0.0-2697-g2f5f6028-1focal librbd1=18.0.0-2697-g2f5f6028-1focal rbd-fuse=18.0.0-2697-g2f5f6028-1focal python3-cephfs=18.0.0-2697-g2f5f6028-1focal cephfs-shell=18.0.0-2697-g2f5f6028-1focal cephfs-top=18.0.0-2697-g2f5f6028-1focal cephfs-mirror=18.0.0-2697-g2f5f6028-1focal 2023-11-28T11:51:52.827 INFO:teuthology.orchestra.run.smithi039.stdout:Reading package lists... 2023-11-28T11:51:52.900 INFO:teuthology.orchestra.run.smithi184.stdout:Building dependency tree... 2023-11-28T11:51:52.901 INFO:teuthology.orchestra.run.smithi184.stdout:Reading state information... 2023-11-28T11:51:53.041 INFO:teuthology.orchestra.run.smithi039.stdout:Building dependency tree... 2023-11-28T11:51:53.042 INFO:teuthology.orchestra.run.smithi039.stdout:Reading state information... 2023-11-28T11:51:53.092 INFO:teuthology.orchestra.run.smithi184.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T11:51:53.093 INFO:teuthology.orchestra.run.smithi184.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-11-28T11:51:53.093 INFO:teuthology.orchestra.run.smithi184.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T11:51:53.094 INFO:teuthology.orchestra.run.smithi184.stdout:The following additional packages will be installed: 2023-11-28T11:51:53.094 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-28T11:51:53.094 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-11-28T11:51:53.094 INFO:teuthology.orchestra.run.smithi184.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-11-28T11:51:53.094 INFO:teuthology.orchestra.run.smithi184.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-11-28T11:51:53.094 INFO:teuthology.orchestra.run.smithi184.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-11-28T11:51:53.094 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-11-28T11:51:53.095 INFO:teuthology.orchestra.run.smithi184.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-11-28T11:51:53.095 INFO:teuthology.orchestra.run.smithi184.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-11-28T11:51:53.095 INFO:teuthology.orchestra.run.smithi184.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-11-28T11:51:53.095 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-11-28T11:51:53.095 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-11-28T11:51:53.095 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-11-28T11:51:53.095 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-11-28T11:51:53.095 INFO:teuthology.orchestra.run.smithi184.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-11-28T11:51:53.095 INFO:teuthology.orchestra.run.smithi184.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-28T11:51:53.095 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-11-28T11:51:53.095 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-11-28T11:51:53.096 INFO:teuthology.orchestra.run.smithi184.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-11-28T11:51:53.096 INFO:teuthology.orchestra.run.smithi184.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-11-28T11:51:53.096 INFO:teuthology.orchestra.run.smithi184.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-11-28T11:51:53.096 INFO:teuthology.orchestra.run.smithi184.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-11-28T11:51:53.096 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-11-28T11:51:53.096 INFO:teuthology.orchestra.run.smithi184.stdout: qttranslations5-l10n socat xmlstarlet 2023-11-28T11:51:53.096 INFO:teuthology.orchestra.run.smithi184.stdout:Suggested packages: 2023-11-28T11:51:53.096 INFO:teuthology.orchestra.run.smithi184.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-11-28T11:51:53.097 INFO:teuthology.orchestra.run.smithi184.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-11-28T11:51:53.097 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-11-28T11:51:53.097 INFO:teuthology.orchestra.run.smithi184.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-11-28T11:51:53.097 INFO:teuthology.orchestra.run.smithi184.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-11-28T11:51:53.097 INFO:teuthology.orchestra.run.smithi184.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-11-28T11:51:53.097 INFO:teuthology.orchestra.run.smithi184.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-11-28T11:51:53.097 INFO:teuthology.orchestra.run.smithi184.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-11-28T11:51:53.098 INFO:teuthology.orchestra.run.smithi184.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-11-28T11:51:53.098 INFO:teuthology.orchestra.run.smithi184.stdout:Recommended packages: 2023-11-28T11:51:53.098 INFO:teuthology.orchestra.run.smithi184.stdout: btrfs-tools 2023-11-28T11:51:53.240 INFO:teuthology.orchestra.run.smithi039.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T11:51:53.241 INFO:teuthology.orchestra.run.smithi039.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-11-28T11:51:53.241 INFO:teuthology.orchestra.run.smithi039.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T11:51:53.241 INFO:teuthology.orchestra.run.smithi039.stdout:The following additional packages will be installed: 2023-11-28T11:51:53.241 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-28T11:51:53.242 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-11-28T11:51:53.242 INFO:teuthology.orchestra.run.smithi039.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-11-28T11:51:53.242 INFO:teuthology.orchestra.run.smithi039.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-11-28T11:51:53.242 INFO:teuthology.orchestra.run.smithi039.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-11-28T11:51:53.242 INFO:teuthology.orchestra.run.smithi039.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-11-28T11:51:53.242 INFO:teuthology.orchestra.run.smithi039.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-11-28T11:51:53.242 INFO:teuthology.orchestra.run.smithi039.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-11-28T11:51:53.242 INFO:teuthology.orchestra.run.smithi039.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-11-28T11:51:53.242 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-11-28T11:51:53.243 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-11-28T11:51:53.243 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-11-28T11:51:53.243 INFO:teuthology.orchestra.run.smithi039.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-11-28T11:51:53.243 INFO:teuthology.orchestra.run.smithi039.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-11-28T11:51:53.243 INFO:teuthology.orchestra.run.smithi039.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-28T11:51:53.243 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-11-28T11:51:53.243 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-11-28T11:51:53.243 INFO:teuthology.orchestra.run.smithi039.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-11-28T11:51:53.243 INFO:teuthology.orchestra.run.smithi039.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-11-28T11:51:53.243 INFO:teuthology.orchestra.run.smithi039.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-11-28T11:51:53.243 INFO:teuthology.orchestra.run.smithi039.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-11-28T11:51:53.243 INFO:teuthology.orchestra.run.smithi039.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-11-28T11:51:53.243 INFO:teuthology.orchestra.run.smithi039.stdout: qttranslations5-l10n socat xmlstarlet 2023-11-28T11:51:53.244 INFO:teuthology.orchestra.run.smithi039.stdout:Suggested packages: 2023-11-28T11:51:53.244 INFO:teuthology.orchestra.run.smithi039.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-11-28T11:51:53.244 INFO:teuthology.orchestra.run.smithi039.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-11-28T11:51:53.244 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-11-28T11:51:53.244 INFO:teuthology.orchestra.run.smithi039.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-11-28T11:51:53.244 INFO:teuthology.orchestra.run.smithi039.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-11-28T11:51:53.244 INFO:teuthology.orchestra.run.smithi039.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-11-28T11:51:53.244 INFO:teuthology.orchestra.run.smithi039.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-11-28T11:51:53.244 INFO:teuthology.orchestra.run.smithi039.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-11-28T11:51:53.244 INFO:teuthology.orchestra.run.smithi039.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-11-28T11:51:53.245 INFO:teuthology.orchestra.run.smithi039.stdout:Recommended packages: 2023-11-28T11:51:53.245 INFO:teuthology.orchestra.run.smithi039.stdout: btrfs-tools 2023-11-28T11:51:53.309 INFO:teuthology.orchestra.run.smithi184.stdout:The following NEW packages will be installed: 2023-11-28T11:51:53.310 INFO:teuthology.orchestra.run.smithi184.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-28T11:51:53.310 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-28T11:51:53.310 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-28T11:51:53.310 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-11-28T11:51:53.311 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-11-28T11:51:53.311 INFO:teuthology.orchestra.run.smithi184.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-11-28T11:51:53.311 INFO:teuthology.orchestra.run.smithi184.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-11-28T11:51:53.311 INFO:teuthology.orchestra.run.smithi184.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-11-28T11:51:53.311 INFO:teuthology.orchestra.run.smithi184.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-11-28T11:51:53.311 INFO:teuthology.orchestra.run.smithi184.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-11-28T11:51:53.311 INFO:teuthology.orchestra.run.smithi184.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-11-28T11:51:53.311 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-11-28T11:51:53.311 INFO:teuthology.orchestra.run.smithi184.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-11-28T11:51:53.311 INFO:teuthology.orchestra.run.smithi184.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-11-28T11:51:53.311 INFO:teuthology.orchestra.run.smithi184.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-11-28T11:51:53.311 INFO:teuthology.orchestra.run.smithi184.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-11-28T11:51:53.311 INFO:teuthology.orchestra.run.smithi184.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-11-28T11:51:53.311 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-11-28T11:51:53.312 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-11-28T11:51:53.312 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-11-28T11:51:53.312 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-28T11:51:53.312 INFO:teuthology.orchestra.run.smithi184.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-11-28T11:51:53.312 INFO:teuthology.orchestra.run.smithi184.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-11-28T11:51:53.312 INFO:teuthology.orchestra.run.smithi184.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-11-28T11:51:53.312 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-11-28T11:51:53.312 INFO:teuthology.orchestra.run.smithi184.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-11-28T11:51:53.312 INFO:teuthology.orchestra.run.smithi184.stdout:The following packages will be upgraded: 2023-11-28T11:51:53.312 INFO:teuthology.orchestra.run.smithi184.stdout: librados2 librbd1 2023-11-28T11:51:53.463 INFO:teuthology.orchestra.run.smithi039.stdout:The following NEW packages will be installed: 2023-11-28T11:51:53.463 INFO:teuthology.orchestra.run.smithi039.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-28T11:51:53.463 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-28T11:51:53.463 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-28T11:51:53.463 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-11-28T11:51:53.463 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-11-28T11:51:53.463 INFO:teuthology.orchestra.run.smithi039.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-11-28T11:51:53.464 INFO:teuthology.orchestra.run.smithi039.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-11-28T11:51:53.464 INFO:teuthology.orchestra.run.smithi039.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-11-28T11:51:53.464 INFO:teuthology.orchestra.run.smithi039.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-11-28T11:51:53.465 INFO:teuthology.orchestra.run.smithi039.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-11-28T11:51:53.465 INFO:teuthology.orchestra.run.smithi039.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-11-28T11:51:53.465 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-11-28T11:51:53.465 INFO:teuthology.orchestra.run.smithi039.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-11-28T11:51:53.465 INFO:teuthology.orchestra.run.smithi039.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-11-28T11:51:53.465 INFO:teuthology.orchestra.run.smithi039.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-11-28T11:51:53.465 INFO:teuthology.orchestra.run.smithi039.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-11-28T11:51:53.465 INFO:teuthology.orchestra.run.smithi039.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-11-28T11:51:53.465 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-11-28T11:51:53.465 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-11-28T11:51:53.465 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-11-28T11:51:53.465 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-28T11:51:53.465 INFO:teuthology.orchestra.run.smithi039.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-11-28T11:51:53.465 INFO:teuthology.orchestra.run.smithi039.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-11-28T11:51:53.465 INFO:teuthology.orchestra.run.smithi039.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-11-28T11:51:53.466 INFO:teuthology.orchestra.run.smithi039.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-11-28T11:51:53.466 INFO:teuthology.orchestra.run.smithi039.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-11-28T11:51:53.466 INFO:teuthology.orchestra.run.smithi039.stdout:The following packages will be upgraded: 2023-11-28T11:51:53.466 INFO:teuthology.orchestra.run.smithi039.stdout: librados2 librbd1 2023-11-28T11:51:53.517 INFO:teuthology.orchestra.run.smithi184.stdout:2 upgraded, 116 newly installed, 0 to remove and 260 not upgraded. 2023-11-28T11:51:53.517 INFO:teuthology.orchestra.run.smithi184.stdout:Need to get 207 MB of archives. 2023-11-28T11:51:53.517 INFO:teuthology.orchestra.run.smithi184.stdout:After this operation, 1,026 MB of additional disk space will be used. 2023-11-28T11:51:53.517 INFO:teuthology.orchestra.run.smithi184.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-11-28T11:51:53.551 INFO:teuthology.orchestra.run.smithi039.stdout:2 upgraded, 116 newly installed, 0 to remove and 260 not upgraded. 2023-11-28T11:51:53.551 INFO:teuthology.orchestra.run.smithi039.stdout:Need to get 207 MB of archives. 2023-11-28T11:51:53.551 INFO:teuthology.orchestra.run.smithi039.stdout:After this operation, 1,026 MB of additional disk space will be used. 2023-11-28T11:51:53.551 INFO:teuthology.orchestra.run.smithi039.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-11-28T11:51:53.559 INFO:teuthology.orchestra.run.smithi184.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-2697-g2f5f6028-1focal [3,431 kB] 2023-11-28T11:51:53.571 INFO:teuthology.orchestra.run.smithi039.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-11-28T11:51:53.578 INFO:teuthology.orchestra.run.smithi039.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-11-28T11:51:53.602 INFO:teuthology.orchestra.run.smithi184.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-11-28T11:51:53.606 INFO:teuthology.orchestra.run.smithi039.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-11-28T11:51:53.636 INFO:teuthology.orchestra.run.smithi039.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-11-28T11:51:53.637 INFO:teuthology.orchestra.run.smithi184.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-11-28T11:51:53.637 INFO:teuthology.orchestra.run.smithi039.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-11-28T11:51:53.650 INFO:teuthology.orchestra.run.smithi039.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-11-28T11:51:53.693 INFO:teuthology.orchestra.run.smithi039.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-11-28T11:51:53.696 INFO:teuthology.orchestra.run.smithi039.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-11-28T11:51:53.706 INFO:teuthology.orchestra.run.smithi039.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-11-28T11:51:53.709 INFO:teuthology.orchestra.run.smithi039.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-11-28T11:51:53.709 INFO:teuthology.orchestra.run.smithi039.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-11-28T11:51:53.710 INFO:teuthology.orchestra.run.smithi039.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-11-28T11:51:53.710 INFO:teuthology.orchestra.run.smithi039.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-11-28T11:51:53.712 INFO:teuthology.orchestra.run.smithi039.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-11-28T11:51:53.713 INFO:teuthology.orchestra.run.smithi039.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-11-28T11:51:53.714 INFO:teuthology.orchestra.run.smithi039.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-11-28T11:51:53.723 INFO:teuthology.orchestra.run.smithi039.stdout:Get:18 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-2697-g2f5f6028-1focal [3,431 kB] 2023-11-28T11:51:53.727 INFO:teuthology.orchestra.run.smithi039.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-11-28T11:51:53.728 INFO:teuthology.orchestra.run.smithi039.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-11-28T11:51:53.730 INFO:teuthology.orchestra.run.smithi039.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-11-28T11:51:53.731 INFO:teuthology.orchestra.run.smithi039.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-28T11:51:53.732 INFO:teuthology.orchestra.run.smithi039.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-11-28T11:51:53.733 INFO:teuthology.orchestra.run.smithi039.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-11-28T11:51:53.745 INFO:teuthology.orchestra.run.smithi039.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-11-28T11:51:53.745 INFO:teuthology.orchestra.run.smithi039.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-11-28T11:51:53.747 INFO:teuthology.orchestra.run.smithi039.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-11-28T11:51:53.750 INFO:teuthology.orchestra.run.smithi039.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-11-28T11:51:53.761 INFO:teuthology.orchestra.run.smithi039.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-11-28T11:51:53.770 INFO:teuthology.orchestra.run.smithi039.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-11-28T11:51:53.770 INFO:teuthology.orchestra.run.smithi039.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-11-28T11:51:53.772 INFO:teuthology.orchestra.run.smithi039.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-11-28T11:51:53.773 INFO:teuthology.orchestra.run.smithi039.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-11-28T11:51:53.773 INFO:teuthology.orchestra.run.smithi039.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-11-28T11:51:53.775 INFO:teuthology.orchestra.run.smithi184.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-11-28T11:51:53.777 INFO:teuthology.orchestra.run.smithi039.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-11-28T11:51:53.780 INFO:teuthology.orchestra.run.smithi039.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-11-28T11:51:53.780 INFO:teuthology.orchestra.run.smithi039.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-11-28T11:51:53.783 INFO:teuthology.orchestra.run.smithi039.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-11-28T11:51:53.794 INFO:teuthology.orchestra.run.smithi039.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-11-28T11:51:53.795 INFO:teuthology.orchestra.run.smithi039.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-11-28T11:51:53.796 INFO:teuthology.orchestra.run.smithi039.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-11-28T11:51:53.797 INFO:teuthology.orchestra.run.smithi039.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-11-28T11:51:53.798 INFO:teuthology.orchestra.run.smithi039.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-11-28T11:51:53.801 INFO:teuthology.orchestra.run.smithi039.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-11-28T11:51:53.811 INFO:teuthology.orchestra.run.smithi039.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-11-28T11:51:53.812 INFO:teuthology.orchestra.run.smithi039.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-11-28T11:51:53.816 INFO:teuthology.orchestra.run.smithi039.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-28T11:51:53.816 INFO:teuthology.orchestra.run.smithi039.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-11-28T11:51:53.828 INFO:teuthology.orchestra.run.smithi039.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-11-28T11:51:53.831 INFO:teuthology.orchestra.run.smithi039.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-11-28T11:51:53.835 INFO:teuthology.orchestra.run.smithi039.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-11-28T11:51:53.836 INFO:teuthology.orchestra.run.smithi039.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-11-28T11:51:53.838 INFO:teuthology.orchestra.run.smithi039.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-11-28T11:51:53.911 INFO:teuthology.orchestra.run.smithi184.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-11-28T11:51:53.929 INFO:teuthology.orchestra.run.smithi184.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-11-28T11:51:53.935 INFO:teuthology.orchestra.run.smithi039.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-11-28T11:51:53.956 INFO:teuthology.orchestra.run.smithi039.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-11-28T11:51:53.958 INFO:teuthology.orchestra.run.smithi039.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-11-28T11:51:53.972 INFO:teuthology.orchestra.run.smithi039.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-11-28T11:51:53.973 INFO:teuthology.orchestra.run.smithi039.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-11-28T11:51:53.973 INFO:teuthology.orchestra.run.smithi039.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-11-28T11:51:53.974 INFO:teuthology.orchestra.run.smithi039.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-11-28T11:51:53.974 INFO:teuthology.orchestra.run.smithi039.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-11-28T11:51:53.975 INFO:teuthology.orchestra.run.smithi039.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-11-28T11:51:53.976 INFO:teuthology.orchestra.run.smithi039.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-11-28T11:51:53.977 INFO:teuthology.orchestra.run.smithi039.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-11-28T11:51:53.990 INFO:teuthology.orchestra.run.smithi039.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-11-28T11:51:53.994 INFO:teuthology.orchestra.run.smithi039.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-11-28T11:51:53.995 INFO:teuthology.orchestra.run.smithi184.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-11-28T11:51:53.997 INFO:teuthology.orchestra.run.smithi039.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-11-28T11:51:54.005 INFO:teuthology.orchestra.run.smithi184.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-2697-g2f5f6028-1focal [3,982 kB] 2023-11-28T11:51:54.007 INFO:teuthology.orchestra.run.smithi039.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-11-28T11:51:54.009 INFO:teuthology.orchestra.run.smithi039.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-11-28T11:51:54.010 INFO:teuthology.orchestra.run.smithi039.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-11-28T11:51:54.017 INFO:teuthology.orchestra.run.smithi039.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-11-28T11:51:54.020 INFO:teuthology.orchestra.run.smithi039.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-11-28T11:51:54.020 INFO:teuthology.orchestra.run.smithi039.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-11-28T11:51:54.039 INFO:teuthology.orchestra.run.smithi039.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-11-28T11:51:54.043 INFO:teuthology.orchestra.run.smithi039.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-11-28T11:51:54.046 INFO:teuthology.orchestra.run.smithi039.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-11-28T11:51:54.093 INFO:teuthology.orchestra.run.smithi039.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-11-28T11:51:54.094 INFO:teuthology.orchestra.run.smithi039.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-11-28T11:51:54.095 INFO:teuthology.orchestra.run.smithi039.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-11-28T11:51:54.095 INFO:teuthology.orchestra.run.smithi039.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-11-28T11:51:54.110 INFO:teuthology.orchestra.run.smithi039.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-28T11:51:54.110 INFO:teuthology.orchestra.run.smithi039.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-11-28T11:51:54.112 INFO:teuthology.orchestra.run.smithi039.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-11-28T11:51:54.112 INFO:teuthology.orchestra.run.smithi039.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-11-28T11:51:54.113 INFO:teuthology.orchestra.run.smithi039.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-11-28T11:51:54.179 INFO:teuthology.orchestra.run.smithi039.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-2697-g2f5f6028-1focal [3,982 kB] 2023-11-28T11:51:54.193 INFO:teuthology.orchestra.run.smithi184.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-11-28T11:51:54.202 INFO:teuthology.orchestra.run.smithi184.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-11-28T11:51:54.212 INFO:teuthology.orchestra.run.smithi184.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-2697-g2f5f6028-1focal [721 kB] 2023-11-28T11:51:54.228 INFO:teuthology.orchestra.run.smithi184.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-11-28T11:51:54.236 INFO:teuthology.orchestra.run.smithi184.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-11-28T11:51:54.257 INFO:teuthology.orchestra.run.smithi184.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-2697-g2f5f6028-1focal [376 kB] 2023-11-28T11:51:54.287 INFO:teuthology.orchestra.run.smithi184.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-2697-g2f5f6028-1focal [22.4 kB] 2023-11-28T11:51:54.288 INFO:teuthology.orchestra.run.smithi184.stdout:Get:17 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-2697-g2f5f6028-1focal [184 kB] 2023-11-28T11:51:54.293 INFO:teuthology.orchestra.run.smithi184.stdout:Get:18 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-2697-g2f5f6028-1focal [47.7 kB] 2023-11-28T11:51:54.295 INFO:teuthology.orchestra.run.smithi184.stdout:Get:19 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-2697-g2f5f6028-1focal [353 kB] 2023-11-28T11:51:54.307 INFO:teuthology.orchestra.run.smithi184.stdout:Get:20 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-2697-g2f5f6028-1focal [6,529 kB] 2023-11-28T11:51:54.401 INFO:teuthology.orchestra.run.smithi184.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-11-28T11:51:54.475 INFO:teuthology.orchestra.run.smithi039.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-2697-g2f5f6028-1focal [721 kB] 2023-11-28T11:51:54.496 INFO:teuthology.orchestra.run.smithi039.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-2697-g2f5f6028-1focal [376 kB] 2023-11-28T11:51:54.543 INFO:teuthology.orchestra.run.smithi039.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-2697-g2f5f6028-1focal [22.4 kB] 2023-11-28T11:51:54.543 INFO:teuthology.orchestra.run.smithi039.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-2697-g2f5f6028-1focal [184 kB] 2023-11-28T11:51:54.549 INFO:teuthology.orchestra.run.smithi039.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-2697-g2f5f6028-1focal [47.7 kB] 2023-11-28T11:51:54.550 INFO:teuthology.orchestra.run.smithi039.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-2697-g2f5f6028-1focal [353 kB] 2023-11-28T11:51:54.598 INFO:teuthology.orchestra.run.smithi039.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-2697-g2f5f6028-1focal [6,529 kB] 2023-11-28T11:51:54.702 INFO:teuthology.orchestra.run.smithi184.stdout:Get:22 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-2697-g2f5f6028-1focal [103 kB] 2023-11-28T11:51:54.704 INFO:teuthology.orchestra.run.smithi184.stdout:Get:23 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-2697-g2f5f6028-1focal [468 kB] 2023-11-28T11:51:54.718 INFO:teuthology.orchestra.run.smithi184.stdout:Get:24 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-2697-g2f5f6028-1focal [25.0 MB] 2023-11-28T11:51:54.775 INFO:teuthology.orchestra.run.smithi184.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-11-28T11:51:54.794 INFO:teuthology.orchestra.run.smithi184.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-11-28T11:51:54.972 INFO:teuthology.orchestra.run.smithi184.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-11-28T11:51:54.981 INFO:teuthology.orchestra.run.smithi184.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-11-28T11:51:55.017 INFO:teuthology.orchestra.run.smithi184.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-11-28T11:51:55.022 INFO:teuthology.orchestra.run.smithi184.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-11-28T11:51:55.025 INFO:teuthology.orchestra.run.smithi184.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-11-28T11:51:55.027 INFO:teuthology.orchestra.run.smithi184.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-11-28T11:51:55.036 INFO:teuthology.orchestra.run.smithi184.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-28T11:51:55.037 INFO:teuthology.orchestra.run.smithi184.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-11-28T11:51:55.068 INFO:teuthology.orchestra.run.smithi039.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-2697-g2f5f6028-1focal [103 kB] 2023-11-28T11:51:55.070 INFO:teuthology.orchestra.run.smithi039.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-2697-g2f5f6028-1focal [468 kB] 2023-11-28T11:51:55.134 INFO:teuthology.orchestra.run.smithi039.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-2697-g2f5f6028-1focal [25.0 MB] 2023-11-28T11:51:55.203 INFO:teuthology.orchestra.run.smithi184.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-11-28T11:51:55.547 INFO:teuthology.orchestra.run.smithi184.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-11-28T11:51:55.570 INFO:teuthology.orchestra.run.smithi184.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-11-28T11:51:55.640 INFO:teuthology.orchestra.run.smithi184.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-11-28T11:51:55.701 INFO:teuthology.orchestra.run.smithi184.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-11-28T11:51:55.709 INFO:teuthology.orchestra.run.smithi184.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-11-28T11:51:55.830 INFO:teuthology.orchestra.run.smithi184.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-11-28T11:51:55.830 INFO:teuthology.orchestra.run.smithi184.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-11-28T11:51:55.834 INFO:teuthology.orchestra.run.smithi184.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-11-28T11:51:55.838 INFO:teuthology.orchestra.run.smithi184.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-11-28T11:51:55.850 INFO:teuthology.orchestra.run.smithi184.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-11-28T11:51:56.035 INFO:teuthology.orchestra.run.smithi184.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-11-28T11:51:56.202 INFO:teuthology.orchestra.run.smithi184.stdout:Get:47 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-2697-g2f5f6028-1focal [10.9 MB] 2023-11-28T11:51:56.487 INFO:teuthology.orchestra.run.smithi184.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-11-28T11:51:56.501 INFO:teuthology.orchestra.run.smithi184.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-11-28T11:51:56.549 INFO:teuthology.orchestra.run.smithi184.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-11-28T11:51:56.590 INFO:teuthology.orchestra.run.smithi184.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-11-28T11:51:56.600 INFO:teuthology.orchestra.run.smithi184.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-11-28T11:51:56.603 INFO:teuthology.orchestra.run.smithi184.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-11-28T11:51:56.618 INFO:teuthology.orchestra.run.smithi184.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-11-28T11:51:56.619 INFO:teuthology.orchestra.run.smithi184.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-11-28T11:51:56.638 INFO:teuthology.orchestra.run.smithi184.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-11-28T11:51:56.638 INFO:teuthology.orchestra.run.smithi184.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-11-28T11:51:56.808 INFO:teuthology.orchestra.run.smithi184.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-11-28T11:51:56.833 INFO:teuthology.orchestra.run.smithi184.stdout:Get:59 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-2697-g2f5f6028-1focal [221 kB] 2023-11-28T11:51:56.836 INFO:teuthology.orchestra.run.smithi184.stdout:Get:60 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-2697-g2f5f6028-1focal [133 kB] 2023-11-28T11:51:56.840 INFO:teuthology.orchestra.run.smithi184.stdout:Get:61 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-2697-g2f5f6028-1focal [1,547 kB] 2023-11-28T11:51:56.926 INFO:teuthology.orchestra.run.smithi184.stdout:Get:62 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-2697-g2f5f6028-1focal [9,378 kB] 2023-11-28T11:51:56.974 INFO:teuthology.orchestra.run.smithi039.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-2697-g2f5f6028-1focal [10.9 MB] 2023-11-28T11:51:57.238 INFO:teuthology.orchestra.run.smithi184.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-28T11:51:57.242 INFO:teuthology.orchestra.run.smithi184.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-11-28T11:51:57.275 INFO:teuthology.orchestra.run.smithi184.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-11-28T11:51:57.326 INFO:teuthology.orchestra.run.smithi184.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-11-28T11:51:57.355 INFO:teuthology.orchestra.run.smithi184.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-11-28T11:51:57.358 INFO:teuthology.orchestra.run.smithi184.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-11-28T11:51:57.368 INFO:teuthology.orchestra.run.smithi184.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-11-28T11:51:57.503 INFO:teuthology.orchestra.run.smithi184.stdout:Get:70 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-2697-g2f5f6028-1focal [31.3 MB] 2023-11-28T11:51:57.812 INFO:teuthology.orchestra.run.smithi039.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-2697-g2f5f6028-1focal [221 kB] 2023-11-28T11:51:57.817 INFO:teuthology.orchestra.run.smithi039.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-2697-g2f5f6028-1focal [133 kB] 2023-11-28T11:51:57.818 INFO:teuthology.orchestra.run.smithi039.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-2697-g2f5f6028-1focal [1,547 kB] 2023-11-28T11:51:57.859 INFO:teuthology.orchestra.run.smithi184.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-11-28T11:51:57.903 INFO:teuthology.orchestra.run.smithi184.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-11-28T11:51:57.905 INFO:teuthology.orchestra.run.smithi184.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-11-28T11:51:57.965 INFO:teuthology.orchestra.run.smithi039.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-2697-g2f5f6028-1focal [9,378 kB] 2023-11-28T11:51:58.141 INFO:teuthology.orchestra.run.smithi184.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-11-28T11:51:58.226 INFO:teuthology.orchestra.run.smithi184.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-11-28T11:51:58.352 INFO:teuthology.orchestra.run.smithi184.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-11-28T11:51:58.413 INFO:teuthology.orchestra.run.smithi184.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-11-28T11:51:58.440 INFO:teuthology.orchestra.run.smithi184.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-11-28T11:51:58.478 INFO:teuthology.orchestra.run.smithi184.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-11-28T11:51:58.490 INFO:teuthology.orchestra.run.smithi184.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-11-28T11:51:58.541 INFO:teuthology.orchestra.run.smithi184.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-11-28T11:51:58.550 INFO:teuthology.orchestra.run.smithi184.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-11-28T11:51:58.563 INFO:teuthology.orchestra.run.smithi184.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-11-28T11:51:58.629 INFO:teuthology.orchestra.run.smithi039.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-2697-g2f5f6028-1focal [31.3 MB] 2023-11-28T11:51:58.642 INFO:teuthology.orchestra.run.smithi184.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-11-28T11:51:58.833 INFO:teuthology.orchestra.run.smithi184.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-11-28T11:51:59.209 INFO:teuthology.orchestra.run.smithi184.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-11-28T11:51:59.236 INFO:teuthology.orchestra.run.smithi184.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-11-28T11:51:59.328 INFO:teuthology.orchestra.run.smithi184.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-2697-g2f5f6028-1focal [3,812 B] 2023-11-28T11:51:59.329 INFO:teuthology.orchestra.run.smithi184.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-2697-g2f5f6028-1focal [831 kB] 2023-11-28T11:51:59.383 INFO:teuthology.orchestra.run.smithi184.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-2697-g2f5f6028-1focal [2,284 kB] 2023-11-28T11:51:59.388 INFO:teuthology.orchestra.run.smithi184.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-11-28T11:51:59.443 INFO:teuthology.orchestra.run.smithi184.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-11-28T11:51:59.448 INFO:teuthology.orchestra.run.smithi184.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-11-28T11:51:59.491 INFO:teuthology.orchestra.run.smithi184.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-2697-g2f5f6028-1focal [96.8 kB] 2023-11-28T11:51:59.493 INFO:teuthology.orchestra.run.smithi184.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-2697-g2f5f6028-1focal [117 kB] 2023-11-28T11:51:59.502 INFO:teuthology.orchestra.run.smithi184.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-2697-g2f5f6028-1focal [1,795 kB] 2023-11-28T11:51:59.586 INFO:teuthology.orchestra.run.smithi184.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-2697-g2f5f6028-1focal [7,878 kB] 2023-11-28T11:51:59.614 INFO:teuthology.orchestra.run.smithi184.stdout:Get:98 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-11-28T11:51:59.624 INFO:teuthology.orchestra.run.smithi184.stdout:Get:99 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-11-28T11:51:59.637 INFO:teuthology.orchestra.run.smithi184.stdout:Get:100 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-11-28T11:51:59.790 INFO:teuthology.orchestra.run.smithi184.stdout:Get:101 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-11-28T11:51:59.791 INFO:teuthology.orchestra.run.smithi184.stdout:Get:102 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-11-28T11:51:59.956 INFO:teuthology.orchestra.run.smithi184.stdout:Get:103 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-11-28T11:51:59.992 INFO:teuthology.orchestra.run.smithi184.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-2697-g2f5f6028-1focal [3,936 B] 2023-11-28T11:51:59.993 INFO:teuthology.orchestra.run.smithi184.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-2697-g2f5f6028-1focal [49.9 MB] 2023-11-28T11:52:00.296 INFO:teuthology.orchestra.run.smithi184.stdout:Get:106 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-11-28T11:52:00.657 INFO:teuthology.orchestra.run.smithi184.stdout:Get:107 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-28T11:52:00.661 INFO:teuthology.orchestra.run.smithi184.stdout:Get:108 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-11-28T11:52:00.672 INFO:teuthology.orchestra.run.smithi184.stdout:Get:109 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-11-28T11:52:00.673 INFO:teuthology.orchestra.run.smithi184.stdout:Get:110 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-11-28T11:52:00.677 INFO:teuthology.orchestra.run.smithi184.stdout:Get:111 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-11-28T11:52:01.333 INFO:teuthology.orchestra.run.smithi039.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-2697-g2f5f6028-1focal [3,812 B] 2023-11-28T11:52:01.333 INFO:teuthology.orchestra.run.smithi039.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-2697-g2f5f6028-1focal [831 kB] 2023-11-28T11:52:01.388 INFO:teuthology.orchestra.run.smithi039.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-2697-g2f5f6028-1focal [2,284 kB] 2023-11-28T11:52:01.590 INFO:teuthology.orchestra.run.smithi039.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-2697-g2f5f6028-1focal [96.8 kB] 2023-11-28T11:52:01.592 INFO:teuthology.orchestra.run.smithi039.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-2697-g2f5f6028-1focal [117 kB] 2023-11-28T11:52:01.595 INFO:teuthology.orchestra.run.smithi039.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-2697-g2f5f6028-1focal [1,795 kB] 2023-11-28T11:52:01.768 INFO:teuthology.orchestra.run.smithi039.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-2697-g2f5f6028-1focal [7,878 kB] 2023-11-28T11:52:02.427 INFO:teuthology.orchestra.run.smithi039.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-2697-g2f5f6028-1focal [3,936 B] 2023-11-28T11:52:02.458 INFO:teuthology.orchestra.run.smithi039.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-2697-g2f5f6028-1focal [49.9 MB] 2023-11-28T11:52:02.630 INFO:teuthology.orchestra.run.smithi184.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-2697-g2f5f6028-1focal [225 kB] 2023-11-28T11:52:02.632 INFO:teuthology.orchestra.run.smithi184.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.0.0-2697-g2f5f6028-1focal [253 kB] 2023-11-28T11:52:02.634 INFO:teuthology.orchestra.run.smithi184.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.0.0-2697-g2f5f6028-1focal [23.3 kB] 2023-11-28T11:52:02.635 INFO:teuthology.orchestra.run.smithi184.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.0.0-2697-g2f5f6028-1focal [13.0 kB] 2023-11-28T11:52:02.635 INFO:teuthology.orchestra.run.smithi184.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-2697-g2f5f6028-1focal [27.4 kB] 2023-11-28T11:52:02.636 INFO:teuthology.orchestra.run.smithi184.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-2697-g2f5f6028-1focal [13.3 MB] 2023-11-28T11:52:03.347 INFO:teuthology.orchestra.run.smithi184.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-2697-g2f5f6028-1focal [97.4 kB] 2023-11-28T11:52:04.262 INFO:teuthology.orchestra.run.smithi184.stdout:Fetched 207 MB in 10s (20.6 MB/s) 2023-11-28T11:52:04.456 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-28T11:52:04.528 INFO:teuthology.orchestra.run.smithi184.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107756 files and directories currently installed.) 2023-11-28T11:52:04.531 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-11-28T11:52:04.577 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-11-28T11:52:04.683 INFO:teuthology.orchestra.run.smithi039.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-2697-g2f5f6028-1focal [225 kB] 2023-11-28T11:52:04.685 INFO:teuthology.orchestra.run.smithi039.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.0.0-2697-g2f5f6028-1focal [253 kB] 2023-11-28T11:52:04.687 INFO:teuthology.orchestra.run.smithi039.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.0.0-2697-g2f5f6028-1focal [23.3 kB] 2023-11-28T11:52:04.688 INFO:teuthology.orchestra.run.smithi039.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.0.0-2697-g2f5f6028-1focal [13.0 kB] 2023-11-28T11:52:04.688 INFO:teuthology.orchestra.run.smithi039.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-2697-g2f5f6028-1focal [27.4 kB] 2023-11-28T11:52:04.689 INFO:teuthology.orchestra.run.smithi039.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-2697-g2f5f6028-1focal [13.3 MB] 2023-11-28T11:52:04.947 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-28T11:52:04.965 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-11-28T11:52:05.005 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-11-28T11:52:05.136 INFO:teuthology.orchestra.run.smithi039.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-2697-g2f5f6028-1focal [97.4 kB] 2023-11-28T11:52:05.375 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-cmd2. 2023-11-28T11:52:05.393 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-11-28T11:52:05.433 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-11-28T11:52:05.812 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-11-28T11:52:05.832 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-11-28T11:52:05.911 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-11-28T11:52:06.096 INFO:teuthology.orchestra.run.smithi039.stdout:Fetched 207 MB in 12s (17.8 MB/s) 2023-11-28T11:52:06.244 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-28T11:52:06.317 INFO:teuthology.orchestra.run.smithi039.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107756 files and directories currently installed.) 2023-11-28T11:52:06.320 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-11-28T11:52:06.323 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-28T11:52:06.342 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-11-28T11:52:06.365 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-11-28T11:52:06.382 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-11-28T11:52:06.735 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-28T11:52:06.757 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-11-28T11:52:06.770 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-28T11:52:06.788 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-11-28T11:52:06.809 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-11-28T11:52:06.828 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-11-28T11:52:07.315 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-28T11:52:07.333 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-28T11:52:07.363 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-cmd2. 2023-11-28T11:52:07.384 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-11-28T11:52:07.421 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-11-28T11:52:07.462 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-28T11:52:07.766 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-11-28T11:52:07.787 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-11-28T11:52:07.879 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-11-28T11:52:08.027 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-28T11:52:08.045 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-28T11:52:08.084 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-28T11:52:08.296 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-28T11:52:08.317 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-11-28T11:52:08.353 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-11-28T11:52:08.471 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-28T11:52:08.489 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-28T11:52:08.529 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-28T11:52:08.716 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-28T11:52:08.733 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-11-28T11:52:08.773 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-11-28T11:52:08.949 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-11-28T11:52:08.972 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-11-28T11:52:09.015 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-11-28T11:52:09.335 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-28T11:52:09.354 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-28T11:52:09.414 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-28T11:52:09.432 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../010-librbd1_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:52:09.561 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking librbd1 (18.0.0-2697-g2f5f6028-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-11-28T11:52:09.905 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-28T11:52:09.923 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-28T11:52:09.955 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-28T11:52:10.298 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../011-librados2_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:52:10.358 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-28T11:52:10.377 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-28T11:52:10.441 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking librados2 (18.0.0-2697-g2f5f6028-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-11-28T11:52:10.450 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-28T11:52:10.887 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-11-28T11:52:10.907 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-11-28T11:52:10.944 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-11-28T11:52:11.235 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libcephfs2. 2023-11-28T11:52:11.256 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:52:11.293 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libcephfs2 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:11.353 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../010-librbd1_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:52:11.506 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking librbd1 (18.0.0-2697-g2f5f6028-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-11-28T11:52:11.688 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-rados. 2023-11-28T11:52:11.710 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../013-python3-rados_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:52:11.754 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-rados (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:12.141 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-28T11:52:12.160 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T11:52:12.190 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-ceph-argparse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:12.304 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../011-librados2_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:52:12.428 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking librados2 (18.0.0-2697-g2f5f6028-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-11-28T11:52:12.493 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-cephfs. 2023-11-28T11:52:12.513 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:52:12.551 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-cephfs (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:12.929 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-28T11:52:12.949 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T11:52:12.987 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-ceph-common (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:13.200 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libcephfs2. 2023-11-28T11:52:13.221 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:52:13.265 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libcephfs2 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:13.373 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-prettytable. 2023-11-28T11:52:13.394 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-11-28T11:52:13.434 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-11-28T11:52:13.635 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-rados. 2023-11-28T11:52:13.657 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../013-python3-rados_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:52:13.692 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-rados (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:13.709 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-rbd. 2023-11-28T11:52:13.726 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:52:13.791 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-rbd (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:14.112 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-28T11:52:14.132 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T11:52:14.145 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-11-28T11:52:14.165 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-11-28T11:52:14.170 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-ceph-argparse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:14.244 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-11-28T11:52:14.482 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-cephfs. 2023-11-28T11:52:14.502 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:52:14.540 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-cephfs (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:14.622 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-11-28T11:52:14.643 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-11-28T11:52:14.705 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-11-28T11:52:14.909 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-28T11:52:14.927 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T11:52:15.012 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-ceph-common (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:15.120 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-28T11:52:15.138 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-11-28T11:52:15.183 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-11-28T11:52:15.379 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-prettytable. 2023-11-28T11:52:15.402 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-11-28T11:52:15.437 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-11-28T11:52:15.603 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package librgw2. 2023-11-28T11:52:15.623 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../022-librgw2_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:52:15.661 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking librgw2 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:15.749 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-rbd. 2023-11-28T11:52:15.769 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:52:15.806 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-rbd (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:16.176 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-11-28T11:52:16.196 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-11-28T11:52:16.234 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-11-28T11:52:16.630 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-rgw. 2023-11-28T11:52:16.645 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-11-28T11:52:16.652 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../023-python3-rgw_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:52:16.658 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-11-28T11:52:16.695 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-11-28T11:52:16.696 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-rgw (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:17.117 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package liboath0. 2023-11-28T11:52:17.125 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-28T11:52:17.133 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-11-28T11:52:17.141 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-11-28T11:52:17.180 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-11-28T11:52:17.182 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-11-28T11:52:17.536 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libradosstriper1. 2023-11-28T11:52:17.558 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../025-libradosstriper1_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:52:17.602 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package librgw2. 2023-11-28T11:52:17.603 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libradosstriper1 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:17.626 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../022-librgw2_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:52:17.668 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking librgw2 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:18.188 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-common. 2023-11-28T11:52:18.205 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../026-ceph-common_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:52:18.263 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-common (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:18.562 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-rgw. 2023-11-28T11:52:18.583 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../023-python3-rgw_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:52:18.620 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-rgw (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:18.966 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package liboath0. 2023-11-28T11:52:18.988 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-11-28T11:52:19.023 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-11-28T11:52:19.377 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libradosstriper1. 2023-11-28T11:52:19.396 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../025-libradosstriper1_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:52:19.434 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libradosstriper1 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:19.988 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-common. 2023-11-28T11:52:20.009 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../026-ceph-common_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:52:20.046 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-common (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:20.777 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-base. 2023-11-28T11:52:20.797 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../027-ceph-base_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:52:20.856 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-base (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:22.297 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-28T11:52:22.316 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-11-28T11:52:22.372 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-11-28T11:52:22.702 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-base. 2023-11-28T11:52:22.715 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../027-ceph-base_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:52:22.781 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-base (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:23.509 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-natsort. 2023-11-28T11:52:23.532 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-11-28T11:52:23.578 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-11-28T11:52:23.945 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-logutils. 2023-11-28T11:52:23.966 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-11-28T11:52:24.007 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-11-28T11:52:24.265 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-28T11:52:24.286 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-11-28T11:52:24.323 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-11-28T11:52:24.348 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-28T11:52:24.369 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-11-28T11:52:24.406 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-11-28T11:52:24.735 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-natsort. 2023-11-28T11:52:24.742 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-mako. 2023-11-28T11:52:24.756 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-11-28T11:52:24.761 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-11-28T11:52:24.793 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-11-28T11:52:24.800 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-11-28T11:52:25.180 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-logutils. 2023-11-28T11:52:25.201 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-11-28T11:52:25.212 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-28T11:52:25.232 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-28T11:52:25.270 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-28T11:52:25.272 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-11-28T11:52:25.623 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-28T11:52:25.641 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-11-28T11:52:25.650 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-28T11:52:25.672 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-11-28T11:52:25.680 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-11-28T11:52:25.716 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-11-28T11:52:26.034 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-webob. 2023-11-28T11:52:26.056 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-11-28T11:52:26.069 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-mako. 2023-11-28T11:52:26.092 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-11-28T11:52:26.100 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-11-28T11:52:26.136 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-11-28T11:52:26.453 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-soupsieve. 2023-11-28T11:52:26.473 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-11-28T11:52:26.503 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-11-28T11:52:26.540 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-28T11:52:26.560 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-28T11:52:26.598 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-28T11:52:26.847 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-bs4. 2023-11-28T11:52:26.868 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-11-28T11:52:26.905 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-11-28T11:52:26.968 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-28T11:52:26.985 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-11-28T11:52:27.053 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-11-28T11:52:27.308 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-waitress. 2023-11-28T11:52:27.329 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-11-28T11:52:27.373 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-11-28T11:52:27.420 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-webob. 2023-11-28T11:52:27.433 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-11-28T11:52:27.478 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-11-28T11:52:27.770 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-tempita. 2023-11-28T11:52:27.788 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-11-28T11:52:27.828 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-11-28T11:52:28.189 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-paste. 2023-11-28T11:52:28.209 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-11-28T11:52:28.247 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-11-28T11:52:28.515 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-soupsieve. 2023-11-28T11:52:28.536 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-11-28T11:52:28.606 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-11-28T11:52:28.634 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-28T11:52:28.652 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-11-28T11:52:28.692 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-11-28T11:52:28.985 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-bs4. 2023-11-28T11:52:29.003 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-28T11:52:29.006 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-11-28T11:52:29.021 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-11-28T11:52:29.051 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-11-28T11:52:29.078 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-11-28T11:52:29.423 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-webtest. 2023-11-28T11:52:29.443 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-11-28T11:52:29.463 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-waitress. 2023-11-28T11:52:29.484 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-11-28T11:52:29.514 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-11-28T11:52:29.528 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-11-28T11:52:29.866 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-tempita. 2023-11-28T11:52:29.867 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pecan. 2023-11-28T11:52:29.879 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-11-28T11:52:29.888 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-11-28T11:52:29.924 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-11-28T11:52:29.958 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-11-28T11:52:30.286 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-paste. 2023-11-28T11:52:30.298 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-11-28T11:52:30.355 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-28T11:52:30.360 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-11-28T11:52:30.376 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-11-28T11:52:30.437 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-11-28T11:52:30.731 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-28T11:52:30.751 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-11-28T11:52:30.774 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-28T11:52:30.795 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T11:52:30.797 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-11-28T11:52:30.857 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr-modules-core (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:31.159 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-28T11:52:31.179 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-11-28T11:52:31.216 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-11-28T11:52:31.345 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-28T11:52:31.364 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:52:31.403 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:31.578 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-webtest. 2023-11-28T11:52:31.597 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-11-28T11:52:31.636 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-11-28T11:52:31.773 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-cryptography. 2023-11-28T11:52:31.792 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-11-28T11:52:31.831 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-11-28T11:52:31.995 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-pecan. 2023-11-28T11:52:32.010 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-11-28T11:52:32.049 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-11-28T11:52:32.276 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-openssl. 2023-11-28T11:52:32.290 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-11-28T11:52:32.334 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-11-28T11:52:32.513 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-28T11:52:32.533 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-11-28T11:52:32.579 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-11-28T11:52:32.731 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr. 2023-11-28T11:52:34.663 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../050-ceph-mgr_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:52:34.663 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:34.663 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mon. 2023-11-28T11:52:34.664 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../051-ceph-mon_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:52:34.664 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mon (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:34.664 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-28T11:52:34.664 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T11:52:34.665 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-mgr-modules-core (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:34.665 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-28T11:52:34.665 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:52:34.665 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:34.665 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-cryptography. 2023-11-28T11:52:34.665 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-11-28T11:52:34.665 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-11-28T11:52:34.665 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-openssl. 2023-11-28T11:52:34.665 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-11-28T11:52:34.665 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-11-28T11:52:34.677 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-osd. 2023-11-28T11:52:34.694 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../052-ceph-osd_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:52:34.735 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-osd (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:34.955 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-mgr. 2023-11-28T11:52:34.976 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../050-ceph-mgr_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:52:35.012 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-mgr (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:35.574 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-mon. 2023-11-28T11:52:35.595 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../051-ceph-mon_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:52:35.665 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-mon (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:37.053 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-osd. 2023-11-28T11:52:37.073 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../052-ceph-osd_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:52:37.110 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-osd (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:37.505 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph. 2023-11-28T11:52:37.521 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../053-ceph_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:52:37.562 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:37.926 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-fuse. 2023-11-28T11:52:37.944 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../054-ceph-fuse_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:52:37.973 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-fuse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:38.452 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mds. 2023-11-28T11:52:38.472 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../055-ceph-mds_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:52:38.509 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mds (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:39.304 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package cephadm. 2023-11-28T11:52:39.326 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../056-cephadm_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:52:39.370 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking cephadm (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:39.748 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-28T11:52:39.769 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-11-28T11:52:39.806 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-11-28T11:52:39.938 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph. 2023-11-28T11:52:39.961 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../053-ceph_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:52:40.011 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:40.234 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-jinja2. 2023-11-28T11:52:40.255 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-11-28T11:52:40.301 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-11-28T11:52:40.383 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-fuse. 2023-11-28T11:52:40.404 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../054-ceph-fuse_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:52:40.457 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-fuse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:40.704 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-28T11:52:40.722 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T11:52:40.762 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr-cephadm (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:41.004 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-mds. 2023-11-28T11:52:41.021 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../055-ceph-mds_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:52:41.061 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-mds (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:41.157 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-28T11:52:41.177 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-11-28T11:52:41.215 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-11-28T11:52:41.585 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-jwt. 2023-11-28T11:52:41.604 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-11-28T11:52:41.642 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-11-28T11:52:41.647 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package cephadm. 2023-11-28T11:52:41.666 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../056-cephadm_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:52:41.705 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking cephadm (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:42.009 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-attr. 2023-11-28T11:52:42.026 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../062-python3-attr_19.3.0-2_all.deb ... 2023-11-28T11:52:42.058 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-28T11:52:42.066 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-11-28T11:52:42.078 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-11-28T11:52:42.116 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-11-28T11:52:42.470 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pluggy. 2023-11-28T11:52:42.492 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../063-python3-pluggy_0.13.0-2_all.deb ... 2023-11-28T11:52:42.536 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-11-28T11:52:42.544 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-jinja2. 2023-11-28T11:52:42.565 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-11-28T11:52:42.602 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-11-28T11:52:42.939 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-py. 2023-11-28T11:52:42.959 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../064-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-11-28T11:52:42.980 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-28T11:52:42.997 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-11-28T11:52:43.001 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T11:52:43.063 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-mgr-cephadm (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:43.378 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-atomicwrites. 2023-11-28T11:52:43.396 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../065-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-11-28T11:52:43.438 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-11-28T11:52:43.502 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-28T11:52:43.520 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-11-28T11:52:43.558 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-11-28T11:52:43.803 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-packaging. 2023-11-28T11:52:43.823 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../066-python3-packaging_20.3-1_all.deb ... 2023-11-28T11:52:43.861 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-packaging (20.3-1) ... 2023-11-28T11:52:43.919 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-jwt. 2023-11-28T11:52:43.939 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-11-28T11:52:43.977 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-11-28T11:52:44.230 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pytest. 2023-11-28T11:52:44.252 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../067-python3-pytest_4.6.9-1_all.deb ... 2023-11-28T11:52:44.296 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-11-28T11:52:44.380 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-attr. 2023-11-28T11:52:44.401 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../062-python3-attr_19.3.0-2_all.deb ... 2023-11-28T11:52:44.480 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-11-28T11:52:44.683 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-28T11:52:44.705 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../068-python3-repoze.lru_0.7-2_all.deb ... 2023-11-28T11:52:44.749 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-28T11:52:44.863 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-pluggy. 2023-11-28T11:52:44.884 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../063-python3-pluggy_0.13.0-2_all.deb ... 2023-11-28T11:52:44.929 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-11-28T11:52:45.079 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libjs-underscore. 2023-11-28T11:52:45.098 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../069-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-11-28T11:52:45.135 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-11-28T11:52:45.283 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-py. 2023-11-28T11:52:45.307 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../064-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-11-28T11:52:45.357 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-11-28T11:52:45.488 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-11-28T11:52:45.508 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../070-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-11-28T11:52:45.547 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-11-28T11:52:45.778 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-atomicwrites. 2023-11-28T11:52:45.799 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../065-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-11-28T11:52:45.877 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-11-28T11:52:45.936 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-routes. 2023-11-28T11:52:45.957 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../071-python3-routes_2.4.1-2_all.deb ... 2023-11-28T11:52:46.002 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-11-28T11:52:46.255 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-packaging. 2023-11-28T11:52:46.273 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../066-python3-packaging_20.3-1_all.deb ... 2023-11-28T11:52:46.313 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-packaging (20.3-1) ... 2023-11-28T11:52:46.456 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-28T11:52:46.476 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T11:52:46.513 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr-dashboard (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:46.683 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-pytest. 2023-11-28T11:52:46.703 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../067-python3-pytest_4.6.9-1_all.deb ... 2023-11-28T11:52:46.740 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-11-28T11:52:47.082 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-decorator. 2023-11-28T11:52:47.100 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../073-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-11-28T11:52:47.144 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-28T11:52:47.156 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-11-28T11:52:47.163 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../068-python3-repoze.lru_0.7-2_all.deb ... 2023-11-28T11:52:47.202 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-28T11:52:47.484 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-11-28T11:52:47.505 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../074-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-11-28T11:52:47.522 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libjs-underscore. 2023-11-28T11:52:47.542 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-11-28T11:52:47.544 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../069-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-11-28T11:52:47.588 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-11-28T11:52:47.920 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-scipy. 2023-11-28T11:52:47.924 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-11-28T11:52:47.938 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../075-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-11-28T11:52:47.942 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../070-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-11-28T11:52:47.978 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-11-28T11:52:48.007 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-11-28T11:52:48.395 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-routes. 2023-11-28T11:52:48.414 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../071-python3-routes_2.4.1-2_all.deb ... 2023-11-28T11:52:48.451 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-11-28T11:52:48.909 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-28T11:52:48.929 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T11:52:48.975 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-mgr-dashboard (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:49.421 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-11-28T11:52:49.442 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../076-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-11-28T11:52:49.512 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-11-28T11:52:49.554 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-decorator. 2023-11-28T11:52:49.573 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../073-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-11-28T11:52:49.611 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-11-28T11:52:50.013 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-11-28T11:52:50.027 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../074-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-11-28T11:52:50.104 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-11-28T11:52:50.115 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-joblib. 2023-11-28T11:52:50.133 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../077-python3-joblib_0.14.0-3_all.deb ... 2023-11-28T11:52:50.173 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-11-28T11:52:50.474 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-scipy. 2023-11-28T11:52:50.495 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../075-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-11-28T11:52:50.540 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-11-28T11:52:50.612 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-sklearn. 2023-11-28T11:52:50.633 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../078-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-11-28T11:52:50.678 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-11-28T11:52:51.486 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-28T11:52:51.505 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../079-ceph-mgr-diskprediction-local_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T11:52:51.544 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:52.041 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-11-28T11:52:52.062 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../076-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-11-28T11:52:52.099 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-11-28T11:52:52.712 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-joblib. 2023-11-28T11:52:52.732 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../077-python3-joblib_0.14.0-3_all.deb ... 2023-11-28T11:52:52.769 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-11-28T11:52:52.822 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-cachetools. 2023-11-28T11:52:52.842 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../080-python3-cachetools_4.0.0-1_all.deb ... 2023-11-28T11:52:52.880 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-11-28T11:52:53.215 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-sklearn. 2023-11-28T11:52:53.236 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../078-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-11-28T11:52:53.306 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-11-28T11:52:53.361 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-28T11:52:53.381 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../081-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-11-28T11:52:53.418 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-11-28T11:52:53.814 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-28T11:52:53.832 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../082-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-11-28T11:52:53.872 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-11-28T11:52:54.114 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-28T11:52:54.129 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../079-ceph-mgr-diskprediction-local_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T11:52:54.172 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:54.269 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-rsa. 2023-11-28T11:52:54.292 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../083-python3-rsa_4.0-3_all.deb ... 2023-11-28T11:52:54.335 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-rsa (4.0-3) ... 2023-11-28T11:52:54.714 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-google-auth. 2023-11-28T11:52:54.737 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../084-python3-google-auth_1.5.1-2_all.deb ... 2023-11-28T11:52:54.780 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-11-28T11:52:55.200 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-blinker. 2023-11-28T11:52:55.218 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../085-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-11-28T11:52:55.258 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-11-28T11:52:55.475 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-cachetools. 2023-11-28T11:52:55.493 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../080-python3-cachetools_4.0.0-1_all.deb ... 2023-11-28T11:52:55.533 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-11-28T11:52:55.628 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-oauthlib. 2023-11-28T11:52:55.646 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../086-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-11-28T11:52:55.685 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-11-28T11:52:56.014 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-28T11:52:56.035 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../081-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-11-28T11:52:56.079 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-11-28T11:52:56.098 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-28T11:52:56.119 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-11-28T11:52:56.164 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-11-28T11:52:56.501 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-28T11:52:56.521 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../082-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-11-28T11:52:56.542 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-websocket. 2023-11-28T11:52:56.565 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../088-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-11-28T11:52:56.592 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-11-28T11:52:56.608 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-11-28T11:52:56.979 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-rsa. 2023-11-28T11:52:56.997 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-28T11:52:56.998 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../083-python3-rsa_4.0-3_all.deb ... 2023-11-28T11:52:57.016 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../089-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-11-28T11:52:57.037 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-rsa (4.0-3) ... 2023-11-28T11:52:57.061 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-11-28T11:52:57.434 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-google-auth. 2023-11-28T11:52:57.457 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../084-python3-google-auth_1.5.1-2_all.deb ... 2023-11-28T11:52:57.500 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-11-28T11:52:57.733 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-28T11:52:57.753 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T11:52:57.790 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:52:57.903 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-blinker. 2023-11-28T11:52:57.921 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../085-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-11-28T11:52:57.986 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-11-28T11:52:58.143 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-28T11:52:58.162 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../091-libonig5_6.9.4-1_amd64.deb ... 2023-11-28T11:52:58.201 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-11-28T11:52:58.331 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-oauthlib. 2023-11-28T11:52:58.352 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../086-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-11-28T11:52:58.397 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-11-28T11:52:58.613 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-28T11:52:58.635 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../092-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-11-28T11:52:58.679 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-11-28T11:52:58.793 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-28T11:52:58.811 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-11-28T11:52:58.850 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-11-28T11:52:59.007 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package jq. 2023-11-28T11:52:59.028 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../093-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-11-28T11:52:59.065 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-11-28T11:52:59.245 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-websocket. 2023-11-28T11:52:59.269 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../088-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-11-28T11:52:59.311 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-11-28T11:52:59.385 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package socat. 2023-11-28T11:52:59.402 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../094-socat_1.7.3.3-2_amd64.deb ... 2023-11-28T11:52:59.442 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking socat (1.7.3.3-2) ... 2023-11-28T11:52:59.707 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-28T11:52:59.729 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../089-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-11-28T11:52:59.798 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-11-28T11:52:59.813 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package xmlstarlet. 2023-11-28T11:52:59.832 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-11-28T11:52:59.871 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-11-28T11:53:00.292 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-test. 2023-11-28T11:53:00.313 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../096-ceph-test_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:53:00.357 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-test (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:00.512 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-28T11:53:00.533 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T11:53:00.586 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:00.956 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-28T11:53:00.977 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../091-libonig5_6.9.4-1_amd64.deb ... 2023-11-28T11:53:01.022 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-11-28T11:53:01.434 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-28T11:53:01.456 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../092-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-11-28T11:53:01.533 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-11-28T11:53:01.820 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package jq. 2023-11-28T11:53:01.841 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../093-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-11-28T11:53:01.919 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-11-28T11:53:02.249 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package socat. 2023-11-28T11:53:02.266 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../094-socat_1.7.3.3-2_amd64.deb ... 2023-11-28T11:53:02.305 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking socat (1.7.3.3-2) ... 2023-11-28T11:53:02.675 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package xmlstarlet. 2023-11-28T11:53:02.697 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-11-28T11:53:02.741 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-11-28T11:53:03.187 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-test. 2023-11-28T11:53:03.205 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../096-ceph-test_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:53:03.245 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-test (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:04.563 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-volume. 2023-11-28T11:53:04.585 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../097-ceph-volume_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T11:53:04.629 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-volume (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:05.033 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-28T11:53:05.055 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../098-cephfs-mirror_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:53:05.099 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking cephfs-mirror (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:05.495 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-colorama. 2023-11-28T11:53:05.514 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../099-python3-colorama_0.4.3-1build1_all.deb ... 2023-11-28T11:53:05.552 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-11-28T11:53:05.881 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package cephfs-shell. 2023-11-28T11:53:05.901 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../100-cephfs-shell_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T11:53:05.938 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking cephfs-shell (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:06.258 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package cephfs-top. 2023-11-28T11:53:06.283 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../101-cephfs-top_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T11:53:06.324 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking cephfs-top (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:06.620 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package fonts-mathjax. 2023-11-28T11:53:06.638 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../102-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-11-28T11:53:06.676 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-11-28T11:53:07.225 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-28T11:53:07.249 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../103-libcephfs-dev_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:53:07.291 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libcephfs-dev (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:07.475 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-volume. 2023-11-28T11:53:07.494 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../097-ceph-volume_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T11:53:07.533 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-volume (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:07.736 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package nvme-cli. 2023-11-28T11:53:07.758 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../104-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-11-28T11:53:07.837 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-11-28T11:53:07.921 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-28T11:53:07.939 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../098-cephfs-mirror_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:53:08.004 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking cephfs-mirror (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:08.199 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-28T11:53:08.222 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../105-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-11-28T11:53:08.265 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-11-28T11:53:08.407 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-colorama. 2023-11-28T11:53:08.427 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../099-python3-colorama_0.4.3-1build1_all.deb ... 2023-11-28T11:53:08.464 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-11-28T11:53:08.685 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libjs-mathjax. 2023-11-28T11:53:08.707 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../106-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-11-28T11:53:08.784 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-11-28T11:53:08.785 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package cephfs-shell. 2023-11-28T11:53:08.805 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../100-cephfs-shell_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T11:53:08.850 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking cephfs-shell (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:09.313 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package cephfs-top. 2023-11-28T11:53:09.335 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../101-cephfs-top_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T11:53:09.404 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking cephfs-top (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:09.682 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package fonts-mathjax. 2023-11-28T11:53:09.704 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../102-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-11-28T11:53:09.772 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-11-28T11:53:10.351 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-28T11:53:10.365 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../103-libcephfs-dev_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:53:10.409 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libcephfs-dev (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:10.917 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package nvme-cli. 2023-11-28T11:53:10.937 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../104-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-11-28T11:53:11.024 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python-natsort-doc. 2023-11-28T11:53:11.029 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-11-28T11:53:11.046 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../107-python-natsort-doc_7.0.1-1_all.deb ... 2023-11-28T11:53:11.124 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-11-28T11:53:11.429 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-28T11:53:11.453 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../105-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-11-28T11:53:11.495 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-11-28T11:53:11.510 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-webencodings. 2023-11-28T11:53:11.534 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../108-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-11-28T11:53:11.593 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-11-28T11:53:11.929 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-html5lib. 2023-11-28T11:53:11.950 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../109-python3-html5lib_1.0.1-2_all.deb ... 2023-11-28T11:53:11.957 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libjs-mathjax. 2023-11-28T11:53:11.978 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../106-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-11-28T11:53:12.020 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-11-28T11:53:12.023 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-11-28T11:53:12.382 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-11-28T11:53:12.396 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../110-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-11-28T11:53:12.465 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-11-28T11:53:12.968 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pastescript. 2023-11-28T11:53:12.989 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../111-python3-pastescript_2.0.2-4_all.deb ... 2023-11-28T11:53:13.034 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-28T11:53:13.421 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-psutil. 2023-11-28T11:53:13.442 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../112-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-11-28T11:53:13.487 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-11-28T11:53:13.882 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-28T11:53:13.902 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../113-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-11-28T11:53:13.940 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-11-28T11:53:14.276 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-simplejson. 2023-11-28T11:53:14.295 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-11-28T11:53:14.334 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-11-28T11:53:14.459 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python-natsort-doc. 2023-11-28T11:53:14.484 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../107-python-natsort-doc_7.0.1-1_all.deb ... 2023-11-28T11:53:14.526 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-11-28T11:53:14.787 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-28T11:53:14.809 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-11-28T11:53:14.853 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-11-28T11:53:14.937 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-webencodings. 2023-11-28T11:53:14.956 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../108-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-11-28T11:53:14.994 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-11-28T11:53:15.348 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-html5lib. 2023-11-28T11:53:15.370 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../109-python3-html5lib_1.0.1-2_all.deb ... 2023-11-28T11:53:15.422 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-11-28T11:53:15.582 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package radosgw. 2023-11-28T11:53:15.606 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../116-radosgw_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:53:15.681 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking radosgw (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:15.851 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-11-28T11:53:15.871 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../110-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-11-28T11:53:15.909 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-11-28T11:53:16.445 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-pastescript. 2023-11-28T11:53:16.465 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../111-python3-pastescript_2.0.2-4_all.deb ... 2023-11-28T11:53:16.547 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-28T11:53:16.924 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-psutil. 2023-11-28T11:53:16.943 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../112-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-11-28T11:53:16.981 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-11-28T11:53:17.093 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package rbd-fuse. 2023-11-28T11:53:17.116 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../117-rbd-fuse_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:53:17.159 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking rbd-fuse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:17.384 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-28T11:53:17.403 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../113-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-11-28T11:53:17.442 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-11-28T11:53:17.546 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-attr (19.3.0-2) ... 2023-11-28T11:53:17.803 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-simplejson. 2023-11-28T11:53:17.823 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-11-28T11:53:17.861 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-11-28T11:53:17.925 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-11-28T11:53:18.048 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-11-28T11:53:18.174 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-11-28T11:53:18.197 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-28T11:53:18.220 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-11-28T11:53:18.263 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-11-28T11:53:18.409 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up cephadm (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:19.043 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package radosgw. 2023-11-28T11:53:19.063 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../116-radosgw_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:53:19.064 INFO:teuthology.orchestra.run.smithi184.stdout:Adding system user cephadm....done 2023-11-28T11:53:19.100 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking radosgw (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:19.273 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-11-28T11:53:19.408 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-11-28T11:53:19.851 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-28T11:53:20.219 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-11-28T11:53:20.345 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-11-28T11:53:20.470 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-11-28T11:53:20.521 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package rbd-fuse. 2023-11-28T11:53:20.542 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../117-rbd-fuse_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:53:20.620 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking rbd-fuse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:20.897 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-11-28T11:53:20.997 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-attr (19.3.0-2) ... 2023-11-28T11:53:21.367 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-11-28T11:53:21.391 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-11-28T11:53:21.493 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-11-28T11:53:21.662 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-11-28T11:53:21.775 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-11-28T11:53:21.870 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up cephadm (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:22.127 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-11-28T11:53:22.486 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-11-28T11:53:22.612 INFO:teuthology.orchestra.run.smithi039.stdout:Adding system user cephadm....done 2023-11-28T11:53:22.835 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-11-28T11:53:22.854 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-11-28T11:53:22.960 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-11-28T11:53:23.213 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-ceph-argparse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:23.379 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-28T11:53:23.606 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-11-28T11:53:23.757 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-11-28T11:53:23.772 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-11-28T11:53:23.948 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-11-28T11:53:24.074 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-11-28T11:53:24.108 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-11-28T11:53:24.484 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-11-28T11:53:24.550 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-11-28T11:53:24.826 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-11-28T11:53:24.952 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-11-28T11:53:25.069 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-11-28T11:53:25.436 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-11-28T11:53:25.437 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-11-28T11:53:25.788 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-11-28T11:53:25.810 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-11-28T11:53:26.162 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-11-28T11:53:26.165 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-11-28T11:53:26.524 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-11-28T11:53:26.570 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-11-28T11:53:26.892 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-ceph-argparse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:26.913 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-11-28T11:53:27.284 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-11-28T11:53:27.330 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-11-28T11:53:27.452 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-11-28T11:53:27.690 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-packaging (20.3-1) ... 2023-11-28T11:53:27.820 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-11-28T11:53:28.091 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-11-28T11:53:28.179 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-11-28T11:53:28.267 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-11-28T11:53:28.393 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-11-28T11:53:28.563 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-11-28T11:53:28.698 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-11-28T11:53:28.753 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-11-28T11:53:29.199 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-11-28T11:53:29.246 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-11-28T11:53:29.567 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-11-28T11:53:29.613 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-11-28T11:53:29.927 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-11-28T11:53:30.049 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-11-28T11:53:30.352 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-11-28T11:53:30.503 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up socat (1.7.3.3-2) ... 2023-11-28T11:53:30.629 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-ceph-common (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:30.706 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-11-28T11:53:31.013 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-28T11:53:31.141 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-11-28T11:53:31.156 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-11-28T11:53:31.586 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-packaging (20.3-1) ... 2023-11-28T11:53:31.591 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-11-28T11:53:31.717 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-11-28T11:53:31.868 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-11-28T11:53:31.968 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-11-28T11:53:32.094 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-11-28T11:53:32.211 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-11-28T11:53:32.252 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-11-28T11:53:32.654 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-11-28T11:53:32.683 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-28T11:53:32.813 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-11-28T11:53:32.941 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-11-28T11:53:33.181 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-11-28T11:53:33.359 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-11-28T11:53:33.573 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-11-28T11:53:33.718 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-11-28T11:53:34.067 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-11-28T11:53:34.078 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-11-28T11:53:34.204 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-28T11:53:34.518 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up socat (1.7.3.3-2) ... 2023-11-28T11:53:34.538 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-11-28T11:53:34.644 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-ceph-common (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:34.931 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-11-28T11:53:35.106 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-28T11:53:35.249 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-11-28T11:53:35.324 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-11-28T11:53:35.683 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-11-28T11:53:35.731 INFO:teuthology.orchestra.run.smithi184.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-11-28T11:53:35.851 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-11-28T11:53:35.977 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-11-28T11:53:36.060 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-11-28T11:53:36.186 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-11-28T11:53:36.337 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-11-28T11:53:36.603 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-11-28T11:53:36.738 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-28T11:53:36.914 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-11-28T11:53:37.040 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-11-28T11:53:37.080 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-11-28T11:53:37.231 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-11-28T11:53:37.357 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-11-28T11:53:37.451 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-11-28T11:53:37.767 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-11-28T11:53:37.836 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-11-28T11:53:38.118 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-11-28T11:53:38.295 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-11-28T11:53:38.421 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-28T11:53:38.781 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-11-28T11:53:39.148 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-11-28T11:53:39.524 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-11-28T11:53:39.875 INFO:teuthology.orchestra.run.smithi039.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-11-28T11:53:39.932 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-11-28T11:53:40.058 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-11-28T11:53:40.227 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-11-28T11:53:40.411 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-11-28T11:53:40.501 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-11-28T11:53:40.821 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-11-28T11:53:40.877 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-11-28T11:53:41.237 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-28T11:53:41.272 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-11-28T11:53:41.362 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-11-28T11:53:41.431 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-11-28T11:53:41.566 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-11-28T11:53:41.780 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-11-28T11:53:41.992 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-11-28T11:53:42.183 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-11-28T11:53:42.351 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-11-28T11:53:42.659 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-11-28T11:53:43.068 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-11-28T11:53:44.207 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-11-28T11:53:44.332 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-11-28T11:53:44.358 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-11-28T11:53:44.458 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-11-28T11:53:44.584 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-11-28T11:53:44.710 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-rsa (4.0-3) ... 2023-11-28T11:53:44.834 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-11-28T11:53:45.111 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-11-28T11:53:45.485 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-11-28T11:53:45.587 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-11-28T11:53:45.845 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-28T11:53:45.955 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-11-28T11:53:45.971 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-11-28T11:53:46.365 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-28T11:53:46.414 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-11-28T11:53:46.749 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-11-28T11:53:46.882 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-11-28T11:53:47.201 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up librados2 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:47.383 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-11-28T11:53:47.421 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-11-28T11:53:47.581 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up librgw2 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:47.707 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libsqlite3-mod-ceph (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:47.801 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-11-28T11:53:47.833 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libcephfs2 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:47.992 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-routes (2.4.1-2) ... 2023-11-28T11:53:48.370 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libradosstriper1 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:48.520 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-11-28T11:53:48.905 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up librbd1 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:49.031 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr-modules-core (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:49.124 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-11-28T11:53:49.157 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-fuse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:49.249 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-11-28T11:53:49.400 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-11-28T11:53:49.418 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T11:53:49.418 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T11:53:49.526 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-rsa (4.0-3) ... 2023-11-28T11:53:49.877 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-11-28T11:53:50.026 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-11-28T11:53:50.438 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-11-28T11:53:50.450 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libcephfs-dev (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:50.577 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-rados (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:50.728 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up cephfs-top (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:50.806 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-28T11:53:50.854 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-11-28T11:53:51.207 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-11-28T11:53:51.667 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up librados2 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:51.920 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-11-28T11:53:52.014 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-rbd (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:52.047 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up librgw2 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:52.142 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up rbd-fuse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:52.181 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libsqlite3-mod-ceph (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:52.268 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-rgw (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:52.307 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libcephfs2 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:52.394 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-cephfs (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:52.433 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-routes (2.4.1-2) ... 2023-11-28T11:53:52.546 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up cephfs-shell (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:52.671 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-common (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:52.851 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libradosstriper1 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:52.985 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-11-28T11:53:53.288 INFO:teuthology.orchestra.run.smithi184.stdout:Adding group ceph....done 2023-11-28T11:53:53.362 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up librbd1 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:53.488 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-mgr-modules-core (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:53.656 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-fuse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:53.717 INFO:teuthology.orchestra.run.smithi184.stdout:Adding system user ceph....done 2023-11-28T11:53:53.926 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T11:53:53.926 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T11:53:53.981 INFO:teuthology.orchestra.run.smithi184.stdout:Setting system user ceph properties....done 2023-11-28T11:53:54.016 INFO:teuthology.orchestra.run.smithi184.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-28T11:53:54.224 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-28T11:53:54.768 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-28T11:53:54.823 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libcephfs-dev (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:55.050 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-rados (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:55.217 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up cephfs-top (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:55.536 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-11-28T11:53:55.732 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up cephfs-mirror (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:55.858 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-test (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:55.984 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up radosgw (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:56.325 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T11:53:56.325 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T11:53:56.759 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-rbd (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:56.885 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up rbd-fuse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:57.011 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-rgw (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:57.162 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-cephfs (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:57.288 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up cephfs-shell (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:57.439 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-common (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:57.586 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-base (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:58.054 INFO:teuthology.orchestra.run.smithi039.stdout:Adding group ceph....done 2023-11-28T11:53:58.074 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-28T11:53:58.529 INFO:teuthology.orchestra.run.smithi039.stdout:Adding system user ceph....done 2023-11-28T11:53:58.767 INFO:teuthology.orchestra.run.smithi039.stdout:Setting system user ceph properties....done 2023-11-28T11:53:58.802 INFO:teuthology.orchestra.run.smithi039.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-28T11:53:58.996 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mds (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:53:59.001 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-28T11:53:59.278 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T11:53:59.278 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T11:53:59.554 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-28T11:54:00.148 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:54:00.407 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T11:54:00.407 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T11:54:00.433 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up cephfs-mirror (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:54:00.634 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-test (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:54:00.761 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up radosgw (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:54:01.089 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T11:54:01.089 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T11:54:01.274 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-osd (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:54:02.132 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T11:54:02.132 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T11:54:02.387 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-base (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:54:02.915 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-28T11:54:02.951 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr-k8sevents (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:54:03.077 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:54:03.236 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mon (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:54:03.488 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T11:54:03.489 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T11:54:03.814 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-mds (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:54:04.095 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T11:54:04.095 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T11:54:04.370 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr-cephadm (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:54:04.563 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:54:04.689 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr-dashboard (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:54:04.841 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-volume (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:54:04.983 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-mgr (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:54:04.991 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-11-28T11:54:05.152 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-11-28T11:54:05.265 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T11:54:05.265 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T11:54:05.664 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-11-28T11:54:06.127 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-osd (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:54:07.020 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T11:54:07.021 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T11:54:07.869 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-mgr-k8sevents (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:54:08.020 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:54:08.171 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-mon (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:54:08.444 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T11:54:08.444 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T11:54:09.331 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-mgr-cephadm (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:54:09.507 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:54:09.633 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-mgr-dashboard (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:54:09.809 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-volume (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:54:09.936 INFO:teuthology.orchestra.run.smithi039.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-11-28T11:54:10.137 INFO:teuthology.orchestra.run.smithi039.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-11-28T11:54:10.631 INFO:teuthology.orchestra.run.smithi039.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-11-28T11:54:10.982 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-11-28T11:54:11.783 INFO:teuthology.orchestra.run.smithi184.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T11:54:11.790 DEBUG:teuthology.orchestra.run.smithi184:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-28T11:54:11.915 INFO:teuthology.orchestra.run.smithi184.stdout:Reading package lists... 2023-11-28T11:54:12.122 INFO:teuthology.orchestra.run.smithi184.stdout:Building dependency tree... 2023-11-28T11:54:12.123 INFO:teuthology.orchestra.run.smithi184.stdout:Reading state information... 2023-11-28T11:54:12.326 INFO:teuthology.orchestra.run.smithi184.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-11-28T11:54:12.326 INFO:teuthology.orchestra.run.smithi184.stdout:flex is already the newest version (2.6.4-6.2). 2023-11-28T11:54:12.327 INFO:teuthology.orchestra.run.smithi184.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-11-28T11:54:12.327 INFO:teuthology.orchestra.run.smithi184.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-11-28T11:54:12.327 INFO:teuthology.orchestra.run.smithi184.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-11-28T11:54:12.327 INFO:teuthology.orchestra.run.smithi184.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T11:54:12.327 INFO:teuthology.orchestra.run.smithi184.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-11-28T11:54:12.327 INFO:teuthology.orchestra.run.smithi184.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T11:54:12.327 INFO:teuthology.orchestra.run.smithi184.stdout:The following additional packages will be installed: 2023-11-28T11:54:12.328 INFO:teuthology.orchestra.run.smithi184.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-11-28T11:54:12.328 INFO:teuthology.orchestra.run.smithi184.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2023-11-28T11:54:12.328 INFO:teuthology.orchestra.run.smithi184.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2023-11-28T11:54:12.329 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2023-11-28T11:54:12.329 INFO:teuthology.orchestra.run.smithi184.stdout: usb-modeswitch-data wpasupplicant 2023-11-28T11:54:12.330 INFO:teuthology.orchestra.run.smithi184.stdout:Suggested packages: 2023-11-28T11:54:12.330 INFO:teuthology.orchestra.run.smithi184.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-11-28T11:54:12.330 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2023-11-28T11:54:12.330 INFO:teuthology.orchestra.run.smithi184.stdout: libengine-pkcs11-openssl 2023-11-28T11:54:12.437 INFO:teuthology.orchestra.run.smithi184.stdout:The following NEW packages will be installed: 2023-11-28T11:54:12.437 INFO:teuthology.orchestra.run.smithi184.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-11-28T11:54:12.438 INFO:teuthology.orchestra.run.smithi184.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-11-28T11:54:12.438 INFO:teuthology.orchestra.run.smithi184.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-11-28T11:54:12.438 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-11-28T11:54:12.439 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-11-28T11:54:12.439 INFO:teuthology.orchestra.run.smithi184.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-28T11:54:12.440 INFO:teuthology.orchestra.run.smithi184.stdout:The following packages will be upgraded: 2023-11-28T11:54:12.441 INFO:teuthology.orchestra.run.smithi184.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-11-28T11:54:12.511 INFO:teuthology.orchestra.run.smithi184.stdout:6 upgraded, 31 newly installed, 0 to remove and 254 not upgraded. 2023-11-28T11:54:12.511 INFO:teuthology.orchestra.run.smithi184.stdout:Need to get 25.3 MB of archives. 2023-11-28T11:54:12.511 INFO:teuthology.orchestra.run.smithi184.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-11-28T11:54:12.511 INFO:teuthology.orchestra.run.smithi184.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-11-28T11:54:12.677 INFO:teuthology.orchestra.run.smithi184.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-11-28T11:54:12.679 INFO:teuthology.orchestra.run.smithi184.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-11-28T11:54:12.681 INFO:teuthology.orchestra.run.smithi184.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-11-28T11:54:12.687 INFO:teuthology.orchestra.run.smithi184.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-11-28T11:54:12.687 INFO:teuthology.orchestra.run.smithi184.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.20 [1,321 kB] 2023-11-28T11:54:12.712 INFO:teuthology.orchestra.run.smithi184.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-11-28T11:54:12.712 INFO:teuthology.orchestra.run.smithi184.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-11-28T11:54:12.715 INFO:teuthology.orchestra.run.smithi184.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-11-28T11:54:12.717 INFO:teuthology.orchestra.run.smithi184.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-11-28T11:54:12.717 INFO:teuthology.orchestra.run.smithi184.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-11-28T11:54:12.719 INFO:teuthology.orchestra.run.smithi184.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-11-28T11:54:12.720 INFO:teuthology.orchestra.run.smithi184.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-11-28T11:54:12.722 INFO:teuthology.orchestra.run.smithi184.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-11-28T11:54:12.722 INFO:teuthology.orchestra.run.smithi184.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-11-28T11:54:12.736 INFO:teuthology.orchestra.run.smithi184.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-11-28T11:54:12.737 INFO:teuthology.orchestra.run.smithi184.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-11-28T11:54:12.746 INFO:teuthology.orchestra.run.smithi184.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.16-0ubuntu0.20.04.1 [115 kB] 2023-11-28T11:54:12.756 INFO:teuthology.orchestra.run.smithi184.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-11-28T11:54:12.766 INFO:teuthology.orchestra.run.smithi184.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-11-28T11:54:12.766 INFO:teuthology.orchestra.run.smithi184.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.20 [1,584 kB] 2023-11-28T11:54:12.789 INFO:teuthology.orchestra.run.smithi184.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-11-28T11:54:12.789 INFO:teuthology.orchestra.run.smithi184.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-11-28T11:54:12.799 INFO:teuthology.orchestra.run.smithi184.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-11-28T11:54:12.811 INFO:teuthology.orchestra.run.smithi184.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-11-28T11:54:12.838 INFO:teuthology.orchestra.run.smithi184.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-11-28T11:54:12.842 INFO:teuthology.orchestra.run.smithi184.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-11-28T11:54:12.843 INFO:teuthology.orchestra.run.smithi184.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-11-28T11:54:12.843 INFO:teuthology.orchestra.run.smithi184.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-11-28T11:54:12.844 INFO:teuthology.orchestra.run.smithi184.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.16-0ubuntu0.20.04.1 [1,053 kB] 2023-11-28T11:54:12.858 INFO:teuthology.orchestra.run.smithi184.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-11-28T11:54:12.858 INFO:teuthology.orchestra.run.smithi184.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.16-0ubuntu0.20.04.1 [13.5 MB] 2023-11-28T11:54:13.014 INFO:teuthology.orchestra.run.smithi184.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-11-28T11:54:13.014 INFO:teuthology.orchestra.run.smithi184.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-11-28T11:54:13.014 INFO:teuthology.orchestra.run.smithi184.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-11-28T11:54:13.015 INFO:teuthology.orchestra.run.smithi184.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-11-28T11:54:13.015 INFO:teuthology.orchestra.run.smithi184.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-11-28T11:54:13.592 INFO:teuthology.orchestra.run.smithi184.stdout:Preconfiguring packages ... 2023-11-28T11:54:13.825 INFO:teuthology.orchestra.run.smithi184.stdout:Fetched 25.3 MB in 1s (44.8 MB/s) 2023-11-28T11:54:14.172 INFO:teuthology.orchestra.run.smithi184.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118858 files and directories currently installed.) 2023-11-28T11:54:14.176 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-28T11:54:14.356 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-28T11:54:16.268 INFO:teuthology.orchestra.run.smithi039.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-11-28T11:54:16.376 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-11-28T11:54:17.064 INFO:teuthology.orchestra.run.smithi039.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T11:54:17.070 DEBUG:teuthology.orchestra.run.smithi039:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-28T11:54:17.198 INFO:teuthology.orchestra.run.smithi039.stdout:Reading package lists... 2023-11-28T11:54:17.407 INFO:teuthology.orchestra.run.smithi039.stdout:Building dependency tree... 2023-11-28T11:54:17.408 INFO:teuthology.orchestra.run.smithi039.stdout:Reading state information... 2023-11-28T11:54:17.619 INFO:teuthology.orchestra.run.smithi039.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-11-28T11:54:17.620 INFO:teuthology.orchestra.run.smithi039.stdout:flex is already the newest version (2.6.4-6.2). 2023-11-28T11:54:17.620 INFO:teuthology.orchestra.run.smithi039.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-11-28T11:54:17.620 INFO:teuthology.orchestra.run.smithi039.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-11-28T11:54:17.620 INFO:teuthology.orchestra.run.smithi039.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-11-28T11:54:17.620 INFO:teuthology.orchestra.run.smithi039.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T11:54:17.622 INFO:teuthology.orchestra.run.smithi039.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-11-28T11:54:17.622 INFO:teuthology.orchestra.run.smithi039.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T11:54:17.622 INFO:teuthology.orchestra.run.smithi039.stdout:The following additional packages will be installed: 2023-11-28T11:54:17.622 INFO:teuthology.orchestra.run.smithi039.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-11-28T11:54:17.623 INFO:teuthology.orchestra.run.smithi039.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2023-11-28T11:54:17.623 INFO:teuthology.orchestra.run.smithi039.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2023-11-28T11:54:17.623 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2023-11-28T11:54:17.623 INFO:teuthology.orchestra.run.smithi039.stdout: usb-modeswitch-data wpasupplicant 2023-11-28T11:54:17.624 INFO:teuthology.orchestra.run.smithi039.stdout:Suggested packages: 2023-11-28T11:54:17.624 INFO:teuthology.orchestra.run.smithi039.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-11-28T11:54:17.624 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2023-11-28T11:54:17.624 INFO:teuthology.orchestra.run.smithi039.stdout: libengine-pkcs11-openssl 2023-11-28T11:54:17.726 INFO:teuthology.orchestra.run.smithi039.stdout:The following NEW packages will be installed: 2023-11-28T11:54:17.726 INFO:teuthology.orchestra.run.smithi039.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-11-28T11:54:17.726 INFO:teuthology.orchestra.run.smithi039.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-11-28T11:54:17.727 INFO:teuthology.orchestra.run.smithi039.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-11-28T11:54:17.727 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-11-28T11:54:17.727 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-11-28T11:54:17.727 INFO:teuthology.orchestra.run.smithi039.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-28T11:54:17.728 INFO:teuthology.orchestra.run.smithi039.stdout:The following packages will be upgraded: 2023-11-28T11:54:17.728 INFO:teuthology.orchestra.run.smithi039.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-11-28T11:54:17.795 INFO:teuthology.orchestra.run.smithi039.stdout:6 upgraded, 31 newly installed, 0 to remove and 254 not upgraded. 2023-11-28T11:54:17.795 INFO:teuthology.orchestra.run.smithi039.stdout:Need to get 25.3 MB of archives. 2023-11-28T11:54:17.795 INFO:teuthology.orchestra.run.smithi039.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-11-28T11:54:17.795 INFO:teuthology.orchestra.run.smithi039.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-11-28T11:54:17.930 INFO:teuthology.orchestra.run.smithi039.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-11-28T11:54:17.931 INFO:teuthology.orchestra.run.smithi039.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-11-28T11:54:17.933 INFO:teuthology.orchestra.run.smithi039.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-11-28T11:54:17.940 INFO:teuthology.orchestra.run.smithi039.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-11-28T11:54:17.941 INFO:teuthology.orchestra.run.smithi039.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.20 [1,321 kB] 2023-11-28T11:54:17.956 INFO:teuthology.orchestra.run.smithi039.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-11-28T11:54:17.956 INFO:teuthology.orchestra.run.smithi039.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-11-28T11:54:17.958 INFO:teuthology.orchestra.run.smithi039.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-11-28T11:54:17.959 INFO:teuthology.orchestra.run.smithi039.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-11-28T11:54:17.959 INFO:teuthology.orchestra.run.smithi039.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-11-28T11:54:17.963 INFO:teuthology.orchestra.run.smithi039.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-11-28T11:54:17.964 INFO:teuthology.orchestra.run.smithi039.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-11-28T11:54:17.966 INFO:teuthology.orchestra.run.smithi039.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-11-28T11:54:17.966 INFO:teuthology.orchestra.run.smithi039.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-11-28T11:54:17.980 INFO:teuthology.orchestra.run.smithi039.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-11-28T11:54:17.981 INFO:teuthology.orchestra.run.smithi039.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-11-28T11:54:17.993 INFO:teuthology.orchestra.run.smithi039.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.16-0ubuntu0.20.04.1 [115 kB] 2023-11-28T11:54:17.995 INFO:teuthology.orchestra.run.smithi039.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-11-28T11:54:18.003 INFO:teuthology.orchestra.run.smithi039.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-11-28T11:54:18.003 INFO:teuthology.orchestra.run.smithi039.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.20 [1,584 kB] 2023-11-28T11:54:18.020 INFO:teuthology.orchestra.run.smithi039.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-11-28T11:54:18.020 INFO:teuthology.orchestra.run.smithi039.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-11-28T11:54:18.030 INFO:teuthology.orchestra.run.smithi039.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-11-28T11:54:18.042 INFO:teuthology.orchestra.run.smithi039.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-11-28T11:54:18.062 INFO:teuthology.orchestra.run.smithi039.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-11-28T11:54:18.065 INFO:teuthology.orchestra.run.smithi039.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-11-28T11:54:18.066 INFO:teuthology.orchestra.run.smithi039.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-11-28T11:54:18.066 INFO:teuthology.orchestra.run.smithi039.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-11-28T11:54:18.067 INFO:teuthology.orchestra.run.smithi039.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.16-0ubuntu0.20.04.1 [1,053 kB] 2023-11-28T11:54:18.077 INFO:teuthology.orchestra.run.smithi039.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-11-28T11:54:18.079 INFO:teuthology.orchestra.run.smithi039.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.16-0ubuntu0.20.04.1 [13.5 MB] 2023-11-28T11:54:18.211 INFO:teuthology.orchestra.run.smithi039.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-11-28T11:54:18.211 INFO:teuthology.orchestra.run.smithi039.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-11-28T11:54:18.212 INFO:teuthology.orchestra.run.smithi039.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-11-28T11:54:18.212 INFO:teuthology.orchestra.run.smithi039.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-11-28T11:54:18.212 INFO:teuthology.orchestra.run.smithi039.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-11-28T11:54:18.377 INFO:teuthology.orchestra.run.smithi184.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118858 files and directories currently installed.) 2023-11-28T11:54:18.380 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-28T11:54:18.501 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-28T11:54:18.789 INFO:teuthology.orchestra.run.smithi039.stdout:Preconfiguring packages ... 2023-11-28T11:54:18.962 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-28T11:54:19.038 INFO:teuthology.orchestra.run.smithi039.stdout:Fetched 25.3 MB in 0s (53.2 MB/s) 2023-11-28T11:54:19.166 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-28T11:54:19.385 INFO:teuthology.orchestra.run.smithi039.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118858 files and directories currently installed.) 2023-11-28T11:54:19.389 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-28T11:54:19.571 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-11-28T11:54:19.579 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-28T11:54:20.089 INFO:teuthology.orchestra.run.smithi184.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118858 files and directories currently installed.) 2023-11-28T11:54:20.092 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-28T11:54:20.224 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-11-28T11:54:20.775 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-28T11:54:20.921 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-11-28T11:54:21.405 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-11-28T11:54:21.735 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-11-28T11:54:21.877 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.20) over (1.1.1f-1ubuntu2.16) ... 2023-11-28T11:54:22.439 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-28T11:54:22.459 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-11-28T11:54:22.497 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-11-28T11:54:22.884 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package dump. 2023-11-28T11:54:22.903 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-11-28T11:54:22.942 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking dump (0.4b46-6) ... 2023-11-28T11:54:23.279 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package indent. 2023-11-28T11:54:23.301 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-11-28T11:54:23.346 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-11-28T11:54:23.431 INFO:teuthology.orchestra.run.smithi039.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118858 files and directories currently installed.) 2023-11-28T11:54:23.435 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-28T11:54:23.571 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-28T11:54:23.716 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-28T11:54:23.735 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-11-28T11:54:23.774 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-11-28T11:54:24.083 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-28T11:54:24.186 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-28T11:54:24.208 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-11-28T11:54:24.252 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-11-28T11:54:24.261 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-28T11:54:24.580 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-28T11:54:24.599 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-28T11:54:24.638 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-28T11:54:24.662 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-11-28T11:54:25.058 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-28T11:54:25.080 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T11:54:25.124 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-11-28T11:54:25.222 INFO:teuthology.orchestra.run.smithi039.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118858 files and directories currently installed.) 2023-11-28T11:54:25.226 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-28T11:54:25.406 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-11-28T11:54:25.444 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-28T11:54:25.465 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T11:54:25.510 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-11-28T11:54:25.897 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-28T11:54:25.914 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-28T11:54:25.918 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T11:54:25.963 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-11-28T11:54:26.050 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-11-28T11:54:26.517 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-28T11:54:26.536 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-11-28T11:54:26.585 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-11-28T11:54:26.875 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-11-28T11:54:26.938 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-28T11:54:26.962 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-11-28T11:54:27.004 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-11-28T11:54:27.007 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.20) over (1.1.1f-1ubuntu2.16) ... 2023-11-28T11:54:27.416 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-28T11:54:27.435 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../14-libpq5_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-28T11:54:27.474 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-11-28T11:54:27.611 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-28T11:54:27.625 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-11-28T11:54:27.669 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-11-28T11:54:27.877 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-28T11:54:27.898 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T11:54:27.981 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-11-28T11:54:28.065 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package dump. 2023-11-28T11:54:28.088 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-11-28T11:54:28.131 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking dump (0.4b46-6) ... 2023-11-28T11:54:28.363 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-28T11:54:28.385 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T11:54:28.454 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-11-28T11:54:28.468 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package indent. 2023-11-28T11:54:28.490 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-11-28T11:54:28.558 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-11-28T11:54:28.749 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-28T11:54:28.771 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-11-28T11:54:28.815 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-28T11:54:28.946 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-28T11:54:28.969 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-11-28T11:54:29.012 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-11-28T11:54:29.383 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-28T11:54:29.386 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-28T11:54:29.397 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-11-28T11:54:29.408 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2023-11-28T11:54:29.441 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-11-28T11:54:29.452 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-11-28T11:54:29.752 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-28T11:54:29.766 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-28T11:54:29.810 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-28T11:54:29.881 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package modemmanager. 2023-11-28T11:54:29.899 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T11:54:29.962 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-11-28T11:54:30.197 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-28T11:54:30.217 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T11:54:30.255 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-11-28T11:54:30.592 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-28T11:54:30.613 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T11:54:30.658 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-11-28T11:54:30.678 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package wpasupplicant. 2023-11-28T11:54:30.700 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-11-28T11:54:30.744 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-11-28T11:54:31.094 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-28T11:54:31.116 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T11:54:31.161 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-11-28T11:54:31.344 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package network-manager. 2023-11-28T11:54:31.367 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-11-28T11:54:31.462 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-11-28T11:54:31.590 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-28T11:54:31.613 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-11-28T11:54:31.657 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-11-28T11:54:32.051 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-28T11:54:32.073 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-11-28T11:54:32.151 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-11-28T11:54:32.268 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ppp. 2023-11-28T11:54:32.287 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-11-28T11:54:32.588 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-28T11:54:32.607 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../14-libpq5_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-28T11:54:32.645 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-11-28T11:54:32.755 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-11-28T11:54:33.057 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-28T11:54:33.079 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T11:54:33.148 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-11-28T11:54:33.182 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package pptp-linux. 2023-11-28T11:54:33.205 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-11-28T11:54:33.248 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-11-28T11:54:33.518 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-28T11:54:33.541 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T11:54:33.593 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-11-28T11:54:33.693 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-28T11:54:33.716 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-11-28T11:54:33.794 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-11-28T11:54:33.926 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-28T11:54:33.947 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-11-28T11:54:33.995 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-28T11:54:34.138 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-28T11:54:34.162 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-11-28T11:54:34.204 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-11-28T11:54:34.551 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package postgresql-client-12. 2023-11-28T11:54:34.570 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../26-postgresql-client-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-28T11:54:34.591 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-28T11:54:34.608 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-28T11:54:34.615 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2023-11-28T11:54:34.683 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-11-28T11:54:35.128 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package modemmanager. 2023-11-28T11:54:35.147 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T11:54:35.208 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-11-28T11:54:35.297 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package postgresql-common. 2023-11-28T11:54:35.318 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2023-11-28T11:54:35.397 INFO:teuthology.orchestra.run.smithi184.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-28T11:54:35.425 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-11-28T11:54:35.901 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package wpasupplicant. 2023-11-28T11:54:35.919 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-11-28T11:54:35.937 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package postgresql-12. 2023-11-28T11:54:35.958 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-11-28T11:54:35.961 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../28-postgresql-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-28T11:54:36.010 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-28T11:54:36.539 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package network-manager. 2023-11-28T11:54:36.559 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-11-28T11:54:36.662 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-11-28T11:54:37.480 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ppp. 2023-11-28T11:54:37.495 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-11-28T11:54:37.640 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package postgresql. 2023-11-28T11:54:37.661 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2023-11-28T11:54:37.715 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-11-28T11:54:37.970 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-11-28T11:54:38.026 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package postgresql-client. 2023-11-28T11:54:38.050 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-11-28T11:54:38.092 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-11-28T11:54:38.353 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package pptp-linux. 2023-11-28T11:54:38.376 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-11-28T11:54:38.386 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-28T11:54:38.405 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-11-28T11:54:38.419 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-11-28T11:54:38.444 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-11-28T11:54:38.746 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-28T11:54:38.769 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2023-11-28T11:54:38.813 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-11-28T11:54:38.914 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-28T11:54:38.936 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-11-28T11:54:39.014 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-11-28T11:54:39.266 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-28T11:54:39.289 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-11-28T11:54:39.358 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-11-28T11:54:39.401 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-28T11:54:39.422 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-11-28T11:54:39.467 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-11-28T11:54:39.730 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-11-28T11:54:39.838 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package postgresql-client-12. 2023-11-28T11:54:39.861 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../26-postgresql-client-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-28T11:54:39.938 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-28T11:54:39.947 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-28T11:54:40.315 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-11-28T11:54:40.441 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-11-28T11:54:40.601 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-11-28T11:54:40.652 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package postgresql-common. 2023-11-28T11:54:40.674 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2023-11-28T11:54:40.727 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-11-28T11:54:40.745 INFO:teuthology.orchestra.run.smithi039.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-28T11:54:40.772 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-11-28T11:54:41.189 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T11:54:41.189 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T11:54:41.359 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package postgresql-12. 2023-11-28T11:54:41.381 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../28-postgresql-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-28T11:54:41.433 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-28T11:54:42.155 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-28T11:54:43.154 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package postgresql. 2023-11-28T11:54:43.177 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2023-11-28T11:54:43.221 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-11-28T11:54:43.490 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package postgresql-client. 2023-11-28T11:54:43.511 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-11-28T11:54:43.556 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-11-28T11:54:43.859 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-28T11:54:43.882 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-11-28T11:54:43.925 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-11-28T11:54:44.220 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-28T11:54:44.242 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2023-11-28T11:54:44.259 INFO:teuthology.orchestra.run.smithi184.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-28T11:54:44.286 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-11-28T11:54:44.377 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-11-28T11:54:44.503 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-11-28T11:54:44.629 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-11-28T11:54:44.731 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-28T11:54:44.754 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-11-28T11:54:44.818 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-11-28T11:54:45.182 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-11-28T11:54:45.412 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-28T11:54:45.780 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-11-28T11:54:45.890 INFO:teuthology.orchestra.run.smithi184.stdout:Adding user postgres to group ssl-cert 2023-11-28T11:54:45.932 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-11-28T11:54:46.058 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-11-28T11:54:46.184 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-11-28T11:54:46.259 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-11-28T11:54:46.259 INFO:teuthology.orchestra.run.smithi184.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-28T11:54:46.646 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T11:54:46.646 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T11:54:46.741 INFO:teuthology.orchestra.run.smithi184.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-28T11:54:46.741 INFO:teuthology.orchestra.run.smithi184.stdout:Removing obsolete dictionary files: 2023-11-28T11:54:47.314 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-28T11:54:47.637 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-28T11:54:48.740 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-28T11:54:48.899 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-11-28T11:54:49.025 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-11-28T11:54:49.151 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-11-28T11:54:49.843 INFO:teuthology.orchestra.run.smithi039.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-28T11:54:49.959 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-11-28T11:54:50.085 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-11-28T11:54:50.236 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-11-28T11:54:50.422 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-11-28T11:54:50.857 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up dump (0.4b46-6) ... 2023-11-28T11:54:50.963 INFO:teuthology.orchestra.run.smithi184.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-28T11:54:51.067 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-11-28T11:54:51.193 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-11-28T11:54:51.319 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-11-28T11:54:51.445 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-11-28T11:54:51.573 INFO:teuthology.orchestra.run.smithi039.stdout:Adding user postgres to group ssl-cert 2023-11-28T11:54:51.663 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-11-28T11:54:51.798 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-28T11:54:52.014 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:54:52.014 INFO:teuthology.orchestra.run.smithi039.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-28T11:54:52.302 INFO:teuthology.orchestra.run.smithi184.stdout:Creating new PostgreSQL cluster 12/main ... 2023-11-28T11:54:52.335 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-11-28T11:54:52.432 INFO:teuthology.orchestra.run.smithi184.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-28T11:54:52.432 INFO:teuthology.orchestra.run.smithi184.stdout:This user must also own the server process. 2023-11-28T11:54:52.432 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-11-28T11:54:52.432 INFO:teuthology.orchestra.run.smithi184.stdout:The database cluster will be initialized with locale "en_US". 2023-11-28T11:54:52.432 INFO:teuthology.orchestra.run.smithi184.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-28T11:54:52.432 INFO:teuthology.orchestra.run.smithi184.stdout:The default text search configuration will be set to "english". 2023-11-28T11:54:52.433 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-11-28T11:54:52.433 INFO:teuthology.orchestra.run.smithi184.stdout:Data page checksums are disabled. 2023-11-28T11:54:52.433 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-11-28T11:54:52.433 INFO:teuthology.orchestra.run.smithi184.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-11-28T11:54:52.436 INFO:teuthology.orchestra.run.smithi184.stdout:creating subdirectories ... ok 2023-11-28T11:54:52.436 INFO:teuthology.orchestra.run.smithi184.stdout:selecting dynamic shared memory implementation ... posix 2023-11-28T11:54:52.471 INFO:teuthology.orchestra.run.smithi184.stdout:selecting default max_connections ... 100 2023-11-28T11:54:52.520 INFO:teuthology.orchestra.run.smithi039.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-28T11:54:52.520 INFO:teuthology.orchestra.run.smithi039.stdout:Removing obsolete dictionary files: 2023-11-28T11:54:52.522 INFO:teuthology.orchestra.run.smithi184.stdout:selecting default shared_buffers ... 128MB 2023-11-28T11:54:52.545 INFO:teuthology.orchestra.run.smithi184.stdout:selecting default time zone ... Etc/UTC 2023-11-28T11:54:52.546 INFO:teuthology.orchestra.run.smithi184.stdout:creating configuration files ... ok 2023-11-28T11:54:52.732 INFO:teuthology.orchestra.run.smithi184.stdout:running bootstrap script ... ok 2023-11-28T11:54:53.092 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-28T11:54:53.351 INFO:teuthology.orchestra.run.smithi184.stdout:performing post-bootstrap initialization ... ok 2023-11-28T11:54:53.897 INFO:teuthology.orchestra.run.smithi184.stdout:syncing data to disk ... ok 2023-11-28T11:54:53.897 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-11-28T11:54:53.897 INFO:teuthology.orchestra.run.smithi184.stdout:Success. You can now start the database server using: 2023-11-28T11:54:53.897 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-11-28T11:54:53.897 INFO:teuthology.orchestra.run.smithi184.stdout: pg_ctlcluster 12 main start 2023-11-28T11:54:53.897 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-11-28T11:54:54.470 INFO:teuthology.orchestra.run.smithi184.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-11-28T11:54:54.470 INFO:teuthology.orchestra.run.smithi184.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-11-28T11:54:54.547 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-28T11:54:54.673 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-11-28T11:54:54.680 INFO:teuthology.orchestra.run.smithi184.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-28T11:54:54.824 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-11-28T11:54:54.951 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-11-28T11:54:56.225 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-11-28T11:54:56.633 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up dump (0.4b46-6) ... 2023-11-28T11:54:56.741 INFO:teuthology.orchestra.run.smithi039.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-28T11:54:56.809 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-11-28T11:54:56.969 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-11-28T11:54:57.103 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-11-28T11:54:57.321 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-11-28T11:54:57.505 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-11-28T11:54:57.665 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-28T11:54:58.186 INFO:teuthology.orchestra.run.smithi039.stdout:Creating new PostgreSQL cluster 12/main ... 2023-11-28T11:54:58.219 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-11-28T11:54:58.300 INFO:teuthology.orchestra.run.smithi039.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-28T11:54:58.300 INFO:teuthology.orchestra.run.smithi039.stdout:This user must also own the server process. 2023-11-28T11:54:58.300 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:54:58.300 INFO:teuthology.orchestra.run.smithi039.stdout:The database cluster will be initialized with locale "en_US". 2023-11-28T11:54:58.300 INFO:teuthology.orchestra.run.smithi039.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-28T11:54:58.300 INFO:teuthology.orchestra.run.smithi039.stdout:The default text search configuration will be set to "english". 2023-11-28T11:54:58.300 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:54:58.301 INFO:teuthology.orchestra.run.smithi039.stdout:Data page checksums are disabled. 2023-11-28T11:54:58.301 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:54:58.301 INFO:teuthology.orchestra.run.smithi039.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-11-28T11:54:58.304 INFO:teuthology.orchestra.run.smithi039.stdout:creating subdirectories ... ok 2023-11-28T11:54:58.304 INFO:teuthology.orchestra.run.smithi039.stdout:selecting dynamic shared memory implementation ... posix 2023-11-28T11:54:58.342 INFO:teuthology.orchestra.run.smithi039.stdout:selecting default max_connections ... 100 2023-11-28T11:54:58.372 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-28T11:54:58.387 INFO:teuthology.orchestra.run.smithi039.stdout:selecting default shared_buffers ... 128MB 2023-11-28T11:54:58.411 INFO:teuthology.orchestra.run.smithi039.stdout:selecting default time zone ... Etc/UTC 2023-11-28T11:54:58.411 INFO:teuthology.orchestra.run.smithi039.stdout:creating configuration files ... ok 2023-11-28T11:54:58.498 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-11-28T11:54:58.602 INFO:teuthology.orchestra.run.smithi039.stdout:running bootstrap script ... ok 2023-11-28T11:54:58.624 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-11-28T11:54:58.809 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-28T11:54:58.935 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-11-28T11:54:59.061 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-11-28T11:54:59.260 INFO:teuthology.orchestra.run.smithi039.stdout:performing post-bootstrap initialization ... ok 2023-11-28T11:54:59.804 INFO:teuthology.orchestra.run.smithi039.stdout:syncing data to disk ... ok 2023-11-28T11:54:59.804 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:54:59.804 INFO:teuthology.orchestra.run.smithi039.stdout:Success. You can now start the database server using: 2023-11-28T11:54:59.805 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:54:59.805 INFO:teuthology.orchestra.run.smithi039.stdout: pg_ctlcluster 12 main start 2023-11-28T11:54:59.805 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:55:00.231 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-11-28T11:55:00.231 INFO:teuthology.orchestra.run.smithi184.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-28T11:55:00.231 INFO:teuthology.orchestra.run.smithi184.stdout:which means they are currently configured by ifupdown: 2023-11-28T11:55:00.231 INFO:teuthology.orchestra.run.smithi184.stdout:- enp3s0f1 2023-11-28T11:55:00.231 INFO:teuthology.orchestra.run.smithi184.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-28T11:55:00.231 INFO:teuthology.orchestra.run.smithi184.stdout:remove their configuration from /etc/network/interfaces. 2023-11-28T11:55:00.231 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-11-28T11:55:00.372 INFO:teuthology.orchestra.run.smithi039.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-11-28T11:55:00.373 INFO:teuthology.orchestra.run.smithi039.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-11-28T11:55:00.468 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-28T11:55:00.607 INFO:teuthology.orchestra.run.smithi039.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-28T11:55:01.027 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-28T11:55:01.952 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-28T11:55:02.889 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-11-28T11:55:03.023 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-11-28T11:55:03.225 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-28T11:55:03.350 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-11-28T11:55:03.468 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-11-28T11:55:03.636 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-11-28T11:55:03.762 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-11-28T11:55:03.888 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-11-28T11:55:04.245 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T11:55:04.245 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T11:55:04.322 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-28T11:55:04.448 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-11-28T11:55:04.608 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-11-28T11:55:04.776 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-28T11:55:04.935 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-11-28T11:55:05.061 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-11-28T11:55:05.282 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-11-28T11:55:05.417 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-28T11:55:05.551 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-11-28T11:55:05.712 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-11-28T11:55:06.229 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-11-28T11:55:06.294 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:55:06.294 INFO:teuthology.orchestra.run.smithi039.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-28T11:55:06.294 INFO:teuthology.orchestra.run.smithi039.stdout:which means they are currently configured by ifupdown: 2023-11-28T11:55:06.294 INFO:teuthology.orchestra.run.smithi039.stdout:- ens1f0 2023-11-28T11:55:06.294 INFO:teuthology.orchestra.run.smithi039.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-28T11:55:06.294 INFO:teuthology.orchestra.run.smithi039.stdout:remove their configuration from /etc/network/interfaces. 2023-11-28T11:55:06.295 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:55:06.543 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-28T11:55:07.116 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-28T11:55:08.105 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-28T11:55:09.072 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-11-28T11:55:09.248 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-11-28T11:55:09.416 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-28T11:55:09.592 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-11-28T11:55:09.710 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-11-28T11:55:09.869 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-11-28T11:55:09.995 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-11-28T11:55:10.121 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-11-28T11:55:10.475 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T11:55:10.475 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T11:55:11.482 INFO:teuthology.orchestra.run.smithi039.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-11-28T11:55:11.633 INFO:teuthology.orchestra.run.smithi039.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-28T11:55:11.767 INFO:teuthology.orchestra.run.smithi039.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-11-28T11:55:11.951 INFO:teuthology.orchestra.run.smithi039.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-11-28T11:55:12.478 INFO:teuthology.orchestra.run.smithi039.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-11-28T11:55:20.041 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-11-28T11:55:20.183 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-11-28T11:55:21.401 INFO:teuthology.orchestra.run.smithi184.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T11:55:21.407 DEBUG:teuthology.parallel:result is None 2023-11-28T11:55:26.298 INFO:teuthology.orchestra.run.smithi039.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-11-28T11:55:26.440 INFO:teuthology.orchestra.run.smithi039.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-11-28T11:55:27.684 INFO:teuthology.orchestra.run.smithi039.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T11:55:27.690 DEBUG:teuthology.parallel:result is None 2023-11-28T11:55:27.691 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2f5f6028b893ad41357cd06e827373f0fe2a1232 2023-11-28T11:55:27.832 DEBUG:teuthology.orchestra.run.smithi039:> dpkg-query -W -f '${Version}' ceph 2023-11-28T11:55:27.871 INFO:teuthology.orchestra.run.smithi039.stdout:18.0.0-2697-g2f5f6028-1focal 2023-11-28T11:55:27.872 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-2697-g2f5f6028-1focal 2023-11-28T11:55:27.872 INFO:teuthology.task.install:The correct ceph version 18.0.0-2697-g2f5f6028-1focal is installed. 2023-11-28T11:55:27.872 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2f5f6028b893ad41357cd06e827373f0fe2a1232 2023-11-28T11:55:28.007 DEBUG:teuthology.orchestra.run.smithi184:> dpkg-query -W -f '${Version}' ceph 2023-11-28T11:55:28.048 INFO:teuthology.orchestra.run.smithi184.stdout:18.0.0-2697-g2f5f6028-1focal 2023-11-28T11:55:28.048 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-2697-g2f5f6028-1focal 2023-11-28T11:55:28.048 INFO:teuthology.task.install:The correct ceph version 18.0.0-2697-g2f5f6028-1focal is installed. 2023-11-28T11:55:28.049 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-28T11:55:28.049 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:55:28.049 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-28T11:55:28.084 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:55:28.084 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-28T11:55:28.127 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-28T11:55:28.127 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:55:28.127 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/daemon-helper 2023-11-28T11:55:28.164 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-28T11:55:28.242 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:55:28.243 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/daemon-helper 2023-11-28T11:55:28.281 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-28T11:55:28.359 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-28T11:55:28.359 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:55:28.359 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-28T11:55:28.394 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-28T11:55:28.469 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:55:28.469 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-28T11:55:28.506 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-28T11:55:28.580 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-28T11:55:28.580 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:55:28.580 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/stdin-killer 2023-11-28T11:55:28.621 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-28T11:55:28.702 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:55:28.702 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/stdin-killer 2023-11-28T11:55:28.739 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-28T11:55:28.812 INFO:teuthology.run_tasks:Running task ceph... 2023-11-28T11:55:28.878 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-28T11:55:28.878 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 777 /var/log/ceph 2023-11-28T11:55:28.886 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 777 /var/log/ceph 2023-11-28T11:55:28.922 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-28T11:55:28.922 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-28T11:55:28.962 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-28T11:55:28.995 INFO:tasks.ceph:Creating extra log directories... 2023-11-28T11:55:28.995 DEBUG:teuthology.orchestra.run.smithi039:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-28T11:55:29.038 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-28T11:55:29.082 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-28T11:55:29.083 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-28T11:55:29.083 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-28T11:55:29.083 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:55:29.083 DEBUG:teuthology.orchestra.run.smithi039:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-28T11:55:29.140 DEBUG:teuthology.orchestra.run.smithi039:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-28T11:55:29.274 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:55:29.274 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-28T11:55:29.294 DEBUG:teuthology.orchestra.run.smithi184:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-28T11:55:29.429 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-28T11:55:29.429 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-28T11:55:29.429 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469963', 'branch': 'wip-neesingh-testing-231123', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub}', 'email': 'neesingh@redhat.com', 'first_in_suite': False, 'job_id': '7469963', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-neesingh-testing-231123'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'sha1': '2f5f6028b893ad41357cd06e827373f0fe2a1232'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '2f5f6028b893ad41357cd06e827373f0fe2a1232'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'issue_54557', 'sha1': '17c45c858c4cb3105f973d12c6c74f8d5037aa89'}}, 'owner': 'scheduled_neesingh@teuthology', 'priority': 10, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 4140, 'sha1': '2f5f6028b893ad41357cd06e827373f0fe2a1232', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'issue_54557', 'suite_path': '/home/teuthworker/src/github.com_neesingh-rh_ceph_17c45c858c4cb3105f973d12c6c74f8d5037aa89/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/neesingh-rh/ceph', 'suite_sha1': '17c45c858c4cb3105f973d12c6c74f8d5037aa89', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi039.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi184.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f5f6028b893ad41357cd06e827373f0fe2a1232'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_forward_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '5ae09a5cc7064ca2bf994df19f3006b79794789a', 'timestamp': '2023-11-28_11:27:19', 'tube': 'smithi', 'user': 'neesingh', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-28T11:55:29.430 DEBUG:teuthology.orchestra.run.smithi039:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-28T11:55:29.437 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-28T11:55:29.457 DEBUG:teuthology.orchestra.run.smithi039:> sudo install -d -m0777 -- /var/run/ceph 2023-11-28T11:55:29.504 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m0777 -- /var/run/ceph 2023-11-28T11:55:29.542 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:55:29.543 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/scratch_devs of=/dev/stdout 2023-11-28T11:55:29.593 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-28T11:55:29.593 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_1 2023-11-28T11:55:29.653 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-28T11:55:29.654 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T11:55:29.654 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 496 Links: 1 2023-11-28T11:55:29.654 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T11:55:29.654 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2023-11-28 11:49:41.115507633 +0000 2023-11-28T11:55:29.654 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2023-11-28 11:49:40.635518804 +0000 2023-11-28T11:55:29.654 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2023-11-28 11:49:40.635518804 +0000 2023-11-28T11:55:29.654 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: - 2023-11-28T11:55:29.654 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-28T11:55:29.728 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2023-11-28T11:55:29.728 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2023-11-28T11:55:29.729 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000685246 s, 747 kB/s 2023-11-28T11:55:29.732 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-28T11:55:29.804 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_2 2023-11-28T11:55:29.871 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-28T11:55:29.871 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T11:55:29.871 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 501 Links: 1 2023-11-28T11:55:29.871 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T11:55:29.871 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2023-11-28 11:49:41.859490320 +0000 2023-11-28T11:55:29.872 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2023-11-28 11:49:41.395501117 +0000 2023-11-28T11:55:29.872 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2023-11-28 11:49:41.395501117 +0000 2023-11-28T11:55:29.872 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: - 2023-11-28T11:55:29.872 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-28T11:55:29.946 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2023-11-28T11:55:29.946 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2023-11-28T11:55:29.946 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000595355 s, 860 kB/s 2023-11-28T11:55:29.948 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-28T11:55:30.015 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_3 2023-11-28T11:55:30.074 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-28T11:55:30.075 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T11:55:30.075 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 506 Links: 1 2023-11-28T11:55:30.075 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T11:55:30.075 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2023-11-28 11:49:42.651471889 +0000 2023-11-28T11:55:30.075 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2023-11-28 11:49:42.187482686 +0000 2023-11-28T11:55:30.075 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2023-11-28 11:49:42.187482686 +0000 2023-11-28T11:55:30.075 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: - 2023-11-28T11:55:30.075 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-28T11:55:30.147 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2023-11-28T11:55:30.148 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2023-11-28T11:55:30.149 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.00064739 s, 791 kB/s 2023-11-28T11:55:30.150 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-28T11:55:30.216 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_4 2023-11-28T11:55:30.279 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-28T11:55:30.279 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T11:55:30.279 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 515 Links: 1 2023-11-28T11:55:30.279 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T11:55:30.279 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2023-11-28 11:49:42.931465374 +0000 2023-11-28T11:55:30.279 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2023-11-28 11:49:42.927465467 +0000 2023-11-28T11:55:30.279 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2023-11-28 11:49:42.927465467 +0000 2023-11-28T11:55:30.280 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: - 2023-11-28T11:55:30.280 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-28T11:55:30.355 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2023-11-28T11:55:30.356 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2023-11-28T11:55:30.356 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000736842 s, 695 kB/s 2023-11-28T11:55:30.361 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-28T11:55:30.429 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T11:55:30.429 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:55:30.429 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/scratch_devs of=/dev/stdout 2023-11-28T11:55:30.450 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-28T11:55:30.450 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_1 2023-11-28T11:55:30.514 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-28T11:55:30.514 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T11:55:30.515 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 497 Links: 1 2023-11-28T11:55:30.515 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T11:55:30.515 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2023-11-28 11:49:38.331237284 +0000 2023-11-28T11:55:30.515 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2023-11-28 11:49:37.867247203 +0000 2023-11-28T11:55:30.515 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2023-11-28 11:49:37.867247203 +0000 2023-11-28T11:55:30.515 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2023-11-28T11:55:30.516 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-28T11:55:30.602 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2023-11-28T11:55:30.602 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2023-11-28T11:55:30.602 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000555554 s, 922 kB/s 2023-11-28T11:55:30.604 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-28T11:55:30.675 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_2 2023-11-28T11:55:30.734 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-28T11:55:30.734 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T11:55:30.734 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 505 Links: 1 2023-11-28T11:55:30.734 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T11:55:30.734 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2023-11-28 11:49:39.083221206 +0000 2023-11-28T11:55:30.734 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2023-11-28 11:49:38.639230699 +0000 2023-11-28T11:55:30.734 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2023-11-28 11:49:38.639230699 +0000 2023-11-28T11:55:30.734 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2023-11-28T11:55:30.735 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-28T11:55:30.812 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2023-11-28T11:55:30.813 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2023-11-28T11:55:30.813 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.00071551 s, 716 kB/s 2023-11-28T11:55:30.815 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-28T11:55:30.886 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_3 2023-11-28T11:55:30.950 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-28T11:55:30.950 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T11:55:30.951 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 508 Links: 1 2023-11-28T11:55:30.951 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T11:55:30.951 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2023-11-28 11:49:39.879204184 +0000 2023-11-28T11:55:30.951 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2023-11-28 11:49:39.375214962 +0000 2023-11-28T11:55:30.951 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2023-11-28 11:49:39.375214962 +0000 2023-11-28T11:55:30.952 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2023-11-28T11:55:30.952 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-28T11:55:31.031 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2023-11-28T11:55:31.031 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2023-11-28T11:55:31.031 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000684793 s, 748 kB/s 2023-11-28T11:55:31.033 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-28T11:55:31.102 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_4 2023-11-28T11:55:31.167 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-28T11:55:31.167 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T11:55:31.167 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 517 Links: 1 2023-11-28T11:55:31.167 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T11:55:31.168 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2023-11-28 11:49:40.683186987 +0000 2023-11-28T11:55:31.168 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2023-11-28 11:49:40.195197425 +0000 2023-11-28T11:55:31.168 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2023-11-28 11:49:40.195197425 +0000 2023-11-28T11:55:31.168 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2023-11-28T11:55:31.168 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-28T11:55:31.244 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2023-11-28T11:55:31.244 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2023-11-28T11:55:31.244 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.0005524 s, 927 kB/s 2023-11-28T11:55:31.246 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-28T11:55:31.311 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T11:55:31.312 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi039.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi184.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-28T11:55:31.312 INFO:tasks.ceph:Generating config... 2023-11-28T11:55:31.313 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-28T11:55:31.313 INFO:tasks.ceph:[client] debug client = 20 2023-11-28T11:55:31.313 INFO:tasks.ceph:[client] debug ms = 1 2023-11-28T11:55:31.313 INFO:tasks.ceph:[client] pid file = 2023-11-28T11:55:31.313 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-28T11:55:31.313 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-28T11:55:31.313 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-11-28T11:55:31.313 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-28T11:55:31.314 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-28T11:55:31.314 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-28T11:55:31.314 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-28T11:55:31.314 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-28T11:55:31.314 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-28T11:55:31.314 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-28T11:55:31.314 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-28T11:55:31.314 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-28T11:55:31.314 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-28T11:55:31.314 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-28T11:55:31.314 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-28T11:55:31.314 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-28T11:55:31.314 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-28T11:55:31.315 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-28T11:55:31.315 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-28T11:55:31.315 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-28T11:55:31.315 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-28T11:55:31.315 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-11-28T11:55:31.315 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-11-28T11:55:31.315 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-28T11:55:31.315 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-28T11:55:31.315 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-11-28T11:55:31.315 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-28T11:55:31.315 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-28T11:55:31.315 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-28T11:55:31.315 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-28T11:55:31.316 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-28T11:55:31.316 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-28T11:55:31.316 INFO:tasks.ceph:Setting up mon.a... 2023-11-28T11:55:31.316 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-28T11:55:31.392 INFO:teuthology.orchestra.run.smithi039.stdout:creating /etc/ceph/ceph.keyring 2023-11-28T11:55:31.419 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-28T11:55:31.501 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-28T11:55:31.534 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.39'), ('mon.b', '172.21.15.184'), ('mon.c', '[v2:172.21.15.184:3301,v1:172.21.15.184:6790]')] 2023-11-28T11:55:31.535 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.39,172.21.15.184,[v2:172.21.15.184:3301,v1:172.21.15.184:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-28T11:55:31.536 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:55:31.536 DEBUG:teuthology.orchestra.run.smithi039:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-28T11:55:31.593 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.39 --add b 172.21.15.184 --addv c '[v2:172.21.15.184:3301,v1:172.21.15.184:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:55:31.704 INFO:teuthology.orchestra.run.smithi039.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:55:31.704 INFO:teuthology.orchestra.run.smithi039.stdout:monmaptool: generated fsid 67ce95b1-cd7e-4478-b863-c714ef275520 2023-11-28T11:55:31.704 INFO:teuthology.orchestra.run.smithi039.stdout:setting min_mon_release = pacific 2023-11-28T11:55:31.705 INFO:teuthology.orchestra.run.smithi039.stdout:epoch 0 2023-11-28T11:55:31.705 INFO:teuthology.orchestra.run.smithi039.stdout:fsid 67ce95b1-cd7e-4478-b863-c714ef275520 2023-11-28T11:55:31.705 INFO:teuthology.orchestra.run.smithi039.stdout:last_changed 2023-11-28T11:55:31.704043+0000 2023-11-28T11:55:31.705 INFO:teuthology.orchestra.run.smithi039.stdout:created 2023-11-28T11:55:31.704043+0000 2023-11-28T11:55:31.705 INFO:teuthology.orchestra.run.smithi039.stdout:min_mon_release 16 (pacific) 2023-11-28T11:55:31.705 INFO:teuthology.orchestra.run.smithi039.stdout:election_strategy: 1 2023-11-28T11:55:31.705 INFO:teuthology.orchestra.run.smithi039.stdout:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2023-11-28T11:55:31.705 INFO:teuthology.orchestra.run.smithi039.stdout:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2023-11-28T11:55:31.705 INFO:teuthology.orchestra.run.smithi039.stdout:2: [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] mon.c 2023-11-28T11:55:31.705 INFO:teuthology.orchestra.run.smithi039.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-28T11:55:31.708 DEBUG:teuthology.orchestra.run.smithi039:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-28T11:55:31.727 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 67ce95b1-cd7e-4478-b863-c714ef275520... 2023-11-28T11:55:31.727 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-28T11:55:31.781 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-28T11:55:31.854 INFO:teuthology.orchestra.run.smithi184.stdout:[global] 2023-11-28T11:55:31.855 INFO:teuthology.orchestra.run.smithi184.stdout: chdir = "" 2023-11-28T11:55:31.855 INFO:teuthology.orchestra.run.smithi184.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-28T11:55:31.855 INFO:teuthology.orchestra.run.smithi184.stdout: auth supported = cephx 2023-11-28T11:55:31.855 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-11-28T11:55:31.855 INFO:teuthology.orchestra.run.smithi184.stdout: filestore xattr use omap = true 2023-11-28T11:55:31.855 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-11-28T11:55:31.855 INFO:teuthology.orchestra.run.smithi184.stdout: mon clock drift allowed = 1.000 2023-11-28T11:55:31.855 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-11-28T11:55:31.855 INFO:teuthology.orchestra.run.smithi184.stdout: osd crush chooseleaf type = 0 2023-11-28T11:55:31.855 INFO:teuthology.orchestra.run.smithi184.stdout: auth debug = true 2023-11-28T11:55:31.856 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-11-28T11:55:31.856 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on old message = true 2023-11-28T11:55:31.856 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on bug = true 2023-11-28T11:55:31.856 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-11-28T11:55:31.856 INFO:teuthology.orchestra.run.smithi184.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-28T11:55:31.856 INFO:teuthology.orchestra.run.smithi184.stdout: mon pg warn max object skew = 0 2023-11-28T11:55:31.856 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-11-28T11:55:31.856 INFO:teuthology.orchestra.run.smithi184.stdout: # disable pg_autoscaler by default for new pools 2023-11-28T11:55:31.856 INFO:teuthology.orchestra.run.smithi184.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-28T11:55:31.856 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-11-28T11:55:31.857 INFO:teuthology.orchestra.run.smithi184.stdout: osd pool default size = 2 2023-11-28T11:55:31.857 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-11-28T11:55:31.857 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd allow primary affinity = true 2023-11-28T11:55:31.857 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd allow pg remap = true 2023-11-28T11:55:31.857 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on legacy crush tunables = false 2023-11-28T11:55:31.857 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on crush straw calc version zero = false 2023-11-28T11:55:31.857 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on no sortbitwise = false 2023-11-28T11:55:31.857 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on osd down out interval zero = false 2023-11-28T11:55:31.857 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on too few osds = false 2023-11-28T11:55:31.857 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-28T11:55:31.858 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-28T11:55:31.858 INFO:teuthology.orchestra.run.smithi184.stdout: mon_allow_pool_size_one = true 2023-11-28T11:55:31.858 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-11-28T11:55:31.858 INFO:teuthology.orchestra.run.smithi184.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-28T11:55:31.858 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-11-28T11:55:31.858 INFO:teuthology.orchestra.run.smithi184.stdout: osd default data pool replay window = 5 2023-11-28T11:55:31.858 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-11-28T11:55:31.858 INFO:teuthology.orchestra.run.smithi184.stdout: mon allow pool delete = true 2023-11-28T11:55:31.858 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-11-28T11:55:31.858 INFO:teuthology.orchestra.run.smithi184.stdout: mon cluster log file level = debug 2023-11-28T11:55:31.859 INFO:teuthology.orchestra.run.smithi184.stdout: debug asserts on shutdown = true 2023-11-28T11:55:31.859 INFO:teuthology.orchestra.run.smithi184.stdout: mon health detail to clog = false 2023-11-28T11:55:31.859 INFO:teuthology.orchestra.run.smithi184.stdout: mon host = "172.21.15.39,172.21.15.184,[v2:172.21.15.184:3301,v1:172.21.15.184:6790]" 2023-11-28T11:55:31.859 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on skipped message = False 2023-11-28T11:55:31.859 INFO:teuthology.orchestra.run.smithi184.stdout: fsid = 67ce95b1-cd7e-4478-b863-c714ef275520 2023-11-28T11:55:31.859 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-11-28T11:55:31.859 INFO:teuthology.orchestra.run.smithi184.stdout:[osd] 2023-11-28T11:55:31.859 INFO:teuthology.orchestra.run.smithi184.stdout: osd journal size = 100 2023-11-28T11:55:31.859 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-11-28T11:55:31.859 INFO:teuthology.orchestra.run.smithi184.stdout: osd scrub load threshold = 5.0 2023-11-28T11:55:31.859 INFO:teuthology.orchestra.run.smithi184.stdout: osd scrub max interval = 600 2023-11-28T11:55:31.860 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-11-28T11:55:31.860 INFO:teuthology.orchestra.run.smithi184.stdout: osd recover clone overlap = true 2023-11-28T11:55:31.860 INFO:teuthology.orchestra.run.smithi184.stdout: osd recovery max chunk = 1048576 2023-11-28T11:55:31.860 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-11-28T11:55:31.860 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug shutdown = true 2023-11-28T11:55:31.860 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug op order = true 2023-11-28T11:55:31.860 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug verify stray on activate = true 2023-11-28T11:55:31.860 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-11-28T11:55:31.860 INFO:teuthology.orchestra.run.smithi184.stdout: osd open classes on start = true 2023-11-28T11:55:31.861 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug pg log writeout = true 2023-11-28T11:55:31.861 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-11-28T11:55:31.861 INFO:teuthology.orchestra.run.smithi184.stdout: osd deep scrub update digest min age = 30 2023-11-28T11:55:31.861 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-11-28T11:55:31.861 INFO:teuthology.orchestra.run.smithi184.stdout: osd map max advance = 10 2023-11-28T11:55:31.861 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-11-28T11:55:31.861 INFO:teuthology.orchestra.run.smithi184.stdout: journal zero on create = true 2023-11-28T11:55:31.861 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-11-28T11:55:31.861 INFO:teuthology.orchestra.run.smithi184.stdout: filestore ondisk finisher threads = 3 2023-11-28T11:55:31.861 INFO:teuthology.orchestra.run.smithi184.stdout: filestore apply finisher threads = 3 2023-11-28T11:55:31.861 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-11-28T11:55:31.862 INFO:teuthology.orchestra.run.smithi184.stdout: bdev debug aio = true 2023-11-28T11:55:31.862 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug misdirected ops = true 2023-11-28T11:55:31.862 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore block size = 96636764160 2023-11-28T11:55:31.862 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore fsck on mount = True 2023-11-28T11:55:31.862 INFO:teuthology.orchestra.run.smithi184.stdout: debug bluefs = 20 2023-11-28T11:55:31.862 INFO:teuthology.orchestra.run.smithi184.stdout: debug bluestore = 20 2023-11-28T11:55:31.862 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-11-28T11:55:31.862 INFO:teuthology.orchestra.run.smithi184.stdout: debug osd = 20 2023-11-28T11:55:31.862 INFO:teuthology.orchestra.run.smithi184.stdout: debug rocksdb = 10 2023-11-28T11:55:31.862 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd backfillfull_ratio = 0.85 2023-11-28T11:55:31.863 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd full ratio = 0.9 2023-11-28T11:55:31.863 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd nearfull ratio = 0.8 2023-11-28T11:55:31.863 INFO:teuthology.orchestra.run.smithi184.stdout: osd failsafe full ratio = 0.95 2023-11-28T11:55:31.863 INFO:teuthology.orchestra.run.smithi184.stdout: osd objectstore = bluestore 2023-11-28T11:55:31.863 INFO:teuthology.orchestra.run.smithi184.stdout: osd op complaint time = 180 2023-11-28T11:55:31.863 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-11-28T11:55:31.863 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr] 2023-11-28T11:55:31.863 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-11-28T11:55:31.863 INFO:teuthology.orchestra.run.smithi184.stdout: debug mgr = 20 2023-11-28T11:55:31.863 INFO:teuthology.orchestra.run.smithi184.stdout: debug mon = 20 2023-11-28T11:55:31.864 INFO:teuthology.orchestra.run.smithi184.stdout: debug auth = 20 2023-11-28T11:55:31.864 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min pgs per osd = 4 2023-11-28T11:55:31.864 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min bytes per osd = 10 2023-11-28T11:55:31.864 INFO:teuthology.orchestra.run.smithi184.stdout: mgr/telemetry/nag = false 2023-11-28T11:55:31.864 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-11-28T11:55:31.864 INFO:teuthology.orchestra.run.smithi184.stdout:[mon] 2023-11-28T11:55:31.865 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-11-28T11:55:31.865 INFO:teuthology.orchestra.run.smithi184.stdout: debug mon = 20 2023-11-28T11:55:31.865 INFO:teuthology.orchestra.run.smithi184.stdout: debug paxos = 20 2023-11-28T11:55:31.865 INFO:teuthology.orchestra.run.smithi184.stdout: debug auth = 20 2023-11-28T11:55:31.865 INFO:teuthology.orchestra.run.smithi184.stdout: mon data avail warn = 5 2023-11-28T11:55:31.865 INFO:teuthology.orchestra.run.smithi184.stdout: mon mgr mkfs grace = 240 2023-11-28T11:55:31.866 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min pgs per osd = 4 2023-11-28T11:55:31.866 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd reporter subtree level = osd 2023-11-28T11:55:31.866 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd prime pg temp = true 2023-11-28T11:55:31.866 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min bytes per osd = 10 2023-11-28T11:55:31.866 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-11-28T11:55:31.866 INFO:teuthology.orchestra.run.smithi184.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-28T11:55:31.867 INFO:teuthology.orchestra.run.smithi184.stdout: auth mon ticket ttl = 660 # 11m 2023-11-28T11:55:31.867 INFO:teuthology.orchestra.run.smithi184.stdout: auth service ticket ttl = 240 # 4m 2023-11-28T11:55:31.867 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-11-28T11:55:31.867 INFO:teuthology.orchestra.run.smithi184.stdout: # don't complain about insecure global_id in the test suite 2023-11-28T11:55:31.867 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-28T11:55:31.868 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-28T11:55:31.868 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-11-28T11:55:31.868 INFO:teuthology.orchestra.run.smithi184.stdout: # 1m isn't quite enough 2023-11-28T11:55:31.868 INFO:teuthology.orchestra.run.smithi184.stdout: mon_down_mkfs_grace = 2m 2023-11-28T11:55:31.868 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-11-28T11:55:31.868 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_filestore_osds = false 2023-11-28T11:55:31.869 INFO:teuthology.orchestra.run.smithi184.stdout: mon op complaint time = 120 2023-11-28T11:55:31.869 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-11-28T11:55:31.869 INFO:teuthology.orchestra.run.smithi184.stdout:[client] 2023-11-28T11:55:31.869 INFO:teuthology.orchestra.run.smithi184.stdout: rgw cache enabled = true 2023-11-28T11:55:31.869 INFO:teuthology.orchestra.run.smithi184.stdout: rgw enable ops log = true 2023-11-28T11:55:31.869 INFO:teuthology.orchestra.run.smithi184.stdout: rgw enable usage log = true 2023-11-28T11:55:31.870 INFO:teuthology.orchestra.run.smithi184.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-28T11:55:31.870 INFO:teuthology.orchestra.run.smithi184.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-28T11:55:31.870 INFO:teuthology.orchestra.run.smithi184.stdout: client mount timeout = 600 2023-11-28T11:55:31.870 INFO:teuthology.orchestra.run.smithi184.stdout: debug client = 20 2023-11-28T11:55:31.870 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-11-28T11:55:31.870 INFO:teuthology.orchestra.run.smithi184.stdout: pid file = "" 2023-11-28T11:55:31.871 INFO:teuthology.orchestra.run.smithi184.stdout: rados mon op timeout = 900 2023-11-28T11:55:31.871 INFO:teuthology.orchestra.run.smithi184.stdout: rados osd op timeout = 900 2023-11-28T11:55:31.871 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.a] 2023-11-28T11:55:31.871 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.b] 2023-11-28T11:55:31.871 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.c] 2023-11-28T11:55:31.871 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.a] 2023-11-28T11:55:31.872 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.c] 2023-11-28T11:55:31.872 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.b] 2023-11-28T11:55:31.872 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.d] 2023-11-28T11:55:31.872 INFO:teuthology.orchestra.run.smithi184.stdout:[mds] 2023-11-28T11:55:31.872 INFO:teuthology.orchestra.run.smithi184.stdout: debug mds = 20 2023-11-28T11:55:31.873 INFO:teuthology.orchestra.run.smithi184.stdout: debug mds balancer = 20 2023-11-28T11:55:31.873 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-11-28T11:55:31.873 INFO:teuthology.orchestra.run.smithi184.stdout: mds debug frag = True 2023-11-28T11:55:31.873 INFO:teuthology.orchestra.run.smithi184.stdout: mds debug scatterstat = True 2023-11-28T11:55:31.873 INFO:teuthology.orchestra.run.smithi184.stdout: mds op complaint time = 180 2023-11-28T11:55:31.873 INFO:teuthology.orchestra.run.smithi184.stdout: mds verify scatter = True 2023-11-28T11:55:31.873 INFO:teuthology.orchestra.run.smithi184.stdout: osd op complaint time = 180 2023-11-28T11:55:31.874 INFO:teuthology.orchestra.run.smithi184.stdout: rados mon op timeout = 900 2023-11-28T11:55:31.874 INFO:teuthology.orchestra.run.smithi184.stdout: rados osd op timeout = 900 2023-11-28T11:55:31.874 INFO:teuthology.orchestra.run.smithi039.stdout:[global] 2023-11-28T11:55:31.874 INFO:teuthology.orchestra.run.smithi039.stdout: chdir = "" 2023-11-28T11:55:31.874 INFO:teuthology.orchestra.run.smithi039.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-28T11:55:31.875 INFO:teuthology.orchestra.run.smithi039.stdout: auth supported = cephx 2023-11-28T11:55:31.875 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:55:31.875 INFO:teuthology.orchestra.run.smithi039.stdout: filestore xattr use omap = true 2023-11-28T11:55:31.875 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:55:31.875 INFO:teuthology.orchestra.run.smithi039.stdout: mon clock drift allowed = 1.000 2023-11-28T11:55:31.875 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:55:31.875 INFO:teuthology.orchestra.run.smithi039.stdout: osd crush chooseleaf type = 0 2023-11-28T11:55:31.875 INFO:teuthology.orchestra.run.smithi039.stdout: auth debug = true 2023-11-28T11:55:31.875 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:55:31.875 INFO:teuthology.orchestra.run.smithi039.stdout: ms die on old message = true 2023-11-28T11:55:31.875 INFO:teuthology.orchestra.run.smithi039.stdout: ms die on bug = true 2023-11-28T11:55:31.875 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:55:31.876 INFO:teuthology.orchestra.run.smithi039.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-28T11:55:31.876 INFO:teuthology.orchestra.run.smithi039.stdout: mon pg warn max object skew = 0 2023-11-28T11:55:31.876 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:55:31.876 INFO:teuthology.orchestra.run.smithi039.stdout: # disable pg_autoscaler by default for new pools 2023-11-28T11:55:31.876 INFO:teuthology.orchestra.run.smithi039.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-28T11:55:31.876 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:55:31.876 INFO:teuthology.orchestra.run.smithi039.stdout: osd pool default size = 2 2023-11-28T11:55:31.876 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:55:31.877 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd allow primary affinity = true 2023-11-28T11:55:31.877 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd allow pg remap = true 2023-11-28T11:55:31.877 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on legacy crush tunables = false 2023-11-28T11:55:31.877 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on crush straw calc version zero = false 2023-11-28T11:55:31.877 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on no sortbitwise = false 2023-11-28T11:55:31.877 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on osd down out interval zero = false 2023-11-28T11:55:31.877 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on too few osds = false 2023-11-28T11:55:31.877 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-28T11:55:31.877 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-28T11:55:31.878 INFO:teuthology.orchestra.run.smithi039.stdout: mon_allow_pool_size_one = true 2023-11-28T11:55:31.878 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:55:31.878 INFO:teuthology.orchestra.run.smithi039.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-28T11:55:31.878 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:55:31.878 INFO:teuthology.orchestra.run.smithi039.stdout: osd default data pool replay window = 5 2023-11-28T11:55:31.878 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:55:31.878 INFO:teuthology.orchestra.run.smithi039.stdout: mon allow pool delete = true 2023-11-28T11:55:31.878 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:55:31.878 INFO:teuthology.orchestra.run.smithi039.stdout: mon cluster log file level = debug 2023-11-28T11:55:31.879 INFO:teuthology.orchestra.run.smithi039.stdout: debug asserts on shutdown = true 2023-11-28T11:55:31.879 INFO:teuthology.orchestra.run.smithi039.stdout: mon health detail to clog = false 2023-11-28T11:55:31.879 INFO:teuthology.orchestra.run.smithi039.stdout: mon host = "172.21.15.39,172.21.15.184,[v2:172.21.15.184:3301,v1:172.21.15.184:6790]" 2023-11-28T11:55:31.879 INFO:teuthology.orchestra.run.smithi039.stdout: ms die on skipped message = False 2023-11-28T11:55:31.879 INFO:teuthology.orchestra.run.smithi039.stdout: fsid = 67ce95b1-cd7e-4478-b863-c714ef275520 2023-11-28T11:55:31.879 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:55:31.879 INFO:teuthology.orchestra.run.smithi039.stdout:[osd] 2023-11-28T11:55:31.879 INFO:teuthology.orchestra.run.smithi039.stdout: osd journal size = 100 2023-11-28T11:55:31.879 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:55:31.879 INFO:teuthology.orchestra.run.smithi039.stdout: osd scrub load threshold = 5.0 2023-11-28T11:55:31.880 INFO:teuthology.orchestra.run.smithi039.stdout: osd scrub max interval = 600 2023-11-28T11:55:31.880 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:55:31.880 INFO:teuthology.orchestra.run.smithi039.stdout: osd recover clone overlap = true 2023-11-28T11:55:31.880 INFO:teuthology.orchestra.run.smithi039.stdout: osd recovery max chunk = 1048576 2023-11-28T11:55:31.880 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:55:31.880 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug shutdown = true 2023-11-28T11:55:31.880 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug op order = true 2023-11-28T11:55:31.880 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug verify stray on activate = true 2023-11-28T11:55:31.880 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:55:31.880 INFO:teuthology.orchestra.run.smithi039.stdout: osd open classes on start = true 2023-11-28T11:55:31.880 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug pg log writeout = true 2023-11-28T11:55:31.881 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:55:31.881 INFO:teuthology.orchestra.run.smithi039.stdout: osd deep scrub update digest min age = 30 2023-11-28T11:55:31.881 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:55:31.881 INFO:teuthology.orchestra.run.smithi039.stdout: osd map max advance = 10 2023-11-28T11:55:31.881 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:55:31.881 INFO:teuthology.orchestra.run.smithi039.stdout: journal zero on create = true 2023-11-28T11:55:31.881 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:55:31.881 INFO:teuthology.orchestra.run.smithi039.stdout: filestore ondisk finisher threads = 3 2023-11-28T11:55:31.881 INFO:teuthology.orchestra.run.smithi039.stdout: filestore apply finisher threads = 3 2023-11-28T11:55:31.881 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:55:31.881 INFO:teuthology.orchestra.run.smithi039.stdout: bdev debug aio = true 2023-11-28T11:55:31.881 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug misdirected ops = true 2023-11-28T11:55:31.882 INFO:teuthology.orchestra.run.smithi039.stdout: bluestore block size = 96636764160 2023-11-28T11:55:31.882 INFO:teuthology.orchestra.run.smithi039.stdout: bluestore fsck on mount = True 2023-11-28T11:55:31.882 INFO:teuthology.orchestra.run.smithi039.stdout: debug bluefs = 20 2023-11-28T11:55:31.882 INFO:teuthology.orchestra.run.smithi039.stdout: debug bluestore = 20 2023-11-28T11:55:31.882 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2023-11-28T11:55:31.882 INFO:teuthology.orchestra.run.smithi039.stdout: debug osd = 20 2023-11-28T11:55:31.882 INFO:teuthology.orchestra.run.smithi039.stdout: debug rocksdb = 10 2023-11-28T11:55:31.882 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd backfillfull_ratio = 0.85 2023-11-28T11:55:31.882 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd full ratio = 0.9 2023-11-28T11:55:31.883 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd nearfull ratio = 0.8 2023-11-28T11:55:31.883 INFO:teuthology.orchestra.run.smithi039.stdout: osd failsafe full ratio = 0.95 2023-11-28T11:55:31.883 INFO:teuthology.orchestra.run.smithi039.stdout: osd objectstore = bluestore 2023-11-28T11:55:31.883 INFO:teuthology.orchestra.run.smithi039.stdout: osd op complaint time = 180 2023-11-28T11:55:31.883 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:55:31.883 INFO:teuthology.orchestra.run.smithi039.stdout:[mgr] 2023-11-28T11:55:31.883 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2023-11-28T11:55:31.883 INFO:teuthology.orchestra.run.smithi039.stdout: debug mgr = 20 2023-11-28T11:55:31.883 INFO:teuthology.orchestra.run.smithi039.stdout: debug mon = 20 2023-11-28T11:55:31.883 INFO:teuthology.orchestra.run.smithi039.stdout: debug auth = 20 2023-11-28T11:55:31.883 INFO:teuthology.orchestra.run.smithi039.stdout: mon reweight min pgs per osd = 4 2023-11-28T11:55:31.884 INFO:teuthology.orchestra.run.smithi039.stdout: mon reweight min bytes per osd = 10 2023-11-28T11:55:31.884 INFO:teuthology.orchestra.run.smithi039.stdout: mgr/telemetry/nag = false 2023-11-28T11:55:31.884 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:55:31.884 INFO:teuthology.orchestra.run.smithi039.stdout:[mon] 2023-11-28T11:55:31.884 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2023-11-28T11:55:31.884 INFO:teuthology.orchestra.run.smithi039.stdout: debug mon = 20 2023-11-28T11:55:31.884 INFO:teuthology.orchestra.run.smithi039.stdout: debug paxos = 20 2023-11-28T11:55:31.884 INFO:teuthology.orchestra.run.smithi039.stdout: debug auth = 20 2023-11-28T11:55:31.884 INFO:teuthology.orchestra.run.smithi039.stdout: mon data avail warn = 5 2023-11-28T11:55:31.885 INFO:teuthology.orchestra.run.smithi039.stdout: mon mgr mkfs grace = 240 2023-11-28T11:55:31.885 INFO:teuthology.orchestra.run.smithi039.stdout: mon reweight min pgs per osd = 4 2023-11-28T11:55:31.885 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd reporter subtree level = osd 2023-11-28T11:55:31.885 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd prime pg temp = true 2023-11-28T11:55:31.885 INFO:teuthology.orchestra.run.smithi039.stdout: mon reweight min bytes per osd = 10 2023-11-28T11:55:31.885 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:55:31.885 INFO:teuthology.orchestra.run.smithi039.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-28T11:55:31.885 INFO:teuthology.orchestra.run.smithi039.stdout: auth mon ticket ttl = 660 # 11m 2023-11-28T11:55:31.885 INFO:teuthology.orchestra.run.smithi039.stdout: auth service ticket ttl = 240 # 4m 2023-11-28T11:55:31.886 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:55:31.886 INFO:teuthology.orchestra.run.smithi039.stdout: # don't complain about insecure global_id in the test suite 2023-11-28T11:55:31.886 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-28T11:55:31.886 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-28T11:55:31.886 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:55:31.886 INFO:teuthology.orchestra.run.smithi039.stdout: # 1m isn't quite enough 2023-11-28T11:55:31.886 INFO:teuthology.orchestra.run.smithi039.stdout: mon_down_mkfs_grace = 2m 2023-11-28T11:55:31.886 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:55:31.886 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_filestore_osds = false 2023-11-28T11:55:31.887 INFO:teuthology.orchestra.run.smithi039.stdout: mon op complaint time = 120 2023-11-28T11:55:31.887 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:55:31.887 INFO:teuthology.orchestra.run.smithi039.stdout:[client] 2023-11-28T11:55:31.887 INFO:teuthology.orchestra.run.smithi039.stdout: rgw cache enabled = true 2023-11-28T11:55:31.887 INFO:teuthology.orchestra.run.smithi039.stdout: rgw enable ops log = true 2023-11-28T11:55:31.887 INFO:teuthology.orchestra.run.smithi039.stdout: rgw enable usage log = true 2023-11-28T11:55:31.887 INFO:teuthology.orchestra.run.smithi039.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-28T11:55:31.888 INFO:teuthology.orchestra.run.smithi039.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-28T11:55:31.888 INFO:teuthology.orchestra.run.smithi039.stdout: client mount timeout = 600 2023-11-28T11:55:31.888 INFO:teuthology.orchestra.run.smithi039.stdout: debug client = 20 2023-11-28T11:55:31.888 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2023-11-28T11:55:31.888 INFO:teuthology.orchestra.run.smithi039.stdout: pid file = "" 2023-11-28T11:55:31.888 INFO:teuthology.orchestra.run.smithi039.stdout: rados mon op timeout = 900 2023-11-28T11:55:31.889 INFO:teuthology.orchestra.run.smithi039.stdout: rados osd op timeout = 900 2023-11-28T11:55:31.889 INFO:teuthology.orchestra.run.smithi039.stdout:[mon.a] 2023-11-28T11:55:31.889 INFO:teuthology.orchestra.run.smithi039.stdout:[mon.b] 2023-11-28T11:55:31.889 INFO:teuthology.orchestra.run.smithi039.stdout:[mon.c] 2023-11-28T11:55:31.889 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.a] 2023-11-28T11:55:31.889 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.c] 2023-11-28T11:55:31.889 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.b] 2023-11-28T11:55:31.889 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.d] 2023-11-28T11:55:31.889 INFO:teuthology.orchestra.run.smithi039.stdout:[mds] 2023-11-28T11:55:31.890 INFO:teuthology.orchestra.run.smithi039.stdout: debug mds = 20 2023-11-28T11:55:31.890 INFO:teuthology.orchestra.run.smithi039.stdout: debug mds balancer = 20 2023-11-28T11:55:31.890 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2023-11-28T11:55:31.890 INFO:teuthology.orchestra.run.smithi039.stdout: mds debug frag = True 2023-11-28T11:55:31.890 INFO:teuthology.orchestra.run.smithi039.stdout: mds debug scatterstat = True 2023-11-28T11:55:31.890 INFO:teuthology.orchestra.run.smithi039.stdout: mds op complaint time = 180 2023-11-28T11:55:31.891 INFO:teuthology.orchestra.run.smithi039.stdout: mds verify scatter = True 2023-11-28T11:55:31.891 INFO:teuthology.orchestra.run.smithi039.stdout: osd op complaint time = 180 2023-11-28T11:55:31.891 INFO:teuthology.orchestra.run.smithi039.stdout: rados mon op timeout = 900 2023-11-28T11:55:31.891 INFO:teuthology.orchestra.run.smithi039.stdout: rados osd op timeout = 900 2023-11-28T11:55:31.893 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-28T11:55:31.894 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-28T11:55:32.026 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-28T11:55:32.026 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:55:32.026 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-28T11:55:32.044 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:55:32.044 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-28T11:55:32.106 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi039.front.sepia.ceph.com 2023-11-28T11:55:32.107 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:55:32.107 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-28T11:55:32.107 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-28T11:55:32.214 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:55:32.214 DEBUG:teuthology.orchestra.run.smithi039:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:55:32.274 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi184.front.sepia.ceph.com 2023-11-28T11:55:32.274 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:55:32.274 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-28T11:55:32.274 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-28T11:55:32.335 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:55:32.335 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:55:32.398 INFO:tasks.ceph:Setting up mon nodes... 2023-11-28T11:55:32.398 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-28T11:55:32.398 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-28T11:55:32.495 INFO:teuthology.orchestra.run.smithi039.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-28T11:55:32.503 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-28T11:55:32.608 INFO:teuthology.orchestra.run.smithi184.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-28T11:55:32.626 INFO:tasks.ceph:Setting up mds nodes... 2023-11-28T11:55:32.626 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-28T11:55:32.727 INFO:teuthology.orchestra.run.smithi039.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-28T11:55:32.734 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-28T11:55:32.770 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-28T11:55:32.919 INFO:teuthology.orchestra.run.smithi039.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-28T11:55:32.929 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-28T11:55:32.963 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-28T11:55:33.057 INFO:teuthology.orchestra.run.smithi184.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-28T11:55:33.064 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-28T11:55:33.104 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-28T11:55:33.245 INFO:teuthology.orchestra.run.smithi184.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-28T11:55:33.252 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-28T11:55:33.283 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-28T11:55:33.283 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-28T11:55:33.364 INFO:teuthology.orchestra.run.smithi039.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-28T11:55:33.395 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-28T11:55:33.469 INFO:teuthology.orchestra.run.smithi039.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-28T11:55:33.500 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-28T11:55:33.578 INFO:teuthology.orchestra.run.smithi184.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-28T11:55:33.604 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-28T11:55:33.677 INFO:teuthology.orchestra.run.smithi184.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-28T11:55:33.704 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-28T11:55:33.705 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi039.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi184.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-28T11:55:33.705 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-28T11:55:33.745 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T11:55:33.745 INFO:tasks.ceph:role: osd.0 2023-11-28T11:55:33.745 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi039.front.sepia.ceph.com 2023-11-28T11:55:33.745 DEBUG:teuthology.orchestra.run.smithi039:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-28T11:55:35.168 INFO:teuthology.orchestra.run.smithi039.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T11:55:35.168 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T11:55:35.168 INFO:teuthology.orchestra.run.smithi039.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T11:55:35.169 INFO:teuthology.orchestra.run.smithi039.stdout: = reflink=1 2023-11-28T11:55:35.169 INFO:teuthology.orchestra.run.smithi039.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T11:55:35.169 INFO:teuthology.orchestra.run.smithi039.stdout: = sunit=0 swidth=0 blks 2023-11-28T11:55:35.169 INFO:teuthology.orchestra.run.smithi039.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T11:55:35.169 INFO:teuthology.orchestra.run.smithi039.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T11:55:35.169 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T11:55:35.169 INFO:teuthology.orchestra.run.smithi039.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T11:55:35.171 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi039.front.sepia.ceph.com -o noatime 2023-11-28T11:55:35.171 DEBUG:teuthology.orchestra.run.smithi039:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-28T11:55:35.214 DEBUG:teuthology.orchestra.run.smithi039:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-28T11:55:35.281 INFO:teuthology.orchestra.run.smithi039.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T11:55:35.282 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:55:35.283 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-28T11:55:35.365 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T11:55:35.365 INFO:tasks.ceph:role: osd.1 2023-11-28T11:55:35.365 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi039.front.sepia.ceph.com 2023-11-28T11:55:35.365 DEBUG:teuthology.orchestra.run.smithi039:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-28T11:55:36.787 INFO:teuthology.orchestra.run.smithi039.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T11:55:36.787 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T11:55:36.787 INFO:teuthology.orchestra.run.smithi039.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T11:55:36.787 INFO:teuthology.orchestra.run.smithi039.stdout: = reflink=1 2023-11-28T11:55:36.787 INFO:teuthology.orchestra.run.smithi039.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T11:55:36.787 INFO:teuthology.orchestra.run.smithi039.stdout: = sunit=0 swidth=0 blks 2023-11-28T11:55:36.787 INFO:teuthology.orchestra.run.smithi039.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T11:55:36.787 INFO:teuthology.orchestra.run.smithi039.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T11:55:36.788 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T11:55:36.788 INFO:teuthology.orchestra.run.smithi039.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T11:55:36.791 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi039.front.sepia.ceph.com -o noatime 2023-11-28T11:55:36.791 DEBUG:teuthology.orchestra.run.smithi039:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-28T11:55:36.837 DEBUG:teuthology.orchestra.run.smithi039:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-28T11:55:36.913 INFO:teuthology.orchestra.run.smithi039.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T11:55:36.914 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:55:36.915 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-28T11:55:36.994 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T11:55:36.994 INFO:tasks.ceph:role: osd.2 2023-11-28T11:55:36.994 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi039.front.sepia.ceph.com 2023-11-28T11:55:36.994 DEBUG:teuthology.orchestra.run.smithi039:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-28T11:55:38.398 INFO:teuthology.orchestra.run.smithi039.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T11:55:38.398 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T11:55:38.398 INFO:teuthology.orchestra.run.smithi039.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T11:55:38.398 INFO:teuthology.orchestra.run.smithi039.stdout: = reflink=1 2023-11-28T11:55:38.398 INFO:teuthology.orchestra.run.smithi039.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T11:55:38.399 INFO:teuthology.orchestra.run.smithi039.stdout: = sunit=0 swidth=0 blks 2023-11-28T11:55:38.399 INFO:teuthology.orchestra.run.smithi039.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T11:55:38.399 INFO:teuthology.orchestra.run.smithi039.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T11:55:38.399 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T11:55:38.399 INFO:teuthology.orchestra.run.smithi039.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T11:55:38.402 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi039.front.sepia.ceph.com -o noatime 2023-11-28T11:55:38.402 DEBUG:teuthology.orchestra.run.smithi039:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-28T11:55:38.443 DEBUG:teuthology.orchestra.run.smithi039:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-28T11:55:38.513 INFO:teuthology.orchestra.run.smithi039.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T11:55:38.513 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:55:38.514 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-28T11:55:38.594 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T11:55:38.595 INFO:tasks.ceph:role: osd.3 2023-11-28T11:55:38.595 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi039.front.sepia.ceph.com 2023-11-28T11:55:38.595 DEBUG:teuthology.orchestra.run.smithi039:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-28T11:55:40.006 INFO:teuthology.orchestra.run.smithi039.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T11:55:40.007 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T11:55:40.007 INFO:teuthology.orchestra.run.smithi039.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T11:55:40.007 INFO:teuthology.orchestra.run.smithi039.stdout: = reflink=1 2023-11-28T11:55:40.007 INFO:teuthology.orchestra.run.smithi039.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T11:55:40.007 INFO:teuthology.orchestra.run.smithi039.stdout: = sunit=0 swidth=0 blks 2023-11-28T11:55:40.007 INFO:teuthology.orchestra.run.smithi039.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T11:55:40.007 INFO:teuthology.orchestra.run.smithi039.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T11:55:40.007 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T11:55:40.007 INFO:teuthology.orchestra.run.smithi039.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T11:55:40.011 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi039.front.sepia.ceph.com -o noatime 2023-11-28T11:55:40.012 DEBUG:teuthology.orchestra.run.smithi039:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-28T11:55:40.053 DEBUG:teuthology.orchestra.run.smithi039:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-28T11:55:40.122 INFO:teuthology.orchestra.run.smithi039.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T11:55:40.124 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:55:40.124 DEBUG:teuthology.orchestra.run.smithi039:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:55:40.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:55:40.295+0000 7f37e660e700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-28T11:55:40.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:55:40.299+0000 7f37e660e700 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-28T11:55:40.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:55:40.299+0000 7f37e660e700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-28T11:55:40.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:55:40.299+0000 7f37e660e700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-28T11:55:40.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:55:40.299+0000 7f37e660e700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-28T11:55:40.304 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:55:40.299+0000 7f37e660e700 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-28T11:55:43.419 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-28T11:55:43.458 DEBUG:teuthology.orchestra.run.smithi039:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:55:43.591 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:55:43.587+0000 7f20a5ffa700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-28T11:55:43.592 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:55:43.591+0000 7f20a5ffa700 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-28T11:55:43.592 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:55:43.591+0000 7f20a5ffa700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-28T11:55:43.592 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:55:43.591+0000 7f20a5ffa700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-28T11:55:43.592 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:55:43.591+0000 7f20a5ffa700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-28T11:55:43.595 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:55:43.591+0000 7f20a5ffa700 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-28T11:55:46.678 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-28T11:55:46.713 DEBUG:teuthology.orchestra.run.smithi039:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:55:46.840 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:55:46.835+0000 7fb5f23be700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-28T11:55:46.842 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:55:46.839+0000 7fb5f23be700 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-28T11:55:46.842 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:55:46.839+0000 7fb5f23be700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-28T11:55:46.842 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:55:46.839+0000 7fb5f23be700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-28T11:55:46.842 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:55:46.839+0000 7fb5f23be700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-28T11:55:46.844 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:55:46.843+0000 7fb5f23be700 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-28T11:55:49.945 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-28T11:55:49.981 DEBUG:teuthology.orchestra.run.smithi039:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:55:50.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:55:50.111+0000 7f954405e700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-28T11:55:50.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:55:50.111+0000 7f954405e700 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-28T11:55:50.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:55:50.111+0000 7f954405e700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-28T11:55:50.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:55:50.111+0000 7f954405e700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-28T11:55:50.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:55:50.111+0000 7f954405e700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-28T11:55:50.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:55:50.111+0000 7f954405e700 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-28T11:55:53.175 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-28T11:55:53.212 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-28T11:55:53.249 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T11:55:53.249 INFO:tasks.ceph:role: osd.4 2023-11-28T11:55:53.249 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi184.front.sepia.ceph.com 2023-11-28T11:55:53.250 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-28T11:55:53.854 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T11:55:53.854 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T11:55:53.854 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T11:55:53.854 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 2023-11-28T11:55:53.854 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T11:55:53.854 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2023-11-28T11:55:53.854 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T11:55:53.855 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T11:55:53.855 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T11:55:53.855 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T11:55:53.859 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2023-11-28T11:55:53.859 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-28T11:55:54.003 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-28T11:55:54.025 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T11:55:54.026 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:55:54.026 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-28T11:55:54.104 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T11:55:54.105 INFO:tasks.ceph:role: osd.5 2023-11-28T11:55:54.105 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi184.front.sepia.ceph.com 2023-11-28T11:55:54.105 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-28T11:55:54.615 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T11:55:54.615 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T11:55:54.615 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T11:55:54.615 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 2023-11-28T11:55:54.615 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T11:55:54.615 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2023-11-28T11:55:54.615 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T11:55:54.615 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T11:55:54.615 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T11:55:54.615 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T11:55:54.622 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2023-11-28T11:55:54.622 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-28T11:55:54.691 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-28T11:55:54.715 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T11:55:54.715 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:55:54.716 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-28T11:55:54.801 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T11:55:54.801 INFO:tasks.ceph:role: osd.6 2023-11-28T11:55:54.801 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi184.front.sepia.ceph.com 2023-11-28T11:55:54.801 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-28T11:55:55.370 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T11:55:55.370 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T11:55:55.370 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T11:55:55.370 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 2023-11-28T11:55:55.370 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T11:55:55.370 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2023-11-28T11:55:55.370 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T11:55:55.370 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T11:55:55.370 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T11:55:55.370 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T11:55:55.375 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2023-11-28T11:55:55.375 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-28T11:55:55.496 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-28T11:55:55.516 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T11:55:55.517 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:55:55.518 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-28T11:55:55.594 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T11:55:55.594 INFO:tasks.ceph:role: osd.7 2023-11-28T11:55:55.594 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi184.front.sepia.ceph.com 2023-11-28T11:55:55.595 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-28T11:55:56.178 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T11:55:56.178 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T11:55:56.178 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T11:55:56.178 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 2023-11-28T11:55:56.178 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T11:55:56.178 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2023-11-28T11:55:56.178 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T11:55:56.179 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T11:55:56.179 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T11:55:56.179 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T11:55:56.181 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2023-11-28T11:55:56.181 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-28T11:55:56.339 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-28T11:55:56.360 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T11:55:56.360 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:55:56.361 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:55:56.523 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:55:56.519+0000 7f7bf71e6700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-28T11:55:56.527 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:55:56.523+0000 7f7bf71e6700 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-28T11:55:56.528 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:55:56.523+0000 7f7bf71e6700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-28T11:55:56.528 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:55:56.523+0000 7f7bf71e6700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-28T11:55:56.528 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:55:56.523+0000 7f7bf71e6700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-28T11:55:56.530 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:55:56.527+0000 7f7bf71e6700 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-28T11:55:59.431 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:55:59.438 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:55:59.847 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-28T11:55:59.884 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:56:00.018 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:00.015+0000 7fe321054700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-28T11:56:00.019 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:00.015+0000 7fe321054700 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-28T11:56:00.019 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:00.015+0000 7fe321054700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-28T11:56:00.020 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:00.015+0000 7fe321054700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-28T11:56:00.020 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:00.015+0000 7fe321054700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-28T11:56:00.022 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:00.019+0000 7fe321054700 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-28T11:56:03.098 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-28T11:56:03.132 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:56:03.271 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:03.267+0000 7fda0bd19700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-28T11:56:03.271 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:03.267+0000 7fda0bd19700 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-28T11:56:03.271 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:03.267+0000 7fda0bd19700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-28T11:56:03.272 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:03.267+0000 7fda0bd19700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-28T11:56:03.272 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:03.267+0000 7fda0bd19700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-28T11:56:03.274 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:03.271+0000 7fda0bd19700 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-28T11:56:06.334 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-28T11:56:06.372 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:56:06.510 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:06.507+0000 7f7b46720700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-28T11:56:06.511 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:06.507+0000 7f7b46720700 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-28T11:56:06.511 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:06.507+0000 7f7b46720700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-28T11:56:06.511 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:06.507+0000 7f7b46720700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-28T11:56:06.511 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:06.507+0000 7f7b46720700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-28T11:56:06.513 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:06.511+0000 7f7b46720700 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-28T11:56:09.581 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-28T11:56:09.614 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-28T11:56:09.614 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:56:09.615 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-28T11:56:09.652 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:56:09.653 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-28T11:56:09.732 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:56:09.732 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-28T11:56:09.812 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:56:09.812 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-28T11:56:09.892 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:56:09.892 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-28T11:56:09.971 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:56:09.971 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-28T11:56:10.054 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:56:10.055 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-28T11:56:10.135 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:56:10.136 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-28T11:56:10.174 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:56:10.175 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-28T11:56:10.256 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:56:10.256 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-28T11:56:10.333 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:56:10.334 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-28T11:56:10.414 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:56:10.414 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-28T11:56:10.494 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:56:10.494 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-28T11:56:10.572 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:56:10.572 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-28T11:56:10.651 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:56:10.651 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-28T11:56:10.670 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:56:10.670 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-28T11:56:10.729 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:56:10.729 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-28T11:56:10.747 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:56:10.747 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-28T11:56:10.808 INFO:tasks.ceph:Adding keys to all mons... 2023-11-28T11:56:10.808 DEBUG:teuthology.orchestra.run.smithi039:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-28T11:56:10.817 DEBUG:teuthology.orchestra.run.smithi184:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-28T11:56:10.859 INFO:teuthology.orchestra.run.smithi039.stdout:[mgr.y] 2023-11-28T11:56:10.860 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQA01WVl2MuIHRAAJcRCzINF6RaIyQSyE4VLgQ== 2023-11-28T11:56:10.860 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.a] 2023-11-28T11:56:10.860 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQA01WVlQyBbKxAAY5bRNsaX8hfv1p9qFxGk7A== 2023-11-28T11:56:10.860 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.c] 2023-11-28T11:56:10.860 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQA01WVltd/PNhAARPTeQ/ls/8rykZx5Nqpdaw== 2023-11-28T11:56:10.860 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.0] 2023-11-28T11:56:10.860 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQA81WVlStbVERAAQPnXIt45pPKg99io3w4nHA== 2023-11-28T11:56:10.860 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.1] 2023-11-28T11:56:10.860 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQA/1WVlrdM7IxAA2g0ZCNubjLlQMt1fSQxrFQ== 2023-11-28T11:56:10.860 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.2] 2023-11-28T11:56:10.861 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQBC1WVlg3ITMhAAm9eJaDLqZDJ0cZGrMdcAdQ== 2023-11-28T11:56:10.861 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.3] 2023-11-28T11:56:10.861 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQBG1WVliM+vBhAAGP25Wh7MAPte/DgAH0t2sg== 2023-11-28T11:56:10.861 INFO:teuthology.orchestra.run.smithi039.stdout:[mgr.x] 2023-11-28T11:56:10.861 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQA01WVlZ2c8JBAAZIy0cQXW2ZvyFXfMMhU66g== 2023-11-28T11:56:10.861 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.b] 2023-11-28T11:56:10.861 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQA11WVlZB1uAxAAzd+69PaNzatkv+qGZhwEng== 2023-11-28T11:56:10.861 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.d] 2023-11-28T11:56:10.861 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQA11WVl3BKfDhAABJE0cb9fBNb7Sy9gC8wS7w== 2023-11-28T11:56:10.861 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.4] 2023-11-28T11:56:10.862 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQBM1WVlFgQ0HxAAoisaw/l1WjPkX6ndrRC9zw== 2023-11-28T11:56:10.862 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.5] 2023-11-28T11:56:10.862 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQBQ1WVlIGsdARAAFGnkOWG4A4wMr68uP8c73A== 2023-11-28T11:56:10.862 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.6] 2023-11-28T11:56:10.862 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQBT1WVl7WokEBAAARrh+05BXBzm8tJPplREMg== 2023-11-28T11:56:10.862 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.7] 2023-11-28T11:56:10.862 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQBW1WVl/yFiHhAAzxVK7EGFHEK0oEyqjaJ8uQ== 2023-11-28T11:56:10.862 INFO:teuthology.orchestra.run.smithi039.stdout:[client.0] 2023-11-28T11:56:10.862 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQA11WVlc1G2FRAAQ7OTgUCsPgSquiptDBs73Q== 2023-11-28T11:56:10.862 INFO:teuthology.orchestra.run.smithi039.stdout:[client.2] 2023-11-28T11:56:10.862 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQA11WVlWm/8GxAAXdoSzGMMGGRpddGUgipXaw== 2023-11-28T11:56:10.862 INFO:teuthology.orchestra.run.smithi039.stdout:[client.1] 2023-11-28T11:56:10.863 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQA11WVlrvFzIhAAgF6N85WgJkyxjS5R19vj2A== 2023-11-28T11:56:10.863 INFO:teuthology.orchestra.run.smithi039.stdout:[client.3] 2023-11-28T11:56:10.863 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQA11WVlhyZcKBAARWiULAwCFB1cHeFUgPlYKQ== 2023-11-28T11:56:10.890 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr.y] 2023-11-28T11:56:10.890 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQA01WVl2MuIHRAAJcRCzINF6RaIyQSyE4VLgQ== 2023-11-28T11:56:10.890 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.a] 2023-11-28T11:56:10.890 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQA01WVlQyBbKxAAY5bRNsaX8hfv1p9qFxGk7A== 2023-11-28T11:56:10.890 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.c] 2023-11-28T11:56:10.890 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQA01WVltd/PNhAARPTeQ/ls/8rykZx5Nqpdaw== 2023-11-28T11:56:10.890 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.0] 2023-11-28T11:56:10.891 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQA81WVlStbVERAAQPnXIt45pPKg99io3w4nHA== 2023-11-28T11:56:10.891 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.1] 2023-11-28T11:56:10.891 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQA/1WVlrdM7IxAA2g0ZCNubjLlQMt1fSQxrFQ== 2023-11-28T11:56:10.891 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.2] 2023-11-28T11:56:10.891 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBC1WVlg3ITMhAAm9eJaDLqZDJ0cZGrMdcAdQ== 2023-11-28T11:56:10.891 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.3] 2023-11-28T11:56:10.891 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBG1WVliM+vBhAAGP25Wh7MAPte/DgAH0t2sg== 2023-11-28T11:56:10.891 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr.x] 2023-11-28T11:56:10.891 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQA01WVlZ2c8JBAAZIy0cQXW2ZvyFXfMMhU66g== 2023-11-28T11:56:10.891 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.b] 2023-11-28T11:56:10.891 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQA11WVlZB1uAxAAzd+69PaNzatkv+qGZhwEng== 2023-11-28T11:56:10.891 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.d] 2023-11-28T11:56:10.892 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQA11WVl3BKfDhAABJE0cb9fBNb7Sy9gC8wS7w== 2023-11-28T11:56:10.892 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.4] 2023-11-28T11:56:10.892 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBM1WVlFgQ0HxAAoisaw/l1WjPkX6ndrRC9zw== 2023-11-28T11:56:10.892 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.5] 2023-11-28T11:56:10.892 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBQ1WVlIGsdARAAFGnkOWG4A4wMr68uP8c73A== 2023-11-28T11:56:10.892 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.6] 2023-11-28T11:56:10.892 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBT1WVl7WokEBAAARrh+05BXBzm8tJPplREMg== 2023-11-28T11:56:10.892 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.7] 2023-11-28T11:56:10.892 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBW1WVl/yFiHhAAzxVK7EGFHEK0oEyqjaJ8uQ== 2023-11-28T11:56:10.892 INFO:teuthology.orchestra.run.smithi184.stdout:[client.0] 2023-11-28T11:56:10.892 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQA11WVlc1G2FRAAQ7OTgUCsPgSquiptDBs73Q== 2023-11-28T11:56:10.892 INFO:teuthology.orchestra.run.smithi184.stdout:[client.2] 2023-11-28T11:56:10.892 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQA11WVlWm/8GxAAXdoSzGMMGGRpddGUgipXaw== 2023-11-28T11:56:10.893 INFO:teuthology.orchestra.run.smithi184.stdout:[client.1] 2023-11-28T11:56:10.893 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQA11WVlrvFzIhAAgF6N85WgJkyxjS5R19vj2A== 2023-11-28T11:56:10.893 INFO:teuthology.orchestra.run.smithi184.stdout:[client.3] 2023-11-28T11:56:10.894 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQA11WVlhyZcKBAARWiULAwCFB1cHeFUgPlYKQ== 2023-11-28T11:56:10.895 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T11:56:10.921 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T11:56:11.025 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T11:56:11.032 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T11:56:11.117 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T11:56:11.124 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T11:56:11.210 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:56:11.217 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:56:11.299 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:56:11.305 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:56:11.399 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:56:11.405 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:56:11.489 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:56:11.496 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:56:11.581 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T11:56:11.587 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T11:56:11.672 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T11:56:11.679 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T11:56:11.764 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T11:56:11.772 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T11:56:11.860 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:56:11.866 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:56:11.953 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:56:11.959 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:56:12.048 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:56:12.055 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:56:12.141 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:56:12.146 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:56:12.232 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T11:56:12.239 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T11:56:12.321 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T11:56:12.328 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T11:56:12.417 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T11:56:12.423 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T11:56:12.516 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T11:56:12.522 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T11:56:12.608 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-28T11:56:12.608 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-28T11:56:12.646 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-28T11:56:12.810 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-28T11:56:12.843 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-28T11:56:12.883 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-28T11:56:13.037 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-28T11:56:13.073 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-28T11:56:13.151 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-28T11:56:13.305 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-28T11:56:13.404 DEBUG:teuthology.orchestra.run.smithi039:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:56:13.411 DEBUG:teuthology.orchestra.run.smithi184:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:56:13.469 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-28T11:56:13.469 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-28T11:56:13.469 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-28T11:56:13.476 INFO:tasks.ceph.mon.a:Started 2023-11-28T11:56:13.477 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-28T11:56:13.477 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-28T11:56:13.518 INFO:tasks.ceph.mon.b:Started 2023-11-28T11:56:13.519 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-28T11:56:13.519 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-28T11:56:13.523 INFO:tasks.ceph.mon.c:Started 2023-11-28T11:56:13.523 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-28T11:56:13.523 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-28T11:56:13.523 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-28T11:56:13.530 INFO:tasks.ceph.mgr.y:Started 2023-11-28T11:56:13.531 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-28T11:56:13.531 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-28T11:56:13.535 INFO:tasks.ceph.mgr.x:Started 2023-11-28T11:56:13.536 INFO:tasks.ceph:Setting crush tunables to default 2023-11-28T11:56:13.536 DEBUG:teuthology.orchestra.run.smithi039:> sudo ceph --cluster ceph osd crush tunables default 2023-11-28T11:56:13.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.694+0000 7f59d1fdc700 1 Processor -- start 2023-11-28T11:56:13.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.694+0000 7f59d1fdc700 1 -- start start 2023-11-28T11:56:13.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.694+0000 7f59d1fdc700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f59cc0b43a0 0x7f59cc15e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:13.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.694+0000 7f59d1fdc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59cc0b1640 0x7f59cc070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:13.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.694+0000 7f59d1fdc700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f59cc0c9040 0x7f59cc0705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:13.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.694+0000 7f59d1fdc700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59cc15a550 con 0x7f59cc0c9040 2023-11-28T11:56:13.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.694+0000 7f59d1fdc700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59cc06b0a0 con 0x7f59cc0b43a0 2023-11-28T11:56:13.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.694+0000 7f59d1fdc700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59cc0caac0 con 0x7f59cc0b1640 2023-11-28T11:56:13.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.698+0000 7f59d0fda700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f59cc0b43a0 0x7f59cc15e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:13.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.698+0000 7f59cbfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59cc0b1640 0x7f59cc070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:13.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.698+0000 7f59d17db700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f59cc0c9040 0x7f59cc0705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:13.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.698+0000 7f59d0fda700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f59cc0b43a0 0x7f59cc15e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:49670/0 (socket says 172.21.15.39:49670) 2023-11-28T11:56:13.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.698+0000 7f59cbfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59cc0b1640 0x7f59cc070080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:55094/0 (socket says 172.21.15.39:55094) 2023-11-28T11:56:13.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.698+0000 7f59d0fda700 1 -- 172.21.15.39:0/2839628877 learned_addr learned my addr 172.21.15.39:0/2839628877 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:13.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.698+0000 7f59d0fda700 1 -- 172.21.15.39:0/2839628877 >> v2:172.21.15.184:3300/0 conn(0x7f59cc0b43a0 msgr2=0x7f59cc15e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T11:56:13.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.698+0000 7f59d0fda700 1 -- 172.21.15.39:0/2839628877 >> v2:172.21.15.184:3300/0 conn(0x7f59cc0b43a0 msgr2=0x7f59cc15e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T11:56:13.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.698+0000 7f59d0fda700 1 --2- 172.21.15.39:0/2839628877 >> v2:172.21.15.184:3300/0 conn(0x7f59cc0b43a0 0x7f59cc15e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T11:56:13.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.698+0000 7f59cbfff700 1 -- 172.21.15.39:0/2839628877 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59cc0b1640 msgr2=0x7f59cc070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T11:56:13.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.698+0000 7f59cbfff700 1 -- 172.21.15.39:0/2839628877 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59cc0b1640 msgr2=0x7f59cc070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T11:56:13.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.698+0000 7f59cbfff700 1 --2- 172.21.15.39:0/2839628877 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59cc0b1640 0x7f59cc070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T11:56:13.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.698+0000 7f59cbfff700 1 --2- 172.21.15.39:0/2839628877 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59cc0b1640 0x7f59cc070080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T11:56:13.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.698+0000 7f59d0fda700 1 --2- 172.21.15.39:0/2839628877 >> v2:172.21.15.184:3300/0 conn(0x7f59cc0b43a0 0x7f59cc15e5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T11:56:13.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.698+0000 7f59d17db700 1 -- 172.21.15.39:0/2839628877 >> v2:172.21.15.39:3300/0 conn(0x7f59cc0c9040 msgr2=0x7f59cc0705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T11:56:13.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.698+0000 7f59d17db700 1 -- 172.21.15.39:0/2839628877 >> v2:172.21.15.39:3300/0 conn(0x7f59cc0c9040 msgr2=0x7f59cc0705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T11:56:13.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.698+0000 7f59d17db700 1 --2- 172.21.15.39:0/2839628877 >> v2:172.21.15.39:3300/0 conn(0x7f59cc0c9040 0x7f59cc0705c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T11:56:13.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.698+0000 7f59d17db700 1 --2- 172.21.15.39:0/2839628877 >> v2:172.21.15.39:3300/0 conn(0x7f59cc0c9040 0x7f59cc0705c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T11:56:13.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.902+0000 7f59d0fda700 1 --2- 172.21.15.39:0/2839628877 >> v2:172.21.15.184:3300/0 conn(0x7f59cc0b43a0 0x7f59cc15e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:13.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.902+0000 7f59cbfff700 1 --2- 172.21.15.39:0/2839628877 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59cc0b1640 0x7f59cc070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:13.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.902+0000 7f59d17db700 1 --2- 172.21.15.39:0/2839628877 >> v2:172.21.15.39:3300/0 conn(0x7f59cc0c9040 0x7f59cc0705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:13.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.902+0000 7f59d0fda700 1 -- 172.21.15.39:0/2839628877 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59cc0b1640 msgr2=0x7f59cc070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:13.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.902+0000 7f59d0fda700 1 --2- 172.21.15.39:0/2839628877 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59cc0b1640 0x7f59cc070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:13.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.902+0000 7f59d0fda700 1 -- 172.21.15.39:0/2839628877 >> v2:172.21.15.39:3300/0 conn(0x7f59cc0c9040 msgr2=0x7f59cc0705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:13.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.902+0000 7f59d0fda700 1 --2- 172.21.15.39:0/2839628877 >> v2:172.21.15.39:3300/0 conn(0x7f59cc0c9040 0x7f59cc0705c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:13.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.902+0000 7f59d0fda700 1 -- 172.21.15.39:0/2839628877 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59cc0cada0 con 0x7f59cc0b43a0 2023-11-28T11:56:13.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.902+0000 7f59d0fda700 1 --2- 172.21.15.39:0/2839628877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59cc0b43a0 0x7f59cc15e5d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f59cc06fe80 tx=0x7f59c0009c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c1a5b3a5c4f15f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:13.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.902+0000 7f59cb7fe700 1 -- 172.21.15.39:0/2839628877 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c000c070 con 0x7f59cc0b43a0 2023-11-28T11:56:13.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.902+0000 7f59cb7fe700 1 -- 172.21.15.39:0/2839628877 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c000e670 con 0x7f59cc0b43a0 2023-11-28T11:56:13.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.902+0000 7f59cb7fe700 1 -- 172.21.15.39:0/2839628877 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c000ea00 con 0x7f59cc0b43a0 2023-11-28T11:56:13.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.906+0000 7f59d1fdc700 1 -- 172.21.15.39:0/2839628877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59cc0b43a0 msgr2=0x7f59cc15e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:13.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.906+0000 7f59d1fdc700 1 --2- 172.21.15.39:0/2839628877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59cc0b43a0 0x7f59cc15e5d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f59cc06fe80 tx=0x7f59c0009c70 comp rx=0 tx=0).stop 2023-11-28T11:56:13.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.906+0000 7f59d1fdc700 1 -- 172.21.15.39:0/2839628877 shutdown_connections 2023-11-28T11:56:13.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.906+0000 7f59d1fdc700 1 --2- 172.21.15.39:0/2839628877 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59cc0b1640 0x7f59cc070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:13.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.906+0000 7f59d1fdc700 1 --2- 172.21.15.39:0/2839628877 >> v2:172.21.15.39:3300/0 conn(0x7f59cc0c9040 0x7f59cc0705c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:13.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.906+0000 7f59d1fdc700 1 --2- 172.21.15.39:0/2839628877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59cc0b43a0 0x7f59cc15e5d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:13.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.906+0000 7f59d1fdc700 1 -- 172.21.15.39:0/2839628877 >> 172.21.15.39:0/2839628877 conn(0x7f59cc0b0f80 msgr2=0x7f59cc0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:13.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.906+0000 7f59d1fdc700 1 -- 172.21.15.39:0/2839628877 shutdown_connections 2023-11-28T11:56:13.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.906+0000 7f59d1fdc700 1 -- 172.21.15.39:0/2839628877 wait complete. 2023-11-28T11:56:13.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.906+0000 7f59d1fdc700 1 Processor -- start 2023-11-28T11:56:13.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.910+0000 7f59d1fdc700 1 -- start start 2023-11-28T11:56:13.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.910+0000 7f59d1fdc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f59cc0b1640 0x7f59cc15c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:13.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.910+0000 7f59d1fdc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59cc0b43a0 0x7f59cc158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:13.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.910+0000 7f59d1fdc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59cc0c9040 0x7f59cc0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:13.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.910+0000 7f59d1fdc700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59cc15c8e0 con 0x7f59cc0b1640 2023-11-28T11:56:13.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.910+0000 7f59d1fdc700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59cc15d370 con 0x7f59cc0b43a0 2023-11-28T11:56:13.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.910+0000 7f59d1fdc700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59cc158570 con 0x7f59cc0c9040 2023-11-28T11:56:13.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.910+0000 7f59d0fda700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f59cc0b1640 0x7f59cc15c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:13.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.910+0000 7f59d0fda700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f59cc0b1640 0x7f59cc15c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34150/0 (socket says 172.21.15.39:34150) 2023-11-28T11:56:13.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.910+0000 7f59d0fda700 1 -- 172.21.15.39:0/2608485807 learned_addr learned my addr 172.21.15.39:0/2608485807 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:13.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.910+0000 7f59cbfff700 1 --2- 172.21.15.39:0/2608485807 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59cc0b43a0 0x7f59cc158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:13.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.910+0000 7f59d17db700 1 --2- 172.21.15.39:0/2608485807 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59cc0c9040 0x7f59cc0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:13.916 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.910+0000 7f59d0fda700 1 -- 172.21.15.39:0/2608485807 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59cc0c9040 msgr2=0x7f59cc0c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:13.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.910+0000 7f59d0fda700 1 --2- 172.21.15.39:0/2608485807 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59cc0c9040 0x7f59cc0c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:13.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.910+0000 7f59d0fda700 1 -- 172.21.15.39:0/2608485807 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59cc0b43a0 msgr2=0x7f59cc158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:13.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.910+0000 7f59d0fda700 1 --2- 172.21.15.39:0/2608485807 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59cc0b43a0 0x7f59cc158030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:13.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.910+0000 7f59d0fda700 1 -- 172.21.15.39:0/2608485807 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c00095f0 con 0x7f59cc0b1640 2023-11-28T11:56:13.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.910+0000 7f59d0fda700 1 --2- 172.21.15.39:0/2608485807 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f59cc0b1640 0x7f59cc15c3a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f59cc06b1e0 tx=0x7f59c00047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:13.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.914+0000 7f59c97fa700 1 -- 172.21.15.39:0/2608485807 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c0021070 con 0x7f59cc0b1640 2023-11-28T11:56:13.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.914+0000 7f59c97fa700 1 -- 172.21.15.39:0/2608485807 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c0006bf0 con 0x7f59cc0b1640 2023-11-28T11:56:13.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.914+0000 7f59c97fa700 1 -- 172.21.15.39:0/2608485807 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c001c7d0 con 0x7f59cc0b1640 2023-11-28T11:56:13.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.914+0000 7f59d1fdc700 1 -- 172.21.15.39:0/2608485807 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59cc06b5d0 con 0x7f59cc0b1640 2023-11-28T11:56:13.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.914+0000 7f59d1fdc700 1 -- 172.21.15.39:0/2608485807 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59cc06b2f0 con 0x7f59cc0b1640 2023-11-28T11:56:13.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.914+0000 7f59c97fa700 1 -- 172.21.15.39:0/2608485807 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f59c001c930 con 0x7f59cc0b1640 2023-11-28T11:56:13.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.914+0000 7f59c97fa700 1 -- 172.21.15.39:0/2608485807 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f59c00278a0 con 0x7f59cc0b1640 2023-11-28T11:56:13.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.914+0000 7f59d1fdc700 1 -- 172.21.15.39:0/2608485807 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59cc15eb10 con 0x7f59cc0b1640 2023-11-28T11:56:13.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.918+0000 7f59c97fa700 1 -- 172.21.15.39:0/2608485807 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f59c0035060 con 0x7f59cc0b1640 2023-11-28T11:56:14.000 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:13.994+0000 7f59d1fdc700 1 -- 172.21.15.39:0/2608485807 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f59cc073cb0 con 0x7f59cc0b1640 2023-11-28T11:56:14.007 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:14.002+0000 7f59c97fa700 1 -- 172.21.15.39:0/2608485807 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f59c0017020 con 0x7f59cc0b1640 2023-11-28T11:56:14.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:14.006+0000 7f59d1fdc700 1 -- 172.21.15.39:0/2608485807 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f59cc0b1640 msgr2=0x7f59cc15c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:14.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:14.006+0000 7f59d1fdc700 1 --2- 172.21.15.39:0/2608485807 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f59cc0b1640 0x7f59cc15c3a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f59cc06b1e0 tx=0x7f59c00047e0 comp rx=0 tx=0).stop 2023-11-28T11:56:14.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:14.006+0000 7f59d1fdc700 1 -- 172.21.15.39:0/2608485807 shutdown_connections 2023-11-28T11:56:14.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:14.006+0000 7f59d1fdc700 1 --2- 172.21.15.39:0/2608485807 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59cc0c9040 0x7f59cc0c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:14.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:14.006+0000 7f59d1fdc700 1 --2- 172.21.15.39:0/2608485807 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59cc0b43a0 0x7f59cc158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:14.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:14.006+0000 7f59d1fdc700 1 --2- 172.21.15.39:0/2608485807 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f59cc0b1640 0x7f59cc15c3a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:14.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:14.006+0000 7f59d1fdc700 1 -- 172.21.15.39:0/2608485807 >> 172.21.15.39:0/2608485807 conn(0x7f59cc0b0f80 msgr2=0x7f59cc070060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:14.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:14.006+0000 7f59d1fdc700 1 -- 172.21.15.39:0/2608485807 shutdown_connections 2023-11-28T11:56:14.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:14.006+0000 7f59d1fdc700 1 -- 172.21.15.39:0/2608485807 wait complete. 2023-11-28T11:56:14.013 INFO:teuthology.orchestra.run.smithi039.stderr:adjusted tunables profile to default 2023-11-28T11:56:14.031 INFO:tasks.ceph:check_enable_crimson: False 2023-11-28T11:56:14.031 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-28T11:56:14.032 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:56:14.032 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-28T11:56:14.073 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:56:14.073 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-28T11:56:14.153 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:56:14.153 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-28T11:56:14.160 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-11-28T11:56:14.154+0000 7fabd39892c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-28T11:56:14.175 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-11-28T11:56:14.170+0000 7fddf53662c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-28T11:56:14.208 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:56:14.209 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-28T11:56:14.287 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:56:14.288 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-28T11:56:14.319 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:56:14.320 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-28T11:56:14.397 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:56:14.397 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-28T11:56:14.473 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:56:14.473 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-28T11:56:14.553 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new ab7b9010-d38f-4f91-ab43-344fd159f42c 0 2023-11-28T11:56:14.759 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.754+0000 7f942234f700 1 Processor -- start 2023-11-28T11:56:14.760 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.754+0000 7f942234f700 1 -- start start 2023-11-28T11:56:14.764 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.758+0000 7f942234f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f941c159320 0x7f941c0b1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:14.764 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.758+0000 7f942234f700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f941c0b1780 0x7f941c0cd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:14.764 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.758+0000 7f942234f700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f941c0cd8d0 0x7f941c0711e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:14.764 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.758+0000 7f942234f700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f941c0b1bf0 con 0x7f941c0b1780 2023-11-28T11:56:14.764 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.758+0000 7f942234f700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f941c0cdd50 con 0x7f941c0cd8d0 2023-11-28T11:56:14.764 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.758+0000 7f942234f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941c15cde0 con 0x7f941c159320 2023-11-28T11:56:14.765 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.758+0000 7f942134d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f941c159320 0x7f941c0b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:14.766 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.758+0000 7f942134d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f941c159320 0x7f941c0b1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:59544/0 (socket says 172.21.15.184:59544) 2023-11-28T11:56:14.766 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.758+0000 7f942134d700 1 -- 172.21.15.184:0/1813198623 learned_addr learned my addr 172.21.15.184:0/1813198623 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-11-28T11:56:14.766 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.758+0000 7f9421b4e700 1 --2- 172.21.15.184:0/1813198623 >> v2:172.21.15.184:3300/0 conn(0x7f941c0cd8d0 0x7f941c0711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:14.766 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.762+0000 7f9420b4c700 1 --2- 172.21.15.184:0/1813198623 >> v2:172.21.15.39:3300/0 conn(0x7f941c0b1780 0x7f941c0cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:14.766 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.762+0000 7f9421b4e700 1 -- 172.21.15.184:0/1813198623 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f941c159320 msgr2=0x7f941c0b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:14.766 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.762+0000 7f9421b4e700 1 --2- 172.21.15.184:0/1813198623 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f941c159320 0x7f941c0b1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:14.766 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.762+0000 7f9421b4e700 1 -- 172.21.15.184:0/1813198623 >> v2:172.21.15.39:3300/0 conn(0x7f941c0b1780 msgr2=0x7f941c0cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:14.767 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.762+0000 7f9421b4e700 1 --2- 172.21.15.184:0/1813198623 >> v2:172.21.15.39:3300/0 conn(0x7f941c0b1780 0x7f941c0cd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:14.767 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.762+0000 7f9421b4e700 1 -- 172.21.15.184:0/1813198623 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941c0af040 con 0x7f941c0cd8d0 2023-11-28T11:56:14.767 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.762+0000 7f9421b4e700 1 --2- 172.21.15.184:0/1813198623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f941c0cd8d0 0x7f941c0711e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f941c0c6820 tx=0x7f941400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=880769951d2e1b25 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:14.767 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.762+0000 7f9413fff700 1 -- 172.21.15.184:0/1813198623 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941400e070 con 0x7f941c0cd8d0 2023-11-28T11:56:14.767 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.762+0000 7f9413fff700 1 -- 172.21.15.184:0/1813198623 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941400bb20 con 0x7f941c0cd8d0 2023-11-28T11:56:14.767 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.762+0000 7f9413fff700 1 -- 172.21.15.184:0/1813198623 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9414012430 con 0x7f941c0cd8d0 2023-11-28T11:56:14.768 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.762+0000 7f942234f700 1 -- 172.21.15.184:0/1813198623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f941c0cd8d0 msgr2=0x7f941c0711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:14.768 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.762+0000 7f942234f700 1 --2- 172.21.15.184:0/1813198623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f941c0cd8d0 0x7f941c0711e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f941c0c6820 tx=0x7f941400b330 comp rx=0 tx=0).stop 2023-11-28T11:56:14.768 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.762+0000 7f942234f700 1 -- 172.21.15.184:0/1813198623 shutdown_connections 2023-11-28T11:56:14.768 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.762+0000 7f942234f700 1 --2- 172.21.15.184:0/1813198623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f941c0cd8d0 0x7f941c0711e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:14.768 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.762+0000 7f942234f700 1 --2- 172.21.15.184:0/1813198623 >> v2:172.21.15.39:3300/0 conn(0x7f941c0b1780 0x7f941c0cd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:14.768 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.762+0000 7f942234f700 1 --2- 172.21.15.184:0/1813198623 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f941c159320 0x7f941c0b1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:14.768 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.762+0000 7f942234f700 1 -- 172.21.15.184:0/1813198623 >> 172.21.15.184:0/1813198623 conn(0x7f941c0cc240 msgr2=0x7f941c0cc610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:14.768 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.762+0000 7f942234f700 1 -- 172.21.15.184:0/1813198623 shutdown_connections 2023-11-28T11:56:14.768 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.762+0000 7f942234f700 1 -- 172.21.15.184:0/1813198623 wait complete. 2023-11-28T11:56:14.771 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.766+0000 7f942234f700 1 Processor -- start 2023-11-28T11:56:14.772 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.766+0000 7f942234f700 1 -- start start 2023-11-28T11:56:14.773 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.770+0000 7f942234f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f941c0b1780 0x7f941c1f3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:14.773 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.770+0000 7f942234f700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f941c0cd8d0 0x7f941c157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:14.773 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.770+0000 7f942234f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f941c159320 0x7f941c1ef240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:14.773 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.770+0000 7f942234f700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c159b10 con 0x7f941c0cd8d0 2023-11-28T11:56:14.773 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.770+0000 7f942234f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c1f3f40 con 0x7f941c159320 2023-11-28T11:56:14.773 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.770+0000 7f942234f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941c1576b0 con 0x7f941c0b1780 2023-11-28T11:56:14.775 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.770+0000 7f9421b4e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f941c159320 0x7f941c1ef240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:14.775 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.770+0000 7f942134d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f941c0b1780 0x7f941c1f3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:14.775 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.770+0000 7f9421b4e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f941c159320 0x7f941c1ef240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:54458/0 (socket says 172.21.15.184:54458) 2023-11-28T11:56:14.775 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.770+0000 7f9421b4e700 1 -- 172.21.15.184:0/3009538896 learned_addr learned my addr 172.21.15.184:0/3009538896 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-11-28T11:56:14.775 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.770+0000 7f9420b4c700 1 --2- 172.21.15.184:0/3009538896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f941c0cd8d0 0x7f941c157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:14.776 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.770+0000 7f942134d700 1 -- 172.21.15.184:0/3009538896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f941c159320 msgr2=0x7f941c1ef240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:14.776 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.770+0000 7f942134d700 1 --2- 172.21.15.184:0/3009538896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f941c159320 0x7f941c1ef240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:14.776 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.770+0000 7f942134d700 1 -- 172.21.15.184:0/3009538896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f941c0cd8d0 msgr2=0x7f941c157170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:14.776 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.770+0000 7f942134d700 1 --2- 172.21.15.184:0/3009538896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f941c0cd8d0 0x7f941c157170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:14.776 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.770+0000 7f942134d700 1 -- 172.21.15.184:0/3009538896 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9414009a70 con 0x7f941c0b1780 2023-11-28T11:56:14.776 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.770+0000 7f9420b4c700 1 --2- 172.21.15.184:0/3009538896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f941c0cd8d0 0x7f941c157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:14.776 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.770+0000 7f9421b4e700 1 --2- 172.21.15.184:0/3009538896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f941c159320 0x7f941c1ef240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:14.776 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.770+0000 7f942134d700 1 --2- 172.21.15.184:0/3009538896 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f941c0b1780 0x7f941c1f3a00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f941800e8a0 tx=0x7f941800ebb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:14.776 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.770+0000 7f9411ffb700 1 -- 172.21.15.184:0/3009538896 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9418013680 con 0x7f941c0b1780 2023-11-28T11:56:14.776 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.770+0000 7f9411ffb700 1 -- 172.21.15.184:0/3009538896 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9418013800 con 0x7f941c0b1780 2023-11-28T11:56:14.777 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.770+0000 7f942234f700 1 -- 172.21.15.184:0/3009538896 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f941c1596f0 con 0x7f941c0b1780 2023-11-28T11:56:14.777 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.770+0000 7f9411ffb700 1 -- 172.21.15.184:0/3009538896 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9418013bb0 con 0x7f941c0b1780 2023-11-28T11:56:14.777 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.770+0000 7f9411ffb700 1 -- 172.21.15.184:0/3009538896 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f9418019030 con 0x7f941c0b1780 2023-11-28T11:56:14.777 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.770+0000 7f942234f700 1 -- 172.21.15.184:0/3009538896 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f941c0ca7f0 con 0x7f941c0b1780 2023-11-28T11:56:14.777 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.774+0000 7f9411ffb700 1 -- 172.21.15.184:0/3009538896 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9418005d80 con 0x7f941c0b1780 2023-11-28T11:56:14.778 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.774+0000 7f942234f700 1 -- 172.21.15.184:0/3009538896 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f941c15d030 con 0x7f941c0b1780 2023-11-28T11:56:14.782 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.778+0000 7f9411ffb700 1 -- 172.21.15.184:0/3009538896 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f9418021060 con 0x7f941c0b1780 2023-11-28T11:56:14.863 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.858+0000 7f942234f700 1 -- 172.21.15.184:0/3009538896 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ab7b9010-d38f-4f91-ab43-344fd159f42c", "id": 0} v 0) v1 -- 0x7f941c157920 con 0x7f941c0b1780 2023-11-28T11:56:14.876 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.870+0000 7f9411ffb700 1 -- 172.21.15.184:0/3009538896 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ab7b9010-d38f-4f91-ab43-344fd159f42c", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9418017070 con 0x7f941c0b1780 2023-11-28T11:56:14.876 INFO:teuthology.orchestra.run.smithi184.stdout:0 2023-11-28T11:56:14.878 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.874+0000 7f942234f700 1 -- 172.21.15.184:0/3009538896 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f941c0b1780 msgr2=0x7f941c1f3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:14.878 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.874+0000 7f942234f700 1 --2- 172.21.15.184:0/3009538896 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f941c0b1780 0x7f941c1f3a00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f941800e8a0 tx=0x7f941800ebb0 comp rx=0 tx=0).stop 2023-11-28T11:56:14.878 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.874+0000 7f942234f700 1 -- 172.21.15.184:0/3009538896 shutdown_connections 2023-11-28T11:56:14.878 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.874+0000 7f942234f700 1 --2- 172.21.15.184:0/3009538896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f941c159320 0x7f941c1ef240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:14.879 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.874+0000 7f942234f700 1 --2- 172.21.15.184:0/3009538896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f941c0cd8d0 0x7f941c157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:14.879 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.874+0000 7f942234f700 1 --2- 172.21.15.184:0/3009538896 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f941c0b1780 0x7f941c1f3a00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:14.879 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.874+0000 7f942234f700 1 -- 172.21.15.184:0/3009538896 >> 172.21.15.184:0/3009538896 conn(0x7f941c0cc240 msgr2=0x7f941c0b4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:14.879 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.874+0000 7f942234f700 1 -- 172.21.15.184:0/3009538896 shutdown_connections 2023-11-28T11:56:14.879 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:14.874+0000 7f942234f700 1 -- 172.21.15.184:0/3009538896 wait complete. 2023-11-28T11:56:14.885 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-11-28T11:56:14.882+0000 7fabd39892c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-28T11:56:14.898 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 0d5b9166-b139-4326-a47b-a482226648f0 1 2023-11-28T11:56:14.923 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-11-28T11:56:14.918+0000 7fddf53662c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-28T11:56:14.971 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-11-28T11:56:14.966+0000 7fabd39892c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-28T11:56:15.010 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-11-28T11:56:15.006+0000 7fddf53662c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-28T11:56:15.058 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.054+0000 7f20f1329700 1 Processor -- start 2023-11-28T11:56:15.059 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.054+0000 7f20f1329700 1 -- start start 2023-11-28T11:56:15.061 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.058+0000 7f20f1329700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20ec15c420 0x7f20ec071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:15.061 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.058+0000 7f20f1329700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f20ec071fe0 0x7f20ec069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:15.062 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.058+0000 7f20f1329700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20ec0d0000 con 0x7f20ec06a340 2023-11-28T11:56:15.062 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.058+0000 7f20f1329700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20ec06a7c0 con 0x7f20ec071fe0 2023-11-28T11:56:15.062 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.058+0000 7f20f1329700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec0b8820 con 0x7f20ec15c420 2023-11-28T11:56:15.062 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.058+0000 7f20e37fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f20ec071fe0 0x7f20ec069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:15.062 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.058+0000 7f20f0b28700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f20ec06a340 0x7f20ec0d28b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:53056/0 (socket says 172.21.15.184:53056) 2023-11-28T11:56:15.062 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.058+0000 7f20f0b28700 1 -- 172.21.15.184:0/1202521216 learned_addr learned my addr 172.21.15.184:0/1202521216 (peer_addr_for_me v1:172.21.15.184:0/0) 2023-11-28T11:56:15.062 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.058+0000 7f20ebfff700 1 --2- 172.21.15.184:0/1202521216 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20ec15c420 0x7f20ec071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:15.063 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.058+0000 7f20e37fe700 1 -- 172.21.15.184:0/1202521216 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20ec15c420 msgr2=0x7f20ec071aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:15.064 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.058+0000 7f20e37fe700 1 --2- 172.21.15.184:0/1202521216 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20ec15c420 0x7f20ec071aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:15.064 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.058+0000 7f20e37fe700 1 -- 172.21.15.184:0/1202521216 >> v1:172.21.15.184:6789/0 conn(0x7f20ec06a340 legacy=0x7f20ec0d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:15.064 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.058+0000 7f20eb7fe700 1 -- 172.21.15.184:0/1202521216 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1913886715 0 0) 0x7f20ec0d0000 con 0x7f20ec06a340 2023-11-28T11:56:15.064 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.058+0000 7f20e37fe700 1 -- 172.21.15.184:0/1202521216 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ec0cf3f0 con 0x7f20ec071fe0 2023-11-28T11:56:15.064 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.058+0000 7f20e37fe700 1 --2- 172.21.15.184:0/1202521216 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20ec071fe0 0x7f20ec069e00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f20d4009850 tx=0x7f20d4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6c49c2110bd60ea server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:15.064 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.058+0000 7f20eb7fe700 1 -- 172.21.15.184:0/1202521216 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d4011830 con 0x7f20ec071fe0 2023-11-28T11:56:15.064 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.058+0000 7f20eb7fe700 1 -- 172.21.15.184:0/1202521216 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d4011990 con 0x7f20ec071fe0 2023-11-28T11:56:15.064 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.058+0000 7f20eb7fe700 1 -- 172.21.15.184:0/1202521216 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d4011d40 con 0x7f20ec071fe0 2023-11-28T11:56:15.065 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.062+0000 7f20f1329700 1 -- 172.21.15.184:0/1202521216 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20ec071fe0 msgr2=0x7f20ec069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:15.065 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.062+0000 7f20f1329700 1 --2- 172.21.15.184:0/1202521216 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20ec071fe0 0x7f20ec069e00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f20d4009850 tx=0x7f20d4009b60 comp rx=0 tx=0).stop 2023-11-28T11:56:15.065 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.062+0000 7f20f1329700 1 -- 172.21.15.184:0/1202521216 shutdown_connections 2023-11-28T11:56:15.065 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.062+0000 7f20f1329700 1 --2- 172.21.15.184:0/1202521216 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20ec071fe0 0x7f20ec069e00 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:15.066 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.062+0000 7f20f1329700 1 --2- 172.21.15.184:0/1202521216 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20ec15c420 0x7f20ec071aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:15.066 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.062+0000 7f20f1329700 1 -- 172.21.15.184:0/1202521216 >> 172.21.15.184:0/1202521216 conn(0x7f20ec0b6490 msgr2=0x7f20ec071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:15.066 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.062+0000 7f20f1329700 1 -- 172.21.15.184:0/1202521216 shutdown_connections 2023-11-28T11:56:15.066 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.062+0000 7f20f1329700 1 -- 172.21.15.184:0/1202521216 wait complete. 2023-11-28T11:56:15.068 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.066+0000 7f20f1329700 1 Processor -- start 2023-11-28T11:56:15.069 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.066+0000 7f20f1329700 1 -- start start 2023-11-28T11:56:15.070 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.066+0000 7f20f1329700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20ec06a340 0x7f20ec0d2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:15.070 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.066+0000 7f20f1329700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20ec071fe0 0x7f20ec157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:15.070 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.066+0000 7f20f1329700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20ec15c420 0x7f20ec157660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:15.071 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.066+0000 7f20f1329700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec0cb450 con 0x7f20ec06a340 2023-11-28T11:56:15.071 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.066+0000 7f20f1329700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec0cb730 con 0x7f20ec15c420 2023-11-28T11:56:15.071 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.066+0000 7f20f1329700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec0cba10 con 0x7f20ec071fe0 2023-11-28T11:56:15.071 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.066+0000 7f20e37fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20ec071fe0 0x7f20ec157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:15.071 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.066+0000 7f20e37fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20ec071fe0 0x7f20ec157120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:59576/0 (socket says 172.21.15.184:59576) 2023-11-28T11:56:15.071 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.066+0000 7f20f0b28700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20ec15c420 0x7f20ec157660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:15.071 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.066+0000 7f20e37fe700 1 -- 172.21.15.184:0/3973209939 learned_addr learned my addr 172.21.15.184:0/3973209939 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-11-28T11:56:15.071 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.066+0000 7f20ebfff700 1 --2- 172.21.15.184:0/3973209939 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20ec06a340 0x7f20ec0d2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:15.072 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.066+0000 7f20e37fe700 1 -- 172.21.15.184:0/3973209939 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20ec15c420 msgr2=0x7f20ec157660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:15.072 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.066+0000 7f20e37fe700 1 --2- 172.21.15.184:0/3973209939 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20ec15c420 0x7f20ec157660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:15.072 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.066+0000 7f20e37fe700 1 -- 172.21.15.184:0/3973209939 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20ec06a340 msgr2=0x7f20ec0d2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:15.073 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.066+0000 7f20e37fe700 1 --2- 172.21.15.184:0/3973209939 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20ec06a340 0x7f20ec0d2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:15.073 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.066+0000 7f20e37fe700 1 -- 172.21.15.184:0/3973209939 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d40094b0 con 0x7f20ec071fe0 2023-11-28T11:56:15.073 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.066+0000 7f20e37fe700 1 --2- 172.21.15.184:0/3973209939 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20ec071fe0 0x7f20ec157120 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f20d4000c00 tx=0x7f20d4004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:15.073 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.066+0000 7f20e97fa700 1 -- 172.21.15.184:0/3973209939 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d401a990 con 0x7f20ec071fe0 2023-11-28T11:56:15.073 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.066+0000 7f20e97fa700 1 -- 172.21.15.184:0/3973209939 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d401f070 con 0x7f20ec071fe0 2023-11-28T11:56:15.073 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.066+0000 7f20e97fa700 1 -- 172.21.15.184:0/3973209939 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d401ad30 con 0x7f20ec071fe0 2023-11-28T11:56:15.073 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.066+0000 7f20f1329700 1 -- 172.21.15.184:0/3973209939 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20ec0cf9b0 con 0x7f20ec071fe0 2023-11-28T11:56:15.073 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.066+0000 7f20f1329700 1 -- 172.21.15.184:0/3973209939 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20ec0cf6d0 con 0x7f20ec071fe0 2023-11-28T11:56:15.073 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.070+0000 7f20e97fa700 1 -- 172.21.15.184:0/3973209939 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f20d400f050 con 0x7f20ec071fe0 2023-11-28T11:56:15.073 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.070+0000 7f20e97fa700 1 -- 172.21.15.184:0/3973209939 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f20d4025400 con 0x7f20ec071fe0 2023-11-28T11:56:15.074 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.070+0000 7f20f1329700 1 -- 172.21.15.184:0/3973209939 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20ec0cfc90 con 0x7f20ec071fe0 2023-11-28T11:56:15.076 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.070+0000 7f20e97fa700 1 -- 172.21.15.184:0/3973209939 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f20d4033060 con 0x7f20ec071fe0 2023-11-28T11:56:15.118 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-11-28T11:56:15.114+0000 7fabd39892c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-28T11:56:15.158 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.154+0000 7f20f1329700 1 -- 172.21.15.184:0/3973209939 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0d5b9166-b139-4326-a47b-a482226648f0", "id": 1} v 0) v1 -- 0x7f20ec073cb0 con 0x7f20ec071fe0 2023-11-28T11:56:15.170 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.166+0000 7f20e97fa700 1 -- 172.21.15.184:0/3973209939 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0d5b9166-b139-4326-a47b-a482226648f0", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f20d4021070 con 0x7f20ec071fe0 2023-11-28T11:56:15.171 INFO:teuthology.orchestra.run.smithi184.stdout:1 2023-11-28T11:56:15.172 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.166+0000 7f20f1329700 1 -- 172.21.15.184:0/3973209939 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20ec071fe0 msgr2=0x7f20ec157120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:15.172 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.166+0000 7f20f1329700 1 --2- 172.21.15.184:0/3973209939 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20ec071fe0 0x7f20ec157120 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f20d4000c00 tx=0x7f20d4004770 comp rx=0 tx=0).stop 2023-11-28T11:56:15.173 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-11-28T11:56:15.170+0000 7fddf53662c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-28T11:56:15.173 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.170+0000 7f20f1329700 1 -- 172.21.15.184:0/3973209939 shutdown_connections 2023-11-28T11:56:15.173 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.170+0000 7f20f1329700 1 --2- 172.21.15.184:0/3973209939 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20ec15c420 0x7f20ec157660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:15.173 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.170+0000 7f20f1329700 1 --2- 172.21.15.184:0/3973209939 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20ec071fe0 0x7f20ec157120 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:15.173 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.170+0000 7f20f1329700 1 --2- 172.21.15.184:0/3973209939 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20ec06a340 0x7f20ec0d2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:15.174 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.170+0000 7f20f1329700 1 -- 172.21.15.184:0/3973209939 >> 172.21.15.184:0/3973209939 conn(0x7f20ec0b6490 msgr2=0x7f20ec0b0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:15.174 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.170+0000 7f20f1329700 1 -- 172.21.15.184:0/3973209939 shutdown_connections 2023-11-28T11:56:15.174 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.170+0000 7f20f1329700 1 -- 172.21.15.184:0/3973209939 wait complete. 2023-11-28T11:56:15.191 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 1492ac7a-e277-401c-877e-632f589a2d19 2 2023-11-28T11:56:15.354 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.350+0000 7f97c0c20700 1 Processor -- start 2023-11-28T11:56:15.354 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.350+0000 7f97c0c20700 1 -- start start 2023-11-28T11:56:15.356 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.350+0000 7f97c0c20700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97bc15c640 0x7f97bc0d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:15.356 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.350+0000 7f97c0c20700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97bc06c600 con 0x7f97bc069e00 2023-11-28T11:56:15.356 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.350+0000 7f97c0c20700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97bc0722f0 con 0x7f97bc071aa0 2023-11-28T11:56:15.356 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.350+0000 7f97c0c20700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97bc06cef0 con 0x7f97bc15c640 2023-11-28T11:56:15.357 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.354+0000 7f97b3fff700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f97bc071aa0 0x7f97bc06d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:45548/0 (socket says 172.21.15.184:45548) 2023-11-28T11:56:15.357 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.354+0000 7f97b3fff700 1 -- 172.21.15.184:0/331211928 learned_addr learned my addr 172.21.15.184:0/331211928 (peer_addr_for_me v1:172.21.15.184:0/0) 2023-11-28T11:56:15.357 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.354+0000 7f97bb7fe700 1 --2- 172.21.15.184:0/331211928 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97bc15c640 0x7f97bc0d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:15.358 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.354+0000 7f97baffd700 1 -- 172.21.15.184:0/331211928 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1629671329 0 0) 0x7f97bc0722f0 con 0x7f97bc071aa0 2023-11-28T11:56:15.358 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.354+0000 7f97baffd700 1 -- 172.21.15.184:0/331211928 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97a80035d0 con 0x7f97bc071aa0 2023-11-28T11:56:15.358 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.354+0000 7f97baffd700 1 -- 172.21.15.184:0/331211928 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3270687581 0 0) 0x7f97bc06c600 con 0x7f97bc069e00 2023-11-28T11:56:15.358 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.354+0000 7f97bb7fe700 1 -- 172.21.15.184:0/331211928 >> v1:172.21.15.184:6789/0 conn(0x7f97bc071aa0 legacy=0x7f97bc06d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:15.359 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.354+0000 7f97bb7fe700 1 -- 172.21.15.184:0/331211928 >> v1:172.21.15.39:6789/0 conn(0x7f97bc069e00 legacy=0x7f97bc0d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:15.359 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.354+0000 7f97bb7fe700 1 -- 172.21.15.184:0/331211928 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97bc06da20 con 0x7f97bc15c640 2023-11-28T11:56:15.359 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.354+0000 7f97bb7fe700 1 --2- 172.21.15.184:0/331211928 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97bc15c640 0x7f97bc0d31e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f97ac009880 tx=0x7f97ac009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39998b16b88fb808 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:15.359 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.354+0000 7f97baffd700 1 -- 172.21.15.184:0/331211928 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ac011830 con 0x7f97bc15c640 2023-11-28T11:56:15.359 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.354+0000 7f97baffd700 1 -- 172.21.15.184:0/331211928 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97ac011990 con 0x7f97bc15c640 2023-11-28T11:56:15.359 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.354+0000 7f97baffd700 1 -- 172.21.15.184:0/331211928 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ac011d20 con 0x7f97bc15c640 2023-11-28T11:56:15.360 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.354+0000 7f97c0c20700 1 -- 172.21.15.184:0/331211928 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97bc15c640 msgr2=0x7f97bc0d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:15.360 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.354+0000 7f97c0c20700 1 --2- 172.21.15.184:0/331211928 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97bc15c640 0x7f97bc0d31e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f97ac009880 tx=0x7f97ac009b90 comp rx=0 tx=0).stop 2023-11-28T11:56:15.360 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.354+0000 7f97c0c20700 1 -- 172.21.15.184:0/331211928 shutdown_connections 2023-11-28T11:56:15.360 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.354+0000 7f97c0c20700 1 --2- 172.21.15.184:0/331211928 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97bc15c640 0x7f97bc0d31e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:15.360 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.354+0000 7f97c0c20700 1 -- 172.21.15.184:0/331211928 >> 172.21.15.184:0/331211928 conn(0x7f97bc0b6520 msgr2=0x7f97bc071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:15.360 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.354+0000 7f97c0c20700 1 -- 172.21.15.184:0/331211928 shutdown_connections 2023-11-28T11:56:15.360 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.354+0000 7f97c0c20700 1 -- 172.21.15.184:0/331211928 wait complete. 2023-11-28T11:56:15.362 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.358+0000 7f97c0c20700 1 Processor -- start 2023-11-28T11:56:15.363 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.358+0000 7f97c0c20700 1 -- start start 2023-11-28T11:56:15.366 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.358+0000 7f97c0c20700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97bc069e00 0x7f97bc159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:15.366 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.358+0000 7f97c0c20700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97bc071aa0 0x7f97bc0d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:15.366 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.358+0000 7f97c0c20700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97bc15c640 0x7f97bc0d0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:15.366 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.358+0000 7f97c0c20700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97bc159d80 con 0x7f97bc071aa0 2023-11-28T11:56:15.367 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.358+0000 7f97c0c20700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97bc0cecb0 con 0x7f97bc15c640 2023-11-28T11:56:15.367 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.358+0000 7f97c0c20700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97bc0cef90 con 0x7f97bc069e00 2023-11-28T11:56:15.367 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.358+0000 7f97bb7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97bc069e00 0x7f97bc159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:15.367 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.358+0000 7f97bb7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97bc069e00 0x7f97bc159840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:47514/0 (socket says 172.21.15.184:47514) 2023-11-28T11:56:15.367 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.358+0000 7f97bb7fe700 1 -- 172.21.15.184:0/128993986 learned_addr learned my addr 172.21.15.184:0/128993986 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-11-28T11:56:15.367 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.362+0000 7f97bbfff700 1 --2- 172.21.15.184:0/128993986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97bc15c640 0x7f97bc0d0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:15.367 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.362+0000 7f97b3fff700 1 --2- 172.21.15.184:0/128993986 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97bc071aa0 0x7f97bc0d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:15.367 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.362+0000 7f97bb7fe700 1 -- 172.21.15.184:0/128993986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97bc15c640 msgr2=0x7f97bc0d0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:15.367 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.362+0000 7f97bb7fe700 1 --2- 172.21.15.184:0/128993986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97bc15c640 0x7f97bc0d0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:15.367 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.362+0000 7f97bb7fe700 1 -- 172.21.15.184:0/128993986 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97bc071aa0 msgr2=0x7f97bc0d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:15.368 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.362+0000 7f97bb7fe700 1 --2- 172.21.15.184:0/128993986 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97bc071aa0 0x7f97bc0d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:15.368 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.362+0000 7f97bb7fe700 1 -- 172.21.15.184:0/128993986 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ac0094b0 con 0x7f97bc069e00 2023-11-28T11:56:15.368 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.362+0000 7f97bb7fe700 1 --2- 172.21.15.184:0/128993986 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97bc069e00 0x7f97bc159840 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f97ac013040 tx=0x7f97ac004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:15.368 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.362+0000 7f97b8ff9700 1 -- 172.21.15.184:0/128993986 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ac0198d0 con 0x7f97bc069e00 2023-11-28T11:56:15.368 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.362+0000 7f97b8ff9700 1 -- 172.21.15.184:0/128993986 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97ac01e070 con 0x7f97bc069e00 2023-11-28T11:56:15.369 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.362+0000 7f97c0c20700 1 -- 172.21.15.184:0/128993986 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97bc072010 con 0x7f97bc069e00 2023-11-28T11:56:15.369 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.362+0000 7f97b8ff9700 1 -- 172.21.15.184:0/128993986 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ac019c50 con 0x7f97bc069e00 2023-11-28T11:56:15.369 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.362+0000 7f97c0c20700 1 -- 172.21.15.184:0/128993986 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97bc15ca10 con 0x7f97bc069e00 2023-11-28T11:56:15.369 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.362+0000 7f97b8ff9700 1 -- 172.21.15.184:0/128993986 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f97ac00f050 con 0x7f97bc069e00 2023-11-28T11:56:15.369 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.362+0000 7f97b8ff9700 1 -- 172.21.15.184:0/128993986 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f97ac019db0 con 0x7f97bc069e00 2023-11-28T11:56:15.369 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.362+0000 7f97c0c20700 1 -- 172.21.15.184:0/128993986 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97bc06c830 con 0x7f97bc069e00 2023-11-28T11:56:15.372 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.366+0000 7f97b8ff9700 1 -- 172.21.15.184:0/128993986 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f97ac044b00 con 0x7f97bc069e00 2023-11-28T11:56:15.424 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-11-28T11:56:15.418+0000 7fabd39892c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-28T11:56:15.456 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.454+0000 7f97c0c20700 1 -- 172.21.15.184:0/128993986 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1492ac7a-e277-401c-877e-632f589a2d19", "id": 2} v 0) v1 -- 0x7f97bc073cb0 con 0x7f97bc069e00 2023-11-28T11:56:15.469 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.466+0000 7f97b8ff9700 1 -- 172.21.15.184:0/128993986 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1492ac7a-e277-401c-877e-632f589a2d19", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f97ac033070 con 0x7f97bc069e00 2023-11-28T11:56:15.469 INFO:teuthology.orchestra.run.smithi184.stdout:2 2023-11-28T11:56:15.471 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.466+0000 7f97c0c20700 1 -- 172.21.15.184:0/128993986 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97bc069e00 msgr2=0x7f97bc159840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:15.471 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.466+0000 7f97c0c20700 1 --2- 172.21.15.184:0/128993986 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97bc069e00 0x7f97bc159840 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f97ac013040 tx=0x7f97ac004770 comp rx=0 tx=0).stop 2023-11-28T11:56:15.471 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.466+0000 7f97c0c20700 1 -- 172.21.15.184:0/128993986 shutdown_connections 2023-11-28T11:56:15.471 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.466+0000 7f97c0c20700 1 --2- 172.21.15.184:0/128993986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97bc15c640 0x7f97bc0d0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:15.471 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.466+0000 7f97c0c20700 1 --2- 172.21.15.184:0/128993986 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97bc071aa0 0x7f97bc0d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:15.472 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.466+0000 7f97c0c20700 1 --2- 172.21.15.184:0/128993986 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97bc069e00 0x7f97bc159840 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:15.472 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.466+0000 7f97c0c20700 1 -- 172.21.15.184:0/128993986 >> 172.21.15.184:0/128993986 conn(0x7f97bc0b6520 msgr2=0x7f97bc06d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:15.472 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.466+0000 7f97c0c20700 1 -- 172.21.15.184:0/128993986 shutdown_connections 2023-11-28T11:56:15.472 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.466+0000 7f97c0c20700 1 -- 172.21.15.184:0/128993986 wait complete. 2023-11-28T11:56:15.478 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-11-28T11:56:15.474+0000 7fddf53662c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-28T11:56:15.490 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 4f2be9a8-314a-4e1b-bf5e-600081a01c21 3 2023-11-28T11:56:15.497 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-11-28T11:56:15.490+0000 7fabd39892c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-28T11:56:15.557 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-11-28T11:56:15.554+0000 7fddf53662c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-28T11:56:15.652 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.646+0000 7f878759e700 1 Processor -- start 2023-11-28T11:56:15.652 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.646+0000 7f878759e700 1 -- start start 2023-11-28T11:56:15.653 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.650+0000 7f878759e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87880cd0d0 0x7f87880b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:15.654 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.650+0000 7f878759e700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87880c9d40 con 0x7f878815c650 2023-11-28T11:56:15.654 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.650+0000 7f878759e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87880cd5d0 con 0x7f87880b1b80 2023-11-28T11:56:15.654 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.650+0000 7f878759e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878806b140 con 0x7f87880cd0d0 2023-11-28T11:56:15.654 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.650+0000 7f8786d9d700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f87880b1b80 0x7f878806bed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:45554/0 (socket says 172.21.15.184:45554) 2023-11-28T11:56:15.654 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.650+0000 7f8786d9d700 1 -- 172.21.15.184:0/1631493293 learned_addr learned my addr 172.21.15.184:0/1631493293 (peer_addr_for_me v1:172.21.15.184:0/0) 2023-11-28T11:56:15.654 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.650+0000 7f8785d9b700 1 --2- 172.21.15.184:0/1631493293 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87880cd0d0 0x7f87880b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:15.655 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.650+0000 7f878559a700 1 -- 172.21.15.184:0/1631493293 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2947895499 0 0) 0x7f87880cd5d0 con 0x7f87880b1b80 2023-11-28T11:56:15.655 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.650+0000 7f878559a700 1 -- 172.21.15.184:0/1631493293 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87700035d0 con 0x7f87880b1b80 2023-11-28T11:56:15.655 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.650+0000 7f8785d9b700 1 -- 172.21.15.184:0/1631493293 >> v1:172.21.15.184:6789/0 conn(0x7f87880b1b80 legacy=0x7f878806bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:15.655 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.650+0000 7f8785d9b700 1 -- 172.21.15.184:0/1631493293 >> v1:172.21.15.39:6789/0 conn(0x7f878815c650 legacy=0x7f878806b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:15.655 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.650+0000 7f8785d9b700 1 -- 172.21.15.184:0/1631493293 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87880cd8b0 con 0x7f87880cd0d0 2023-11-28T11:56:15.656 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.650+0000 7f8785d9b700 1 --2- 172.21.15.184:0/1631493293 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87880cd0d0 0x7f87880b1640 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f877c009880 tx=0x7f877c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa205fac3e53676a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:15.656 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.650+0000 7f878559a700 1 -- 172.21.15.184:0/1631493293 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c011830 con 0x7f87880cd0d0 2023-11-28T11:56:15.656 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.650+0000 7f878559a700 1 -- 172.21.15.184:0/1631493293 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877c011990 con 0x7f87880cd0d0 2023-11-28T11:56:15.656 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.650+0000 7f878559a700 1 -- 172.21.15.184:0/1631493293 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c011d20 con 0x7f87880cd0d0 2023-11-28T11:56:15.657 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.654+0000 7f878759e700 1 -- 172.21.15.184:0/1631493293 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87880cd0d0 msgr2=0x7f87880b1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:15.657 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.654+0000 7f878759e700 1 --2- 172.21.15.184:0/1631493293 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87880cd0d0 0x7f87880b1640 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f877c009880 tx=0x7f877c009b90 comp rx=0 tx=0).stop 2023-11-28T11:56:15.658 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.654+0000 7f878759e700 1 -- 172.21.15.184:0/1631493293 shutdown_connections 2023-11-28T11:56:15.658 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.654+0000 7f878759e700 1 --2- 172.21.15.184:0/1631493293 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87880cd0d0 0x7f87880b1640 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:15.658 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.654+0000 7f878759e700 1 -- 172.21.15.184:0/1631493293 >> 172.21.15.184:0/1631493293 conn(0x7f87880b0f80 msgr2=0x7f87880ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:15.658 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.654+0000 7f878759e700 1 -- 172.21.15.184:0/1631493293 shutdown_connections 2023-11-28T11:56:15.658 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.654+0000 7f878759e700 1 -- 172.21.15.184:0/1631493293 wait complete. 2023-11-28T11:56:15.661 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.658+0000 7f878759e700 1 Processor -- start 2023-11-28T11:56:15.662 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.658+0000 7f878759e700 1 -- start start 2023-11-28T11:56:15.668 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.658+0000 7f878759e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f87880b1b80 0x7f878815a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:15.668 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.658+0000 7f878759e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87880cd0d0 0x7f87880ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:15.668 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.658+0000 7f878759e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f878815c650 0x7f87880ca710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:15.668 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.658+0000 7f878759e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87880c7c30 con 0x7f87880b1b80 2023-11-28T11:56:15.668 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.658+0000 7f878759e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87880ad260 con 0x7f878815c650 2023-11-28T11:56:15.668 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.658+0000 7f878759e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87880a74f0 con 0x7f87880cd0d0 2023-11-28T11:56:15.668 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.658+0000 7f8785d9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87880cd0d0 0x7f87880ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:15.668 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.658+0000 7f8785d9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87880cd0d0 0x7f87880ca1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:47522/0 (socket says 172.21.15.184:47522) 2023-11-28T11:56:15.668 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.658+0000 7f8785d9b700 1 -- 172.21.15.184:0/106267760 learned_addr learned my addr 172.21.15.184:0/106267760 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-11-28T11:56:15.668 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.658+0000 7f8786d9d700 1 --2- 172.21.15.184:0/106267760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f878815c650 0x7f87880ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:15.669 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.658+0000 7f878659c700 1 --2- 172.21.15.184:0/106267760 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f87880b1b80 0x7f878815a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:15.669 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.658+0000 7f8785d9b700 1 -- 172.21.15.184:0/106267760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f878815c650 msgr2=0x7f87880ca710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:15.669 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.658+0000 7f8785d9b700 1 --2- 172.21.15.184:0/106267760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f878815c650 0x7f87880ca710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:15.669 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.658+0000 7f8785d9b700 1 -- 172.21.15.184:0/106267760 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f87880b1b80 msgr2=0x7f878815a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:15.669 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.658+0000 7f8785d9b700 1 --2- 172.21.15.184:0/106267760 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f87880b1b80 0x7f878815a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:15.670 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.658+0000 7f8785d9b700 1 -- 172.21.15.184:0/106267760 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877c0094b0 con 0x7f87880cd0d0 2023-11-28T11:56:15.670 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.662+0000 7f8785d9b700 1 --2- 172.21.15.184:0/106267760 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87880cd0d0 0x7f87880ca1d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f877c013040 tx=0x7f877c004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:15.670 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.662+0000 7f8776ffd700 1 -- 172.21.15.184:0/106267760 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c004610 con 0x7f87880cd0d0 2023-11-28T11:56:15.670 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.662+0000 7f8776ffd700 1 -- 172.21.15.184:0/106267760 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877c0036c0 con 0x7f87880cd0d0 2023-11-28T11:56:15.670 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.662+0000 7f8776ffd700 1 -- 172.21.15.184:0/106267760 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c003a50 con 0x7f87880cd0d0 2023-11-28T11:56:15.670 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.662+0000 7f878759e700 1 -- 172.21.15.184:0/106267760 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87880c9680 con 0x7f87880cd0d0 2023-11-28T11:56:15.670 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.662+0000 7f878759e700 1 -- 172.21.15.184:0/106267760 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87880c99d0 con 0x7f87880cd0d0 2023-11-28T11:56:15.670 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.662+0000 7f8776ffd700 1 -- 172.21.15.184:0/106267760 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f877c00f050 con 0x7f87880cd0d0 2023-11-28T11:56:15.670 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.662+0000 7f8776ffd700 1 -- 172.21.15.184:0/106267760 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f877c01b890 con 0x7f87880cd0d0 2023-11-28T11:56:15.670 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.662+0000 7f878759e700 1 -- 172.21.15.184:0/106267760 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f878806c590 con 0x7f87880cd0d0 2023-11-28T11:56:15.671 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.666+0000 7f8776ffd700 1 -- 172.21.15.184:0/106267760 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f877c02a020 con 0x7f87880cd0d0 2023-11-28T11:56:15.749 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.746+0000 7f878759e700 1 -- 172.21.15.184:0/106267760 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4f2be9a8-314a-4e1b-bf5e-600081a01c21", "id": 3} v 0) v1 -- 0x7f87880a7630 con 0x7f87880cd0d0 2023-11-28T11:56:15.752 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-11-28T11:56:15.750+0000 7fabd39892c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-28T11:56:15.760 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.754+0000 7f8776ffd700 1 -- 172.21.15.184:0/106267760 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4f2be9a8-314a-4e1b-bf5e-600081a01c21", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f87880a7630 con 0x7f87880cd0d0 2023-11-28T11:56:15.760 INFO:teuthology.orchestra.run.smithi184.stdout:3 2023-11-28T11:56:15.761 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.758+0000 7f878759e700 1 -- 172.21.15.184:0/106267760 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87880cd0d0 msgr2=0x7f87880ca1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:15.762 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.758+0000 7f878759e700 1 --2- 172.21.15.184:0/106267760 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87880cd0d0 0x7f87880ca1d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f877c013040 tx=0x7f877c004770 comp rx=0 tx=0).stop 2023-11-28T11:56:15.762 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.758+0000 7f878759e700 1 -- 172.21.15.184:0/106267760 shutdown_connections 2023-11-28T11:56:15.762 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.758+0000 7f878759e700 1 --2- 172.21.15.184:0/106267760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f878815c650 0x7f87880ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:15.762 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.758+0000 7f878759e700 1 --2- 172.21.15.184:0/106267760 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87880cd0d0 0x7f87880ca1d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:15.762 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.758+0000 7f878759e700 1 --2- 172.21.15.184:0/106267760 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f87880b1b80 0x7f878815a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:15.762 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.758+0000 7f878759e700 1 -- 172.21.15.184:0/106267760 >> 172.21.15.184:0/106267760 conn(0x7f87880b0f80 msgr2=0x7f8788070060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:15.762 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.758+0000 7f878759e700 1 -- 172.21.15.184:0/106267760 shutdown_connections 2023-11-28T11:56:15.762 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.758+0000 7f878759e700 1 -- 172.21.15.184:0/106267760 wait complete. 2023-11-28T11:56:15.783 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 22505471-2a47-4f4e-a1ab-e765cc32fb45 4 2023-11-28T11:56:15.806 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-11-28T11:56:15.802+0000 7fddf53662c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-28T11:56:15.838 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-11-28T11:56:15.834+0000 7fabd39892c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-28T11:56:15.899 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-11-28T11:56:15.894+0000 7fddf53662c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-28T11:56:15.932 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-11-28T11:56:15.930+0000 7fabd39892c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-28T11:56:15.933 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.930+0000 7fb77d537700 1 Processor -- start 2023-11-28T11:56:15.934 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.930+0000 7fb77d537700 1 -- start start 2023-11-28T11:56:15.937 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.934+0000 7fb77d537700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7780c9d90 0x7fb778069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:15.937 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.934+0000 7fb77d537700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb77815ceb0 con 0x7fb77806cb00 2023-11-28T11:56:15.937 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.934+0000 7fb77d537700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb77815d190 con 0x7fb778158e50 2023-11-28T11:56:15.937 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.934+0000 7fb776ffd700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fb778158e50 0x7fb77806c3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:45564/0 (socket says 172.21.15.184:45564) 2023-11-28T11:56:15.937 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.934+0000 7fb776ffd700 1 -- 172.21.15.184:0/1453974753 learned_addr learned my addr 172.21.15.184:0/1453974753 (peer_addr_for_me v1:172.21.15.184:0/0) 2023-11-28T11:56:15.937 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.934+0000 7fb77d537700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77806a130 con 0x7fb7780c9d90 2023-11-28T11:56:15.938 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.934+0000 7fb7777fe700 1 --2- 172.21.15.184:0/1453974753 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7780c9d90 0x7fb778069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:15.939 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.934+0000 7fb7777fe700 1 -- 172.21.15.184:0/1453974753 >> v1:172.21.15.184:6789/0 conn(0x7fb778158e50 legacy=0x7fb77806c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:15.939 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.934+0000 7fb7777fe700 1 -- 172.21.15.184:0/1453974753 >> v1:172.21.15.39:6789/0 conn(0x7fb77806cb00 legacy=0x7fb77806a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:15.939 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.934+0000 7fb7777fe700 1 -- 172.21.15.184:0/1453974753 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb77815d470 con 0x7fb7780c9d90 2023-11-28T11:56:15.939 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.934+0000 7fb7777fe700 1 --2- 172.21.15.184:0/1453974753 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7780c9d90 0x7fb778069bf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb7780cee70 tx=0x7fb77000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b54278cd690e308 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:15.939 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.934+0000 7fb775ffb700 1 -- 172.21.15.184:0/1453974753 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77000e070 con 0x7fb7780c9d90 2023-11-28T11:56:15.939 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.934+0000 7fb775ffb700 1 -- 172.21.15.184:0/1453974753 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb770003a90 con 0x7fb7780c9d90 2023-11-28T11:56:15.939 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.934+0000 7fb775ffb700 1 -- 172.21.15.184:0/1453974753 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb770003e20 con 0x7fb7780c9d90 2023-11-28T11:56:15.940 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.934+0000 7fb77d537700 1 -- 172.21.15.184:0/1453974753 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7780c9d90 msgr2=0x7fb778069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:15.940 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.934+0000 7fb77d537700 1 --2- 172.21.15.184:0/1453974753 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7780c9d90 0x7fb778069bf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb7780cee70 tx=0x7fb77000b330 comp rx=0 tx=0).stop 2023-11-28T11:56:15.940 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.934+0000 7fb77d537700 1 -- 172.21.15.184:0/1453974753 shutdown_connections 2023-11-28T11:56:15.940 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.934+0000 7fb77d537700 1 --2- 172.21.15.184:0/1453974753 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7780c9d90 0x7fb778069bf0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:15.940 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.934+0000 7fb77d537700 1 -- 172.21.15.184:0/1453974753 >> 172.21.15.184:0/1453974753 conn(0x7fb7780b0a20 msgr2=0x7fb7780b0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:15.940 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.934+0000 7fb77d537700 1 -- 172.21.15.184:0/1453974753 shutdown_connections 2023-11-28T11:56:15.940 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.934+0000 7fb77d537700 1 -- 172.21.15.184:0/1453974753 wait complete. 2023-11-28T11:56:15.944 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.938+0000 7fb77d537700 1 Processor -- start 2023-11-28T11:56:15.944 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.938+0000 7fb77d537700 1 -- start start 2023-11-28T11:56:15.948 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.942+0000 7fb77d537700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb77806cb00 0x7fb7780b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:15.948 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.942+0000 7fb77d537700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7780c9d90 0x7fb77814f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:15.948 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.942+0000 7fb77d537700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb778158e50 0x7fb7780ad590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:15.948 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.942+0000 7fb77d537700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7780ac2f0 con 0x7fb77806cb00 2023-11-28T11:56:15.948 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.942+0000 7fb77d537700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77814f9f0 con 0x7fb778158e50 2023-11-28T11:56:15.948 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.942+0000 7fb77d537700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7780adad0 con 0x7fb7780c9d90 2023-11-28T11:56:15.948 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.942+0000 7fb7767fc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7780c9d90 0x7fb77814f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:15.948 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.942+0000 7fb7767fc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7780c9d90 0x7fb77814f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:47548/0 (socket says 172.21.15.184:47548) 2023-11-28T11:56:15.948 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.942+0000 7fb7777fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb778158e50 0x7fb7780ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:15.948 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.942+0000 7fb7767fc700 1 -- 172.21.15.184:0/1911440549 learned_addr learned my addr 172.21.15.184:0/1911440549 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-11-28T11:56:15.949 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.942+0000 7fb776ffd700 1 --2- 172.21.15.184:0/1911440549 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb77806cb00 0x7fb7780b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:15.949 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.942+0000 7fb7767fc700 1 -- 172.21.15.184:0/1911440549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb778158e50 msgr2=0x7fb7780ad590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:15.949 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.942+0000 7fb7767fc700 1 --2- 172.21.15.184:0/1911440549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb778158e50 0x7fb7780ad590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:15.949 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.942+0000 7fb7767fc700 1 -- 172.21.15.184:0/1911440549 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb77806cb00 msgr2=0x7fb7780b3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:15.949 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.942+0000 7fb7767fc700 1 --2- 172.21.15.184:0/1911440549 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb77806cb00 0x7fb7780b3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:15.949 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.942+0000 7fb7767fc700 1 -- 172.21.15.184:0/1911440549 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb770009a70 con 0x7fb7780c9d90 2023-11-28T11:56:15.949 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.942+0000 7fb7777fe700 1 --2- 172.21.15.184:0/1911440549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb778158e50 0x7fb7780ad590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:15.950 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.946+0000 7fb7767fc700 1 --2- 172.21.15.184:0/1911440549 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7780c9d90 0x7fb77814f4b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb76c00b480 tx=0x7fb76c00b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:15.950 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.946+0000 7fb75f7fe700 1 -- 172.21.15.184:0/1911440549 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c00be50 con 0x7fb7780c9d90 2023-11-28T11:56:15.950 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.946+0000 7fb75f7fe700 1 -- 172.21.15.184:0/1911440549 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76c004020 con 0x7fb7780c9d90 2023-11-28T11:56:15.950 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.946+0000 7fb75f7fe700 1 -- 172.21.15.184:0/1911440549 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c0043d0 con 0x7fb7780c9d90 2023-11-28T11:56:15.951 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.946+0000 7fb77d537700 1 -- 172.21.15.184:0/1911440549 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7780ccf10 con 0x7fb7780c9d90 2023-11-28T11:56:15.951 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.946+0000 7fb77d537700 1 -- 172.21.15.184:0/1911440549 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb77815d750 con 0x7fb7780c9d90 2023-11-28T11:56:15.951 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.946+0000 7fb75f7fe700 1 -- 172.21.15.184:0/1911440549 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fb76c00f050 con 0x7fb7780c9d90 2023-11-28T11:56:15.951 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.946+0000 7fb75f7fe700 1 -- 172.21.15.184:0/1911440549 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fb76c004530 con 0x7fb7780c9d90 2023-11-28T11:56:15.951 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.946+0000 7fb77d537700 1 -- 172.21.15.184:0/1911440549 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb77815caf0 con 0x7fb7780c9d90 2023-11-28T11:56:15.955 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:15.950+0000 7fb75f7fe700 1 -- 172.21.15.184:0/1911440549 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fb76c015030 con 0x7fb7780c9d90 2023-11-28T11:56:15.998 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-11-28T11:56:15.994+0000 7fddf53662c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-28T11:56:16.028 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.022+0000 7fb77d537700 1 -- 172.21.15.184:0/1911440549 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd new", "uuid": "22505471-2a47-4f4e-a1ab-e765cc32fb45", "id": 4} v 0) v1 -- 0x7fb7780ac4a0 con 0x7fb7780c9d90 2023-11-28T11:56:16.041 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.038+0000 7fb75f7fe700 1 -- 172.21.15.184:0/1911440549 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "22505471-2a47-4f4e-a1ab-e765cc32fb45", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb7780ac4a0 con 0x7fb7780c9d90 2023-11-28T11:56:16.041 INFO:teuthology.orchestra.run.smithi184.stdout:4 2023-11-28T11:56:16.043 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.038+0000 7fb77d537700 1 -- 172.21.15.184:0/1911440549 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7780c9d90 msgr2=0x7fb77814f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:16.043 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.038+0000 7fb77d537700 1 --2- 172.21.15.184:0/1911440549 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7780c9d90 0x7fb77814f4b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb76c00b480 tx=0x7fb76c00b790 comp rx=0 tx=0).stop 2023-11-28T11:56:16.043 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.038+0000 7fb77d537700 1 -- 172.21.15.184:0/1911440549 shutdown_connections 2023-11-28T11:56:16.043 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.038+0000 7fb77d537700 1 --2- 172.21.15.184:0/1911440549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb778158e50 0x7fb7780ad590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:16.043 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.038+0000 7fb77d537700 1 --2- 172.21.15.184:0/1911440549 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7780c9d90 0x7fb77814f4b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:16.043 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.038+0000 7fb77d537700 1 --2- 172.21.15.184:0/1911440549 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb77806cb00 0x7fb7780b3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:16.043 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.038+0000 7fb77d537700 1 -- 172.21.15.184:0/1911440549 >> 172.21.15.184:0/1911440549 conn(0x7fb7780b0a20 msgr2=0x7fb7780ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:16.043 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.038+0000 7fb77d537700 1 -- 172.21.15.184:0/1911440549 shutdown_connections 2023-11-28T11:56:16.043 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.038+0000 7fb77d537700 1 -- 172.21.15.184:0/1911440549 wait complete. 2023-11-28T11:56:16.066 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d 5 2023-11-28T11:56:16.227 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.222+0000 7fa538fa1700 1 Processor -- start 2023-11-28T11:56:16.227 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.222+0000 7fa538fa1700 1 -- start start 2023-11-28T11:56:16.229 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.226+0000 7fa538fa1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa53415c640 0x7fa5340d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:16.229 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.226+0000 7fa538fa1700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa534069e00 0x7fa53406a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:16.229 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.226+0000 7fa538fa1700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa53406c600 con 0x7fa534071aa0 2023-11-28T11:56:16.229 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.226+0000 7fa538fa1700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa53406cef0 con 0x7fa534069e00 2023-11-28T11:56:16.229 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.226+0000 7fa538fa1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa53406a7c0 con 0x7fa53415c640 2023-11-28T11:56:16.230 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.226+0000 7fa532ffd700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fa534071aa0 0x7fa53406d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:45572/0 (socket says 172.21.15.184:45572) 2023-11-28T11:56:16.230 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.226+0000 7fa532ffd700 1 -- 172.21.15.184:0/3294130532 learned_addr learned my addr 172.21.15.184:0/3294130532 (peer_addr_for_me v1:172.21.15.184:0/0) 2023-11-28T11:56:16.230 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.226+0000 7fa5337fe700 1 --2- 172.21.15.184:0/3294130532 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa53415c640 0x7fa5340d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:16.231 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.226+0000 7fa533fff700 1 --2- 172.21.15.184:0/3294130532 >> v2:172.21.15.39:3300/0 conn(0x7fa534069e00 0x7fa53406a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:16.231 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.226+0000 7fa5327fc700 1 -- 172.21.15.184:0/3294130532 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2398075477 0 0) 0x7fa53406c600 con 0x7fa534071aa0 2023-11-28T11:56:16.231 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.226+0000 7fa5327fc700 1 -- 172.21.15.184:0/3294130532 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa51c0035d0 con 0x7fa534071aa0 2023-11-28T11:56:16.231 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.226+0000 7fa5327fc700 1 -- 172.21.15.184:0/3294130532 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2228263753 0 0) 0x7fa51c0035d0 con 0x7fa534071aa0 2023-11-28T11:56:16.231 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.226+0000 7fa5337fe700 1 -- 172.21.15.184:0/3294130532 >> v2:172.21.15.39:3300/0 conn(0x7fa534069e00 msgr2=0x7fa53406a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:16.232 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.226+0000 7fa5337fe700 1 --2- 172.21.15.184:0/3294130532 >> v2:172.21.15.39:3300/0 conn(0x7fa534069e00 0x7fa53406a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:16.232 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.226+0000 7fa5337fe700 1 -- 172.21.15.184:0/3294130532 >> v1:172.21.15.184:6789/0 conn(0x7fa534071aa0 legacy=0x7fa53406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:16.232 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.226+0000 7fa5337fe700 1 -- 172.21.15.184:0/3294130532 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5340722f0 con 0x7fa53415c640 2023-11-28T11:56:16.232 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.226+0000 7fa5337fe700 1 --2- 172.21.15.184:0/3294130532 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa53415c640 0x7fa5340d31e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa524009850 tx=0x7fa524009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14b3a5c5e9c3592 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:16.232 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.226+0000 7fa5327fc700 1 -- 172.21.15.184:0/3294130532 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa528001670 con 0x7fa53415c640 2023-11-28T11:56:16.232 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.226+0000 7fa5327fc700 1 -- 172.21.15.184:0/3294130532 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa524004030 con 0x7fa53415c640 2023-11-28T11:56:16.232 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.226+0000 7fa5327fc700 1 -- 172.21.15.184:0/3294130532 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5240043e0 con 0x7fa53415c640 2023-11-28T11:56:16.233 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.230+0000 7fa538fa1700 1 -- 172.21.15.184:0/3294130532 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa53415c640 msgr2=0x7fa5340d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:16.233 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.230+0000 7fa538fa1700 1 --2- 172.21.15.184:0/3294130532 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa53415c640 0x7fa5340d31e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa524009850 tx=0x7fa524009b60 comp rx=0 tx=0).stop 2023-11-28T11:56:16.233 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.230+0000 7fa538fa1700 1 -- 172.21.15.184:0/3294130532 shutdown_connections 2023-11-28T11:56:16.233 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.230+0000 7fa538fa1700 1 --2- 172.21.15.184:0/3294130532 >> v2:172.21.15.39:3300/0 conn(0x7fa534069e00 0x7fa53406a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:16.233 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.230+0000 7fa538fa1700 1 --2- 172.21.15.184:0/3294130532 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa53415c640 0x7fa5340d31e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:16.233 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.230+0000 7fa538fa1700 1 -- 172.21.15.184:0/3294130532 >> 172.21.15.184:0/3294130532 conn(0x7fa5340b6520 msgr2=0x7fa534071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:16.233 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.230+0000 7fa538fa1700 1 -- 172.21.15.184:0/3294130532 shutdown_connections 2023-11-28T11:56:16.234 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.230+0000 7fa538fa1700 1 -- 172.21.15.184:0/3294130532 wait complete. 2023-11-28T11:56:16.236 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.234+0000 7fa538fa1700 1 Processor -- start 2023-11-28T11:56:16.237 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.234+0000 7fa538fa1700 1 -- start start 2023-11-28T11:56:16.238 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.234+0000 7fa538fa1700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa534069e00 0x7fa534159a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:16.239 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.234+0000 7fa538fa1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa534071aa0 0x7fa5340d1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:16.239 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.234+0000 7fa538fa1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa53415c640 0x7fa5340d1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:16.239 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.234+0000 7fa538fa1700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5340b53d0 con 0x7fa534069e00 2023-11-28T11:56:16.239 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.234+0000 7fa538fa1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5340b2520 con 0x7fa534071aa0 2023-11-28T11:56:16.239 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.234+0000 7fa538fa1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5340b2800 con 0x7fa53415c640 2023-11-28T11:56:16.239 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.234+0000 7fa532ffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa534071aa0 0x7fa5340d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:16.239 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.234+0000 7fa533fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa53415c640 0x7fa5340d1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:16.239 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.234+0000 7fa533fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa53415c640 0x7fa5340d1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:47576/0 (socket says 172.21.15.184:47576) 2023-11-28T11:56:16.239 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.234+0000 7fa532ffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa534071aa0 0x7fa5340d1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:51066/0 (socket says 172.21.15.184:51066) 2023-11-28T11:56:16.239 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.234+0000 7fa533fff700 1 -- 172.21.15.184:0/2613940154 learned_addr learned my addr 172.21.15.184:0/2613940154 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-11-28T11:56:16.239 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.234+0000 7fa5337fe700 1 --2- 172.21.15.184:0/2613940154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa534069e00 0x7fa534159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:16.241 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.234+0000 7fa532ffd700 1 -- 172.21.15.184:0/2613940154 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa53415c640 msgr2=0x7fa5340d1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:16.241 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.234+0000 7fa532ffd700 1 --2- 172.21.15.184:0/2613940154 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa53415c640 0x7fa5340d1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:16.241 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.234+0000 7fa532ffd700 1 -- 172.21.15.184:0/2613940154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa534069e00 msgr2=0x7fa534159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:16.241 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.234+0000 7fa532ffd700 1 --2- 172.21.15.184:0/2613940154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa534069e00 0x7fa534159a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:16.241 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.234+0000 7fa532ffd700 1 -- 172.21.15.184:0/2613940154 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5240094b0 con 0x7fa534071aa0 2023-11-28T11:56:16.241 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.234+0000 7fa533fff700 1 --2- 172.21.15.184:0/2613940154 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa53415c640 0x7fa5340d1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:16.241 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.234+0000 7fa532ffd700 1 --2- 172.21.15.184:0/2613940154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa534071aa0 0x7fa5340d1570 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa5280011e0 tx=0x7fa52800c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:16.241 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.234+0000 7fa51bfff700 1 -- 172.21.15.184:0/2613940154 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa528004ca0 con 0x7fa534071aa0 2023-11-28T11:56:16.242 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.234+0000 7fa51bfff700 1 -- 172.21.15.184:0/2613940154 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa528004e00 con 0x7fa534071aa0 2023-11-28T11:56:16.242 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.234+0000 7fa51bfff700 1 -- 172.21.15.184:0/2613940154 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa528007310 con 0x7fa534071aa0 2023-11-28T11:56:16.242 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.234+0000 7fa538fa1700 1 -- 172.21.15.184:0/2613940154 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa53415ca10 con 0x7fa534071aa0 2023-11-28T11:56:16.242 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.234+0000 7fa538fa1700 1 -- 172.21.15.184:0/2613940154 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa53406da20 con 0x7fa534071aa0 2023-11-28T11:56:16.242 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.238+0000 7fa51bfff700 1 -- 172.21.15.184:0/2613940154 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fa52801a020 con 0x7fa534071aa0 2023-11-28T11:56:16.242 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.238+0000 7fa51bfff700 1 -- 172.21.15.184:0/2613940154 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fa52801d3f0 con 0x7fa534071aa0 2023-11-28T11:56:16.242 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.238+0000 7fa538fa1700 1 -- 172.21.15.184:0/2613940154 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa534072010 con 0x7fa534071aa0 2023-11-28T11:56:16.244 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.242+0000 7fa51bfff700 1 -- 172.21.15.184:0/2613940154 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fa528007470 con 0x7fa534071aa0 2023-11-28T11:56:16.324 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.318+0000 7fa538fa1700 1 -- 172.21.15.184:0/2613940154 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d", "id": 5} v 0) v1 -- 0x7fa5340718c0 con 0x7fa534071aa0 2023-11-28T11:56:16.333 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.330+0000 7fa51bfff700 1 -- 172.21.15.184:0/2613940154 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa528007610 con 0x7fa534071aa0 2023-11-28T11:56:16.338 INFO:teuthology.orchestra.run.smithi184.stdout:5 2023-11-28T11:56:16.338 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.330+0000 7fa538fa1700 1 -- 172.21.15.184:0/2613940154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa534071aa0 msgr2=0x7fa5340d1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:16.339 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.330+0000 7fa538fa1700 1 --2- 172.21.15.184:0/2613940154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa534071aa0 0x7fa5340d1570 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa5280011e0 tx=0x7fa52800c7e0 comp rx=0 tx=0).stop 2023-11-28T11:56:16.339 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.330+0000 7fa538fa1700 1 -- 172.21.15.184:0/2613940154 shutdown_connections 2023-11-28T11:56:16.339 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.330+0000 7fa538fa1700 1 --2- 172.21.15.184:0/2613940154 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa53415c640 0x7fa5340d1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:16.339 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.330+0000 7fa538fa1700 1 --2- 172.21.15.184:0/2613940154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa534071aa0 0x7fa5340d1570 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:16.339 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.330+0000 7fa538fa1700 1 --2- 172.21.15.184:0/2613940154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa534069e00 0x7fa534159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:16.339 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.330+0000 7fa538fa1700 1 -- 172.21.15.184:0/2613940154 >> 172.21.15.184:0/2613940154 conn(0x7fa5340b6520 msgr2=0x7fa53415b910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:16.339 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.330+0000 7fa538fa1700 1 -- 172.21.15.184:0/2613940154 shutdown_connections 2023-11-28T11:56:16.339 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.330+0000 7fa538fa1700 1 -- 172.21.15.184:0/2613940154 wait complete. 2023-11-28T11:56:16.357 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 52838753-04a9-417b-95df-6fbe87b817c0 6 2023-11-28T11:56:16.442 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-11-28T11:56:16.438+0000 7fabd39892c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-28T11:56:16.472 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-11-28T11:56:16.466+0000 7fddf53662c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-28T11:56:16.522 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.518+0000 7f374decb700 1 Processor -- start 2023-11-28T11:56:16.522 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.518+0000 7f374decb700 1 -- start start 2023-11-28T11:56:16.525 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.522+0000 7f374decb700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f37480cfc40 0x7f37480b17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:16.525 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.522+0000 7f374decb700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3748072270 con 0x7f374815c6d0 2023-11-28T11:56:16.525 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.522+0000 7f374decb700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37480d0120 con 0x7f374806a300 2023-11-28T11:56:16.525 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.522+0000 7f374decb700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37480d0400 con 0x7f37480cfc40 2023-11-28T11:56:16.526 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.522+0000 7f3747fff700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f374806a300 0x7f374806c5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:45586/0 (socket says 172.21.15.184:45586) 2023-11-28T11:56:16.526 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.522+0000 7f3747fff700 1 -- 172.21.15.184:0/2927933581 learned_addr learned my addr 172.21.15.184:0/2927933581 (peer_addr_for_me v1:172.21.15.184:0/0) 2023-11-28T11:56:16.526 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.522+0000 7f374d6ca700 1 --2- 172.21.15.184:0/2927933581 >> v2:172.21.15.39:3300/0 conn(0x7f37480cfc40 0x7f37480b17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:16.526 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.522+0000 7f37477fe700 1 -- 172.21.15.184:0/2927933581 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3010210735 0 0) 0x7f37480d0120 con 0x7f374806a300 2023-11-28T11:56:16.527 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.522+0000 7f37477fe700 1 -- 172.21.15.184:0/2927933581 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37380035d0 con 0x7f374806a300 2023-11-28T11:56:16.527 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.522+0000 7f37477fe700 1 -- 172.21.15.184:0/2927933581 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4254398745 0 0) 0x7f3748072270 con 0x7f374815c6d0 2023-11-28T11:56:16.527 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.522+0000 7f37477fe700 1 -- 172.21.15.184:0/2927933581 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37480d0120 con 0x7f374815c6d0 2023-11-28T11:56:16.527 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.522+0000 7f374d6ca700 1 -- 172.21.15.184:0/2927933581 >> v1:172.21.15.184:6789/0 conn(0x7f374806a300 legacy=0x7f374806c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:16.527 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.522+0000 7f37477fe700 1 -- 172.21.15.184:0/2927933581 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2984797008 0 0) 0x7f37380035d0 con 0x7f374806a300 2023-11-28T11:56:16.527 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.522+0000 7f374d6ca700 1 -- 172.21.15.184:0/2927933581 >> v1:172.21.15.39:6789/0 conn(0x7f374815c6d0 legacy=0x7f3748069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:16.527 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.522+0000 7f374d6ca700 1 -- 172.21.15.184:0/2927933581 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3748071c20 con 0x7f37480cfc40 2023-11-28T11:56:16.528 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.522+0000 7f374d6ca700 1 --2- 172.21.15.184:0/2927933581 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37480cfc40 0x7f37480b17a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3740009d90 tx=0x7f374000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fa5e6560ad44137 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:16.528 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.522+0000 7f37477fe700 1 -- 172.21.15.184:0/2927933581 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374000e070 con 0x7f37480cfc40 2023-11-28T11:56:16.528 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.522+0000 7f37477fe700 1 -- 172.21.15.184:0/2927933581 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3740003a40 con 0x7f37480cfc40 2023-11-28T11:56:16.528 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.522+0000 7f37477fe700 1 -- 172.21.15.184:0/2927933581 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3734001670 con 0x7f37480cfc40 2023-11-28T11:56:16.529 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.526+0000 7f374decb700 1 -- 172.21.15.184:0/2927933581 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37480cfc40 msgr2=0x7f37480b17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:16.529 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.526+0000 7f374decb700 1 --2- 172.21.15.184:0/2927933581 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37480cfc40 0x7f37480b17a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3740009d90 tx=0x7f374000b330 comp rx=0 tx=0).stop 2023-11-28T11:56:16.530 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.526+0000 7f374decb700 1 -- 172.21.15.184:0/2927933581 shutdown_connections 2023-11-28T11:56:16.530 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.526+0000 7f374decb700 1 --2- 172.21.15.184:0/2927933581 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37480cfc40 0x7f37480b17a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:16.530 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.526+0000 7f374decb700 1 -- 172.21.15.184:0/2927933581 >> 172.21.15.184:0/2927933581 conn(0x7f37480b6520 msgr2=0x7f3748071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:16.530 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.526+0000 7f374decb700 1 -- 172.21.15.184:0/2927933581 shutdown_connections 2023-11-28T11:56:16.530 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.526+0000 7f374decb700 1 -- 172.21.15.184:0/2927933581 wait complete. 2023-11-28T11:56:16.532 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.526+0000 7f374decb700 1 Processor -- start 2023-11-28T11:56:16.532 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.530+0000 7f374decb700 1 -- start start 2023-11-28T11:56:16.534 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.530+0000 7f374decb700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f374806a300 0x7f37480ce580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:16.534 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.530+0000 7f374decb700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37480cfc40 0x7f37480cc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:16.534 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.530+0000 7f374decb700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f374815c6d0 0x7f3748159610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:16.535 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.530+0000 7f374decb700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37480b2410 con 0x7f374806a300 2023-11-28T11:56:16.535 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.530+0000 7f374decb700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37480cc7d0 con 0x7f37480cfc40 2023-11-28T11:56:16.535 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.530+0000 7f374decb700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37480b2620 con 0x7f374815c6d0 2023-11-28T11:56:16.535 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.530+0000 7f3747fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37480cfc40 0x7f37480cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:16.535 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.530+0000 7f374d6ca700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f374815c6d0 0x7f3748159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:16.535 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.530+0000 7f3747fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37480cfc40 0x7f37480cc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:51080/0 (socket says 172.21.15.184:51080) 2023-11-28T11:56:16.535 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.530+0000 7f3747fff700 1 -- 172.21.15.184:0/2751161061 learned_addr learned my addr 172.21.15.184:0/2751161061 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-11-28T11:56:16.535 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.530+0000 7f374cec9700 1 --2- 172.21.15.184:0/2751161061 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f374806a300 0x7f37480ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:16.536 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.530+0000 7f374d6ca700 1 -- 172.21.15.184:0/2751161061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37480cfc40 msgr2=0x7f37480cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:16.537 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.530+0000 7f374d6ca700 1 --2- 172.21.15.184:0/2751161061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37480cfc40 0x7f37480cc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:16.537 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.530+0000 7f374d6ca700 1 -- 172.21.15.184:0/2751161061 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f374806a300 msgr2=0x7f37480ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:16.537 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.530+0000 7f374d6ca700 1 --2- 172.21.15.184:0/2751161061 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f374806a300 0x7f37480ce580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:16.537 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.530+0000 7f374d6ca700 1 -- 172.21.15.184:0/2751161061 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3740009a70 con 0x7f374815c6d0 2023-11-28T11:56:16.537 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.530+0000 7f374d6ca700 1 --2- 172.21.15.184:0/2751161061 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f374815c6d0 0x7f3748159610 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3740014000 tx=0x7f3740004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:16.537 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.530+0000 7f37457fa700 1 -- 172.21.15.184:0/2751161061 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37400044c0 con 0x7f374815c6d0 2023-11-28T11:56:16.537 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.530+0000 7f37457fa700 1 -- 172.21.15.184:0/2751161061 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3740004620 con 0x7f374815c6d0 2023-11-28T11:56:16.537 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.530+0000 7f374decb700 1 -- 172.21.15.184:0/2751161061 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f374815caa0 con 0x7f374815c6d0 2023-11-28T11:56:16.537 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.530+0000 7f37457fa700 1 -- 172.21.15.184:0/2751161061 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374001d470 con 0x7f374815c6d0 2023-11-28T11:56:16.537 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.530+0000 7f374decb700 1 -- 172.21.15.184:0/2751161061 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3748071f00 con 0x7f374815c6d0 2023-11-28T11:56:16.538 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.534+0000 7f37457fa700 1 -- 172.21.15.184:0/2751161061 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f3740018070 con 0x7f374815c6d0 2023-11-28T11:56:16.538 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.534+0000 7f37457fa700 1 -- 172.21.15.184:0/2751161061 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f3740012430 con 0x7f374815c6d0 2023-11-28T11:56:16.538 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.534+0000 7f374decb700 1 -- 172.21.15.184:0/2751161061 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37480731b0 con 0x7f374815c6d0 2023-11-28T11:56:16.542 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.538+0000 7f37457fa700 1 -- 172.21.15.184:0/2751161061 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f37480731b0 con 0x7f374815c6d0 2023-11-28T11:56:16.615 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-11-28T11:56:16.610+0000 7fabd39892c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-28T11:56:16.626 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.622+0000 7f374decb700 1 -- 172.21.15.184:0/2751161061 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd new", "uuid": "52838753-04a9-417b-95df-6fbe87b817c0", "id": 6} v 0) v1 -- 0x7f37480b87e0 con 0x7f374815c6d0 2023-11-28T11:56:16.637 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.634+0000 7f37457fa700 1 -- 172.21.15.184:0/2751161061 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "52838753-04a9-417b-95df-6fbe87b817c0", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3740021020 con 0x7f374815c6d0 2023-11-28T11:56:16.638 INFO:teuthology.orchestra.run.smithi184.stdout:6 2023-11-28T11:56:16.639 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.634+0000 7f374decb700 1 -- 172.21.15.184:0/2751161061 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f374815c6d0 msgr2=0x7f3748159610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:16.639 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.634+0000 7f374decb700 1 --2- 172.21.15.184:0/2751161061 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f374815c6d0 0x7f3748159610 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3740014000 tx=0x7f3740004af0 comp rx=0 tx=0).stop 2023-11-28T11:56:16.639 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.634+0000 7f374decb700 1 -- 172.21.15.184:0/2751161061 shutdown_connections 2023-11-28T11:56:16.640 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.634+0000 7f374decb700 1 --2- 172.21.15.184:0/2751161061 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f374815c6d0 0x7f3748159610 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:16.640 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.634+0000 7f374decb700 1 --2- 172.21.15.184:0/2751161061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37480cfc40 0x7f37480cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:16.640 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.634+0000 7f374decb700 1 --2- 172.21.15.184:0/2751161061 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f374806a300 0x7f37480ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:16.640 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.634+0000 7f374decb700 1 -- 172.21.15.184:0/2751161061 >> 172.21.15.184:0/2751161061 conn(0x7f37480b6520 msgr2=0x7f37480b1550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:16.640 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.634+0000 7f374decb700 1 -- 172.21.15.184:0/2751161061 shutdown_connections 2023-11-28T11:56:16.640 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.634+0000 7f374decb700 1 -- 172.21.15.184:0/2751161061 wait complete. 2023-11-28T11:56:16.648 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-11-28T11:56:16.646+0000 7fddf53662c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-28T11:56:16.659 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 7dd4385b-724d-40dd-84cd-31bab39d1bee 7 2023-11-28T11:56:16.822 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.818+0000 7f6feab45700 1 Processor -- start 2023-11-28T11:56:16.822 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.818+0000 7f6feab45700 1 -- start start 2023-11-28T11:56:16.824 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.818+0000 7f6feab45700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fe415c640 0x7f6fe40d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:16.824 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.818+0000 7f6feab45700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fe406c600 con 0x7f6fe4069e00 2023-11-28T11:56:16.824 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.818+0000 7f6feab45700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fe40722f0 con 0x7f6fe4071aa0 2023-11-28T11:56:16.824 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.822+0000 7f6feab45700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe406cef0 con 0x7f6fe415c640 2023-11-28T11:56:16.825 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.822+0000 7f6fe9b43700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fe415c640 0x7f6fe40d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:16.825 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.822+0000 7f6fe9b43700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fe415c640 0x7f6fe40d31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:47592/0 (socket says 172.21.15.184:47592) 2023-11-28T11:56:16.825 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.822+0000 7f6fe9b43700 1 -- 172.21.15.184:0/3107689454 learned_addr learned my addr 172.21.15.184:0/3107689454 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-11-28T11:56:16.825 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.822+0000 7f6fe9b43700 1 -- 172.21.15.184:0/3107689454 >> v1:172.21.15.184:6789/0 conn(0x7f6fe4071aa0 legacy=0x7f6fe406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:16.825 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.822+0000 7f6fe9b43700 1 -- 172.21.15.184:0/3107689454 >> v1:172.21.15.39:6789/0 conn(0x7f6fe4069e00 legacy=0x7f6fe40d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:16.825 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.822+0000 7f6fe9b43700 1 -- 172.21.15.184:0/3107689454 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe406da20 con 0x7f6fe415c640 2023-11-28T11:56:16.826 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.822+0000 7f6fe9b43700 1 --2- 172.21.15.184:0/3107689454 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fe415c640 0x7f6fe40d31e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0009e80 tx=0x7f6fe000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1282c30343977e27 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:16.827 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.822+0000 7f6fe8b41700 1 -- 172.21.15.184:0/3107689454 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe000e070 con 0x7f6fe415c640 2023-11-28T11:56:16.827 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.822+0000 7f6fe8b41700 1 -- 172.21.15.184:0/3107689454 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe0003a40 con 0x7f6fe415c640 2023-11-28T11:56:16.827 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.822+0000 7f6fe8b41700 1 -- 172.21.15.184:0/3107689454 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe0003df0 con 0x7f6fe415c640 2023-11-28T11:56:16.828 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.822+0000 7f6feab45700 1 -- 172.21.15.184:0/3107689454 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fe415c640 msgr2=0x7f6fe40d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:16.828 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.822+0000 7f6feab45700 1 --2- 172.21.15.184:0/3107689454 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fe415c640 0x7f6fe40d31e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0009e80 tx=0x7f6fe000b330 comp rx=0 tx=0).stop 2023-11-28T11:56:16.828 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.822+0000 7f6feab45700 1 -- 172.21.15.184:0/3107689454 shutdown_connections 2023-11-28T11:56:16.828 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.822+0000 7f6feab45700 1 --2- 172.21.15.184:0/3107689454 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fe415c640 0x7f6fe40d31e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:16.828 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.822+0000 7f6feab45700 1 -- 172.21.15.184:0/3107689454 >> 172.21.15.184:0/3107689454 conn(0x7f6fe40b6520 msgr2=0x7f6fe4071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:16.828 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.822+0000 7f6feab45700 1 -- 172.21.15.184:0/3107689454 shutdown_connections 2023-11-28T11:56:16.828 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.822+0000 7f6feab45700 1 -- 172.21.15.184:0/3107689454 wait complete. 2023-11-28T11:56:16.831 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.826+0000 7f6feab45700 1 Processor -- start 2023-11-28T11:56:16.831 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.826+0000 7f6feab45700 1 -- start start 2023-11-28T11:56:16.833 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.830+0000 7f6feab45700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fe4069e00 0x7f6fe4158810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:16.833 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.830+0000 7f6feab45700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fe4071aa0 0x7f6fe40b2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:16.833 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.830+0000 7f6feab45700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fe415c640 0x7f6fe40cf490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:16.833 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.830+0000 7f6feab45700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe40c7160 con 0x7f6fe415c640 2023-11-28T11:56:16.833 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.830+0000 7f6feab45700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe40c6790 con 0x7f6fe4069e00 2023-11-28T11:56:16.833 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.830+0000 7f6feab45700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe40c73b0 con 0x7f6fe4071aa0 2023-11-28T11:56:16.834 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.830+0000 7f6fe9b43700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fe4069e00 0x7f6fe4158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:16.834 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.830+0000 7f6fe9342700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fe4071aa0 0x7f6fe40b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:16.835 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.830+0000 7f6fe9b43700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fe4069e00 0x7f6fe4158810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:51086/0 (socket says 172.21.15.184:51086) 2023-11-28T11:56:16.835 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.830+0000 7f6fe9342700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fe4071aa0 0x7f6fe40b2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:47596/0 (socket says 172.21.15.184:47596) 2023-11-28T11:56:16.835 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.830+0000 7f6fe9b43700 1 -- 172.21.15.184:0/2468222372 learned_addr learned my addr 172.21.15.184:0/2468222372 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-11-28T11:56:16.835 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.830+0000 7f6fea344700 1 --2- 172.21.15.184:0/2468222372 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fe415c640 0x7f6fe40cf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:16.835 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.830+0000 7f6fe9b43700 1 -- 172.21.15.184:0/2468222372 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fe4071aa0 msgr2=0x7f6fe40b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:16.835 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.830+0000 7f6fe9b43700 1 --2- 172.21.15.184:0/2468222372 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fe4071aa0 0x7f6fe40b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:16.835 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.830+0000 7f6fe9b43700 1 -- 172.21.15.184:0/2468222372 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fe415c640 msgr2=0x7f6fe40cf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:16.835 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.830+0000 7f6fe9b43700 1 --2- 172.21.15.184:0/2468222372 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fe415c640 0x7f6fe40cf490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:16.835 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.830+0000 7f6fe9b43700 1 -- 172.21.15.184:0/2468222372 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe0009b30 con 0x7f6fe4069e00 2023-11-28T11:56:16.835 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.830+0000 7f6fea344700 1 --2- 172.21.15.184:0/2468222372 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fe415c640 0x7f6fe40cf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:16.835 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.830+0000 7f6fe9342700 1 --2- 172.21.15.184:0/2468222372 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fe4071aa0 0x7f6fe40b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:16.835 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.830+0000 7f6fe9b43700 1 --2- 172.21.15.184:0/2468222372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fe4069e00 0x7f6fe4158810 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6fe406f090 tx=0x7f6fe0004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:16.838 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.830+0000 7f6fda7fc700 1 -- 172.21.15.184:0/2468222372 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe0004240 con 0x7f6fe4069e00 2023-11-28T11:56:16.838 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.830+0000 7f6fda7fc700 1 -- 172.21.15.184:0/2468222372 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe00043a0 con 0x7f6fe4069e00 2023-11-28T11:56:16.838 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.830+0000 7f6feab45700 1 -- 172.21.15.184:0/2468222372 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fe4072010 con 0x7f6fe4069e00 2023-11-28T11:56:16.838 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.830+0000 7f6fda7fc700 1 -- 172.21.15.184:0/2468222372 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe0004750 con 0x7f6fe4069e00 2023-11-28T11:56:16.838 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.830+0000 7f6feab45700 1 -- 172.21.15.184:0/2468222372 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fe415ca10 con 0x7f6fe4069e00 2023-11-28T11:56:16.838 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.830+0000 7f6fda7fc700 1 -- 172.21.15.184:0/2468222372 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f6fe0012430 con 0x7f6fe4069e00 2023-11-28T11:56:16.839 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.830+0000 7f6fda7fc700 1 -- 172.21.15.184:0/2468222372 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f6fe0012d20 con 0x7f6fe4069e00 2023-11-28T11:56:16.839 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.834+0000 7f6feab45700 1 -- 172.21.15.184:0/2468222372 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fe406c830 con 0x7f6fe4069e00 2023-11-28T11:56:16.840 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.838+0000 7f6fda7fc700 1 -- 172.21.15.184:0/2468222372 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f6fe0020030 con 0x7f6fe4069e00 2023-11-28T11:56:16.924 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.918+0000 7f6feab45700 1 -- 172.21.15.184:0/2468222372 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7dd4385b-724d-40dd-84cd-31bab39d1bee", "id": 7} v 0) v1 -- 0x7f6fe4073cb0 con 0x7f6fe4069e00 2023-11-28T11:56:16.936 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.930+0000 7f6fda7fc700 1 -- 172.21.15.184:0/2468222372 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7dd4385b-724d-40dd-84cd-31bab39d1bee", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6fe0032020 con 0x7f6fe4069e00 2023-11-28T11:56:16.936 INFO:teuthology.orchestra.run.smithi184.stdout:7 2023-11-28T11:56:16.938 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.934+0000 7f6feab45700 1 -- 172.21.15.184:0/2468222372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fe4069e00 msgr2=0x7f6fe4158810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:16.938 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.934+0000 7f6feab45700 1 --2- 172.21.15.184:0/2468222372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fe4069e00 0x7f6fe4158810 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6fe406f090 tx=0x7f6fe0004af0 comp rx=0 tx=0).stop 2023-11-28T11:56:16.938 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.934+0000 7f6feab45700 1 -- 172.21.15.184:0/2468222372 shutdown_connections 2023-11-28T11:56:16.938 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.934+0000 7f6feab45700 1 --2- 172.21.15.184:0/2468222372 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fe415c640 0x7f6fe40cf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:16.938 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.934+0000 7f6feab45700 1 --2- 172.21.15.184:0/2468222372 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fe4071aa0 0x7f6fe40b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:16.938 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.934+0000 7f6feab45700 1 --2- 172.21.15.184:0/2468222372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fe4069e00 0x7f6fe4158810 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:16.938 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.934+0000 7f6feab45700 1 -- 172.21.15.184:0/2468222372 >> 172.21.15.184:0/2468222372 conn(0x7f6fe40b6520 msgr2=0x7f6fe40d1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:16.938 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.934+0000 7f6feab45700 1 -- 172.21.15.184:0/2468222372 shutdown_connections 2023-11-28T11:56:16.939 INFO:teuthology.orchestra.run.smithi184.stderr:2023-11-28T11:56:16.934+0000 7f6feab45700 1 -- 172.21.15.184:0/2468222372 wait complete. 2023-11-28T11:56:16.958 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-28T11:56:16.958 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-28T11:56:16.965 INFO:tasks.ceph.osd.0:Started 2023-11-28T11:56:16.965 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-28T11:56:16.967 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-28T11:56:16.974 INFO:tasks.ceph.osd.1:Started 2023-11-28T11:56:16.974 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-28T11:56:16.975 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-28T11:56:16.979 INFO:tasks.ceph.osd.2:Started 2023-11-28T11:56:16.979 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-28T11:56:16.979 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-28T11:56:16.986 INFO:tasks.ceph.osd.3:Started 2023-11-28T11:56:16.986 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-28T11:56:16.987 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-28T11:56:16.993 INFO:tasks.ceph.osd.4:Started 2023-11-28T11:56:16.993 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-28T11:56:16.993 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-28T11:56:16.998 INFO:tasks.ceph.osd.5:Started 2023-11-28T11:56:16.998 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-28T11:56:16.999 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-28T11:56:17.003 INFO:tasks.ceph.osd.6:Started 2023-11-28T11:56:17.004 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-28T11:56:17.004 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-28T11:56:17.009 INFO:tasks.ceph.osd.7:Started 2023-11-28T11:56:17.010 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:56:17.203 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.198+0000 7f23008e6700 1 Processor -- start 2023-11-28T11:56:17.203 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.198+0000 7f23008e6700 1 -- start start 2023-11-28T11:56:17.206 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.202+0000 7f23008e6700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f22fc15c6d0 0x7f22fc0b17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:17.206 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.202+0000 7f23008e6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22fc0cfc40 0x7f22fc069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:17.206 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.202+0000 7f23008e6700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f22fc06a130 0x7f22fc0b7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:17.206 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.202+0000 7f23008e6700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22fc0d0400 con 0x7f22fc06a130 2023-11-28T11:56:17.206 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.202+0000 7f23008e6700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22fc06a5b0 con 0x7f22fc15c6d0 2023-11-28T11:56:17.206 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.202+0000 7f23008e6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc072270 con 0x7f22fc0cfc40 2023-11-28T11:56:17.208 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.202+0000 7f22fb59e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f22fc06a130 0x7f22fc0b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:17.208 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.202+0000 7f22fad9d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f22fc15c6d0 0x7f22fc0b17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:17.208 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.202+0000 7f22fb59e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f22fc06a130 0x7f22fc0b7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34192/0 (socket says 172.21.15.39:34192) 2023-11-28T11:56:17.208 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.202+0000 7f22fb59e700 1 -- 172.21.15.39:0/1275540639 learned_addr learned my addr 172.21.15.39:0/1275540639 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:17.208 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.202+0000 7f22fa59c700 1 --2- 172.21.15.39:0/1275540639 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22fc0cfc40 0x7f22fc069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:17.208 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.202+0000 7f22fb59e700 1 -- 172.21.15.39:0/1275540639 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22fc0cfc40 msgr2=0x7f22fc069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:17.208 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.202+0000 7f22fb59e700 1 --2- 172.21.15.39:0/1275540639 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22fc0cfc40 0x7f22fc069bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:17.208 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.202+0000 7f22fb59e700 1 -- 172.21.15.39:0/1275540639 >> v2:172.21.15.184:3300/0 conn(0x7f22fc15c6d0 msgr2=0x7f22fc0b17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:17.208 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.202+0000 7f22fb59e700 1 --2- 172.21.15.39:0/1275540639 >> v2:172.21.15.184:3300/0 conn(0x7f22fc15c6d0 0x7f22fc0b17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:17.208 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.202+0000 7f22fb59e700 1 -- 172.21.15.39:0/1275540639 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22fc0d0120 con 0x7f22fc06a130 2023-11-28T11:56:17.208 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.202+0000 7f22fa59c700 1 --2- 172.21.15.39:0/1275540639 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22fc0cfc40 0x7f22fc069bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:17.209 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.202+0000 7f22fb59e700 1 --2- 172.21.15.39:0/1275540639 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22fc06a130 0x7f22fc0b7950 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f22fc066bf0 tx=0x7f22f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e322867552cc77f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:17.209 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.202+0000 7f22f9d9b700 1 -- 172.21.15.39:0/1275540639 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f400e070 con 0x7f22fc06a130 2023-11-28T11:56:17.209 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.202+0000 7f22f9d9b700 1 -- 172.21.15.39:0/1275540639 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f400b910 con 0x7f22fc06a130 2023-11-28T11:56:17.209 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.202+0000 7f22f9d9b700 1 -- 172.21.15.39:0/1275540639 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f400bcc0 con 0x7f22fc06a130 2023-11-28T11:56:17.209 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.206+0000 7f23008e6700 1 -- 172.21.15.39:0/1275540639 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22fc06a130 msgr2=0x7f22fc0b7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:17.210 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.206+0000 7f23008e6700 1 --2- 172.21.15.39:0/1275540639 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22fc06a130 0x7f22fc0b7950 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f22fc066bf0 tx=0x7f22f400b330 comp rx=0 tx=0).stop 2023-11-28T11:56:17.210 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.206+0000 7f23008e6700 1 -- 172.21.15.39:0/1275540639 shutdown_connections 2023-11-28T11:56:17.210 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.206+0000 7f23008e6700 1 --2- 172.21.15.39:0/1275540639 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22fc0cfc40 0x7f22fc069bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:17.210 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.206+0000 7f23008e6700 1 --2- 172.21.15.39:0/1275540639 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22fc06a130 0x7f22fc0b7950 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:17.210 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.206+0000 7f23008e6700 1 --2- 172.21.15.39:0/1275540639 >> v2:172.21.15.184:3300/0 conn(0x7f22fc15c6d0 0x7f22fc0b17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:17.210 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.206+0000 7f23008e6700 1 -- 172.21.15.39:0/1275540639 >> 172.21.15.39:0/1275540639 conn(0x7f22fc0b6520 msgr2=0x7f22fc071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:17.210 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.206+0000 7f23008e6700 1 -- 172.21.15.39:0/1275540639 shutdown_connections 2023-11-28T11:56:17.210 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.206+0000 7f23008e6700 1 -- 172.21.15.39:0/1275540639 wait complete. 2023-11-28T11:56:17.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.206+0000 7f23008e6700 1 Processor -- start 2023-11-28T11:56:17.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.206+0000 7f23008e6700 1 -- start start 2023-11-28T11:56:17.212 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.210+0000 7f23008e6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22fc06a130 0x7f22fc0cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:17.212 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.210+0000 7f23008e6700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22fc0cfc40 0x7f22fc15a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:17.212 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.210+0000 7f23008e6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22fc15c6d0 0x7f22fc1e2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:17.212 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.210+0000 7f23008e6700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc0b49e0 con 0x7f22fc0cfc40 2023-11-28T11:56:17.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.210+0000 7f23008e6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc0b4e00 con 0x7f22fc06a130 2023-11-28T11:56:17.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.210+0000 7f23008e6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc0b3d60 con 0x7f22fc15c6d0 2023-11-28T11:56:17.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.210+0000 7f22fa59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22fc0cfc40 0x7f22fc15a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:17.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.210+0000 7f22fa59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22fc0cfc40 0x7f22fc15a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34200/0 (socket says 172.21.15.39:34200) 2023-11-28T11:56:17.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.210+0000 7f22fa59c700 1 -- 172.21.15.39:0/2132972940 learned_addr learned my addr 172.21.15.39:0/2132972940 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:17.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.210+0000 7f22fb59e700 1 --2- 172.21.15.39:0/2132972940 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22fc15c6d0 0x7f22fc1e2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:17.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.210+0000 7f22fad9d700 1 --2- 172.21.15.39:0/2132972940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22fc06a130 0x7f22fc0cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:17.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.210+0000 7f22fa59c700 1 -- 172.21.15.39:0/2132972940 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22fc15c6d0 msgr2=0x7f22fc1e2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:17.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.210+0000 7f22fa59c700 1 --2- 172.21.15.39:0/2132972940 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22fc15c6d0 0x7f22fc1e2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:17.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.210+0000 7f22fa59c700 1 -- 172.21.15.39:0/2132972940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22fc06a130 msgr2=0x7f22fc0cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:17.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.210+0000 7f22fa59c700 1 --2- 172.21.15.39:0/2132972940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22fc06a130 0x7f22fc0cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:17.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.210+0000 7f22fa59c700 1 -- 172.21.15.39:0/2132972940 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f4009b30 con 0x7f22fc0cfc40 2023-11-28T11:56:17.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.210+0000 7f22fa59c700 1 --2- 172.21.15.39:0/2132972940 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22fc0cfc40 0x7f22fc15a400 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f22f000d7d0 tx=0x7f22f000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:17.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.210+0000 7f22e37fe700 1 -- 172.21.15.39:0/2132972940 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f0004030 con 0x7f22fc0cfc40 2023-11-28T11:56:17.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.210+0000 7f22e37fe700 1 -- 172.21.15.39:0/2132972940 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f0004190 con 0x7f22fc0cfc40 2023-11-28T11:56:17.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.210+0000 7f23008e6700 1 -- 172.21.15.39:0/2132972940 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22fc071f00 con 0x7f22fc0cfc40 2023-11-28T11:56:17.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.210+0000 7f22e37fe700 1 -- 172.21.15.39:0/2132972940 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f0004520 con 0x7f22fc0cfc40 2023-11-28T11:56:17.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.210+0000 7f23008e6700 1 -- 172.21.15.39:0/2132972940 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22fc071c20 con 0x7f22fc0cfc40 2023-11-28T11:56:17.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.210+0000 7f22e37fe700 1 -- 172.21.15.39:0/2132972940 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f22f001a020 con 0x7f22fc0cfc40 2023-11-28T11:56:17.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.210+0000 7f22e37fe700 1 -- 172.21.15.39:0/2132972940 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f22f001dad0 con 0x7f22fc0cfc40 2023-11-28T11:56:17.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.214+0000 7f23008e6700 1 -- 172.21.15.39:0/2132972940 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22fc15caa0 con 0x7f22fc0cfc40 2023-11-28T11:56:17.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.218+0000 7f22e37fe700 1 -- 172.21.15.39:0/2132972940 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f22f001dc90 con 0x7f22fc0cfc40 2023-11-28T11:56:17.289 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.286+0000 7f23008e6700 1 -- 172.21.15.39:0/2132972940 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22fc073cb0 con 0x7f22fc0cfc40 2023-11-28T11:56:17.291 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.286+0000 7f22e37fe700 1 -- 172.21.15.39:0/2132972940 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f22f00039b0 con 0x7f22fc0cfc40 2023-11-28T11:56:17.291 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:56:17.291 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":10,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:56:16.925470+0000","last_up_change":"0.000000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:56:17.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.290+0000 7f23008e6700 1 -- 172.21.15.39:0/2132972940 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22fc0cfc40 msgr2=0x7f22fc15a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:17.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.290+0000 7f23008e6700 1 --2- 172.21.15.39:0/2132972940 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22fc0cfc40 0x7f22fc15a400 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f22f000d7d0 tx=0x7f22f000dae0 comp rx=0 tx=0).stop 2023-11-28T11:56:17.293 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.290+0000 7f23008e6700 1 -- 172.21.15.39:0/2132972940 shutdown_connections 2023-11-28T11:56:17.293 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.290+0000 7f23008e6700 1 --2- 172.21.15.39:0/2132972940 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22fc15c6d0 0x7f22fc1e2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:17.293 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.290+0000 7f23008e6700 1 --2- 172.21.15.39:0/2132972940 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22fc0cfc40 0x7f22fc15a400 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:17.293 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.290+0000 7f23008e6700 1 --2- 172.21.15.39:0/2132972940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22fc06a130 0x7f22fc0cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:17.293 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.290+0000 7f23008e6700 1 -- 172.21.15.39:0/2132972940 >> 172.21.15.39:0/2132972940 conn(0x7f22fc0b6520 msgr2=0x7f22fc15b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:17.293 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.290+0000 7f23008e6700 1 -- 172.21.15.39:0/2132972940 shutdown_connections 2023-11-28T11:56:17.293 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:17.290+0000 7f23008e6700 1 -- 172.21.15.39:0/2132972940 wait complete. 2023-11-28T11:56:17.312 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-28T11:56:17.313 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-28T11:56:17.366 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-11-28T11:56:17.362+0000 7fabd39892c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-28T11:56:17.406 INFO:tasks.ceph.osd.0.smithi039.stderr:2023-11-28T11:56:17.402+0000 7f250a4f4700 -1 Falling back to public interface 2023-11-28T11:56:17.418 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-11-28T11:56:17.414+0000 7fddf53662c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-28T11:56:17.586 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-11-28T11:56:17.582+0000 7fabd39892c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-28T11:56:17.655 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-11-28T11:56:17.650+0000 7fda8b4d5700 -1 Falling back to public interface 2023-11-28T11:56:17.657 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-11-28T11:56:17.654+0000 7fddf53662c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-28T11:56:17.681 INFO:tasks.ceph.osd.2.smithi039.stderr:2023-11-28T11:56:17.678+0000 7fe1dd78c700 -1 Falling back to public interface 2023-11-28T11:56:17.681 INFO:tasks.ceph.osd.3.smithi039.stderr:2023-11-28T11:56:17.678+0000 7fb50b81c700 -1 Falling back to public interface 2023-11-28T11:56:17.683 INFO:tasks.ceph.osd.2.smithi039.stderr:2023-11-28T11:56:17.678+0000 7fe1dc757700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6811/0: (98) Address already in use 2023-11-28T11:56:17.683 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-11-28T11:56:17.678+0000 7f529d732700 -1 Falling back to public interface 2023-11-28T11:56:17.684 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-11-28T11:56:17.678+0000 7f3ba1657700 -1 Falling back to public interface 2023-11-28T11:56:17.690 INFO:tasks.ceph.osd.1.smithi039.stderr:2023-11-28T11:56:17.686+0000 7fe166239700 -1 Falling back to public interface 2023-11-28T11:56:17.691 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-11-28T11:56:17.686+0000 7febb03ba700 -1 Falling back to public interface 2023-11-28T11:56:17.808 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-11-28T11:56:17.802+0000 7fabd39892c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-28T11:56:17.886 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-11-28T11:56:17.882+0000 7fddf53662c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-28T11:56:17.894 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-11-28T11:56:17.890+0000 7fabd39892c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-28T11:56:17.968 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-11-28T11:56:17.962+0000 7fddf53662c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-28T11:56:18.120 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-28T11:56:18.276 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.274+0000 7fac05816700 1 Processor -- start 2023-11-28T11:56:18.277 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.274+0000 7fac05816700 1 -- start start 2023-11-28T11:56:18.280 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.274+0000 7fac05816700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac000ce770 0x7fac000ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:18.280 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.274+0000 7fac05816700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fac0015dd10 0x7fac00159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:18.280 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.274+0000 7fac05816700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fac0015a300 0x7fac000caf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:18.280 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.274+0000 7fac05816700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac0015d8f0 con 0x7fac0015dd10 2023-11-28T11:56:18.280 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.274+0000 7fac05816700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac0015d530 con 0x7fac0015a300 2023-11-28T11:56:18.280 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.274+0000 7fac05816700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac000cf080 con 0x7fac000ce770 2023-11-28T11:56:18.280 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.278+0000 7fabf7fff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fac0015dd10 0x7fac00159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:18.281 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.278+0000 7fabf7fff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fac0015dd10 0x7fac00159dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36854/0 (socket says 172.21.15.39:36854) 2023-11-28T11:56:18.282 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.278+0000 7fabf7fff700 1 -- 172.21.15.39:0/3461019124 learned_addr learned my addr 172.21.15.39:0/3461019124 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:18.282 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.278+0000 7fabff7fe700 1 --2- 172.21.15.39:0/3461019124 >> v2:172.21.15.184:3300/0 conn(0x7fac0015a300 0x7fac000caf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:18.282 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.278+0000 7fabfeffd700 1 --2- 172.21.15.39:0/3461019124 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac000ce770 0x7fac000ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:18.282 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.278+0000 7fabf7fff700 1 -- 172.21.15.39:0/3461019124 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac000ce770 msgr2=0x7fac000ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:18.282 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.278+0000 7fabf7fff700 1 --2- 172.21.15.39:0/3461019124 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac000ce770 0x7fac000ceb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:18.282 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.278+0000 7fabf7fff700 1 -- 172.21.15.39:0/3461019124 >> v2:172.21.15.184:3300/0 conn(0x7fac0015a300 msgr2=0x7fac000caf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:18.282 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.278+0000 7fabf7fff700 1 --2- 172.21.15.39:0/3461019124 >> v2:172.21.15.184:3300/0 conn(0x7fac0015a300 0x7fac000caf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:18.282 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.278+0000 7fabf7fff700 1 -- 172.21.15.39:0/3461019124 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac0015a880 con 0x7fac0015dd10 2023-11-28T11:56:18.282 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.278+0000 7fabf7fff700 1 --2- 172.21.15.39:0/3461019124 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac0015dd10 0x7fac00159dc0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fac000af3b0 tx=0x7fabe800be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65f42d89ebe478b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:18.283 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.278+0000 7fabfe7fc700 1 -- 172.21.15.39:0/3461019124 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe800dd90 con 0x7fac0015dd10 2023-11-28T11:56:18.283 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.278+0000 7fabfe7fc700 1 -- 172.21.15.39:0/3461019124 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe8010470 con 0x7fac0015dd10 2023-11-28T11:56:18.284 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.278+0000 7fabfe7fc700 1 -- 172.21.15.39:0/3461019124 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe8010800 con 0x7fac0015dd10 2023-11-28T11:56:18.284 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.278+0000 7fac05816700 1 -- 172.21.15.39:0/3461019124 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac0015dd10 msgr2=0x7fac00159dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:18.284 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.278+0000 7fac05816700 1 --2- 172.21.15.39:0/3461019124 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac0015dd10 0x7fac00159dc0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fac000af3b0 tx=0x7fabe800be90 comp rx=0 tx=0).stop 2023-11-28T11:56:18.284 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.278+0000 7fac05816700 1 -- 172.21.15.39:0/3461019124 shutdown_connections 2023-11-28T11:56:18.284 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.278+0000 7fac05816700 1 --2- 172.21.15.39:0/3461019124 >> v2:172.21.15.184:3300/0 conn(0x7fac0015a300 0x7fac000caf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:18.284 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.278+0000 7fac05816700 1 --2- 172.21.15.39:0/3461019124 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac0015dd10 0x7fac00159dc0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:18.284 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.278+0000 7fac05816700 1 --2- 172.21.15.39:0/3461019124 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac000ce770 0x7fac000ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:18.284 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.278+0000 7fac05816700 1 -- 172.21.15.39:0/3461019124 >> 172.21.15.39:0/3461019124 conn(0x7fac0006d590 msgr2=0x7fac0006d990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:18.284 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.278+0000 7fac05816700 1 -- 172.21.15.39:0/3461019124 shutdown_connections 2023-11-28T11:56:18.284 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.278+0000 7fac05816700 1 -- 172.21.15.39:0/3461019124 wait complete. 2023-11-28T11:56:18.286 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.282+0000 7fac05816700 1 Processor -- start 2023-11-28T11:56:18.286 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.282+0000 7fac05816700 1 -- start start 2023-11-28T11:56:18.288 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.282+0000 7fac05816700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac000ce770 0x7fac000b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:18.288 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.282+0000 7fac05816700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac0015a300 0x7fac000caf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:18.288 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.282+0000 7fac05816700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac0015dd10 0x7fac000cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:18.288 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.282+0000 7fac05816700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac000c89d0 con 0x7fac000ce770 2023-11-28T11:56:18.288 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.282+0000 7fac05816700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac00142370 con 0x7fac0015a300 2023-11-28T11:56:18.288 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.282+0000 7fac05816700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac00142650 con 0x7fac0015dd10 2023-11-28T11:56:18.288 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.282+0000 7fabfeffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac000ce770 0x7fac000b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:18.289 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.286+0000 7fabfeffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac000ce770 0x7fac000b2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36868/0 (socket says 172.21.15.39:36868) 2023-11-28T11:56:18.289 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.286+0000 7fabfeffd700 1 -- 172.21.15.39:0/1490155500 learned_addr learned my addr 172.21.15.39:0/1490155500 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:18.289 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.286+0000 7fabf7fff700 1 --2- 172.21.15.39:0/1490155500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac0015a300 0x7fac000caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:18.289 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.286+0000 7fabff7fe700 1 --2- 172.21.15.39:0/1490155500 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac0015dd10 0x7fac000cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:18.290 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.286+0000 7fabfeffd700 1 -- 172.21.15.39:0/1490155500 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac0015dd10 msgr2=0x7fac000cb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:18.290 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.286+0000 7fabfeffd700 1 --2- 172.21.15.39:0/1490155500 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac0015dd10 0x7fac000cb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:18.290 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.286+0000 7fabfeffd700 1 -- 172.21.15.39:0/1490155500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac0015a300 msgr2=0x7fac000caf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:18.290 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.286+0000 7fabfeffd700 1 --2- 172.21.15.39:0/1490155500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac0015a300 0x7fac000caf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:18.290 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.286+0000 7fabfeffd700 1 -- 172.21.15.39:0/1490155500 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe800b810 con 0x7fac000ce770 2023-11-28T11:56:18.290 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.286+0000 7fabfeffd700 1 --2- 172.21.15.39:0/1490155500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac000ce770 0x7fac000b2e80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fabf000e810 tx=0x7fabf000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:18.291 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.286+0000 7fabfcff9700 1 -- 172.21.15.39:0/1490155500 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf000c070 con 0x7fac000ce770 2023-11-28T11:56:18.291 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.286+0000 7fabfcff9700 1 -- 172.21.15.39:0/1490155500 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf0013630 con 0x7fac000ce770 2023-11-28T11:56:18.291 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.286+0000 7fabfcff9700 1 -- 172.21.15.39:0/1490155500 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf00139e0 con 0x7fac000ce770 2023-11-28T11:56:18.291 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.286+0000 7fac05816700 1 -- 172.21.15.39:0/1490155500 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac00154170 con 0x7fac000ce770 2023-11-28T11:56:18.291 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.286+0000 7fac05816700 1 -- 172.21.15.39:0/1490155500 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac0015ab60 con 0x7fac000ce770 2023-11-28T11:56:18.291 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.286+0000 7fabfcff9700 1 -- 172.21.15.39:0/1490155500 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fabf0023070 con 0x7fac000ce770 2023-11-28T11:56:18.291 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.286+0000 7fabfcff9700 1 -- 172.21.15.39:0/1490155500 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fabf001c400 con 0x7fac000ce770 2023-11-28T11:56:18.291 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.286+0000 7fac05816700 1 -- 172.21.15.39:0/1490155500 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac0006c5d0 con 0x7fac000ce770 2023-11-28T11:56:18.294 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.290+0000 7fabfcff9700 1 -- 172.21.15.39:0/1490155500 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fabf0017020 con 0x7fac000ce770 2023-11-28T11:56:18.366 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.362+0000 7fac05816700 1 -- 172.21.15.39:0/1490155500 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac000c8b40 con 0x7fac000ce770 2023-11-28T11:56:18.368 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.362+0000 7fabfcff9700 1 -- 172.21.15.39:0/1490155500 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fabf002a020 con 0x7fac000ce770 2023-11-28T11:56:18.369 INFO:teuthology.misc.health.smithi039.stdout: 2023-11-28T11:56:18.370 INFO:teuthology.misc.health.smithi039.stdout:{"epoch":10,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:56:16.925470+0000","last_up_change":"0.000000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:56:18.374 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.362+0000 7fac05816700 1 -- 172.21.15.39:0/1490155500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac000ce770 msgr2=0x7fac000b2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:18.374 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.362+0000 7fac05816700 1 --2- 172.21.15.39:0/1490155500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac000ce770 0x7fac000b2e80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fabf000e810 tx=0x7fabf000eb20 comp rx=0 tx=0).stop 2023-11-28T11:56:18.374 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.362+0000 7fac05816700 1 -- 172.21.15.39:0/1490155500 shutdown_connections 2023-11-28T11:56:18.374 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.366+0000 7fac05816700 1 --2- 172.21.15.39:0/1490155500 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac0015dd10 0x7fac000cb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:18.375 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.366+0000 7fac05816700 1 --2- 172.21.15.39:0/1490155500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac0015a300 0x7fac000caf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:18.375 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.366+0000 7fac05816700 1 --2- 172.21.15.39:0/1490155500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac000ce770 0x7fac000b2e80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:18.375 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.366+0000 7fac05816700 1 -- 172.21.15.39:0/1490155500 >> 172.21.15.39:0/1490155500 conn(0x7fac0006d590 msgr2=0x7fac0015b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:18.375 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.366+0000 7fac05816700 1 -- 172.21.15.39:0/1490155500 shutdown_connections 2023-11-28T11:56:18.375 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:18.366+0000 7fac05816700 1 -- 172.21.15.39:0/1490155500 wait complete. 2023-11-28T11:56:18.385 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-28T11:56:18.609 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-11-28T11:56:18.606+0000 7fabd39892c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-28T11:56:18.666 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-11-28T11:56:18.662+0000 7fddf53662c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-28T11:56:18.706 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-11-28T11:56:18.702+0000 7fabd39892c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-28T11:56:18.767 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-11-28T11:56:18.762+0000 7fddf53662c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-28T11:56:18.885 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-11-28T11:56:18.882+0000 7fabd39892c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-28T11:56:18.953 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-11-28T11:56:18.950+0000 7fddf53662c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-28T11:56:18.980 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-11-28T11:56:18.974+0000 7fabd39892c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-28T11:56:19.052 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-11-28T11:56:19.050+0000 7fddf53662c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-28T11:56:19.260 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-11-28T11:56:19.258+0000 7fabd39892c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-28T11:56:19.338 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-11-28T11:56:19.334+0000 7fddf53662c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-28T11:56:19.483 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-11-28T11:56:19.478+0000 7fabd39892c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-28T11:56:19.568 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-11-28T11:56:19.566+0000 7fddf53662c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-28T11:56:19.583 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-11-28T11:56:19.578+0000 7fabd39892c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-28T11:56:19.675 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-11-28T11:56:19.670+0000 7fddf53662c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-28T11:56:20.520 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-11-28T11:56:20.514+0000 7fabd39892c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-28T11:56:20.635 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-11-28T11:56:20.630+0000 7fddf53662c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-28T11:56:21.467 INFO:tasks.ceph.osd.0.smithi039.stderr:2023-11-28T11:56:21.462+0000 7f250a4f4700 -1 osd.0 0 log_to_monitors true 2023-11-28T11:56:21.489 INFO:tasks.ceph.osd.2.smithi039.stderr:2023-11-28T11:56:21.486+0000 7fe1dd78c700 -1 osd.2 0 log_to_monitors true 2023-11-28T11:56:21.556 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-11-28T11:56:21.554+0000 7fabba1e5700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-28T11:56:21.558 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-11-28T11:56:21.554+0000 7fabba1e5700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-28T11:56:21.615 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-11-28T11:56:21.610+0000 7f3ba1657700 -1 osd.7 0 log_to_monitors true 2023-11-28T11:56:21.676 INFO:tasks.ceph.osd.3.smithi039.stderr:2023-11-28T11:56:21.674+0000 7fb50b81c700 -1 osd.3 0 log_to_monitors true 2023-11-28T11:56:21.712 INFO:tasks.ceph.osd.1.smithi039.stderr:2023-11-28T11:56:21.710+0000 7fe166239700 -1 osd.1 0 log_to_monitors true 2023-11-28T11:56:21.813 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-11-28T11:56:21.810+0000 7fda8b4d5700 -1 osd.4 0 log_to_monitors true 2023-11-28T11:56:21.854 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-11-28T11:56:21.850+0000 7f529d732700 -1 osd.5 0 log_to_monitors true 2023-11-28T11:56:21.854 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-11-28T11:56:21.850+0000 7febb03ba700 -1 osd.6 0 log_to_monitors true 2023-11-28T11:56:24.309 INFO:tasks.ceph.osd.0.smithi039.stderr:2023-11-28T11:56:24.306+0000 7f2506333700 -1 osd.0 0 waiting for initial osdmap 2023-11-28T11:56:24.325 INFO:tasks.ceph.osd.0.smithi039.stderr:2023-11-28T11:56:24.322+0000 7f24fddf0700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T11:56:24.429 INFO:tasks.ceph.osd.2.smithi039.stderr:2023-11-28T11:56:24.426+0000 7fe1d95cb700 -1 osd.2 0 waiting for initial osdmap 2023-11-28T11:56:24.446 INFO:tasks.ceph.osd.2.smithi039.stderr:2023-11-28T11:56:24.442+0000 7fe1d0ff0700 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T11:56:25.192 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-28T11:56:25.274 INFO:tasks.ceph.osd.1.smithi039.stderr:2023-11-28T11:56:25.270+0000 7fe162078700 -1 osd.1 0 waiting for initial osdmap 2023-11-28T11:56:25.282 INFO:tasks.ceph.osd.3.smithi039.stderr:2023-11-28T11:56:25.278+0000 7fb50765b700 -1 osd.3 0 waiting for initial osdmap 2023-11-28T11:56:25.289 INFO:tasks.ceph.osd.1.smithi039.stderr:2023-11-28T11:56:25.286+0000 7fe1599f0700 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T11:56:25.291 INFO:tasks.ceph.osd.3.smithi039.stderr:2023-11-28T11:56:25.286+0000 7fb4feff0700 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T11:56:25.358 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.354+0000 7f31b5f18700 1 Processor -- start 2023-11-28T11:56:25.359 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.354+0000 7f31b5f18700 1 -- start start 2023-11-28T11:56:25.361 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.358+0000 7f31b5f18700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f31b006c3c0 0x7f31b006c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:25.361 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.358+0000 7f31b5f18700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31b006a890 con 0x7f31b015acd0 2023-11-28T11:56:25.361 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.358+0000 7f31b5f18700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31b0069c80 con 0x7f31b00ad7d0 2023-11-28T11:56:25.362 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.358+0000 7f31b5f18700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31b015b0a0 con 0x7f31b006c3c0 2023-11-28T11:56:25.362 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.358+0000 7f31b4f16700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f31b015acd0 0x7f31b006ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:32784/0 (socket says 172.21.15.39:32784) 2023-11-28T11:56:25.362 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.358+0000 7f31b4f16700 1 -- 172.21.15.39:0/1507027067 learned_addr learned my addr 172.21.15.39:0/1507027067 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:56:25.363 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.358+0000 7f31a77fe700 1 -- 172.21.15.39:0/1507027067 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3238261633 0 0) 0x7f31b006a890 con 0x7f31b015acd0 2023-11-28T11:56:25.363 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.358+0000 7f31a77fe700 1 -- 172.21.15.39:0/1507027067 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31980035d0 con 0x7f31b015acd0 2023-11-28T11:56:25.363 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.358+0000 7f31a7fff700 1 --2- 172.21.15.39:0/1507027067 >> v2:172.21.15.184:3300/0 conn(0x7f31b006c3c0 0x7f31b006c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:25.363 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.358+0000 7f31a77fe700 1 -- 172.21.15.39:0/1507027067 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 78997781 0 0) 0x7f31980035d0 con 0x7f31b015acd0 2023-11-28T11:56:25.364 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.358+0000 7f31a77fe700 1 -- 172.21.15.39:0/1507027067 >> v2:172.21.15.184:3300/0 conn(0x7f31b006c3c0 msgr2=0x7f31b006c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:25.364 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.358+0000 7f31a77fe700 1 --2- 172.21.15.39:0/1507027067 >> v2:172.21.15.184:3300/0 conn(0x7f31b006c3c0 0x7f31b006c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:25.364 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.358+0000 7f31a77fe700 1 -- 172.21.15.39:0/1507027067 >> v1:172.21.15.184:6789/0 conn(0x7f31b00ad7d0 legacy=0x7f31b00adbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:25.364 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.358+0000 7f31a77fe700 1 -- 172.21.15.39:0/1507027067 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b0069f60 con 0x7f31b015acd0 2023-11-28T11:56:25.364 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.358+0000 7f31a77fe700 1 -- 172.21.15.39:0/1507027067 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4013383302 0 0) 0x7f31ac001670 con 0x7f31b015acd0 2023-11-28T11:56:25.364 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.358+0000 7f31a77fe700 1 -- 172.21.15.39:0/1507027067 >> v1:172.21.15.39:6789/0 conn(0x7f31b015acd0 legacy=0x7f31b006ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:25.364 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.358+0000 7f31a77fe700 1 --2- 172.21.15.39:0/1507027067 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3198003a20 0x7f3198003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:25.364 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.358+0000 7f31a77fe700 1 --2- 172.21.15.39:0/1507027067 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3198004410 0x7f31980048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:25.366 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.358+0000 7f31a77fe700 1 --2- 172.21.15.39:0/1507027067 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31980050d0 0x7f319800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:25.366 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.358+0000 7f31a77fe700 1 -- 172.21.15.39:0/1507027067 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b015b0a0 con 0x7f31980050d0 2023-11-28T11:56:25.366 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.358+0000 7f31a77fe700 1 -- 172.21.15.39:0/1507027067 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319800c020 con 0x7f3198003a20 2023-11-28T11:56:25.366 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.358+0000 7f31a77fe700 1 -- 172.21.15.39:0/1507027067 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319800c1e0 con 0x7f3198004410 2023-11-28T11:56:25.366 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.362+0000 7f31b5717700 1 --2- 172.21.15.39:0/1507027067 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31980050d0 0x7f319800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:25.366 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.362+0000 7f31b4f16700 1 --2- 172.21.15.39:0/1507027067 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3198003a20 0x7f3198003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:25.366 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.362+0000 7f31a7fff700 1 --2- 172.21.15.39:0/1507027067 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3198004410 0x7f31980048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:25.366 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.362+0000 7f31b5717700 1 -- 172.21.15.39:0/1507027067 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3198004410 msgr2=0x7f31980048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:25.366 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.362+0000 7f31b5717700 1 --2- 172.21.15.39:0/1507027067 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3198004410 0x7f31980048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:25.366 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.362+0000 7f31b5717700 1 -- 172.21.15.39:0/1507027067 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3198003a20 msgr2=0x7f3198003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:25.367 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.362+0000 7f31b5717700 1 --2- 172.21.15.39:0/1507027067 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3198003a20 0x7f3198003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:25.367 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.362+0000 7f31b5717700 1 -- 172.21.15.39:0/1507027067 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31980035d0 con 0x7f31980050d0 2023-11-28T11:56:25.367 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.362+0000 7f31b5717700 1 -- 172.21.15.39:0/1507027067 reap_dead start 2023-11-28T11:56:25.367 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.362+0000 7f31b5717700 1 --2- 172.21.15.39:0/1507027067 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31980050d0 0x7f319800ba30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f31a800c340 tx=0x7f31980058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f131c1ca2eb140a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:25.367 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.362+0000 7f31a77fe700 1 -- 172.21.15.39:0/1507027067 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a8001f20 con 0x7f31980050d0 2023-11-28T11:56:25.367 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.362+0000 7f31a77fe700 1 -- 172.21.15.39:0/1507027067 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a800ce60 con 0x7f31980050d0 2023-11-28T11:56:25.367 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.362+0000 7f31a77fe700 1 -- 172.21.15.39:0/1507027067 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a8003c60 con 0x7f31980050d0 2023-11-28T11:56:25.368 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.362+0000 7f31b5f18700 1 -- 172.21.15.39:0/1507027067 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31980050d0 msgr2=0x7f319800ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:25.368 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.362+0000 7f31b5f18700 1 --2- 172.21.15.39:0/1507027067 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31980050d0 0x7f319800ba30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f31a800c340 tx=0x7f31980058a0 comp rx=0 tx=0).stop 2023-11-28T11:56:25.368 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.362+0000 7f31b5f18700 1 -- 172.21.15.39:0/1507027067 shutdown_connections 2023-11-28T11:56:25.368 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.362+0000 7f31b5f18700 1 --2- 172.21.15.39:0/1507027067 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31980050d0 0x7f319800ba30 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:25.368 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.362+0000 7f31b5f18700 1 -- 172.21.15.39:0/1507027067 >> 172.21.15.39:0/1507027067 conn(0x7f31b00cb0c0 msgr2=0x7f31b00cb490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:25.368 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.362+0000 7f31b5f18700 1 -- 172.21.15.39:0/1507027067 shutdown_connections 2023-11-28T11:56:25.368 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.362+0000 7f31b5f18700 1 -- 172.21.15.39:0/1507027067 wait complete. 2023-11-28T11:56:25.369 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.366+0000 7f31b5f18700 1 Processor -- start 2023-11-28T11:56:25.370 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.366+0000 7f31b5f18700 1 -- start start 2023-11-28T11:56:25.372 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.366+0000 7f31b5f18700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31980050d0 0x7f31b01f6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:25.372 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.370+0000 7f31b5f18700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31b01637e0 0x7f31b01f8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:25.372 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.370+0000 7f31b5f18700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f31b0153580 0x7f31b00cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:25.372 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.370+0000 7f31b5f18700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b00af200 con 0x7f31b01637e0 2023-11-28T11:56:25.372 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.370+0000 7f31b5f18700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b0153ef0 con 0x7f31980050d0 2023-11-28T11:56:25.373 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.370+0000 7f31b5f18700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b00ae8d0 con 0x7f31b0153580 2023-11-28T11:56:25.373 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.370+0000 7f31a7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31b01637e0 0x7f31b01f8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:25.373 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.370+0000 7f31a7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31b01637e0 0x7f31b01f8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36930/0 (socket says 172.21.15.39:36930) 2023-11-28T11:56:25.373 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.370+0000 7f31a7fff700 1 -- 172.21.15.39:0/1587300332 learned_addr learned my addr 172.21.15.39:0/1587300332 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:25.374 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.370+0000 7f31b5717700 1 --2- 172.21.15.39:0/1587300332 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f31b0153580 0x7f31b00cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:25.374 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.370+0000 7f31a7fff700 1 -- 172.21.15.39:0/1587300332 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f31b0153580 msgr2=0x7f31b00cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:25.374 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.370+0000 7f31a7fff700 1 --2- 172.21.15.39:0/1587300332 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f31b0153580 0x7f31b00cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:25.374 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.370+0000 7f31a7fff700 1 -- 172.21.15.39:0/1587300332 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31980050d0 msgr2=0x7f31b01f6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:25.374 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.370+0000 7f31a7fff700 1 --2- 172.21.15.39:0/1587300332 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31980050d0 0x7f31b01f6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:25.374 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.370+0000 7f31a7fff700 1 -- 172.21.15.39:0/1587300332 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b006a520 con 0x7f31b01637e0 2023-11-28T11:56:25.374 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.370+0000 7f31a7fff700 1 --2- 172.21.15.39:0/1587300332 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31b01637e0 0x7f31b01f8c90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f31a00108f0 tx=0x7f31a0010cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:25.374 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.370+0000 7f31a57fa700 1 -- 172.21.15.39:0/1587300332 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a0010e90 con 0x7f31b01637e0 2023-11-28T11:56:25.375 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.370+0000 7f31a57fa700 1 -- 172.21.15.39:0/1587300332 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a000e8d0 con 0x7f31b01637e0 2023-11-28T11:56:25.375 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.370+0000 7f31b5f18700 1 -- 172.21.15.39:0/1587300332 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b006a240 con 0x7f31b01637e0 2023-11-28T11:56:25.375 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.370+0000 7f31a57fa700 1 -- 172.21.15.39:0/1587300332 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a000ec40 con 0x7f31b01637e0 2023-11-28T11:56:25.375 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.370+0000 7f31b5f18700 1 -- 172.21.15.39:0/1587300332 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b006c860 con 0x7f31b01637e0 2023-11-28T11:56:25.376 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.374+0000 7f31b5f18700 1 -- 172.21.15.39:0/1587300332 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31b0067250 con 0x7f31b01637e0 2023-11-28T11:56:25.379 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.374+0000 7f31a57fa700 1 -- 172.21.15.39:0/1587300332 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 83919+0+0 (secure 0 0 0) 0x7f31a0026070 con 0x7f31b01637e0 2023-11-28T11:56:25.381 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.378+0000 7f31a57fa700 1 --2- 172.21.15.39:0/1587300332 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f319c064ec0 0x7f319c067370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:25.381 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.378+0000 7f31a57fa700 1 -- 172.21.15.39:0/1587300332 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2791+0+0 (secure 0 0 0) 0x7f31a0081b90 con 0x7f31b01637e0 2023-11-28T11:56:25.381 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.378+0000 7f31b4f16700 1 --2- 172.21.15.39:0/1587300332 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f319c064ec0 0x7f319c067370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:25.382 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.378+0000 7f31b4f16700 1 --2- 172.21.15.39:0/1587300332 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f319c064ec0 0x7f319c067370 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f31ac001050 tx=0x7f31ac001110 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:25.386 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.382+0000 7f31a57fa700 1 -- 172.21.15.39:0/1587300332 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f31a0050970 con 0x7f31b01637e0 2023-11-28T11:56:25.569 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.566+0000 7f31b5f18700 1 -- 172.21.15.39:0/1587300332 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31b00af340 con 0x7f31b01637e0 2023-11-28T11:56:25.570 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.566+0000 7f31a57fa700 1 -- 172.21.15.39:0/1587300332 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+7908 (secure 0 0 0) 0x7f31a0053f90 con 0x7f31b01637e0 2023-11-28T11:56:25.570 INFO:teuthology.misc.health.smithi039.stdout: 2023-11-28T11:56:25.571 INFO:teuthology.misc.health.smithi039.stdout:{"epoch":14,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:56:24.870983+0000","last_up_change":"2023-11-28T11:56:24.870983+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:56:25.575 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.570+0000 7f31b5f18700 1 -- 172.21.15.39:0/1587300332 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f319c064ec0 msgr2=0x7f319c067370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:25.575 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.570+0000 7f31b5f18700 1 --2- 172.21.15.39:0/1587300332 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f319c064ec0 0x7f319c067370 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f31ac001050 tx=0x7f31ac001110 comp rx=0 tx=0).stop 2023-11-28T11:56:25.575 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.570+0000 7f31b5f18700 1 -- 172.21.15.39:0/1587300332 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31b01637e0 msgr2=0x7f31b01f8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:25.575 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.570+0000 7f31b5f18700 1 --2- 172.21.15.39:0/1587300332 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31b01637e0 0x7f31b01f8c90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f31a00108f0 tx=0x7f31a0010cb0 comp rx=0 tx=0).stop 2023-11-28T11:56:25.576 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.570+0000 7f31b5f18700 1 -- 172.21.15.39:0/1587300332 shutdown_connections 2023-11-28T11:56:25.576 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.570+0000 7f31b5f18700 1 --2- 172.21.15.39:0/1587300332 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f31b0153580 0x7f31b00cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:25.576 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.570+0000 7f31b5f18700 1 --2- 172.21.15.39:0/1587300332 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31b01637e0 0x7f31b01f8c90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:25.576 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.570+0000 7f31b5f18700 1 --2- 172.21.15.39:0/1587300332 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f319c064ec0 0x7f319c067370 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:25.576 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.570+0000 7f31b5f18700 1 --2- 172.21.15.39:0/1587300332 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31980050d0 0x7f31b01f6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:25.576 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.570+0000 7f31b5f18700 1 -- 172.21.15.39:0/1587300332 >> 172.21.15.39:0/1587300332 conn(0x7f31b00cb0c0 msgr2=0x7f31b006ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:25.576 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.570+0000 7f31b5f18700 1 -- 172.21.15.39:0/1587300332 shutdown_connections 2023-11-28T11:56:25.576 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:25.570+0000 7f31b5f18700 1 -- 172.21.15.39:0/1587300332 wait complete. 2023-11-28T11:56:25.593 DEBUG:teuthology.misc:2 of 8 OSDs are up 2023-11-28T11:56:26.078 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-11-28T11:56:26.074+0000 7f5299571700 -1 osd.5 0 waiting for initial osdmap 2023-11-28T11:56:26.094 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-11-28T11:56:26.086+0000 7f5290ff0700 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T11:56:26.124 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-11-28T11:56:26.118+0000 7febacb80700 -1 osd.6 0 waiting for initial osdmap 2023-11-28T11:56:26.137 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-11-28T11:56:26.134+0000 7feba3bf0700 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T11:56:26.149 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-11-28T11:56:26.146+0000 7fda87c9b700 -1 osd.4 0 waiting for initial osdmap 2023-11-28T11:56:26.163 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-11-28T11:56:26.158+0000 7fda7ebf0700 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T11:56:26.190 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-11-28T11:56:26.186+0000 7f3b9d496700 -1 osd.7 0 waiting for initial osdmap 2023-11-28T11:56:26.201 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-11-28T11:56:26.198+0000 7f3b94df0700 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T11:56:29.528 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:56:29.536 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:56:32.400 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-28T11:56:32.569 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.566+0000 7f016b59e700 1 Processor -- start 2023-11-28T11:56:32.569 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.566+0000 7f016b59e700 1 -- start start 2023-11-28T11:56:32.571 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.566+0000 7f016b59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f016c156b30 0x7f016c159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:32.571 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.566+0000 7f016b59e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f016c0c93a0 0x7f016c0b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:32.571 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.566+0000 7f016b59e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f016c0cae90 con 0x7f016c0b0760 2023-11-28T11:56:32.571 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.566+0000 7f016b59e700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f016c15a3e0 con 0x7f016c0c93a0 2023-11-28T11:56:32.571 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.566+0000 7f016b59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f016c0b02d0 con 0x7f016c156b30 2023-11-28T11:56:32.572 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.566+0000 7f016ad9d700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f016c0c93a0 0x7f016c0b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:32.572 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.570+0000 7f016ad9d700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f016c0c93a0 0x7f016c0b0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56644/0 (socket says 172.21.15.39:56644) 2023-11-28T11:56:32.572 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.570+0000 7f016ad9d700 1 -- 172.21.15.39:0/3973768937 learned_addr learned my addr 172.21.15.39:0/3973768937 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:32.572 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.570+0000 7f016a59c700 1 --2- 172.21.15.39:0/3973768937 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f016c156b30 0x7f016c159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:32.573 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.570+0000 7f016ad9d700 1 -- 172.21.15.39:0/3973768937 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f016c156b30 msgr2=0x7f016c159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:32.573 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.570+0000 7f016ad9d700 1 --2- 172.21.15.39:0/3973768937 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f016c156b30 0x7f016c159ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:32.573 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.570+0000 7f016ad9d700 1 -- 172.21.15.39:0/3973768937 >> v1:172.21.15.184:6789/0 conn(0x7f016c0b0760 legacy=0x7f016c0c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:32.573 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.570+0000 7f016ad9d700 1 -- 172.21.15.39:0/3973768937 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f016c0cabb0 con 0x7f016c0c93a0 2023-11-28T11:56:32.573 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.570+0000 7f016959a700 1 -- 172.21.15.39:0/3973768937 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1259493569 0 0) 0x7f016c0cae90 con 0x7f016c0b0760 2023-11-28T11:56:32.574 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.570+0000 7f016ad9d700 1 --2- 172.21.15.39:0/3973768937 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f016c0c93a0 0x7f016c0b0bb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0164009e50 tx=0x7f016400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ab8a2f2f4c232c6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:32.574 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.570+0000 7f016959a700 1 -- 172.21.15.39:0/3973768937 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016400e070 con 0x7f016c0c93a0 2023-11-28T11:56:32.574 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.570+0000 7f016959a700 1 -- 172.21.15.39:0/3973768937 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016400b910 con 0x7f016c0c93a0 2023-11-28T11:56:32.574 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.570+0000 7f016959a700 1 -- 172.21.15.39:0/3973768937 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016400bcc0 con 0x7f016c0c93a0 2023-11-28T11:56:32.575 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.570+0000 7f016b59e700 1 -- 172.21.15.39:0/3973768937 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f016c0c93a0 msgr2=0x7f016c0b0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:32.575 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.570+0000 7f016b59e700 1 --2- 172.21.15.39:0/3973768937 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f016c0c93a0 0x7f016c0b0bb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0164009e50 tx=0x7f016400b330 comp rx=0 tx=0).stop 2023-11-28T11:56:32.576 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.570+0000 7f016b59e700 1 -- 172.21.15.39:0/3973768937 shutdown_connections 2023-11-28T11:56:32.576 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.570+0000 7f016b59e700 1 --2- 172.21.15.39:0/3973768937 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f016c0c93a0 0x7f016c0b0bb0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:32.576 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.570+0000 7f016b59e700 1 --2- 172.21.15.39:0/3973768937 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f016c156b30 0x7f016c159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:32.576 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.570+0000 7f016b59e700 1 -- 172.21.15.39:0/3973768937 >> 172.21.15.39:0/3973768937 conn(0x7f016c0cb0c0 msgr2=0x7f016c0cb490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:32.576 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.574+0000 7f016b59e700 1 -- 172.21.15.39:0/3973768937 shutdown_connections 2023-11-28T11:56:32.576 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.574+0000 7f016b59e700 1 -- 172.21.15.39:0/3973768937 wait complete. 2023-11-28T11:56:32.579 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.574+0000 7f016b59e700 1 Processor -- start 2023-11-28T11:56:32.580 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.574+0000 7f016b59e700 1 -- start start 2023-11-28T11:56:32.582 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.578+0000 7f016b59e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f016c0b0760 0x7f016c06a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:32.582 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.578+0000 7f016b59e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f016c0c93a0 0x7f016c06abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:32.582 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.578+0000 7f016b59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f016c156b30 0x7f016c144f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:32.582 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.578+0000 7f016b59e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016c151500 con 0x7f016c0b0760 2023-11-28T11:56:32.583 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.578+0000 7f016b59e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016c1517e0 con 0x7f016c0c93a0 2023-11-28T11:56:32.583 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.578+0000 7f016b59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f016c15a5c0 con 0x7f016c156b30 2023-11-28T11:56:32.583 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.578+0000 7f016a59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f016c0b0760 0x7f016c06a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:32.583 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.578+0000 7f016a59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f016c0b0760 0x7f016c06a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56658/0 (socket says 172.21.15.39:56658) 2023-11-28T11:56:32.583 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.578+0000 7f016a59c700 1 -- 172.21.15.39:0/3562334245 learned_addr learned my addr 172.21.15.39:0/3562334245 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:32.583 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.578+0000 7f0169d9b700 1 --2- 172.21.15.39:0/3562334245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f016c0c93a0 0x7f016c06abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:32.583 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.578+0000 7f016ad9d700 1 --2- 172.21.15.39:0/3562334245 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f016c156b30 0x7f016c144f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:32.584 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.578+0000 7f016a59c700 1 -- 172.21.15.39:0/3562334245 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f016c156b30 msgr2=0x7f016c144f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:32.584 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.578+0000 7f016a59c700 1 --2- 172.21.15.39:0/3562334245 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f016c156b30 0x7f016c144f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:32.584 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.578+0000 7f016a59c700 1 -- 172.21.15.39:0/3562334245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f016c0c93a0 msgr2=0x7f016c06abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:32.584 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.578+0000 7f016a59c700 1 --2- 172.21.15.39:0/3562334245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f016c0c93a0 0x7f016c06abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:32.584 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.578+0000 7f016a59c700 1 -- 172.21.15.39:0/3562334245 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0164009b30 con 0x7f016c0b0760 2023-11-28T11:56:32.584 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.578+0000 7f016a59c700 1 --2- 172.21.15.39:0/3562334245 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f016c0b0760 0x7f016c06a6b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f015c00ebe0 tx=0x7f015c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:32.585 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.578+0000 7f015affd700 1 -- 172.21.15.39:0/3562334245 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015c009740 con 0x7f016c0b0760 2023-11-28T11:56:32.585 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.578+0000 7f015affd700 1 -- 172.21.15.39:0/3562334245 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f015c00c850 con 0x7f016c0b0760 2023-11-28T11:56:32.585 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.578+0000 7f015affd700 1 -- 172.21.15.39:0/3562334245 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015c00cbe0 con 0x7f016c0b0760 2023-11-28T11:56:32.585 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.582+0000 7f016b59e700 1 -- 172.21.15.39:0/3562334245 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f016c0aff60 con 0x7f016c0b0760 2023-11-28T11:56:32.585 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.582+0000 7f016b59e700 1 -- 172.21.15.39:0/3562334245 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f016c0afc80 con 0x7f016c0b0760 2023-11-28T11:56:32.585 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.582+0000 7f016b59e700 1 -- 172.21.15.39:0/3562334245 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f016c067250 con 0x7f016c0b0760 2023-11-28T11:56:32.586 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.582+0000 7f015affd700 1 -- 172.21.15.39:0/3562334245 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f015c023070 con 0x7f016c0b0760 2023-11-28T11:56:32.587 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.582+0000 7f015affd700 1 --2- 172.21.15.39:0/3562334245 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f014c064ee0 0x7f014c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:32.588 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.582+0000 7f015affd700 1 -- 172.21.15.39:0/3562334245 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f015c081c80 con 0x7f016c0b0760 2023-11-28T11:56:32.588 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.586+0000 7f0169d9b700 1 --2- 172.21.15.39:0/3562334245 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f014c064ee0 0x7f014c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:32.589 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.586+0000 7f0169d9b700 1 --2- 172.21.15.39:0/3562334245 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f014c064ee0 0x7f014c067390 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f016c06ea20 tx=0x7f0160009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:32.596 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.594+0000 7f015affd700 1 -- 172.21.15.39:0/3562334245 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f015c050270 con 0x7f016c0b0760 2023-11-28T11:56:32.771 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.766+0000 7f016b59e700 1 -- 172.21.15.39:0/3562334245 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f016c0ae670 con 0x7f016c0b0760 2023-11-28T11:56:32.773 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.770+0000 7f015affd700 1 -- 172.21.15.39:0/3562334245 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12382 (secure 0 0 0) 0x7f015c053890 con 0x7f016c0b0760 2023-11-28T11:56:32.774 INFO:teuthology.misc.health.smithi039.stdout: 2023-11-28T11:56:32.774 INFO:teuthology.misc.health.smithi039.stdout:{"epoch":18,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:56:29.311958+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:56:32.777 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.774+0000 7f016b59e700 1 -- 172.21.15.39:0/3562334245 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f014c064ee0 msgr2=0x7f014c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:32.777 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.774+0000 7f016b59e700 1 --2- 172.21.15.39:0/3562334245 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f014c064ee0 0x7f014c067390 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f016c06ea20 tx=0x7f0160009040 comp rx=0 tx=0).stop 2023-11-28T11:56:32.777 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.774+0000 7f016b59e700 1 -- 172.21.15.39:0/3562334245 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f016c0b0760 msgr2=0x7f016c06a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:32.777 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.774+0000 7f016b59e700 1 --2- 172.21.15.39:0/3562334245 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f016c0b0760 0x7f016c06a6b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f015c00ebe0 tx=0x7f015c00eef0 comp rx=0 tx=0).stop 2023-11-28T11:56:32.777 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.774+0000 7f016b59e700 1 -- 172.21.15.39:0/3562334245 shutdown_connections 2023-11-28T11:56:32.777 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.774+0000 7f016b59e700 1 --2- 172.21.15.39:0/3562334245 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f016c156b30 0x7f016c144f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:32.777 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.774+0000 7f016b59e700 1 --2- 172.21.15.39:0/3562334245 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f014c064ee0 0x7f014c067390 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:32.777 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.774+0000 7f016b59e700 1 --2- 172.21.15.39:0/3562334245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f016c0c93a0 0x7f016c06abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:32.777 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.774+0000 7f016b59e700 1 --2- 172.21.15.39:0/3562334245 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f016c0b0760 0x7f016c06a6b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:32.777 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.774+0000 7f016b59e700 1 -- 172.21.15.39:0/3562334245 >> 172.21.15.39:0/3562334245 conn(0x7f016c0cb0c0 msgr2=0x7f016c06d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:32.777 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.774+0000 7f016b59e700 1 -- 172.21.15.39:0/3562334245 shutdown_connections 2023-11-28T11:56:32.777 INFO:teuthology.misc.health.smithi039.stderr:2023-11-28T11:56:32.774+0000 7f016b59e700 1 -- 172.21.15.39:0/3562334245 wait complete. 2023-11-28T11:56:32.798 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-28T11:56:32.798 INFO:tasks.ceph:Creating RBD pool 2023-11-28T11:56:32.798 DEBUG:teuthology.orchestra.run.smithi039:> sudo ceph --cluster ceph osd pool create rbd 8 2023-11-28T11:56:32.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.970+0000 7f70c5edd700 1 Processor -- start 2023-11-28T11:56:32.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.970+0000 7f70c5edd700 1 -- start start 2023-11-28T11:56:32.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.974+0000 7f70c5edd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f70c015c150 0x7f70c00b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:32.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.974+0000 7f70c5edd700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70c015c520 con 0x7f70c006ff10 2023-11-28T11:56:32.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.974+0000 7f70c5edd700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70c006ac00 con 0x7f70c0070360 2023-11-28T11:56:32.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.974+0000 7f70c5edd700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70c00b4240 con 0x7f70c015c150 2023-11-28T11:56:32.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.974+0000 7f70c4edb700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f70c015c150 0x7f70c00b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:32.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.974+0000 7f70c4edb700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f70c015c150 0x7f70c00b3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:44440/0 (socket says 172.21.15.39:44440) 2023-11-28T11:56:32.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.974+0000 7f70c4edb700 1 -- 172.21.15.39:0/3127437976 learned_addr learned my addr 172.21.15.39:0/3127437976 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:32.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.974+0000 7f70c4edb700 1 -- 172.21.15.39:0/3127437976 >> v1:172.21.15.184:6789/0 conn(0x7f70c0070360 legacy=0x7f70c0160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:32.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.974+0000 7f70c4edb700 1 -- 172.21.15.39:0/3127437976 >> v1:172.21.15.39:6789/0 conn(0x7f70c006ff10 legacy=0x7f70c015fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:32.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.974+0000 7f70bf7fe700 1 -- 172.21.15.39:0/3127437976 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1050494667 0 0) 0x7f70c015c520 con 0x7f70c006ff10 2023-11-28T11:56:32.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.974+0000 7f70c4edb700 1 -- 172.21.15.39:0/3127437976 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c0160a50 con 0x7f70c015c150 2023-11-28T11:56:32.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.974+0000 7f70c4edb700 1 --2- 172.21.15.39:0/3127437976 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70c015c150 0x7f70c00b3d00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f70b4009890 tx=0x7f70b4009ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe35f7fd19843eac server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:32.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.974+0000 7f70bf7fe700 1 -- 172.21.15.39:0/3127437976 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b4004230 con 0x7f70c015c150 2023-11-28T11:56:32.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.974+0000 7f70bf7fe700 1 -- 172.21.15.39:0/3127437976 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b4004390 con 0x7f70c015c150 2023-11-28T11:56:32.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.974+0000 7f70bf7fe700 1 -- 172.21.15.39:0/3127437976 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b40036c0 con 0x7f70c015c150 2023-11-28T11:56:32.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.978+0000 7f70c5edd700 1 -- 172.21.15.39:0/3127437976 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70c015c150 msgr2=0x7f70c00b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:32.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.978+0000 7f70c5edd700 1 --2- 172.21.15.39:0/3127437976 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70c015c150 0x7f70c00b3d00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f70b4009890 tx=0x7f70b4009ba0 comp rx=0 tx=0).stop 2023-11-28T11:56:32.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.978+0000 7f70c5edd700 1 -- 172.21.15.39:0/3127437976 shutdown_connections 2023-11-28T11:56:32.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.978+0000 7f70c5edd700 1 --2- 172.21.15.39:0/3127437976 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70c015c150 0x7f70c00b3d00 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:32.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.978+0000 7f70c5edd700 1 -- 172.21.15.39:0/3127437976 >> 172.21.15.39:0/3127437976 conn(0x7f70c00d3680 msgr2=0x7f70c00cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:32.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.978+0000 7f70c5edd700 1 -- 172.21.15.39:0/3127437976 shutdown_connections 2023-11-28T11:56:32.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.978+0000 7f70c5edd700 1 -- 172.21.15.39:0/3127437976 wait complete. 2023-11-28T11:56:32.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.982+0000 7f70c5edd700 1 Processor -- start 2023-11-28T11:56:32.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.982+0000 7f70c5edd700 1 -- start start 2023-11-28T11:56:32.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.982+0000 7f70c5edd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70c006ff10 0x7f70c01f11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:32.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.982+0000 7f70c5edd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70c0070360 0x7f70c0158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:32.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.982+0000 7f70c5edd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f70c015c150 0x7f70c015a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:32.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.982+0000 7f70c5edd700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c0159160 con 0x7f70c015c150 2023-11-28T11:56:32.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.982+0000 7f70c5edd700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c0159440 con 0x7f70c0070360 2023-11-28T11:56:32.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.982+0000 7f70c5edd700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70c00cd280 con 0x7f70c006ff10 2023-11-28T11:56:32.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.982+0000 7f70c56dc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f70c015c150 0x7f70c015a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:32.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.982+0000 7f70c56dc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f70c015c150 0x7f70c015a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56668/0 (socket says 172.21.15.39:56668) 2023-11-28T11:56:32.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.982+0000 7f70c56dc700 1 -- 172.21.15.39:0/2261567168 learned_addr learned my addr 172.21.15.39:0/2261567168 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:32.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.982+0000 7f70c4edb700 1 --2- 172.21.15.39:0/2261567168 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70c006ff10 0x7f70c01f11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:32.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.986+0000 7f70bffff700 1 --2- 172.21.15.39:0/2261567168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70c0070360 0x7f70c0158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:32.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.986+0000 7f70c4edb700 1 -- 172.21.15.39:0/2261567168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70c0070360 msgr2=0x7f70c0158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:32.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.986+0000 7f70c4edb700 1 --2- 172.21.15.39:0/2261567168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70c0070360 0x7f70c0158750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:32.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.986+0000 7f70c4edb700 1 -- 172.21.15.39:0/2261567168 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f70c015c150 msgr2=0x7f70c015a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:32.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.986+0000 7f70c4edb700 1 --2- 172.21.15.39:0/2261567168 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f70c015c150 0x7f70c015a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:32.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.986+0000 7f70c4edb700 1 -- 172.21.15.39:0/2261567168 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b4009570 con 0x7f70c006ff10 2023-11-28T11:56:32.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.986+0000 7f70c56dc700 1 --2- 172.21.15.39:0/2261567168 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f70c015c150 0x7f70c015a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:32.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.986+0000 7f70c4edb700 1 --2- 172.21.15.39:0/2261567168 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70c006ff10 0x7f70c01f11e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f70b4015000 tx=0x7f70b4004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:32.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.986+0000 7f70bd7fa700 1 -- 172.21.15.39:0/2261567168 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b4003ea0 con 0x7f70c006ff10 2023-11-28T11:56:32.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.986+0000 7f70bd7fa700 1 -- 172.21.15.39:0/2261567168 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b4011630 con 0x7f70c006ff10 2023-11-28T11:56:32.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.986+0000 7f70c5edd700 1 -- 172.21.15.39:0/2261567168 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70c00d2450 con 0x7f70c006ff10 2023-11-28T11:56:32.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.986+0000 7f70bd7fa700 1 -- 172.21.15.39:0/2261567168 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b4011a00 con 0x7f70c006ff10 2023-11-28T11:56:32.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.986+0000 7f70c5edd700 1 -- 172.21.15.39:0/2261567168 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70c006cc50 con 0x7f70c006ff10 2023-11-28T11:56:32.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.986+0000 7f70c5edd700 1 -- 172.21.15.39:0/2261567168 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70c00d2730 con 0x7f70c006ff10 2023-11-28T11:56:32.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.990+0000 7f70bd7fa700 1 -- 172.21.15.39:0/2261567168 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f70b4017020 con 0x7f70c006ff10 2023-11-28T11:56:32.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.990+0000 7f70bd7fa700 1 --2- 172.21.15.39:0/2261567168 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f70a4064ee0 0x7f70a4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:32.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.990+0000 7f70bd7fa700 1 -- 172.21.15.39:0/2261567168 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f70b4083980 con 0x7f70c006ff10 2023-11-28T11:56:32.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.990+0000 7f70bffff700 1 --2- 172.21.15.39:0/2261567168 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f70a4064ee0 0x7f70a4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:32.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.994+0000 7f70bffff700 1 --2- 172.21.15.39:0/2261567168 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f70a4064ee0 0x7f70a4067390 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f70c00d0020 tx=0x7f70ac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:33.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:32.998+0000 7f70bd7fa700 1 -- 172.21.15.39:0/2261567168 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f70b4051f60 con 0x7f70c006ff10 2023-11-28T11:56:33.179 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.174+0000 7f70c5edd700 1 -- 172.21.15.39:0/2261567168 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f70c0073d20 con 0x7f70c006ff10 2023-11-28T11:56:33.373 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.370+0000 7f70bd7fa700 1 -- 172.21.15.39:0/2261567168 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v19) v1 ==== 109+0+0 (secure 0 0 0) 0x7f70b4055580 con 0x7f70c006ff10 2023-11-28T11:56:33.377 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.374+0000 7f70c5edd700 1 -- 172.21.15.39:0/2261567168 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f70a4064ee0 msgr2=0x7f70a4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:33.378 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.374+0000 7f70c5edd700 1 --2- 172.21.15.39:0/2261567168 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f70a4064ee0 0x7f70a4067390 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f70c00d0020 tx=0x7f70ac009040 comp rx=0 tx=0).stop 2023-11-28T11:56:33.378 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.374+0000 7f70c5edd700 1 -- 172.21.15.39:0/2261567168 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70c006ff10 msgr2=0x7f70c01f11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:33.378 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.374+0000 7f70c5edd700 1 --2- 172.21.15.39:0/2261567168 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70c006ff10 0x7f70c01f11e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f70b4015000 tx=0x7f70b4004770 comp rx=0 tx=0).stop 2023-11-28T11:56:33.378 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.374+0000 7f70c5edd700 1 -- 172.21.15.39:0/2261567168 shutdown_connections 2023-11-28T11:56:33.378 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.374+0000 7f70c5edd700 1 --2- 172.21.15.39:0/2261567168 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f70c015c150 0x7f70c015a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:33.378 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.374+0000 7f70c5edd700 1 --2- 172.21.15.39:0/2261567168 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f70a4064ee0 0x7f70a4067390 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:33.378 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.374+0000 7f70c5edd700 1 --2- 172.21.15.39:0/2261567168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70c0070360 0x7f70c0158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:33.378 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.374+0000 7f70c5edd700 1 --2- 172.21.15.39:0/2261567168 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70c006ff10 0x7f70c01f11e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:33.378 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.374+0000 7f70c5edd700 1 -- 172.21.15.39:0/2261567168 >> 172.21.15.39:0/2261567168 conn(0x7f70c00d3680 msgr2=0x7f70c00b7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:33.378 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.374+0000 7f70c5edd700 1 -- 172.21.15.39:0/2261567168 shutdown_connections 2023-11-28T11:56:33.379 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.374+0000 7f70c5edd700 1 -- 172.21.15.39:0/2261567168 wait complete. 2023-11-28T11:56:33.380 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'rbd' created 2023-11-28T11:56:33.400 DEBUG:teuthology.orchestra.run.smithi039:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-11-28T11:56:33.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.574+0000 7fa8fb518700 1 Processor -- start 2023-11-28T11:56:33.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.574+0000 7fa8fb518700 1 -- start start 2023-11-28T11:56:33.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.578+0000 7fa8fb518700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8f415c5d0 0x7fa8f406ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:33.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.578+0000 7fa8fb518700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa8f40cdf80 0x7fa8f40ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:33.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.578+0000 7fa8fb518700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8f406f520 con 0x7fa8f406e990 2023-11-28T11:56:33.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.578+0000 7fa8fb518700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f40cf1e0 con 0x7fa8f40cdf80 2023-11-28T11:56:33.583 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.578+0000 7fa8fb518700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f40ce910 con 0x7fa8f415c5d0 2023-11-28T11:56:33.583 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.578+0000 7fa8fa516700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8f415c5d0 0x7fa8f406ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:33.583 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.578+0000 7fa8f9d15700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa8f40cdf80 0x7fa8f40ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:33.583 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.578+0000 7fa8fa516700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8f415c5d0 0x7fa8f406ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:50612/0 (socket says 172.21.15.39:50612) 2023-11-28T11:56:33.583 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.578+0000 7fa8fa516700 1 -- 172.21.15.39:0/164208888 learned_addr learned my addr 172.21.15.39:0/164208888 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:33.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.578+0000 7fa8fa516700 1 -- 172.21.15.39:0/164208888 >> v2:172.21.15.39:3300/0 conn(0x7fa8f40cdf80 msgr2=0x7fa8f40ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:33.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.578+0000 7fa8fa516700 1 --2- 172.21.15.39:0/164208888 >> v2:172.21.15.39:3300/0 conn(0x7fa8f40cdf80 0x7fa8f40ce3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:33.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.578+0000 7fa8fa516700 1 -- 172.21.15.39:0/164208888 >> v1:172.21.15.184:6789/0 conn(0x7fa8f406e990 legacy=0x7fa8f406ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:33.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.578+0000 7fa8fa516700 1 -- 172.21.15.39:0/164208888 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f40cad70 con 0x7fa8f415c5d0 2023-11-28T11:56:33.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.578+0000 7fa8fa516700 1 --2- 172.21.15.39:0/164208888 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8f415c5d0 0x7fa8f406ad00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa8f000bbb0 tx=0x7fa8f000bec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c91421bb6d181172 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:33.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.582+0000 7fa8f9514700 1 -- 172.21.15.39:0/164208888 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f000dd30 con 0x7fa8f415c5d0 2023-11-28T11:56:33.585 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.582+0000 7fa8f9514700 1 -- 172.21.15.39:0/164208888 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f000de90 con 0x7fa8f415c5d0 2023-11-28T11:56:33.585 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.582+0000 7fa8f9514700 1 -- 172.21.15.39:0/164208888 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f0010690 con 0x7fa8f415c5d0 2023-11-28T11:56:33.585 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.582+0000 7fa8fb518700 1 -- 172.21.15.39:0/164208888 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8f415c5d0 msgr2=0x7fa8f406ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:33.585 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.582+0000 7fa8fb518700 1 --2- 172.21.15.39:0/164208888 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8f415c5d0 0x7fa8f406ad00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa8f000bbb0 tx=0x7fa8f000bec0 comp rx=0 tx=0).stop 2023-11-28T11:56:33.586 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.582+0000 7fa8fb518700 1 -- 172.21.15.39:0/164208888 shutdown_connections 2023-11-28T11:56:33.586 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.582+0000 7fa8fb518700 1 --2- 172.21.15.39:0/164208888 >> v2:172.21.15.39:3300/0 conn(0x7fa8f40cdf80 0x7fa8f40ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:33.586 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.582+0000 7fa8fb518700 1 --2- 172.21.15.39:0/164208888 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8f415c5d0 0x7fa8f406ad00 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:33.586 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.582+0000 7fa8fb518700 1 -- 172.21.15.39:0/164208888 >> 172.21.15.39:0/164208888 conn(0x7fa8f40d0340 msgr2=0x7fa8f40cc180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:33.586 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.582+0000 7fa8fb518700 1 -- 172.21.15.39:0/164208888 shutdown_connections 2023-11-28T11:56:33.587 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.582+0000 7fa8fb518700 1 -- 172.21.15.39:0/164208888 wait complete. 2023-11-28T11:56:33.589 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.586+0000 7fa8fb518700 1 Processor -- start 2023-11-28T11:56:33.589 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.586+0000 7fa8fb518700 1 -- start start 2023-11-28T11:56:33.590 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.586+0000 7fa8fb518700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8f406e990 0x7fa8f41f4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:33.590 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.586+0000 7fa8fb518700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8f40cdf80 0x7fa8f415a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:33.591 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.586+0000 7fa8fb518700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8f415c5d0 0x7fa8f415a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:33.591 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.586+0000 7fa8fb518700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f40c3b70 con 0x7fa8f40cdf80 2023-11-28T11:56:33.591 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.586+0000 7fa8fb518700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f41f4d80 con 0x7fa8f415c5d0 2023-11-28T11:56:33.591 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.586+0000 7fa8fb518700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f4158910 con 0x7fa8f406e990 2023-11-28T11:56:33.591 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.586+0000 7fa8f9d15700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8f40cdf80 0x7fa8f415a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:33.591 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.586+0000 7fa8f9d15700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8f40cdf80 0x7fa8f415a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56686/0 (socket says 172.21.15.39:56686) 2023-11-28T11:56:33.591 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.586+0000 7fa8f9d15700 1 -- 172.21.15.39:0/361797115 learned_addr learned my addr 172.21.15.39:0/361797115 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:33.591 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.586+0000 7fa8fa516700 1 --2- 172.21.15.39:0/361797115 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8f406e990 0x7fa8f41f4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:33.591 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.586+0000 7fa8fad17700 1 --2- 172.21.15.39:0/361797115 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8f415c5d0 0x7fa8f415a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:33.594 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.586+0000 7fa8f9d15700 1 -- 172.21.15.39:0/361797115 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8f406e990 msgr2=0x7fa8f41f4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:33.594 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.586+0000 7fa8f9d15700 1 --2- 172.21.15.39:0/361797115 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8f406e990 0x7fa8f41f4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:33.594 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.586+0000 7fa8f9d15700 1 -- 172.21.15.39:0/361797115 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8f415c5d0 msgr2=0x7fa8f415a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:33.594 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.586+0000 7fa8f9d15700 1 --2- 172.21.15.39:0/361797115 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8f415c5d0 0x7fa8f415a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:33.594 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.586+0000 7fa8f9d15700 1 -- 172.21.15.39:0/361797115 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f000b810 con 0x7fa8f40cdf80 2023-11-28T11:56:33.594 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.586+0000 7fa8f9d15700 1 --2- 172.21.15.39:0/361797115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8f40cdf80 0x7fa8f415a450 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa8e400e9d0 tx=0x7fa8e400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:33.594 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.590+0000 7fa8eaffd700 1 -- 172.21.15.39:0/361797115 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4009720 con 0x7fa8f40cdf80 2023-11-28T11:56:33.594 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.590+0000 7fa8fb518700 1 -- 172.21.15.39:0/361797115 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f406f750 con 0x7fa8f40cdf80 2023-11-28T11:56:33.595 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.590+0000 7fa8eaffd700 1 -- 172.21.15.39:0/361797115 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e400c850 con 0x7fa8f40cdf80 2023-11-28T11:56:33.595 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.590+0000 7fa8eaffd700 1 -- 172.21.15.39:0/361797115 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e400cbc0 con 0x7fa8f40cdf80 2023-11-28T11:56:33.595 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.590+0000 7fa8fb518700 1 -- 172.21.15.39:0/361797115 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f40ca790 con 0x7fa8f40cdf80 2023-11-28T11:56:33.595 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.590+0000 7fa8fb518700 1 -- 172.21.15.39:0/361797115 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8f40caa00 con 0x7fa8f40cdf80 2023-11-28T11:56:33.597 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.594+0000 7fa8eaffd700 1 -- 172.21.15.39:0/361797115 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa8e4019030 con 0x7fa8f40cdf80 2023-11-28T11:56:33.597 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.594+0000 7fa8eaffd700 1 --2- 172.21.15.39:0/361797115 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa8d8064ee0 0x7fa8d8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:33.597 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.594+0000 7fa8eaffd700 1 -- 172.21.15.39:0/361797115 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5199+0+0 (secure 0 0 0) 0x7fa8e4082200 con 0x7fa8f40cdf80 2023-11-28T11:56:33.598 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.594+0000 7fa8fa516700 1 --2- 172.21.15.39:0/361797115 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa8d8064ee0 0x7fa8d8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:33.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.594+0000 7fa8fa516700 1 --2- 172.21.15.39:0/361797115 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa8d8064ee0 0x7fa8d8067390 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa8f000bfd0 tx=0x7fa8f001b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:33.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.598+0000 7fa8eaffd700 1 -- 172.21.15.39:0/361797115 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa8e40507a0 con 0x7fa8f40cdf80 2023-11-28T11:56:33.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:33.774+0000 7fa8fb518700 1 -- 172.21.15.39:0/361797115 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa8f4073cb0 con 0x7fa8f40cdf80 2023-11-28T11:56:34.375 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.370+0000 7fa8eaffd700 1 -- 172.21.15.39:0/361797115 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v20) v1 ==== 173+0+0 (secure 0 0 0) 0x7fa8e40170c0 con 0x7fa8f40cdf80 2023-11-28T11:56:34.382 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.378+0000 7fa8fb518700 1 -- 172.21.15.39:0/361797115 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa8d8064ee0 msgr2=0x7fa8d8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:34.382 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.378+0000 7fa8fb518700 1 --2- 172.21.15.39:0/361797115 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa8d8064ee0 0x7fa8d8067390 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa8f000bfd0 tx=0x7fa8f001b040 comp rx=0 tx=0).stop 2023-11-28T11:56:34.382 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.378+0000 7fa8fb518700 1 -- 172.21.15.39:0/361797115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8f40cdf80 msgr2=0x7fa8f415a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:34.382 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.378+0000 7fa8fb518700 1 --2- 172.21.15.39:0/361797115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8f40cdf80 0x7fa8f415a450 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa8e400e9d0 tx=0x7fa8e400ece0 comp rx=0 tx=0).stop 2023-11-28T11:56:34.382 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.378+0000 7fa8fb518700 1 -- 172.21.15.39:0/361797115 shutdown_connections 2023-11-28T11:56:34.382 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.378+0000 7fa8fb518700 1 --2- 172.21.15.39:0/361797115 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa8d8064ee0 0x7fa8d8067390 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa8f000bfd0 tx=0x7fa8f001b040 comp rx=0 tx=0).stop 2023-11-28T11:56:34.382 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.378+0000 7fa8fb518700 1 --2- 172.21.15.39:0/361797115 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8f415c5d0 0x7fa8f415a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:34.382 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.378+0000 7fa8fb518700 1 --2- 172.21.15.39:0/361797115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8f40cdf80 0x7fa8f415a450 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:34.383 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.378+0000 7fa8fb518700 1 --2- 172.21.15.39:0/361797115 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8f406e990 0x7fa8f41f4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:34.383 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.378+0000 7fa8fb518700 1 -- 172.21.15.39:0/361797115 >> 172.21.15.39:0/361797115 conn(0x7fa8f40d0340 msgr2=0x7fa8f4071000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:34.383 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.378+0000 7fa8fb518700 1 -- 172.21.15.39:0/361797115 shutdown_connections 2023-11-28T11:56:34.383 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.378+0000 7fa8fb518700 1 -- 172.21.15.39:0/361797115 wait complete. 2023-11-28T11:56:34.389 INFO:teuthology.orchestra.run.smithi039.stderr:enabled application 'rbd' on pool 'rbd' 2023-11-28T11:56:34.411 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-28T11:56:34.411 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T11:56:34.411 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T11:56:34.418 INFO:tasks.ceph.mds.a:Started 2023-11-28T11:56:34.419 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T11:56:34.419 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T11:56:34.425 INFO:tasks.ceph.mds.c:Started 2023-11-28T11:56:34.426 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T11:56:34.426 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T11:56:34.433 INFO:tasks.ceph.mds.b:Started 2023-11-28T11:56:34.434 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-28T11:56:34.434 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-28T11:56:34.438 INFO:tasks.ceph.mds.d:Started 2023-11-28T11:56:34.438 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-28T11:56:34.438 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:56:34.535 INFO:tasks.ceph.mds.a.smithi039.stdout:starting mds.a at 2023-11-28T11:56:34.548 INFO:tasks.ceph.mds.c.smithi039.stdout:starting mds.c at 2023-11-28T11:56:34.564 INFO:tasks.ceph.mds.b.smithi184.stdout:starting mds.b at 2023-11-28T11:56:34.567 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2023-11-28T11:56:34.624 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.618+0000 7f7157c62700 1 Processor -- start 2023-11-28T11:56:34.624 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.622+0000 7f7157c62700 1 -- start start 2023-11-28T11:56:34.627 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.622+0000 7f7157c62700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f71500b6200 0x7f7150070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:34.627 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.622+0000 7f7157c62700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f715015d080 con 0x7f715015d510 2023-11-28T11:56:34.627 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.622+0000 7f7157c62700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7150153870 con 0x7f71501534a0 2023-11-28T11:56:34.627 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.622+0000 7f7157c62700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f715015d970 con 0x7f71500b6200 2023-11-28T11:56:34.628 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.622+0000 7f71551fd700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f715015d510 0x7f71500b5af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:37536/0 (socket says 172.21.15.39:37536) 2023-11-28T11:56:34.628 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.622+0000 7f71551fd700 1 -- 172.21.15.39:0/2920647392 learned_addr learned my addr 172.21.15.39:0/2920647392 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:56:34.628 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.622+0000 7f71561ff700 1 --2- 172.21.15.39:0/2920647392 >> v2:172.21.15.39:3300/0 conn(0x7f71500b6200 0x7f7150070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:34.629 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.626+0000 7f71561ff700 1 -- 172.21.15.39:0/2920647392 >> v1:172.21.15.184:6789/0 conn(0x7f71501534a0 legacy=0x7f7150160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:34.629 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.626+0000 7f71561ff700 1 -- 172.21.15.39:0/2920647392 >> v1:172.21.15.39:6789/0 conn(0x7f715015d510 legacy=0x7f71500b5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:34.629 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.626+0000 7f71561ff700 1 -- 172.21.15.39:0/2920647392 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71500b53c0 con 0x7f71500b6200 2023-11-28T11:56:34.629 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.626+0000 7f71549fc700 1 -- 172.21.15.39:0/2920647392 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 787636352 0 0) 0x7f7150153870 con 0x7f71501534a0 2023-11-28T11:56:34.629 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.626+0000 7f71561ff700 1 --2- 172.21.15.39:0/2920647392 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71500b6200 0x7f7150070630 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7148009d90 tx=0x7f714800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8770355711bd469e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:34.629 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.626+0000 7f71549fc700 1 -- 172.21.15.39:0/2920647392 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714800e070 con 0x7f71500b6200 2023-11-28T11:56:34.630 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.626+0000 7f71549fc700 1 -- 172.21.15.39:0/2920647392 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714800bbd0 con 0x7f71500b6200 2023-11-28T11:56:34.630 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.626+0000 7f71549fc700 1 -- 172.21.15.39:0/2920647392 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7148012430 con 0x7f71500b6200 2023-11-28T11:56:34.630 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.626+0000 7f7157c62700 1 -- 172.21.15.39:0/2920647392 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71500b6200 msgr2=0x7f7150070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:34.631 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.626+0000 7f7157c62700 1 --2- 172.21.15.39:0/2920647392 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71500b6200 0x7f7150070630 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7148009d90 tx=0x7f714800b330 comp rx=0 tx=0).stop 2023-11-28T11:56:34.631 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.626+0000 7f7157c62700 1 -- 172.21.15.39:0/2920647392 shutdown_connections 2023-11-28T11:56:34.631 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.626+0000 7f7157c62700 1 --2- 172.21.15.39:0/2920647392 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71500b6200 0x7f7150070630 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:34.631 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.626+0000 7f7157c62700 1 -- 172.21.15.39:0/2920647392 >> 172.21.15.39:0/2920647392 conn(0x7f715006bfc0 msgr2=0x7f715006c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:34.631 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.626+0000 7f7157c62700 1 -- 172.21.15.39:0/2920647392 shutdown_connections 2023-11-28T11:56:34.632 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.626+0000 7f7157c62700 1 -- 172.21.15.39:0/2920647392 wait complete. 2023-11-28T11:56:34.633 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.630+0000 7f7157c62700 1 Processor -- start 2023-11-28T11:56:34.633 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.630+0000 7f7157c62700 1 -- start start 2023-11-28T11:56:34.635 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.630+0000 7f7157c62700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71500b6200 0x7f715013c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:34.635 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.630+0000 7f7157c62700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71501534a0 0x7f715015e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:34.635 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.630+0000 7f7157c62700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f715015d510 0x7f715015ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:34.635 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.630+0000 7f7157c62700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715014f040 con 0x7f71501534a0 2023-11-28T11:56:34.635 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.630+0000 7f7157c62700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715013ca80 con 0x7f71500b6200 2023-11-28T11:56:34.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.630+0000 7f7157c62700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71501f3440 con 0x7f715015d510 2023-11-28T11:56:34.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.630+0000 7f71551fd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71501534a0 0x7f715015e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:34.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.630+0000 7f71551fd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71501534a0 0x7f715015e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56732/0 (socket says 172.21.15.39:56732) 2023-11-28T11:56:34.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.630+0000 7f71551fd700 1 -- 172.21.15.39:0/69053509 learned_addr learned my addr 172.21.15.39:0/69053509 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:34.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.630+0000 7f71559fe700 1 --2- 172.21.15.39:0/69053509 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71500b6200 0x7f715013c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:34.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.630+0000 7f71561ff700 1 --2- 172.21.15.39:0/69053509 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f715015d510 0x7f715015ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:34.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.630+0000 7f71551fd700 1 -- 172.21.15.39:0/69053509 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f715015d510 msgr2=0x7f715015ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:34.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.630+0000 7f71551fd700 1 --2- 172.21.15.39:0/69053509 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f715015d510 0x7f715015ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:34.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.630+0000 7f71551fd700 1 -- 172.21.15.39:0/69053509 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71500b6200 msgr2=0x7f715013c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:34.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.630+0000 7f71551fd700 1 --2- 172.21.15.39:0/69053509 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71500b6200 0x7f715013c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:34.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.630+0000 7f71551fd700 1 -- 172.21.15.39:0/69053509 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7148009a70 con 0x7f71501534a0 2023-11-28T11:56:34.637 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.630+0000 7f71551fd700 1 --2- 172.21.15.39:0/69053509 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71501534a0 0x7f715015e4d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7140001eb0 tx=0x7f714000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:34.637 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.630+0000 7f71467fc700 1 -- 172.21.15.39:0/69053509 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7140005d90 con 0x7f71501534a0 2023-11-28T11:56:34.637 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.630+0000 7f71467fc700 1 -- 172.21.15.39:0/69053509 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71400070d0 con 0x7f71501534a0 2023-11-28T11:56:34.637 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.630+0000 7f7157c62700 1 -- 172.21.15.39:0/69053509 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f715015ca30 con 0x7f71501534a0 2023-11-28T11:56:34.637 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.630+0000 7f71467fc700 1 -- 172.21.15.39:0/69053509 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7140007440 con 0x7f71501534a0 2023-11-28T11:56:34.638 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.634+0000 7f7157c62700 1 -- 172.21.15.39:0/69053509 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71500b56a0 con 0x7f71501534a0 2023-11-28T11:56:34.638 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.634+0000 7f7157c62700 1 -- 172.21.15.39:0/69053509 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f715015cd10 con 0x7f71501534a0 2023-11-28T11:56:34.639 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.634+0000 7f71467fc700 1 -- 172.21.15.39:0/69053509 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7140019030 con 0x7f71501534a0 2023-11-28T11:56:34.641 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.638+0000 7f71467fc700 1 --2- 172.21.15.39:0/69053509 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7134064f10 0x7f71340673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:34.641 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.638+0000 7f71467fc700 1 -- 172.21.15.39:0/69053509 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7140080e60 con 0x7f71501534a0 2023-11-28T11:56:34.642 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.638+0000 7f71559fe700 1 --2- 172.21.15.39:0/69053509 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7134064f10 0x7f71340673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:34.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.638+0000 7f71559fe700 1 --2- 172.21.15.39:0/69053509 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7134064f10 0x7f71340673c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f714c001110 tx=0x7f714c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:34.646 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.642+0000 7f71467fc700 1 -- 172.21.15.39:0/69053509 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f714004a400 con 0x7f71501534a0 2023-11-28T11:56:34.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.814+0000 7f7157c62700 1 -- 172.21.15.39:0/69053509 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71500d0050 con 0x7f71501534a0 2023-11-28T11:56:34.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.818+0000 7f71467fc700 1 -- 172.21.15.39:0/69053509 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+14181 (secure 0 0 0) 0x7f714004f310 con 0x7f71501534a0 2023-11-28T11:56:34.823 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:56:34.823 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":20,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:56:34.363924+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:56:34.825 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.822+0000 7f7157c62700 1 -- 172.21.15.39:0/69053509 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7134064f10 msgr2=0x7f71340673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:34.825 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.822+0000 7f7157c62700 1 --2- 172.21.15.39:0/69053509 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7134064f10 0x7f71340673c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f714c001110 tx=0x7f714c009040 comp rx=0 tx=0).stop 2023-11-28T11:56:34.825 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.822+0000 7f7157c62700 1 -- 172.21.15.39:0/69053509 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71501534a0 msgr2=0x7f715015e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:34.825 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.822+0000 7f7157c62700 1 --2- 172.21.15.39:0/69053509 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71501534a0 0x7f715015e4d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7140001eb0 tx=0x7f714000c860 comp rx=0 tx=0).stop 2023-11-28T11:56:34.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.822+0000 7f7157c62700 1 -- 172.21.15.39:0/69053509 shutdown_connections 2023-11-28T11:56:34.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.822+0000 7f7157c62700 1 --2- 172.21.15.39:0/69053509 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f715015d510 0x7f715015ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:34.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.822+0000 7f7157c62700 1 --2- 172.21.15.39:0/69053509 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71501534a0 0x7f715015e4d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:34.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.822+0000 7f7157c62700 1 --2- 172.21.15.39:0/69053509 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7134064f10 0x7f71340673c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:34.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.822+0000 7f7157c62700 1 --2- 172.21.15.39:0/69053509 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71500b6200 0x7f715013c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:34.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.822+0000 7f7157c62700 1 -- 172.21.15.39:0/69053509 >> 172.21.15.39:0/69053509 conn(0x7f715006bfc0 msgr2=0x7f71500d0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:34.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.822+0000 7f7157c62700 1 -- 172.21.15.39:0/69053509 shutdown_connections 2023-11-28T11:56:34.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:34.822+0000 7f7157c62700 1 -- 172.21.15.39:0/69053509 wait complete. 2023-11-28T11:56:34.847 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:56:26.631457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:56:33.242202+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:56:34.848 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:56:35.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.030+0000 7f99efc91700 1 Processor -- start 2023-11-28T11:56:35.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.030+0000 7f99efc91700 1 -- start start 2023-11-28T11:56:35.036 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.034+0000 7f99efc91700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f99e806cb40 0x7f99e80b06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:35.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.034+0000 7f99efc91700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e80b0be0 con 0x7f99e8066b40 2023-11-28T11:56:35.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.034+0000 7f99efc91700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e815bff0 con 0x7f99e80713b0 2023-11-28T11:56:35.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.034+0000 7f99efc91700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e815c340 con 0x7f99e806cb40 2023-11-28T11:56:35.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.034+0000 7f99eda2d700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f99e8066b40 0x7f99e815c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:37544/0 (socket says 172.21.15.39:37544) 2023-11-28T11:56:35.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.034+0000 7f99eda2d700 1 -- 172.21.15.39:0/2746999777 learned_addr learned my addr 172.21.15.39:0/2746999777 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:56:35.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.034+0000 7f99ee22e700 1 --2- 172.21.15.39:0/2746999777 >> v2:172.21.15.184:3300/0 conn(0x7f99e806cb40 0x7f99e80b06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:35.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.034+0000 7f99eca2b700 1 -- 172.21.15.39:0/2746999777 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3869686746 0 0) 0x7f99e815bff0 con 0x7f99e80713b0 2023-11-28T11:56:35.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.034+0000 7f99eca2b700 1 -- 172.21.15.39:0/2746999777 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99d40035d0 con 0x7f99e80713b0 2023-11-28T11:56:35.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.034+0000 7f99eca2b700 1 -- 172.21.15.39:0/2746999777 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2211256501 0 0) 0x7f99e80b0be0 con 0x7f99e8066b40 2023-11-28T11:56:35.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.034+0000 7f99eca2b700 1 -- 172.21.15.39:0/2746999777 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99e815bff0 con 0x7f99e8066b40 2023-11-28T11:56:35.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.034+0000 7f99ee22e700 1 -- 172.21.15.39:0/2746999777 >> v1:172.21.15.184:6789/0 conn(0x7f99e80713b0 legacy=0x7f99e806c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:35.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.034+0000 7f99ee22e700 1 -- 172.21.15.39:0/2746999777 >> v1:172.21.15.39:6789/0 conn(0x7f99e8066b40 legacy=0x7f99e815c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:35.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.034+0000 7f99ee22e700 1 -- 172.21.15.39:0/2746999777 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e815ce70 con 0x7f99e806cb40 2023-11-28T11:56:35.040 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.034+0000 7f99ee22e700 1 --2- 172.21.15.39:0/2746999777 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99e806cb40 0x7f99e80b06a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f99e0009d90 tx=0x7f99e000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fba1024720b9136a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:35.040 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.034+0000 7f99eca2b700 1 -- 172.21.15.39:0/2746999777 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e000bd20 con 0x7f99e806cb40 2023-11-28T11:56:35.040 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.038+0000 7f99eca2b700 1 -- 172.21.15.39:0/2746999777 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e000be80 con 0x7f99e806cb40 2023-11-28T11:56:35.040 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.038+0000 7f99eca2b700 1 -- 172.21.15.39:0/2746999777 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e00116a0 con 0x7f99e806cb40 2023-11-28T11:56:35.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.038+0000 7f99efc91700 1 -- 172.21.15.39:0/2746999777 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99e806cb40 msgr2=0x7f99e80b06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:35.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.038+0000 7f99efc91700 1 --2- 172.21.15.39:0/2746999777 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99e806cb40 0x7f99e80b06a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f99e0009d90 tx=0x7f99e000b330 comp rx=0 tx=0).stop 2023-11-28T11:56:35.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.038+0000 7f99efc91700 1 -- 172.21.15.39:0/2746999777 shutdown_connections 2023-11-28T11:56:35.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.038+0000 7f99efc91700 1 --2- 172.21.15.39:0/2746999777 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99e806cb40 0x7f99e80b06a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.038+0000 7f99efc91700 1 -- 172.21.15.39:0/2746999777 >> 172.21.15.39:0/2746999777 conn(0x7f99e80cec20 msgr2=0x7f99e80ceff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:35.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.038+0000 7f99efc91700 1 -- 172.21.15.39:0/2746999777 shutdown_connections 2023-11-28T11:56:35.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.038+0000 7f99efc91700 1 -- 172.21.15.39:0/2746999777 wait complete. 2023-11-28T11:56:35.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.042+0000 7f99efc91700 1 Processor -- start 2023-11-28T11:56:35.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.042+0000 7f99efc91700 1 -- start start 2023-11-28T11:56:35.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.042+0000 7f99efc91700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99e8066b40 0x7f99e81f1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:35.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.042+0000 7f99efc91700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99e806cb40 0x7f99e80cb630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:35.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.042+0000 7f99efc91700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99e80713b0 0x7f99e80cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:35.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.042+0000 7f99efc91700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e81e4d30 con 0x7f99e80713b0 2023-11-28T11:56:35.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.042+0000 7f99efc91700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e8150370 con 0x7f99e8066b40 2023-11-28T11:56:35.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.042+0000 7f99efc91700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e8150650 con 0x7f99e806cb40 2023-11-28T11:56:35.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.046+0000 7f99ee22e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99e80713b0 0x7f99e80cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:35.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.046+0000 7f99ee22e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99e80713b0 0x7f99e80cbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56746/0 (socket says 172.21.15.39:56746) 2023-11-28T11:56:35.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.046+0000 7f99ee22e700 1 -- 172.21.15.39:0/2225088335 learned_addr learned my addr 172.21.15.39:0/2225088335 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:35.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.046+0000 7f99eda2d700 1 --2- 172.21.15.39:0/2225088335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99e8066b40 0x7f99e81f1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:35.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.046+0000 7f99ed22c700 1 --2- 172.21.15.39:0/2225088335 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99e806cb40 0x7f99e80cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:35.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.046+0000 7f99ee22e700 1 -- 172.21.15.39:0/2225088335 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99e806cb40 msgr2=0x7f99e80cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:35.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.046+0000 7f99ee22e700 1 --2- 172.21.15.39:0/2225088335 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99e806cb40 0x7f99e80cb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.046+0000 7f99ee22e700 1 -- 172.21.15.39:0/2225088335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99e8066b40 msgr2=0x7f99e81f1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:35.050 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.046+0000 7f99ee22e700 1 --2- 172.21.15.39:0/2225088335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99e8066b40 0x7f99e81f1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.050 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.046+0000 7f99ee22e700 1 -- 172.21.15.39:0/2225088335 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e0009a70 con 0x7f99e80713b0 2023-11-28T11:56:35.050 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.046+0000 7f99ee22e700 1 --2- 172.21.15.39:0/2225088335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99e80713b0 0x7f99e80cbb70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f99e80cfbb0 tx=0x7f99e0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:35.050 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.046+0000 7f99de7fc700 1 -- 172.21.15.39:0/2225088335 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e0019600 con 0x7f99e80713b0 2023-11-28T11:56:35.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.046+0000 7f99de7fc700 1 -- 172.21.15.39:0/2225088335 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e0019780 con 0x7f99e80713b0 2023-11-28T11:56:35.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.046+0000 7f99efc91700 1 -- 172.21.15.39:0/2225088335 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e80b0e10 con 0x7f99e80713b0 2023-11-28T11:56:35.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.046+0000 7f99de7fc700 1 -- 172.21.15.39:0/2225088335 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e0019b30 con 0x7f99e80713b0 2023-11-28T11:56:35.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.046+0000 7f99efc91700 1 -- 172.21.15.39:0/2225088335 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e80cd490 con 0x7f99e80713b0 2023-11-28T11:56:35.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.046+0000 7f99efc91700 1 -- 172.21.15.39:0/2225088335 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e80b10f0 con 0x7f99e80713b0 2023-11-28T11:56:35.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.050+0000 7f99de7fc700 1 -- 172.21.15.39:0/2225088335 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f99e0029030 con 0x7f99e80713b0 2023-11-28T11:56:35.055 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.050+0000 7f99de7fc700 1 --2- 172.21.15.39:0/2225088335 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f99cc064ee0 0x7f99cc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:35.056 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.050+0000 7f99de7fc700 1 -- 172.21.15.39:0/2225088335 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f99e0083240 con 0x7f99e80713b0 2023-11-28T11:56:35.056 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.050+0000 7f99eda2d700 1 --2- 172.21.15.39:0/2225088335 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f99cc064ee0 0x7f99cc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:35.057 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.054+0000 7f99eda2d700 1 --2- 172.21.15.39:0/2225088335 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f99cc064ee0 0x7f99cc067390 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f99e4007fd0 tx=0x7f99e4007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:35.064 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.058+0000 7f99de7fc700 1 -- 172.21.15.39:0/2225088335 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f99e0051640 con 0x7f99e80713b0 2023-11-28T11:56:35.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.234+0000 7f99efc91700 1 -- 172.21.15.39:0/2225088335 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f99e80726c0 con 0x7f99e80713b0 2023-11-28T11:56:35.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.234+0000 7f99de7fc700 1 -- 172.21.15.39:0/2225088335 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f99e0054c60 con 0x7f99e80713b0 2023-11-28T11:56:35.239 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-11-28T11:56:35.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.234+0000 7f99efc91700 1 -- 172.21.15.39:0/2225088335 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f99cc064ee0 msgr2=0x7f99cc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:35.241 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.234+0000 7f99efc91700 1 --2- 172.21.15.39:0/2225088335 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f99cc064ee0 0x7f99cc067390 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f99e4007fd0 tx=0x7f99e4007de0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.241 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.234+0000 7f99efc91700 1 -- 172.21.15.39:0/2225088335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99e80713b0 msgr2=0x7f99e80cbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:35.241 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.234+0000 7f99efc91700 1 --2- 172.21.15.39:0/2225088335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99e80713b0 0x7f99e80cbb70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f99e80cfbb0 tx=0x7f99e0004af0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.241 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.238+0000 7f99efc91700 1 -- 172.21.15.39:0/2225088335 shutdown_connections 2023-11-28T11:56:35.241 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.238+0000 7f99efc91700 1 --2- 172.21.15.39:0/2225088335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99e80713b0 0x7f99e80cbb70 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.241 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.238+0000 7f99efc91700 1 --2- 172.21.15.39:0/2225088335 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99e806cb40 0x7f99e80cb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.238+0000 7f99efc91700 1 --2- 172.21.15.39:0/2225088335 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f99cc064ee0 0x7f99cc067390 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.238+0000 7f99efc91700 1 --2- 172.21.15.39:0/2225088335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99e8066b40 0x7f99e81f1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.238+0000 7f99efc91700 1 -- 172.21.15.39:0/2225088335 >> 172.21.15.39:0/2225088335 conn(0x7f99e80cec20 msgr2=0x7f99e8152070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:35.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.238+0000 7f99efc91700 1 -- 172.21.15.39:0/2225088335 shutdown_connections 2023-11-28T11:56:35.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.238+0000 7f99efc91700 1 -- 172.21.15.39:0/2225088335 wait complete. 2023-11-28T11:56:35.262 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:56:35.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.446+0000 7f9d2eced700 1 Processor -- start 2023-11-28T11:56:35.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.446+0000 7f9d2eced700 1 -- start start 2023-11-28T11:56:35.452 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.450+0000 7f9d2eced700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d2815c150 0x7f9d280b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:35.452 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.450+0000 7f9d2eced700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9d28070360 0x7f9d28160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:35.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.450+0000 7f9d2eced700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d2815c520 con 0x7f9d2806ff10 2023-11-28T11:56:35.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.450+0000 7f9d2eced700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d280b4240 con 0x7f9d28070360 2023-11-28T11:56:35.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.450+0000 7f9d2eced700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2806ac00 con 0x7f9d2815c150 2023-11-28T11:56:35.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.450+0000 7f9d2e4ec700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9d28070360 0x7f9d28160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:35.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.450+0000 7f9d2e4ec700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9d28070360 0x7f9d28160340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:44524/0 (socket says 172.21.15.39:44524) 2023-11-28T11:56:35.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.450+0000 7f9d2e4ec700 1 -- 172.21.15.39:0/3317971035 learned_addr learned my addr 172.21.15.39:0/3317971035 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:35.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.450+0000 7f9d2dceb700 1 --2- 172.21.15.39:0/3317971035 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d2815c150 0x7f9d280b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:35.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.450+0000 7f9d2e4ec700 1 -- 172.21.15.39:0/3317971035 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d2815c150 msgr2=0x7f9d280b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:35.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.450+0000 7f9d2e4ec700 1 --2- 172.21.15.39:0/3317971035 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d2815c150 0x7f9d280b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.450+0000 7f9d2e4ec700 1 -- 172.21.15.39:0/3317971035 >> v1:172.21.15.184:6789/0 conn(0x7f9d2806ff10 legacy=0x7f9d2815fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.450+0000 7f9d2e4ec700 1 -- 172.21.15.39:0/3317971035 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d2806cc50 con 0x7f9d28070360 2023-11-28T11:56:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.450+0000 7f9d2e4ec700 1 --2- 172.21.15.39:0/3317971035 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d28070360 0x7f9d28160340 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9d20009910 tx=0x7f9d20009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26834464cdf1dd5a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.450+0000 7f9d2cce9700 1 -- 172.21.15.39:0/3317971035 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2000ba60 con 0x7f9d28070360 2023-11-28T11:56:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.450+0000 7f9d2cce9700 1 -- 172.21.15.39:0/3317971035 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d2000bbc0 con 0x7f9d28070360 2023-11-28T11:56:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.450+0000 7f9d2cce9700 1 -- 172.21.15.39:0/3317971035 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d20009e60 con 0x7f9d28070360 2023-11-28T11:56:35.457 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.450+0000 7f9d2eced700 1 -- 172.21.15.39:0/3317971035 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d28070360 msgr2=0x7f9d28160340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:35.458 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.450+0000 7f9d2eced700 1 --2- 172.21.15.39:0/3317971035 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d28070360 0x7f9d28160340 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9d20009910 tx=0x7f9d20009c20 comp rx=0 tx=0).stop 2023-11-28T11:56:35.458 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.450+0000 7f9d2eced700 1 -- 172.21.15.39:0/3317971035 shutdown_connections 2023-11-28T11:56:35.458 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.450+0000 7f9d2eced700 1 --2- 172.21.15.39:0/3317971035 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d28070360 0x7f9d28160340 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.458 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.450+0000 7f9d2eced700 1 --2- 172.21.15.39:0/3317971035 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d2815c150 0x7f9d280b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.459 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.450+0000 7f9d2eced700 1 -- 172.21.15.39:0/3317971035 >> 172.21.15.39:0/3317971035 conn(0x7f9d280d3680 msgr2=0x7f9d280cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:35.459 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.450+0000 7f9d2eced700 1 -- 172.21.15.39:0/3317971035 shutdown_connections 2023-11-28T11:56:35.459 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.450+0000 7f9d2eced700 1 -- 172.21.15.39:0/3317971035 wait complete. 2023-11-28T11:56:35.459 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.454+0000 7f9d2eced700 1 Processor -- start 2023-11-28T11:56:35.459 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.454+0000 7f9d2eced700 1 -- start start 2023-11-28T11:56:35.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.454+0000 7f9d2eced700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d2806ff10 0x7f9d280b6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:35.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.454+0000 7f9d2eced700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d28070360 0x7f9d280cee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:35.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.454+0000 7f9d2eced700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d2815c150 0x7f9d2814fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:35.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.454+0000 7f9d2eced700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d280cf340 con 0x7f9d2806ff10 2023-11-28T11:56:35.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.454+0000 7f9d2eced700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d280b6a60 con 0x7f9d28070360 2023-11-28T11:56:35.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.454+0000 7f9d2eced700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d280b6d40 con 0x7f9d2815c150 2023-11-28T11:56:35.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.454+0000 7f9d2dceb700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d2806ff10 0x7f9d280b6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:35.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.454+0000 7f9d2dceb700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d2806ff10 0x7f9d280b6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56750/0 (socket says 172.21.15.39:56750) 2023-11-28T11:56:35.464 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.454+0000 7f9d2d4ea700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d28070360 0x7f9d280cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:35.464 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.454+0000 7f9d2dceb700 1 -- 172.21.15.39:0/1863369433 learned_addr learned my addr 172.21.15.39:0/1863369433 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:35.464 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.454+0000 7f9d2e4ec700 1 --2- 172.21.15.39:0/1863369433 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d2815c150 0x7f9d2814fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:35.464 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.458+0000 7f9d2d4ea700 1 -- 172.21.15.39:0/1863369433 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d2815c150 msgr2=0x7f9d2814fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:35.465 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.458+0000 7f9d2d4ea700 1 --2- 172.21.15.39:0/1863369433 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d2815c150 0x7f9d2814fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.465 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.458+0000 7f9d2d4ea700 1 -- 172.21.15.39:0/1863369433 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d2806ff10 msgr2=0x7f9d280b6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:35.465 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.458+0000 7f9d2d4ea700 1 --2- 172.21.15.39:0/1863369433 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d2806ff10 0x7f9d280b6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.465 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.458+0000 7f9d2d4ea700 1 -- 172.21.15.39:0/1863369433 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d20009570 con 0x7f9d28070360 2023-11-28T11:56:35.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.458+0000 7f9d2e4ec700 1 --2- 172.21.15.39:0/1863369433 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d2815c150 0x7f9d2814fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:35.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.458+0000 7f9d2d4ea700 1 --2- 172.21.15.39:0/1863369433 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d28070360 0x7f9d280cee00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9d1800c460 tx=0x7f9d1800c770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:35.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.458+0000 7f9d1e7fc700 1 -- 172.21.15.39:0/1863369433 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d180052d0 con 0x7f9d28070360 2023-11-28T11:56:35.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.458+0000 7f9d1e7fc700 1 -- 172.21.15.39:0/1863369433 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d18005450 con 0x7f9d28070360 2023-11-28T11:56:35.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.458+0000 7f9d1e7fc700 1 -- 172.21.15.39:0/1863369433 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d18006b10 con 0x7f9d28070360 2023-11-28T11:56:35.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.458+0000 7f9d2eced700 1 -- 172.21.15.39:0/1863369433 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d280d2730 con 0x7f9d28070360 2023-11-28T11:56:35.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.458+0000 7f9d2eced700 1 -- 172.21.15.39:0/1863369433 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d280d2450 con 0x7f9d28070360 2023-11-28T11:56:35.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.458+0000 7f9d2eced700 1 -- 172.21.15.39:0/1863369433 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d280d05e0 con 0x7f9d28070360 2023-11-28T11:56:35.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.462+0000 7f9d1e7fc700 1 -- 172.21.15.39:0/1863369433 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9d18010050 con 0x7f9d28070360 2023-11-28T11:56:35.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.462+0000 7f9d1e7fc700 1 --2- 172.21.15.39:0/1863369433 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9d0c064ee0 0x7f9d0c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:35.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.462+0000 7f9d1e7fc700 1 -- 172.21.15.39:0/1863369433 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9d18080d40 con 0x7f9d28070360 2023-11-28T11:56:35.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.462+0000 7f9d2dceb700 1 --2- 172.21.15.39:0/1863369433 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9d0c064ee0 0x7f9d0c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:35.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.462+0000 7f9d2dceb700 1 --2- 172.21.15.39:0/1863369433 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9d0c064ee0 0x7f9d0c067390 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9d24003c30 tx=0x7f9d240098d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:35.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.466+0000 7f9d1e7fc700 1 -- 172.21.15.39:0/1863369433 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9d18049400 con 0x7f9d28070360 2023-11-28T11:56:35.646 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.642+0000 7f9d2eced700 1 -- 172.21.15.39:0/1863369433 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9d28073d20 con 0x7f9d28070360 2023-11-28T11:56:35.647 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.642+0000 7f9d1e7fc700 1 -- 172.21.15.39:0/1863369433 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9d1804f050 con 0x7f9d28070360 2023-11-28T11:56:35.648 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-11-28T11:56:35.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.646+0000 7f9d2eced700 1 -- 172.21.15.39:0/1863369433 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9d0c064ee0 msgr2=0x7f9d0c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:35.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.646+0000 7f9d2eced700 1 --2- 172.21.15.39:0/1863369433 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9d0c064ee0 0x7f9d0c067390 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9d24003c30 tx=0x7f9d240098d0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.646+0000 7f9d2eced700 1 -- 172.21.15.39:0/1863369433 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d28070360 msgr2=0x7f9d280cee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:35.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.646+0000 7f9d2eced700 1 --2- 172.21.15.39:0/1863369433 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d28070360 0x7f9d280cee00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9d1800c460 tx=0x7f9d1800c770 comp rx=0 tx=0).stop 2023-11-28T11:56:35.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.646+0000 7f9d2eced700 1 -- 172.21.15.39:0/1863369433 shutdown_connections 2023-11-28T11:56:35.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.646+0000 7f9d2eced700 1 --2- 172.21.15.39:0/1863369433 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d2815c150 0x7f9d2814fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.646+0000 7f9d2eced700 1 --2- 172.21.15.39:0/1863369433 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9d0c064ee0 0x7f9d0c067390 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.646+0000 7f9d2eced700 1 --2- 172.21.15.39:0/1863369433 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d28070360 0x7f9d280cee00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.646+0000 7f9d2eced700 1 --2- 172.21.15.39:0/1863369433 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d2806ff10 0x7f9d280b6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.646+0000 7f9d2eced700 1 -- 172.21.15.39:0/1863369433 >> 172.21.15.39:0/1863369433 conn(0x7f9d280d3680 msgr2=0x7f9d281597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:35.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.646+0000 7f9d2eced700 1 -- 172.21.15.39:0/1863369433 shutdown_connections 2023-11-28T11:56:35.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.646+0000 7f9d2eced700 1 -- 172.21.15.39:0/1863369433 wait complete. 2023-11-28T11:56:35.675 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:56:35.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.846+0000 7f8369e48700 1 Processor -- start 2023-11-28T11:56:35.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.846+0000 7f8369e48700 1 -- start start 2023-11-28T11:56:35.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.850+0000 7f8369e48700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f836415c640 0x7f83640d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:35.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.850+0000 7f8369e48700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f8364069e00 0x7f836406a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:35.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.850+0000 7f8369e48700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f836406c600 con 0x7f8364071aa0 2023-11-28T11:56:35.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.850+0000 7f8369e48700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f836406cef0 con 0x7f836415c640 2023-11-28T11:56:35.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.850+0000 7f8369e48700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f836406a7c0 con 0x7f8364069e00 2023-11-28T11:56:35.855 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.850+0000 7f8368e46700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f836415c640 0x7f83640d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:35.855 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.850+0000 7f835bfff700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f8364071aa0 0x7f836406d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:37556/0 (socket says 172.21.15.39:37556) 2023-11-28T11:56:35.855 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.850+0000 7f835bfff700 1 -- 172.21.15.39:0/2984863969 learned_addr learned my addr 172.21.15.39:0/2984863969 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:56:35.855 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.850+0000 7f8369647700 1 --2- 172.21.15.39:0/2984863969 >> v2:172.21.15.184:3300/0 conn(0x7f8364069e00 0x7f836406a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:35.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.850+0000 7f835b7fe700 1 -- 172.21.15.39:0/2984863969 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3152941822 0 0) 0x7f836406c600 con 0x7f8364071aa0 2023-11-28T11:56:35.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.850+0000 7f835b7fe700 1 -- 172.21.15.39:0/2984863969 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f834c0035d0 con 0x7f8364071aa0 2023-11-28T11:56:35.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.850+0000 7f8368e46700 1 -- 172.21.15.39:0/2984863969 >> v2:172.21.15.184:3300/0 conn(0x7f8364069e00 msgr2=0x7f836406a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:35.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.850+0000 7f8368e46700 1 --2- 172.21.15.39:0/2984863969 >> v2:172.21.15.184:3300/0 conn(0x7f8364069e00 0x7f836406a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.850+0000 7f8368e46700 1 -- 172.21.15.39:0/2984863969 >> v1:172.21.15.39:6789/0 conn(0x7f8364071aa0 legacy=0x7f836406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:35.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.850+0000 7f8368e46700 1 -- 172.21.15.39:0/2984863969 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83640722f0 con 0x7f836415c640 2023-11-28T11:56:35.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.854+0000 7f8368e46700 1 --2- 172.21.15.39:0/2984863969 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f836415c640 0x7f83640d31e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f836406ed60 tx=0x7f8360009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8530ff5412d41e72 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:35.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.854+0000 7f835b7fe700 1 -- 172.21.15.39:0/2984863969 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8360011830 con 0x7f836415c640 2023-11-28T11:56:35.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.854+0000 7f835b7fe700 1 -- 172.21.15.39:0/2984863969 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8360011990 con 0x7f836415c640 2023-11-28T11:56:35.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.854+0000 7f835b7fe700 1 -- 172.21.15.39:0/2984863969 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8360011d20 con 0x7f836415c640 2023-11-28T11:56:35.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.854+0000 7f8369e48700 1 -- 172.21.15.39:0/2984863969 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f836415c640 msgr2=0x7f83640d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:35.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.854+0000 7f8369e48700 1 --2- 172.21.15.39:0/2984863969 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f836415c640 0x7f83640d31e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f836406ed60 tx=0x7f8360009b30 comp rx=0 tx=0).stop 2023-11-28T11:56:35.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.854+0000 7f8369e48700 1 -- 172.21.15.39:0/2984863969 shutdown_connections 2023-11-28T11:56:35.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.854+0000 7f8369e48700 1 --2- 172.21.15.39:0/2984863969 >> v2:172.21.15.184:3300/0 conn(0x7f8364069e00 0x7f836406a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.854+0000 7f8369e48700 1 --2- 172.21.15.39:0/2984863969 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f836415c640 0x7f83640d31e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.854+0000 7f8369e48700 1 -- 172.21.15.39:0/2984863969 >> 172.21.15.39:0/2984863969 conn(0x7f83640b6520 msgr2=0x7f8364071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:35.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.854+0000 7f8369e48700 1 -- 172.21.15.39:0/2984863969 shutdown_connections 2023-11-28T11:56:35.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.854+0000 7f8369e48700 1 -- 172.21.15.39:0/2984863969 wait complete. 2023-11-28T11:56:35.861 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.858+0000 7f8369e48700 1 Processor -- start 2023-11-28T11:56:35.861 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.858+0000 7f8369e48700 1 -- start start 2023-11-28T11:56:35.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.858+0000 7f8369e48700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8364069e00 0x7f836414f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:35.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.858+0000 7f8369e48700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8364071aa0 0x7f83640cde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:35.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.858+0000 7f8369e48700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f836415c640 0x7f83640b23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:35.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.858+0000 7f8369e48700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83640c9bb0 con 0x7f836415c640 2023-11-28T11:56:35.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.858+0000 7f8369e48700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836414fbc0 con 0x7f8364071aa0 2023-11-28T11:56:35.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.858+0000 7f8369e48700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83640ce710 con 0x7f8364069e00 2023-11-28T11:56:35.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.858+0000 7f8369647700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f836415c640 0x7f83640b23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:35.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.858+0000 7f8369647700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f836415c640 0x7f83640b23d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56756/0 (socket says 172.21.15.39:56756) 2023-11-28T11:56:35.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.862+0000 7f8369647700 1 -- 172.21.15.39:0/1964744640 learned_addr learned my addr 172.21.15.39:0/1964744640 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:35.865 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.862+0000 7f835bfff700 1 --2- 172.21.15.39:0/1964744640 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8364071aa0 0x7f83640cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:35.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.862+0000 7f8368e46700 1 --2- 172.21.15.39:0/1964744640 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8364069e00 0x7f836414f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:35.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.862+0000 7f8369647700 1 -- 172.21.15.39:0/1964744640 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8364069e00 msgr2=0x7f836414f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:35.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.862+0000 7f8369647700 1 --2- 172.21.15.39:0/1964744640 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8364069e00 0x7f836414f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.862+0000 7f8369647700 1 -- 172.21.15.39:0/1964744640 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8364071aa0 msgr2=0x7f83640cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:35.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.862+0000 7f8369647700 1 --2- 172.21.15.39:0/1964744640 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8364071aa0 0x7f83640cde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.862+0000 7f8369647700 1 -- 172.21.15.39:0/1964744640 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83600094b0 con 0x7f836415c640 2023-11-28T11:56:35.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.862+0000 7f8369647700 1 --2- 172.21.15.39:0/1964744640 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f836415c640 0x7f83640b23d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f835c00efc0 tx=0x7f835c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:35.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.862+0000 7f83597fa700 1 -- 172.21.15.39:0/1964744640 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c009ba0 con 0x7f836415c640 2023-11-28T11:56:35.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.862+0000 7f83597fa700 1 -- 172.21.15.39:0/1964744640 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835c00f040 con 0x7f836415c640 2023-11-28T11:56:35.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.862+0000 7f8369e48700 1 -- 172.21.15.39:0/1964744640 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f836415ca10 con 0x7f836415c640 2023-11-28T11:56:35.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.862+0000 7f83597fa700 1 -- 172.21.15.39:0/1964744640 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c014480 con 0x7f836415c640 2023-11-28T11:56:35.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.862+0000 7f8369e48700 1 -- 172.21.15.39:0/1964744640 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f836406da20 con 0x7f836415c640 2023-11-28T11:56:35.868 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.862+0000 7f8369e48700 1 -- 172.21.15.39:0/1964744640 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8364072010 con 0x7f836415c640 2023-11-28T11:56:35.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.866+0000 7f83597fa700 1 -- 172.21.15.39:0/1964744640 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f835c0145e0 con 0x7f836415c640 2023-11-28T11:56:35.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.866+0000 7f83597fa700 1 --2- 172.21.15.39:0/1964744640 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8350064ee0 0x7f8350067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:35.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.866+0000 7f83597fa700 1 -- 172.21.15.39:0/1964744640 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f835c082620 con 0x7f836415c640 2023-11-28T11:56:35.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.866+0000 7f8368e46700 1 --2- 172.21.15.39:0/1964744640 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8350064ee0 0x7f8350067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:35.875 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.870+0000 7f8368e46700 1 --2- 172.21.15.39:0/1964744640 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8350064ee0 0x7f8350067390 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8360009fd0 tx=0x7f8360008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:35.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:35.874+0000 7f83597fa700 1 -- 172.21.15.39:0/1964744640 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f835c050a20 con 0x7f836415c640 2023-11-28T11:56:36.084 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.078+0000 7f8369e48700 1 -- 172.21.15.39:0/1964744640 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83640c9cf0 con 0x7f836415c640 2023-11-28T11:56:36.085 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.082+0000 7f83597fa700 1 -- 172.21.15.39:0/1964744640 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3527 (secure 0 0 0) 0x7f835c018de0 con 0x7f836415c640 2023-11-28T11:56:36.085 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:56:36.085 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4265,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1518942402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":1518942402},{"type":"v1","addr":"172.21.15.184:6837","nonce":1518942402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/1834562481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":1834562481},{"type":"v1","addr":"172.21.15.39:6833","nonce":1834562481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2470756838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2470756838},{"type":"v1","addr":"172.21.15.39:6835","nonce":2470756838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/516507254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":516507254},{"type":"v1","addr":"172.21.15.184:6835","nonce":516507254}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-11-28T11:56:36.087 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.082+0000 7f8369e48700 1 -- 172.21.15.39:0/1964744640 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8350064ee0 msgr2=0x7f8350067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:36.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.082+0000 7f8369e48700 1 --2- 172.21.15.39:0/1964744640 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8350064ee0 0x7f8350067390 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8360009fd0 tx=0x7f8360008030 comp rx=0 tx=0).stop 2023-11-28T11:56:36.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.082+0000 7f8369e48700 1 -- 172.21.15.39:0/1964744640 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f836415c640 msgr2=0x7f83640b23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:36.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.082+0000 7f8369e48700 1 --2- 172.21.15.39:0/1964744640 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f836415c640 0x7f83640b23d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f835c00efc0 tx=0x7f835c00c3a0 comp rx=0 tx=0).stop 2023-11-28T11:56:36.089 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.082+0000 7f8369e48700 1 -- 172.21.15.39:0/1964744640 shutdown_connections 2023-11-28T11:56:36.089 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.082+0000 7f8369e48700 1 --2- 172.21.15.39:0/1964744640 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f836415c640 0x7f83640b23d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:36.090 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.082+0000 7f8369e48700 1 --2- 172.21.15.39:0/1964744640 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8350064ee0 0x7f8350067390 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:36.090 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.082+0000 7f8369e48700 1 --2- 172.21.15.39:0/1964744640 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8364071aa0 0x7f83640cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:36.090 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.082+0000 7f8369e48700 1 --2- 172.21.15.39:0/1964744640 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8364069e00 0x7f836414f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:36.090 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.082+0000 7f8369e48700 1 -- 172.21.15.39:0/1964744640 >> 172.21.15.39:0/1964744640 conn(0x7f83640b6520 msgr2=0x7f83641e18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:36.090 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.086+0000 7f8369e48700 1 -- 172.21.15.39:0/1964744640 shutdown_connections 2023-11-28T11:56:36.090 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.086+0000 7f8369e48700 1 -- 172.21.15.39:0/1964744640 wait complete. 2023-11-28T11:56:36.091 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 3 2023-11-28T11:56:36.110 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:56:36.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.282+0000 7fc9c16d8700 1 Processor -- start 2023-11-28T11:56:36.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.282+0000 7fc9c16d8700 1 -- start start 2023-11-28T11:56:36.290 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.286+0000 7fc9c16d8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9bc15a480 0x7fc9bc0cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:36.290 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.286+0000 7fc9c16d8700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc9bc0c8d10 0x7fc9bc0cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:36.290 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.286+0000 7fc9c16d8700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9bc15a850 con 0x7fc9bc0ccd10 2023-11-28T11:56:36.290 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.286+0000 7fc9c16d8700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9bc0ce060 con 0x7fc9bc0c8d10 2023-11-28T11:56:36.290 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.286+0000 7fc9c16d8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc0ce300 con 0x7fc9bc15a480 2023-11-28T11:56:36.291 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.286+0000 7fc9bb7fe700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fc9bc0ccd10 0x7fc9bc15dee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:37572/0 (socket says 172.21.15.39:37572) 2023-11-28T11:56:36.291 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.286+0000 7fc9bb7fe700 1 -- 172.21.15.39:0/88787456 learned_addr learned my addr 172.21.15.39:0/88787456 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:56:36.291 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.286+0000 7fc9baffd700 1 --2- 172.21.15.39:0/88787456 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9bc15a480 0x7fc9bc0cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:36.291 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.286+0000 7fc9ba7fc700 1 --2- 172.21.15.39:0/88787456 >> v2:172.21.15.184:3300/0 conn(0x7fc9bc0c8d10 0x7fc9bc0cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:36.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.286+0000 7fc9b9ffb700 1 -- 172.21.15.39:0/88787456 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1778233743 0 0) 0x7fc9bc15a850 con 0x7fc9bc0ccd10 2023-11-28T11:56:36.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.286+0000 7fc9b9ffb700 1 -- 172.21.15.39:0/88787456 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9a40035d0 con 0x7fc9bc0ccd10 2023-11-28T11:56:36.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.286+0000 7fc9ba7fc700 1 -- 172.21.15.39:0/88787456 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9bc15a480 msgr2=0x7fc9bc0cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:36.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.286+0000 7fc9b9ffb700 1 -- 172.21.15.39:0/88787456 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1525493610 0 0) 0x7fc9a40035d0 con 0x7fc9bc0ccd10 2023-11-28T11:56:36.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.286+0000 7fc9ba7fc700 1 --2- 172.21.15.39:0/88787456 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9bc15a480 0x7fc9bc0cc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:36.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.286+0000 7fc9ba7fc700 1 -- 172.21.15.39:0/88787456 >> v1:172.21.15.39:6789/0 conn(0x7fc9bc0ccd10 legacy=0x7fc9bc15dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:36.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.290+0000 7fc9ba7fc700 1 -- 172.21.15.39:0/88787456 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9bc0cada0 con 0x7fc9bc0c8d10 2023-11-28T11:56:36.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.290+0000 7fc9baffd700 1 --2- 172.21.15.39:0/88787456 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9bc15a480 0x7fc9bc0cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:36.293 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.290+0000 7fc9ba7fc700 1 --2- 172.21.15.39:0/88787456 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9bc0c8d10 0x7fc9bc0cc7d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0009850 tx=0x7fc9b0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eda9ab6a85c6d24 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:36.293 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.290+0000 7fc9b9ffb700 1 -- 172.21.15.39:0/88787456 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b40019f0 con 0x7fc9bc0c8d10 2023-11-28T11:56:36.293 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.290+0000 7fc9b9ffb700 1 -- 172.21.15.39:0/88787456 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b0004030 con 0x7fc9bc0c8d10 2023-11-28T11:56:36.294 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.290+0000 7fc9b9ffb700 1 -- 172.21.15.39:0/88787456 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b00043e0 con 0x7fc9bc0c8d10 2023-11-28T11:56:36.294 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.290+0000 7fc9c16d8700 1 -- 172.21.15.39:0/88787456 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9bc0c8d10 msgr2=0x7fc9bc0cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:36.294 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.290+0000 7fc9c16d8700 1 --2- 172.21.15.39:0/88787456 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9bc0c8d10 0x7fc9bc0cc7d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0009850 tx=0x7fc9b0009b60 comp rx=0 tx=0).stop 2023-11-28T11:56:36.295 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.290+0000 7fc9c16d8700 1 -- 172.21.15.39:0/88787456 shutdown_connections 2023-11-28T11:56:36.295 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.290+0000 7fc9c16d8700 1 --2- 172.21.15.39:0/88787456 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9bc0c8d10 0x7fc9bc0cc7d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:36.295 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.290+0000 7fc9c16d8700 1 --2- 172.21.15.39:0/88787456 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9bc15a480 0x7fc9bc0cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:36.295 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.290+0000 7fc9c16d8700 1 -- 172.21.15.39:0/88787456 >> 172.21.15.39:0/88787456 conn(0x7fc9bc0cf350 msgr2=0x7fc9bc0b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:36.295 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.290+0000 7fc9c16d8700 1 -- 172.21.15.39:0/88787456 shutdown_connections 2023-11-28T11:56:36.295 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.290+0000 7fc9c16d8700 1 -- 172.21.15.39:0/88787456 wait complete. 2023-11-28T11:56:36.297 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.294+0000 7fc9c16d8700 1 Processor -- start 2023-11-28T11:56:36.297 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.294+0000 7fc9c16d8700 1 -- start start 2023-11-28T11:56:36.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.294+0000 7fc9c16d8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9bc0c8d10 0x7fc9bc15d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:36.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.294+0000 7fc9c16d8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9bc0ccd10 0x7fc9bc1571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:36.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.294+0000 7fc9c16d8700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9bc15a480 0x7fc9bc0b2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:36.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.294+0000 7fc9c16d8700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc15d6a0 con 0x7fc9bc15a480 2023-11-28T11:56:36.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.294+0000 7fc9c16d8700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc1576e0 con 0x7fc9bc0ccd10 2023-11-28T11:56:36.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.294+0000 7fc9c16d8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc0c5ae0 con 0x7fc9bc0c8d10 2023-11-28T11:56:36.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.294+0000 7fc9bb7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9bc15a480 0x7fc9bc0b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:36.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.294+0000 7fc9bb7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9bc15a480 0x7fc9bc0b2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56768/0 (socket says 172.21.15.39:56768) 2023-11-28T11:56:36.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.294+0000 7fc9bb7fe700 1 -- 172.21.15.39:0/2558153829 learned_addr learned my addr 172.21.15.39:0/2558153829 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:36.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.294+0000 7fc9ba7fc700 1 --2- 172.21.15.39:0/2558153829 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9bc0ccd10 0x7fc9bc1571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:36.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.294+0000 7fc9baffd700 1 --2- 172.21.15.39:0/2558153829 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9bc0c8d10 0x7fc9bc15d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:36.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.294+0000 7fc9bb7fe700 1 -- 172.21.15.39:0/2558153829 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9bc0c8d10 msgr2=0x7fc9bc15d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:36.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.294+0000 7fc9bb7fe700 1 --2- 172.21.15.39:0/2558153829 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9bc0c8d10 0x7fc9bc15d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:36.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.294+0000 7fc9bb7fe700 1 -- 172.21.15.39:0/2558153829 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9bc0ccd10 msgr2=0x7fc9bc1571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:36.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.294+0000 7fc9bb7fe700 1 --2- 172.21.15.39:0/2558153829 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9bc0ccd10 0x7fc9bc1571a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:36.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.294+0000 7fc9bb7fe700 1 -- 172.21.15.39:0/2558153829 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ac0094b0 con 0x7fc9bc15a480 2023-11-28T11:56:36.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.294+0000 7fc9bb7fe700 1 --2- 172.21.15.39:0/2558153829 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9bc15a480 0x7fc9bc0b2540 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc9b400cc00 tx=0x7fc9b400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:36.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.298+0000 7fc9a37fe700 1 -- 172.21.15.39:0/2558153829 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b400abe0 con 0x7fc9bc15a480 2023-11-28T11:56:36.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.298+0000 7fc9a37fe700 1 -- 172.21.15.39:0/2558153829 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b400ad60 con 0x7fc9bc15a480 2023-11-28T11:56:36.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.298+0000 7fc9a37fe700 1 -- 172.21.15.39:0/2558153829 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4007310 con 0x7fc9bc15a480 2023-11-28T11:56:36.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.298+0000 7fc9c16d8700 1 -- 172.21.15.39:0/2558153829 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9b00094b0 con 0x7fc9bc15a480 2023-11-28T11:56:36.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.298+0000 7fc9c16d8700 1 -- 172.21.15.39:0/2558153829 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9bc0add50 con 0x7fc9bc15a480 2023-11-28T11:56:36.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.298+0000 7fc9c16d8700 1 -- 172.21.15.39:0/2558153829 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9bc0caa30 con 0x7fc9bc15a480 2023-11-28T11:56:36.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.298+0000 7fc9a37fe700 1 -- 172.21.15.39:0/2558153829 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc9b4010070 con 0x7fc9bc15a480 2023-11-28T11:56:36.306 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.302+0000 7fc9a37fe700 1 --2- 172.21.15.39:0/2558153829 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc9a8064ee0 0x7fc9a8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:36.306 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.302+0000 7fc9a37fe700 1 -- 172.21.15.39:0/2558153829 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc9b40815b0 con 0x7fc9bc15a480 2023-11-28T11:56:36.306 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.302+0000 7fc9baffd700 1 --2- 172.21.15.39:0/2558153829 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc9a8064ee0 0x7fc9a8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:36.308 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.302+0000 7fc9baffd700 1 --2- 172.21.15.39:0/2558153829 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc9a8064ee0 0x7fc9a8067390 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc0aeae0 tx=0x7fc9ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:36.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.306+0000 7fc9a37fe700 1 -- 172.21.15.39:0/2558153829 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc9b404fa40 con 0x7fc9bc15a480 2023-11-28T11:56:36.488 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.482+0000 7fc9c16d8700 1 -- 172.21.15.39:0/2558153829 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9bc0ca6e0 con 0x7fc9bc15a480 2023-11-28T11:56:36.488 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.482+0000 7fc9a37fe700 1 -- 172.21.15.39:0/2558153829 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+14168 (secure 0 0 0) 0x7fc9b4018090 con 0x7fc9bc15a480 2023-11-28T11:56:36.488 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:56:36.489 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":21,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:56:35.381565+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:56:36.490 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.486+0000 7fc9c16d8700 1 -- 172.21.15.39:0/2558153829 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc9a8064ee0 msgr2=0x7fc9a8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:36.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.486+0000 7fc9c16d8700 1 --2- 172.21.15.39:0/2558153829 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc9a8064ee0 0x7fc9a8067390 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc0aeae0 tx=0x7fc9ac008040 comp rx=0 tx=0).stop 2023-11-28T11:56:36.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.486+0000 7fc9c16d8700 1 -- 172.21.15.39:0/2558153829 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9bc15a480 msgr2=0x7fc9bc0b2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:36.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.486+0000 7fc9c16d8700 1 --2- 172.21.15.39:0/2558153829 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9bc15a480 0x7fc9bc0b2540 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc9b400cc00 tx=0x7fc9b400a060 comp rx=0 tx=0).stop 2023-11-28T11:56:36.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.486+0000 7fc9c16d8700 1 -- 172.21.15.39:0/2558153829 shutdown_connections 2023-11-28T11:56:36.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.486+0000 7fc9c16d8700 1 --2- 172.21.15.39:0/2558153829 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9bc15a480 0x7fc9bc0b2540 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:36.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.486+0000 7fc9c16d8700 1 --2- 172.21.15.39:0/2558153829 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc9a8064ee0 0x7fc9a8067390 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:36.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.486+0000 7fc9c16d8700 1 --2- 172.21.15.39:0/2558153829 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9bc0ccd10 0x7fc9bc1571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:36.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.486+0000 7fc9c16d8700 1 --2- 172.21.15.39:0/2558153829 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9bc0c8d10 0x7fc9bc15d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:36.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.486+0000 7fc9c16d8700 1 -- 172.21.15.39:0/2558153829 >> 172.21.15.39:0/2558153829 conn(0x7fc9bc0cf350 msgr2=0x7fc9bc0adee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:36.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.486+0000 7fc9c16d8700 1 -- 172.21.15.39:0/2558153829 shutdown_connections 2023-11-28T11:56:36.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.486+0000 7fc9c16d8700 1 -- 172.21.15.39:0/2558153829 wait complete. 2023-11-28T11:56:36.512 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:56:26.631457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:56:33.242202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:56:36.512 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:56:36.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.690+0000 7f8d18955700 1 Processor -- start 2023-11-28T11:56:36.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.690+0000 7f8d18955700 1 -- start start 2023-11-28T11:56:36.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.690+0000 7f8d18955700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f8d140cd8d0 0x7f8d140cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:36.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.690+0000 7f8d18955700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d140b1240 0x7f8d140b16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:36.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.690+0000 7f8d18955700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d140b1be0 con 0x7f8d1415a3d0 2023-11-28T11:56:36.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.690+0000 7f8d18955700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d140cdd20 con 0x7f8d140cd8d0 2023-11-28T11:56:36.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.690+0000 7f8d18955700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d140ceb70 con 0x7f8d140b1240 2023-11-28T11:56:36.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.694+0000 7f8d12d9d700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f8d1415a3d0 0x7f8d140aeae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:36098/0 (socket says 172.21.15.39:36098) 2023-11-28T11:56:36.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.694+0000 7f8d12d9d700 1 -- 172.21.15.39:0/2740757672 learned_addr learned my addr 172.21.15.39:0/2740757672 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:56:36.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.694+0000 7f8d1359e700 1 --2- 172.21.15.39:0/2740757672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d140b1240 0x7f8d140b16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:36.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.694+0000 7f8d1259c700 1 --2- 172.21.15.39:0/2740757672 >> v2:172.21.15.184:3300/0 conn(0x7f8d140cd8d0 0x7f8d140cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:36.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.694+0000 7f8d1359e700 1 -- 172.21.15.39:0/2740757672 >> v2:172.21.15.184:3300/0 conn(0x7f8d140cd8d0 msgr2=0x7f8d140cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:36.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.694+0000 7f8d1359e700 1 --2- 172.21.15.39:0/2740757672 >> v2:172.21.15.184:3300/0 conn(0x7f8d140cd8d0 0x7f8d140cf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:36.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.694+0000 7f8d1359e700 1 -- 172.21.15.39:0/2740757672 >> v1:172.21.15.184:6789/0 conn(0x7f8d1415a3d0 legacy=0x7f8d140aeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:36.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.694+0000 7f8d1359e700 1 -- 172.21.15.39:0/2740757672 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d140cdf60 con 0x7f8d140b1240 2023-11-28T11:56:36.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.694+0000 7f8d11d9b700 1 -- 172.21.15.39:0/2740757672 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1090865414 0 0) 0x7f8d140b1be0 con 0x7f8d1415a3d0 2023-11-28T11:56:36.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.694+0000 7f8d1359e700 1 --2- 172.21.15.39:0/2740757672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d140b1240 0x7f8d140b16a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c009d90 tx=0x7f8d0c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4c2533690c3a772 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:36.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.694+0000 7f8d11d9b700 1 -- 172.21.15.39:0/2740757672 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c00e070 con 0x7f8d140b1240 2023-11-28T11:56:36.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.694+0000 7f8d11d9b700 1 -- 172.21.15.39:0/2740757672 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0c00bb20 con 0x7f8d140b1240 2023-11-28T11:56:36.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.694+0000 7f8d11d9b700 1 -- 172.21.15.39:0/2740757672 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c012430 con 0x7f8d140b1240 2023-11-28T11:56:36.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.694+0000 7f8d18955700 1 -- 172.21.15.39:0/2740757672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d140b1240 msgr2=0x7f8d140b16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:36.701 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.694+0000 7f8d18955700 1 --2- 172.21.15.39:0/2740757672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d140b1240 0x7f8d140b16a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c009d90 tx=0x7f8d0c00b330 comp rx=0 tx=0).stop 2023-11-28T11:56:36.701 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.694+0000 7f8d18955700 1 -- 172.21.15.39:0/2740757672 shutdown_connections 2023-11-28T11:56:36.701 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.694+0000 7f8d18955700 1 --2- 172.21.15.39:0/2740757672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d140b1240 0x7f8d140b16a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:36.701 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.694+0000 7f8d18955700 1 --2- 172.21.15.39:0/2740757672 >> v2:172.21.15.184:3300/0 conn(0x7f8d140cd8d0 0x7f8d140cf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:36.701 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.694+0000 7f8d18955700 1 -- 172.21.15.39:0/2740757672 >> 172.21.15.39:0/2740757672 conn(0x7f8d140cc240 msgr2=0x7f8d140cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:36.701 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.694+0000 7f8d18955700 1 -- 172.21.15.39:0/2740757672 shutdown_connections 2023-11-28T11:56:36.701 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.698+0000 7f8d18955700 1 -- 172.21.15.39:0/2740757672 wait complete. 2023-11-28T11:56:36.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.698+0000 7f8d18955700 1 Processor -- start 2023-11-28T11:56:36.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.698+0000 7f8d18955700 1 -- start start 2023-11-28T11:56:36.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.702+0000 7f8d18955700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d140b1240 0x7f8d14145ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:36.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.702+0000 7f8d18955700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8d140cd8d0 0x7f8d141f0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:36.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.702+0000 7f8d18955700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d1415a3d0 0x7f8d140b0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:36.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.702+0000 7f8d18955700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d14146410 con 0x7f8d140cd8d0 2023-11-28T11:56:36.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.702+0000 7f8d18955700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d140aff90 con 0x7f8d140b1240 2023-11-28T11:56:36.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.702+0000 7f8d18955700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d141f05d0 con 0x7f8d1415a3d0 2023-11-28T11:56:36.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.702+0000 7f8d1259c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8d140cd8d0 0x7f8d141f0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:36.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.702+0000 7f8d1259c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8d140cd8d0 0x7f8d141f0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56774/0 (socket says 172.21.15.39:56774) 2023-11-28T11:56:36.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.702+0000 7f8d1259c700 1 -- 172.21.15.39:0/2741128155 learned_addr learned my addr 172.21.15.39:0/2741128155 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:36.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.702+0000 7f8d12d9d700 1 --2- 172.21.15.39:0/2741128155 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d140b1240 0x7f8d14145ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:36.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.702+0000 7f8d1359e700 1 --2- 172.21.15.39:0/2741128155 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d1415a3d0 0x7f8d140b0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:36.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.702+0000 7f8d1259c700 1 -- 172.21.15.39:0/2741128155 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d1415a3d0 msgr2=0x7f8d140b0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:36.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.702+0000 7f8d1259c700 1 --2- 172.21.15.39:0/2741128155 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d1415a3d0 0x7f8d140b0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:36.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.702+0000 7f8d1259c700 1 -- 172.21.15.39:0/2741128155 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d140b1240 msgr2=0x7f8d14145ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:36.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.702+0000 7f8d1259c700 1 --2- 172.21.15.39:0/2741128155 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d140b1240 0x7f8d14145ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:36.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.702+0000 7f8d1259c700 1 -- 172.21.15.39:0/2741128155 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d0c009a70 con 0x7f8d140cd8d0 2023-11-28T11:56:36.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.702+0000 7f8d12d9d700 1 --2- 172.21.15.39:0/2741128155 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d140b1240 0x7f8d14145ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:36.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.702+0000 7f8d1259c700 1 --2- 172.21.15.39:0/2741128155 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8d140cd8d0 0x7f8d141f0090 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8d0800ea00 tx=0x7f8d0800ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:36.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.702+0000 7f8cfb7fe700 1 -- 172.21.15.39:0/2741128155 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d08009720 con 0x7f8d140cd8d0 2023-11-28T11:56:36.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.702+0000 7f8cfb7fe700 1 -- 172.21.15.39:0/2741128155 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0800eea0 con 0x7f8d140cd8d0 2023-11-28T11:56:36.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.702+0000 7f8d18955700 1 -- 172.21.15.39:0/2741128155 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d140ce520 con 0x7f8d140cd8d0 2023-11-28T11:56:36.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.702+0000 7f8cfb7fe700 1 -- 172.21.15.39:0/2741128155 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0800ca50 con 0x7f8d140cd8d0 2023-11-28T11:56:36.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.702+0000 7f8d18955700 1 -- 172.21.15.39:0/2741128155 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d140ce240 con 0x7f8d140cd8d0 2023-11-28T11:56:36.709 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.706+0000 7f8d18955700 1 -- 172.21.15.39:0/2741128155 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d140ce800 con 0x7f8d140cd8d0 2023-11-28T11:56:36.711 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.706+0000 7f8cfb7fe700 1 -- 172.21.15.39:0/2741128155 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8d08019030 con 0x7f8d140cd8d0 2023-11-28T11:56:36.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.710+0000 7f8cfb7fe700 1 --2- 172.21.15.39:0/2741128155 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8d00064ee0 0x7f8d00067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:36.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.710+0000 7f8cfb7fe700 1 -- 172.21.15.39:0/2741128155 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8d08081b10 con 0x7f8d140cd8d0 2023-11-28T11:56:36.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.710+0000 7f8d12d9d700 1 --2- 172.21.15.39:0/2741128155 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8d00064ee0 0x7f8d00067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:36.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.710+0000 7f8d12d9d700 1 --2- 172.21.15.39:0/2741128155 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8d00064ee0 0x7f8d00067390 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8d04000f60 tx=0x7f8d04007e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:36.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.714+0000 7f8cfb7fe700 1 -- 172.21.15.39:0/2741128155 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8d0804feb0 con 0x7f8d140cd8d0 2023-11-28T11:56:36.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.886+0000 7f8d18955700 1 -- 172.21.15.39:0/2741128155 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8d140b0140 con 0x7f8d140cd8d0 2023-11-28T11:56:36.893 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.890+0000 7f8cfb7fe700 1 -- 172.21.15.39:0/2741128155 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8d080534d0 con 0x7f8d140cd8d0 2023-11-28T11:56:36.893 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-11-28T11:56:36.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.890+0000 7f8d18955700 1 -- 172.21.15.39:0/2741128155 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8d00064ee0 msgr2=0x7f8d00067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:36.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.890+0000 7f8d18955700 1 --2- 172.21.15.39:0/2741128155 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8d00064ee0 0x7f8d00067390 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8d04000f60 tx=0x7f8d04007e90 comp rx=0 tx=0).stop 2023-11-28T11:56:36.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.890+0000 7f8d18955700 1 -- 172.21.15.39:0/2741128155 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8d140cd8d0 msgr2=0x7f8d141f0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:36.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.890+0000 7f8d18955700 1 --2- 172.21.15.39:0/2741128155 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8d140cd8d0 0x7f8d141f0090 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8d0800ea00 tx=0x7f8d0800ed10 comp rx=0 tx=0).stop 2023-11-28T11:56:36.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.890+0000 7f8d18955700 1 -- 172.21.15.39:0/2741128155 shutdown_connections 2023-11-28T11:56:36.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.890+0000 7f8d18955700 1 --2- 172.21.15.39:0/2741128155 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d1415a3d0 0x7f8d140b0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:36.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.890+0000 7f8d18955700 1 --2- 172.21.15.39:0/2741128155 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8d140cd8d0 0x7f8d141f0090 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:36.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.890+0000 7f8d18955700 1 --2- 172.21.15.39:0/2741128155 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8d00064ee0 0x7f8d00067390 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:36.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.890+0000 7f8d18955700 1 --2- 172.21.15.39:0/2741128155 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d140b1240 0x7f8d14145ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:36.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.890+0000 7f8d18955700 1 -- 172.21.15.39:0/2741128155 >> 172.21.15.39:0/2741128155 conn(0x7f8d140cc240 msgr2=0x7f8d14155f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:36.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.894+0000 7f8d18955700 1 -- 172.21.15.39:0/2741128155 shutdown_connections 2023-11-28T11:56:36.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:36.894+0000 7f8d18955700 1 -- 172.21.15.39:0/2741128155 wait complete. 2023-11-28T11:56:36.922 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:56:37.103 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.098+0000 7f7e155a0700 1 Processor -- start 2023-11-28T11:56:37.104 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.098+0000 7f7e155a0700 1 -- start start 2023-11-28T11:56:37.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.102+0000 7f7e155a0700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7e10070620 0x7f7e100b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:37.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.102+0000 7f7e155a0700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e1015c520 con 0x7f7e1015c150 2023-11-28T11:56:37.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.102+0000 7f7e155a0700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e1006cc50 con 0x7f7e10069bf0 2023-11-28T11:56:37.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.102+0000 7f7e155a0700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e100b4240 con 0x7f7e10070620 2023-11-28T11:56:37.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.102+0000 7f7e0effd700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f7e1015c150 0x7f7e1006ff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:37576/0 (socket says 172.21.15.39:37576) 2023-11-28T11:56:37.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.102+0000 7f7e0effd700 1 -- 172.21.15.39:0/2568521807 learned_addr learned my addr 172.21.15.39:0/2568521807 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:56:37.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.102+0000 7f7e0e7fc700 1 --2- 172.21.15.39:0/2568521807 >> v2:172.21.15.39:3300/0 conn(0x7f7e10070620 0x7f7e100b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:37.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.106+0000 7f7e0dffb700 1 -- 172.21.15.39:0/2568521807 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 879605451 0 0) 0x7f7e1015c520 con 0x7f7e1015c150 2023-11-28T11:56:37.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.106+0000 7f7e0dffb700 1 -- 172.21.15.39:0/2568521807 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7df80035d0 con 0x7f7e1015c150 2023-11-28T11:56:37.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.106+0000 7f7e0dffb700 1 -- 172.21.15.39:0/2568521807 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3613959770 0 0) 0x7f7e1006cc50 con 0x7f7e10069bf0 2023-11-28T11:56:37.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.106+0000 7f7e0dffb700 1 -- 172.21.15.39:0/2568521807 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e1015c520 con 0x7f7e10069bf0 2023-11-28T11:56:37.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.106+0000 7f7e0e7fc700 1 -- 172.21.15.39:0/2568521807 >> v1:172.21.15.184:6789/0 conn(0x7f7e10069bf0 legacy=0x7f7e10069ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:37.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.106+0000 7f7e0e7fc700 1 -- 172.21.15.39:0/2568521807 >> v1:172.21.15.39:6789/0 conn(0x7f7e1015c150 legacy=0x7f7e1006ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:37.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.106+0000 7f7e0e7fc700 1 -- 172.21.15.39:0/2568521807 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e100d2450 con 0x7f7e10070620 2023-11-28T11:56:37.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.106+0000 7f7e0e7fc700 1 --2- 172.21.15.39:0/2568521807 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e10070620 0x7f7e100b3d00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009840 tx=0x7f7e04009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e535f2fedcf43650 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:37.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.106+0000 7f7e0dffb700 1 -- 172.21.15.39:0/2568521807 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e04005e50 con 0x7f7e10070620 2023-11-28T11:56:37.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.106+0000 7f7e0dffb700 1 -- 172.21.15.39:0/2568521807 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e04006030 con 0x7f7e10070620 2023-11-28T11:56:37.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.106+0000 7f7e0dffb700 1 -- 172.21.15.39:0/2568521807 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e040063c0 con 0x7f7e10070620 2023-11-28T11:56:37.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.106+0000 7f7e155a0700 1 -- 172.21.15.39:0/2568521807 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e10070620 msgr2=0x7f7e100b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:37.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.106+0000 7f7e155a0700 1 --2- 172.21.15.39:0/2568521807 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e10070620 0x7f7e100b3d00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009840 tx=0x7f7e04009b50 comp rx=0 tx=0).stop 2023-11-28T11:56:37.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.106+0000 7f7e155a0700 1 -- 172.21.15.39:0/2568521807 shutdown_connections 2023-11-28T11:56:37.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.106+0000 7f7e155a0700 1 --2- 172.21.15.39:0/2568521807 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e10070620 0x7f7e100b3d00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.106+0000 7f7e155a0700 1 -- 172.21.15.39:0/2568521807 >> 172.21.15.39:0/2568521807 conn(0x7f7e100d3680 msgr2=0x7f7e100cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:37.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.106+0000 7f7e155a0700 1 -- 172.21.15.39:0/2568521807 shutdown_connections 2023-11-28T11:56:37.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.106+0000 7f7e155a0700 1 -- 172.21.15.39:0/2568521807 wait complete. 2023-11-28T11:56:37.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.110+0000 7f7e155a0700 1 Processor -- start 2023-11-28T11:56:37.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.110+0000 7f7e155a0700 1 -- start start 2023-11-28T11:56:37.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.114+0000 7f7e155a0700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e10069bf0 0x7f7e100ccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:37.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.114+0000 7f7e155a0700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e10070620 0x7f7e101f10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:37.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.114+0000 7f7e155a0700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e1015c150 0x7f7e10154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:37.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.114+0000 7f7e155a0700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e10157210 con 0x7f7e10070620 2023-11-28T11:56:37.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.114+0000 7f7e155a0700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e10156940 con 0x7f7e10069bf0 2023-11-28T11:56:37.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.114+0000 7f7e155a0700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e101f1600 con 0x7f7e1015c150 2023-11-28T11:56:37.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.114+0000 7f7e0e7fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e10070620 0x7f7e101f10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:37.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.114+0000 7f7e0e7fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e10070620 0x7f7e101f10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56794/0 (socket says 172.21.15.39:56794) 2023-11-28T11:56:37.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.114+0000 7f7e0e7fc700 1 -- 172.21.15.39:0/2119890062 learned_addr learned my addr 172.21.15.39:0/2119890062 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:37.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.114+0000 7f7e0effd700 1 --2- 172.21.15.39:0/2119890062 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e10069bf0 0x7f7e100ccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:37.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.114+0000 7f7e0f7fe700 1 --2- 172.21.15.39:0/2119890062 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e1015c150 0x7f7e10154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:37.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.114+0000 7f7e0e7fc700 1 -- 172.21.15.39:0/2119890062 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e1015c150 msgr2=0x7f7e10154460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:37.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.114+0000 7f7e0e7fc700 1 --2- 172.21.15.39:0/2119890062 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e1015c150 0x7f7e10154460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.114+0000 7f7e0e7fc700 1 -- 172.21.15.39:0/2119890062 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e10069bf0 msgr2=0x7f7e100ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:37.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.114+0000 7f7e0e7fc700 1 --2- 172.21.15.39:0/2119890062 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e10069bf0 0x7f7e100ccfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.114+0000 7f7e0e7fc700 1 -- 172.21.15.39:0/2119890062 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e04009450 con 0x7f7e10070620 2023-11-28T11:56:37.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.114+0000 7f7e0e7fc700 1 --2- 172.21.15.39:0/2119890062 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e10070620 0x7f7e101f10c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7e04013040 tx=0x7f7e04004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:37.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.114+0000 7f7df77fe700 1 -- 172.21.15.39:0/2119890062 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e04006970 con 0x7f7e10070620 2023-11-28T11:56:37.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.114+0000 7f7df77fe700 1 -- 172.21.15.39:0/2119890062 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e04020070 con 0x7f7e10070620 2023-11-28T11:56:37.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.114+0000 7f7e155a0700 1 -- 172.21.15.39:0/2119890062 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e100d05e0 con 0x7f7e10070620 2023-11-28T11:56:37.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.114+0000 7f7df77fe700 1 -- 172.21.15.39:0/2119890062 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e04025670 con 0x7f7e10070620 2023-11-28T11:56:37.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.114+0000 7f7e155a0700 1 -- 172.21.15.39:0/2119890062 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e100d2730 con 0x7f7e10070620 2023-11-28T11:56:37.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.118+0000 7f7e155a0700 1 -- 172.21.15.39:0/2119890062 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e100d2140 con 0x7f7e10070620 2023-11-28T11:56:37.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.118+0000 7f7df77fe700 1 -- 172.21.15.39:0/2119890062 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7e0402b020 con 0x7f7e10070620 2023-11-28T11:56:37.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.122+0000 7f7df77fe700 1 --2- 172.21.15.39:0/2119890062 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7dfc064ee0 0x7f7dfc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:37.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.122+0000 7f7df77fe700 1 -- 172.21.15.39:0/2119890062 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7e040833b0 con 0x7f7e10070620 2023-11-28T11:56:37.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.122+0000 7f7e0effd700 1 --2- 172.21.15.39:0/2119890062 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7dfc064ee0 0x7f7dfc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:37.127 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.122+0000 7f7e0effd700 1 --2- 172.21.15.39:0/2119890062 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7dfc064ee0 0x7f7dfc067390 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7e00000f60 tx=0x7f7e00009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:37.132 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.126+0000 7f7df77fe700 1 -- 172.21.15.39:0/2119890062 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7e040517b0 con 0x7f7e10070620 2023-11-28T11:56:37.307 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.302+0000 7f7e155a0700 1 -- 172.21.15.39:0/2119890062 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7e10073d20 con 0x7f7e10070620 2023-11-28T11:56:37.308 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.306+0000 7f7df77fe700 1 -- 172.21.15.39:0/2119890062 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7e04054dd0 con 0x7f7e10070620 2023-11-28T11:56:37.309 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-11-28T11:56:37.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.306+0000 7f7e155a0700 1 -- 172.21.15.39:0/2119890062 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7dfc064ee0 msgr2=0x7f7dfc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:37.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.306+0000 7f7e155a0700 1 --2- 172.21.15.39:0/2119890062 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7dfc064ee0 0x7f7dfc067390 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7e00000f60 tx=0x7f7e00009040 comp rx=0 tx=0).stop 2023-11-28T11:56:37.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.306+0000 7f7e155a0700 1 -- 172.21.15.39:0/2119890062 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e10070620 msgr2=0x7f7e101f10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:37.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.306+0000 7f7e155a0700 1 --2- 172.21.15.39:0/2119890062 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e10070620 0x7f7e101f10c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7e04013040 tx=0x7f7e04004770 comp rx=0 tx=0).stop 2023-11-28T11:56:37.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.306+0000 7f7e155a0700 1 -- 172.21.15.39:0/2119890062 shutdown_connections 2023-11-28T11:56:37.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.306+0000 7f7e155a0700 1 --2- 172.21.15.39:0/2119890062 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e1015c150 0x7f7e10154460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.306+0000 7f7e155a0700 1 --2- 172.21.15.39:0/2119890062 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e10070620 0x7f7e101f10c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.306+0000 7f7e155a0700 1 --2- 172.21.15.39:0/2119890062 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7dfc064ee0 0x7f7dfc067390 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.306+0000 7f7e155a0700 1 --2- 172.21.15.39:0/2119890062 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e10069bf0 0x7f7e100ccfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.306+0000 7f7e155a0700 1 -- 172.21.15.39:0/2119890062 >> 172.21.15.39:0/2119890062 conn(0x7f7e100d3680 msgr2=0x7f7e100c9140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:37.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.306+0000 7f7e155a0700 1 -- 172.21.15.39:0/2119890062 shutdown_connections 2023-11-28T11:56:37.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.306+0000 7f7e155a0700 1 -- 172.21.15.39:0/2119890062 wait complete. 2023-11-28T11:56:37.337 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T11:56:37.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.510+0000 7f3865de6700 1 Processor -- start 2023-11-28T11:56:37.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.510+0000 7f3865de6700 1 -- start start 2023-11-28T11:56:37.515 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.510+0000 7f3865de6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3860159fe0 0x7f3860071960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:37.515 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.510+0000 7f3865de6700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f386006b220 0x7f386015e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:37.516 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.510+0000 7f3865de6700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f386015ea50 con 0x7f38600cb840 2023-11-28T11:56:37.516 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.510+0000 7f3865de6700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f386015b3c0 con 0x7f386006b220 2023-11-28T11:56:37.516 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.510+0000 7f3865de6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38600cb020 con 0x7f3860159fe0 2023-11-28T11:56:37.529 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.514+0000 7f385f7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3860159fe0 0x7f3860071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:37.529 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.514+0000 7f385ffff700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f38600cb840 0x7f38600cbcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:36104/0 (socket says 172.21.15.39:36104) 2023-11-28T11:56:37.529 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.514+0000 7f385ffff700 1 -- 172.21.15.39:0/1427084642 learned_addr learned my addr 172.21.15.39:0/1427084642 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:56:37.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.514+0000 7f385effd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f386006b220 0x7f386015e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:37.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.514+0000 7f385e7fc700 1 -- 172.21.15.39:0/1427084642 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2221918679 0 0) 0x7f3858001110 con 0x7f38600cb840 2023-11-28T11:56:37.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.514+0000 7f385e7fc700 1 -- 172.21.15.39:0/1427084642 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38480035d0 con 0x7f38600cb840 2023-11-28T11:56:37.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.514+0000 7f385effd700 1 -- 172.21.15.39:0/1427084642 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3860159fe0 msgr2=0x7f3860071960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:37.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.514+0000 7f385effd700 1 --2- 172.21.15.39:0/1427084642 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3860159fe0 0x7f3860071960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.514+0000 7f385effd700 1 -- 172.21.15.39:0/1427084642 >> v1:172.21.15.184:6789/0 conn(0x7f38600cb840 legacy=0x7f38600cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:37.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.514+0000 7f385effd700 1 -- 172.21.15.39:0/1427084642 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38600c9ba0 con 0x7f386006b220 2023-11-28T11:56:37.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.514+0000 7f385f7fe700 1 --2- 172.21.15.39:0/1427084642 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3860159fe0 0x7f3860071960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:37.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.514+0000 7f385effd700 1 --2- 172.21.15.39:0/1427084642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f386006b220 0x7f386015e510 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3854009850 tx=0x7f3854009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a03099592c87903b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:37.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.514+0000 7f385e7fc700 1 -- 172.21.15.39:0/1427084642 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3854011830 con 0x7f386006b220 2023-11-28T11:56:37.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.514+0000 7f385e7fc700 1 -- 172.21.15.39:0/1427084642 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3854011990 con 0x7f386006b220 2023-11-28T11:56:37.531 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.514+0000 7f385e7fc700 1 -- 172.21.15.39:0/1427084642 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3854011d40 con 0x7f386006b220 2023-11-28T11:56:37.531 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.514+0000 7f3865de6700 1 -- 172.21.15.39:0/1427084642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f386006b220 msgr2=0x7f386015e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:37.531 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.514+0000 7f3865de6700 1 --2- 172.21.15.39:0/1427084642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f386006b220 0x7f386015e510 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3854009850 tx=0x7f3854009b60 comp rx=0 tx=0).stop 2023-11-28T11:56:37.531 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.514+0000 7f3865de6700 1 -- 172.21.15.39:0/1427084642 shutdown_connections 2023-11-28T11:56:37.531 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.514+0000 7f3865de6700 1 --2- 172.21.15.39:0/1427084642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f386006b220 0x7f386015e510 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.531 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.514+0000 7f3865de6700 1 --2- 172.21.15.39:0/1427084642 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3860159fe0 0x7f3860071960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.531 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.514+0000 7f3865de6700 1 -- 172.21.15.39:0/1427084642 >> 172.21.15.39:0/1427084642 conn(0x7f386006c8a0 msgr2=0x7f386006cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:37.531 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.518+0000 7f3865de6700 1 -- 172.21.15.39:0/1427084642 shutdown_connections 2023-11-28T11:56:37.531 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.518+0000 7f3865de6700 1 -- 172.21.15.39:0/1427084642 wait complete. 2023-11-28T11:56:37.531 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.518+0000 7f3865de6700 1 Processor -- start 2023-11-28T11:56:37.531 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.518+0000 7f3865de6700 1 -- start start 2023-11-28T11:56:37.531 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.522+0000 7f3865de6700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f386006b220 0x7f386014afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:37.531 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.522+0000 7f3865de6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38600cb840 0x7f38600c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:37.532 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.522+0000 7f3865de6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3860159fe0 0x7f386015c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:37.532 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.522+0000 7f3865de6700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38600c71d0 con 0x7f386006b220 2023-11-28T11:56:37.532 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.522+0000 7f3865de6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38601f1790 con 0x7f3860159fe0 2023-11-28T11:56:37.532 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.522+0000 7f3865de6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f386014b810 con 0x7f38600cb840 2023-11-28T11:56:37.532 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.522+0000 7f385f7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f386006b220 0x7f386014afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:37.532 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.522+0000 7f385f7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f386006b220 0x7f386014afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56798/0 (socket says 172.21.15.39:56798) 2023-11-28T11:56:37.532 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.522+0000 7f385f7fe700 1 -- 172.21.15.39:0/2591546771 learned_addr learned my addr 172.21.15.39:0/2591546771 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:37.532 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.522+0000 7f385effd700 1 --2- 172.21.15.39:0/2591546771 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38600cb840 0x7f38600c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:37.532 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.522+0000 7f385ffff700 1 --2- 172.21.15.39:0/2591546771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3860159fe0 0x7f386015c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:37.532 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.522+0000 7f385effd700 1 -- 172.21.15.39:0/2591546771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3860159fe0 msgr2=0x7f386015c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:37.532 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.522+0000 7f385effd700 1 --2- 172.21.15.39:0/2591546771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3860159fe0 0x7f386015c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.532 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.522+0000 7f385effd700 1 -- 172.21.15.39:0/2591546771 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f386006b220 msgr2=0x7f386014afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:37.532 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.522+0000 7f385effd700 1 --2- 172.21.15.39:0/2591546771 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f386006b220 0x7f386014afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.533 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.522+0000 7f385effd700 1 -- 172.21.15.39:0/2591546771 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3850009a70 con 0x7f38600cb840 2023-11-28T11:56:37.533 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.522+0000 7f385f7fe700 1 --2- 172.21.15.39:0/2591546771 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f386006b220 0x7f386014afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:37.533 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.522+0000 7f385effd700 1 --2- 172.21.15.39:0/2591546771 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38600cb840 0x7f38600c34b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3854016000 tx=0x7f3854004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:37.533 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.522+0000 7f3847fff700 1 -- 172.21.15.39:0/2591546771 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3854004510 con 0x7f38600cb840 2023-11-28T11:56:37.533 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.522+0000 7f3847fff700 1 -- 172.21.15.39:0/2591546771 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38540036c0 con 0x7f38600cb840 2023-11-28T11:56:37.533 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.522+0000 7f3865de6700 1 -- 172.21.15.39:0/2591546771 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38540094b0 con 0x7f38600cb840 2023-11-28T11:56:37.533 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.522+0000 7f3847fff700 1 -- 172.21.15.39:0/2591546771 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3854003a70 con 0x7f38600cb840 2023-11-28T11:56:37.533 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.522+0000 7f3865de6700 1 -- 172.21.15.39:0/2591546771 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38600c98c0 con 0x7f38600cb840 2023-11-28T11:56:37.533 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.526+0000 7f3865de6700 1 -- 172.21.15.39:0/2591546771 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38600c95e0 con 0x7f38600cb840 2023-11-28T11:56:37.533 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.526+0000 7f3847fff700 1 -- 172.21.15.39:0/2591546771 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f385402d070 con 0x7f38600cb840 2023-11-28T11:56:37.534 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.526+0000 7f3847fff700 1 --2- 172.21.15.39:0/2591546771 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f384c064ee0 0x7f384c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:37.534 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.526+0000 7f3847fff700 1 -- 172.21.15.39:0/2591546771 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3854021030 con 0x7f38600cb840 2023-11-28T11:56:37.534 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.526+0000 7f385f7fe700 1 --2- 172.21.15.39:0/2591546771 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f384c064ee0 0x7f384c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:37.534 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.530+0000 7f385f7fe700 1 --2- 172.21.15.39:0/2591546771 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f384c064ee0 0x7f384c067390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3850003e90 tx=0x7f385000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:37.539 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.534+0000 7f3847fff700 1 -- 172.21.15.39:0/2591546771 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f38540514a0 con 0x7f38600cb840 2023-11-28T11:56:37.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.710+0000 7f3865de6700 1 -- 172.21.15.39:0/2591546771 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f38600cb280 con 0x7f38600cb840 2023-11-28T11:56:37.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.710+0000 7f3847fff700 1 -- 172.21.15.39:0/2591546771 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v21) v1 ==== 84+0+126 (secure 0 0 0) 0x7f385402b090 con 0x7f38600cb840 2023-11-28T11:56:37.716 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:56:37.716 INFO:teuthology.orchestra.run.smithi039.stdout:[ 2023-11-28T11:56:37.716 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:56:37.716 INFO:teuthology.orchestra.run.smithi039.stdout: "poolnum": 1, 2023-11-28T11:56:37.716 INFO:teuthology.orchestra.run.smithi039.stdout: "poolname": ".mgr" 2023-11-28T11:56:37.716 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:56:37.716 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:56:37.716 INFO:teuthology.orchestra.run.smithi039.stdout: "poolnum": 2, 2023-11-28T11:56:37.716 INFO:teuthology.orchestra.run.smithi039.stdout: "poolname": "rbd" 2023-11-28T11:56:37.717 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:56:37.717 INFO:teuthology.orchestra.run.smithi039.stdout:] 2023-11-28T11:56:37.718 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.714+0000 7f3865de6700 1 -- 172.21.15.39:0/2591546771 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f384c064ee0 msgr2=0x7f384c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:37.718 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.714+0000 7f3865de6700 1 --2- 172.21.15.39:0/2591546771 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f384c064ee0 0x7f384c067390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3850003e90 tx=0x7f385000b040 comp rx=0 tx=0).stop 2023-11-28T11:56:37.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.714+0000 7f3865de6700 1 -- 172.21.15.39:0/2591546771 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38600cb840 msgr2=0x7f38600c34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:37.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.714+0000 7f3865de6700 1 --2- 172.21.15.39:0/2591546771 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38600cb840 0x7f38600c34b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3854016000 tx=0x7f3854004770 comp rx=0 tx=0).stop 2023-11-28T11:56:37.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.714+0000 7f3865de6700 1 -- 172.21.15.39:0/2591546771 shutdown_connections 2023-11-28T11:56:37.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.714+0000 7f3865de6700 1 --2- 172.21.15.39:0/2591546771 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f384c064ee0 0x7f384c067390 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.714+0000 7f3865de6700 1 --2- 172.21.15.39:0/2591546771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3860159fe0 0x7f386015c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.714+0000 7f3865de6700 1 --2- 172.21.15.39:0/2591546771 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38600cb840 0x7f38600c34b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.714+0000 7f3865de6700 1 --2- 172.21.15.39:0/2591546771 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f386006b220 0x7f386014afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.714+0000 7f3865de6700 1 -- 172.21.15.39:0/2591546771 >> 172.21.15.39:0/2591546771 conn(0x7f386006c8a0 msgr2=0x7f386006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:37.720 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.714+0000 7f3865de6700 1 -- 172.21.15.39:0/2591546771 shutdown_connections 2023-11-28T11:56:37.720 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.714+0000 7f3865de6700 1 -- 172.21.15.39:0/2591546771 wait complete. 2023-11-28T11:56:37.741 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T11:56:37.741 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T11:56:37.930 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.926+0000 7f74f6fd9700 1 Processor -- start 2023-11-28T11:56:37.930 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.926+0000 7f74f6fd9700 1 -- start start 2023-11-28T11:56:37.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.930+0000 7f74f6fd9700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f74f00b6110 0x7f74f0142fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:37.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.930+0000 7f74f6fd9700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74f006b8d0 con 0x7f74f0142650 2023-11-28T11:56:37.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.930+0000 7f74f6fd9700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74f006bb70 con 0x7f74f006aab0 2023-11-28T11:56:37.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.930+0000 7f74f6fd9700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74f006be50 con 0x7f74f00b6110 2023-11-28T11:56:37.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.930+0000 7f74f4d75700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f74f0142650 0x7f74f00b5a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:37586/0 (socket says 172.21.15.39:37586) 2023-11-28T11:56:37.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.930+0000 7f74f4d75700 1 -- 172.21.15.39:0/568143889 learned_addr learned my addr 172.21.15.39:0/568143889 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:56:37.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.930+0000 7f74effff700 1 --2- 172.21.15.39:0/568143889 >> v2:172.21.15.184:3300/0 conn(0x7f74f00b6110 0x7f74f0142fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:37.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.930+0000 7f74ef7fe700 1 -- 172.21.15.39:0/568143889 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1486705405 0 0) 0x7f74f006b8d0 con 0x7f74f0142650 2023-11-28T11:56:37.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.930+0000 7f74ef7fe700 1 -- 172.21.15.39:0/568143889 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74e00035d0 con 0x7f74f0142650 2023-11-28T11:56:37.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.930+0000 7f74ef7fe700 1 -- 172.21.15.39:0/568143889 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3456683520 0 0) 0x7f74f006bb70 con 0x7f74f006aab0 2023-11-28T11:56:37.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.930+0000 7f74ef7fe700 1 -- 172.21.15.39:0/568143889 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74f006b8d0 con 0x7f74f006aab0 2023-11-28T11:56:37.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.930+0000 7f74ef7fe700 1 -- 172.21.15.39:0/568143889 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 66608851 0 0) 0x7f74e00035d0 con 0x7f74f0142650 2023-11-28T11:56:37.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.930+0000 7f74ef7fe700 1 -- 172.21.15.39:0/568143889 >> v2:172.21.15.184:3300/0 conn(0x7f74f00b6110 msgr2=0x7f74f0142fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:37.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.930+0000 7f74ef7fe700 1 --2- 172.21.15.39:0/568143889 >> v2:172.21.15.184:3300/0 conn(0x7f74f00b6110 0x7f74f0142fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.930+0000 7f74ef7fe700 1 -- 172.21.15.39:0/568143889 >> v1:172.21.15.184:6789/0 conn(0x7f74f006aab0 legacy=0x7f74f006af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:37.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.930+0000 7f74ef7fe700 1 -- 172.21.15.39:0/568143889 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f006c130 con 0x7f74f0142650 2023-11-28T11:56:37.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.930+0000 7f74ef7fe700 1 -- 172.21.15.39:0/568143889 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4013383302 0 0) 0x7f74e4001670 con 0x7f74f0142650 2023-11-28T11:56:37.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.930+0000 7f74ef7fe700 1 -- 172.21.15.39:0/568143889 >> v1:172.21.15.39:6789/0 conn(0x7f74f0142650 legacy=0x7f74f00b5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:37.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.930+0000 7f74ef7fe700 1 --2- 172.21.15.39:0/568143889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74e0003bb0 0x7f74e0003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:37.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.930+0000 7f74ef7fe700 1 --2- 172.21.15.39:0/568143889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74e0004870 0x7f74e0004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:37.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.930+0000 7f74ef7fe700 1 --2- 172.21.15.39:0/568143889 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74e0005220 0x7f74e000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:37.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.934+0000 7f74ef7fe700 1 -- 172.21.15.39:0/568143889 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f006be50 con 0x7f74e0004870 2023-11-28T11:56:37.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.934+0000 7f74ef7fe700 1 -- 172.21.15.39:0/568143889 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e000c080 con 0x7f74e0003bb0 2023-11-28T11:56:37.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.934+0000 7f74ef7fe700 1 -- 172.21.15.39:0/568143889 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e000c240 con 0x7f74e0005220 2023-11-28T11:56:37.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.934+0000 7f74effff700 1 --2- 172.21.15.39:0/568143889 >> v2:172.21.15.184:3300/0 conn(0x7f74f00b6110 0x7f74f0142fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:37.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.934+0000 7f74effff700 1 --2- 172.21.15.39:0/568143889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74e0004870 0x7f74e0004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:37.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.934+0000 7f74f5576700 1 --2- 172.21.15.39:0/568143889 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74e0005220 0x7f74e000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:37.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.934+0000 7f74f4d75700 1 --2- 172.21.15.39:0/568143889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74e0003bb0 0x7f74e0003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:37.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.934+0000 7f74effff700 1 -- 172.21.15.39:0/568143889 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74e0005220 msgr2=0x7f74e000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:37.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.934+0000 7f74effff700 1 --2- 172.21.15.39:0/568143889 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74e0005220 0x7f74e000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.934+0000 7f74effff700 1 -- 172.21.15.39:0/568143889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74e0003bb0 msgr2=0x7f74e0003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:37.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.934+0000 7f74effff700 1 --2- 172.21.15.39:0/568143889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74e0003bb0 0x7f74e0003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.934+0000 7f74effff700 1 -- 172.21.15.39:0/568143889 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e00035d0 con 0x7f74e0004870 2023-11-28T11:56:37.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.934+0000 7f74f5576700 1 -- 172.21.15.39:0/568143889 reap_dead start 2023-11-28T11:56:37.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.934+0000 7f74effff700 1 --2- 172.21.15.39:0/568143889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74e0004870 0x7f74e0004ce0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f74dc009d10 tx=0x7f74e00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45aeac4d86aac4fa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:37.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.934+0000 7f74ef7fe700 1 -- 172.21.15.39:0/568143889 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74dc009e60 con 0x7f74e0004870 2023-11-28T11:56:37.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.934+0000 7f74ef7fe700 1 -- 172.21.15.39:0/568143889 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74dc00e9a0 con 0x7f74e0004870 2023-11-28T11:56:37.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.934+0000 7f74ef7fe700 1 -- 172.21.15.39:0/568143889 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74dc00ed30 con 0x7f74e0004870 2023-11-28T11:56:37.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.934+0000 7f74f6fd9700 1 -- 172.21.15.39:0/568143889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74e0004870 msgr2=0x7f74e0004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:37.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.934+0000 7f74f6fd9700 1 --2- 172.21.15.39:0/568143889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74e0004870 0x7f74e0004ce0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f74dc009d10 tx=0x7f74e00058a0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.934+0000 7f74f6fd9700 1 -- 172.21.15.39:0/568143889 shutdown_connections 2023-11-28T11:56:37.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.934+0000 7f74f6fd9700 1 --2- 172.21.15.39:0/568143889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74e0004870 0x7f74e0004ce0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.934+0000 7f74f6fd9700 1 -- 172.21.15.39:0/568143889 >> 172.21.15.39:0/568143889 conn(0x7f74f00b5390 msgr2=0x7f74f00d2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:37.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.934+0000 7f74f6fd9700 1 -- 172.21.15.39:0/568143889 shutdown_connections 2023-11-28T11:56:37.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.934+0000 7f74f6fd9700 1 -- 172.21.15.39:0/568143889 wait complete. 2023-11-28T11:56:37.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.938+0000 7f74f6fd9700 1 Processor -- start 2023-11-28T11:56:37.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.938+0000 7f74f6fd9700 1 -- start start 2023-11-28T11:56:37.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.942+0000 7f74f6fd9700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74e0004870 0x7f74f01e31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:37.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.942+0000 7f74f6fd9700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74f01dcf90 0x7f74f0134190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:37.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.942+0000 7f74f6fd9700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74f0144800 0x7f74f01dfa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:37.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.942+0000 7f74f6fd9700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f01346d0 con 0x7f74e0004870 2023-11-28T11:56:37.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.942+0000 7f74f6fd9700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f0144370 con 0x7f74f0144800 2023-11-28T11:56:37.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.942+0000 7f74f6fd9700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74f01434c0 con 0x7f74f01dcf90 2023-11-28T11:56:37.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.942+0000 7f74f4d75700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74e0004870 0x7f74f01e31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:37.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.942+0000 7f74f4d75700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74e0004870 0x7f74f01e31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56826/0 (socket says 172.21.15.39:56826) 2023-11-28T11:56:37.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.942+0000 7f74f4d75700 1 -- 172.21.15.39:0/3147707356 learned_addr learned my addr 172.21.15.39:0/3147707356 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:37.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.942+0000 7f74f5576700 1 --2- 172.21.15.39:0/3147707356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74f0144800 0x7f74f01dfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:37.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.942+0000 7f74effff700 1 --2- 172.21.15.39:0/3147707356 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74f01dcf90 0x7f74f0134190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:37.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.942+0000 7f74f4d75700 1 -- 172.21.15.39:0/3147707356 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74f01dcf90 msgr2=0x7f74f0134190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:37.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.942+0000 7f74f4d75700 1 --2- 172.21.15.39:0/3147707356 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74f01dcf90 0x7f74f0134190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.942+0000 7f74f4d75700 1 -- 172.21.15.39:0/3147707356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74f0144800 msgr2=0x7f74f01dfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:37.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.942+0000 7f74f4d75700 1 --2- 172.21.15.39:0/3147707356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74f0144800 0x7f74f01dfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.942+0000 7f74f4d75700 1 -- 172.21.15.39:0/3147707356 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f0142a20 con 0x7f74e0004870 2023-11-28T11:56:37.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.942+0000 7f74f5576700 1 --2- 172.21.15.39:0/3147707356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74f0144800 0x7f74f01dfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:37.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.942+0000 7f74f4d75700 1 --2- 172.21.15.39:0/3147707356 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74e0004870 0x7f74f01e31b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f74e400eb20 tx=0x7f74e400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:37.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.942+0000 7f74ed7fa700 1 -- 172.21.15.39:0/3147707356 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e4005e20 con 0x7f74e0004870 2023-11-28T11:56:37.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.942+0000 7f74ed7fa700 1 -- 172.21.15.39:0/3147707356 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e400c570 con 0x7f74e0004870 2023-11-28T11:56:37.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.942+0000 7f74f6fd9700 1 -- 172.21.15.39:0/3147707356 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74f006c410 con 0x7f74e0004870 2023-11-28T11:56:37.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.942+0000 7f74ed7fa700 1 -- 172.21.15.39:0/3147707356 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e400c920 con 0x7f74e0004870 2023-11-28T11:56:37.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.942+0000 7f74f6fd9700 1 -- 172.21.15.39:0/3147707356 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74f0142fa0 con 0x7f74e0004870 2023-11-28T11:56:37.950 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.946+0000 7f74f6fd9700 1 -- 172.21.15.39:0/3147707356 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74f00726c0 con 0x7f74e0004870 2023-11-28T11:56:37.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.946+0000 7f74ed7fa700 1 -- 172.21.15.39:0/3147707356 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f74e400ca80 con 0x7f74e0004870 2023-11-28T11:56:37.952 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.950+0000 7f74ed7fa700 1 --2- 172.21.15.39:0/3147707356 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f74d4064ee0 0x7f74d4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:37.952 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.950+0000 7f74ed7fa700 1 -- 172.21.15.39:0/3147707356 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f74e40819c0 con 0x7f74e0004870 2023-11-28T11:56:37.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.950+0000 7f74effff700 1 --2- 172.21.15.39:0/3147707356 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f74d4064ee0 0x7f74d4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:37.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.950+0000 7f74effff700 1 --2- 172.21.15.39:0/3147707356 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f74d4064ee0 0x7f74d4067390 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f74dc0090b0 tx=0x7f74dc01e040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:37.958 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:37.954+0000 7f74ed7fa700 1 -- 172.21.15.39:0/3147707356 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f74e404fdc0 con 0x7f74e0004870 2023-11-28T11:56:38.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.130+0000 7f74f6fd9700 1 -- 172.21.15.39:0/3147707356 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f74f00d3920 con 0x7f74e0004870 2023-11-28T11:56:38.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.430+0000 7f74ed7fa700 1 -- 172.21.15.39:0/3147707356 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v22) v1 ==== 138+0+0 (secure 0 0 0) 0x7f74e40533e0 con 0x7f74e0004870 2023-11-28T11:56:38.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.434+0000 7f74f6fd9700 1 -- 172.21.15.39:0/3147707356 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f74d4064ee0 msgr2=0x7f74d4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:38.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.434+0000 7f74f6fd9700 1 --2- 172.21.15.39:0/3147707356 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f74d4064ee0 0x7f74d4067390 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f74dc0090b0 tx=0x7f74dc01e040 comp rx=0 tx=0).stop 2023-11-28T11:56:38.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.438+0000 7f74f6fd9700 1 -- 172.21.15.39:0/3147707356 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74e0004870 msgr2=0x7f74f01e31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:38.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.438+0000 7f74f6fd9700 1 --2- 172.21.15.39:0/3147707356 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74e0004870 0x7f74f01e31b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f74e400eb20 tx=0x7f74e400ee30 comp rx=0 tx=0).stop 2023-11-28T11:56:38.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.438+0000 7f74f6fd9700 1 -- 172.21.15.39:0/3147707356 shutdown_connections 2023-11-28T11:56:38.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.438+0000 7f74f6fd9700 1 --2- 172.21.15.39:0/3147707356 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f74d4064ee0 0x7f74d4067390 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f74dc0090b0 tx=0x7f74dc01e040 comp rx=0 tx=0).stop 2023-11-28T11:56:38.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.438+0000 7f74f6fd9700 1 --2- 172.21.15.39:0/3147707356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74f0144800 0x7f74f01dfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:38.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.438+0000 7f74f6fd9700 1 --2- 172.21.15.39:0/3147707356 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74f01dcf90 0x7f74f0134190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:38.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.438+0000 7f74f6fd9700 1 --2- 172.21.15.39:0/3147707356 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74e0004870 0x7f74f01e31b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:38.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.438+0000 7f74f6fd9700 1 -- 172.21.15.39:0/3147707356 >> 172.21.15.39:0/3147707356 conn(0x7f74f00b5390 msgr2=0x7f74f01e0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:38.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.438+0000 7f74f6fd9700 1 -- 172.21.15.39:0/3147707356 shutdown_connections 2023-11-28T11:56:38.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.438+0000 7f74f6fd9700 1 -- 172.21.15.39:0/3147707356 wait complete. 2023-11-28T11:56:38.446 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_metadata' created 2023-11-28T11:56:38.464 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-11-28T11:56:38.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.666+0000 7fedd8850700 1 Processor -- start 2023-11-28T11:56:38.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.666+0000 7fedd8850700 1 -- start start 2023-11-28T11:56:38.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.666+0000 7fedd8850700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fedd415c7c0 0x7fedd406cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:38.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.670+0000 7fedd8850700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd40cdba0 con 0x7fedd4161030 2023-11-28T11:56:38.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.670+0000 7fedd8850700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd40cd8d0 con 0x7fedd40cddf0 2023-11-28T11:56:38.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.670+0000 7fedd8850700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedd406c010 con 0x7fedd415c7c0 2023-11-28T11:56:38.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.670+0000 7fedd259c700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fedd4161030 0x7fedd40cd1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60258/0 (socket says 172.21.15.39:60258) 2023-11-28T11:56:38.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.670+0000 7fedd259c700 1 -- 172.21.15.39:0/926174149 learned_addr learned my addr 172.21.15.39:0/926174149 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:56:38.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.670+0000 7fedd2d9d700 1 --2- 172.21.15.39:0/926174149 >> v2:172.21.15.39:3300/0 conn(0x7fedd415c7c0 0x7fedd406cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:38.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.670+0000 7fedd1d9b700 1 -- 172.21.15.39:0/926174149 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 822709526 0 0) 0x7fedd40cdba0 con 0x7fedd4161030 2023-11-28T11:56:38.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.670+0000 7fedd1d9b700 1 -- 172.21.15.39:0/926174149 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedbc0035d0 con 0x7fedd4161030 2023-11-28T11:56:38.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.670+0000 7fedd2d9d700 1 -- 172.21.15.39:0/926174149 >> v1:172.21.15.184:6789/0 conn(0x7fedd40cddf0 legacy=0x7fedd40ce1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:38.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.670+0000 7fedd1d9b700 1 -- 172.21.15.39:0/926174149 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3454231744 0 0) 0x7fedd40cd8d0 con 0x7fedd40cddf0 2023-11-28T11:56:38.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.670+0000 7fedd2d9d700 1 -- 172.21.15.39:0/926174149 >> v1:172.21.15.39:6789/0 conn(0x7fedd4161030 legacy=0x7fedd40cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:38.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.670+0000 7fedd2d9d700 1 -- 172.21.15.39:0/926174149 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd406c2f0 con 0x7fedd415c7c0 2023-11-28T11:56:38.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.670+0000 7fedd2d9d700 1 --2- 172.21.15.39:0/926174149 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fedd415c7c0 0x7fedd406cdd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fedc4009850 tx=0x7fedc4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=720e0b7d27f2065e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:38.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.670+0000 7fedd1d9b700 1 -- 172.21.15.39:0/926174149 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc4011830 con 0x7fedd415c7c0 2023-11-28T11:56:38.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.670+0000 7fedd1d9b700 1 -- 172.21.15.39:0/926174149 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc4011990 con 0x7fedd415c7c0 2023-11-28T11:56:38.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.670+0000 7fedd1d9b700 1 -- 172.21.15.39:0/926174149 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc4011d40 con 0x7fedd415c7c0 2023-11-28T11:56:38.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.670+0000 7fedd8850700 1 -- 172.21.15.39:0/926174149 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fedd415c7c0 msgr2=0x7fedd406cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:38.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.670+0000 7fedd8850700 1 --2- 172.21.15.39:0/926174149 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fedd415c7c0 0x7fedd406cdd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fedc4009850 tx=0x7fedc4009b60 comp rx=0 tx=0).stop 2023-11-28T11:56:38.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.670+0000 7fedd8850700 1 -- 172.21.15.39:0/926174149 shutdown_connections 2023-11-28T11:56:38.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.670+0000 7fedd8850700 1 --2- 172.21.15.39:0/926174149 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fedd415c7c0 0x7fedd406cdd0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:38.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.670+0000 7fedd8850700 1 -- 172.21.15.39:0/926174149 >> 172.21.15.39:0/926174149 conn(0x7fedd40d3800 msgr2=0x7fedd40cf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:38.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.670+0000 7fedd8850700 1 -- 172.21.15.39:0/926174149 shutdown_connections 2023-11-28T11:56:38.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.670+0000 7fedd8850700 1 -- 172.21.15.39:0/926174149 wait complete. 2023-11-28T11:56:38.680 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.678+0000 7fedd8850700 1 Processor -- start 2023-11-28T11:56:38.680 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.678+0000 7fedd8850700 1 -- start start 2023-11-28T11:56:38.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.678+0000 7fedd8850700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fedd40cddf0 0x7fedd41500c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:38.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.678+0000 7fedd8850700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fedd415c7c0 0x7fedd40c66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:38.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.678+0000 7fedd8850700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fedd40c6be0 0x7fedd415d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:38.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.678+0000 7fedd8850700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd40c7080 con 0x7fedd40cddf0 2023-11-28T11:56:38.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.678+0000 7fedd8850700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd415e9f0 con 0x7fedd40c6be0 2023-11-28T11:56:38.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.678+0000 7fedd8850700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd415dde0 con 0x7fedd415c7c0 2023-11-28T11:56:38.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.678+0000 7fedd2d9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fedd40cddf0 0x7fedd41500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:38.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.678+0000 7fedd2d9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fedd40cddf0 0x7fedd41500c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55428/0 (socket says 172.21.15.39:55428) 2023-11-28T11:56:38.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.678+0000 7fedd2d9d700 1 -- 172.21.15.39:0/1996678508 learned_addr learned my addr 172.21.15.39:0/1996678508 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:38.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.678+0000 7fedd259c700 1 --2- 172.21.15.39:0/1996678508 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fedd415c7c0 0x7fedd40c66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:38.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.678+0000 7fedd359e700 1 --2- 172.21.15.39:0/1996678508 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fedd40c6be0 0x7fedd415d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:38.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.678+0000 7fedd2d9d700 1 -- 172.21.15.39:0/1996678508 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fedd415c7c0 msgr2=0x7fedd40c66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:38.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.678+0000 7fedd2d9d700 1 --2- 172.21.15.39:0/1996678508 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fedd415c7c0 0x7fedd40c66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:38.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.678+0000 7fedd2d9d700 1 -- 172.21.15.39:0/1996678508 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fedd40c6be0 msgr2=0x7fedd415d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:38.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.678+0000 7fedd2d9d700 1 --2- 172.21.15.39:0/1996678508 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fedd40c6be0 0x7fedd415d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:38.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.678+0000 7fedd2d9d700 1 -- 172.21.15.39:0/1996678508 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc40094b0 con 0x7fedd40cddf0 2023-11-28T11:56:38.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.678+0000 7fedd2d9d700 1 --2- 172.21.15.39:0/1996678508 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fedd40cddf0 0x7fedd41500c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fedd406fdb0 tx=0x7fedc4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:38.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.682+0000 7fedbb7fe700 1 -- 172.21.15.39:0/1996678508 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc401ab70 con 0x7fedd40cddf0 2023-11-28T11:56:38.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.682+0000 7fedbb7fe700 1 -- 172.21.15.39:0/1996678508 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc401f070 con 0x7fedd40cddf0 2023-11-28T11:56:38.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.682+0000 7fedbb7fe700 1 -- 172.21.15.39:0/1996678508 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc401b430 con 0x7fedd40cddf0 2023-11-28T11:56:38.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.682+0000 7fedd8850700 1 -- 172.21.15.39:0/1996678508 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedd406c8b0 con 0x7fedd40cddf0 2023-11-28T11:56:38.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.682+0000 7fedd8850700 1 -- 172.21.15.39:0/1996678508 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedd406c5d0 con 0x7fedd40cddf0 2023-11-28T11:56:38.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.682+0000 7fedd8850700 1 -- 172.21.15.39:0/1996678508 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedd415cb90 con 0x7fedd40cddf0 2023-11-28T11:56:38.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.686+0000 7fedbb7fe700 1 -- 172.21.15.39:0/1996678508 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fedc400f050 con 0x7fedd40cddf0 2023-11-28T11:56:38.689 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.686+0000 7fedbb7fe700 1 --2- 172.21.15.39:0/1996678508 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fedc0064ee0 0x7fedc0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:38.689 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.686+0000 7fedbb7fe700 1 -- 172.21.15.39:0/1996678508 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fedc4082df0 con 0x7fedd40cddf0 2023-11-28T11:56:38.690 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.686+0000 7fedd259c700 1 --2- 172.21.15.39:0/1996678508 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fedc0064ee0 0x7fedc0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:38.691 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.686+0000 7fedd259c700 1 --2- 172.21.15.39:0/1996678508 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fedc0064ee0 0x7fedc0067390 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fedd41f52c0 tx=0x7fedc8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:38.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.694+0000 7fedbb7fe700 1 -- 172.21.15.39:0/1996678508 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fedc4051170 con 0x7fedd40cddf0 2023-11-28T11:56:38.880 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:38.878+0000 7fedd8850700 1 -- 172.21.15.39:0/1996678508 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fedd4073cb0 con 0x7fedd40cddf0 2023-11-28T11:56:39.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.434+0000 7fedbb7fe700 1 -- 172.21.15.39:0/1996678508 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v23) v1 ==== 171+0+0 (secure 0 0 0) 0x7fedc40150d0 con 0x7fedd40cddf0 2023-11-28T11:56:39.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.450+0000 7fedd8850700 1 -- 172.21.15.39:0/1996678508 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fedc0064ee0 msgr2=0x7fedc0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:39.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.450+0000 7fedd8850700 1 --2- 172.21.15.39:0/1996678508 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fedc0064ee0 0x7fedc0067390 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fedd41f52c0 tx=0x7fedc8009040 comp rx=0 tx=0).stop 2023-11-28T11:56:39.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.450+0000 7fedd8850700 1 -- 172.21.15.39:0/1996678508 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fedd40cddf0 msgr2=0x7fedd41500c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:39.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.450+0000 7fedd8850700 1 --2- 172.21.15.39:0/1996678508 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fedd40cddf0 0x7fedd41500c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fedd406fdb0 tx=0x7fedc4004770 comp rx=0 tx=0).stop 2023-11-28T11:56:39.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.450+0000 7fedd8850700 1 -- 172.21.15.39:0/1996678508 shutdown_connections 2023-11-28T11:56:39.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.450+0000 7fedd8850700 1 --2- 172.21.15.39:0/1996678508 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fedc0064ee0 0x7fedc0067390 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fedd41f52c0 tx=0x7fedc8009040 comp rx=0 tx=0).stop 2023-11-28T11:56:39.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.450+0000 7fedd8850700 1 --2- 172.21.15.39:0/1996678508 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fedd40c6be0 0x7fedd415d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:39.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.450+0000 7fedd8850700 1 --2- 172.21.15.39:0/1996678508 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fedd415c7c0 0x7fedd40c66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:39.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.450+0000 7fedd8850700 1 --2- 172.21.15.39:0/1996678508 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fedd40cddf0 0x7fedd41500c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:39.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.450+0000 7fedd8850700 1 -- 172.21.15.39:0/1996678508 >> 172.21.15.39:0/1996678508 conn(0x7fedd40d3800 msgr2=0x7fedd406aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:39.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.450+0000 7fedd8850700 1 -- 172.21.15.39:0/1996678508 shutdown_connections 2023-11-28T11:56:39.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.450+0000 7fedd8850700 1 -- 172.21.15.39:0/1996678508 wait complete. 2023-11-28T11:56:39.469 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_data' created 2023-11-28T11:56:39.489 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T11:56:39.660 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.654+0000 7f5a2ea76700 1 Processor -- start 2023-11-28T11:56:39.661 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.658+0000 7f5a2ea76700 1 -- start start 2023-11-28T11:56:39.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.658+0000 7f5a2ea76700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5a2815e190 0x7f5a280cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:39.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.658+0000 7f5a2ea76700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5a28161560 0x7f5a28069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:39.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.658+0000 7f5a2ea76700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a2806ff10 0x7f5a28070390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:39.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.658+0000 7f5a2ea76700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a280708d0 con 0x7f5a28161560 2023-11-28T11:56:39.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.658+0000 7f5a2ea76700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a2815e560 con 0x7f5a2815e190 2023-11-28T11:56:39.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.658+0000 7f5a2ea76700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2806be80 con 0x7f5a2806ff10 2023-11-28T11:56:39.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.658+0000 7f5a2d273700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5a28161560 0x7f5a28069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:39.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.658+0000 7f5a2d273700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5a28161560 0x7f5a28069bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55432/0 (socket says 172.21.15.39:55432) 2023-11-28T11:56:39.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.658+0000 7f5a2d273700 1 -- 172.21.15.39:0/2970497823 learned_addr learned my addr 172.21.15.39:0/2970497823 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:39.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.658+0000 7f5a2e275700 1 --2- 172.21.15.39:0/2970497823 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a2806ff10 0x7f5a28070390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:39.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.658+0000 7f5a2d273700 1 -- 172.21.15.39:0/2970497823 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a2806ff10 msgr2=0x7f5a28070390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:39.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.658+0000 7f5a2d273700 1 --2- 172.21.15.39:0/2970497823 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a2806ff10 0x7f5a28070390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:39.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.658+0000 7f5a2d273700 1 -- 172.21.15.39:0/2970497823 >> v2:172.21.15.184:3300/0 conn(0x7f5a2815e190 msgr2=0x7f5a280cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:39.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.658+0000 7f5a2d273700 1 --2- 172.21.15.39:0/2970497823 >> v2:172.21.15.184:3300/0 conn(0x7f5a2815e190 0x7f5a280cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:39.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.658+0000 7f5a2d273700 1 -- 172.21.15.39:0/2970497823 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a280ce330 con 0x7f5a28161560 2023-11-28T11:56:39.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.658+0000 7f5a2e275700 1 --2- 172.21.15.39:0/2970497823 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a2806ff10 0x7f5a28070390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:56:39.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.658+0000 7f5a2d273700 1 --2- 172.21.15.39:0/2970497823 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a28161560 0x7f5a28069bf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5a280cb9b0 tx=0x7f5a18009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69268b051e49b44 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:39.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.658+0000 7f5a2ca72700 1 -- 172.21.15.39:0/2970497823 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1800b8a0 con 0x7f5a28161560 2023-11-28T11:56:39.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.658+0000 7f5a2ca72700 1 -- 172.21.15.39:0/2970497823 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a1800ba00 con 0x7f5a28161560 2023-11-28T11:56:39.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.658+0000 7f5a2ca72700 1 -- 172.21.15.39:0/2970497823 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1800bd90 con 0x7f5a28161560 2023-11-28T11:56:39.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.658+0000 7f5a2ea76700 1 -- 172.21.15.39:0/2970497823 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a28161560 msgr2=0x7f5a28069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:39.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.662+0000 7f5a2ea76700 1 --2- 172.21.15.39:0/2970497823 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a28161560 0x7f5a28069bf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5a280cb9b0 tx=0x7f5a18009bf0 comp rx=0 tx=0).stop 2023-11-28T11:56:39.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.662+0000 7f5a2ea76700 1 -- 172.21.15.39:0/2970497823 shutdown_connections 2023-11-28T11:56:39.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.662+0000 7f5a2ea76700 1 --2- 172.21.15.39:0/2970497823 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a2806ff10 0x7f5a28070390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:39.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.662+0000 7f5a2ea76700 1 --2- 172.21.15.39:0/2970497823 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a28161560 0x7f5a28069bf0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:39.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.662+0000 7f5a2ea76700 1 --2- 172.21.15.39:0/2970497823 >> v2:172.21.15.184:3300/0 conn(0x7f5a2815e190 0x7f5a280cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:39.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.662+0000 7f5a2ea76700 1 -- 172.21.15.39:0/2970497823 >> 172.21.15.39:0/2970497823 conn(0x7f5a280cf280 msgr2=0x7f5a280cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:39.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.662+0000 7f5a2ea76700 1 -- 172.21.15.39:0/2970497823 shutdown_connections 2023-11-28T11:56:39.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.662+0000 7f5a2ea76700 1 -- 172.21.15.39:0/2970497823 wait complete. 2023-11-28T11:56:39.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.662+0000 7f5a2ea76700 1 Processor -- start 2023-11-28T11:56:39.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.662+0000 7f5a2ea76700 1 -- start start 2023-11-28T11:56:39.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.662+0000 7f5a2ea76700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a2806ff10 0x7f5a28156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:39.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.662+0000 7f5a2ea76700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a2815e190 0x7f5a28158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:39.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.662+0000 7f5a2ea76700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a28161560 0x7f5a2814d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:39.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.662+0000 7f5a2ea76700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2814dd60 con 0x7f5a2815e190 2023-11-28T11:56:39.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.662+0000 7f5a2ea76700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a28158d10 con 0x7f5a28161560 2023-11-28T11:56:39.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.662+0000 7f5a2ea76700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a28158ff0 con 0x7f5a2806ff10 2023-11-28T11:56:39.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.662+0000 7f5a2d273700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a2815e190 0x7f5a28158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:39.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.666+0000 7f5a2d273700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a2815e190 0x7f5a28158680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55440/0 (socket says 172.21.15.39:55440) 2023-11-28T11:56:39.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.666+0000 7f5a2d273700 1 -- 172.21.15.39:0/2874025750 learned_addr learned my addr 172.21.15.39:0/2874025750 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:39.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.666+0000 7f5a2da74700 1 --2- 172.21.15.39:0/2874025750 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a2806ff10 0x7f5a28156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:39.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.666+0000 7f5a2d273700 1 -- 172.21.15.39:0/2874025750 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a2806ff10 msgr2=0x7f5a28156fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:39.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.666+0000 7f5a2d273700 1 --2- 172.21.15.39:0/2874025750 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a2806ff10 0x7f5a28156fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:39.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.666+0000 7f5a2d273700 1 -- 172.21.15.39:0/2874025750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a28161560 msgr2=0x7f5a2814d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:39.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.666+0000 7f5a2d273700 1 --2- 172.21.15.39:0/2874025750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a28161560 0x7f5a2814d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:39.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.666+0000 7f5a2d273700 1 -- 172.21.15.39:0/2874025750 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a18009570 con 0x7f5a2815e190 2023-11-28T11:56:39.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.666+0000 7f5a2d273700 1 --2- 172.21.15.39:0/2874025750 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a2815e190 0x7f5a28158680 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5a18000c00 tx=0x7f5a18004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:39.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.666+0000 7f5a1e7fc700 1 -- 172.21.15.39:0/2874025750 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a18003ad0 con 0x7f5a2815e190 2023-11-28T11:56:39.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.666+0000 7f5a1e7fc700 1 -- 172.21.15.39:0/2874025750 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a1801e070 con 0x7f5a2815e190 2023-11-28T11:56:39.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.666+0000 7f5a2ea76700 1 -- 172.21.15.39:0/2874025750 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a280afc70 con 0x7f5a2815e190 2023-11-28T11:56:39.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.666+0000 7f5a1e7fc700 1 -- 172.21.15.39:0/2874025750 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a18003e90 con 0x7f5a2815e190 2023-11-28T11:56:39.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.666+0000 7f5a2ea76700 1 -- 172.21.15.39:0/2874025750 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a280af990 con 0x7f5a2815e190 2023-11-28T11:56:39.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.666+0000 7f5a2ea76700 1 -- 172.21.15.39:0/2874025750 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a280aff50 con 0x7f5a2815e190 2023-11-28T11:56:39.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.670+0000 7f5a1e7fc700 1 -- 172.21.15.39:0/2874025750 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5a1800f050 con 0x7f5a2815e190 2023-11-28T11:56:39.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.670+0000 7f5a1e7fc700 1 --2- 172.21.15.39:0/2874025750 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5a0c064f10 0x7f5a0c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:39.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.670+0000 7f5a1e7fc700 1 -- 172.21.15.39:0/2874025750 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f5a18020070 con 0x7f5a2815e190 2023-11-28T11:56:39.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.670+0000 7f5a2da74700 1 --2- 172.21.15.39:0/2874025750 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5a0c064f10 0x7f5a0c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:39.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.670+0000 7f5a2da74700 1 --2- 172.21.15.39:0/2874025750 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5a0c064f10 0x7f5a0c0673c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5a24006fd0 tx=0x7f5a24008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:39.680 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.678+0000 7f5a1e7fc700 1 -- 172.21.15.39:0/2874025750 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5a18051a40 con 0x7f5a2815e190 2023-11-28T11:56:39.893 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.890+0000 7f5a2ea76700 1 -- 172.21.15.39:0/2874025750 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5a28073d20 con 0x7f5a2815e190 2023-11-28T11:56:39.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.906+0000 7f5a1e7fc700 1 -- 172.21.15.39:0/2874025750 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f5a18055060 con 0x7f5a2815e190 2023-11-28T11:56:39.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.914+0000 7f5a2ea76700 1 -- 172.21.15.39:0/2874025750 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5a0c064f10 msgr2=0x7f5a0c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:39.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.914+0000 7f5a2ea76700 1 --2- 172.21.15.39:0/2874025750 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5a0c064f10 0x7f5a0c0673c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5a24006fd0 tx=0x7f5a24008040 comp rx=0 tx=0).stop 2023-11-28T11:56:39.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.914+0000 7f5a2ea76700 1 -- 172.21.15.39:0/2874025750 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a2815e190 msgr2=0x7f5a28158680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:39.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.914+0000 7f5a2ea76700 1 --2- 172.21.15.39:0/2874025750 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a2815e190 0x7f5a28158680 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5a18000c00 tx=0x7f5a18004770 comp rx=0 tx=0).stop 2023-11-28T11:56:39.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.914+0000 7f5a2ea76700 1 -- 172.21.15.39:0/2874025750 shutdown_connections 2023-11-28T11:56:39.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.914+0000 7f5a2ea76700 1 --2- 172.21.15.39:0/2874025750 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5a0c064f10 0x7f5a0c0673c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:39.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.914+0000 7f5a2ea76700 1 --2- 172.21.15.39:0/2874025750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a28161560 0x7f5a2814d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:39.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.914+0000 7f5a2ea76700 1 --2- 172.21.15.39:0/2874025750 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a2815e190 0x7f5a28158680 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:39.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.914+0000 7f5a2ea76700 1 --2- 172.21.15.39:0/2874025750 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a2806ff10 0x7f5a28156fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:39.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.914+0000 7f5a2ea76700 1 -- 172.21.15.39:0/2874025750 >> 172.21.15.39:0/2874025750 conn(0x7f5a280cf280 msgr2=0x7f5a280cdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:39.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.918+0000 7f5a2ea76700 1 -- 172.21.15.39:0/2874025750 shutdown_connections 2023-11-28T11:56:39.924 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:39.918+0000 7f5a2ea76700 1 -- 172.21.15.39:0/2874025750 wait complete. 2023-11-28T11:56:39.931 INFO:teuthology.orchestra.run.smithi039.stderr:new fs with metadata pool 3 and data pool 4 2023-11-28T11:56:39.956 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-11-28T11:56:39.956 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-11-28T11:56:40.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.130+0000 7f7dedec4700 1 Processor -- start 2023-11-28T11:56:40.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.130+0000 7f7dedec4700 1 -- start start 2023-11-28T11:56:40.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.130+0000 7f7dedec4700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7de815c6e0 0x7f7de8071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:40.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.130+0000 7f7dedec4700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7de806a510 0x7f7de806c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:40.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.130+0000 7f7dedec4700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de815cab0 con 0x7f7de8071fe0 2023-11-28T11:56:40.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.130+0000 7f7dedec4700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7de80d2800 con 0x7f7de806a510 2023-11-28T11:56:40.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.130+0000 7f7dedec4700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7de80702d0 con 0x7f7de815c6e0 2023-11-28T11:56:40.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.134+0000 7f7ded6c3700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7de806a510 0x7f7de806c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:40.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.134+0000 7f7decec2700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7de815c6e0 0x7f7de8071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:40.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.134+0000 7f7ded6c3700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7de806a510 0x7f7de806c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55454/0 (socket says 172.21.15.39:55454) 2023-11-28T11:56:40.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.134+0000 7f7ded6c3700 1 -- 172.21.15.39:0/1405451580 learned_addr learned my addr 172.21.15.39:0/1405451580 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:40.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.134+0000 7f7de7fff700 1 --1- 172.21.15.39:0/1405451580 >> v1:172.21.15.184:6789/0 conn(0x7f7de8071fe0 0x7f7de8069e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:38542/0 (socket says 172.21.15.39:38542) 2023-11-28T11:56:40.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.134+0000 7f7decec2700 1 -- 172.21.15.39:0/1405451580 >> v2:172.21.15.39:3300/0 conn(0x7f7de806a510 msgr2=0x7f7de806c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:40.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.134+0000 7f7decec2700 1 --2- 172.21.15.39:0/1405451580 >> v2:172.21.15.39:3300/0 conn(0x7f7de806a510 0x7f7de806c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:40.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.134+0000 7f7de77fe700 1 -- 172.21.15.39:0/1405451580 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4080360316 0 0) 0x7f7de815cab0 con 0x7f7de8071fe0 2023-11-28T11:56:40.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.134+0000 7f7decec2700 1 -- 172.21.15.39:0/1405451580 >> v1:172.21.15.184:6789/0 conn(0x7f7de8071fe0 legacy=0x7f7de8069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:40.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.134+0000 7f7decec2700 1 -- 172.21.15.39:0/1405451580 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de80d2a10 con 0x7f7de815c6e0 2023-11-28T11:56:40.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.134+0000 7f7decec2700 1 --2- 172.21.15.39:0/1405451580 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7de815c6e0 0x7f7de8071aa0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7de806e290 tx=0x7f7ddc009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4969b4cdd014bdcd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:40.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.134+0000 7f7de77fe700 1 -- 172.21.15.39:0/1405451580 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc011830 con 0x7f7de815c6e0 2023-11-28T11:56:40.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.134+0000 7f7de77fe700 1 -- 172.21.15.39:0/1405451580 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ddc011990 con 0x7f7de815c6e0 2023-11-28T11:56:40.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.134+0000 7f7de77fe700 1 -- 172.21.15.39:0/1405451580 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc011d20 con 0x7f7de815c6e0 2023-11-28T11:56:40.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.134+0000 7f7dedec4700 1 -- 172.21.15.39:0/1405451580 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7de815c6e0 msgr2=0x7f7de8071aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:40.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.134+0000 7f7dedec4700 1 --2- 172.21.15.39:0/1405451580 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7de815c6e0 0x7f7de8071aa0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7de806e290 tx=0x7f7ddc009b30 comp rx=0 tx=0).stop 2023-11-28T11:56:40.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.134+0000 7f7dedec4700 1 -- 172.21.15.39:0/1405451580 shutdown_connections 2023-11-28T11:56:40.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.134+0000 7f7dedec4700 1 --2- 172.21.15.39:0/1405451580 >> v2:172.21.15.39:3300/0 conn(0x7f7de806a510 0x7f7de806c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:40.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.134+0000 7f7dedec4700 1 --2- 172.21.15.39:0/1405451580 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7de815c6e0 0x7f7de8071aa0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:40.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.134+0000 7f7dedec4700 1 -- 172.21.15.39:0/1405451580 >> 172.21.15.39:0/1405451580 conn(0x7f7de80b65b0 msgr2=0x7f7de8071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:40.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.134+0000 7f7dedec4700 1 -- 172.21.15.39:0/1405451580 shutdown_connections 2023-11-28T11:56:40.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.138+0000 7f7dedec4700 1 -- 172.21.15.39:0/1405451580 wait complete. 2023-11-28T11:56:40.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.138+0000 7f7dedec4700 1 Processor -- start 2023-11-28T11:56:40.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.138+0000 7f7dedec4700 1 -- start start 2023-11-28T11:56:40.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.142+0000 7f7dedec4700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7de806a510 0x7f7de80cfd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:40.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.142+0000 7f7dedec4700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7de8071fe0 0x7f7de81f0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:40.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.142+0000 7f7dedec4700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7de815c6e0 0x7f7de80cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:40.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.142+0000 7f7dedec4700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de81f1ee0 con 0x7f7de806a510 2023-11-28T11:56:40.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.142+0000 7f7dedec4700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de81f2d60 con 0x7f7de815c6e0 2023-11-28T11:56:40.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.142+0000 7f7dedec4700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de80ce8b0 con 0x7f7de8071fe0 2023-11-28T11:56:40.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.142+0000 7f7decec2700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7de806a510 0x7f7de80cfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:40.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.142+0000 7f7decec2700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7de806a510 0x7f7de80cfd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55458/0 (socket says 172.21.15.39:55458) 2023-11-28T11:56:40.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.142+0000 7f7decec2700 1 -- 172.21.15.39:0/241697853 learned_addr learned my addr 172.21.15.39:0/241697853 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:40.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.142+0000 7f7de7fff700 1 --2- 172.21.15.39:0/241697853 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7de8071fe0 0x7f7de81f0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:40.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.142+0000 7f7ded6c3700 1 --2- 172.21.15.39:0/241697853 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7de815c6e0 0x7f7de80cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:40.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.142+0000 7f7decec2700 1 -- 172.21.15.39:0/241697853 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7de8071fe0 msgr2=0x7f7de81f0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:40.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.142+0000 7f7decec2700 1 --2- 172.21.15.39:0/241697853 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7de8071fe0 0x7f7de81f0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:40.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.142+0000 7f7decec2700 1 -- 172.21.15.39:0/241697853 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7de815c6e0 msgr2=0x7f7de80cd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:40.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.142+0000 7f7decec2700 1 --2- 172.21.15.39:0/241697853 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7de815c6e0 0x7f7de80cd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:40.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.142+0000 7f7decec2700 1 -- 172.21.15.39:0/241697853 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ddc0094b0 con 0x7f7de806a510 2023-11-28T11:56:40.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.142+0000 7f7decec2700 1 --2- 172.21.15.39:0/241697853 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7de806a510 0x7f7de80cfd10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7de80d2940 tx=0x7f7ddc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:40.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.146+0000 7f7de57fa700 1 -- 172.21.15.39:0/241697853 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc004400 con 0x7f7de806a510 2023-11-28T11:56:40.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.146+0000 7f7de57fa700 1 -- 172.21.15.39:0/241697853 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ddc01f070 con 0x7f7de806a510 2023-11-28T11:56:40.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.146+0000 7f7dedec4700 1 -- 172.21.15.39:0/241697853 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de80d2fd0 con 0x7f7de806a510 2023-11-28T11:56:40.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.146+0000 7f7de57fa700 1 -- 172.21.15.39:0/241697853 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc0036c0 con 0x7f7de806a510 2023-11-28T11:56:40.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.146+0000 7f7dedec4700 1 -- 172.21.15.39:0/241697853 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de80d2cf0 con 0x7f7de806a510 2023-11-28T11:56:40.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.146+0000 7f7dedec4700 1 -- 172.21.15.39:0/241697853 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de80d32b0 con 0x7f7de806a510 2023-11-28T11:56:40.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.150+0000 7f7de57fa700 1 -- 172.21.15.39:0/241697853 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7ddc02a020 con 0x7f7de806a510 2023-11-28T11:56:40.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.150+0000 7f7de57fa700 1 --2- 172.21.15.39:0/241697853 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7dcc064ee0 0x7f7dcc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:40.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.150+0000 7f7de57fa700 1 -- 172.21.15.39:0/241697853 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7ddc0834a0 con 0x7f7de806a510 2023-11-28T11:56:40.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.150+0000 7f7de7fff700 1 --2- 172.21.15.39:0/241697853 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7dcc064ee0 0x7f7dcc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:40.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.150+0000 7f7de7fff700 1 --2- 172.21.15.39:0/241697853 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7dcc064ee0 0x7f7dcc067390 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7de815b470 tx=0x7f7dd4007e00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:40.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.158+0000 7f7de57fa700 1 -- 172.21.15.39:0/241697853 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7ddc0514d0 con 0x7f7de806a510 2023-11-28T11:56:40.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.338+0000 7f7dedec4700 1 -- 172.21.15.39:0/241697853 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f7de8073cb0 con 0x7f7de806a510 2023-11-28T11:56:40.924 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.918+0000 7f7de57fa700 1 -- 172.21.15.39:0/241697853 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v25) v1 ==== 157+0+0 (secure 0 0 0) 0x7f7ddc054af0 con 0x7f7de806a510 2023-11-28T11:56:40.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.922+0000 7f7dedec4700 1 -- 172.21.15.39:0/241697853 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7dcc064ee0 msgr2=0x7f7dcc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:40.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.922+0000 7f7dedec4700 1 --2- 172.21.15.39:0/241697853 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7dcc064ee0 0x7f7dcc067390 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7de815b470 tx=0x7f7dd4007e00 comp rx=0 tx=0).stop 2023-11-28T11:56:40.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.922+0000 7f7dedec4700 1 -- 172.21.15.39:0/241697853 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7de806a510 msgr2=0x7f7de80cfd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:40.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.922+0000 7f7dedec4700 1 --2- 172.21.15.39:0/241697853 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7de806a510 0x7f7de80cfd10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7de80d2940 tx=0x7f7ddc004770 comp rx=0 tx=0).stop 2023-11-28T11:56:40.929 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.926+0000 7f7dedec4700 1 -- 172.21.15.39:0/241697853 shutdown_connections 2023-11-28T11:56:40.929 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.926+0000 7f7dedec4700 1 --2- 172.21.15.39:0/241697853 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7dcc064ee0 0x7f7dcc067390 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:40.929 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.926+0000 7f7dedec4700 1 --2- 172.21.15.39:0/241697853 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7de815c6e0 0x7f7de80cd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:40.929 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.926+0000 7f7dedec4700 1 --2- 172.21.15.39:0/241697853 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7de8071fe0 0x7f7de81f0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:40.929 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.926+0000 7f7dedec4700 1 --2- 172.21.15.39:0/241697853 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7de806a510 0x7f7de80cfd10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:40.929 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.926+0000 7f7dedec4700 1 -- 172.21.15.39:0/241697853 >> 172.21.15.39:0/241697853 conn(0x7f7de80b65b0 msgr2=0x7f7de806cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:40.929 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.926+0000 7f7dedec4700 1 -- 172.21.15.39:0/241697853 shutdown_connections 2023-11-28T11:56:40.929 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:40.926+0000 7f7dedec4700 1 -- 172.21.15.39:0/241697853 wait complete. 2023-11-28T11:56:40.950 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T11:56:41.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.142+0000 7f18a9b41700 1 Processor -- start 2023-11-28T11:56:41.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.142+0000 7f18a9b41700 1 -- start start 2023-11-28T11:56:41.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.142+0000 7f18a9b41700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f18a406b0d0 0x7f18a415c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:41.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.142+0000 7f18a9b41700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f18a40c7b60 0x7f18a40c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:41.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.142+0000 7f18a9b41700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a4069d20 con 0x7f18a4156a20 2023-11-28T11:56:41.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.142+0000 7f18a9b41700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18a40c8520 con 0x7f18a40c7b60 2023-11-28T11:56:41.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.142+0000 7f18a9b41700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a406b540 con 0x7f18a406b0d0 2023-11-28T11:56:41.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.142+0000 7f18a8b3f700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f18a4156a20 0x7f18a406c050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60270/0 (socket says 172.21.15.39:60270) 2023-11-28T11:56:41.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.142+0000 7f18a8b3f700 1 -- 172.21.15.39:0/1243843629 learned_addr learned my addr 172.21.15.39:0/1243843629 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:56:41.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.142+0000 7f18a3fff700 1 --2- 172.21.15.39:0/1243843629 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f18a406b0d0 0x7f18a415c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:41.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.142+0000 7f18a9340700 1 --2- 172.21.15.39:0/1243843629 >> v2:172.21.15.184:3300/0 conn(0x7f18a40c7b60 0x7f18a40c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:41.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.142+0000 7f18a3fff700 1 -- 172.21.15.39:0/1243843629 >> v2:172.21.15.184:3300/0 conn(0x7f18a40c7b60 msgr2=0x7f18a40c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:41.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.142+0000 7f18a3fff700 1 --2- 172.21.15.39:0/1243843629 >> v2:172.21.15.184:3300/0 conn(0x7f18a40c7b60 0x7f18a40c7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:41.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.142+0000 7f18a3fff700 1 -- 172.21.15.39:0/1243843629 >> v1:172.21.15.39:6789/0 conn(0x7f18a4156a20 legacy=0x7f18a406c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:41.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.142+0000 7f18a37fe700 1 -- 172.21.15.39:0/1243843629 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1527762905 0 0) 0x7f18a4069d20 con 0x7f18a4156a20 2023-11-28T11:56:41.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.142+0000 7f18a3fff700 1 -- 172.21.15.39:0/1243843629 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a415ce10 con 0x7f18a406b0d0 2023-11-28T11:56:41.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.146+0000 7f18a3fff700 1 --2- 172.21.15.39:0/1243843629 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f18a406b0d0 0x7f18a415c730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1890009850 tx=0x7f1890009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d05461fb66a1bad server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:41.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.146+0000 7f18a37fe700 1 -- 172.21.15.39:0/1243843629 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1890011830 con 0x7f18a406b0d0 2023-11-28T11:56:41.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.146+0000 7f18a37fe700 1 -- 172.21.15.39:0/1243843629 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1890011990 con 0x7f18a406b0d0 2023-11-28T11:56:41.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.146+0000 7f18a37fe700 1 -- 172.21.15.39:0/1243843629 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1890011d40 con 0x7f18a406b0d0 2023-11-28T11:56:41.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.146+0000 7f18a9b41700 1 -- 172.21.15.39:0/1243843629 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f18a406b0d0 msgr2=0x7f18a415c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:41.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.146+0000 7f18a9b41700 1 --2- 172.21.15.39:0/1243843629 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f18a406b0d0 0x7f18a415c730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1890009850 tx=0x7f1890009b60 comp rx=0 tx=0).stop 2023-11-28T11:56:41.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.146+0000 7f18a9b41700 1 -- 172.21.15.39:0/1243843629 shutdown_connections 2023-11-28T11:56:41.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.146+0000 7f18a9b41700 1 --2- 172.21.15.39:0/1243843629 >> v2:172.21.15.184:3300/0 conn(0x7f18a40c7b60 0x7f18a40c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:41.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.146+0000 7f18a9b41700 1 --2- 172.21.15.39:0/1243843629 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f18a406b0d0 0x7f18a415c730 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:41.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.146+0000 7f18a9b41700 1 -- 172.21.15.39:0/1243843629 >> 172.21.15.39:0/1243843629 conn(0x7f18a40cb2b0 msgr2=0x7f18a40cb680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:41.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.146+0000 7f18a9b41700 1 -- 172.21.15.39:0/1243843629 shutdown_connections 2023-11-28T11:56:41.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.146+0000 7f18a9b41700 1 -- 172.21.15.39:0/1243843629 wait complete. 2023-11-28T11:56:41.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.150+0000 7f18a9b41700 1 Processor -- start 2023-11-28T11:56:41.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.150+0000 7f18a9b41700 1 -- start start 2023-11-28T11:56:41.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.150+0000 7f18a9b41700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18a406b0d0 0x7f18a40affa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:41.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.150+0000 7f18a9b41700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f18a40c7b60 0x7f18a40b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:41.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.150+0000 7f18a9b41700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18a4156a20 0x7f18a40b0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:41.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.150+0000 7f18a9b41700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a40aefb0 con 0x7f18a406b0d0 2023-11-28T11:56:41.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.150+0000 7f18a9b41700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a4147b90 con 0x7f18a4156a20 2023-11-28T11:56:41.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.150+0000 7f18a9b41700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a41597f0 con 0x7f18a40c7b60 2023-11-28T11:56:41.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.154+0000 7f18a8b3f700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18a406b0d0 0x7f18a40affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:41.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.154+0000 7f18a8b3f700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18a406b0d0 0x7f18a40affa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55466/0 (socket says 172.21.15.39:55466) 2023-11-28T11:56:41.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.154+0000 7f18a8b3f700 1 -- 172.21.15.39:0/3734744290 learned_addr learned my addr 172.21.15.39:0/3734744290 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:41.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.154+0000 7f18a9340700 1 --2- 172.21.15.39:0/3734744290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18a4156a20 0x7f18a40b0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:41.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.154+0000 7f18a3fff700 1 --2- 172.21.15.39:0/3734744290 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f18a40c7b60 0x7f18a40b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:41.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.154+0000 7f18a8b3f700 1 -- 172.21.15.39:0/3734744290 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f18a40c7b60 msgr2=0x7f18a40b04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:41.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.154+0000 7f18a8b3f700 1 --2- 172.21.15.39:0/3734744290 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f18a40c7b60 0x7f18a40b04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:41.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.154+0000 7f18a8b3f700 1 -- 172.21.15.39:0/3734744290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18a4156a20 msgr2=0x7f18a40b0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:41.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.154+0000 7f18a8b3f700 1 --2- 172.21.15.39:0/3734744290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18a4156a20 0x7f18a40b0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:41.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.154+0000 7f18a8b3f700 1 -- 172.21.15.39:0/3734744290 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18900094b0 con 0x7f18a406b0d0 2023-11-28T11:56:41.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.154+0000 7f18a8b3f700 1 --2- 172.21.15.39:0/3734744290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18a406b0d0 0x7f18a40affa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f189800c4e0 tx=0x7f189800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:41.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.154+0000 7f18a17fa700 1 -- 172.21.15.39:0/3734744290 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1898004ca0 con 0x7f18a406b0d0 2023-11-28T11:56:41.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.154+0000 7f18a17fa700 1 -- 172.21.15.39:0/3734744290 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1898004e20 con 0x7f18a406b0d0 2023-11-28T11:56:41.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.154+0000 7f18a17fa700 1 -- 172.21.15.39:0/3734744290 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1898007310 con 0x7f18a406b0d0 2023-11-28T11:56:41.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.154+0000 7f18a9b41700 1 -- 172.21.15.39:0/3734744290 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a415d3d0 con 0x7f18a406b0d0 2023-11-28T11:56:41.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.154+0000 7f18a9b41700 1 -- 172.21.15.39:0/3734744290 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a415d0f0 con 0x7f18a406b0d0 2023-11-28T11:56:41.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.158+0000 7f18a9b41700 1 -- 172.21.15.39:0/3734744290 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18a415d6b0 con 0x7f18a406b0d0 2023-11-28T11:56:41.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.158+0000 7f18a17fa700 1 -- 172.21.15.39:0/3734744290 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f189801a020 con 0x7f18a406b0d0 2023-11-28T11:56:41.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.158+0000 7f18a17fa700 1 --2- 172.21.15.39:0/3734744290 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1888064ee0 0x7f1888067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:41.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.158+0000 7f18a17fa700 1 -- 172.21.15.39:0/3734744290 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6288+0+0 (secure 0 0 0) 0x7f1898081b90 con 0x7f18a406b0d0 2023-11-28T11:56:41.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.158+0000 7f18a3fff700 1 --2- 172.21.15.39:0/3734744290 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1888064ee0 0x7f1888067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:41.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.162+0000 7f18a3fff700 1 --2- 172.21.15.39:0/3734744290 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1888064ee0 0x7f1888067390 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f18900090b0 tx=0x7f1890008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:41.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.166+0000 7f18a17fa700 1 -- 172.21.15.39:0/3734744290 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f189804faa0 con 0x7f18a406b0d0 2023-11-28T11:56:41.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:41.338+0000 7f18a9b41700 1 -- 172.21.15.39:0/3734744290 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f18a4073d20 con 0x7f18a406b0d0 2023-11-28T11:56:42.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:42.934+0000 7f18a17fa700 1 -- 172.21.15.39:0/3734744290 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v27) v1 ==== 228+0+0 (secure 0 0 0) 0x7f18980530c0 con 0x7f18a406b0d0 2023-11-28T11:56:42.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:42.938+0000 7f18a9b41700 1 -- 172.21.15.39:0/3734744290 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1888064ee0 msgr2=0x7f1888067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:42.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:42.938+0000 7f18a9b41700 1 --2- 172.21.15.39:0/3734744290 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1888064ee0 0x7f1888067390 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f18900090b0 tx=0x7f1890008030 comp rx=0 tx=0).stop 2023-11-28T11:56:42.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:42.938+0000 7f18a9b41700 1 -- 172.21.15.39:0/3734744290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18a406b0d0 msgr2=0x7f18a40affa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:42.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:42.938+0000 7f18a9b41700 1 --2- 172.21.15.39:0/3734744290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18a406b0d0 0x7f18a40affa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f189800c4e0 tx=0x7f189800c7f0 comp rx=0 tx=0).stop 2023-11-28T11:56:42.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:42.942+0000 7f18a9b41700 1 -- 172.21.15.39:0/3734744290 shutdown_connections 2023-11-28T11:56:42.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:42.942+0000 7f18a9b41700 1 --2- 172.21.15.39:0/3734744290 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1888064ee0 0x7f1888067390 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:42.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:42.942+0000 7f18a9b41700 1 --2- 172.21.15.39:0/3734744290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18a4156a20 0x7f18a40b0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:42.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:42.942+0000 7f18a9b41700 1 --2- 172.21.15.39:0/3734744290 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f18a40c7b60 0x7f18a40b04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:42.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:42.942+0000 7f18a9b41700 1 --2- 172.21.15.39:0/3734744290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18a406b0d0 0x7f18a40affa0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:42.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:42.942+0000 7f18a9b41700 1 -- 172.21.15.39:0/3734744290 >> 172.21.15.39:0/3734744290 conn(0x7f18a40cb2b0 msgr2=0x7f18a40cd890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:42.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:42.942+0000 7f18a9b41700 1 -- 172.21.15.39:0/3734744290 shutdown_connections 2023-11-28T11:56:42.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:42.942+0000 7f18a9b41700 1 -- 172.21.15.39:0/3734744290 wait complete. 2023-11-28T11:56:42.951 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_data_ec' created 2023-11-28T11:56:42.972 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-11-28T11:56:43.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.154+0000 7f595b1c3700 1 Processor -- start 2023-11-28T11:56:43.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.154+0000 7f595b1c3700 1 -- start start 2023-11-28T11:56:43.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.158+0000 7f595b1c3700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f595415c6e0 0x7f5954071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:43.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.158+0000 7f595b1c3700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f595406a510 0x7f595406c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:43.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.158+0000 7f595b1c3700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f595415cab0 con 0x7f5954071fe0 2023-11-28T11:56:43.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.158+0000 7f595b1c3700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59540d2800 con 0x7f595406a510 2023-11-28T11:56:43.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.158+0000 7f595b1c3700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59540702d0 con 0x7f595415c6e0 2023-11-28T11:56:43.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.158+0000 7f595a1c1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f595415c6e0 0x7f5954071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:43.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.158+0000 7f595a1c1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f595415c6e0 0x7f5954071aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:59392/0 (socket says 172.21.15.39:59392) 2023-11-28T11:56:43.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.158+0000 7f595a9c2700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f595406a510 0x7f595406c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:43.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.158+0000 7f595a1c1700 1 -- 172.21.15.39:0/3224564438 learned_addr learned my addr 172.21.15.39:0/3224564438 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:43.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.162+0000 7f595a1c1700 1 -- 172.21.15.39:0/3224564438 >> v2:172.21.15.184:3300/0 conn(0x7f595406a510 msgr2=0x7f595406c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:43.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.162+0000 7f595a1c1700 1 --2- 172.21.15.39:0/3224564438 >> v2:172.21.15.184:3300/0 conn(0x7f595406a510 0x7f595406c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.162+0000 7f595a1c1700 1 -- 172.21.15.39:0/3224564438 >> v1:172.21.15.184:6789/0 conn(0x7f5954071fe0 legacy=0x7f5954069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:43.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.162+0000 7f595a1c1700 1 -- 172.21.15.39:0/3224564438 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59540d2a10 con 0x7f595415c6e0 2023-11-28T11:56:43.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.162+0000 7f595a1c1700 1 --2- 172.21.15.39:0/3224564438 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f595415c6e0 0x7f5954071aa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5950009910 tx=0x7f5950009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f81a1f2995830f1f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:43.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.162+0000 7f59591bf700 1 -- 172.21.15.39:0/3224564438 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5950011830 con 0x7f595415c6e0 2023-11-28T11:56:43.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.162+0000 7f59591bf700 1 -- 172.21.15.39:0/3224564438 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5950011990 con 0x7f595415c6e0 2023-11-28T11:56:43.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.162+0000 7f59591bf700 1 -- 172.21.15.39:0/3224564438 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5950011d40 con 0x7f595415c6e0 2023-11-28T11:56:43.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.162+0000 7f595b1c3700 1 -- 172.21.15.39:0/3224564438 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f595415c6e0 msgr2=0x7f5954071aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:43.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.162+0000 7f595b1c3700 1 --2- 172.21.15.39:0/3224564438 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f595415c6e0 0x7f5954071aa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5950009910 tx=0x7f5950009c20 comp rx=0 tx=0).stop 2023-11-28T11:56:43.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.162+0000 7f595b1c3700 1 -- 172.21.15.39:0/3224564438 shutdown_connections 2023-11-28T11:56:43.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.162+0000 7f595b1c3700 1 --2- 172.21.15.39:0/3224564438 >> v2:172.21.15.184:3300/0 conn(0x7f595406a510 0x7f595406c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.162+0000 7f595b1c3700 1 --2- 172.21.15.39:0/3224564438 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f595415c6e0 0x7f5954071aa0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.162+0000 7f595b1c3700 1 -- 172.21.15.39:0/3224564438 >> 172.21.15.39:0/3224564438 conn(0x7f59540b65b0 msgr2=0x7f5954071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:43.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.162+0000 7f595b1c3700 1 -- 172.21.15.39:0/3224564438 shutdown_connections 2023-11-28T11:56:43.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.162+0000 7f595b1c3700 1 -- 172.21.15.39:0/3224564438 wait complete. 2023-11-28T11:56:43.170 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.166+0000 7f595b1c3700 1 Processor -- start 2023-11-28T11:56:43.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.166+0000 7f595b1c3700 1 -- start start 2023-11-28T11:56:43.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.170+0000 7f595b1c3700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f595406a510 0x7f595409bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:43.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.170+0000 7f595b1c3700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5954071fe0 0x7f59540cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:43.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.170+0000 7f595b1c3700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f595415c6e0 0x7f59540b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:43.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.170+0000 7f595b1c3700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59540afec0 con 0x7f5954071fe0 2023-11-28T11:56:43.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.170+0000 7f595b1c3700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59540af5f0 con 0x7f595415c6e0 2023-11-28T11:56:43.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.170+0000 7f595b1c3700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59540cfa10 con 0x7f595406a510 2023-11-28T11:56:43.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.170+0000 7f59599c0700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5954071fe0 0x7f59540cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:43.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.170+0000 7f59599c0700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5954071fe0 0x7f59540cf4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55472/0 (socket says 172.21.15.39:55472) 2023-11-28T11:56:43.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.170+0000 7f59599c0700 1 -- 172.21.15.39:0/1722234000 learned_addr learned my addr 172.21.15.39:0/1722234000 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:43.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.170+0000 7f595a9c2700 1 --2- 172.21.15.39:0/1722234000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f595415c6e0 0x7f59540b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:43.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.170+0000 7f595a1c1700 1 --2- 172.21.15.39:0/1722234000 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f595406a510 0x7f595409bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:43.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.170+0000 7f595a1c1700 1 -- 172.21.15.39:0/1722234000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f595415c6e0 msgr2=0x7f59540b02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:43.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.170+0000 7f595a1c1700 1 --2- 172.21.15.39:0/1722234000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f595415c6e0 0x7f59540b02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.176 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.170+0000 7f595a1c1700 1 -- 172.21.15.39:0/1722234000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5954071fe0 msgr2=0x7f59540cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:43.176 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.170+0000 7f595a1c1700 1 --2- 172.21.15.39:0/1722234000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5954071fe0 0x7f59540cf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.176 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.170+0000 7f595a1c1700 1 -- 172.21.15.39:0/1722234000 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5950009570 con 0x7f595406a510 2023-11-28T11:56:43.176 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.170+0000 7f595a9c2700 1 --2- 172.21.15.39:0/1722234000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f595415c6e0 0x7f59540b02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:43.176 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.170+0000 7f59599c0700 1 --2- 172.21.15.39:0/1722234000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5954071fe0 0x7f59540cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:43.176 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.170+0000 7f595a1c1700 1 --2- 172.21.15.39:0/1722234000 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f595406a510 0x7f595409bdb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5950016000 tx=0x7f5950004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:43.177 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.170+0000 7f594affd700 1 -- 172.21.15.39:0/1722234000 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5950004510 con 0x7f595406a510 2023-11-28T11:56:43.177 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.170+0000 7f594affd700 1 -- 172.21.15.39:0/1722234000 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595001e070 con 0x7f595406a510 2023-11-28T11:56:43.177 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.170+0000 7f595b1c3700 1 -- 172.21.15.39:0/1722234000 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59540d2fd0 con 0x7f595406a510 2023-11-28T11:56:43.177 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.170+0000 7f594affd700 1 -- 172.21.15.39:0/1722234000 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59500038e0 con 0x7f595406a510 2023-11-28T11:56:43.177 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.170+0000 7f595b1c3700 1 -- 172.21.15.39:0/1722234000 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59540d2cf0 con 0x7f595406a510 2023-11-28T11:56:43.177 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.174+0000 7f595b1c3700 1 -- 172.21.15.39:0/1722234000 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59540d32b0 con 0x7f595406a510 2023-11-28T11:56:43.180 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.174+0000 7f594affd700 1 -- 172.21.15.39:0/1722234000 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5950006d70 con 0x7f595406a510 2023-11-28T11:56:43.181 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.178+0000 7f594affd700 1 --2- 172.21.15.39:0/1722234000 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5938064f10 0x7f59380673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:43.181 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.178+0000 7f594affd700 1 -- 172.21.15.39:0/1722234000 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f59500834e0 con 0x7f595406a510 2023-11-28T11:56:43.182 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.178+0000 7f59599c0700 1 --2- 172.21.15.39:0/1722234000 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5938064f10 0x7f59380673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:43.183 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.178+0000 7f59599c0700 1 --2- 172.21.15.39:0/1722234000 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5938064f10 0x7f59380673c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f59540cce20 tx=0x7f5944009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:43.188 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.186+0000 7f594affd700 1 -- 172.21.15.39:0/1722234000 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5950051340 con 0x7f595406a510 2023-11-28T11:56:43.359 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.354+0000 7f595b1c3700 1 -- 172.21.15.39:0/1722234000 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f5954073cb0 con 0x7f595406a510 2023-11-28T11:56:43.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.946+0000 7f594affd700 1 -- 172.21.15.39:0/1722234000 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v28) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5950054960 con 0x7f595406a510 2023-11-28T11:56:43.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.966+0000 7f595b1c3700 1 -- 172.21.15.39:0/1722234000 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5938064f10 msgr2=0x7f59380673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:43.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.966+0000 7f595b1c3700 1 --2- 172.21.15.39:0/1722234000 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5938064f10 0x7f59380673c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f59540cce20 tx=0x7f5944009040 comp rx=0 tx=0).stop 2023-11-28T11:56:43.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.966+0000 7f595b1c3700 1 -- 172.21.15.39:0/1722234000 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f595406a510 msgr2=0x7f595409bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:43.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.966+0000 7f595b1c3700 1 --2- 172.21.15.39:0/1722234000 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f595406a510 0x7f595409bdb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5950016000 tx=0x7f5950004770 comp rx=0 tx=0).stop 2023-11-28T11:56:43.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.966+0000 7f595b1c3700 1 -- 172.21.15.39:0/1722234000 shutdown_connections 2023-11-28T11:56:43.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.966+0000 7f595b1c3700 1 --2- 172.21.15.39:0/1722234000 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5938064f10 0x7f59380673c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.966+0000 7f595b1c3700 1 --2- 172.21.15.39:0/1722234000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f595415c6e0 0x7f59540b02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.966+0000 7f595b1c3700 1 --2- 172.21.15.39:0/1722234000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5954071fe0 0x7f59540cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.966+0000 7f595b1c3700 1 --2- 172.21.15.39:0/1722234000 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f595406a510 0x7f595409bdb0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.966+0000 7f595b1c3700 1 -- 172.21.15.39:0/1722234000 >> 172.21.15.39:0/1722234000 conn(0x7f59540b65b0 msgr2=0x7f5954071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:43.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.966+0000 7f595b1c3700 1 -- 172.21.15.39:0/1722234000 shutdown_connections 2023-11-28T11:56:43.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:43.966+0000 7f595b1c3700 1 -- 172.21.15.39:0/1722234000 wait complete. 2023-11-28T11:56:43.980 INFO:teuthology.orchestra.run.smithi039.stderr:set pool 5 allow_ec_overwrites to true 2023-11-28T11:56:44.000 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-11-28T11:56:44.190 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.186+0000 7f052b59e700 1 Processor -- start 2023-11-28T11:56:44.190 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.186+0000 7f052b59e700 1 -- start start 2023-11-28T11:56:44.193 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.190+0000 7f052b59e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f05240e29f0 0x7f0524055490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:44.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.190+0000 7f052b59e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f052403b330 0x7f0524057210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:44.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.190+0000 7f052b59e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0524007360 con 0x7f0524038560 2023-11-28T11:56:44.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.190+0000 7f052b59e700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05240e2dc0 con 0x7f05240e29f0 2023-11-28T11:56:44.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.190+0000 7f052b59e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0524053f70 con 0x7f052403b330 2023-11-28T11:56:44.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.190+0000 7f052a59c700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f05240e29f0 0x7f0524055490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:44.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.190+0000 7f052a59c700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f05240e29f0 0x7f0524055490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55484/0 (socket says 172.21.15.39:55484) 2023-11-28T11:56:44.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.190+0000 7f052a59c700 1 -- 172.21.15.39:0/1415429866 learned_addr learned my addr 172.21.15.39:0/1415429866 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:44.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.190+0000 7f052ad9d700 1 --2- 172.21.15.39:0/1415429866 >> v2:172.21.15.184:3300/0 conn(0x7f052403b330 0x7f0524057210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:44.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.190+0000 7f052ad9d700 1 -- 172.21.15.39:0/1415429866 >> v2:172.21.15.39:3300/0 conn(0x7f05240e29f0 msgr2=0x7f0524055490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:44.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.190+0000 7f052ad9d700 1 --2- 172.21.15.39:0/1415429866 >> v2:172.21.15.39:3300/0 conn(0x7f05240e29f0 0x7f0524055490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:44.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.190+0000 7f052ad9d700 1 -- 172.21.15.39:0/1415429866 >> v1:172.21.15.184:6789/0 conn(0x7f0524038560 legacy=0x7f052403ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:44.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.190+0000 7f052ad9d700 1 -- 172.21.15.39:0/1415429866 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0524006dc0 con 0x7f052403b330 2023-11-28T11:56:44.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.194+0000 7f052ad9d700 1 --2- 172.21.15.39:0/1415429866 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f052403b330 0x7f0524057210 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f052c066a20 tx=0x7f052c04e8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16d3533d3caee158 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:44.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.194+0000 7f052959a700 1 -- 172.21.15.39:0/1415429866 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c072c00 con 0x7f052403b330 2023-11-28T11:56:44.197 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.194+0000 7f052959a700 1 -- 172.21.15.39:0/1415429866 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052c072d80 con 0x7f052403b330 2023-11-28T11:56:44.197 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.194+0000 7f052959a700 1 -- 172.21.15.39:0/1415429866 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c066d80 con 0x7f052403b330 2023-11-28T11:56:44.197 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.194+0000 7f052b59e700 1 -- 172.21.15.39:0/1415429866 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f052403b330 msgr2=0x7f0524057210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:44.197 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.194+0000 7f052b59e700 1 --2- 172.21.15.39:0/1415429866 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f052403b330 0x7f0524057210 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f052c066a20 tx=0x7f052c04e8b0 comp rx=0 tx=0).stop 2023-11-28T11:56:44.198 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.194+0000 7f052b59e700 1 -- 172.21.15.39:0/1415429866 shutdown_connections 2023-11-28T11:56:44.198 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.194+0000 7f052b59e700 1 --2- 172.21.15.39:0/1415429866 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f052403b330 0x7f0524057210 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:44.198 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.194+0000 7f052b59e700 1 --2- 172.21.15.39:0/1415429866 >> v2:172.21.15.39:3300/0 conn(0x7f05240e29f0 0x7f0524055490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:44.198 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.194+0000 7f052b59e700 1 -- 172.21.15.39:0/1415429866 >> 172.21.15.39:0/1415429866 conn(0x7f0524055c20 msgr2=0x7f0524056020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:44.198 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.194+0000 7f052b59e700 1 -- 172.21.15.39:0/1415429866 shutdown_connections 2023-11-28T11:56:44.199 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.194+0000 7f052b59e700 1 -- 172.21.15.39:0/1415429866 wait complete. 2023-11-28T11:56:44.200 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.198+0000 7f052b59e700 1 Processor -- start 2023-11-28T11:56:44.200 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.198+0000 7f052b59e700 1 -- start start 2023-11-28T11:56:44.201 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.198+0000 7f052b59e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0524038560 0x7f05240de6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:44.201 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.198+0000 7f052b59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f052403b330 0x7f05240dbb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:44.201 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.198+0000 7f052b59e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05240e29f0 0x7f052403d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:44.202 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.198+0000 7f052b59e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05240dcce0 con 0x7f05240e29f0 2023-11-28T11:56:44.202 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.198+0000 7f052b59e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052404deb0 con 0x7f0524038560 2023-11-28T11:56:44.202 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.198+0000 7f052b59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05240e1430 con 0x7f052403b330 2023-11-28T11:56:44.203 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.198+0000 7f052ad9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05240e29f0 0x7f052403d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:44.203 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.198+0000 7f052ad9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05240e29f0 0x7f052403d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55498/0 (socket says 172.21.15.39:55498) 2023-11-28T11:56:44.203 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.198+0000 7f052ad9d700 1 -- 172.21.15.39:0/2550775470 learned_addr learned my addr 172.21.15.39:0/2550775470 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:44.203 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.198+0000 7f052a59c700 1 --2- 172.21.15.39:0/2550775470 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0524038560 0x7f05240de6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:44.203 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.198+0000 7f0529d9b700 1 --2- 172.21.15.39:0/2550775470 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f052403b330 0x7f05240dbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:44.203 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.198+0000 7f052ad9d700 1 -- 172.21.15.39:0/2550775470 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f052403b330 msgr2=0x7f05240dbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:44.203 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.198+0000 7f052ad9d700 1 --2- 172.21.15.39:0/2550775470 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f052403b330 0x7f05240dbb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:44.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.198+0000 7f052ad9d700 1 -- 172.21.15.39:0/2550775470 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0524038560 msgr2=0x7f05240de6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:44.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.198+0000 7f052ad9d700 1 --2- 172.21.15.39:0/2550775470 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0524038560 0x7f05240de6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:44.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.198+0000 7f052ad9d700 1 -- 172.21.15.39:0/2550775470 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052c04e720 con 0x7f05240e29f0 2023-11-28T11:56:44.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.198+0000 7f052ad9d700 1 --2- 172.21.15.39:0/2550775470 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05240e29f0 0x7f052403d3b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f052c066a20 tx=0x7f052c0678c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:44.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.198+0000 7f051affd700 1 -- 172.21.15.39:0/2550775470 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c073480 con 0x7f05240e29f0 2023-11-28T11:56:44.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.198+0000 7f051affd700 1 -- 172.21.15.39:0/2550775470 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052c0735e0 con 0x7f05240e29f0 2023-11-28T11:56:44.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.198+0000 7f051affd700 1 -- 172.21.15.39:0/2550775470 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c09d680 con 0x7f05240e29f0 2023-11-28T11:56:44.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.198+0000 7f052b59e700 1 -- 172.21.15.39:0/2550775470 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0524053920 con 0x7f05240e29f0 2023-11-28T11:56:44.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.198+0000 7f052b59e700 1 -- 172.21.15.39:0/2550775470 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0524007080 con 0x7f05240e29f0 2023-11-28T11:56:44.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.202+0000 7f052b59e700 1 -- 172.21.15.39:0/2550775470 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0524053c00 con 0x7f05240e29f0 2023-11-28T11:56:44.206 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.202+0000 7f051affd700 1 -- 172.21.15.39:0/2550775470 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f052c0a6450 con 0x7f05240e29f0 2023-11-28T11:56:44.207 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.202+0000 7f051affd700 1 --2- 172.21.15.39:0/2550775470 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f050c064ee0 0x7f050c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:44.207 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.202+0000 7f051affd700 1 -- 172.21.15.39:0/2550775470 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f052c099040 con 0x7f05240e29f0 2023-11-28T11:56:44.208 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.206+0000 7f052a59c700 1 --2- 172.21.15.39:0/2550775470 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f050c064ee0 0x7f050c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:44.209 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.206+0000 7f052a59c700 1 --2- 172.21.15.39:0/2550775470 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f050c064ee0 0x7f050c067390 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f051c009ba0 tx=0x7f051c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:44.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.214+0000 7f051affd700 1 -- 172.21.15.39:0/2550775470 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f052c0cb300 con 0x7f05240e29f0 2023-11-28T11:56:44.439 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.434+0000 7f052b59e700 1 -- 172.21.15.39:0/2550775470 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f0524005550 con 0x7f05240e29f0 2023-11-28T11:56:44.452 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.446+0000 7f051affd700 1 -- 172.21.15.39:0/2550775470 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f052c0ce920 con 0x7f05240e29f0 2023-11-28T11:56:44.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.450+0000 7f052b59e700 1 -- 172.21.15.39:0/2550775470 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f050c064ee0 msgr2=0x7f050c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:44.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.450+0000 7f052b59e700 1 --2- 172.21.15.39:0/2550775470 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f050c064ee0 0x7f050c067390 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f051c009ba0 tx=0x7f051c008040 comp rx=0 tx=0).stop 2023-11-28T11:56:44.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.450+0000 7f052b59e700 1 -- 172.21.15.39:0/2550775470 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05240e29f0 msgr2=0x7f052403d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:44.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.450+0000 7f052b59e700 1 --2- 172.21.15.39:0/2550775470 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05240e29f0 0x7f052403d3b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f052c066a20 tx=0x7f052c0678c0 comp rx=0 tx=0).stop 2023-11-28T11:56:44.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.450+0000 7f052b59e700 1 -- 172.21.15.39:0/2550775470 shutdown_connections 2023-11-28T11:56:44.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.450+0000 7f052b59e700 1 --2- 172.21.15.39:0/2550775470 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05240e29f0 0x7f052403d3b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:44.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.450+0000 7f052b59e700 1 --2- 172.21.15.39:0/2550775470 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f052403b330 0x7f05240dbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:44.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.450+0000 7f052b59e700 1 --2- 172.21.15.39:0/2550775470 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f050c064ee0 0x7f050c067390 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:44.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.450+0000 7f052b59e700 1 --2- 172.21.15.39:0/2550775470 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0524038560 0x7f05240de6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:44.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.450+0000 7f052b59e700 1 -- 172.21.15.39:0/2550775470 >> 172.21.15.39:0/2550775470 conn(0x7f0524055c20 msgr2=0x7f0524039da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:44.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.450+0000 7f052b59e700 1 -- 172.21.15.39:0/2550775470 shutdown_connections 2023-11-28T11:56:44.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.450+0000 7f052b59e700 1 -- 172.21.15.39:0/2550775470 wait complete. 2023-11-28T11:56:44.458 INFO:teuthology.orchestra.run.smithi039.stderr:added data pool 5 to fsmap 2023-11-28T11:56:44.477 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:56:44.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.658+0000 7f5f745e6700 1 Processor -- start 2023-11-28T11:56:44.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.658+0000 7f5f745e6700 1 -- start start 2023-11-28T11:56:44.664 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.662+0000 7f5f745e6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f6c160880 0x7f5f6c15c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:44.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.662+0000 7f5f745e6700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f6c15fe30 con 0x7f5f6c0b1290 2023-11-28T11:56:44.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.662+0000 7f5f745e6700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f6c0cf620 con 0x7f5f6c15cd90 2023-11-28T11:56:44.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.662+0000 7f5f745e6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c15d210 con 0x7f5f6c160880 2023-11-28T11:56:44.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.662+0000 7f5f72382700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f5f6c0b1290 0x7f5f6c0b1660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60276/0 (socket says 172.21.15.39:60276) 2023-11-28T11:56:44.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.662+0000 7f5f72382700 1 -- 172.21.15.39:0/2411930110 learned_addr learned my addr 172.21.15.39:0/2411930110 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:56:44.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.662+0000 7f5f71b81700 1 --2- 172.21.15.39:0/2411930110 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f6c160880 0x7f5f6c15c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:44.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.662+0000 7f5f71380700 1 -- 172.21.15.39:0/2411930110 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1762617940 0 0) 0x7f5f6c15fe30 con 0x7f5f6c0b1290 2023-11-28T11:56:44.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.662+0000 7f5f71380700 1 -- 172.21.15.39:0/2411930110 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f580035d0 con 0x7f5f6c0b1290 2023-11-28T11:56:44.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.662+0000 7f5f71b81700 1 -- 172.21.15.39:0/2411930110 >> v1:172.21.15.184:6789/0 conn(0x7f5f6c15cd90 legacy=0x7f5f6c0cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:44.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.662+0000 7f5f71b81700 1 -- 172.21.15.39:0/2411930110 >> v1:172.21.15.39:6789/0 conn(0x7f5f6c0b1290 legacy=0x7f5f6c0b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:44.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.662+0000 7f5f71b81700 1 -- 172.21.15.39:0/2411930110 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6c15d3f0 con 0x7f5f6c160880 2023-11-28T11:56:44.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.662+0000 7f5f71b81700 1 --2- 172.21.15.39:0/2411930110 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f6c160880 0x7f5f6c15c850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c009880 tx=0x7f5f5c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34a4ebbe1c4f1838 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:44.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.662+0000 7f5f71380700 1 -- 172.21.15.39:0/2411930110 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c011830 con 0x7f5f6c160880 2023-11-28T11:56:44.668 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.662+0000 7f5f71380700 1 -- 172.21.15.39:0/2411930110 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5c011990 con 0x7f5f6c160880 2023-11-28T11:56:44.668 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.662+0000 7f5f71380700 1 -- 172.21.15.39:0/2411930110 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c011d20 con 0x7f5f6c160880 2023-11-28T11:56:44.668 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.666+0000 7f5f745e6700 1 -- 172.21.15.39:0/2411930110 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f6c160880 msgr2=0x7f5f6c15c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:44.668 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.666+0000 7f5f745e6700 1 --2- 172.21.15.39:0/2411930110 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f6c160880 0x7f5f6c15c850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c009880 tx=0x7f5f5c009b90 comp rx=0 tx=0).stop 2023-11-28T11:56:44.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.666+0000 7f5f745e6700 1 -- 172.21.15.39:0/2411930110 shutdown_connections 2023-11-28T11:56:44.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.666+0000 7f5f745e6700 1 --2- 172.21.15.39:0/2411930110 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f6c160880 0x7f5f6c15c850 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:44.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.666+0000 7f5f745e6700 1 -- 172.21.15.39:0/2411930110 >> 172.21.15.39:0/2411930110 conn(0x7f5f6c0cc290 msgr2=0x7f5f6c0cc690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:44.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.666+0000 7f5f745e6700 1 -- 172.21.15.39:0/2411930110 shutdown_connections 2023-11-28T11:56:44.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.666+0000 7f5f745e6700 1 -- 172.21.15.39:0/2411930110 wait complete. 2023-11-28T11:56:44.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.666+0000 7f5f745e6700 1 Processor -- start 2023-11-28T11:56:44.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.666+0000 7f5f745e6700 1 -- start start 2023-11-28T11:56:44.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.670+0000 7f5f745e6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f6c0b1290 0x7f5f6c0c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:44.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.670+0000 7f5f745e6700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f6c15cd90 0x7f5f6c0ac3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:44.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.670+0000 7f5f745e6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f6c160880 0x7f5f6c14eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:44.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.670+0000 7f5f745e6700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c0ac8e0 con 0x7f5f6c15cd90 2023-11-28T11:56:44.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.670+0000 7f5f745e6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c0c84c0 con 0x7f5f6c0b1290 2023-11-28T11:56:44.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.670+0000 7f5f745e6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c0c87a0 con 0x7f5f6c160880 2023-11-28T11:56:44.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.670+0000 7f5f71b81700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f6c15cd90 0x7f5f6c0ac3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:44.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.670+0000 7f5f71b81700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f6c15cd90 0x7f5f6c0ac3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55504/0 (socket says 172.21.15.39:55504) 2023-11-28T11:56:44.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.670+0000 7f5f71b81700 1 -- 172.21.15.39:0/573429836 learned_addr learned my addr 172.21.15.39:0/573429836 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:44.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.670+0000 7f5f72382700 1 --2- 172.21.15.39:0/573429836 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f6c0b1290 0x7f5f6c0c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:44.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.670+0000 7f5f72b83700 1 --2- 172.21.15.39:0/573429836 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f6c160880 0x7f5f6c14eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:44.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.670+0000 7f5f71b81700 1 -- 172.21.15.39:0/573429836 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f6c160880 msgr2=0x7f5f6c14eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:44.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.670+0000 7f5f71b81700 1 --2- 172.21.15.39:0/573429836 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f6c160880 0x7f5f6c14eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:44.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.670+0000 7f5f71b81700 1 -- 172.21.15.39:0/573429836 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f6c0b1290 msgr2=0x7f5f6c0c7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:44.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.670+0000 7f5f71b81700 1 --2- 172.21.15.39:0/573429836 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f6c0b1290 0x7f5f6c0c7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:44.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.670+0000 7f5f71b81700 1 -- 172.21.15.39:0/573429836 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5c0094b0 con 0x7f5f6c15cd90 2023-11-28T11:56:44.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.670+0000 7f5f72382700 1 --2- 172.21.15.39:0/573429836 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f6c0b1290 0x7f5f6c0c7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:44.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.670+0000 7f5f71b81700 1 --2- 172.21.15.39:0/573429836 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f6c15cd90 0x7f5f6c0ac3a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c013040 tx=0x7f5f5c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:44.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.670+0000 7f5f62ffd700 1 -- 172.21.15.39:0/573429836 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c004610 con 0x7f5f6c15cd90 2023-11-28T11:56:44.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.670+0000 7f5f62ffd700 1 -- 172.21.15.39:0/573429836 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5c0036c0 con 0x7f5f6c15cd90 2023-11-28T11:56:44.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.670+0000 7f5f745e6700 1 -- 172.21.15.39:0/573429836 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f6c160080 con 0x7f5f6c15cd90 2023-11-28T11:56:44.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.670+0000 7f5f62ffd700 1 -- 172.21.15.39:0/573429836 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c003a50 con 0x7f5f6c15cd90 2023-11-28T11:56:44.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.670+0000 7f5f745e6700 1 -- 172.21.15.39:0/573429836 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f6c15d6d0 con 0x7f5f6c15cd90 2023-11-28T11:56:44.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.674+0000 7f5f745e6700 1 -- 172.21.15.39:0/573429836 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f6c160360 con 0x7f5f6c15cd90 2023-11-28T11:56:44.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.674+0000 7f5f62ffd700 1 -- 172.21.15.39:0/573429836 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5f5c00f050 con 0x7f5f6c15cd90 2023-11-28T11:56:44.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.674+0000 7f5f62ffd700 1 --2- 172.21.15.39:0/573429836 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5f50064ee0 0x7f5f50067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:44.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.674+0000 7f5f62ffd700 1 -- 172.21.15.39:0/573429836 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5f5c083600 con 0x7f5f6c15cd90 2023-11-28T11:56:44.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.678+0000 7f5f72382700 1 --2- 172.21.15.39:0/573429836 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5f50064ee0 0x7f5f50067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:44.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.678+0000 7f5f72382700 1 --2- 172.21.15.39:0/573429836 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5f50064ee0 0x7f5f50067390 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5f68001560 tx=0x7f5f68001a90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:44.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.682+0000 7f5f62ffd700 1 -- 172.21.15.39:0/573429836 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5f5c0513c0 con 0x7f5f6c15cd90 2023-11-28T11:56:44.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.898+0000 7f5f745e6700 1 -- 172.21.15.39:0/573429836 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5f6c0726c0 con 0x7f5f6c15cd90 2023-11-28T11:56:44.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.898+0000 7f5f62ffd700 1 -- 172.21.15.39:0/573429836 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4647 (secure 0 0 0) 0x7f5f5c0549e0 con 0x7f5f6c15cd90 2023-11-28T11:56:44.902 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:56:44.902 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4265,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1518942402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":1518942402},{"type":"v1","addr":"172.21.15.184:6837","nonce":1518942402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/1834562481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":1834562481},{"type":"v1","addr":"172.21.15.39:6833","nonce":1834562481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2470756838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2470756838},{"type":"v1","addr":"172.21.15.39:6835","nonce":2470756838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:56:39.894634+0000","modified":"2023-11-28T11:56:44.439910+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6835/516507254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":516507254},{"type":"v1","addr":"172.21.15.184:6835","nonce":516507254}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-11-28T11:56:44.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.902+0000 7f5f745e6700 1 -- 172.21.15.39:0/573429836 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5f50064ee0 msgr2=0x7f5f50067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:44.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.902+0000 7f5f745e6700 1 --2- 172.21.15.39:0/573429836 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5f50064ee0 0x7f5f50067390 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5f68001560 tx=0x7f5f68001a90 comp rx=0 tx=0).stop 2023-11-28T11:56:44.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.902+0000 7f5f745e6700 1 -- 172.21.15.39:0/573429836 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f6c15cd90 msgr2=0x7f5f6c0ac3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:44.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.902+0000 7f5f745e6700 1 --2- 172.21.15.39:0/573429836 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f6c15cd90 0x7f5f6c0ac3a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c013040 tx=0x7f5f5c004770 comp rx=0 tx=0).stop 2023-11-28T11:56:44.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.902+0000 7f5f745e6700 1 -- 172.21.15.39:0/573429836 shutdown_connections 2023-11-28T11:56:44.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.902+0000 7f5f745e6700 1 --2- 172.21.15.39:0/573429836 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f6c160880 0x7f5f6c14eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:44.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.902+0000 7f5f745e6700 1 --2- 172.21.15.39:0/573429836 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f6c15cd90 0x7f5f6c0ac3a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:44.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.902+0000 7f5f745e6700 1 --2- 172.21.15.39:0/573429836 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5f50064ee0 0x7f5f50067390 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:44.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.902+0000 7f5f745e6700 1 --2- 172.21.15.39:0/573429836 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f6c0b1290 0x7f5f6c0c7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:44.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.902+0000 7f5f745e6700 1 -- 172.21.15.39:0/573429836 >> 172.21.15.39:0/573429836 conn(0x7f5f6c0cc290 msgr2=0x7f5f6c0b1660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:44.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.902+0000 7f5f745e6700 1 -- 172.21.15.39:0/573429836 shutdown_connections 2023-11-28T11:56:44.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:44.902+0000 7f5f745e6700 1 -- 172.21.15.39:0/573429836 wait complete. 2023-11-28T11:56:44.907 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 7 2023-11-28T11:56:44.928 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:56:45.106 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.102+0000 7f743889f700 1 Processor -- start 2023-11-28T11:56:45.106 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.102+0000 7f743889f700 1 -- start start 2023-11-28T11:56:45.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.102+0000 7f743889f700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f743415c640 0x7f74340d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:45.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.106+0000 7f743889f700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f743406c600 con 0x7f7434069e00 2023-11-28T11:56:45.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.106+0000 7f743889f700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74340722f0 con 0x7f7434071aa0 2023-11-28T11:56:45.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.106+0000 7f743889f700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f743406cef0 con 0x7f743415c640 2023-11-28T11:56:45.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.106+0000 7f7433fff700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f7434069e00 0x7f74340d0580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60292/0 (socket says 172.21.15.39:60292) 2023-11-28T11:56:45.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.106+0000 7f7433fff700 1 -- 172.21.15.39:0/2486776842 learned_addr learned my addr 172.21.15.39:0/2486776842 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:56:45.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.106+0000 7f74337fe700 1 --2- 172.21.15.39:0/2486776842 >> v2:172.21.15.184:3300/0 conn(0x7f743415c640 0x7f74340d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:45.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.106+0000 7f7432ffd700 1 -- 172.21.15.39:0/2486776842 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1858290413 0 0) 0x7f743406c600 con 0x7f7434069e00 2023-11-28T11:56:45.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.106+0000 7f7432ffd700 1 -- 172.21.15.39:0/2486776842 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74200035d0 con 0x7f7434069e00 2023-11-28T11:56:45.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.106+0000 7f7432ffd700 1 -- 172.21.15.39:0/2486776842 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1833136566 0 0) 0x7f74200035d0 con 0x7f7434069e00 2023-11-28T11:56:45.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.106+0000 7f7432ffd700 1 -- 172.21.15.39:0/2486776842 >> v2:172.21.15.184:3300/0 conn(0x7f743415c640 msgr2=0x7f74340d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:45.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.106+0000 7f7432ffd700 1 --2- 172.21.15.39:0/2486776842 >> v2:172.21.15.184:3300/0 conn(0x7f743415c640 0x7f74340d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:45.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.106+0000 7f7432ffd700 1 -- 172.21.15.39:0/2486776842 >> v1:172.21.15.184:6789/0 conn(0x7f7434071aa0 legacy=0x7f743406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:45.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.106+0000 7f7432ffd700 1 -- 172.21.15.39:0/2486776842 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743406da20 con 0x7f7434069e00 2023-11-28T11:56:45.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.106+0000 7f7432ffd700 1 -- 172.21.15.39:0/2486776842 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4013383302 0 0) 0x7f742c001670 con 0x7f7434069e00 2023-11-28T11:56:45.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.106+0000 7f7432ffd700 1 -- 172.21.15.39:0/2486776842 >> v1:172.21.15.39:6789/0 conn(0x7f7434069e00 legacy=0x7f74340d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:45.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.106+0000 7f7432ffd700 1 --2- 172.21.15.39:0/2486776842 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7420003a20 0x7f7420003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:45.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.106+0000 7f7432ffd700 1 --2- 172.21.15.39:0/2486776842 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7420004870 0x7f7420004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:45.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.106+0000 7f7432ffd700 1 --2- 172.21.15.39:0/2486776842 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7420005220 0x7f742000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:45.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.106+0000 7f7432ffd700 1 -- 172.21.15.39:0/2486776842 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743406cef0 con 0x7f7420003a20 2023-11-28T11:56:45.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.106+0000 7f7432ffd700 1 -- 172.21.15.39:0/2486776842 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742000c0a0 con 0x7f7420005220 2023-11-28T11:56:45.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.106+0000 7f7432ffd700 1 -- 172.21.15.39:0/2486776842 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f742000c260 con 0x7f7420004870 2023-11-28T11:56:45.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.106+0000 7f74337fe700 1 --2- 172.21.15.39:0/2486776842 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7420003a20 0x7f7420003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:45.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.106+0000 7f742affd700 1 --2- 172.21.15.39:0/2486776842 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7420004870 0x7f7420004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:45.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.106+0000 7f74337fe700 1 -- 172.21.15.39:0/2486776842 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7420004870 msgr2=0x7f7420004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:45.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.106+0000 7f74337fe700 1 --2- 172.21.15.39:0/2486776842 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7420004870 0x7f7420004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:45.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.106+0000 7f74337fe700 1 -- 172.21.15.39:0/2486776842 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7420005220 msgr2=0x7f742000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:45.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.106+0000 7f74337fe700 1 --2- 172.21.15.39:0/2486776842 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7420005220 0x7f742000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:45.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.106+0000 7f7433fff700 1 -- 172.21.15.39:0/2486776842 reap_dead start 2023-11-28T11:56:45.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.106+0000 7f74337fe700 1 -- 172.21.15.39:0/2486776842 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74200035d0 con 0x7f7420003a20 2023-11-28T11:56:45.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.106+0000 7f742affd700 1 --2- 172.21.15.39:0/2486776842 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7420004870 0x7f7420004ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:56:45.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.106+0000 7f74337fe700 1 --2- 172.21.15.39:0/2486776842 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7420003a20 0x7f7420003e30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7424009fc0 tx=0x7f74200058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1ec6603668d11cd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:45.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.106+0000 7f7432ffd700 1 -- 172.21.15.39:0/2486776842 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742400ec30 con 0x7f7420003a20 2023-11-28T11:56:45.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.110+0000 7f7432ffd700 1 -- 172.21.15.39:0/2486776842 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742400f040 con 0x7f7420003a20 2023-11-28T11:56:45.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.110+0000 7f7432ffd700 1 -- 172.21.15.39:0/2486776842 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7424014480 con 0x7f7420003a20 2023-11-28T11:56:45.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.110+0000 7f743889f700 1 -- 172.21.15.39:0/2486776842 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7420003a20 msgr2=0x7f7420003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:45.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.110+0000 7f743889f700 1 --2- 172.21.15.39:0/2486776842 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7420003a20 0x7f7420003e30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7424009fc0 tx=0x7f74200058a0 comp rx=0 tx=0).stop 2023-11-28T11:56:45.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.110+0000 7f743889f700 1 -- 172.21.15.39:0/2486776842 shutdown_connections 2023-11-28T11:56:45.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.110+0000 7f743889f700 1 --2- 172.21.15.39:0/2486776842 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7420003a20 0x7f7420003e30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:45.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.110+0000 7f743889f700 1 -- 172.21.15.39:0/2486776842 >> 172.21.15.39:0/2486776842 conn(0x7f74340b6520 msgr2=0x7f7434071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:45.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.110+0000 7f743889f700 1 -- 172.21.15.39:0/2486776842 shutdown_connections 2023-11-28T11:56:45.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.110+0000 7f743889f700 1 -- 172.21.15.39:0/2486776842 wait complete. 2023-11-28T11:56:45.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.114+0000 7f743889f700 1 Processor -- start 2023-11-28T11:56:45.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.114+0000 7f743889f700 1 -- start start 2023-11-28T11:56:45.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.114+0000 7f743889f700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7420003a20 0x7f74340cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:45.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.114+0000 7f743889f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74340cc4f0 0x7f74340cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:45.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.114+0000 7f743889f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74340cf4f0 0x7f74340c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:45.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.114+0000 7f743889f700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74340cf970 con 0x7f7420003a20 2023-11-28T11:56:45.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.114+0000 7f743889f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74340cbb20 con 0x7f74340cf4f0 2023-11-28T11:56:45.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.114+0000 7f743889f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74340cb1f0 con 0x7f74340cc4f0 2023-11-28T11:56:45.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.114+0000 7f74337fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7420003a20 0x7f74340cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:45.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.114+0000 7f74337fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7420003a20 0x7f74340cbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55516/0 (socket says 172.21.15.39:55516) 2023-11-28T11:56:45.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.114+0000 7f74337fe700 1 -- 172.21.15.39:0/3564267251 learned_addr learned my addr 172.21.15.39:0/3564267251 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:45.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.114+0000 7f742affd700 1 --2- 172.21.15.39:0/3564267251 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74340cc4f0 0x7f74340cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:45.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.114+0000 7f7433fff700 1 --2- 172.21.15.39:0/3564267251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74340cf4f0 0x7f74340c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:45.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.114+0000 7f74337fe700 1 -- 172.21.15.39:0/3564267251 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74340cc4f0 msgr2=0x7f74340cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:45.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.118+0000 7f74337fe700 1 --2- 172.21.15.39:0/3564267251 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74340cc4f0 0x7f74340cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:45.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.118+0000 7f74337fe700 1 -- 172.21.15.39:0/3564267251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74340cf4f0 msgr2=0x7f74340c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:45.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.118+0000 7f74337fe700 1 --2- 172.21.15.39:0/3564267251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74340cf4f0 0x7f74340c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:45.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.118+0000 7f74337fe700 1 -- 172.21.15.39:0/3564267251 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7434072010 con 0x7f7420003a20 2023-11-28T11:56:45.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.118+0000 7f7433fff700 1 --2- 172.21.15.39:0/3564267251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74340cf4f0 0x7f74340c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:56:45.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.118+0000 7f742affd700 1 --2- 172.21.15.39:0/3564267251 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74340cc4f0 0x7f74340cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:56:45.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.118+0000 7f74337fe700 1 --2- 172.21.15.39:0/3564267251 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7420003a20 0x7f74340cbfb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f742400e700 tx=0x7f7424009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:45.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.118+0000 7f7430ff9700 1 -- 172.21.15.39:0/3564267251 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7424004450 con 0x7f7420003a20 2023-11-28T11:56:45.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.118+0000 7f7430ff9700 1 -- 172.21.15.39:0/3564267251 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74240045d0 con 0x7f7420003a20 2023-11-28T11:56:45.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.118+0000 7f7430ff9700 1 -- 172.21.15.39:0/3564267251 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7424004980 con 0x7f7420003a20 2023-11-28T11:56:45.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.118+0000 7f743889f700 1 -- 172.21.15.39:0/3564267251 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f743415ca10 con 0x7f7420003a20 2023-11-28T11:56:45.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.118+0000 7f743889f700 1 -- 172.21.15.39:0/3564267251 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f743406c830 con 0x7f7420003a20 2023-11-28T11:56:45.123 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.118+0000 7f743889f700 1 -- 172.21.15.39:0/3564267251 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74340cc8c0 con 0x7f7420003a20 2023-11-28T11:56:45.124 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.122+0000 7f7430ff9700 1 -- 172.21.15.39:0/3564267251 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7424014480 con 0x7f7420003a20 2023-11-28T11:56:45.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.122+0000 7f7430ff9700 1 --2- 172.21.15.39:0/3564267251 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7414064ee0 0x7f7414067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:45.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.122+0000 7f7430ff9700 1 -- 172.21.15.39:0/3564267251 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7424084420 con 0x7f7420003a20 2023-11-28T11:56:45.127 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.122+0000 7f742affd700 1 --2- 172.21.15.39:0/3564267251 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7414064ee0 0x7f7414067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:45.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.126+0000 7f742affd700 1 --2- 172.21.15.39:0/3564267251 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7414064ee0 0x7f7414067390 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f741c000c00 tx=0x7f741c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:45.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.126+0000 7f7430ff9700 1 -- 172.21.15.39:0/3564267251 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7424052100 con 0x7f7420003a20 2023-11-28T11:56:45.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.302+0000 7f743889f700 1 -- 172.21.15.39:0/3564267251 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7434073cb0 con 0x7f7420003a20 2023-11-28T11:56:45.308 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.306+0000 7f7430ff9700 1 -- 172.21.15.39:0/3564267251 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+19652 (secure 0 0 0) 0x7f7424055720 con 0x7f7420003a20 2023-11-28T11:56:45.309 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:56:45.309 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":29,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:56:44.439368+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:56:38.203736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:56:38.946498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:56:41.988334+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:56:45.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.310+0000 7f743889f700 1 -- 172.21.15.39:0/3564267251 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7414064ee0 msgr2=0x7f7414067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:45.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.310+0000 7f743889f700 1 --2- 172.21.15.39:0/3564267251 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7414064ee0 0x7f7414067390 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f741c000c00 tx=0x7f741c009040 comp rx=0 tx=0).stop 2023-11-28T11:56:45.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.310+0000 7f743889f700 1 -- 172.21.15.39:0/3564267251 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7420003a20 msgr2=0x7f74340cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:45.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.310+0000 7f743889f700 1 --2- 172.21.15.39:0/3564267251 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7420003a20 0x7f74340cbfb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f742400e700 tx=0x7f7424009750 comp rx=0 tx=0).stop 2023-11-28T11:56:45.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.310+0000 7f743889f700 1 -- 172.21.15.39:0/3564267251 shutdown_connections 2023-11-28T11:56:45.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.310+0000 7f743889f700 1 --2- 172.21.15.39:0/3564267251 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7414064ee0 0x7f7414067390 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:45.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.310+0000 7f743889f700 1 --2- 172.21.15.39:0/3564267251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74340cf4f0 0x7f74340c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:45.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.310+0000 7f743889f700 1 --2- 172.21.15.39:0/3564267251 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74340cc4f0 0x7f74340cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:45.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.310+0000 7f743889f700 1 --2- 172.21.15.39:0/3564267251 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7420003a20 0x7f74340cbfb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:45.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.310+0000 7f743889f700 1 -- 172.21.15.39:0/3564267251 >> 172.21.15.39:0/3564267251 conn(0x7f74340b6520 msgr2=0x7f74340b2410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:45.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.310+0000 7f743889f700 1 -- 172.21.15.39:0/3564267251 shutdown_connections 2023-11-28T11:56:45.315 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.310+0000 7f743889f700 1 -- 172.21.15.39:0/3564267251 wait complete. 2023-11-28T11:56:45.336 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:56:45.515 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.510+0000 7fdba359e700 1 Processor -- start 2023-11-28T11:56:45.515 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.510+0000 7fdba359e700 1 -- start start 2023-11-28T11:56:45.516 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.514+0000 7fdba359e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fdba415c650 0x7fdba406b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:45.517 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.514+0000 7fdba359e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdba40cd0d0 0x7fdba40b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:45.517 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.514+0000 7fdba359e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdba40c9d40 con 0x7fdba40b1b80 2023-11-28T11:56:45.517 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.514+0000 7fdba359e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdba406b140 con 0x7fdba415c650 2023-11-28T11:56:45.517 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.514+0000 7fdba359e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba406b820 con 0x7fdba40cd0d0 2023-11-28T11:56:45.518 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.514+0000 7fdba259c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fdba415c650 0x7fdba406b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:45.518 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.514+0000 7fdb99d9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdba40cd0d0 0x7fdba40b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:45.518 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.514+0000 7fdba2d9d700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fdba40b1b80 0x7fdba406bed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:38576/0 (socket says 172.21.15.39:38576) 2023-11-28T11:56:45.518 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.514+0000 7fdba2d9d700 1 -- 172.21.15.39:0/506952044 learned_addr learned my addr 172.21.15.39:0/506952044 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:56:45.518 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.514+0000 7fdb99d9b700 1 -- 172.21.15.39:0/506952044 >> v2:172.21.15.184:3300/0 conn(0x7fdba415c650 msgr2=0x7fdba406b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:45.519 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.514+0000 7fdb99d9b700 1 --2- 172.21.15.39:0/506952044 >> v2:172.21.15.184:3300/0 conn(0x7fdba415c650 0x7fdba406b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:45.519 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.514+0000 7fdb99d9b700 1 -- 172.21.15.39:0/506952044 >> v1:172.21.15.184:6789/0 conn(0x7fdba40b1b80 legacy=0x7fdba406bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:45.519 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.514+0000 7fdb99d9b700 1 -- 172.21.15.39:0/506952044 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba40cd5d0 con 0x7fdba40cd0d0 2023-11-28T11:56:45.519 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.514+0000 7fdba259c700 1 --2- 172.21.15.39:0/506952044 >> v2:172.21.15.184:3300/0 conn(0x7fdba415c650 0x7fdba406b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:45.519 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.514+0000 7fdb99d9b700 1 --2- 172.21.15.39:0/506952044 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdba40cd0d0 0x7fdba40b1640 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c009850 tx=0x7fdb8c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=132df7c091117478 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:45.519 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.514+0000 7fdba1d9b700 1 -- 172.21.15.39:0/506952044 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c004230 con 0x7fdba40cd0d0 2023-11-28T11:56:45.520 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.514+0000 7fdba1d9b700 1 -- 172.21.15.39:0/506952044 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb8c004390 con 0x7fdba40cd0d0 2023-11-28T11:56:45.520 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.514+0000 7fdba1d9b700 1 -- 172.21.15.39:0/506952044 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c0036c0 con 0x7fdba40cd0d0 2023-11-28T11:56:45.521 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.518+0000 7fdba359e700 1 -- 172.21.15.39:0/506952044 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdba40cd0d0 msgr2=0x7fdba40b1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:45.521 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.518+0000 7fdba359e700 1 --2- 172.21.15.39:0/506952044 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdba40cd0d0 0x7fdba40b1640 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c009850 tx=0x7fdb8c009b60 comp rx=0 tx=0).stop 2023-11-28T11:56:45.521 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.518+0000 7fdba359e700 1 -- 172.21.15.39:0/506952044 shutdown_connections 2023-11-28T11:56:45.521 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.518+0000 7fdba359e700 1 --2- 172.21.15.39:0/506952044 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdba40cd0d0 0x7fdba40b1640 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:45.521 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.518+0000 7fdba359e700 1 --2- 172.21.15.39:0/506952044 >> v2:172.21.15.184:3300/0 conn(0x7fdba415c650 0x7fdba406b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:45.521 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.518+0000 7fdba359e700 1 -- 172.21.15.39:0/506952044 >> 172.21.15.39:0/506952044 conn(0x7fdba40b0f80 msgr2=0x7fdba40ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:45.521 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.518+0000 7fdba359e700 1 -- 172.21.15.39:0/506952044 shutdown_connections 2023-11-28T11:56:45.521 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.518+0000 7fdba359e700 1 -- 172.21.15.39:0/506952044 wait complete. 2023-11-28T11:56:45.525 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.522+0000 7fdba359e700 1 Processor -- start 2023-11-28T11:56:45.525 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.522+0000 7fdba359e700 1 -- start start 2023-11-28T11:56:45.527 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.522+0000 7fdba359e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdba40b1b80 0x7fdba414eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:45.527 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.522+0000 7fdba359e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdba40cd0d0 0x7fdba40af780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:45.527 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.522+0000 7fdba359e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdba415c650 0x7fdba40afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:45.527 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.522+0000 7fdba359e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba40c6640 con 0x7fdba40cd0d0 2023-11-28T11:56:45.527 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.522+0000 7fdba359e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba40c7ea0 con 0x7fdba40b1b80 2023-11-28T11:56:45.527 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.522+0000 7fdba359e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba40c59c0 con 0x7fdba415c650 2023-11-28T11:56:45.528 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.522+0000 7fdb99d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdba40cd0d0 0x7fdba40af780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:45.528 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.522+0000 7fdba259c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdba40b1b80 0x7fdba414eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:45.528 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.522+0000 7fdba259c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdba40b1b80 0x7fdba414eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:51232/0 (socket says 172.21.15.39:51232) 2023-11-28T11:56:45.528 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.522+0000 7fdb99d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdba40cd0d0 0x7fdba40af780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55522/0 (socket says 172.21.15.39:55522) 2023-11-28T11:56:45.529 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.522+0000 7fdba2d9d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdba415c650 0x7fdba40afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:45.529 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.522+0000 7fdba259c700 1 -- 172.21.15.39:0/3840657122 learned_addr learned my addr 172.21.15.39:0/3840657122 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:45.529 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.526+0000 7fdba259c700 1 -- 172.21.15.39:0/3840657122 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdba415c650 msgr2=0x7fdba40afcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:45.529 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.526+0000 7fdba259c700 1 --2- 172.21.15.39:0/3840657122 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdba415c650 0x7fdba40afcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:45.529 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.526+0000 7fdba259c700 1 -- 172.21.15.39:0/3840657122 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdba40cd0d0 msgr2=0x7fdba40af780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:45.529 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.526+0000 7fdba259c700 1 --2- 172.21.15.39:0/3840657122 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdba40cd0d0 0x7fdba40af780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:45.529 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.526+0000 7fdba259c700 1 -- 172.21.15.39:0/3840657122 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb94009a70 con 0x7fdba40b1b80 2023-11-28T11:56:45.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.526+0000 7fdba259c700 1 --2- 172.21.15.39:0/3840657122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdba40b1b80 0x7fdba414eac0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdb94009f60 tx=0x7fdb94009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:45.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.526+0000 7fdb9b7fe700 1 -- 172.21.15.39:0/3840657122 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9400cdc0 con 0x7fdba40b1b80 2023-11-28T11:56:45.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.526+0000 7fdb9b7fe700 1 -- 172.21.15.39:0/3840657122 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9400f040 con 0x7fdba40b1b80 2023-11-28T11:56:45.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.526+0000 7fdb9b7fe700 1 -- 172.21.15.39:0/3840657122 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb940146a0 con 0x7fdba40b1b80 2023-11-28T11:56:45.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.526+0000 7fdba359e700 1 -- 172.21.15.39:0/3840657122 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb8c0094b0 con 0x7fdba40b1b80 2023-11-28T11:56:45.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.526+0000 7fdba359e700 1 -- 172.21.15.39:0/3840657122 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba40c99d0 con 0x7fdba40b1b80 2023-11-28T11:56:45.532 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.526+0000 7fdba359e700 1 -- 172.21.15.39:0/3840657122 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba40cd8b0 con 0x7fdba40b1b80 2023-11-28T11:56:45.534 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.530+0000 7fdb9b7fe700 1 -- 172.21.15.39:0/3840657122 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdb94039ba0 con 0x7fdba40b1b80 2023-11-28T11:56:45.536 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.530+0000 7fdb9b7fe700 1 --2- 172.21.15.39:0/3840657122 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fdb84064ee0 0x7fdb84067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:45.536 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.530+0000 7fdb9b7fe700 1 -- 172.21.15.39:0/3840657122 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdb940832f0 con 0x7fdba40b1b80 2023-11-28T11:56:45.536 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.534+0000 7fdb99d9b700 1 --2- 172.21.15.39:0/3840657122 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fdb84064ee0 0x7fdb84067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:45.539 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.534+0000 7fdb99d9b700 1 --2- 172.21.15.39:0/3840657122 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fdb84064ee0 0x7fdb84067390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c009850 tx=0x7fdb8c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:45.541 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.538+0000 7fdb9b7fe700 1 -- 172.21.15.39:0/3840657122 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdb94051130 con 0x7fdba40b1b80 2023-11-28T11:56:45.578 INFO:tasks.ceph.mds.b.smithi184.stderr:2023-11-28T11:56:45.570+0000 7f93306bf700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T11:56:45.718 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.714+0000 7fdba359e700 1 -- 172.21.15.39:0/3840657122 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdba40c9680 con 0x7fdba40b1b80 2023-11-28T11:56:45.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.718+0000 7fdb9b7fe700 1 -- 172.21.15.39:0/3840657122 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+19652 (secure 0 0 0) 0x7fdb94054750 con 0x7fdba40b1b80 2023-11-28T11:56:45.723 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:56:45.723 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":29,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:56:44.439368+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:56:38.203736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:56:38.946498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:56:41.988334+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:56:45.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.722+0000 7fdba359e700 1 -- 172.21.15.39:0/3840657122 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fdb84064ee0 msgr2=0x7fdb84067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:45.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.722+0000 7fdba359e700 1 --2- 172.21.15.39:0/3840657122 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fdb84064ee0 0x7fdb84067390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c009850 tx=0x7fdb8c008030 comp rx=0 tx=0).stop 2023-11-28T11:56:45.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.722+0000 7fdba359e700 1 -- 172.21.15.39:0/3840657122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdba40b1b80 msgr2=0x7fdba414eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:45.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.722+0000 7fdba359e700 1 --2- 172.21.15.39:0/3840657122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdba40b1b80 0x7fdba414eac0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdb94009f60 tx=0x7fdb94009f90 comp rx=0 tx=0).stop 2023-11-28T11:56:45.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.722+0000 7fdba359e700 1 -- 172.21.15.39:0/3840657122 shutdown_connections 2023-11-28T11:56:45.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.722+0000 7fdba359e700 1 --2- 172.21.15.39:0/3840657122 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdba415c650 0x7fdba40afcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:45.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.722+0000 7fdba359e700 1 --2- 172.21.15.39:0/3840657122 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdba40cd0d0 0x7fdba40af780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:45.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.722+0000 7fdba359e700 1 --2- 172.21.15.39:0/3840657122 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fdb84064ee0 0x7fdb84067390 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:45.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.722+0000 7fdba359e700 1 --2- 172.21.15.39:0/3840657122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdba40b1b80 0x7fdba414eac0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:45.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.722+0000 7fdba359e700 1 -- 172.21.15.39:0/3840657122 >> 172.21.15.39:0/3840657122 conn(0x7fdba40b0f80 msgr2=0x7fdba40abaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:45.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.722+0000 7fdba359e700 1 -- 172.21.15.39:0/3840657122 shutdown_connections 2023-11-28T11:56:45.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.722+0000 7fdba359e700 1 -- 172.21.15.39:0/3840657122 wait complete. 2023-11-28T11:56:45.768 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:56:45.949 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.946+0000 7fa72f2b5700 1 Processor -- start 2023-11-28T11:56:45.949 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.946+0000 7fa72f2b5700 1 -- start start 2023-11-28T11:56:45.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.946+0000 7fa72f2b5700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa72815d510 0x7fa7280b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:45.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.946+0000 7fa72f2b5700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa7280b6030 0x7fa728070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:45.952 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.946+0000 7fa72f2b5700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa72815d080 con 0x7fa7281534a0 2023-11-28T11:56:45.952 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.946+0000 7fa72f2b5700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa72815d940 con 0x7fa7280b6030 2023-11-28T11:56:45.952 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.946+0000 7fa72f2b5700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa728153870 con 0x7fa72815d510 2023-11-28T11:56:45.952 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.950+0000 7fa72d051700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fa7281534a0 0x7fa728160920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:38580/0 (socket says 172.21.15.39:38580) 2023-11-28T11:56:45.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.950+0000 7fa72d051700 1 -- 172.21.15.39:0/2440333305 learned_addr learned my addr 172.21.15.39:0/2440333305 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:56:45.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.950+0000 7fa72d852700 1 --2- 172.21.15.39:0/2440333305 >> v2:172.21.15.39:3300/0 conn(0x7fa7280b6030 0x7fa728070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:45.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.950+0000 7fa72c850700 1 --2- 172.21.15.39:0/2440333305 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa72815d510 0x7fa7280b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:45.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.950+0000 7fa72d852700 1 -- 172.21.15.39:0/2440333305 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa72815d510 msgr2=0x7fa7280b5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:45.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.950+0000 7fa72d852700 1 --2- 172.21.15.39:0/2440333305 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa72815d510 0x7fa7280b5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:45.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.950+0000 7fa72d852700 1 -- 172.21.15.39:0/2440333305 >> v1:172.21.15.184:6789/0 conn(0x7fa7281534a0 legacy=0x7fa728160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:45.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.950+0000 7fa72d852700 1 -- 172.21.15.39:0/2440333305 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7280b6450 con 0x7fa7280b6030 2023-11-28T11:56:45.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.950+0000 7fa72d852700 1 --2- 172.21.15.39:0/2440333305 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7280b6030 0x7fa728070630 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa720009d90 tx=0x7fa72000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=377cc8eb64e352ca server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:45.960 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.958+0000 7fa71ffff700 1 -- 172.21.15.39:0/2440333305 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72000e070 con 0x7fa7280b6030 2023-11-28T11:56:45.960 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.958+0000 7fa71ffff700 1 -- 172.21.15.39:0/2440333305 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72000bb20 con 0x7fa7280b6030 2023-11-28T11:56:45.960 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.958+0000 7fa71ffff700 1 -- 172.21.15.39:0/2440333305 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa720012430 con 0x7fa7280b6030 2023-11-28T11:56:45.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.958+0000 7fa72f2b5700 1 -- 172.21.15.39:0/2440333305 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7280b6030 msgr2=0x7fa728070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:45.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.958+0000 7fa72f2b5700 1 --2- 172.21.15.39:0/2440333305 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7280b6030 0x7fa728070630 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa720009d90 tx=0x7fa72000b330 comp rx=0 tx=0).stop 2023-11-28T11:56:45.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.958+0000 7fa72f2b5700 1 -- 172.21.15.39:0/2440333305 shutdown_connections 2023-11-28T11:56:45.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.958+0000 7fa72f2b5700 1 --2- 172.21.15.39:0/2440333305 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7280b6030 0x7fa728070630 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:45.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.958+0000 7fa72f2b5700 1 --2- 172.21.15.39:0/2440333305 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa72815d510 0x7fa7280b5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:45.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.958+0000 7fa72f2b5700 1 -- 172.21.15.39:0/2440333305 >> 172.21.15.39:0/2440333305 conn(0x7fa72806bfc0 msgr2=0x7fa72806c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:45.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.958+0000 7fa72f2b5700 1 -- 172.21.15.39:0/2440333305 shutdown_connections 2023-11-28T11:56:45.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.958+0000 7fa72f2b5700 1 -- 172.21.15.39:0/2440333305 wait complete. 2023-11-28T11:56:45.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.962+0000 7fa72f2b5700 1 Processor -- start 2023-11-28T11:56:45.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.962+0000 7fa72f2b5700 1 -- start start 2023-11-28T11:56:45.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.962+0000 7fa72f2b5700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7280b6030 0x7fa728151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:45.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.962+0000 7fa72f2b5700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7281534a0 0x7fa7280cff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:45.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.962+0000 7fa72f2b5700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa72815d510 0x7fa7281f17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:45.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.962+0000 7fa72f2b5700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa728155cf0 con 0x7fa7281534a0 2023-11-28T11:56:45.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.962+0000 7fa72f2b5700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa728151cd0 con 0x7fa7280b6030 2023-11-28T11:56:45.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.962+0000 7fa72f2b5700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa728155070 con 0x7fa72815d510 2023-11-28T11:56:45.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.962+0000 7fa72c850700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7281534a0 0x7fa7280cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:45.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.962+0000 7fa72c850700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7281534a0 0x7fa7280cff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55548/0 (socket says 172.21.15.39:55548) 2023-11-28T11:56:45.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.962+0000 7fa72c850700 1 -- 172.21.15.39:0/2502621613 learned_addr learned my addr 172.21.15.39:0/2502621613 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:45.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.962+0000 7fa72d051700 1 --2- 172.21.15.39:0/2502621613 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7280b6030 0x7fa728151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:45.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.962+0000 7fa72d852700 1 --2- 172.21.15.39:0/2502621613 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa72815d510 0x7fa7281f17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:45.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.966+0000 7fa72c850700 1 -- 172.21.15.39:0/2502621613 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa72815d510 msgr2=0x7fa7281f17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:45.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.966+0000 7fa72c850700 1 --2- 172.21.15.39:0/2502621613 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa72815d510 0x7fa7281f17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:45.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.966+0000 7fa72c850700 1 -- 172.21.15.39:0/2502621613 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7280b6030 msgr2=0x7fa728151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:45.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.966+0000 7fa72c850700 1 --2- 172.21.15.39:0/2502621613 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7280b6030 0x7fa728151790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:45.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.966+0000 7fa72c850700 1 -- 172.21.15.39:0/2502621613 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa720009a70 con 0x7fa7281534a0 2023-11-28T11:56:45.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.966+0000 7fa72d051700 1 --2- 172.21.15.39:0/2502621613 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7280b6030 0x7fa728151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:45.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.966+0000 7fa72c850700 1 --2- 172.21.15.39:0/2502621613 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7281534a0 0x7fa7280cff70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa71800e9d0 tx=0x7fa71800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:45.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.966+0000 7fa71dffb700 1 -- 172.21.15.39:0/2502621613 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa718009720 con 0x7fa7281534a0 2023-11-28T11:56:45.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.966+0000 7fa71dffb700 1 -- 172.21.15.39:0/2502621613 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa71800c850 con 0x7fa7281534a0 2023-11-28T11:56:45.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.966+0000 7fa72f2b5700 1 -- 172.21.15.39:0/2502621613 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7280b56a0 con 0x7fa7281534a0 2023-11-28T11:56:45.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.966+0000 7fa71dffb700 1 -- 172.21.15.39:0/2502621613 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa71800cbc0 con 0x7fa7281534a0 2023-11-28T11:56:45.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.966+0000 7fa72f2b5700 1 -- 172.21.15.39:0/2502621613 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7280b53c0 con 0x7fa7281534a0 2023-11-28T11:56:45.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.966+0000 7fa72f2b5700 1 -- 172.21.15.39:0/2502621613 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa72815ca30 con 0x7fa7281534a0 2023-11-28T11:56:45.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.970+0000 7fa71dffb700 1 -- 172.21.15.39:0/2502621613 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa718019030 con 0x7fa7281534a0 2023-11-28T11:56:45.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.970+0000 7fa71dffb700 1 --2- 172.21.15.39:0/2502621613 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa70c064ee0 0x7fa70c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:45.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.970+0000 7fa71dffb700 1 -- 172.21.15.39:0/2502621613 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa7180821d0 con 0x7fa7281534a0 2023-11-28T11:56:45.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.970+0000 7fa72d051700 1 --2- 172.21.15.39:0/2502621613 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa70c064ee0 0x7fa70c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:45.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.974+0000 7fa72d051700 1 --2- 172.21.15.39:0/2502621613 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa70c064ee0 0x7fa70c067390 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa724007fd0 tx=0x7fa724009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:45.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:45.978+0000 7fa71dffb700 1 -- 172.21.15.39:0/2502621613 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa71804ff90 con 0x7fa7281534a0 2023-11-28T11:56:46.199 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.194+0000 7fa72f2b5700 1 -- 172.21.15.39:0/2502621613 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa728071880 con 0x7fa7281534a0 2023-11-28T11:56:46.201 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.198+0000 7fa71dffb700 1 -- 172.21.15.39:0/2502621613 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4647 (secure 0 0 0) 0x7fa7180535b0 con 0x7fa7281534a0 2023-11-28T11:56:46.201 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:56:46.201 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4265,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1518942402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":1518942402},{"type":"v1","addr":"172.21.15.184:6837","nonce":1518942402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/1834562481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":1834562481},{"type":"v1","addr":"172.21.15.39:6833","nonce":1834562481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2470756838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2470756838},{"type":"v1","addr":"172.21.15.39:6835","nonce":2470756838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:56:39.894634+0000","modified":"2023-11-28T11:56:44.439910+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6835/516507254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":516507254},{"type":"v1","addr":"172.21.15.184:6835","nonce":516507254}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-11-28T11:56:46.206 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.202+0000 7fa72f2b5700 1 -- 172.21.15.39:0/2502621613 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa70c064ee0 msgr2=0x7fa70c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:46.206 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.202+0000 7fa72f2b5700 1 --2- 172.21.15.39:0/2502621613 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa70c064ee0 0x7fa70c067390 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa724007fd0 tx=0x7fa724009040 comp rx=0 tx=0).stop 2023-11-28T11:56:46.206 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.202+0000 7fa72f2b5700 1 -- 172.21.15.39:0/2502621613 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7281534a0 msgr2=0x7fa7280cff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:46.206 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.202+0000 7fa72f2b5700 1 --2- 172.21.15.39:0/2502621613 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7281534a0 0x7fa7280cff70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa71800e9d0 tx=0x7fa71800ece0 comp rx=0 tx=0).stop 2023-11-28T11:56:46.206 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.202+0000 7fa72f2b5700 1 -- 172.21.15.39:0/2502621613 shutdown_connections 2023-11-28T11:56:46.206 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.202+0000 7fa72f2b5700 1 --2- 172.21.15.39:0/2502621613 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa72815d510 0x7fa7281f17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:46.206 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.202+0000 7fa72f2b5700 1 --2- 172.21.15.39:0/2502621613 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7281534a0 0x7fa7280cff70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:46.206 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.202+0000 7fa72f2b5700 1 --2- 172.21.15.39:0/2502621613 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa70c064ee0 0x7fa70c067390 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:46.206 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.202+0000 7fa72f2b5700 1 --2- 172.21.15.39:0/2502621613 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7280b6030 0x7fa728151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:46.206 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.202+0000 7fa72f2b5700 1 -- 172.21.15.39:0/2502621613 >> 172.21.15.39:0/2502621613 conn(0x7fa72806bfc0 msgr2=0x7fa72806c390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:46.207 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.202+0000 7fa72f2b5700 1 -- 172.21.15.39:0/2502621613 shutdown_connections 2023-11-28T11:56:46.207 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.202+0000 7fa72f2b5700 1 -- 172.21.15.39:0/2502621613 wait complete. 2023-11-28T11:56:46.208 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 7 2023-11-28T11:56:46.629 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T11:56:39.894634+0000', 'modified': '2023-11-28T11:56:44.439910+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4288}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4288': {'gid': 4288, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.184:6835/516507254', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6834', 'nonce': 516507254}, {'type': 'v1', 'addr': '172.21.15.184:6835', 'nonce': 516507254}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-11-28T11:56:46.629 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T11:56:46.629 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-28T11:56:46.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.810+0000 7ff79f59e700 1 Processor -- start 2023-11-28T11:56:46.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.810+0000 7ff79f59e700 1 -- start start 2023-11-28T11:56:46.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.814+0000 7ff79f59e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff7a00b1640 0x7ff7a0070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:46.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.814+0000 7ff79f59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7a00c9040 0x7ff7a00705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:46.819 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.814+0000 7ff79f59e700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7a015a550 con 0x7ff7a00b43a0 2023-11-28T11:56:46.819 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.814+0000 7ff79f59e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7a006b0a0 con 0x7ff7a00b1640 2023-11-28T11:56:46.819 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.814+0000 7ff79f59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a00caac0 con 0x7ff7a00c9040 2023-11-28T11:56:46.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.814+0000 7ff79e59c700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7ff7a00b43a0 0x7ff7a015e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60304/0 (socket says 172.21.15.39:60304) 2023-11-28T11:56:46.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.814+0000 7ff79e59c700 1 -- 172.21.15.39:0/545388364 learned_addr learned my addr 172.21.15.39:0/545388364 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:56:46.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.814+0000 7ff79dd9b700 1 --2- 172.21.15.39:0/545388364 >> v2:172.21.15.184:3300/0 conn(0x7ff7a00b1640 0x7ff7a0070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:46.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.814+0000 7ff79ed9d700 1 --2- 172.21.15.39:0/545388364 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7a00c9040 0x7ff7a00705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:46.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.814+0000 7ff79d59a700 1 -- 172.21.15.39:0/545388364 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2372812253 0 0) 0x7ff790001110 con 0x7ff7a00b43a0 2023-11-28T11:56:46.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.814+0000 7ff79d59a700 1 -- 172.21.15.39:0/545388364 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7880035d0 con 0x7ff7a00b43a0 2023-11-28T11:56:46.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.818+0000 7ff79ed9d700 1 -- 172.21.15.39:0/545388364 >> v2:172.21.15.184:3300/0 conn(0x7ff7a00b1640 msgr2=0x7ff7a0070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:46.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.818+0000 7ff79ed9d700 1 --2- 172.21.15.39:0/545388364 >> v2:172.21.15.184:3300/0 conn(0x7ff7a00b1640 0x7ff7a0070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:46.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.818+0000 7ff79ed9d700 1 -- 172.21.15.39:0/545388364 >> v1:172.21.15.39:6789/0 conn(0x7ff7a00b43a0 legacy=0x7ff7a015e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:46.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.818+0000 7ff79ed9d700 1 -- 172.21.15.39:0/545388364 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a00cada0 con 0x7ff7a00c9040 2023-11-28T11:56:46.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.818+0000 7ff79ed9d700 1 --2- 172.21.15.39:0/545388364 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7a00c9040 0x7ff7a00705c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff798009d90 tx=0x7ff79800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bea0c4885f0d79af server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:46.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.818+0000 7ff79d59a700 1 -- 172.21.15.39:0/545388364 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79800e070 con 0x7ff7a00c9040 2023-11-28T11:56:46.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.818+0000 7ff79d59a700 1 -- 172.21.15.39:0/545388364 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79800bb20 con 0x7ff7a00c9040 2023-11-28T11:56:46.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.818+0000 7ff79d59a700 1 -- 172.21.15.39:0/545388364 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff798012430 con 0x7ff7a00c9040 2023-11-28T11:56:46.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.818+0000 7ff79f59e700 1 -- 172.21.15.39:0/545388364 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7a00c9040 msgr2=0x7ff7a00705c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:46.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.818+0000 7ff79f59e700 1 --2- 172.21.15.39:0/545388364 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7a00c9040 0x7ff7a00705c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff798009d90 tx=0x7ff79800b330 comp rx=0 tx=0).stop 2023-11-28T11:56:46.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.818+0000 7ff79f59e700 1 -- 172.21.15.39:0/545388364 shutdown_connections 2023-11-28T11:56:46.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.818+0000 7ff79f59e700 1 --2- 172.21.15.39:0/545388364 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7a00c9040 0x7ff7a00705c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:46.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.818+0000 7ff79f59e700 1 --2- 172.21.15.39:0/545388364 >> v2:172.21.15.184:3300/0 conn(0x7ff7a00b1640 0x7ff7a0070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:46.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.818+0000 7ff79f59e700 1 -- 172.21.15.39:0/545388364 >> 172.21.15.39:0/545388364 conn(0x7ff7a00b0f80 msgr2=0x7ff7a00ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:46.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.818+0000 7ff79f59e700 1 -- 172.21.15.39:0/545388364 shutdown_connections 2023-11-28T11:56:46.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.818+0000 7ff79f59e700 1 -- 172.21.15.39:0/545388364 wait complete. 2023-11-28T11:56:46.825 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.822+0000 7ff79f59e700 1 Processor -- start 2023-11-28T11:56:46.825 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.822+0000 7ff79f59e700 1 -- start start 2023-11-28T11:56:46.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.822+0000 7ff79f59e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7a00b1640 0x7ff7a01547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:46.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.822+0000 7ff79f59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7a00b43a0 0x7ff7a00ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:46.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.822+0000 7ff79f59e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7a00c9040 0x7ff7a0156450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:46.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.822+0000 7ff79f59e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a00cdb40 con 0x7ff7a00b1640 2023-11-28T11:56:46.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.822+0000 7ff79f59e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a00ad0f0 con 0x7ff7a00c9040 2023-11-28T11:56:46.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.822+0000 7ff79f59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a00ad3d0 con 0x7ff7a00b43a0 2023-11-28T11:56:46.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.822+0000 7ff79e59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7a00b1640 0x7ff7a01547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:46.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.822+0000 7ff79e59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7a00b1640 0x7ff7a01547e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55554/0 (socket says 172.21.15.39:55554) 2023-11-28T11:56:46.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.822+0000 7ff79e59c700 1 -- 172.21.15.39:0/504285207 learned_addr learned my addr 172.21.15.39:0/504285207 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:46.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.822+0000 7ff79ed9d700 1 --2- 172.21.15.39:0/504285207 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7a00c9040 0x7ff7a0156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:46.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.822+0000 7ff79dd9b700 1 --2- 172.21.15.39:0/504285207 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7a00b43a0 0x7ff7a00ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:46.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.826+0000 7ff79e59c700 1 -- 172.21.15.39:0/504285207 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7a00b43a0 msgr2=0x7ff7a00ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:46.829 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.826+0000 7ff79e59c700 1 --2- 172.21.15.39:0/504285207 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7a00b43a0 0x7ff7a00ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:46.829 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.826+0000 7ff79e59c700 1 -- 172.21.15.39:0/504285207 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7a00c9040 msgr2=0x7ff7a0156450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:46.829 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.826+0000 7ff79e59c700 1 --2- 172.21.15.39:0/504285207 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7a00c9040 0x7ff7a0156450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:46.829 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.826+0000 7ff79e59c700 1 -- 172.21.15.39:0/504285207 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff798009a70 con 0x7ff7a00b1640 2023-11-28T11:56:46.830 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.826+0000 7ff79e59c700 1 --2- 172.21.15.39:0/504285207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7a00b1640 0x7ff7a01547e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff790001270 tx=0x7ff79000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:46.830 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.826+0000 7ff78effd700 1 -- 172.21.15.39:0/504285207 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff790005d90 con 0x7ff7a00b1640 2023-11-28T11:56:46.830 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.826+0000 7ff78effd700 1 -- 172.21.15.39:0/504285207 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7900070d0 con 0x7ff7a00b1640 2023-11-28T11:56:46.830 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.826+0000 7ff79f59e700 1 -- 172.21.15.39:0/504285207 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7a006b5d0 con 0x7ff7a00b1640 2023-11-28T11:56:46.830 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.826+0000 7ff78effd700 1 -- 172.21.15.39:0/504285207 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff790007480 con 0x7ff7a00b1640 2023-11-28T11:56:46.830 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.826+0000 7ff79f59e700 1 -- 172.21.15.39:0/504285207 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7a006b2f0 con 0x7ff7a00b1640 2023-11-28T11:56:46.832 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.830+0000 7ff78effd700 1 -- 172.21.15.39:0/504285207 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff790019030 con 0x7ff7a00b1640 2023-11-28T11:56:46.834 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.830+0000 7ff78effd700 1 --2- 172.21.15.39:0/504285207 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff780064f10 0x7ff7800673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:46.834 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.830+0000 7ff78effd700 1 -- 172.21.15.39:0/504285207 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff7900813f0 con 0x7ff7a00b1640 2023-11-28T11:56:46.835 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.830+0000 7ff79dd9b700 1 --2- 172.21.15.39:0/504285207 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff780064f10 0x7ff7800673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:46.836 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.830+0000 7ff79dd9b700 1 --2- 172.21.15.39:0/504285207 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff780064f10 0x7ff7800673c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff7a015e740 tx=0x7ff794009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:46.836 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.830+0000 7ff7a817f740 1 Processor -- start 2023-11-28T11:56:46.836 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.834+0000 7ff7a817f740 1 -- start start 2023-11-28T11:56:46.839 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.834+0000 7ff7a817f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1f79ae0 0x2239800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:46.839 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.834+0000 7ff7a817f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1f79710 0x2239d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:46.839 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.834+0000 7ff7a817f740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1fc4790 0x2229e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:46.839 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.834+0000 7ff7a817f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x20e8ae0 con 0x1f79710 2023-11-28T11:56:46.840 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.834+0000 7ff7a817f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x2158bd0 con 0x1f79ae0 2023-11-28T11:56:46.840 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.834+0000 7ff7a817f740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x2151ed0 con 0x1fc4790 2023-11-28T11:56:46.840 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.834+0000 7ff79dd9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1f79710 0x2239d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:46.840 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.834+0000 7ff79dd9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1f79710 0x2239d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55566/0 (socket says 172.21.15.39:55566) 2023-11-28T11:56:46.840 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.834+0000 7ff79dd9b700 1 -- 172.21.15.39:0/3456449954 learned_addr learned my addr 172.21.15.39:0/3456449954 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:46.841 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.834+0000 7ff79ed9d700 1 --2- 172.21.15.39:0/3456449954 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1fc4790 0x2229e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:46.841 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.834+0000 7ff79e59c700 1 --2- 172.21.15.39:0/3456449954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1f79ae0 0x2239800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:46.841 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.834+0000 7ff79dd9b700 1 -- 172.21.15.39:0/3456449954 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1fc4790 msgr2=0x2229e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:46.841 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.834+0000 7ff79dd9b700 1 --2- 172.21.15.39:0/3456449954 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1fc4790 0x2229e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:46.841 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.834+0000 7ff79dd9b700 1 -- 172.21.15.39:0/3456449954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1f79ae0 msgr2=0x2239800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:46.842 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.834+0000 7ff79dd9b700 1 --2- 172.21.15.39:0/3456449954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1f79ae0 0x2239800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:46.842 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.834+0000 7ff79dd9b700 1 -- 172.21.15.39:0/3456449954 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2177cc0 con 0x1f79710 2023-11-28T11:56:46.842 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.834+0000 7ff79ed9d700 1 --2- 172.21.15.39:0/3456449954 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1fc4790 0x2229e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:46.842 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.834+0000 7ff79e59c700 1 --2- 172.21.15.39:0/3456449954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1f79ae0 0x2239800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:46.846 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.834+0000 7ff79dd9b700 1 --2- 172.21.15.39:0/3456449954 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1f79710 0x2239d40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff794004590 tx=0x7ff794009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7908f5ae927ba60 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:46.846 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.838+0000 7ff77ffff700 1 -- 172.21.15.39:0/3456449954 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79401c040 con 0x1f79710 2023-11-28T11:56:46.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.838+0000 7ff77ffff700 1 -- 172.21.15.39:0/3456449954 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7940045c0 con 0x1f79710 2023-11-28T11:56:46.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.838+0000 7ff77ffff700 1 -- 172.21.15.39:0/3456449954 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff794003ad0 con 0x1f79710 2023-11-28T11:56:46.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.838+0000 7ff7a817f740 1 -- 172.21.15.39:0/3456449954 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1f79710 msgr2=0x2239d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:46.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.838+0000 7ff7a817f740 1 --2- 172.21.15.39:0/3456449954 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1f79710 0x2239d40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff794004590 tx=0x7ff794009f90 comp rx=0 tx=0).stop 2023-11-28T11:56:46.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.838+0000 7ff7a817f740 1 -- 172.21.15.39:0/3456449954 shutdown_connections 2023-11-28T11:56:46.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.838+0000 7ff7a817f740 1 --2- 172.21.15.39:0/3456449954 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1fc4790 0x2229e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:46.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.838+0000 7ff7a817f740 1 --2- 172.21.15.39:0/3456449954 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1f79710 0x2239d40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:46.848 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.838+0000 7ff7a817f740 1 --2- 172.21.15.39:0/3456449954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1f79ae0 0x2239800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:46.848 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.838+0000 7ff7a817f740 1 -- 172.21.15.39:0/3456449954 >> 172.21.15.39:0/3456449954 conn(0x1f79eb0 msgr2=0x2212700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:46.848 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.838+0000 7ff7a817f740 1 -- 172.21.15.39:0/3456449954 shutdown_connections 2023-11-28T11:56:46.848 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.838+0000 7ff7a817f740 1 -- 172.21.15.39:0/3456449954 wait complete. 2023-11-28T11:56:46.848 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.838+0000 7ff7a817f740 1 -- start start 2023-11-28T11:56:46.848 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.838+0000 7ff7a817f740 1 Processor -- start 2023-11-28T11:56:46.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.842+0000 7ff7a817f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1f79710 0x21e9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:46.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.842+0000 7ff7a817f740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1f79ae0 0x21e9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:46.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.842+0000 7ff7a817f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1fc4790 0x220aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:46.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.842+0000 7ff7a817f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ffeb20 con 0x1fc4790 2023-11-28T11:56:46.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.842+0000 7ff7a817f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x21ea550 con 0x1f79710 2023-11-28T11:56:46.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.842+0000 7ff7a817f740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x21e5000 con 0x1f79ae0 2023-11-28T11:56:46.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.842+0000 7ff7a817f740 10 client.0 _ll_register_callbacks cb 0x21ae0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:56:46.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.842+0000 7ff79ed9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1fc4790 0x220aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:46.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.842+0000 7ff79ed9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1fc4790 0x220aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55574/0 (socket says 172.21.15.39:55574) 2023-11-28T11:56:46.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.842+0000 7ff79ed9d700 1 -- 172.21.15.39:0/3360174692 learned_addr learned my addr 172.21.15.39:0/3360174692 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:46.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.842+0000 7ff79e59c700 1 --2- 172.21.15.39:0/3360174692 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1f79710 0x21e9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:46.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.842+0000 7ff79dd9b700 1 --2- 172.21.15.39:0/3360174692 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1f79ae0 0x21e9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:46.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.842+0000 7ff79e59c700 1 -- 172.21.15.39:0/3360174692 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1f79ae0 msgr2=0x21e9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:46.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.842+0000 7ff79e59c700 1 --2- 172.21.15.39:0/3360174692 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1f79ae0 0x21e9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:46.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.842+0000 7ff79e59c700 1 -- 172.21.15.39:0/3360174692 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1fc4790 msgr2=0x220aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:46.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.842+0000 7ff79e59c700 1 --2- 172.21.15.39:0/3360174692 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1fc4790 0x220aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:46.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.842+0000 7ff79e59c700 1 -- 172.21.15.39:0/3360174692 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff794004210 con 0x1f79710 2023-11-28T11:56:46.852 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.842+0000 7ff79ed9d700 1 --2- 172.21.15.39:0/3360174692 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1fc4790 0x220aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:46.852 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.842+0000 7ff79e59c700 1 --2- 172.21.15.39:0/3360174692 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1f79710 0x21e9510 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff79007f6d0 tx=0x7ff7900512e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22bb400adbe68975 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:46.852 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.842+0000 7ff77d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2023-11-28T11:56:46.855 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.842+0000 7ff77d7fa700 1 -- 172.21.15.39:0/3360174692 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff790052630 con 0x1f79710 2023-11-28T11:56:46.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.842+0000 7ff77d7fa700 1 -- 172.21.15.39:0/3360174692 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff79005ac70 con 0x1f79710 2023-11-28T11:56:46.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.842+0000 7ff7a817f740 1 -- 172.21.15.39:0/3360174692 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x214af50 con 0x1f79710 2023-11-28T11:56:46.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.842+0000 7ff77d7fa700 1 -- 172.21.15.39:0/3360174692 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff79006a1c0 con 0x1f79710 2023-11-28T11:56:46.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.842+0000 7ff7a817f740 10 client.4435 fetch_fsmap learned FSMap version 7 2023-11-28T11:56:46.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.842+0000 7ff7a817f740 1 -- 172.21.15.39:0/3360174692 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x1fc59e0 con 0x1f79710 2023-11-28T11:56:46.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.846+0000 7ff77d7fa700 1 -- 172.21.15.39:0/3360174692 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x214af50 con 0x1f79710 2023-11-28T11:56:46.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.846+0000 7ff77d7fa700 1 -- 172.21.15.39:0/3360174692 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 7) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ff79007f260 con 0x1f79710 2023-11-28T11:56:46.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.846+0000 7ff7a817f740 10 client.4435 fetch_fsmap finished waiting for FSMap version 7 2023-11-28T11:56:46.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.846+0000 7ff7a817f740 10 client.4435 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-28T11:56:46.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.846+0000 7ff7a817f740 20 client.4435 populate_metadata read hostname 'smithi039' 2023-11-28T11:56:46.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.846+0000 7ff7a817f740 1 --2- 172.21.15.39:0/3360174692 >> [v2:172.21.15.184:6834/516507254,v1:172.21.15.184:6835/516507254] conn(0x220b300 0x2242fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:46.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.846+0000 7ff7a817f740 4 client.4435 mds_command: new command op to 4288 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T11:56:46.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.846+0000 7ff7a817f740 1 -- 172.21.15.39:0/3360174692 --> [v2:172.21.15.184:6834/516507254,v1:172.21.15.184:6835/516507254] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x214ac70 con 0x220b300 2023-11-28T11:56:46.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.846+0000 7ff79dd9b700 1 --2- 172.21.15.39:0/3360174692 >> [v2:172.21.15.184:6834/516507254,v1:172.21.15.184:6835/516507254] conn(0x220b300 0x2242fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:46.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.846+0000 7ff79dd9b700 1 --2- 172.21.15.39:0/3360174692 >> [v2:172.21.15.184:6834/516507254,v1:172.21.15.184:6835/516507254] conn(0x220b300 0x2242fc0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2348d46677eaddd server_cookie=b99229526f67f4e3 in_seq=0 out_seq=0 2023-11-28T11:56:46.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.846+0000 7ff77d7fa700 10 client.4435 ms_handle_connect on v2:172.21.15.184:6834/516507254 2023-11-28T11:56:46.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.850+0000 7ff77d7fa700 1 -- 172.21.15.39:0/3360174692 <== mds.0 v2:172.21.15.184:6834/516507254 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x214ac70 con 0x220b300 2023-11-28T11:56:46.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.850+0000 7ff77d7fa700 10 client.4435 handle_command_reply: tid=0 2023-11-28T11:56:46.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.850+0000 7ff7a817f740 1 client.4435 shutdown 2023-11-28T11:56:46.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.850+0000 7ff7a817f740 1 -- 172.21.15.39:0/3360174692 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1f79710 msgr2=0x21e9510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:46.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.850+0000 7ff7a817f740 1 --2- 172.21.15.39:0/3360174692 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1f79710 0x21e9510 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff79007f6d0 tx=0x7ff7900512e0 comp rx=0 tx=0).stop 2023-11-28T11:56:46.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.850+0000 7ff7a817f740 1 -- 172.21.15.39:0/3360174692 shutdown_connections 2023-11-28T11:56:46.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.850+0000 7ff7a817f740 1 --2- 172.21.15.39:0/3360174692 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1fc4790 0x220aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:46.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.850+0000 7ff7a817f740 1 --2- 172.21.15.39:0/3360174692 >> [v2:172.21.15.184:6834/516507254,v1:172.21.15.184:6835/516507254] conn(0x220b300 0x2242fc0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:46.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.850+0000 7ff7a817f740 1 --2- 172.21.15.39:0/3360174692 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1f79ae0 0x21e9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:46.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.850+0000 7ff7a817f740 1 --2- 172.21.15.39:0/3360174692 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1f79710 0x21e9510 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:46.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.850+0000 7ff7a817f740 1 -- 172.21.15.39:0/3360174692 >> 172.21.15.39:0/3360174692 conn(0x1f79eb0 msgr2=0x220ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:46.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.850+0000 7ff77d7fa700 0 client.4435 ms_handle_reset on v2:172.21.15.184:6834/516507254 2023-11-28T11:56:46.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.850+0000 7ff7a817f740 1 -- 172.21.15.39:0/3360174692 shutdown_connections 2023-11-28T11:56:46.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.850+0000 7ff7a817f740 1 -- 172.21.15.39:0/3360174692 wait complete. 2023-11-28T11:56:46.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.850+0000 7ff7a817f740 20 client.4435 trim_cache size 0 max 16384 2023-11-28T11:56:46.874 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.870+0000 7ff7a817f740 1 Processor -- start 2023-11-28T11:56:46.874 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.870+0000 7ff7a817f740 1 -- start start 2023-11-28T11:56:46.875 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.870+0000 7ff7a817f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1f79710 0x22382e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:46.875 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.870+0000 7ff7a817f740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1f79ae0 0x2238820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:46.875 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.870+0000 7ff7a817f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1fc4790 0x220a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:46.875 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.870+0000 7ff7a817f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x220c7f0 con 0x1f79710 2023-11-28T11:56:46.875 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.870+0000 7ff7a817f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x2191070 con 0x1fc4790 2023-11-28T11:56:46.875 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.870+0000 7ff7a817f740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x2156b40 con 0x1f79ae0 2023-11-28T11:56:46.875 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.870+0000 7ff79e59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1f79710 0x22382e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:46.875 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.870+0000 7ff79e59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1f79710 0x22382e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55578/0 (socket says 172.21.15.39:55578) 2023-11-28T11:56:46.875 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.870+0000 7ff79e59c700 1 -- 172.21.15.39:0/3105640827 learned_addr learned my addr 172.21.15.39:0/3105640827 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:46.876 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.870+0000 7ff79dd9b700 1 --2- 172.21.15.39:0/3105640827 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1f79ae0 0x2238820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:46.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.870+0000 7ff79ed9d700 1 --2- 172.21.15.39:0/3105640827 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1fc4790 0x220a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:46.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.870+0000 7ff79e59c700 1 -- 172.21.15.39:0/3105640827 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1f79ae0 msgr2=0x2238820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:46.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.870+0000 7ff79e59c700 1 --2- 172.21.15.39:0/3105640827 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1f79ae0 0x2238820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:46.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.870+0000 7ff79e59c700 1 -- 172.21.15.39:0/3105640827 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1fc4790 msgr2=0x220a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:46.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.870+0000 7ff79e59c700 1 --2- 172.21.15.39:0/3105640827 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1fc4790 0x220a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:46.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.870+0000 7ff79e59c700 1 -- 172.21.15.39:0/3105640827 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a0156cf0 con 0x1f79710 2023-11-28T11:56:46.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.870+0000 7ff79dd9b700 1 --2- 172.21.15.39:0/3105640827 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1f79ae0 0x2238820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:56:46.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.870+0000 7ff79ed9d700 1 --2- 172.21.15.39:0/3105640827 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1fc4790 0x220a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:56:46.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.870+0000 7ff79e59c700 1 --2- 172.21.15.39:0/3105640827 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1f79710 0x22382e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff790001370 tx=0x7ff790014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b3a61de1f1cf0e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:46.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.874+0000 7ff78cff9700 1 -- 172.21.15.39:0/3105640827 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79006a1c0 con 0x1f79710 2023-11-28T11:56:46.878 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.874+0000 7ff78cff9700 1 -- 172.21.15.39:0/3105640827 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff790051260 con 0x1f79710 2023-11-28T11:56:46.878 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.874+0000 7ff78cff9700 1 -- 172.21.15.39:0/3105640827 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff790052630 con 0x1f79710 2023-11-28T11:56:46.878 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.874+0000 7ff7a817f740 1 -- 172.21.15.39:0/3105640827 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1f79710 msgr2=0x22382e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:46.879 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.874+0000 7ff7a817f740 1 --2- 172.21.15.39:0/3105640827 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1f79710 0x22382e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff790001370 tx=0x7ff790014000 comp rx=0 tx=0).stop 2023-11-28T11:56:46.879 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.874+0000 7ff7a817f740 1 -- 172.21.15.39:0/3105640827 shutdown_connections 2023-11-28T11:56:46.879 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.874+0000 7ff7a817f740 1 --2- 172.21.15.39:0/3105640827 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1fc4790 0x220a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:46.879 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.874+0000 7ff7a817f740 1 --2- 172.21.15.39:0/3105640827 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1f79ae0 0x2238820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:46.879 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.874+0000 7ff7a817f740 1 --2- 172.21.15.39:0/3105640827 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1f79710 0x22382e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:46.879 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.874+0000 7ff7a817f740 1 -- 172.21.15.39:0/3105640827 >> 172.21.15.39:0/3105640827 conn(0x1f79eb0 msgr2=0x220bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:46.879 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.874+0000 7ff7a817f740 1 -- 172.21.15.39:0/3105640827 shutdown_connections 2023-11-28T11:56:46.879 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.874+0000 7ff7a817f740 1 -- 172.21.15.39:0/3105640827 wait complete. 2023-11-28T11:56:46.879 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.874+0000 7ff7a817f740 1 -- start start 2023-11-28T11:56:46.880 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.874+0000 7ff7a817f740 1 Processor -- start 2023-11-28T11:56:46.882 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.878+0000 7ff7a817f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1f79ae0 0x2249880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:46.882 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.878+0000 7ff7a817f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1fc4790 0x224bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:46.882 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.878+0000 7ff7a817f740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x22986b0 0x224c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:46.882 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.878+0000 7ff7a817f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x224b900 con 0x1f79ae0 2023-11-28T11:56:46.882 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.878+0000 7ff7a817f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x2298a80 con 0x1fc4790 2023-11-28T11:56:46.882 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.878+0000 7ff7a817f740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x21e9c40 con 0x22986b0 2023-11-28T11:56:46.882 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.878+0000 7ff7a817f740 10 client.0 _ll_register_callbacks cb 0x20fe2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:56:46.884 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.878+0000 7ff79e59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1f79ae0 0x2249880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:46.884 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.878+0000 7ff79e59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1f79ae0 0x2249880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55584/0 (socket says 172.21.15.39:55584) 2023-11-28T11:56:46.884 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.878+0000 7ff79e59c700 1 -- 172.21.15.39:0/421280036 learned_addr learned my addr 172.21.15.39:0/421280036 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:46.884 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.878+0000 7ff79ed9d700 1 --2- 172.21.15.39:0/421280036 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x22986b0 0x224c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:46.884 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.878+0000 7ff79dd9b700 1 --2- 172.21.15.39:0/421280036 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1fc4790 0x224bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:46.884 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.878+0000 7ff79e59c700 1 -- 172.21.15.39:0/421280036 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x22986b0 msgr2=0x224c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:46.884 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.878+0000 7ff79e59c700 1 --2- 172.21.15.39:0/421280036 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x22986b0 0x224c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:46.884 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.878+0000 7ff79e59c700 1 -- 172.21.15.39:0/421280036 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1fc4790 msgr2=0x224bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:46.885 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.878+0000 7ff79e59c700 1 --2- 172.21.15.39:0/421280036 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1fc4790 0x224bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:46.885 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.878+0000 7ff79e59c700 1 -- 172.21.15.39:0/421280036 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1fc59e0 con 0x1f79ae0 2023-11-28T11:56:46.885 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.878+0000 7ff79e59c700 1 --2- 172.21.15.39:0/421280036 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1f79ae0 0x2249880 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff79004f890 tx=0x7ff7900012a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79cb3898b2b66c67 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:46.885 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.878+0000 7ff77d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-11-28T11:56:46.885 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.878+0000 7ff77d7fa700 1 -- 172.21.15.39:0/421280036 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff790052be0 con 0x1f79ae0 2023-11-28T11:56:46.885 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.878+0000 7ff77d7fa700 1 -- 172.21.15.39:0/421280036 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff79005aa70 con 0x1f79ae0 2023-11-28T11:56:46.885 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.878+0000 7ff7a817f740 1 -- 172.21.15.39:0/421280036 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff7940045c0 con 0x1f79ae0 2023-11-28T11:56:46.886 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.878+0000 7ff77d7fa700 1 -- 172.21.15.39:0/421280036 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff79005ac30 con 0x1f79ae0 2023-11-28T11:56:46.886 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.882+0000 7ff7a817f740 10 client.4413 fetch_fsmap learned FSMap version 7 2023-11-28T11:56:46.886 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.882+0000 7ff7a817f740 1 -- 172.21.15.39:0/421280036 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x20fea20 con 0x1f79ae0 2023-11-28T11:56:46.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.882+0000 7ff77d7fa700 1 -- 172.21.15.39:0/421280036 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7940045c0 con 0x1f79ae0 2023-11-28T11:56:46.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.882+0000 7ff77d7fa700 1 -- 172.21.15.39:0/421280036 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 7) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ff790075020 con 0x1f79ae0 2023-11-28T11:56:46.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.882+0000 7ff7a817f740 10 client.4413 fetch_fsmap finished waiting for FSMap version 7 2023-11-28T11:56:46.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.882+0000 7ff7a817f740 10 client.4413 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-28T11:56:46.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.882+0000 7ff7a817f740 20 client.4413 populate_metadata read hostname 'smithi039' 2023-11-28T11:56:46.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.882+0000 7ff7a817f740 1 --2- 172.21.15.39:0/421280036 >> [v2:172.21.15.184:6834/516507254,v1:172.21.15.184:6835/516507254] conn(0x224c990 0x224eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:46.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.882+0000 7ff7a817f740 4 client.4413 mds_command: new command op to 4288 tid=0[{"prefix": "status"}] 2023-11-28T11:56:46.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.882+0000 7ff7a817f740 1 -- 172.21.15.39:0/421280036 --> [v2:172.21.15.184:6834/516507254,v1:172.21.15.184:6835/516507254] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1ff6260 con 0x224c990 2023-11-28T11:56:46.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.882+0000 7ff79dd9b700 1 --2- 172.21.15.39:0/421280036 >> [v2:172.21.15.184:6834/516507254,v1:172.21.15.184:6835/516507254] conn(0x224c990 0x224eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:46.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.882+0000 7ff77d7fa700 10 client.4413 ms_handle_connect on v2:172.21.15.184:6834/516507254 2023-11-28T11:56:46.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.882+0000 7ff79dd9b700 1 --2- 172.21.15.39:0/421280036 >> [v2:172.21.15.184:6834/516507254,v1:172.21.15.184:6835/516507254] conn(0x224c990 0x224eeb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=146273e545c44767 server_cookie=89b890de417dd2fb in_seq=0 out_seq=0 2023-11-28T11:56:46.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.882+0000 7ff77d7fa700 1 -- 172.21.15.39:0/421280036 <== mds.0 v2:172.21.15.184:6834/516507254 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x1ff6260 con 0x224c990 2023-11-28T11:56:46.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.882+0000 7ff77d7fa700 10 client.4413 handle_command_reply: tid=0 2023-11-28T11:56:46.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.882+0000 7ff7a817f740 1 client.4413 shutdown 2023-11-28T11:56:46.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.882+0000 7ff7a817f740 1 -- 172.21.15.39:0/421280036 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1f79ae0 msgr2=0x2249880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:46.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.882+0000 7ff7a817f740 1 --2- 172.21.15.39:0/421280036 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1f79ae0 0x2249880 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff79004f890 tx=0x7ff7900012a0 comp rx=0 tx=0).stop 2023-11-28T11:56:46.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.882+0000 7ff7a817f740 1 -- 172.21.15.39:0/421280036 shutdown_connections 2023-11-28T11:56:46.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.882+0000 7ff7a817f740 1 --2- 172.21.15.39:0/421280036 >> [v2:172.21.15.184:6834/516507254,v1:172.21.15.184:6835/516507254] conn(0x224c990 0x224eeb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:46.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.882+0000 7ff7a817f740 1 --2- 172.21.15.39:0/421280036 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x22986b0 0x224c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:46.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.882+0000 7ff7a817f740 1 --2- 172.21.15.39:0/421280036 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1fc4790 0x224bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:46.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.882+0000 7ff7a817f740 1 --2- 172.21.15.39:0/421280036 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1f79ae0 0x2249880 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:46.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.882+0000 7ff7a817f740 1 -- 172.21.15.39:0/421280036 >> 172.21.15.39:0/421280036 conn(0x1f79eb0 msgr2=0x22384f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:46.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.882+0000 7ff77d7fa700 0 client.4413 ms_handle_reset on v2:172.21.15.184:6834/516507254 2023-11-28T11:56:46.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.882+0000 7ff7a817f740 1 -- 172.21.15.39:0/421280036 shutdown_connections 2023-11-28T11:56:46.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.882+0000 7ff7a817f740 1 -- 172.21.15.39:0/421280036 wait complete. 2023-11-28T11:56:46.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.886+0000 7ff7a817f740 20 client.4413 trim_cache size 0 max 16384 2023-11-28T11:56:46.891 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2023-11-28T11:56:46.891 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "67ce95b1-cd7e-4478-b863-c714ef275520", 2023-11-28T11:56:46.891 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 0, 2023-11-28T11:56:46.893 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 4288, 2023-11-28T11:56:46.893 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2023-11-28T11:56:46.893 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2023-11-28T11:56:46.893 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2023-11-28T11:56:46.894 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 6.9815278970000003, 2023-11-28T11:56:46.894 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 7, 2023-11-28T11:56:46.894 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 29, 2023-11-28T11:56:46.894 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 28, 2023-11-28T11:56:46.894 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 12.318302922999999 2023-11-28T11:56:46.894 INFO:teuthology.orchestra.run.smithi039.stdout:} 2023-11-28T11:56:46.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.886+0000 7ff79f59e700 1 -- 172.21.15.39:0/504285207 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff780064f10 msgr2=0x7ff7800673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:46.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.886+0000 7ff79f59e700 1 --2- 172.21.15.39:0/504285207 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff780064f10 0x7ff7800673c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff7a015e740 tx=0x7ff794009240 comp rx=0 tx=0).stop 2023-11-28T11:56:46.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.886+0000 7ff79f59e700 1 -- 172.21.15.39:0/504285207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7a00b1640 msgr2=0x7ff7a01547e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:46.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.886+0000 7ff79f59e700 1 --2- 172.21.15.39:0/504285207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7a00b1640 0x7ff7a01547e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff790001270 tx=0x7ff79000c9e0 comp rx=0 tx=0).stop 2023-11-28T11:56:46.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.886+0000 7ff79f59e700 1 -- 172.21.15.39:0/504285207 shutdown_connections 2023-11-28T11:56:46.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.886+0000 7ff79f59e700 1 --2- 172.21.15.39:0/504285207 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff780064f10 0x7ff7800673c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:46.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.886+0000 7ff79f59e700 1 --2- 172.21.15.39:0/504285207 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7a00c9040 0x7ff7a0156450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:46.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.886+0000 7ff79f59e700 1 --2- 172.21.15.39:0/504285207 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7a00b43a0 0x7ff7a00ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:46.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.886+0000 7ff79f59e700 1 --2- 172.21.15.39:0/504285207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7a00b1640 0x7ff7a01547e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:46.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.886+0000 7ff79f59e700 1 -- 172.21.15.39:0/504285207 >> 172.21.15.39:0/504285207 conn(0x7ff7a00b0f80 msgr2=0x7ff7a0159b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:46.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.886+0000 7ff79f59e700 1 -- 172.21.15.39:0/504285207 shutdown_connections 2023-11-28T11:56:46.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:46.886+0000 7ff79f59e700 1 -- 172.21.15.39:0/504285207 wait complete. 2023-11-28T11:56:46.912 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T11:56:46.912 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-11-28T11:56:46.912 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T11:56:47.101 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.098+0000 7f1fa66cb700 1 Processor -- start 2023-11-28T11:56:47.102 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.098+0000 7f1fa66cb700 1 -- start start 2023-11-28T11:56:47.105 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.102+0000 7f1fa66cb700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fa00b43a0 0x7f1fa015e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:47.105 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.102+0000 7f1fa66cb700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1fa0070790 0x7f1fa006bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:47.105 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.102+0000 7f1fa66cb700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fa015a550 con 0x7f1fa00b1640 2023-11-28T11:56:47.105 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.102+0000 7f1fa66cb700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa006b0a0 con 0x7f1fa0070790 2023-11-28T11:56:47.105 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.102+0000 7f1fa66cb700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa00caac0 con 0x7f1fa00b43a0 2023-11-28T11:56:47.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.102+0000 7f1fa5eca700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1fa0070790 0x7f1fa006bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:47.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.102+0000 7f1fa5eca700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1fa0070790 0x7f1fa006bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55600/0 (socket says 172.21.15.39:55600) 2023-11-28T11:56:47.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.102+0000 7f1fa5eca700 1 -- 172.21.15.39:0/2919079728 learned_addr learned my addr 172.21.15.39:0/2919079728 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:47.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.102+0000 7f1fa56c9700 1 --2- 172.21.15.39:0/2919079728 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fa00b43a0 0x7f1fa015e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:47.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.102+0000 7f1fa5eca700 1 -- 172.21.15.39:0/2919079728 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fa00b43a0 msgr2=0x7f1fa015e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:47.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.102+0000 7f1fa5eca700 1 --2- 172.21.15.39:0/2919079728 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fa00b43a0 0x7f1fa015e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:47.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.102+0000 7f1fa5eca700 1 -- 172.21.15.39:0/2919079728 >> v1:172.21.15.184:6789/0 conn(0x7f1fa00b1640 legacy=0x7f1fa0070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:47.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.102+0000 7f1fa5eca700 1 -- 172.21.15.39:0/2919079728 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa00cada0 con 0x7f1fa0070790 2023-11-28T11:56:47.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.102+0000 7f1fa5eca700 1 --2- 172.21.15.39:0/2919079728 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1fa0070790 0x7f1fa006bfd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1f98009e50 tx=0x7f1f9800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=778dcf80a02e7f85 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:47.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.102+0000 7f1f97fff700 1 -- 172.21.15.39:0/2919079728 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9800e070 con 0x7f1fa0070790 2023-11-28T11:56:47.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.102+0000 7f1f97fff700 1 -- 172.21.15.39:0/2919079728 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9800b910 con 0x7f1fa0070790 2023-11-28T11:56:47.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.102+0000 7f1f97fff700 1 -- 172.21.15.39:0/2919079728 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9800bcc0 con 0x7f1fa0070790 2023-11-28T11:56:47.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.106+0000 7f1fa66cb700 1 -- 172.21.15.39:0/2919079728 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1fa0070790 msgr2=0x7f1fa006bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:47.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.106+0000 7f1fa66cb700 1 --2- 172.21.15.39:0/2919079728 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1fa0070790 0x7f1fa006bfd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1f98009e50 tx=0x7f1f9800b330 comp rx=0 tx=0).stop 2023-11-28T11:56:47.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.106+0000 7f1fa66cb700 1 -- 172.21.15.39:0/2919079728 shutdown_connections 2023-11-28T11:56:47.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.106+0000 7f1fa66cb700 1 --2- 172.21.15.39:0/2919079728 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1fa0070790 0x7f1fa006bfd0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:47.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.106+0000 7f1fa66cb700 1 --2- 172.21.15.39:0/2919079728 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fa00b43a0 0x7f1fa015e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:47.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.106+0000 7f1fa66cb700 1 -- 172.21.15.39:0/2919079728 >> 172.21.15.39:0/2919079728 conn(0x7f1fa00b0f80 msgr2=0x7f1fa00ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:47.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.106+0000 7f1fa66cb700 1 -- 172.21.15.39:0/2919079728 shutdown_connections 2023-11-28T11:56:47.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.106+0000 7f1fa66cb700 1 -- 172.21.15.39:0/2919079728 wait complete. 2023-11-28T11:56:47.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.110+0000 7f1fa66cb700 1 Processor -- start 2023-11-28T11:56:47.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.110+0000 7f1fa66cb700 1 -- start start 2023-11-28T11:56:47.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.110+0000 7f1fa66cb700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1fa0070790 0x7f1fa015c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:47.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.110+0000 7f1fa66cb700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1fa00b1640 0x7f1fa00c37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:47.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.110+0000 7f1fa66cb700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fa00b43a0 0x7f1fa01f1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:47.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.110+0000 7f1fa66cb700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa00c33a0 con 0x7f1fa00b1640 2023-11-28T11:56:47.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.110+0000 7f1fa66cb700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa00c2720 con 0x7f1fa0070790 2023-11-28T11:56:47.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.110+0000 7f1fa66cb700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa00c2a00 con 0x7f1fa00b43a0 2023-11-28T11:56:47.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.110+0000 7f1fa4ec8700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1fa00b1640 0x7f1fa00c37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:47.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.110+0000 7f1fa4ec8700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1fa00b1640 0x7f1fa00c37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55612/0 (socket says 172.21.15.39:55612) 2023-11-28T11:56:47.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.110+0000 7f1fa4ec8700 1 -- 172.21.15.39:0/2408647703 learned_addr learned my addr 172.21.15.39:0/2408647703 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:47.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.110+0000 7f1fa56c9700 1 --2- 172.21.15.39:0/2408647703 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1fa0070790 0x7f1fa015c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:47.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.110+0000 7f1fa5eca700 1 --2- 172.21.15.39:0/2408647703 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fa00b43a0 0x7f1fa01f1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:47.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.110+0000 7f1fa4ec8700 1 -- 172.21.15.39:0/2408647703 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fa00b43a0 msgr2=0x7f1fa01f1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:47.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.110+0000 7f1fa4ec8700 1 --2- 172.21.15.39:0/2408647703 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fa00b43a0 0x7f1fa01f1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:47.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.110+0000 7f1fa4ec8700 1 -- 172.21.15.39:0/2408647703 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1fa0070790 msgr2=0x7f1fa015c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:47.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.110+0000 7f1fa4ec8700 1 --2- 172.21.15.39:0/2408647703 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1fa0070790 0x7f1fa015c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:47.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.110+0000 7f1fa4ec8700 1 -- 172.21.15.39:0/2408647703 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f98009b30 con 0x7f1fa00b1640 2023-11-28T11:56:47.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.110+0000 7f1fa4ec8700 1 --2- 172.21.15.39:0/2408647703 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1fa00b1640 0x7f1fa00c37c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1f9000c500 tx=0x7f1f9000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:47.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.110+0000 7f1f95ffb700 1 -- 172.21.15.39:0/2408647703 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f900052d0 con 0x7f1fa00b1640 2023-11-28T11:56:47.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.110+0000 7f1f95ffb700 1 -- 172.21.15.39:0/2408647703 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f90005430 con 0x7f1fa00b1640 2023-11-28T11:56:47.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.110+0000 7f1fa66cb700 1 -- 172.21.15.39:0/2408647703 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa006b5d0 con 0x7f1fa00b1640 2023-11-28T11:56:47.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.110+0000 7f1f95ffb700 1 -- 172.21.15.39:0/2408647703 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f900055a0 con 0x7f1fa00b1640 2023-11-28T11:56:47.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.114+0000 7f1fa66cb700 1 -- 172.21.15.39:0/2408647703 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa006b2f0 con 0x7f1fa00b1640 2023-11-28T11:56:47.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.114+0000 7f1fa66cb700 1 -- 172.21.15.39:0/2408647703 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa015eb10 con 0x7f1fa00b1640 2023-11-28T11:56:47.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.114+0000 7f1f95ffb700 1 -- 172.21.15.39:0/2408647703 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1f90019030 con 0x7f1fa00b1640 2023-11-28T11:56:47.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.118+0000 7f1f95ffb700 1 --2- 172.21.15.39:0/2408647703 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1f84064ee0 0x7f1f84067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:47.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.118+0000 7f1f95ffb700 1 -- 172.21.15.39:0/2408647703 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1f900813a0 con 0x7f1fa00b1640 2023-11-28T11:56:47.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.118+0000 7f1fa56c9700 1 --2- 172.21.15.39:0/2408647703 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1f84064ee0 0x7f1f84067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:47.123 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.118+0000 7f1fa56c9700 1 --2- 172.21.15.39:0/2408647703 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1f84064ee0 0x7f1f84067390 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c009b50 tx=0x7f1f9c009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:47.127 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.122+0000 7f1f95ffb700 1 -- 172.21.15.39:0/2408647703 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1f9004f160 con 0x7f1fa00b1640 2023-11-28T11:56:47.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.334+0000 7f1fa66cb700 1 -- 172.21.15.39:0/2408647703 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1fa00c34e0 con 0x7f1fa00b1640 2023-11-28T11:56:47.338 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.334+0000 7f1f95ffb700 1 -- 172.21.15.39:0/2408647703 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f1f90052780 con 0x7f1fa00b1640 2023-11-28T11:56:47.338 INFO:teuthology.orchestra.run.smithi039.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-28T11:56:47.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.338+0000 7f1fa66cb700 1 -- 172.21.15.39:0/2408647703 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1f84064ee0 msgr2=0x7f1f84067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:47.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.338+0000 7f1fa66cb700 1 --2- 172.21.15.39:0/2408647703 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1f84064ee0 0x7f1f84067390 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c009b50 tx=0x7f1f9c009240 comp rx=0 tx=0).stop 2023-11-28T11:56:47.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.338+0000 7f1fa66cb700 1 -- 172.21.15.39:0/2408647703 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1fa00b1640 msgr2=0x7f1fa00c37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:47.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.338+0000 7f1fa66cb700 1 --2- 172.21.15.39:0/2408647703 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1fa00b1640 0x7f1fa00c37c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1f9000c500 tx=0x7f1f9000c810 comp rx=0 tx=0).stop 2023-11-28T11:56:47.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.338+0000 7f1fa66cb700 1 -- 172.21.15.39:0/2408647703 shutdown_connections 2023-11-28T11:56:47.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.338+0000 7f1fa66cb700 1 --2- 172.21.15.39:0/2408647703 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fa00b43a0 0x7f1fa01f1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:47.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.338+0000 7f1fa66cb700 1 --2- 172.21.15.39:0/2408647703 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1fa00b1640 0x7f1fa00c37c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:47.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.338+0000 7f1fa66cb700 1 --2- 172.21.15.39:0/2408647703 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1f84064ee0 0x7f1f84067390 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:47.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.338+0000 7f1fa66cb700 1 --2- 172.21.15.39:0/2408647703 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1fa0070790 0x7f1fa015c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:47.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.338+0000 7f1fa66cb700 1 -- 172.21.15.39:0/2408647703 >> 172.21.15.39:0/2408647703 conn(0x7f1fa00b0f80 msgr2=0x7f1fa00c9040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:47.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.338+0000 7f1fa66cb700 1 -- 172.21.15.39:0/2408647703 shutdown_connections 2023-11-28T11:56:47.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:47.338+0000 7f1fa66cb700 1 -- 172.21.15.39:0/2408647703 wait complete. 2023-11-28T11:56:47.362 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-28T11:56:47.363 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T11:56:47.363 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi039.front.sepia.ceph.com 2023-11-28T11:56:47.363 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-11-28T11:56:47.363 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-11-28T11:56:47.363 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-28T11:56:47.363 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T11:56:47.363 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T11:56:47.363 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-11-28T11:56:47.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:47.364 DEBUG:teuthology.orchestra.run.smithi039:> ip addr 2023-11-28T11:56:47.382 INFO:teuthology.orchestra.run.smithi039.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T11:56:47.382 INFO:teuthology.orchestra.run.smithi039.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T11:56:47.382 INFO:teuthology.orchestra.run.smithi039.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T11:56:47.382 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:56:47.383 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 ::1/128 scope host 2023-11-28T11:56:47.383 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:56:47.383 INFO:teuthology.orchestra.run.smithi039.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:56:47.383 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c6 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:56:47.383 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f0 2023-11-28T11:56:47.384 INFO:teuthology.orchestra.run.smithi039.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T11:56:47.384 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:70 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:56:47.385 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f0 2023-11-28T11:56:47.385 INFO:teuthology.orchestra.run.smithi039.stdout: inet 172.21.15.39/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-28T11:56:47.385 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft 42368sec preferred_lft 42368sec 2023-11-28T11:56:47.385 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::ec4:7aff:febd:1370/64 scope link 2023-11-28T11:56:47.385 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:56:47.385 INFO:teuthology.orchestra.run.smithi039.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:56:47.385 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c7 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:56:47.385 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f1 2023-11-28T11:56:47.385 INFO:teuthology.orchestra.run.smithi039.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:56:47.386 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:71 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:56:47.386 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f1 2023-11-28T11:56:47.386 INFO:teuthology.orchestra.run.smithi039.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T11:56:47.386 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 02:42:df:e8:d2:63 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:56:47.387 INFO:teuthology.orchestra.run.smithi039.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T11:56:47.387 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:56:47.388 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-28T11:56:47.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:47.388 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2023-11-28T11:56:47.388 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2023-11-28T11:56:47.388 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link add name ceph-brx type bridge 2023-11-28T11:56:47.389 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip addr flush dev ceph-brx 2023-11-28T11:56:47.389 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set ceph-brx up 2023-11-28T11:56:47.389 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-28T11:56:47.389 DEBUG:teuthology.orchestra.run.smithi039:> ') 2023-11-28T11:56:47.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:47.544 DEBUG:teuthology.orchestra.run.smithi039:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T11:56:47.582 INFO:teuthology.orchestra.run.smithi039.stdout:1 2023-11-28T11:56:47.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:47.586 DEBUG:teuthology.orchestra.run.smithi039:> route 2023-11-28T11:56:47.672 INFO:teuthology.orchestra.run.smithi039.stdout:Kernel IP routing table 2023-11-28T11:56:47.673 INFO:teuthology.orchestra.run.smithi039.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T11:56:47.673 INFO:teuthology.orchestra.run.smithi039.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-28T11:56:47.673 INFO:teuthology.orchestra.run.smithi039.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T11:56:47.673 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-28T11:56:47.673 INFO:teuthology.orchestra.run.smithi039.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T11:56:47.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:47.674 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2023-11-28T11:56:47.674 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2023-11-28T11:56:47.674 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-28T11:56:47.674 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-28T11:56:47.674 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-28T11:56:47.674 DEBUG:teuthology.orchestra.run.smithi039:> ') 2023-11-28T11:56:47.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:47.819 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2023-11-28T11:56:47.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:47.838 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list-id 2023-11-28T11:56:47.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:47.898 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2023-11-28T11:56:47.898 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2023-11-28T11:56:47.898 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-28T11:56:47.898 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-11-28T11:56:47.898 DEBUG:teuthology.orchestra.run.smithi039:> ') 2023-11-28T11:56:48.011 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-11-28T11:56:48.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:48.012 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2023-11-28T11:56:48.012 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2023-11-28T11:56:48.012 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-11-28T11:56:48.012 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-28T11:56:48.012 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-11-28T11:56:48.012 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-11-28T11:56:48.012 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-11-28T11:56:48.012 DEBUG:teuthology.orchestra.run.smithi039:> ') 2023-11-28T11:56:48.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:48.192 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2023-11-28T11:56:48.192 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2023-11-28T11:56:48.193 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set brx.0 up 2023-11-28T11:56:48.193 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set dev brx.0 master ceph-brx 2023-11-28T11:56:48.193 DEBUG:teuthology.orchestra.run.smithi039:> ') 2023-11-28T11:56:48.267 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-11-28T11:56:48.267 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:56:48.268 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-11-28T11:56:48.284 INFO:teuthology.orchestra.run.smithi039.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-11-28T11:56:48.284 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:56:48.284 DEBUG:teuthology.orchestra.run.smithi039:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-11-28T11:56:48.345 DEBUG:teuthology.orchestra.run.smithi039:> sudo modprobe fuse 2023-11-28T11:56:48.433 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:56:48.433 DEBUG:teuthology.orchestra.run.smithi039:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:56:48.515 INFO:teuthology.orchestra.run.smithi039.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:56:48.517 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:56:48.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:48.518 DEBUG:teuthology.orchestra.run.smithi039:> ls /sys/fs/fuse/connections 2023-11-28T11:56:48.579 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-28T11:56:48.579 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_mountpoint=/ --client_fs=cephfs) 2023-11-28T11:56:48.627 DEBUG:teuthology.orchestra.run.smithi039:> sudo modprobe fuse 2023-11-28T11:56:48.656 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:56:48.657 DEBUG:teuthology.orchestra.run.smithi039:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:56:48.730 INFO:teuthology.orchestra.run.smithi039.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:56:48.732 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:56:48.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:48.733 DEBUG:teuthology.orchestra.run.smithi039:> ls /sys/fs/fuse/connections 2023-11-28T11:56:48.781 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi039.stderr:2023-11-28T11:56:48.778+0000 7f78eebdc640 -1 init, newargv = 0x55d2109c4760 newargc=15 2023-11-28T11:56:48.781 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi039.stderr:ceph-fuse[41362]: starting ceph client 2023-11-28T11:56:48.797 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi039.stderr:ceph-fuse[41362]: starting fuse 2023-11-28T11:56:49.896 DEBUG:teuthology.orchestra.run.smithi039:> sudo modprobe fuse 2023-11-28T11:56:49.936 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:56:49.936 DEBUG:teuthology.orchestra.run.smithi039:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:56:50.017 INFO:teuthology.orchestra.run.smithi039.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:56:50.020 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:56:50.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:50.020 DEBUG:teuthology.orchestra.run.smithi039:> ls /sys/fs/fuse/connections 2023-11-28T11:56:50.083 INFO:teuthology.orchestra.run.smithi039.stdout:49 2023-11-28T11:56:50.083 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-11-28T11:56:50.083 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T11:56:50.083 DEBUG:teuthology.orchestra.run.smithi039:> import glob 2023-11-28T11:56:50.083 DEBUG:teuthology.orchestra.run.smithi039:> import re 2023-11-28T11:56:50.083 DEBUG:teuthology.orchestra.run.smithi039:> import os 2023-11-28T11:56:50.084 DEBUG:teuthology.orchestra.run.smithi039:> import subprocess 2023-11-28T11:56:50.084 DEBUG:teuthology.orchestra.run.smithi039:> 2023-11-28T11:56:50.084 DEBUG:teuthology.orchestra.run.smithi039:> def _find_admin_socket(client_name): 2023-11-28T11:56:50.084 DEBUG:teuthology.orchestra.run.smithi039:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-11-28T11:56:50.084 DEBUG:teuthology.orchestra.run.smithi039:> files = glob.glob(asok_path) 2023-11-28T11:56:50.084 DEBUG:teuthology.orchestra.run.smithi039:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-11-28T11:56:50.084 DEBUG:teuthology.orchestra.run.smithi039:> 2023-11-28T11:56:50.084 DEBUG:teuthology.orchestra.run.smithi039:> # Given a non-glob path, it better be there 2023-11-28T11:56:50.084 DEBUG:teuthology.orchestra.run.smithi039:> if "*" not in asok_path: 2023-11-28T11:56:50.084 DEBUG:teuthology.orchestra.run.smithi039:> assert(len(files) == 1) 2023-11-28T11:56:50.084 DEBUG:teuthology.orchestra.run.smithi039:> return files[0] 2023-11-28T11:56:50.084 DEBUG:teuthology.orchestra.run.smithi039:> 2023-11-28T11:56:50.084 DEBUG:teuthology.orchestra.run.smithi039:> for f in files: 2023-11-28T11:56:50.085 DEBUG:teuthology.orchestra.run.smithi039:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T11:56:50.085 DEBUG:teuthology.orchestra.run.smithi039:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T11:56:50.085 DEBUG:teuthology.orchestra.run.smithi039:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T11:56:50.085 DEBUG:teuthology.orchestra.run.smithi039:> contents = proc_f.read() 2023-11-28T11:56:50.085 DEBUG:teuthology.orchestra.run.smithi039:> if mountpoint in contents: 2023-11-28T11:56:50.085 DEBUG:teuthology.orchestra.run.smithi039:> return f 2023-11-28T11:56:50.085 DEBUG:teuthology.orchestra.run.smithi039:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T11:56:50.085 DEBUG:teuthology.orchestra.run.smithi039:> 2023-11-28T11:56:50.085 DEBUG:teuthology.orchestra.run.smithi039:> print(_find_admin_socket("client.admin")) 2023-11-28T11:56:50.085 DEBUG:teuthology.orchestra.run.smithi039:> ' 2023-11-28T11:56:50.219 INFO:teuthology.orchestra.run.smithi039.stdout:/var/run/ceph/ceph-client.admin.41362.asok 2023-11-28T11:56:50.409 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.41362.asok 2023-11-28T11:56:50.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:50.410 DEBUG:teuthology.orchestra.run.smithi039:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.41362.asok status 2023-11-28T11:56:50.615 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2023-11-28T11:56:50.615 INFO:teuthology.orchestra.run.smithi039.stdout: "metadata": { 2023-11-28T11:56:50.615 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_sha1": "2f5f6028b893ad41357cd06e827373f0fe2a1232", 2023-11-28T11:56:50.615 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_version": "ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev)", 2023-11-28T11:56:50.615 INFO:teuthology.orchestra.run.smithi039.stdout: "entity_id": "admin", 2023-11-28T11:56:50.615 INFO:teuthology.orchestra.run.smithi039.stdout: "hostname": "smithi039", 2023-11-28T11:56:50.615 INFO:teuthology.orchestra.run.smithi039.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-11-28T11:56:50.616 INFO:teuthology.orchestra.run.smithi039.stdout: "pid": "41362", 2023-11-28T11:56:50.616 INFO:teuthology.orchestra.run.smithi039.stdout: "root": "/" 2023-11-28T11:56:50.616 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:56:50.616 INFO:teuthology.orchestra.run.smithi039.stdout: "dentry_count": 0, 2023-11-28T11:56:50.616 INFO:teuthology.orchestra.run.smithi039.stdout: "dentry_pinned_count": 0, 2023-11-28T11:56:50.616 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 4425, 2023-11-28T11:56:50.616 INFO:teuthology.orchestra.run.smithi039.stdout: "inst": { 2023-11-28T11:56:50.616 INFO:teuthology.orchestra.run.smithi039.stdout: "name": { 2023-11-28T11:56:50.616 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "client", 2023-11-28T11:56:50.616 INFO:teuthology.orchestra.run.smithi039.stdout: "num": 4425 2023-11-28T11:56:50.616 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:56:50.616 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": { 2023-11-28T11:56:50.617 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v1", 2023-11-28T11:56:50.617 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "192.168.0.1:0", 2023-11-28T11:56:50.617 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 617059182 2023-11-28T11:56:50.617 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:56:50.617 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:56:50.617 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": { 2023-11-28T11:56:50.617 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v1", 2023-11-28T11:56:50.617 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "192.168.0.1:0", 2023-11-28T11:56:50.617 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 617059182 2023-11-28T11:56:50.617 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:56:50.617 INFO:teuthology.orchestra.run.smithi039.stdout: "inst_str": "client.4425 192.168.0.1:0/617059182", 2023-11-28T11:56:50.617 INFO:teuthology.orchestra.run.smithi039.stdout: "addr_str": "192.168.0.1:0/617059182", 2023-11-28T11:56:50.618 INFO:teuthology.orchestra.run.smithi039.stdout: "inode_count": 1, 2023-11-28T11:56:50.618 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_epoch": 7, 2023-11-28T11:56:50.618 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_epoch": 29, 2023-11-28T11:56:50.618 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_epoch_barrier": 0, 2023-11-28T11:56:50.618 INFO:teuthology.orchestra.run.smithi039.stdout: "blocklisted": false, 2023-11-28T11:56:50.618 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs" 2023-11-28T11:56:50.618 INFO:teuthology.orchestra.run.smithi039.stdout:} 2023-11-28T11:56:50.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:50.629 DEBUG:teuthology.orchestra.run.smithi039:> stat --file-system '--printf=%T 2023-11-28T11:56:50.629 DEBUG:teuthology.orchestra.run.smithi039:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-11-28T11:56:50.650 INFO:teuthology.orchestra.run.smithi039.stdout:fuseblk 2023-11-28T11:56:50.651 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-11-28T11:56:50.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:50.651 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-11-28T11:56:50.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:50.734 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-11-28T11:56:51.068 INFO:teuthology.orchestra.run.smithi039.stdout:# file: . 2023-11-28T11:56:51.069 INFO:teuthology.orchestra.run.smithi039.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-11-28T11:56:51.069 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:56:51.070 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:56:51.070 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:56:51.089 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:56:51.317 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.314+0000 7f684a584700 1 Processor -- start 2023-11-28T11:56:51.317 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.314+0000 7f684a584700 1 -- start start 2023-11-28T11:56:51.319 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.314+0000 7f684a584700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6844071aa0 0x7f684406d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:51.319 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.314+0000 7f684a584700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6844069e00 0x7f684406a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:51.319 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.314+0000 7f684a584700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f684406c600 con 0x7f684415c640 2023-11-28T11:56:51.319 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.314+0000 7f684a584700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f684406cef0 con 0x7f6844071aa0 2023-11-28T11:56:51.319 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.314+0000 7f684a584700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68440d38f0 con 0x7f6844069e00 2023-11-28T11:56:51.319 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.314+0000 7f6849582700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f684415c640 0x7f68440d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:55004/0 (socket says 172.21.15.39:55004) 2023-11-28T11:56:51.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.314+0000 7f6849582700 1 -- 172.21.15.39:0/1185186211 learned_addr learned my addr 172.21.15.39:0/1185186211 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:56:51.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.314+0000 7f6849d83700 1 --2- 172.21.15.39:0/1185186211 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6844069e00 0x7f684406a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:51.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.318+0000 7f6848d81700 1 --2- 172.21.15.39:0/1185186211 >> v2:172.21.15.184:3300/0 conn(0x7f6844071aa0 0x7f684406d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:51.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.318+0000 7f683bfff700 1 -- 172.21.15.39:0/1185186211 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 53051214 0 0) 0x7f684406c600 con 0x7f684415c640 2023-11-28T11:56:51.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.318+0000 7f683bfff700 1 -- 172.21.15.39:0/1185186211 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68300035d0 con 0x7f684415c640 2023-11-28T11:56:51.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.318+0000 7f6849d83700 1 -- 172.21.15.39:0/1185186211 >> v2:172.21.15.184:3300/0 conn(0x7f6844071aa0 msgr2=0x7f684406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:51.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.318+0000 7f6849d83700 1 --2- 172.21.15.39:0/1185186211 >> v2:172.21.15.184:3300/0 conn(0x7f6844071aa0 0x7f684406d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:51.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.318+0000 7f6849d83700 1 -- 172.21.15.39:0/1185186211 >> v1:172.21.15.184:6789/0 conn(0x7f684415c640 legacy=0x7f68440d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:51.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.318+0000 7f6849d83700 1 -- 172.21.15.39:0/1185186211 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68440722f0 con 0x7f6844069e00 2023-11-28T11:56:51.322 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.318+0000 7f6848d81700 1 --2- 172.21.15.39:0/1185186211 >> v2:172.21.15.184:3300/0 conn(0x7f6844071aa0 0x7f684406d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:51.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.318+0000 7f6849d83700 1 --2- 172.21.15.39:0/1185186211 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6844069e00 0x7f684406a280 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f683c009d90 tx=0x7f683c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fb810445b88237d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:51.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.318+0000 7f683bfff700 1 -- 172.21.15.39:0/1185186211 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683c00e070 con 0x7f6844069e00 2023-11-28T11:56:51.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.318+0000 7f683bfff700 1 -- 172.21.15.39:0/1185186211 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f683c00bb20 con 0x7f6844069e00 2023-11-28T11:56:51.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.318+0000 7f683bfff700 1 -- 172.21.15.39:0/1185186211 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683c00be90 con 0x7f6844069e00 2023-11-28T11:56:51.324 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.318+0000 7f684a584700 1 -- 172.21.15.39:0/1185186211 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6844069e00 msgr2=0x7f684406a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:51.324 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.318+0000 7f684a584700 1 --2- 172.21.15.39:0/1185186211 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6844069e00 0x7f684406a280 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f683c009d90 tx=0x7f683c00b330 comp rx=0 tx=0).stop 2023-11-28T11:56:51.324 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.318+0000 7f684a584700 1 -- 172.21.15.39:0/1185186211 shutdown_connections 2023-11-28T11:56:51.324 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.318+0000 7f684a584700 1 --2- 172.21.15.39:0/1185186211 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6844069e00 0x7f684406a280 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:51.324 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.318+0000 7f684a584700 1 --2- 172.21.15.39:0/1185186211 >> v2:172.21.15.184:3300/0 conn(0x7f6844071aa0 0x7f684406d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:51.324 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.318+0000 7f684a584700 1 -- 172.21.15.39:0/1185186211 >> 172.21.15.39:0/1185186211 conn(0x7f68440b6520 msgr2=0x7f6844071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:51.324 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.322+0000 7f684a584700 1 -- 172.21.15.39:0/1185186211 shutdown_connections 2023-11-28T11:56:51.325 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.322+0000 7f684a584700 1 -- 172.21.15.39:0/1185186211 wait complete. 2023-11-28T11:56:51.327 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.322+0000 7f684a584700 1 Processor -- start 2023-11-28T11:56:51.327 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.322+0000 7f684a584700 1 -- start start 2023-11-28T11:56:51.328 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.326+0000 7f684a584700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6844069e00 0x7f6844157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:51.328 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.326+0000 7f684a584700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6844071aa0 0x7f684406d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:51.328 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.326+0000 7f684a584700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f684415c640 0x7f684406d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:51.328 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.326+0000 7f684a584700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68440ccde0 con 0x7f6844069e00 2023-11-28T11:56:51.328 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.326+0000 7f684a584700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684415ced0 con 0x7f684415c640 2023-11-28T11:56:51.328 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.326+0000 7f684a584700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f684415d1b0 con 0x7f6844071aa0 2023-11-28T11:56:51.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.326+0000 7f6849582700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6844069e00 0x7f6844157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:51.330 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.326+0000 7f6849582700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6844069e00 0x7f6844157bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39196/0 (socket says 172.21.15.39:39196) 2023-11-28T11:56:51.330 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.326+0000 7f6849582700 1 -- 172.21.15.39:0/574908031 learned_addr learned my addr 172.21.15.39:0/574908031 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:51.330 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.326+0000 7f6849d83700 1 --2- 172.21.15.39:0/574908031 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f684415c640 0x7f684406d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:51.330 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.326+0000 7f6848d81700 1 --2- 172.21.15.39:0/574908031 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6844071aa0 0x7f684406d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:51.330 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.326+0000 7f6849582700 1 -- 172.21.15.39:0/574908031 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6844071aa0 msgr2=0x7f684406d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:51.330 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.326+0000 7f6849582700 1 --2- 172.21.15.39:0/574908031 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6844071aa0 0x7f684406d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:51.330 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.326+0000 7f6849582700 1 -- 172.21.15.39:0/574908031 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f684415c640 msgr2=0x7f684406d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:51.330 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.326+0000 7f6849582700 1 --2- 172.21.15.39:0/574908031 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f684415c640 0x7f684406d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:51.330 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.326+0000 7f6849582700 1 -- 172.21.15.39:0/574908031 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68340094b0 con 0x7f6844069e00 2023-11-28T11:56:51.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.326+0000 7f6849582700 1 --2- 172.21.15.39:0/574908031 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6844069e00 0x7f6844157bb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f684000c4f0 tx=0x7f684000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:51.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.326+0000 7f6839ffb700 1 -- 172.21.15.39:0/574908031 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6840005d90 con 0x7f6844069e00 2023-11-28T11:56:51.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.326+0000 7f6839ffb700 1 -- 172.21.15.39:0/574908031 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68400070d0 con 0x7f6844069e00 2023-11-28T11:56:51.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.326+0000 7f684a584700 1 -- 172.21.15.39:0/574908031 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f683c009a70 con 0x7f6844069e00 2023-11-28T11:56:51.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.326+0000 7f6839ffb700 1 -- 172.21.15.39:0/574908031 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6840007440 con 0x7f6844069e00 2023-11-28T11:56:51.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.326+0000 7f684a584700 1 -- 172.21.15.39:0/574908031 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6844072010 con 0x7f6844069e00 2023-11-28T11:56:51.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.330+0000 7f684a584700 1 -- 172.21.15.39:0/574908031 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f684406c830 con 0x7f6844069e00 2023-11-28T11:56:51.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.330+0000 7f6839ffb700 1 -- 172.21.15.39:0/574908031 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6840019030 con 0x7f6844069e00 2023-11-28T11:56:51.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.334+0000 7f6839ffb700 1 --2- 172.21.15.39:0/574908031 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6828064ee0 0x7f6828067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:51.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.334+0000 7f6839ffb700 1 -- 172.21.15.39:0/574908031 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6840081420 con 0x7f6844069e00 2023-11-28T11:56:51.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.334+0000 7f6848d81700 1 --2- 172.21.15.39:0/574908031 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6828064ee0 0x7f6828067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:51.338 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.334+0000 7f6848d81700 1 --2- 172.21.15.39:0/574908031 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6828064ee0 0x7f6828067390 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f684415bd80 tx=0x7f6834009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:51.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.338+0000 7f6839ffb700 1 -- 172.21.15.39:0/574908031 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f684004a400 con 0x7f6844069e00 2023-11-28T11:56:51.516 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.510+0000 7f684a584700 1 -- 172.21.15.39:0/574908031 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f684415d3d0 con 0x7f6844069e00 2023-11-28T11:56:51.519 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.514+0000 7f6839ffb700 1 -- 172.21.15.39:0/574908031 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+19652 (secure 0 0 0) 0x7f684004f290 con 0x7f6844069e00 2023-11-28T11:56:51.520 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:56:51.520 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":29,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:56:44.439368+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:56:38.203736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:56:38.946498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:56:41.988334+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:56:51.523 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.518+0000 7f684a584700 1 -- 172.21.15.39:0/574908031 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6828064ee0 msgr2=0x7f6828067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:51.523 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.518+0000 7f684a584700 1 --2- 172.21.15.39:0/574908031 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6828064ee0 0x7f6828067390 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f684415bd80 tx=0x7f6834009240 comp rx=0 tx=0).stop 2023-11-28T11:56:51.523 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.518+0000 7f684a584700 1 -- 172.21.15.39:0/574908031 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6844069e00 msgr2=0x7f6844157bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:51.523 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.518+0000 7f684a584700 1 --2- 172.21.15.39:0/574908031 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6844069e00 0x7f6844157bb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f684000c4f0 tx=0x7f684000c800 comp rx=0 tx=0).stop 2023-11-28T11:56:51.523 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.518+0000 7f684a584700 1 -- 172.21.15.39:0/574908031 shutdown_connections 2023-11-28T11:56:51.523 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.518+0000 7f684a584700 1 --2- 172.21.15.39:0/574908031 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6828064ee0 0x7f6828067390 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:51.523 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.518+0000 7f684a584700 1 --2- 172.21.15.39:0/574908031 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f684415c640 0x7f684406d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:51.523 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.518+0000 7f684a584700 1 --2- 172.21.15.39:0/574908031 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6844071aa0 0x7f684406d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:51.523 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.518+0000 7f684a584700 1 --2- 172.21.15.39:0/574908031 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6844069e00 0x7f6844157bb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:51.523 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.518+0000 7f684a584700 1 -- 172.21.15.39:0/574908031 >> 172.21.15.39:0/574908031 conn(0x7f68440b6520 msgr2=0x7f68440b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:51.523 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.518+0000 7f684a584700 1 -- 172.21.15.39:0/574908031 shutdown_connections 2023-11-28T11:56:51.524 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.518+0000 7f684a584700 1 -- 172.21.15.39:0/574908031 wait complete. 2023-11-28T11:56:51.546 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:56:26.631457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:56:33.242202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:56:38.203736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:56:38.946498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T11:56:41.988334+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T11:56:51.546 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:56:51.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.730+0000 7f2449730700 1 Processor -- start 2023-11-28T11:56:51.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.734+0000 7f2449730700 1 -- start start 2023-11-28T11:56:51.738 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.734+0000 7f2449730700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f244415c150 0x7f24440b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:51.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.734+0000 7f2449730700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2444070360 0x7f2444160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:51.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.734+0000 7f2449730700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f244415c520 con 0x7f244406ff10 2023-11-28T11:56:51.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.734+0000 7f2449730700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24440b4240 con 0x7f2444070360 2023-11-28T11:56:51.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.734+0000 7f2449730700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f244406ac00 con 0x7f244415c150 2023-11-28T11:56:51.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.734+0000 7f2443fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f244415c150 0x7f24440b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:51.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.734+0000 7f2448f2f700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2444070360 0x7f2444160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:51.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.734+0000 7f243bfff700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f244406ff10 0x7f244415fc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:55020/0 (socket says 172.21.15.39:55020) 2023-11-28T11:56:51.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.734+0000 7f243bfff700 1 -- 172.21.15.39:0/3861319556 learned_addr learned my addr 172.21.15.39:0/3861319556 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:56:51.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.738+0000 7f2443fff700 1 -- 172.21.15.39:0/3861319556 >> v2:172.21.15.184:3300/0 conn(0x7f2444070360 msgr2=0x7f2444160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:51.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.738+0000 7f24437fe700 1 -- 172.21.15.39:0/3861319556 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3991419511 0 0) 0x7f244415c520 con 0x7f244406ff10 2023-11-28T11:56:51.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.738+0000 7f2443fff700 1 --2- 172.21.15.39:0/3861319556 >> v2:172.21.15.184:3300/0 conn(0x7f2444070360 0x7f2444160340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:51.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.738+0000 7f2443fff700 1 -- 172.21.15.39:0/3861319556 >> v1:172.21.15.184:6789/0 conn(0x7f244406ff10 legacy=0x7f244415fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:51.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.738+0000 7f2443fff700 1 -- 172.21.15.39:0/3861319556 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f244406cc50 con 0x7f244415c150 2023-11-28T11:56:51.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.738+0000 7f2443fff700 1 --2- 172.21.15.39:0/3861319556 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f244415c150 0x7f24440b3d00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2434009850 tx=0x7f2434009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbf4b1078b55d73f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:51.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.738+0000 7f24437fe700 1 -- 172.21.15.39:0/3861319556 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2434011830 con 0x7f244415c150 2023-11-28T11:56:51.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.738+0000 7f24437fe700 1 -- 172.21.15.39:0/3861319556 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2434011990 con 0x7f244415c150 2023-11-28T11:56:51.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.738+0000 7f24437fe700 1 -- 172.21.15.39:0/3861319556 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2434011d40 con 0x7f244415c150 2023-11-28T11:56:51.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.738+0000 7f2449730700 1 -- 172.21.15.39:0/3861319556 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f244415c150 msgr2=0x7f24440b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:51.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.738+0000 7f2449730700 1 --2- 172.21.15.39:0/3861319556 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f244415c150 0x7f24440b3d00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2434009850 tx=0x7f2434009b60 comp rx=0 tx=0).stop 2023-11-28T11:56:51.744 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.738+0000 7f2449730700 1 -- 172.21.15.39:0/3861319556 shutdown_connections 2023-11-28T11:56:51.744 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.738+0000 7f2449730700 1 --2- 172.21.15.39:0/3861319556 >> v2:172.21.15.184:3300/0 conn(0x7f2444070360 0x7f2444160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:51.744 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.738+0000 7f2449730700 1 --2- 172.21.15.39:0/3861319556 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f244415c150 0x7f24440b3d00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:51.744 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.738+0000 7f2449730700 1 -- 172.21.15.39:0/3861319556 >> 172.21.15.39:0/3861319556 conn(0x7f24440d3680 msgr2=0x7f24440cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:51.744 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.738+0000 7f2449730700 1 -- 172.21.15.39:0/3861319556 shutdown_connections 2023-11-28T11:56:51.744 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.738+0000 7f2449730700 1 -- 172.21.15.39:0/3861319556 wait complete. 2023-11-28T11:56:51.747 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.742+0000 7f2449730700 1 Processor -- start 2023-11-28T11:56:51.747 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.742+0000 7f2449730700 1 -- start start 2023-11-28T11:56:51.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.746+0000 7f2449730700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f244406ff10 0x7f2444147570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:51.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.746+0000 7f2449730700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2444070360 0x7f2444147f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:51.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.746+0000 7f2449730700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f244415c150 0x7f24440ca9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:51.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.746+0000 7f2449730700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24440cce00 con 0x7f244406ff10 2023-11-28T11:56:51.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.746+0000 7f2449730700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2444147ab0 con 0x7f244415c150 2023-11-28T11:56:51.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.746+0000 7f2449730700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2444148490 con 0x7f2444070360 2023-11-28T11:56:51.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.746+0000 7f2443fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f244406ff10 0x7f2444147570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:51.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.746+0000 7f2443fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f244406ff10 0x7f2444147570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39204/0 (socket says 172.21.15.39:39204) 2023-11-28T11:56:51.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.746+0000 7f2443fff700 1 -- 172.21.15.39:0/4171587236 learned_addr learned my addr 172.21.15.39:0/4171587236 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:51.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.746+0000 7f243bfff700 1 --2- 172.21.15.39:0/4171587236 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2444070360 0x7f2444147f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:51.751 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.746+0000 7f2448f2f700 1 --2- 172.21.15.39:0/4171587236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f244415c150 0x7f24440ca9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:51.751 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.746+0000 7f2443fff700 1 -- 172.21.15.39:0/4171587236 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2444070360 msgr2=0x7f2444147f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:51.752 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.746+0000 7f2443fff700 1 --2- 172.21.15.39:0/4171587236 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2444070360 0x7f2444147f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:51.752 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.746+0000 7f2443fff700 1 -- 172.21.15.39:0/4171587236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f244415c150 msgr2=0x7f24440ca9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:51.752 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.746+0000 7f2443fff700 1 --2- 172.21.15.39:0/4171587236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f244415c150 0x7f24440ca9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:51.752 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.746+0000 7f2443fff700 1 -- 172.21.15.39:0/4171587236 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24340094b0 con 0x7f244406ff10 2023-11-28T11:56:51.752 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.746+0000 7f2443fff700 1 --2- 172.21.15.39:0/4171587236 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f244406ff10 0x7f2444147570 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2434014040 tx=0x7f2434004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:51.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.746+0000 7f24417fa700 1 -- 172.21.15.39:0/4171587236 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2434019980 con 0x7f244406ff10 2023-11-28T11:56:51.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.750+0000 7f24417fa700 1 -- 172.21.15.39:0/4171587236 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243401e070 con 0x7f244406ff10 2023-11-28T11:56:51.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.750+0000 7f24417fa700 1 -- 172.21.15.39:0/4171587236 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2434019d20 con 0x7f244406ff10 2023-11-28T11:56:51.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.750+0000 7f2449730700 1 -- 172.21.15.39:0/4171587236 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24440d2730 con 0x7f244406ff10 2023-11-28T11:56:51.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.750+0000 7f2449730700 1 -- 172.21.15.39:0/4171587236 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24440d2450 con 0x7f244406ff10 2023-11-28T11:56:51.755 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.750+0000 7f2449730700 1 -- 172.21.15.39:0/4171587236 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24440d05e0 con 0x7f244406ff10 2023-11-28T11:56:51.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.750+0000 7f24417fa700 1 -- 172.21.15.39:0/4171587236 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f243400f050 con 0x7f244406ff10 2023-11-28T11:56:51.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.754+0000 7f24417fa700 1 --2- 172.21.15.39:0/4171587236 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2424064ee0 0x7f2424067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:51.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.754+0000 7f24417fa700 1 -- 172.21.15.39:0/4171587236 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2434083280 con 0x7f244406ff10 2023-11-28T11:56:51.758 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.754+0000 7f243bfff700 1 --2- 172.21.15.39:0/4171587236 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2424064ee0 0x7f2424067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:51.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.754+0000 7f243bfff700 1 --2- 172.21.15.39:0/4171587236 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2424064ee0 0x7f2424067390 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f24440d00f0 tx=0x7f242c007dd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:51.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.758+0000 7f24417fa700 1 -- 172.21.15.39:0/4171587236 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2434050fc0 con 0x7f244406ff10 2023-11-28T11:56:51.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.930+0000 7f2449730700 1 -- 172.21.15.39:0/4171587236 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2444073d20 con 0x7f244406ff10 2023-11-28T11:56:51.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.930+0000 7f24417fa700 1 -- 172.21.15.39:0/4171587236 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f24340200a0 con 0x7f244406ff10 2023-11-28T11:56:51.934 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-11-28T11:56:51.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.934+0000 7f2449730700 1 -- 172.21.15.39:0/4171587236 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2424064ee0 msgr2=0x7f2424067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:51.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.934+0000 7f2449730700 1 --2- 172.21.15.39:0/4171587236 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2424064ee0 0x7f2424067390 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f24440d00f0 tx=0x7f242c007dd0 comp rx=0 tx=0).stop 2023-11-28T11:56:51.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.934+0000 7f2449730700 1 -- 172.21.15.39:0/4171587236 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f244406ff10 msgr2=0x7f2444147570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:51.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.934+0000 7f2449730700 1 --2- 172.21.15.39:0/4171587236 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f244406ff10 0x7f2444147570 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2434014040 tx=0x7f2434004770 comp rx=0 tx=0).stop 2023-11-28T11:56:51.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.934+0000 7f2449730700 1 -- 172.21.15.39:0/4171587236 shutdown_connections 2023-11-28T11:56:51.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.934+0000 7f2449730700 1 --2- 172.21.15.39:0/4171587236 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2424064ee0 0x7f2424067390 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:51.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.934+0000 7f2449730700 1 --2- 172.21.15.39:0/4171587236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f244415c150 0x7f24440ca9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:51.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.934+0000 7f2449730700 1 --2- 172.21.15.39:0/4171587236 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2444070360 0x7f2444147f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:51.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.934+0000 7f2449730700 1 --2- 172.21.15.39:0/4171587236 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f244406ff10 0x7f2444147570 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:51.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.934+0000 7f2449730700 1 -- 172.21.15.39:0/4171587236 >> 172.21.15.39:0/4171587236 conn(0x7f24440d3680 msgr2=0x7f2444156580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:51.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.934+0000 7f2449730700 1 -- 172.21.15.39:0/4171587236 shutdown_connections 2023-11-28T11:56:51.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:51.934+0000 7f2449730700 1 -- 172.21.15.39:0/4171587236 wait complete. 2023-11-28T11:56:51.962 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:56:52.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.137+0000 7f22f2020700 1 Processor -- start 2023-11-28T11:56:52.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.137+0000 7f22f2020700 1 -- start start 2023-11-28T11:56:52.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.141+0000 7f22f2020700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22ec070620 0x7f22ec0b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.141+0000 7f22f2020700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f22ec069bf0 0x7f22ec06a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.141+0000 7f22f2020700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22ec15c520 con 0x7f22ec15c150 2023-11-28T11:56:52.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.141+0000 7f22f2020700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22ec0b4240 con 0x7f22ec069bf0 2023-11-28T11:56:52.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.141+0000 7f22f2020700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec06cc50 con 0x7f22ec070620 2023-11-28T11:56:52.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.141+0000 7f22f181f700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f22ec069bf0 0x7f22ec06a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.141+0000 7f22f181f700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f22ec069bf0 0x7f22ec06a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39214/0 (socket says 172.21.15.39:39214) 2023-11-28T11:56:52.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.141+0000 7f22f181f700 1 -- 172.21.15.39:0/3628853273 learned_addr learned my addr 172.21.15.39:0/3628853273 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:52.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.141+0000 7f22f101e700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f22ec15c150 0x7f22ec06ff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35820/0 (socket says 172.21.15.39:35820) 2023-11-28T11:56:52.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.141+0000 7f22f081d700 1 --2- 172.21.15.39:0/3628853273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22ec070620 0x7f22ec0b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.141+0000 7f22f181f700 1 -- 172.21.15.39:0/3628853273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22ec070620 msgr2=0x7f22ec0b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:52.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.141+0000 7f22f181f700 1 --2- 172.21.15.39:0/3628853273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22ec070620 0x7f22ec0b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.141+0000 7f22f181f700 1 -- 172.21.15.39:0/3628853273 >> v1:172.21.15.39:6789/0 conn(0x7f22ec15c150 legacy=0x7f22ec06ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:52.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.141+0000 7f22f181f700 1 -- 172.21.15.39:0/3628853273 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ec0d2450 con 0x7f22ec069bf0 2023-11-28T11:56:52.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.141+0000 7f22f081d700 1 --2- 172.21.15.39:0/3628853273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22ec070620 0x7f22ec0b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:56:52.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.141+0000 7f22f181f700 1 --2- 172.21.15.39:0/3628853273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22ec069bf0 0x7f22ec06a050 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f22e4009e50 tx=0x7f22e400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49806a8cf5a645c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:52.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.141+0000 7f22e3fff700 1 -- 172.21.15.39:0/3628853273 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e400e070 con 0x7f22ec069bf0 2023-11-28T11:56:52.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.141+0000 7f22e3fff700 1 -- 172.21.15.39:0/3628853273 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e400b9c0 con 0x7f22ec069bf0 2023-11-28T11:56:52.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.141+0000 7f22e3fff700 1 -- 172.21.15.39:0/3628853273 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e400bd70 con 0x7f22ec069bf0 2023-11-28T11:56:52.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.145+0000 7f22f2020700 1 -- 172.21.15.39:0/3628853273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22ec069bf0 msgr2=0x7f22ec06a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:52.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.145+0000 7f22f2020700 1 --2- 172.21.15.39:0/3628853273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22ec069bf0 0x7f22ec06a050 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f22e4009e50 tx=0x7f22e400b330 comp rx=0 tx=0).stop 2023-11-28T11:56:52.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.145+0000 7f22f2020700 1 -- 172.21.15.39:0/3628853273 shutdown_connections 2023-11-28T11:56:52.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.145+0000 7f22f2020700 1 --2- 172.21.15.39:0/3628853273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22ec069bf0 0x7f22ec06a050 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.145+0000 7f22f2020700 1 --2- 172.21.15.39:0/3628853273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22ec070620 0x7f22ec0b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.145+0000 7f22f2020700 1 -- 172.21.15.39:0/3628853273 >> 172.21.15.39:0/3628853273 conn(0x7f22ec0d3680 msgr2=0x7f22ec0cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:52.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.145+0000 7f22f2020700 1 -- 172.21.15.39:0/3628853273 shutdown_connections 2023-11-28T11:56:52.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.145+0000 7f22f2020700 1 -- 172.21.15.39:0/3628853273 wait complete. 2023-11-28T11:56:52.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.145+0000 7f22f2020700 1 Processor -- start 2023-11-28T11:56:52.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.145+0000 7f22f2020700 1 -- start start 2023-11-28T11:56:52.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.149+0000 7f22f2020700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22ec069bf0 0x7f22ec0cb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.149+0000 7f22f2020700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22ec070620 0x7f22ec1474e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.149+0000 7f22f2020700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22ec15c150 0x7f22ec159310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.149+0000 7f22f2020700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec157c70 con 0x7f22ec070620 2023-11-28T11:56:52.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.149+0000 7f22f2020700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec157f30 con 0x7f22ec069bf0 2023-11-28T11:56:52.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.149+0000 7f22f2020700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec158210 con 0x7f22ec15c150 2023-11-28T11:56:52.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.149+0000 7f22f081d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22ec070620 0x7f22ec1474e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.149+0000 7f22f081d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22ec070620 0x7f22ec1474e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39218/0 (socket says 172.21.15.39:39218) 2023-11-28T11:56:52.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.149+0000 7f22f081d700 1 -- 172.21.15.39:0/1119364230 learned_addr learned my addr 172.21.15.39:0/1119364230 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:52.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.149+0000 7f22f181f700 1 --2- 172.21.15.39:0/1119364230 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22ec15c150 0x7f22ec159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.149+0000 7f22f101e700 1 --2- 172.21.15.39:0/1119364230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22ec069bf0 0x7f22ec0cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.149+0000 7f22f081d700 1 -- 172.21.15.39:0/1119364230 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22ec15c150 msgr2=0x7f22ec159310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:52.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.149+0000 7f22f081d700 1 --2- 172.21.15.39:0/1119364230 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22ec15c150 0x7f22ec159310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.149+0000 7f22f081d700 1 -- 172.21.15.39:0/1119364230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22ec069bf0 msgr2=0x7f22ec0cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:52.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.149+0000 7f22f081d700 1 --2- 172.21.15.39:0/1119364230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22ec069bf0 0x7f22ec0cb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.149+0000 7f22f081d700 1 -- 172.21.15.39:0/1119364230 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e4009b30 con 0x7f22ec070620 2023-11-28T11:56:52.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.149+0000 7f22f081d700 1 --2- 172.21.15.39:0/1119364230 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22ec070620 0x7f22ec1474e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f22dc00c7c0 tx=0x7f22dc00cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:52.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.149+0000 7f22e1ffb700 1 -- 172.21.15.39:0/1119364230 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22dc005c40 con 0x7f22ec070620 2023-11-28T11:56:52.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.149+0000 7f22e1ffb700 1 -- 172.21.15.39:0/1119364230 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22dc005da0 con 0x7f22ec070620 2023-11-28T11:56:52.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.149+0000 7f22f2020700 1 -- 172.21.15.39:0/1119364230 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22ec0d05e0 con 0x7f22ec070620 2023-11-28T11:56:52.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.149+0000 7f22e1ffb700 1 -- 172.21.15.39:0/1119364230 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22dc011840 con 0x7f22ec070620 2023-11-28T11:56:52.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.153+0000 7f22f2020700 1 -- 172.21.15.39:0/1119364230 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22ec0d2730 con 0x7f22ec070620 2023-11-28T11:56:52.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.153+0000 7f22f2020700 1 -- 172.21.15.39:0/1119364230 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22ec0d2140 con 0x7f22ec070620 2023-11-28T11:56:52.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.153+0000 7f22e1ffb700 1 -- 172.21.15.39:0/1119364230 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f22dc020070 con 0x7f22ec070620 2023-11-28T11:56:52.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.157+0000 7f22e1ffb700 1 --2- 172.21.15.39:0/1119364230 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f22d0064ee0 0x7f22d0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.157+0000 7f22e1ffb700 1 -- 172.21.15.39:0/1119364230 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f22dc082250 con 0x7f22ec070620 2023-11-28T11:56:52.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.157+0000 7f22f101e700 1 --2- 172.21.15.39:0/1119364230 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f22d0064ee0 0x7f22d0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.157+0000 7f22f101e700 1 --2- 172.21.15.39:0/1119364230 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f22d0064ee0 0x7f22d0067390 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f22e8000f60 tx=0x7f22e8007ef0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:52.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.161+0000 7f22e1ffb700 1 -- 172.21.15.39:0/1119364230 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f22dc050080 con 0x7f22ec070620 2023-11-28T11:56:52.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.341+0000 7f22f2020700 1 -- 172.21.15.39:0/1119364230 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f22ec0c9a40 con 0x7f22ec070620 2023-11-28T11:56:52.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.341+0000 7f22e1ffb700 1 -- 172.21.15.39:0/1119364230 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f22dc0536a0 con 0x7f22ec070620 2023-11-28T11:56:52.345 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-11-28T11:56:52.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.341+0000 7f22f2020700 1 -- 172.21.15.39:0/1119364230 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f22d0064ee0 msgr2=0x7f22d0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:52.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.341+0000 7f22f2020700 1 --2- 172.21.15.39:0/1119364230 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f22d0064ee0 0x7f22d0067390 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f22e8000f60 tx=0x7f22e8007ef0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.341+0000 7f22f2020700 1 -- 172.21.15.39:0/1119364230 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22ec070620 msgr2=0x7f22ec1474e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:52.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.341+0000 7f22f2020700 1 --2- 172.21.15.39:0/1119364230 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22ec070620 0x7f22ec1474e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f22dc00c7c0 tx=0x7f22dc00cad0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.345+0000 7f22f2020700 1 -- 172.21.15.39:0/1119364230 shutdown_connections 2023-11-28T11:56:52.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.345+0000 7f22f2020700 1 --2- 172.21.15.39:0/1119364230 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22ec15c150 0x7f22ec159310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.345+0000 7f22f2020700 1 --2- 172.21.15.39:0/1119364230 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22ec070620 0x7f22ec1474e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.345+0000 7f22f2020700 1 --2- 172.21.15.39:0/1119364230 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f22d0064ee0 0x7f22d0067390 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.345+0000 7f22f2020700 1 --2- 172.21.15.39:0/1119364230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22ec069bf0 0x7f22ec0cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.345+0000 7f22f2020700 1 -- 172.21.15.39:0/1119364230 >> 172.21.15.39:0/1119364230 conn(0x7f22ec0d3680 msgr2=0x7f22ec0c78c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:52.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.345+0000 7f22f2020700 1 -- 172.21.15.39:0/1119364230 shutdown_connections 2023-11-28T11:56:52.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.345+0000 7f22f2020700 1 -- 172.21.15.39:0/1119364230 wait complete. 2023-11-28T11:56:52.369 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:56:52.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.545+0000 7fdded476700 1 Processor -- start 2023-11-28T11:56:52.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.545+0000 7fdded476700 1 -- start start 2023-11-28T11:56:52.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.549+0000 7fdded476700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fdde8159f10 0x7fdde8070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.549+0000 7fdded476700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fdde815a9f0 0x7fdde806b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.549+0000 7fdded476700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdde8070600 con 0x7fdde80c8c90 2023-11-28T11:56:52.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.549+0000 7fdded476700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdde80c9130 con 0x7fdde8159f10 2023-11-28T11:56:52.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.549+0000 7fdded476700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdde806b840 con 0x7fdde815a9f0 2023-11-28T11:56:52.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.549+0000 7fdde7fff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fdde8159f10 0x7fdde8070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.549+0000 7fdde7fff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fdde8159f10 0x7fdde8070a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39234/0 (socket says 172.21.15.39:39234) 2023-11-28T11:56:52.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.549+0000 7fdde7fff700 1 -- 172.21.15.39:0/484720781 learned_addr learned my addr 172.21.15.39:0/484720781 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:52.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.549+0000 7fddecc75700 1 --2- 172.21.15.39:0/484720781 >> v2:172.21.15.184:3300/0 conn(0x7fdde815a9f0 0x7fdde806b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.549+0000 7fdde7fff700 1 -- 172.21.15.39:0/484720781 >> v2:172.21.15.184:3300/0 conn(0x7fdde815a9f0 msgr2=0x7fdde806b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:52.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.549+0000 7fdde7fff700 1 --2- 172.21.15.39:0/484720781 >> v2:172.21.15.184:3300/0 conn(0x7fdde815a9f0 0x7fdde806b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.549+0000 7fdde7fff700 1 -- 172.21.15.39:0/484720781 >> v1:172.21.15.184:6789/0 conn(0x7fdde80c8c90 legacy=0x7fdde815a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:52.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.549+0000 7fdde7fff700 1 -- 172.21.15.39:0/484720781 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde815adf0 con 0x7fdde8159f10 2023-11-28T11:56:52.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.549+0000 7fddecc75700 1 --2- 172.21.15.39:0/484720781 >> v2:172.21.15.184:3300/0 conn(0x7fdde815a9f0 0x7fdde806b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:52.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.549+0000 7fdde7fff700 1 --2- 172.21.15.39:0/484720781 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdde8159f10 0x7fdde8070a90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdde806bb40 tx=0x7fddd8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6291ff5c33e191f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:52.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.553+0000 7fdde6ffd700 1 -- 172.21.15.39:0/484720781 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd800b8a0 con 0x7fdde8159f10 2023-11-28T11:56:52.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.553+0000 7fdde6ffd700 1 -- 172.21.15.39:0/484720781 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd800ba00 con 0x7fdde8159f10 2023-11-28T11:56:52.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.553+0000 7fdde6ffd700 1 -- 172.21.15.39:0/484720781 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd800bd90 con 0x7fdde8159f10 2023-11-28T11:56:52.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.553+0000 7fdded476700 1 -- 172.21.15.39:0/484720781 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdde8159f10 msgr2=0x7fdde8070a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:52.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.553+0000 7fdded476700 1 --2- 172.21.15.39:0/484720781 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdde8159f10 0x7fdde8070a90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdde806bb40 tx=0x7fddd8009bf0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.553+0000 7fdded476700 1 -- 172.21.15.39:0/484720781 shutdown_connections 2023-11-28T11:56:52.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.553+0000 7fdded476700 1 --2- 172.21.15.39:0/484720781 >> v2:172.21.15.184:3300/0 conn(0x7fdde815a9f0 0x7fdde806b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.553+0000 7fdded476700 1 --2- 172.21.15.39:0/484720781 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdde8159f10 0x7fdde8070a90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.553+0000 7fdded476700 1 -- 172.21.15.39:0/484720781 >> 172.21.15.39:0/484720781 conn(0x7fdde80cf280 msgr2=0x7fdde80cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:52.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.553+0000 7fdded476700 1 -- 172.21.15.39:0/484720781 shutdown_connections 2023-11-28T11:56:52.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.553+0000 7fdded476700 1 -- 172.21.15.39:0/484720781 wait complete. 2023-11-28T11:56:52.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.557+0000 7fdded476700 1 Processor -- start 2023-11-28T11:56:52.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.557+0000 7fdded476700 1 -- start start 2023-11-28T11:56:52.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.557+0000 7fdded476700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdde80c8c90 0x7fdde814f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.557+0000 7fdded476700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdde8159f10 0x7fdde8154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.557+0000 7fdded476700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdde815a9f0 0x7fdde80cd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.557+0000 7fdded476700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde815bf40 con 0x7fdde80c8c90 2023-11-28T11:56:52.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.557+0000 7fdded476700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde8152b00 con 0x7fdde8159f10 2023-11-28T11:56:52.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.557+0000 7fdded476700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde814f770 con 0x7fdde815a9f0 2023-11-28T11:56:52.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.557+0000 7fdde7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdde80c8c90 0x7fdde814f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.557+0000 7fdde7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdde80c8c90 0x7fdde814f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39246/0 (socket says 172.21.15.39:39246) 2023-11-28T11:56:52.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.557+0000 7fdde7fff700 1 -- 172.21.15.39:0/2986983316 learned_addr learned my addr 172.21.15.39:0/2986983316 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:52.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.561+0000 7fddecc75700 1 --2- 172.21.15.39:0/2986983316 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdde815a9f0 0x7fdde80cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.561+0000 7fdde77fe700 1 --2- 172.21.15.39:0/2986983316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdde8159f10 0x7fdde8154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.561+0000 7fdde7fff700 1 -- 172.21.15.39:0/2986983316 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdde815a9f0 msgr2=0x7fdde80cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:52.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.561+0000 7fdde7fff700 1 --2- 172.21.15.39:0/2986983316 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdde815a9f0 0x7fdde80cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.561+0000 7fdde7fff700 1 -- 172.21.15.39:0/2986983316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdde8159f10 msgr2=0x7fdde8154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:52.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.561+0000 7fdde7fff700 1 --2- 172.21.15.39:0/2986983316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdde8159f10 0x7fdde8154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.561+0000 7fdde7fff700 1 -- 172.21.15.39:0/2986983316 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd8009570 con 0x7fdde80c8c90 2023-11-28T11:56:52.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.561+0000 7fdde77fe700 1 --2- 172.21.15.39:0/2986983316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdde8159f10 0x7fdde8154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:52.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.561+0000 7fdde7fff700 1 --2- 172.21.15.39:0/2986983316 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdde80c8c90 0x7fdde814f230 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fddd800b0e0 tx=0x7fddd8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:52.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.561+0000 7fdde4ff9700 1 -- 172.21.15.39:0/2986983316 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd80036c0 con 0x7fdde80c8c90 2023-11-28T11:56:52.567 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.561+0000 7fdde4ff9700 1 -- 172.21.15.39:0/2986983316 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd801f070 con 0x7fdde80c8c90 2023-11-28T11:56:52.567 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.561+0000 7fdded476700 1 -- 172.21.15.39:0/2986983316 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdde806ffb0 con 0x7fdde80c8c90 2023-11-28T11:56:52.567 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.561+0000 7fdde4ff9700 1 -- 172.21.15.39:0/2986983316 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd8003a80 con 0x7fdde80c8c90 2023-11-28T11:56:52.567 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.561+0000 7fdded476700 1 -- 172.21.15.39:0/2986983316 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdde80afcc0 con 0x7fdde80c8c90 2023-11-28T11:56:52.568 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.561+0000 7fdded476700 1 -- 172.21.15.39:0/2986983316 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdde8070290 con 0x7fdde80c8c90 2023-11-28T11:56:52.569 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.565+0000 7fdde4ff9700 1 -- 172.21.15.39:0/2986983316 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fddd802a020 con 0x7fdde80c8c90 2023-11-28T11:56:52.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.565+0000 7fdde4ff9700 1 --2- 172.21.15.39:0/2986983316 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fddd4064ee0 0x7fddd4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.565+0000 7fdde4ff9700 1 -- 172.21.15.39:0/2986983316 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fddd8083980 con 0x7fdde80c8c90 2023-11-28T11:56:52.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.565+0000 7fdde77fe700 1 --2- 172.21.15.39:0/2986983316 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fddd4064ee0 0x7fddd4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.569+0000 7fdde77fe700 1 --2- 172.21.15.39:0/2986983316 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fddd4064ee0 0x7fddd4067390 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdde80cdeb0 tx=0x7fdddc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:52.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.573+0000 7fdde4ff9700 1 -- 172.21.15.39:0/2986983316 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fddd8051830 con 0x7fdde80c8c90 2023-11-28T11:56:52.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.749+0000 7fdded476700 1 -- 172.21.15.39:0/2986983316 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdde806cf30 con 0x7fdde80c8c90 2023-11-28T11:56:52.754 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.749+0000 7fdde4ff9700 1 -- 172.21.15.39:0/2986983316 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fddd8054e50 con 0x7fdde80c8c90 2023-11-28T11:56:52.754 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-11-28T11:56:52.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.753+0000 7fdded476700 1 -- 172.21.15.39:0/2986983316 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fddd4064ee0 msgr2=0x7fddd4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:52.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.753+0000 7fdded476700 1 --2- 172.21.15.39:0/2986983316 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fddd4064ee0 0x7fddd4067390 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdde80cdeb0 tx=0x7fdddc009040 comp rx=0 tx=0).stop 2023-11-28T11:56:52.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.753+0000 7fdded476700 1 -- 172.21.15.39:0/2986983316 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdde80c8c90 msgr2=0x7fdde814f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:52.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.753+0000 7fdded476700 1 --2- 172.21.15.39:0/2986983316 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdde80c8c90 0x7fdde814f230 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fddd800b0e0 tx=0x7fddd8004770 comp rx=0 tx=0).stop 2023-11-28T11:56:52.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.753+0000 7fdded476700 1 -- 172.21.15.39:0/2986983316 shutdown_connections 2023-11-28T11:56:52.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.753+0000 7fdded476700 1 --2- 172.21.15.39:0/2986983316 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdde815a9f0 0x7fdde80cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.753+0000 7fdded476700 1 --2- 172.21.15.39:0/2986983316 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fddd4064ee0 0x7fddd4067390 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.753+0000 7fdded476700 1 --2- 172.21.15.39:0/2986983316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdde8159f10 0x7fdde8154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.753+0000 7fdded476700 1 --2- 172.21.15.39:0/2986983316 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdde80c8c90 0x7fdde814f230 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.753+0000 7fdded476700 1 -- 172.21.15.39:0/2986983316 >> 172.21.15.39:0/2986983316 conn(0x7fdde80cf280 msgr2=0x7fdde80ca730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:52.758 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.753+0000 7fdded476700 1 -- 172.21.15.39:0/2986983316 shutdown_connections 2023-11-28T11:56:52.758 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.753+0000 7fdded476700 1 -- 172.21.15.39:0/2986983316 wait complete. 2023-11-28T11:56:52.778 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:56:52.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.969+0000 7fc411028700 1 Processor -- start 2023-11-28T11:56:52.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.969+0000 7fc411028700 1 -- start start 2023-11-28T11:56:52.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.973+0000 7fc411028700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc40c154670 0x7fc40c0afa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.973+0000 7fc411028700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc40c15a480 0x7fc40c0ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.973+0000 7fc411028700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc40c15db10 con 0x7fc40c0ce920 2023-11-28T11:56:52.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.973+0000 7fc411028700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc40c15aa40 con 0x7fc40c154670 2023-11-28T11:56:52.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.973+0000 7fc411028700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c15ad20 con 0x7fc40c15a480 2023-11-28T11:56:52.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.973+0000 7fc40bfff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc40c154670 0x7fc40c0afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.973+0000 7fc40bfff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc40c154670 0x7fc40c0afa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39260/0 (socket says 172.21.15.39:39260) 2023-11-28T11:56:52.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.973+0000 7fc40bfff700 1 -- 172.21.15.39:0/3732778067 learned_addr learned my addr 172.21.15.39:0/3732778067 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:52.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.973+0000 7fc4037fe700 1 --2- 172.21.15.39:0/3732778067 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc40c15a480 0x7fc40c0ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.973+0000 7fc40bfff700 1 -- 172.21.15.39:0/3732778067 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc40c15a480 msgr2=0x7fc40c0ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:52.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.973+0000 7fc40bfff700 1 --2- 172.21.15.39:0/3732778067 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc40c15a480 0x7fc40c0ce3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.973+0000 7fc40bfff700 1 -- 172.21.15.39:0/3732778067 >> v1:172.21.15.39:6789/0 conn(0x7fc40c0ce920 legacy=0x7fc40c15dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:52.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.973+0000 7fc40bfff700 1 -- 172.21.15.39:0/3732778067 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc40c15b000 con 0x7fc40c154670 2023-11-28T11:56:52.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.973+0000 7fc4037fe700 1 --2- 172.21.15.39:0/3732778067 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc40c15a480 0x7fc40c0ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:56:52.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.977+0000 7fc40bfff700 1 --2- 172.21.15.39:0/3732778067 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc40c154670 0x7fc40c0afa70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc009910 tx=0x7fc3fc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16009747a995eb09 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:52.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.977+0000 7fc40b7fe700 1 -- 172.21.15.39:0/3732778067 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc00ba60 con 0x7fc40c154670 2023-11-28T11:56:52.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.977+0000 7fc40b7fe700 1 -- 172.21.15.39:0/3732778067 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3fc00bbc0 con 0x7fc40c154670 2023-11-28T11:56:52.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.977+0000 7fc40b7fe700 1 -- 172.21.15.39:0/3732778067 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc009e60 con 0x7fc40c154670 2023-11-28T11:56:52.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.977+0000 7fc411028700 1 -- 172.21.15.39:0/3732778067 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc40c154670 msgr2=0x7fc40c0afa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:52.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.977+0000 7fc411028700 1 --2- 172.21.15.39:0/3732778067 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc40c154670 0x7fc40c0afa70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc009910 tx=0x7fc3fc009c20 comp rx=0 tx=0).stop 2023-11-28T11:56:52.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.977+0000 7fc411028700 1 -- 172.21.15.39:0/3732778067 shutdown_connections 2023-11-28T11:56:52.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.977+0000 7fc411028700 1 --2- 172.21.15.39:0/3732778067 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc40c15a480 0x7fc40c0ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.977+0000 7fc411028700 1 --2- 172.21.15.39:0/3732778067 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc40c154670 0x7fc40c0afa70 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.977+0000 7fc411028700 1 -- 172.21.15.39:0/3732778067 >> 172.21.15.39:0/3732778067 conn(0x7fc40c0cd290 msgr2=0x7fc40c0cd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:52.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.977+0000 7fc411028700 1 -- 172.21.15.39:0/3732778067 shutdown_connections 2023-11-28T11:56:52.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.977+0000 7fc411028700 1 -- 172.21.15.39:0/3732778067 wait complete. 2023-11-28T11:56:52.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.977+0000 7fc411028700 1 Processor -- start 2023-11-28T11:56:52.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.977+0000 7fc411028700 1 -- start start 2023-11-28T11:56:52.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.981+0000 7fc411028700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc40c0ce920 0x7fc40c06c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.981+0000 7fc411028700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc40c154670 0x7fc40c0b4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.981+0000 7fc411028700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc40c15a480 0x7fc40c1f5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.981+0000 7fc411028700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c1f5bb0 con 0x7fc40c154670 2023-11-28T11:56:52.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.981+0000 7fc411028700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c146050 con 0x7fc40c15a480 2023-11-28T11:56:52.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.981+0000 7fc411028700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c145440 con 0x7fc40c0ce920 2023-11-28T11:56:52.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.981+0000 7fc4037fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc40c154670 0x7fc40c0b4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.981+0000 7fc4037fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc40c154670 0x7fc40c0b4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39262/0 (socket says 172.21.15.39:39262) 2023-11-28T11:56:52.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.981+0000 7fc4037fe700 1 -- 172.21.15.39:0/3717879090 learned_addr learned my addr 172.21.15.39:0/3717879090 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:52.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.981+0000 7fc40bfff700 1 --2- 172.21.15.39:0/3717879090 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc40c0ce920 0x7fc40c06c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.981+0000 7fc410827700 1 --2- 172.21.15.39:0/3717879090 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc40c15a480 0x7fc40c1f5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.981+0000 7fc4037fe700 1 -- 172.21.15.39:0/3717879090 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc40c0ce920 msgr2=0x7fc40c06c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:52.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.981+0000 7fc4037fe700 1 --2- 172.21.15.39:0/3717879090 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc40c0ce920 0x7fc40c06c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.981+0000 7fc4037fe700 1 -- 172.21.15.39:0/3717879090 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc40c15a480 msgr2=0x7fc40c1f5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:52.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.981+0000 7fc4037fe700 1 --2- 172.21.15.39:0/3717879090 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc40c15a480 0x7fc40c1f5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.981+0000 7fc4037fe700 1 -- 172.21.15.39:0/3717879090 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3fc009570 con 0x7fc40c154670 2023-11-28T11:56:52.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.981+0000 7fc410827700 1 --2- 172.21.15.39:0/3717879090 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc40c15a480 0x7fc40c1f5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:52.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.981+0000 7fc4037fe700 1 --2- 172.21.15.39:0/3717879090 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc40c154670 0x7fc40c0b4690 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc3f400c7c0 tx=0x7fc3f400cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:52.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.981+0000 7fc4097fa700 1 -- 172.21.15.39:0/3717879090 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f4011800 con 0x7fc40c154670 2023-11-28T11:56:52.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.981+0000 7fc4097fa700 1 -- 172.21.15.39:0/3717879090 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f4011960 con 0x7fc40c154670 2023-11-28T11:56:52.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.981+0000 7fc411028700 1 -- 172.21.15.39:0/3717879090 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc40c15b2e0 con 0x7fc40c154670 2023-11-28T11:56:52.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.981+0000 7fc4097fa700 1 -- 172.21.15.39:0/3717879090 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f4011cf0 con 0x7fc40c154670 2023-11-28T11:56:52.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.981+0000 7fc411028700 1 -- 172.21.15.39:0/3717879090 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc40c0affb0 con 0x7fc40c154670 2023-11-28T11:56:52.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.985+0000 7fc411028700 1 -- 172.21.15.39:0/3717879090 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc40c15e6d0 con 0x7fc40c154670 2023-11-28T11:56:52.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.985+0000 7fc4097fa700 1 -- 172.21.15.39:0/3717879090 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc3f4020070 con 0x7fc40c154670 2023-11-28T11:56:52.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.989+0000 7fc4097fa700 1 --2- 172.21.15.39:0/3717879090 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc3ec064ee0 0x7fc3ec067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.989+0000 7fc4097fa700 1 -- 172.21.15.39:0/3717879090 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc3f4082090 con 0x7fc40c154670 2023-11-28T11:56:52.994 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.989+0000 7fc40bfff700 1 --2- 172.21.15.39:0/3717879090 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc3ec064ee0 0x7fc3ec067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.989+0000 7fc40bfff700 1 --2- 172.21.15.39:0/3717879090 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc3ec064ee0 0x7fc3ec067390 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc000c00 tx=0x7fc3fc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:52.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:52.993+0000 7fc4097fa700 1 -- 172.21.15.39:0/3717879090 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc3f404fdd0 con 0x7fc40c154670 2023-11-28T11:56:53.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.165+0000 7fc411028700 1 -- 172.21.15.39:0/3717879090 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc40c073d50 con 0x7fc40c154670 2023-11-28T11:56:53.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.169+0000 7fc4097fa700 1 -- 172.21.15.39:0/3717879090 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc3f40533f0 con 0x7fc40c154670 2023-11-28T11:56:53.173 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2023-11-28T11:56:53.177 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.173+0000 7fc411028700 1 -- 172.21.15.39:0/3717879090 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc3ec064ee0 msgr2=0x7fc3ec067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:53.177 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.173+0000 7fc411028700 1 --2- 172.21.15.39:0/3717879090 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc3ec064ee0 0x7fc3ec067390 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc000c00 tx=0x7fc3fc008030 comp rx=0 tx=0).stop 2023-11-28T11:56:53.178 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.173+0000 7fc411028700 1 -- 172.21.15.39:0/3717879090 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc40c154670 msgr2=0x7fc40c0b4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:53.178 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.173+0000 7fc411028700 1 --2- 172.21.15.39:0/3717879090 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc40c154670 0x7fc40c0b4690 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc3f400c7c0 tx=0x7fc3f400cad0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.178 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.173+0000 7fc411028700 1 -- 172.21.15.39:0/3717879090 shutdown_connections 2023-11-28T11:56:53.179 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.173+0000 7fc411028700 1 --2- 172.21.15.39:0/3717879090 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc3ec064ee0 0x7fc3ec067390 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.179 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.173+0000 7fc411028700 1 --2- 172.21.15.39:0/3717879090 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc40c15a480 0x7fc40c1f5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.179 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.173+0000 7fc411028700 1 --2- 172.21.15.39:0/3717879090 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc40c154670 0x7fc40c0b4690 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.179 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.173+0000 7fc411028700 1 --2- 172.21.15.39:0/3717879090 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc40c0ce920 0x7fc40c06c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.179 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.173+0000 7fc411028700 1 -- 172.21.15.39:0/3717879090 >> 172.21.15.39:0/3717879090 conn(0x7fc40c0cd290 msgr2=0x7fc40c0d0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:53.179 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.173+0000 7fc411028700 1 -- 172.21.15.39:0/3717879090 shutdown_connections 2023-11-28T11:56:53.179 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.173+0000 7fc411028700 1 -- 172.21.15.39:0/3717879090 wait complete. 2023-11-28T11:56:53.200 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T11:56:53.387 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.381+0000 7fcf6a00f700 1 Processor -- start 2023-11-28T11:56:53.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.381+0000 7fcf6a00f700 1 -- start start 2023-11-28T11:56:53.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.385+0000 7fcf6a00f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf64070620 0x7fcf640b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.385+0000 7fcf6a00f700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fcf64069bf0 0x7fcf6406a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.385+0000 7fcf6a00f700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf6415c520 con 0x7fcf6415c150 2023-11-28T11:56:53.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.385+0000 7fcf6a00f700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf640b4240 con 0x7fcf64069bf0 2023-11-28T11:56:53.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.385+0000 7fcf6a00f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6406cc50 con 0x7fcf64070620 2023-11-28T11:56:53.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.385+0000 7fcf6980e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fcf64069bf0 0x7fcf6406a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.385+0000 7fcf6980e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fcf64069bf0 0x7fcf6406a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39270/0 (socket says 172.21.15.39:39270) 2023-11-28T11:56:53.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.385+0000 7fcf6980e700 1 -- 172.21.15.39:0/2082839156 learned_addr learned my addr 172.21.15.39:0/2082839156 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:53.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.385+0000 7fcf6880c700 1 --2- 172.21.15.39:0/2082839156 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf64070620 0x7fcf640b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.389+0000 7fcf6980e700 1 -- 172.21.15.39:0/2082839156 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf64070620 msgr2=0x7fcf640b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:53.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.389+0000 7fcf6980e700 1 --2- 172.21.15.39:0/2082839156 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf64070620 0x7fcf640b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.389+0000 7fcf6980e700 1 -- 172.21.15.39:0/2082839156 >> v1:172.21.15.184:6789/0 conn(0x7fcf6415c150 legacy=0x7fcf6406ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:53.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.389+0000 7fcf6980e700 1 -- 172.21.15.39:0/2082839156 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf640d2450 con 0x7fcf64069bf0 2023-11-28T11:56:53.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.389+0000 7fcf6980e700 1 --2- 172.21.15.39:0/2082839156 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf64069bf0 0x7fcf6406a050 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c009e50 tx=0x7fcf5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d002f65fa515212 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:53.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.389+0000 7fcf5bfff700 1 -- 172.21.15.39:0/2082839156 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c00e070 con 0x7fcf64069bf0 2023-11-28T11:56:53.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.389+0000 7fcf5bfff700 1 -- 172.21.15.39:0/2082839156 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5c00b9c0 con 0x7fcf64069bf0 2023-11-28T11:56:53.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.389+0000 7fcf5bfff700 1 -- 172.21.15.39:0/2082839156 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c00bd70 con 0x7fcf64069bf0 2023-11-28T11:56:53.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.389+0000 7fcf6a00f700 1 -- 172.21.15.39:0/2082839156 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf64069bf0 msgr2=0x7fcf6406a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:53.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.389+0000 7fcf6a00f700 1 --2- 172.21.15.39:0/2082839156 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf64069bf0 0x7fcf6406a050 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c009e50 tx=0x7fcf5c00b330 comp rx=0 tx=0).stop 2023-11-28T11:56:53.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.389+0000 7fcf6a00f700 1 -- 172.21.15.39:0/2082839156 shutdown_connections 2023-11-28T11:56:53.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.389+0000 7fcf6a00f700 1 --2- 172.21.15.39:0/2082839156 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf64069bf0 0x7fcf6406a050 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.389+0000 7fcf6a00f700 1 --2- 172.21.15.39:0/2082839156 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf64070620 0x7fcf640b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.389+0000 7fcf6a00f700 1 -- 172.21.15.39:0/2082839156 >> 172.21.15.39:0/2082839156 conn(0x7fcf640d3680 msgr2=0x7fcf640cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:53.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.389+0000 7fcf6a00f700 1 -- 172.21.15.39:0/2082839156 shutdown_connections 2023-11-28T11:56:53.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.389+0000 7fcf6a00f700 1 -- 172.21.15.39:0/2082839156 wait complete. 2023-11-28T11:56:53.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.393+0000 7fcf6a00f700 1 Processor -- start 2023-11-28T11:56:53.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.393+0000 7fcf6a00f700 1 -- start start 2023-11-28T11:56:53.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.397+0000 7fcf6a00f700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf64069bf0 0x7fcf641506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.397+0000 7fcf6a00f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf64070620 0x7fcf640ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.397+0000 7fcf6a00f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf6415c150 0x7fcf640cbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.397+0000 7fcf6a00f700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf640cff90 con 0x7fcf64069bf0 2023-11-28T11:56:53.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.397+0000 7fcf6a00f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf640c9f50 con 0x7fcf6415c150 2023-11-28T11:56:53.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.397+0000 7fcf6a00f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf64150be0 con 0x7fcf64070620 2023-11-28T11:56:53.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.397+0000 7fcf6900d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf64069bf0 0x7fcf641506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.397+0000 7fcf6900d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf64069bf0 0x7fcf641506a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39286/0 (socket says 172.21.15.39:39286) 2023-11-28T11:56:53.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.397+0000 7fcf6900d700 1 -- 172.21.15.39:0/4121903177 learned_addr learned my addr 172.21.15.39:0/4121903177 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:53.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.397+0000 7fcf6980e700 1 --2- 172.21.15.39:0/4121903177 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf6415c150 0x7fcf640cbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.397+0000 7fcf6880c700 1 --2- 172.21.15.39:0/4121903177 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf64070620 0x7fcf640ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.397+0000 7fcf6900d700 1 -- 172.21.15.39:0/4121903177 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf64070620 msgr2=0x7fcf640ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:53.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.397+0000 7fcf6900d700 1 --2- 172.21.15.39:0/4121903177 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf64070620 0x7fcf640ceff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.397+0000 7fcf6900d700 1 -- 172.21.15.39:0/4121903177 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf6415c150 msgr2=0x7fcf640cbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:53.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.397+0000 7fcf6900d700 1 --2- 172.21.15.39:0/4121903177 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf6415c150 0x7fcf640cbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.397+0000 7fcf6900d700 1 -- 172.21.15.39:0/4121903177 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5c009b30 con 0x7fcf64069bf0 2023-11-28T11:56:53.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.397+0000 7fcf6900d700 1 --2- 172.21.15.39:0/4121903177 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf64069bf0 0x7fcf641506a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcf6000c500 tx=0x7fcf6000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:53.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.397+0000 7fcf59ffb700 1 -- 172.21.15.39:0/4121903177 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf600052d0 con 0x7fcf64069bf0 2023-11-28T11:56:53.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.397+0000 7fcf6a00f700 1 -- 172.21.15.39:0/4121903177 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf640d05e0 con 0x7fcf64069bf0 2023-11-28T11:56:53.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.397+0000 7fcf59ffb700 1 -- 172.21.15.39:0/4121903177 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf60005430 con 0x7fcf64069bf0 2023-11-28T11:56:53.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.397+0000 7fcf59ffb700 1 -- 172.21.15.39:0/4121903177 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf600055a0 con 0x7fcf64069bf0 2023-11-28T11:56:53.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.397+0000 7fcf6a00f700 1 -- 172.21.15.39:0/4121903177 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf640d2730 con 0x7fcf64069bf0 2023-11-28T11:56:53.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.401+0000 7fcf6a00f700 1 -- 172.21.15.39:0/4121903177 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf640d2140 con 0x7fcf64069bf0 2023-11-28T11:56:53.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.401+0000 7fcf59ffb700 1 -- 172.21.15.39:0/4121903177 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fcf60019030 con 0x7fcf64069bf0 2023-11-28T11:56:53.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.401+0000 7fcf59ffb700 1 --2- 172.21.15.39:0/4121903177 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcf48064f10 0x7fcf480673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.405+0000 7fcf59ffb700 1 -- 172.21.15.39:0/4121903177 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcf600813f0 con 0x7fcf64069bf0 2023-11-28T11:56:53.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.405+0000 7fcf6880c700 1 --2- 172.21.15.39:0/4121903177 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcf48064f10 0x7fcf480673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.405+0000 7fcf6880c700 1 --2- 172.21.15.39:0/4121903177 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcf48064f10 0x7fcf480673c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcf640cc990 tx=0x7fcf54008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:53.414 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.409+0000 7fcf59ffb700 1 -- 172.21.15.39:0/4121903177 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcf6004f220 con 0x7fcf64069bf0 2023-11-28T11:56:53.587 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.581+0000 7fcf6a00f700 1 -- 172.21.15.39:0/4121903177 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fcf64073d20 con 0x7fcf64069bf0 2023-11-28T11:56:53.587 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.581+0000 7fcf59ffb700 1 -- 172.21.15.39:0/4121903177 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fcf60052840 con 0x7fcf64069bf0 2023-11-28T11:56:53.588 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-11-28T11:56:53.590 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.585+0000 7fcf6a00f700 1 -- 172.21.15.39:0/4121903177 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcf48064f10 msgr2=0x7fcf480673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:53.591 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.585+0000 7fcf6a00f700 1 --2- 172.21.15.39:0/4121903177 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcf48064f10 0x7fcf480673c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcf640cc990 tx=0x7fcf54008040 comp rx=0 tx=0).stop 2023-11-28T11:56:53.591 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.585+0000 7fcf6a00f700 1 -- 172.21.15.39:0/4121903177 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf64069bf0 msgr2=0x7fcf641506a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:53.591 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.585+0000 7fcf6a00f700 1 --2- 172.21.15.39:0/4121903177 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf64069bf0 0x7fcf641506a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcf6000c500 tx=0x7fcf6000c810 comp rx=0 tx=0).stop 2023-11-28T11:56:53.591 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.585+0000 7fcf6a00f700 1 -- 172.21.15.39:0/4121903177 shutdown_connections 2023-11-28T11:56:53.591 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.585+0000 7fcf6a00f700 1 --2- 172.21.15.39:0/4121903177 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcf48064f10 0x7fcf480673c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.592 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.585+0000 7fcf6a00f700 1 --2- 172.21.15.39:0/4121903177 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf6415c150 0x7fcf640cbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.592 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.585+0000 7fcf6a00f700 1 --2- 172.21.15.39:0/4121903177 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf64070620 0x7fcf640ceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.592 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.585+0000 7fcf6a00f700 1 --2- 172.21.15.39:0/4121903177 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf64069bf0 0x7fcf641506a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.592 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.585+0000 7fcf6a00f700 1 -- 172.21.15.39:0/4121903177 >> 172.21.15.39:0/4121903177 conn(0x7fcf640d3680 msgr2=0x7fcf64155890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:53.592 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.585+0000 7fcf6a00f700 1 -- 172.21.15.39:0/4121903177 shutdown_connections 2023-11-28T11:56:53.592 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.585+0000 7fcf6a00f700 1 -- 172.21.15.39:0/4121903177 wait complete. 2023-11-28T11:56:53.616 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T11:56:53.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.797+0000 7fc2c4651700 1 Processor -- start 2023-11-28T11:56:53.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.797+0000 7fc2c4651700 1 -- start start 2023-11-28T11:56:53.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.801+0000 7fc2c4651700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc2bc1534a0 0x7fc2bc15d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.801+0000 7fc2c4651700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2bc0b6200 0x7fc2bc070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.801+0000 7fc2c4651700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2bc15d080 con 0x7fc2bc160920 2023-11-28T11:56:53.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.801+0000 7fc2c4651700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2bc153870 con 0x7fc2bc1534a0 2023-11-28T11:56:53.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.801+0000 7fc2c4651700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2bc0b53c0 con 0x7fc2bc0b6200 2023-11-28T11:56:53.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.801+0000 7fc2c1bec700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fc2bc160920 0x7fc2bc0b5af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35838/0 (socket says 172.21.15.39:35838) 2023-11-28T11:56:53.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.801+0000 7fc2c1bec700 1 -- 172.21.15.39:0/2328341456 learned_addr learned my addr 172.21.15.39:0/2328341456 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:56:53.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.801+0000 7fc2c23ed700 1 --2- 172.21.15.39:0/2328341456 >> v2:172.21.15.39:3300/0 conn(0x7fc2bc1534a0 0x7fc2bc15d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.801+0000 7fc2c2bee700 1 --2- 172.21.15.39:0/2328341456 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2bc0b6200 0x7fc2bc070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.801+0000 7fc2c13eb700 1 -- 172.21.15.39:0/2328341456 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1408393246 0 0) 0x7fc2bc15d080 con 0x7fc2bc160920 2023-11-28T11:56:53.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.801+0000 7fc2c13eb700 1 -- 172.21.15.39:0/2328341456 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2a80035d0 con 0x7fc2bc160920 2023-11-28T11:56:53.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.801+0000 7fc2c2bee700 1 -- 172.21.15.39:0/2328341456 >> v2:172.21.15.39:3300/0 conn(0x7fc2bc1534a0 msgr2=0x7fc2bc15d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:53.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.801+0000 7fc2c2bee700 1 --2- 172.21.15.39:0/2328341456 >> v2:172.21.15.39:3300/0 conn(0x7fc2bc1534a0 0x7fc2bc15d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.801+0000 7fc2c2bee700 1 -- 172.21.15.39:0/2328341456 >> v1:172.21.15.39:6789/0 conn(0x7fc2bc160920 legacy=0x7fc2bc0b5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:53.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.801+0000 7fc2c2bee700 1 -- 172.21.15.39:0/2328341456 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2bc0b56a0 con 0x7fc2bc0b6200 2023-11-28T11:56:53.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.801+0000 7fc2c23ed700 1 --2- 172.21.15.39:0/2328341456 >> v2:172.21.15.39:3300/0 conn(0x7fc2bc1534a0 0x7fc2bc15d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:53.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.801+0000 7fc2c2bee700 1 --2- 172.21.15.39:0/2328341456 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2bc0b6200 0x7fc2bc070630 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4009d90 tx=0x7fc2b400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e84c255e1d3a6e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:53.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.801+0000 7fc2c13eb700 1 -- 172.21.15.39:0/2328341456 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b400e070 con 0x7fc2bc0b6200 2023-11-28T11:56:53.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.801+0000 7fc2c13eb700 1 -- 172.21.15.39:0/2328341456 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b400bb20 con 0x7fc2bc0b6200 2023-11-28T11:56:53.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.801+0000 7fc2c13eb700 1 -- 172.21.15.39:0/2328341456 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b4012430 con 0x7fc2bc0b6200 2023-11-28T11:56:53.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.805+0000 7fc2c4651700 1 -- 172.21.15.39:0/2328341456 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2bc0b6200 msgr2=0x7fc2bc070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:53.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.805+0000 7fc2c4651700 1 --2- 172.21.15.39:0/2328341456 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2bc0b6200 0x7fc2bc070630 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4009d90 tx=0x7fc2b400b330 comp rx=0 tx=0).stop 2023-11-28T11:56:53.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.805+0000 7fc2c4651700 1 -- 172.21.15.39:0/2328341456 shutdown_connections 2023-11-28T11:56:53.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.805+0000 7fc2c4651700 1 --2- 172.21.15.39:0/2328341456 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2bc0b6200 0x7fc2bc070630 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.805+0000 7fc2c4651700 1 --2- 172.21.15.39:0/2328341456 >> v2:172.21.15.39:3300/0 conn(0x7fc2bc1534a0 0x7fc2bc15d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.805+0000 7fc2c4651700 1 -- 172.21.15.39:0/2328341456 >> 172.21.15.39:0/2328341456 conn(0x7fc2bc06bfc0 msgr2=0x7fc2bc06c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:53.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.805+0000 7fc2c4651700 1 -- 172.21.15.39:0/2328341456 shutdown_connections 2023-11-28T11:56:53.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.805+0000 7fc2c4651700 1 -- 172.21.15.39:0/2328341456 wait complete. 2023-11-28T11:56:53.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.805+0000 7fc2c4651700 1 Processor -- start 2023-11-28T11:56:53.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.805+0000 7fc2c4651700 1 -- start start 2023-11-28T11:56:53.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.809+0000 7fc2c4651700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2bc0b6200 0x7fc2bc14d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.809+0000 7fc2c4651700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2bc1534a0 0x7fc2bc156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.809+0000 7fc2c4651700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2bc160920 0x7fc2bc15eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.809+0000 7fc2c4651700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2bc15ba40 con 0x7fc2bc1534a0 2023-11-28T11:56:53.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.809+0000 7fc2c4651700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2bc0d0c40 con 0x7fc2bc0b6200 2023-11-28T11:56:53.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.809+0000 7fc2c4651700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2bc0d0f20 con 0x7fc2bc160920 2023-11-28T11:56:53.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.809+0000 7fc2c1bec700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2bc1534a0 0x7fc2bc156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.809+0000 7fc2c1bec700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2bc1534a0 0x7fc2bc156fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39296/0 (socket says 172.21.15.39:39296) 2023-11-28T11:56:53.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.809+0000 7fc2c1bec700 1 -- 172.21.15.39:0/1089420275 learned_addr learned my addr 172.21.15.39:0/1089420275 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:53.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.809+0000 7fc2c2bee700 1 --2- 172.21.15.39:0/1089420275 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2bc160920 0x7fc2bc15eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.809+0000 7fc2c23ed700 1 --2- 172.21.15.39:0/1089420275 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2bc0b6200 0x7fc2bc14d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.809+0000 7fc2c1bec700 1 -- 172.21.15.39:0/1089420275 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2bc160920 msgr2=0x7fc2bc15eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:53.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.809+0000 7fc2c1bec700 1 --2- 172.21.15.39:0/1089420275 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2bc160920 0x7fc2bc15eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.809+0000 7fc2c1bec700 1 -- 172.21.15.39:0/1089420275 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2bc0b6200 msgr2=0x7fc2bc14d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:53.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.809+0000 7fc2c1bec700 1 --2- 172.21.15.39:0/1089420275 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2bc0b6200 0x7fc2bc14d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.809+0000 7fc2c1bec700 1 -- 172.21.15.39:0/1089420275 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b80094b0 con 0x7fc2bc1534a0 2023-11-28T11:56:53.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.809+0000 7fc2c1bec700 1 --2- 172.21.15.39:0/1089420275 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2bc1534a0 0x7fc2bc156fe0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac00c700 tx=0x7fc2ac00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:53.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.809+0000 7fc2b2ffd700 1 -- 172.21.15.39:0/1089420275 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac005d90 con 0x7fc2bc1534a0 2023-11-28T11:56:53.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.809+0000 7fc2b2ffd700 1 -- 172.21.15.39:0/1089420275 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2ac0070d0 con 0x7fc2bc1534a0 2023-11-28T11:56:53.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.809+0000 7fc2b2ffd700 1 -- 172.21.15.39:0/1089420275 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac007480 con 0x7fc2bc1534a0 2023-11-28T11:56:53.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.809+0000 7fc2c4651700 1 -- 172.21.15.39:0/1089420275 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2b4009a70 con 0x7fc2bc1534a0 2023-11-28T11:56:53.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.809+0000 7fc2c4651700 1 -- 172.21.15.39:0/1089420275 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2bc15cd10 con 0x7fc2bc1534a0 2023-11-28T11:56:53.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.813+0000 7fc2c4651700 1 -- 172.21.15.39:0/1089420275 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2bc0b7f10 con 0x7fc2bc1534a0 2023-11-28T11:56:53.819 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.813+0000 7fc2b2ffd700 1 -- 172.21.15.39:0/1089420275 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc2ac019030 con 0x7fc2bc1534a0 2023-11-28T11:56:53.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.817+0000 7fc2b2ffd700 1 --2- 172.21.15.39:0/1089420275 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc2a0064f10 0x7fc2a00673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.817+0000 7fc2b2ffd700 1 -- 172.21.15.39:0/1089420275 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc2ac081540 con 0x7fc2bc1534a0 2023-11-28T11:56:53.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.817+0000 7fc2c23ed700 1 --2- 172.21.15.39:0/1089420275 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc2a0064f10 0x7fc2a00673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.817+0000 7fc2c23ed700 1 --2- 172.21.15.39:0/1089420275 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc2a0064f10 0x7fc2a00673c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8009d80 tx=0x7fc2b8009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:53.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:53.821+0000 7fc2b2ffd700 1 -- 172.21.15.39:0/1089420275 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc2ac04f2a0 con 0x7fc2bc1534a0 2023-11-28T11:56:54.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.017+0000 7fc2c4651700 1 -- 172.21.15.39:0/1089420275 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc2bc0726c0 con 0x7fc2bc1534a0 2023-11-28T11:56:54.023 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.017+0000 7fc2b2ffd700 1 -- 172.21.15.39:0/1089420275 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc2ac0528c0 con 0x7fc2bc1534a0 2023-11-28T11:56:54.026 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.021+0000 7fc2c4651700 1 -- 172.21.15.39:0/1089420275 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc2a0064f10 msgr2=0x7fc2a00673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:54.026 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.021+0000 7fc2c4651700 1 --2- 172.21.15.39:0/1089420275 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc2a0064f10 0x7fc2a00673c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8009d80 tx=0x7fc2b8009240 comp rx=0 tx=0).stop 2023-11-28T11:56:54.026 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.021+0000 7fc2c4651700 1 -- 172.21.15.39:0/1089420275 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2bc1534a0 msgr2=0x7fc2bc156fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:54.026 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.021+0000 7fc2c4651700 1 --2- 172.21.15.39:0/1089420275 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2bc1534a0 0x7fc2bc156fe0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac00c700 tx=0x7fc2ac00ca10 comp rx=0 tx=0).stop 2023-11-28T11:56:54.026 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.021+0000 7fc2c4651700 1 -- 172.21.15.39:0/1089420275 shutdown_connections 2023-11-28T11:56:54.026 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.021+0000 7fc2c4651700 1 --2- 172.21.15.39:0/1089420275 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2bc160920 0x7fc2bc15eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:54.026 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.021+0000 7fc2c4651700 1 --2- 172.21.15.39:0/1089420275 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2bc1534a0 0x7fc2bc156fe0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:54.026 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.021+0000 7fc2c4651700 1 --2- 172.21.15.39:0/1089420275 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc2a0064f10 0x7fc2a00673c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:54.026 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.021+0000 7fc2c4651700 1 --2- 172.21.15.39:0/1089420275 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2bc0b6200 0x7fc2bc14d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:54.027 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.021+0000 7fc2c4651700 1 -- 172.21.15.39:0/1089420275 >> 172.21.15.39:0/1089420275 conn(0x7fc2bc06bfc0 msgr2=0x7fc2bc15d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:54.027 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.021+0000 7fc2c4651700 1 -- 172.21.15.39:0/1089420275 shutdown_connections 2023-11-28T11:56:54.027 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.021+0000 7fc2c4651700 1 -- 172.21.15.39:0/1089420275 wait complete. 2023-11-28T11:56:54.028 INFO:teuthology.orchestra.run.smithi039.stderr:listed 0 entries 2023-11-28T11:56:54.048 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:56:54.048 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:56:54.062 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:56:54.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.293+0000 7f99e9de8700 1 Processor -- start 2023-11-28T11:56:54.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.293+0000 7f99e9de8700 1 -- start start 2023-11-28T11:56:54.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.297+0000 7f99e9de8700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f99e415c640 0x7f99e40d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:54.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.297+0000 7f99e9de8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99e4071aa0 0x7f99e406d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:54.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.297+0000 7f99e9de8700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f99e4069e00 0x7f99e406a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:54.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.297+0000 7f99e9de8700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e406cef0 con 0x7f99e415c640 2023-11-28T11:56:54.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.297+0000 7f99e9de8700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e406a7c0 con 0x7f99e4069e00 2023-11-28T11:56:54.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.297+0000 7f99e9de8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e406c600 con 0x7f99e4071aa0 2023-11-28T11:56:54.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.297+0000 7f99e8de6700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f99e415c640 0x7f99e40d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:54.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.297+0000 7f99e8de6700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f99e415c640 0x7f99e40d31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39312/0 (socket says 172.21.15.39:39312) 2023-11-28T11:56:54.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.297+0000 7f99e8de6700 1 -- 172.21.15.39:0/829547064 learned_addr learned my addr 172.21.15.39:0/829547064 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:54.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.297+0000 7f99e95e7700 1 --2- 172.21.15.39:0/829547064 >> v2:172.21.15.184:3300/0 conn(0x7f99e4069e00 0x7f99e406a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:54.304 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.297+0000 7f99e3fff700 1 --2- 172.21.15.39:0/829547064 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99e4071aa0 0x7f99e406d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:54.304 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.297+0000 7f99e8de6700 1 -- 172.21.15.39:0/829547064 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99e4071aa0 msgr2=0x7f99e406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:54.304 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.297+0000 7f99e8de6700 1 --2- 172.21.15.39:0/829547064 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99e4071aa0 0x7f99e406d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:54.304 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.297+0000 7f99e8de6700 1 -- 172.21.15.39:0/829547064 >> v2:172.21.15.184:3300/0 conn(0x7f99e4069e00 msgr2=0x7f99e406a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:54.304 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.297+0000 7f99e8de6700 1 --2- 172.21.15.39:0/829547064 >> v2:172.21.15.184:3300/0 conn(0x7f99e4069e00 0x7f99e406a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:54.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.297+0000 7f99e8de6700 1 -- 172.21.15.39:0/829547064 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e40722f0 con 0x7f99e415c640 2023-11-28T11:56:54.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.297+0000 7f99e95e7700 1 --2- 172.21.15.39:0/829547064 >> v2:172.21.15.184:3300/0 conn(0x7f99e4069e00 0x7f99e406a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:54.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.301+0000 7f99e8de6700 1 --2- 172.21.15.39:0/829547064 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99e415c640 0x7f99e40d31e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f99e406efb0 tx=0x7f99d8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d0df37d49a25cb4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:54.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.301+0000 7f99e37fe700 1 -- 172.21.15.39:0/829547064 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d8011830 con 0x7f99e415c640 2023-11-28T11:56:54.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.301+0000 7f99e37fe700 1 -- 172.21.15.39:0/829547064 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d8011990 con 0x7f99e415c640 2023-11-28T11:56:54.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.301+0000 7f99e37fe700 1 -- 172.21.15.39:0/829547064 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d8011d20 con 0x7f99e415c640 2023-11-28T11:56:54.306 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.301+0000 7f99e9de8700 1 -- 172.21.15.39:0/829547064 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99e415c640 msgr2=0x7f99e40d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:54.306 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.301+0000 7f99e9de8700 1 --2- 172.21.15.39:0/829547064 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99e415c640 0x7f99e40d31e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f99e406efb0 tx=0x7f99d8009bf0 comp rx=0 tx=0).stop 2023-11-28T11:56:54.306 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.301+0000 7f99e9de8700 1 -- 172.21.15.39:0/829547064 shutdown_connections 2023-11-28T11:56:54.307 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.301+0000 7f99e9de8700 1 --2- 172.21.15.39:0/829547064 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99e4071aa0 0x7f99e406d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:54.307 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.301+0000 7f99e9de8700 1 --2- 172.21.15.39:0/829547064 >> v2:172.21.15.184:3300/0 conn(0x7f99e4069e00 0x7f99e406a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:54.307 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.301+0000 7f99e9de8700 1 --2- 172.21.15.39:0/829547064 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99e415c640 0x7f99e40d31e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:54.307 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.301+0000 7f99e9de8700 1 -- 172.21.15.39:0/829547064 >> 172.21.15.39:0/829547064 conn(0x7f99e40b6520 msgr2=0x7f99e4071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:54.307 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.301+0000 7f99e9de8700 1 -- 172.21.15.39:0/829547064 shutdown_connections 2023-11-28T11:56:54.307 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.301+0000 7f99e9de8700 1 -- 172.21.15.39:0/829547064 wait complete. 2023-11-28T11:56:54.309 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.305+0000 7f99e9de8700 1 Processor -- start 2023-11-28T11:56:54.309 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.305+0000 7f99e9de8700 1 -- start start 2023-11-28T11:56:54.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.305+0000 7f99e9de8700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99e4069e00 0x7f99e40cd640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:54.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.305+0000 7f99e9de8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99e4071aa0 0x7f99e40cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:54.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.305+0000 7f99e9de8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99e415c640 0x7f99e415cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:54.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.305+0000 7f99e9de8700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e41f1bb0 con 0x7f99e4069e00 2023-11-28T11:56:54.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.305+0000 7f99e9de8700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e4159b40 con 0x7f99e415c640 2023-11-28T11:56:54.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.305+0000 7f99e9de8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e4159e00 con 0x7f99e4071aa0 2023-11-28T11:56:54.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.309+0000 7f99e8de6700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99e4069e00 0x7f99e40cd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:54.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.309+0000 7f99e8de6700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99e4069e00 0x7f99e40cd640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39326/0 (socket says 172.21.15.39:39326) 2023-11-28T11:56:54.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.309+0000 7f99e8de6700 1 -- 172.21.15.39:0/4276046553 learned_addr learned my addr 172.21.15.39:0/4276046553 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:54.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.309+0000 7f99e3fff700 1 --2- 172.21.15.39:0/4276046553 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99e4071aa0 0x7f99e40cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:54.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.309+0000 7f99e95e7700 1 --2- 172.21.15.39:0/4276046553 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99e415c640 0x7f99e415cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:54.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.309+0000 7f99e8de6700 1 -- 172.21.15.39:0/4276046553 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99e4071aa0 msgr2=0x7f99e40cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:54.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.309+0000 7f99e8de6700 1 --2- 172.21.15.39:0/4276046553 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99e4071aa0 0x7f99e40cf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:54.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.309+0000 7f99e8de6700 1 -- 172.21.15.39:0/4276046553 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99e415c640 msgr2=0x7f99e415cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:54.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.309+0000 7f99e8de6700 1 --2- 172.21.15.39:0/4276046553 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99e415c640 0x7f99e415cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:54.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.309+0000 7f99e8de6700 1 -- 172.21.15.39:0/4276046553 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99dc009a70 con 0x7f99e4069e00 2023-11-28T11:56:54.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.309+0000 7f99e95e7700 1 --2- 172.21.15.39:0/4276046553 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99e415c640 0x7f99e415cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:56:54.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.309+0000 7f99e8de6700 1 --2- 172.21.15.39:0/4276046553 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99e4069e00 0x7f99e40cd640 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f99d8000c00 tx=0x7f99d8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:54.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.309+0000 7f99e17fa700 1 -- 172.21.15.39:0/4276046553 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d8004450 con 0x7f99e4069e00 2023-11-28T11:56:54.315 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.309+0000 7f99e17fa700 1 -- 172.21.15.39:0/4276046553 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d80045b0 con 0x7f99e4069e00 2023-11-28T11:56:54.315 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.309+0000 7f99e17fa700 1 -- 172.21.15.39:0/4276046553 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d8003900 con 0x7f99e4069e00 2023-11-28T11:56:54.315 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.309+0000 7f99e9de8700 1 -- 172.21.15.39:0/4276046553 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99d8009570 con 0x7f99e4069e00 2023-11-28T11:56:54.315 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.309+0000 7f99e9de8700 1 -- 172.21.15.39:0/4276046553 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e4072010 con 0x7f99e4069e00 2023-11-28T11:56:54.315 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.309+0000 7f99e9de8700 1 -- 172.21.15.39:0/4276046553 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e415ca10 con 0x7f99e4069e00 2023-11-28T11:56:54.317 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.313+0000 7f99e17fa700 1 -- 172.21.15.39:0/4276046553 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f99d802d070 con 0x7f99e4069e00 2023-11-28T11:56:54.317 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.313+0000 7f99e17fa700 1 --2- 172.21.15.39:0/4276046553 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f99d0064ee0 0x7f99d0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:54.317 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.313+0000 7f99e17fa700 1 -- 172.21.15.39:0/4276046553 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f99d8021030 con 0x7f99e4069e00 2023-11-28T11:56:54.318 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.313+0000 7f99e3fff700 1 --2- 172.21.15.39:0/4276046553 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f99d0064ee0 0x7f99d0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:54.319 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.313+0000 7f99e3fff700 1 --2- 172.21.15.39:0/4276046553 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f99d0064ee0 0x7f99d0067390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f99e40d2b00 tx=0x7f99d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:54.325 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.321+0000 7f99e17fa700 1 -- 172.21.15.39:0/4276046553 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f99d80515a0 con 0x7f99e4069e00 2023-11-28T11:56:54.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.493+0000 7f99e9de8700 1 -- 172.21.15.39:0/4276046553 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99e406c830 con 0x7f99e4069e00 2023-11-28T11:56:54.502 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.497+0000 7f99e17fa700 1 -- 172.21.15.39:0/4276046553 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+19652 (secure 0 0 0) 0x7f99d802b020 con 0x7f99e4069e00 2023-11-28T11:56:54.502 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:56:54.503 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":29,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:56:44.439368+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:56:38.203736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:56:38.946498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:56:41.988334+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:56:54.505 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.501+0000 7f99e9de8700 1 -- 172.21.15.39:0/4276046553 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f99d0064ee0 msgr2=0x7f99d0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:54.505 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.501+0000 7f99e9de8700 1 --2- 172.21.15.39:0/4276046553 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f99d0064ee0 0x7f99d0067390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f99e40d2b00 tx=0x7f99d4008040 comp rx=0 tx=0).stop 2023-11-28T11:56:54.505 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.501+0000 7f99e9de8700 1 -- 172.21.15.39:0/4276046553 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99e4069e00 msgr2=0x7f99e40cd640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:54.505 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.501+0000 7f99e9de8700 1 --2- 172.21.15.39:0/4276046553 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99e4069e00 0x7f99e40cd640 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f99d8000c00 tx=0x7f99d8004770 comp rx=0 tx=0).stop 2023-11-28T11:56:54.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.501+0000 7f99e9de8700 1 -- 172.21.15.39:0/4276046553 shutdown_connections 2023-11-28T11:56:54.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.501+0000 7f99e9de8700 1 --2- 172.21.15.39:0/4276046553 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f99d0064ee0 0x7f99d0067390 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:54.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.501+0000 7f99e9de8700 1 --2- 172.21.15.39:0/4276046553 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99e415c640 0x7f99e415cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:54.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.501+0000 7f99e9de8700 1 --2- 172.21.15.39:0/4276046553 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99e4071aa0 0x7f99e40cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:54.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.501+0000 7f99e9de8700 1 --2- 172.21.15.39:0/4276046553 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99e4069e00 0x7f99e40cd640 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:54.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.501+0000 7f99e9de8700 1 -- 172.21.15.39:0/4276046553 >> 172.21.15.39:0/4276046553 conn(0x7f99e40b6520 msgr2=0x7f99e40b1590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:54.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.501+0000 7f99e9de8700 1 -- 172.21.15.39:0/4276046553 shutdown_connections 2023-11-28T11:56:54.507 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.501+0000 7f99e9de8700 1 -- 172.21.15.39:0/4276046553 wait complete. 2023-11-28T11:56:54.528 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:56:26.631457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:56:33.242202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:56:38.203736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:56:38.946498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T11:56:41.988334+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T11:56:54.528 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:56:54.711 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.705+0000 7f79f1707700 1 Processor -- start 2023-11-28T11:56:54.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.705+0000 7f79f1707700 1 -- start start 2023-11-28T11:56:54.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.709+0000 7f79f1707700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f79ec070620 0x7f79ec0b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:54.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.709+0000 7f79f1707700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79ec069bf0 0x7f79ec06a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:54.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.709+0000 7f79f1707700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79ec15c520 con 0x7f79ec15c150 2023-11-28T11:56:54.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.709+0000 7f79f1707700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79ec0b4240 con 0x7f79ec070620 2023-11-28T11:56:54.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.709+0000 7f79f1707700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec06cc50 con 0x7f79ec069bf0 2023-11-28T11:56:54.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.709+0000 7f79ebfff700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f79ec15c150 0x7f79ec06ff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35852/0 (socket says 172.21.15.39:35852) 2023-11-28T11:56:54.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.709+0000 7f79ebfff700 1 -- 172.21.15.39:0/3099733365 learned_addr learned my addr 172.21.15.39:0/3099733365 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:56:54.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.709+0000 7f79eb7fe700 1 --2- 172.21.15.39:0/3099733365 >> v2:172.21.15.39:3300/0 conn(0x7f79ec070620 0x7f79ec0b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:54.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.709+0000 7f79f0f06700 1 --2- 172.21.15.39:0/3099733365 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79ec069bf0 0x7f79ec06a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:54.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.709+0000 7f79eaffd700 1 -- 172.21.15.39:0/3099733365 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2157365936 0 0) 0x7f79ec15c520 con 0x7f79ec15c150 2023-11-28T11:56:54.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.709+0000 7f79eaffd700 1 -- 172.21.15.39:0/3099733365 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79d40035d0 con 0x7f79ec15c150 2023-11-28T11:56:54.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.709+0000 7f79eb7fe700 1 -- 172.21.15.39:0/3099733365 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79ec069bf0 msgr2=0x7f79ec06a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:54.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.709+0000 7f79eb7fe700 1 --2- 172.21.15.39:0/3099733365 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79ec069bf0 0x7f79ec06a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:54.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.709+0000 7f79eb7fe700 1 -- 172.21.15.39:0/3099733365 >> v1:172.21.15.39:6789/0 conn(0x7f79ec15c150 legacy=0x7f79ec06ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:54.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.709+0000 7f79eb7fe700 1 -- 172.21.15.39:0/3099733365 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ec0d2450 con 0x7f79ec070620 2023-11-28T11:56:54.717 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.713+0000 7f79eb7fe700 1 --2- 172.21.15.39:0/3099733365 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79ec070620 0x7f79ec0b3d00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f79e0009840 tx=0x7f79e0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b23dc54021cd8885 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:54.717 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.713+0000 7f79eaffd700 1 -- 172.21.15.39:0/3099733365 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e0011830 con 0x7f79ec070620 2023-11-28T11:56:54.717 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.713+0000 7f79eaffd700 1 -- 172.21.15.39:0/3099733365 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e0011990 con 0x7f79ec070620 2023-11-28T11:56:54.717 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.713+0000 7f79eaffd700 1 -- 172.21.15.39:0/3099733365 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e0011d00 con 0x7f79ec070620 2023-11-28T11:56:54.718 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.713+0000 7f79f1707700 1 -- 172.21.15.39:0/3099733365 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79ec070620 msgr2=0x7f79ec0b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:54.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.713+0000 7f79f1707700 1 --2- 172.21.15.39:0/3099733365 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79ec070620 0x7f79ec0b3d00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f79e0009840 tx=0x7f79e0009b50 comp rx=0 tx=0).stop 2023-11-28T11:56:54.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.713+0000 7f79f1707700 1 -- 172.21.15.39:0/3099733365 shutdown_connections 2023-11-28T11:56:54.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.713+0000 7f79f1707700 1 --2- 172.21.15.39:0/3099733365 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79ec069bf0 0x7f79ec06a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:54.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.713+0000 7f79f1707700 1 --2- 172.21.15.39:0/3099733365 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79ec070620 0x7f79ec0b3d00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:54.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.713+0000 7f79f1707700 1 -- 172.21.15.39:0/3099733365 >> 172.21.15.39:0/3099733365 conn(0x7f79ec0d3680 msgr2=0x7f79ec0cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:54.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.713+0000 7f79f1707700 1 -- 172.21.15.39:0/3099733365 shutdown_connections 2023-11-28T11:56:54.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.713+0000 7f79f1707700 1 -- 172.21.15.39:0/3099733365 wait complete. 2023-11-28T11:56:54.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.717+0000 7f79f1707700 1 Processor -- start 2023-11-28T11:56:54.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.717+0000 7f79f1707700 1 -- start start 2023-11-28T11:56:54.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.717+0000 7f79f1707700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79ec069bf0 0x7f79ec1f42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:54.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.717+0000 7f79f1707700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79ec070620 0x7f79ec0c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:54.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.717+0000 7f79f1707700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79ec15c150 0x7f79ec0c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:54.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.717+0000 7f79f1707700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec0b78b0 con 0x7f79ec069bf0 2023-11-28T11:56:54.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.717+0000 7f79f1707700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec0b7b90 con 0x7f79ec070620 2023-11-28T11:56:54.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.717+0000 7f79f1707700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec0b7e70 con 0x7f79ec15c150 2023-11-28T11:56:54.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.717+0000 7f79ebfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79ec069bf0 0x7f79ec1f42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:54.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.721+0000 7f79ebfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79ec069bf0 0x7f79ec1f42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39344/0 (socket says 172.21.15.39:39344) 2023-11-28T11:56:54.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.721+0000 7f79ebfff700 1 -- 172.21.15.39:0/2700900533 learned_addr learned my addr 172.21.15.39:0/2700900533 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:54.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.721+0000 7f79eb7fe700 1 --2- 172.21.15.39:0/2700900533 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79ec070620 0x7f79ec0c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:54.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.721+0000 7f79f0f06700 1 --2- 172.21.15.39:0/2700900533 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79ec15c150 0x7f79ec0c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:54.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.721+0000 7f79ebfff700 1 -- 172.21.15.39:0/2700900533 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79ec15c150 msgr2=0x7f79ec0c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:54.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.721+0000 7f79ebfff700 1 --2- 172.21.15.39:0/2700900533 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79ec15c150 0x7f79ec0c9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:54.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.721+0000 7f79ebfff700 1 -- 172.21.15.39:0/2700900533 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79ec070620 msgr2=0x7f79ec0c9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:54.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.721+0000 7f79ebfff700 1 --2- 172.21.15.39:0/2700900533 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79ec070620 0x7f79ec0c9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:54.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.721+0000 7f79ebfff700 1 -- 172.21.15.39:0/2700900533 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e0009450 con 0x7f79ec069bf0 2023-11-28T11:56:54.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.721+0000 7f79ebfff700 1 --2- 172.21.15.39:0/2700900533 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79ec069bf0 0x7f79ec1f42b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f79dc00c4d0 tx=0x7f79dc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:54.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.721+0000 7f79e8ff9700 1 -- 172.21.15.39:0/2700900533 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc0011d0 con 0x7f79ec069bf0 2023-11-28T11:56:54.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.721+0000 7f79e8ff9700 1 -- 172.21.15.39:0/2700900533 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79dc005d90 con 0x7f79ec069bf0 2023-11-28T11:56:54.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.721+0000 7f79e8ff9700 1 -- 172.21.15.39:0/2700900533 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc0072d0 con 0x7f79ec069bf0 2023-11-28T11:56:54.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.721+0000 7f79f1707700 1 -- 172.21.15.39:0/2700900533 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79ec0d05e0 con 0x7f79ec069bf0 2023-11-28T11:56:54.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.721+0000 7f79f1707700 1 -- 172.21.15.39:0/2700900533 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79ec0d2730 con 0x7f79ec069bf0 2023-11-28T11:56:54.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.721+0000 7f79f1707700 1 -- 172.21.15.39:0/2700900533 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79ec0d2140 con 0x7f79ec069bf0 2023-11-28T11:56:54.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.725+0000 7f79e8ff9700 1 -- 172.21.15.39:0/2700900533 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f79dc019030 con 0x7f79ec069bf0 2023-11-28T11:56:54.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.725+0000 7f79e8ff9700 1 --2- 172.21.15.39:0/2700900533 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f79d8064ee0 0x7f79d8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:54.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.725+0000 7f79e8ff9700 1 -- 172.21.15.39:0/2700900533 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f79dc081500 con 0x7f79ec069bf0 2023-11-28T11:56:54.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.725+0000 7f79eb7fe700 1 --2- 172.21.15.39:0/2700900533 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f79d8064ee0 0x7f79d8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:54.732 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.729+0000 7f79eb7fe700 1 --2- 172.21.15.39:0/2700900533 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f79d8064ee0 0x7f79d8067390 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f79ec070a10 tx=0x7f79e0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:54.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.729+0000 7f79e8ff9700 1 -- 172.21.15.39:0/2700900533 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f79dc04a400 con 0x7f79ec069bf0 2023-11-28T11:56:54.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.905+0000 7f79f1707700 1 -- 172.21.15.39:0/2700900533 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f79ec0b8330 con 0x7f79ec069bf0 2023-11-28T11:56:54.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.905+0000 7f79e8ff9700 1 -- 172.21.15.39:0/2700900533 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f79dc017020 con 0x7f79ec069bf0 2023-11-28T11:56:54.911 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-11-28T11:56:54.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.909+0000 7f79f1707700 1 -- 172.21.15.39:0/2700900533 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f79d8064ee0 msgr2=0x7f79d8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:54.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.909+0000 7f79f1707700 1 --2- 172.21.15.39:0/2700900533 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f79d8064ee0 0x7f79d8067390 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f79ec070a10 tx=0x7f79e0008030 comp rx=0 tx=0).stop 2023-11-28T11:56:54.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.909+0000 7f79f1707700 1 -- 172.21.15.39:0/2700900533 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79ec069bf0 msgr2=0x7f79ec1f42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:54.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.909+0000 7f79f1707700 1 --2- 172.21.15.39:0/2700900533 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79ec069bf0 0x7f79ec1f42b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f79dc00c4d0 tx=0x7f79dc00c890 comp rx=0 tx=0).stop 2023-11-28T11:56:54.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.909+0000 7f79f1707700 1 -- 172.21.15.39:0/2700900533 shutdown_connections 2023-11-28T11:56:54.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.909+0000 7f79f1707700 1 --2- 172.21.15.39:0/2700900533 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79ec15c150 0x7f79ec0c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:54.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.909+0000 7f79f1707700 1 --2- 172.21.15.39:0/2700900533 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f79d8064ee0 0x7f79d8067390 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:54.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.909+0000 7f79f1707700 1 --2- 172.21.15.39:0/2700900533 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79ec070620 0x7f79ec0c9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:54.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.909+0000 7f79f1707700 1 --2- 172.21.15.39:0/2700900533 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79ec069bf0 0x7f79ec1f42b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:54.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.909+0000 7f79f1707700 1 -- 172.21.15.39:0/2700900533 >> 172.21.15.39:0/2700900533 conn(0x7f79ec0d3680 msgr2=0x7f79ec0c8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:54.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.909+0000 7f79f1707700 1 -- 172.21.15.39:0/2700900533 shutdown_connections 2023-11-28T11:56:54.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:54.909+0000 7f79f1707700 1 -- 172.21.15.39:0/2700900533 wait complete. 2023-11-28T11:56:54.935 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:56:55.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.125+0000 7f18271d2700 1 Processor -- start 2023-11-28T11:56:55.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.125+0000 7f18271d2700 1 -- start start 2023-11-28T11:56:55.132 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.129+0000 7f18271d2700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f182015c360 0x7f18200ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:55.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.129+0000 7f18271d2700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f182006cbc0 0x7f182006be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:55.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.129+0000 7f18271d2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f182006c3c0 0x7f182015c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:55.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.129+0000 7f18271d2700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18200c9a40 con 0x7f182006cbc0 2023-11-28T11:56:55.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.129+0000 7f18271d2700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18200cc4a0 con 0x7f182015c360 2023-11-28T11:56:55.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.129+0000 7f18271d2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18200cd900 con 0x7f182006c3c0 2023-11-28T11:56:55.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.129+0000 7f18259cf700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f182006cbc0 0x7f182006be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:55.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.129+0000 7f18259cf700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f182006cbc0 0x7f182006be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39352/0 (socket says 172.21.15.39:39352) 2023-11-28T11:56:55.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.129+0000 7f18259cf700 1 -- 172.21.15.39:0/2638630612 learned_addr learned my addr 172.21.15.39:0/2638630612 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:55.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.129+0000 7f18261d0700 1 --2- 172.21.15.39:0/2638630612 >> v2:172.21.15.184:3300/0 conn(0x7f182015c360 0x7f18200ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:55.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.129+0000 7f18269d1700 1 --2- 172.21.15.39:0/2638630612 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f182006c3c0 0x7f182015c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:55.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.129+0000 7f18259cf700 1 -- 172.21.15.39:0/2638630612 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f182006c3c0 msgr2=0x7f182015c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:55.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.129+0000 7f18259cf700 1 --2- 172.21.15.39:0/2638630612 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f182006c3c0 0x7f182015c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:55.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.129+0000 7f18259cf700 1 -- 172.21.15.39:0/2638630612 >> v2:172.21.15.184:3300/0 conn(0x7f182015c360 msgr2=0x7f18200ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:55.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.129+0000 7f18259cf700 1 --2- 172.21.15.39:0/2638630612 >> v2:172.21.15.184:3300/0 conn(0x7f182015c360 0x7f18200ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:55.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.129+0000 7f18259cf700 1 -- 172.21.15.39:0/2638630612 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18200cd110 con 0x7f182006cbc0 2023-11-28T11:56:55.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.129+0000 7f18259cf700 1 --2- 172.21.15.39:0/2638630612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f182006cbc0 0x7f182006be80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f18200cda40 tx=0x7f1810009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e2f311edfcdd9d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:55.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.129+0000 7f18251ce700 1 -- 172.21.15.39:0/2638630612 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1810004230 con 0x7f182006cbc0 2023-11-28T11:56:55.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.129+0000 7f18251ce700 1 -- 172.21.15.39:0/2638630612 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1810004390 con 0x7f182006cbc0 2023-11-28T11:56:55.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.129+0000 7f18251ce700 1 -- 172.21.15.39:0/2638630612 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18100036c0 con 0x7f182006cbc0 2023-11-28T11:56:55.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.129+0000 7f18271d2700 1 -- 172.21.15.39:0/2638630612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f182006cbc0 msgr2=0x7f182006be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:55.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.129+0000 7f18271d2700 1 --2- 172.21.15.39:0/2638630612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f182006cbc0 0x7f182006be80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f18200cda40 tx=0x7f1810009bf0 comp rx=0 tx=0).stop 2023-11-28T11:56:55.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.129+0000 7f18271d2700 1 -- 172.21.15.39:0/2638630612 shutdown_connections 2023-11-28T11:56:55.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.133+0000 7f18271d2700 1 --2- 172.21.15.39:0/2638630612 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f182006c3c0 0x7f182015c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:55.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.133+0000 7f18271d2700 1 --2- 172.21.15.39:0/2638630612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f182006cbc0 0x7f182006be80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:55.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.133+0000 7f18271d2700 1 --2- 172.21.15.39:0/2638630612 >> v2:172.21.15.184:3300/0 conn(0x7f182015c360 0x7f18200ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:55.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.133+0000 7f18271d2700 1 -- 172.21.15.39:0/2638630612 >> 172.21.15.39:0/2638630612 conn(0x7f18200cf280 msgr2=0x7f18200cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:55.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.133+0000 7f18271d2700 1 -- 172.21.15.39:0/2638630612 shutdown_connections 2023-11-28T11:56:55.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.133+0000 7f18271d2700 1 -- 172.21.15.39:0/2638630612 wait complete. 2023-11-28T11:56:55.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.133+0000 7f18271d2700 1 Processor -- start 2023-11-28T11:56:55.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.133+0000 7f18271d2700 1 -- start start 2023-11-28T11:56:55.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.137+0000 7f18271d2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f182006c3c0 0x7f18201f2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:55.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.137+0000 7f18271d2700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f182006cbc0 0x7f18201508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:55.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.137+0000 7f18271d2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f182015c360 0x7f1820150e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:55.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.137+0000 7f18271d2700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182014ea50 con 0x7f182006cbc0 2023-11-28T11:56:55.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.137+0000 7f18271d2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18201f2c70 con 0x7f182006c3c0 2023-11-28T11:56:55.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.137+0000 7f18271d2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1820150120 con 0x7f182015c360 2023-11-28T11:56:55.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.137+0000 7f18259cf700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f182006cbc0 0x7f18201508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:55.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.137+0000 7f18259cf700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f182006cbc0 0x7f18201508e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39368/0 (socket says 172.21.15.39:39368) 2023-11-28T11:56:55.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.137+0000 7f18259cf700 1 -- 172.21.15.39:0/3102470611 learned_addr learned my addr 172.21.15.39:0/3102470611 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:55.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.137+0000 7f18261d0700 1 --2- 172.21.15.39:0/3102470611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f182006c3c0 0x7f18201f2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:55.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.137+0000 7f18269d1700 1 --2- 172.21.15.39:0/3102470611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f182015c360 0x7f1820150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:55.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.137+0000 7f18259cf700 1 -- 172.21.15.39:0/3102470611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f182015c360 msgr2=0x7f1820150e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:55.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.137+0000 7f18259cf700 1 --2- 172.21.15.39:0/3102470611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f182015c360 0x7f1820150e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:55.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.137+0000 7f18259cf700 1 -- 172.21.15.39:0/3102470611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f182006c3c0 msgr2=0x7f18201f2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:55.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.137+0000 7f18259cf700 1 --2- 172.21.15.39:0/3102470611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f182006c3c0 0x7f18201f2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:55.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.137+0000 7f18259cf700 1 -- 172.21.15.39:0/3102470611 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1810009570 con 0x7f182006cbc0 2023-11-28T11:56:55.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.137+0000 7f18261d0700 1 --2- 172.21.15.39:0/3102470611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f182006c3c0 0x7f18201f2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:55.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.137+0000 7f18259cf700 1 --2- 172.21.15.39:0/3102470611 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f182006cbc0 0x7f18201508e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1810004000 tx=0x7f1810004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:55.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.137+0000 7f1816ffd700 1 -- 172.21.15.39:0/3102470611 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1810011830 con 0x7f182006cbc0 2023-11-28T11:56:55.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.137+0000 7f1816ffd700 1 -- 172.21.15.39:0/3102470611 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18100119b0 con 0x7f182006cbc0 2023-11-28T11:56:55.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.137+0000 7f1816ffd700 1 -- 172.21.15.39:0/3102470611 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1810011d60 con 0x7f182006cbc0 2023-11-28T11:56:55.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.137+0000 7f18271d2700 1 -- 172.21.15.39:0/3102470611 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18200cd340 con 0x7f182006cbc0 2023-11-28T11:56:55.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.137+0000 7f18271d2700 1 -- 172.21.15.39:0/3102470611 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f182006c7d0 con 0x7f182006cbc0 2023-11-28T11:56:55.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.137+0000 7f18271d2700 1 -- 172.21.15.39:0/3102470611 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18200cd620 con 0x7f182006cbc0 2023-11-28T11:56:55.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.141+0000 7f1816ffd700 1 -- 172.21.15.39:0/3102470611 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1810017020 con 0x7f182006cbc0 2023-11-28T11:56:55.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.141+0000 7f1816ffd700 1 --2- 172.21.15.39:0/3102470611 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1804064ee0 0x7f1804067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:55.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.141+0000 7f1816ffd700 1 -- 172.21.15.39:0/3102470611 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1810083ae0 con 0x7f182006cbc0 2023-11-28T11:56:55.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.141+0000 7f18261d0700 1 --2- 172.21.15.39:0/3102470611 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1804064ee0 0x7f1804067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:55.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.145+0000 7f18261d0700 1 --2- 172.21.15.39:0/3102470611 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1804064ee0 0x7f1804067390 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f181c009c40 tx=0x7f181c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:55.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.149+0000 7f1816ffd700 1 -- 172.21.15.39:0/3102470611 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1810051990 con 0x7f182006cbc0 2023-11-28T11:56:55.319 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.313+0000 7f18271d2700 1 -- 172.21.15.39:0/3102470611 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f18200c4f60 con 0x7f182006cbc0 2023-11-28T11:56:55.319 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.313+0000 7f1816ffd700 1 -- 172.21.15.39:0/3102470611 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1810003e60 con 0x7f182006cbc0 2023-11-28T11:56:55.319 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-11-28T11:56:55.322 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.317+0000 7f18271d2700 1 -- 172.21.15.39:0/3102470611 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1804064ee0 msgr2=0x7f1804067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:55.322 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.317+0000 7f18271d2700 1 --2- 172.21.15.39:0/3102470611 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1804064ee0 0x7f1804067390 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f181c009c40 tx=0x7f181c008040 comp rx=0 tx=0).stop 2023-11-28T11:56:55.322 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.317+0000 7f18271d2700 1 -- 172.21.15.39:0/3102470611 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f182006cbc0 msgr2=0x7f18201508e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:55.322 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.317+0000 7f18271d2700 1 --2- 172.21.15.39:0/3102470611 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f182006cbc0 0x7f18201508e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1810004000 tx=0x7f1810004770 comp rx=0 tx=0).stop 2023-11-28T11:56:55.322 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.317+0000 7f18271d2700 1 -- 172.21.15.39:0/3102470611 shutdown_connections 2023-11-28T11:56:55.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.317+0000 7f18271d2700 1 --2- 172.21.15.39:0/3102470611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f182015c360 0x7f1820150e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:55.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.317+0000 7f18271d2700 1 --2- 172.21.15.39:0/3102470611 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f182006cbc0 0x7f18201508e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:55.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.317+0000 7f18271d2700 1 --2- 172.21.15.39:0/3102470611 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1804064ee0 0x7f1804067390 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:55.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.317+0000 7f18271d2700 1 --2- 172.21.15.39:0/3102470611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f182006c3c0 0x7f18201f2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:55.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.317+0000 7f18271d2700 1 -- 172.21.15.39:0/3102470611 >> 172.21.15.39:0/3102470611 conn(0x7f18200cf280 msgr2=0x7f182006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:55.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.317+0000 7f18271d2700 1 -- 172.21.15.39:0/3102470611 shutdown_connections 2023-11-28T11:56:55.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.317+0000 7f18271d2700 1 -- 172.21.15.39:0/3102470611 wait complete. 2023-11-28T11:56:55.344 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:56:55.533 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.529+0000 7fcf321bc700 1 Processor -- start 2023-11-28T11:56:55.533 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.529+0000 7fcf321bc700 1 -- start start 2023-11-28T11:56:55.535 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.529+0000 7fcf321bc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf2c15c150 0x7fcf2c0b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:55.536 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.529+0000 7fcf321bc700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fcf2c06ff10 0x7fcf2c070360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:55.536 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.529+0000 7fcf321bc700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf2c15c520 con 0x7fcf2c15fc30 2023-11-28T11:56:55.536 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.529+0000 7fcf321bc700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf2c0b4240 con 0x7fcf2c06ff10 2023-11-28T11:56:55.536 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.529+0000 7fcf321bc700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c0708a0 con 0x7fcf2c15c150 2023-11-28T11:56:55.536 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.533+0000 7fcf319bb700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fcf2c15fc30 0x7fcf2c1600b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:55052/0 (socket says 172.21.15.39:55052) 2023-11-28T11:56:55.537 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.533+0000 7fcf309b9700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fcf2c06ff10 0x7fcf2c070360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:55.537 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.533+0000 7fcf319bb700 1 -- 172.21.15.39:0/3619504688 learned_addr learned my addr 172.21.15.39:0/3619504688 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:56:55.537 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.533+0000 7fcf311ba700 1 --2- 172.21.15.39:0/3619504688 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf2c15c150 0x7fcf2c0b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:55.537 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.533+0000 7fcf23fff700 1 -- 172.21.15.39:0/3619504688 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1145237158 0 0) 0x7fcf2c15c520 con 0x7fcf2c15fc30 2023-11-28T11:56:55.538 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.533+0000 7fcf23fff700 1 -- 172.21.15.39:0/3619504688 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf180035d0 con 0x7fcf2c15fc30 2023-11-28T11:56:55.538 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.533+0000 7fcf309b9700 1 -- 172.21.15.39:0/3619504688 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf2c15c150 msgr2=0x7fcf2c0b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:55.538 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.533+0000 7fcf309b9700 1 --2- 172.21.15.39:0/3619504688 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf2c15c150 0x7fcf2c0b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:55.538 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.533+0000 7fcf309b9700 1 -- 172.21.15.39:0/3619504688 >> v1:172.21.15.184:6789/0 conn(0x7fcf2c15fc30 legacy=0x7fcf2c1600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:55.538 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.533+0000 7fcf309b9700 1 -- 172.21.15.39:0/3619504688 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2c06ac00 con 0x7fcf2c06ff10 2023-11-28T11:56:55.542 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.533+0000 7fcf309b9700 1 --2- 172.21.15.39:0/3619504688 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf2c06ff10 0x7fcf2c070360 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c009840 tx=0x7fcf1c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b41f30c0070b943 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:55.542 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.533+0000 7fcf23fff700 1 -- 172.21.15.39:0/3619504688 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c011830 con 0x7fcf2c06ff10 2023-11-28T11:56:55.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.533+0000 7fcf23fff700 1 -- 172.21.15.39:0/3619504688 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1c011990 con 0x7fcf2c06ff10 2023-11-28T11:56:55.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.533+0000 7fcf23fff700 1 -- 172.21.15.39:0/3619504688 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c011d20 con 0x7fcf2c06ff10 2023-11-28T11:56:55.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.537+0000 7fcf321bc700 1 -- 172.21.15.39:0/3619504688 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf2c06ff10 msgr2=0x7fcf2c070360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:55.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.537+0000 7fcf321bc700 1 --2- 172.21.15.39:0/3619504688 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf2c06ff10 0x7fcf2c070360 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c009840 tx=0x7fcf1c009b50 comp rx=0 tx=0).stop 2023-11-28T11:56:55.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.537+0000 7fcf321bc700 1 -- 172.21.15.39:0/3619504688 shutdown_connections 2023-11-28T11:56:55.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.537+0000 7fcf321bc700 1 --2- 172.21.15.39:0/3619504688 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf2c06ff10 0x7fcf2c070360 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:55.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.537+0000 7fcf321bc700 1 --2- 172.21.15.39:0/3619504688 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf2c15c150 0x7fcf2c0b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:55.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.537+0000 7fcf321bc700 1 -- 172.21.15.39:0/3619504688 >> 172.21.15.39:0/3619504688 conn(0x7fcf2c0d3680 msgr2=0x7fcf2c0cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:55.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.537+0000 7fcf321bc700 1 -- 172.21.15.39:0/3619504688 shutdown_connections 2023-11-28T11:56:55.544 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.537+0000 7fcf321bc700 1 -- 172.21.15.39:0/3619504688 wait complete. 2023-11-28T11:56:55.544 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.537+0000 7fcf321bc700 1 Processor -- start 2023-11-28T11:56:55.544 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.537+0000 7fcf321bc700 1 -- start start 2023-11-28T11:56:55.545 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.541+0000 7fcf321bc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf2c06ff10 0x7fcf2c0b6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:55.545 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.541+0000 7fcf321bc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf2c15c150 0x7fcf2c14e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:55.545 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.541+0000 7fcf321bc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf2c15fc30 0x7fcf2c15a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:55.545 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.541+0000 7fcf321bc700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c156360 con 0x7fcf2c15c150 2023-11-28T11:56:55.546 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.541+0000 7fcf321bc700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c156640 con 0x7fcf2c15fc30 2023-11-28T11:56:55.546 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.541+0000 7fcf321bc700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c156920 con 0x7fcf2c06ff10 2023-11-28T11:56:55.546 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.541+0000 7fcf309b9700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf2c15c150 0x7fcf2c14e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:55.546 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.541+0000 7fcf309b9700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf2c15c150 0x7fcf2c14e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39392/0 (socket says 172.21.15.39:39392) 2023-11-28T11:56:55.546 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.541+0000 7fcf309b9700 1 -- 172.21.15.39:0/3545527017 learned_addr learned my addr 172.21.15.39:0/3545527017 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:55.546 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.541+0000 7fcf311ba700 1 --2- 172.21.15.39:0/3545527017 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf2c06ff10 0x7fcf2c0b6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:55.547 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.541+0000 7fcf319bb700 1 --2- 172.21.15.39:0/3545527017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf2c15fc30 0x7fcf2c15a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:55.547 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.541+0000 7fcf309b9700 1 -- 172.21.15.39:0/3545527017 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf2c06ff10 msgr2=0x7fcf2c0b6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:55.547 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.541+0000 7fcf309b9700 1 --2- 172.21.15.39:0/3545527017 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf2c06ff10 0x7fcf2c0b6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:55.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.541+0000 7fcf309b9700 1 -- 172.21.15.39:0/3545527017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf2c15fc30 msgr2=0x7fcf2c15a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:55.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.541+0000 7fcf309b9700 1 --2- 172.21.15.39:0/3545527017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf2c15fc30 0x7fcf2c15a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:55.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.541+0000 7fcf309b9700 1 -- 172.21.15.39:0/3545527017 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1c009450 con 0x7fcf2c15c150 2023-11-28T11:56:55.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.541+0000 7fcf309b9700 1 --2- 172.21.15.39:0/3545527017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf2c15c150 0x7fcf2c14e670 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c0090b0 tx=0x7fcf1c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:55.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.541+0000 7fcf21ffb700 1 -- 172.21.15.39:0/3545527017 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c004380 con 0x7fcf2c15c150 2023-11-28T11:56:55.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.541+0000 7fcf21ffb700 1 -- 172.21.15.39:0/3545527017 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1c01f070 con 0x7fcf2c15c150 2023-11-28T11:56:55.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.541+0000 7fcf21ffb700 1 -- 172.21.15.39:0/3545527017 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c0036c0 con 0x7fcf2c15c150 2023-11-28T11:56:55.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.541+0000 7fcf321bc700 1 -- 172.21.15.39:0/3545527017 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf2c0d2450 con 0x7fcf2c15c150 2023-11-28T11:56:55.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.545+0000 7fcf321bc700 1 -- 172.21.15.39:0/3545527017 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf2c06cc50 con 0x7fcf2c15c150 2023-11-28T11:56:55.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.545+0000 7fcf321bc700 1 -- 172.21.15.39:0/3545527017 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf2c0d2730 con 0x7fcf2c15c150 2023-11-28T11:56:55.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.545+0000 7fcf21ffb700 1 -- 172.21.15.39:0/3545527017 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fcf1c02a020 con 0x7fcf2c15c150 2023-11-28T11:56:55.552 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.549+0000 7fcf21ffb700 1 --2- 172.21.15.39:0/3545527017 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcf10064ee0 0x7fcf10067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:55.552 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.549+0000 7fcf21ffb700 1 -- 172.21.15.39:0/3545527017 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcf1c0835d0 con 0x7fcf2c15c150 2023-11-28T11:56:55.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.549+0000 7fcf311ba700 1 --2- 172.21.15.39:0/3545527017 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcf10064ee0 0x7fcf10067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:55.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.549+0000 7fcf311ba700 1 --2- 172.21.15.39:0/3545527017 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcf10064ee0 0x7fcf10067390 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c15b9e0 tx=0x7fcf28009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:55.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.553+0000 7fcf21ffb700 1 -- 172.21.15.39:0/3545527017 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcf1c051400 con 0x7fcf2c15c150 2023-11-28T11:56:55.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.729+0000 7fcf321bc700 1 -- 172.21.15.39:0/3545527017 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcf2c073d20 con 0x7fcf2c15c150 2023-11-28T11:56:55.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.729+0000 7fcf21ffb700 1 -- 172.21.15.39:0/3545527017 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcf1c054a20 con 0x7fcf2c15c150 2023-11-28T11:56:55.736 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-11-28T11:56:55.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.733+0000 7fcf321bc700 1 -- 172.21.15.39:0/3545527017 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcf10064ee0 msgr2=0x7fcf10067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:55.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.733+0000 7fcf321bc700 1 --2- 172.21.15.39:0/3545527017 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcf10064ee0 0x7fcf10067390 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c15b9e0 tx=0x7fcf28009240 comp rx=0 tx=0).stop 2023-11-28T11:56:55.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.733+0000 7fcf321bc700 1 -- 172.21.15.39:0/3545527017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf2c15c150 msgr2=0x7fcf2c14e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:55.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.733+0000 7fcf321bc700 1 --2- 172.21.15.39:0/3545527017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf2c15c150 0x7fcf2c14e670 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c0090b0 tx=0x7fcf1c004770 comp rx=0 tx=0).stop 2023-11-28T11:56:55.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.733+0000 7fcf321bc700 1 -- 172.21.15.39:0/3545527017 shutdown_connections 2023-11-28T11:56:55.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.733+0000 7fcf321bc700 1 --2- 172.21.15.39:0/3545527017 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcf10064ee0 0x7fcf10067390 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:55.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.733+0000 7fcf321bc700 1 --2- 172.21.15.39:0/3545527017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf2c15fc30 0x7fcf2c15a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:55.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.733+0000 7fcf321bc700 1 --2- 172.21.15.39:0/3545527017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf2c15c150 0x7fcf2c14e670 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:55.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.733+0000 7fcf321bc700 1 --2- 172.21.15.39:0/3545527017 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf2c06ff10 0x7fcf2c0b6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:55.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.733+0000 7fcf321bc700 1 -- 172.21.15.39:0/3545527017 >> 172.21.15.39:0/3545527017 conn(0x7fcf2c0d3680 msgr2=0x7fcf2c158eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:55.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.733+0000 7fcf321bc700 1 -- 172.21.15.39:0/3545527017 shutdown_connections 2023-11-28T11:56:55.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.733+0000 7fcf321bc700 1 -- 172.21.15.39:0/3545527017 wait complete. 2023-11-28T11:56:55.762 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:56:55.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.965+0000 7f0ffb59e700 1 Processor -- start 2023-11-28T11:56:55.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.965+0000 7f0ffb59e700 1 -- start start 2023-11-28T11:56:55.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.969+0000 7f0ffb59e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f0ffc159f10 0x7f0ffc070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:55.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.969+0000 7f0ffb59e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0ffc0c8c90 0x7f0ffc06b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:55.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.969+0000 7f0ffb59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ffc15a2e0 0x7f0ffc15a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:55.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.969+0000 7f0ffb59e700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ffc0c9130 con 0x7f0ffc0c8c90 2023-11-28T11:56:55.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.969+0000 7f0ffb59e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ffc06b840 con 0x7f0ffc159f10 2023-11-28T11:56:55.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.969+0000 7f0ffb59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc070600 con 0x7f0ffc15a2e0 2023-11-28T11:56:55.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.969+0000 7f0ff9d9b700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0ffc0c8c90 0x7f0ffc06b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:55.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.969+0000 7f0ff9d9b700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0ffc0c8c90 0x7f0ffc06b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39402/0 (socket says 172.21.15.39:39402) 2023-11-28T11:56:55.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.969+0000 7f0ff9d9b700 1 -- 172.21.15.39:0/4227075534 learned_addr learned my addr 172.21.15.39:0/4227075534 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:55.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.969+0000 7f0ffa59c700 1 --2- 172.21.15.39:0/4227075534 >> v2:172.21.15.184:3300/0 conn(0x7f0ffc159f10 0x7f0ffc070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:55.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.969+0000 7f0ff9d9b700 1 -- 172.21.15.39:0/4227075534 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ffc15a2e0 msgr2=0x7f0ffc15a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:55.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.969+0000 7f0ffad9d700 1 --2- 172.21.15.39:0/4227075534 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ffc15a2e0 0x7f0ffc15a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:55.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.969+0000 7f0ff9d9b700 1 --2- 172.21.15.39:0/4227075534 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ffc15a2e0 0x7f0ffc15a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:55.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.969+0000 7f0ff9d9b700 1 -- 172.21.15.39:0/4227075534 >> v2:172.21.15.184:3300/0 conn(0x7f0ffc159f10 msgr2=0x7f0ffc070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:55.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.969+0000 7f0ff9d9b700 1 --2- 172.21.15.39:0/4227075534 >> v2:172.21.15.184:3300/0 conn(0x7f0ffc159f10 0x7f0ffc070a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:55.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.969+0000 7f0ff9d9b700 1 -- 172.21.15.39:0/4227075534 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ffc0afcc0 con 0x7f0ffc0c8c90 2023-11-28T11:56:55.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.969+0000 7f0ffa59c700 1 --2- 172.21.15.39:0/4227075534 >> v2:172.21.15.184:3300/0 conn(0x7f0ffc159f10 0x7f0ffc070a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:56:55.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.969+0000 7f0ffad9d700 1 --2- 172.21.15.39:0/4227075534 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ffc15a2e0 0x7f0ffc15a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:56:55.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.969+0000 7f0ff9d9b700 1 --2- 172.21.15.39:0/4227075534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ffc0c8c90 0x7f0ffc06b300 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc0cc0e0 tx=0x7f0ff0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cea954e86368e92e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:55.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.969+0000 7f0ff959a700 1 -- 172.21.15.39:0/4227075534 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff000b8a0 con 0x7f0ffc0c8c90 2023-11-28T11:56:55.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.969+0000 7f0ff959a700 1 -- 172.21.15.39:0/4227075534 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff000ba00 con 0x7f0ffc0c8c90 2023-11-28T11:56:55.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.969+0000 7f0ff959a700 1 -- 172.21.15.39:0/4227075534 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff000bd90 con 0x7f0ffc0c8c90 2023-11-28T11:56:55.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.969+0000 7f0ffb59e700 1 -- 172.21.15.39:0/4227075534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ffc0c8c90 msgr2=0x7f0ffc06b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:55.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.969+0000 7f0ffb59e700 1 --2- 172.21.15.39:0/4227075534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ffc0c8c90 0x7f0ffc06b300 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc0cc0e0 tx=0x7f0ff0009bf0 comp rx=0 tx=0).stop 2023-11-28T11:56:55.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.973+0000 7f0ffb59e700 1 -- 172.21.15.39:0/4227075534 shutdown_connections 2023-11-28T11:56:55.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.973+0000 7f0ffb59e700 1 --2- 172.21.15.39:0/4227075534 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ffc15a2e0 0x7f0ffc15a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:55.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.973+0000 7f0ffb59e700 1 --2- 172.21.15.39:0/4227075534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ffc0c8c90 0x7f0ffc06b300 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:55.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.973+0000 7f0ffb59e700 1 --2- 172.21.15.39:0/4227075534 >> v2:172.21.15.184:3300/0 conn(0x7f0ffc159f10 0x7f0ffc070a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:55.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.973+0000 7f0ffb59e700 1 -- 172.21.15.39:0/4227075534 >> 172.21.15.39:0/4227075534 conn(0x7f0ffc0cf280 msgr2=0x7f0ffc0cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:55.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.973+0000 7f0ffb59e700 1 -- 172.21.15.39:0/4227075534 shutdown_connections 2023-11-28T11:56:55.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.973+0000 7f0ffb59e700 1 -- 172.21.15.39:0/4227075534 wait complete. 2023-11-28T11:56:55.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.973+0000 7f0ffb59e700 1 Processor -- start 2023-11-28T11:56:55.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.973+0000 7f0ffb59e700 1 -- start start 2023-11-28T11:56:55.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.977+0000 7f0ffb59e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ffc0c8c90 0x7f0ffc1eeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:55.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.977+0000 7f0ffb59e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ffc159f10 0x7f0ffc0c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:55.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.977+0000 7f0ffb59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ffc15a2e0 0x7f0ffc0b0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:55.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.977+0000 7f0ffb59e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc0b1f50 con 0x7f0ffc159f10 2023-11-28T11:56:55.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.977+0000 7f0ffb59e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc158c20 con 0x7f0ffc0c8c90 2023-11-28T11:56:55.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.977+0000 7f0ffb59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc158f00 con 0x7f0ffc15a2e0 2023-11-28T11:56:55.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.977+0000 7f0ff9d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ffc159f10 0x7f0ffc0c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:55.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.977+0000 7f0ff9d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ffc159f10 0x7f0ffc0c72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39416/0 (socket says 172.21.15.39:39416) 2023-11-28T11:56:55.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.977+0000 7f0ff9d9b700 1 -- 172.21.15.39:0/3315706518 learned_addr learned my addr 172.21.15.39:0/3315706518 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:55.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.977+0000 7f0ffa59c700 1 --2- 172.21.15.39:0/3315706518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ffc0c8c90 0x7f0ffc1eeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:55.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.977+0000 7f0ffad9d700 1 --2- 172.21.15.39:0/3315706518 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ffc15a2e0 0x7f0ffc0b0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:55.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.977+0000 7f0ff9d9b700 1 -- 172.21.15.39:0/3315706518 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ffc15a2e0 msgr2=0x7f0ffc0b0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:55.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.977+0000 7f0ff9d9b700 1 --2- 172.21.15.39:0/3315706518 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ffc15a2e0 0x7f0ffc0b0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:55.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.977+0000 7f0ff9d9b700 1 -- 172.21.15.39:0/3315706518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ffc0c8c90 msgr2=0x7f0ffc1eeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:55.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.977+0000 7f0ff9d9b700 1 --2- 172.21.15.39:0/3315706518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ffc0c8c90 0x7f0ffc1eeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:55.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.977+0000 7f0ff9d9b700 1 -- 172.21.15.39:0/3315706518 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff0009570 con 0x7f0ffc159f10 2023-11-28T11:56:55.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.977+0000 7f0ff9d9b700 1 --2- 172.21.15.39:0/3315706518 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ffc159f10 0x7f0ffc0c72e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc0717e0 tx=0x7f0ff0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:55.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.977+0000 7f0feaffd700 1 -- 172.21.15.39:0/3315706518 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff00038c0 con 0x7f0ffc159f10 2023-11-28T11:56:55.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.977+0000 7f0ffb59e700 1 -- 172.21.15.39:0/3315706518 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ffc070290 con 0x7f0ffc159f10 2023-11-28T11:56:55.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.977+0000 7f0feaffd700 1 -- 172.21.15.39:0/3315706518 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff001f070 con 0x7f0ffc159f10 2023-11-28T11:56:55.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.977+0000 7f0feaffd700 1 -- 172.21.15.39:0/3315706518 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0003c80 con 0x7f0ffc159f10 2023-11-28T11:56:55.984 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.977+0000 7f0ffb59e700 1 -- 172.21.15.39:0/3315706518 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ffc06ffb0 con 0x7f0ffc159f10 2023-11-28T11:56:55.984 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.977+0000 7f0ffb59e700 1 -- 172.21.15.39:0/3315706518 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ffc0affa0 con 0x7f0ffc159f10 2023-11-28T11:56:55.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.981+0000 7f0feaffd700 1 -- 172.21.15.39:0/3315706518 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0ff000f050 con 0x7f0ffc159f10 2023-11-28T11:56:55.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.981+0000 7f0feaffd700 1 --2- 172.21.15.39:0/3315706518 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0fdc064ee0 0x7f0fdc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:55.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.981+0000 7f0feaffd700 1 -- 172.21.15.39:0/3315706518 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0ff0021070 con 0x7f0ffc159f10 2023-11-28T11:56:55.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.981+0000 7f0ffa59c700 1 --2- 172.21.15.39:0/3315706518 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0fdc064ee0 0x7f0fdc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:55.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.985+0000 7f0ffa59c700 1 --2- 172.21.15.39:0/3315706518 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0fdc064ee0 0x7f0fdc067390 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0fec006fd0 tx=0x7f0fec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:55.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:55.989+0000 7f0feaffd700 1 -- 172.21.15.39:0/3315706518 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0ff0051c50 con 0x7f0ffc159f10 2023-11-28T11:56:56.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.161+0000 7f0ffb59e700 1 -- 172.21.15.39:0/3315706518 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0ffc06cf30 con 0x7f0ffc159f10 2023-11-28T11:56:56.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.161+0000 7f0feaffd700 1 -- 172.21.15.39:0/3315706518 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0ff0010380 con 0x7f0ffc159f10 2023-11-28T11:56:56.168 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2023-11-28T11:56:56.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.165+0000 7f0ffb59e700 1 -- 172.21.15.39:0/3315706518 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0fdc064ee0 msgr2=0x7f0fdc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:56.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.165+0000 7f0ffb59e700 1 --2- 172.21.15.39:0/3315706518 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0fdc064ee0 0x7f0fdc067390 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0fec006fd0 tx=0x7f0fec008040 comp rx=0 tx=0).stop 2023-11-28T11:56:56.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.165+0000 7f0ffb59e700 1 -- 172.21.15.39:0/3315706518 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ffc159f10 msgr2=0x7f0ffc0c72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:56.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.165+0000 7f0ffb59e700 1 --2- 172.21.15.39:0/3315706518 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ffc159f10 0x7f0ffc0c72e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc0717e0 tx=0x7f0ff0004770 comp rx=0 tx=0).stop 2023-11-28T11:56:56.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.165+0000 7f0ffb59e700 1 -- 172.21.15.39:0/3315706518 shutdown_connections 2023-11-28T11:56:56.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.165+0000 7f0ffb59e700 1 --2- 172.21.15.39:0/3315706518 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ffc15a2e0 0x7f0ffc0b0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:56.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.165+0000 7f0ffb59e700 1 --2- 172.21.15.39:0/3315706518 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ffc159f10 0x7f0ffc0c72e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:56.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.165+0000 7f0ffb59e700 1 --2- 172.21.15.39:0/3315706518 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0fdc064ee0 0x7f0fdc067390 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:56.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.165+0000 7f0ffb59e700 1 --2- 172.21.15.39:0/3315706518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ffc0c8c90 0x7f0ffc1eeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:56.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.165+0000 7f0ffb59e700 1 -- 172.21.15.39:0/3315706518 >> 172.21.15.39:0/3315706518 conn(0x7f0ffc0cf280 msgr2=0x7f0ffc0cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:56.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.165+0000 7f0ffb59e700 1 -- 172.21.15.39:0/3315706518 shutdown_connections 2023-11-28T11:56:56.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.165+0000 7f0ffb59e700 1 -- 172.21.15.39:0/3315706518 wait complete. 2023-11-28T11:56:56.193 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T11:56:56.376 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.369+0000 7ff212e00700 1 Processor -- start 2023-11-28T11:56:56.376 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.369+0000 7ff212e00700 1 -- start start 2023-11-28T11:56:56.379 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.373+0000 7ff212e00700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff20c070620 0x7ff20c0b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:56.379 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.373+0000 7ff212e00700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff20c15c520 con 0x7ff20c069bf0 2023-11-28T11:56:56.379 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.373+0000 7ff212e00700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff20c06cc50 con 0x7ff20c15c150 2023-11-28T11:56:56.379 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.373+0000 7ff212e00700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff20c0b4240 con 0x7ff20c070620 2023-11-28T11:56:56.379 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.373+0000 7ff211dfe700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7ff20c15c150 0x7ff20c06ff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:55068/0 (socket says 172.21.15.39:55068) 2023-11-28T11:56:56.380 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.373+0000 7ff211dfe700 1 -- 172.21.15.39:0/2962376700 learned_addr learned my addr 172.21.15.39:0/2962376700 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:56:56.380 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.373+0000 7ff2115fd700 1 --2- 172.21.15.39:0/2962376700 >> v2:172.21.15.184:3300/0 conn(0x7ff20c070620 0x7ff20c0b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:56.387 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.373+0000 7ff210dfc700 1 -- 172.21.15.39:0/2962376700 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1995550232 0 0) 0x7ff20c15c520 con 0x7ff20c069bf0 2023-11-28T11:56:56.387 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.373+0000 7ff210dfc700 1 -- 172.21.15.39:0/2962376700 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1f80035d0 con 0x7ff20c069bf0 2023-11-28T11:56:56.387 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.373+0000 7ff210dfc700 1 -- 172.21.15.39:0/2962376700 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4219950380 0 0) 0x7ff20c06cc50 con 0x7ff20c15c150 2023-11-28T11:56:56.387 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.373+0000 7ff210dfc700 1 -- 172.21.15.39:0/2962376700 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff20c15c520 con 0x7ff20c15c150 2023-11-28T11:56:56.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.373+0000 7ff2115fd700 1 -- 172.21.15.39:0/2962376700 >> v1:172.21.15.184:6789/0 conn(0x7ff20c15c150 legacy=0x7ff20c06ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:56.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.373+0000 7ff2115fd700 1 -- 172.21.15.39:0/2962376700 >> v1:172.21.15.39:6789/0 conn(0x7ff20c069bf0 legacy=0x7ff20c069ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:56.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.373+0000 7ff2115fd700 1 -- 172.21.15.39:0/2962376700 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20c0d2450 con 0x7ff20c070620 2023-11-28T11:56:56.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.377+0000 7ff2115fd700 1 --2- 172.21.15.39:0/2962376700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff20c070620 0x7ff20c0b3d00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc009840 tx=0x7ff1fc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12fcb18ccbe6cee3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:56.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.377+0000 7ff210dfc700 1 -- 172.21.15.39:0/2962376700 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc005e50 con 0x7ff20c070620 2023-11-28T11:56:56.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.377+0000 7ff210dfc700 1 -- 172.21.15.39:0/2962376700 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1fc006030 con 0x7ff20c070620 2023-11-28T11:56:56.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.377+0000 7ff210dfc700 1 -- 172.21.15.39:0/2962376700 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc0063c0 con 0x7ff20c070620 2023-11-28T11:56:56.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.377+0000 7ff212e00700 1 -- 172.21.15.39:0/2962376700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff20c070620 msgr2=0x7ff20c0b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:56.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.377+0000 7ff212e00700 1 --2- 172.21.15.39:0/2962376700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff20c070620 0x7ff20c0b3d00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc009840 tx=0x7ff1fc009b50 comp rx=0 tx=0).stop 2023-11-28T11:56:56.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.377+0000 7ff212e00700 1 -- 172.21.15.39:0/2962376700 shutdown_connections 2023-11-28T11:56:56.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.377+0000 7ff212e00700 1 --2- 172.21.15.39:0/2962376700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff20c070620 0x7ff20c0b3d00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:56.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.377+0000 7ff212e00700 1 -- 172.21.15.39:0/2962376700 >> 172.21.15.39:0/2962376700 conn(0x7ff20c0d3680 msgr2=0x7ff20c0cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:56.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.377+0000 7ff212e00700 1 -- 172.21.15.39:0/2962376700 shutdown_connections 2023-11-28T11:56:56.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.377+0000 7ff212e00700 1 -- 172.21.15.39:0/2962376700 wait complete. 2023-11-28T11:56:56.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.381+0000 7ff212e00700 1 Processor -- start 2023-11-28T11:56:56.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.381+0000 7ff212e00700 1 -- start start 2023-11-28T11:56:56.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.385+0000 7ff212e00700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff20c069bf0 0x7ff20c1f5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:56.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.385+0000 7ff212e00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff20c070620 0x7ff20c149f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:56.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.385+0000 7ff212e00700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff20c15c150 0x7ff20c15c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:56.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.385+0000 7ff212e00700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c14ae80 con 0x7ff20c069bf0 2023-11-28T11:56:56.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.385+0000 7ff212e00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c14a8c0 con 0x7ff20c070620 2023-11-28T11:56:56.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.385+0000 7ff212e00700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c14aba0 con 0x7ff20c15c150 2023-11-28T11:56:56.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.385+0000 7ff211dfe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff20c069bf0 0x7ff20c1f5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:56.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.385+0000 7ff211dfe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff20c069bf0 0x7ff20c1f5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39430/0 (socket says 172.21.15.39:39430) 2023-11-28T11:56:56.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.385+0000 7ff211dfe700 1 -- 172.21.15.39:0/2941409451 learned_addr learned my addr 172.21.15.39:0/2941409451 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:56.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.385+0000 7ff2125ff700 1 --2- 172.21.15.39:0/2941409451 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff20c15c150 0x7ff20c15c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:56.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.385+0000 7ff2115fd700 1 --2- 172.21.15.39:0/2941409451 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff20c070620 0x7ff20c149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:56.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.385+0000 7ff211dfe700 1 -- 172.21.15.39:0/2941409451 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff20c15c150 msgr2=0x7ff20c15c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:56.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.385+0000 7ff211dfe700 1 --2- 172.21.15.39:0/2941409451 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff20c15c150 0x7ff20c15c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:56.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.385+0000 7ff211dfe700 1 -- 172.21.15.39:0/2941409451 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff20c070620 msgr2=0x7ff20c149f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:56.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.385+0000 7ff211dfe700 1 --2- 172.21.15.39:0/2941409451 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff20c070620 0x7ff20c149f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:56.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.385+0000 7ff211dfe700 1 -- 172.21.15.39:0/2941409451 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1fc009450 con 0x7ff20c069bf0 2023-11-28T11:56:56.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.385+0000 7ff211dfe700 1 --2- 172.21.15.39:0/2941409451 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff20c069bf0 0x7ff20c1f5800 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff20800c4d0 tx=0x7ff20800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:56.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.385+0000 7ff2027fc700 1 -- 172.21.15.39:0/2941409451 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff208005d90 con 0x7ff20c069bf0 2023-11-28T11:56:56.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.385+0000 7ff2027fc700 1 -- 172.21.15.39:0/2941409451 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2080070d0 con 0x7ff20c069bf0 2023-11-28T11:56:56.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.385+0000 7ff2027fc700 1 -- 172.21.15.39:0/2941409451 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff208007480 con 0x7ff20c069bf0 2023-11-28T11:56:56.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.385+0000 7ff212e00700 1 -- 172.21.15.39:0/2941409451 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff20c0d05e0 con 0x7ff20c069bf0 2023-11-28T11:56:56.397 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.385+0000 7ff212e00700 1 -- 172.21.15.39:0/2941409451 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff20c0d2730 con 0x7ff20c069bf0 2023-11-28T11:56:56.397 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.389+0000 7ff212e00700 1 -- 172.21.15.39:0/2941409451 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff20c0d2140 con 0x7ff20c069bf0 2023-11-28T11:56:56.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.389+0000 7ff2027fc700 1 -- 172.21.15.39:0/2941409451 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff208019030 con 0x7ff20c069bf0 2023-11-28T11:56:56.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.393+0000 7ff2027fc700 1 --2- 172.21.15.39:0/2941409451 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff1f0064ee0 0x7ff1f0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:56.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.393+0000 7ff2027fc700 1 -- 172.21.15.39:0/2941409451 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff208081660 con 0x7ff20c069bf0 2023-11-28T11:56:56.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.393+0000 7ff2115fd700 1 --2- 172.21.15.39:0/2941409451 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff1f0064ee0 0x7ff1f0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:56.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.393+0000 7ff2115fd700 1 --2- 172.21.15.39:0/2941409451 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff1f0064ee0 0x7ff1f0067390 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff20c070a10 tx=0x7ff1fc008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:56.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.397+0000 7ff2027fc700 1 -- 172.21.15.39:0/2941409451 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff20804f420 con 0x7ff20c069bf0 2023-11-28T11:56:56.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.565+0000 7ff212e00700 1 -- 172.21.15.39:0/2941409451 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff20c073d20 con 0x7ff20c069bf0 2023-11-28T11:56:56.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.565+0000 7ff2027fc700 1 -- 172.21.15.39:0/2941409451 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff208052a40 con 0x7ff20c069bf0 2023-11-28T11:56:56.573 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-11-28T11:56:56.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.569+0000 7ff212e00700 1 -- 172.21.15.39:0/2941409451 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff1f0064ee0 msgr2=0x7ff1f0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:56.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.569+0000 7ff212e00700 1 --2- 172.21.15.39:0/2941409451 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff1f0064ee0 0x7ff1f0067390 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff20c070a10 tx=0x7ff1fc008070 comp rx=0 tx=0).stop 2023-11-28T11:56:56.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.569+0000 7ff212e00700 1 -- 172.21.15.39:0/2941409451 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff20c069bf0 msgr2=0x7ff20c1f5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:56.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.569+0000 7ff212e00700 1 --2- 172.21.15.39:0/2941409451 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff20c069bf0 0x7ff20c1f5800 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff20800c4d0 tx=0x7ff20800c890 comp rx=0 tx=0).stop 2023-11-28T11:56:56.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.569+0000 7ff212e00700 1 -- 172.21.15.39:0/2941409451 shutdown_connections 2023-11-28T11:56:56.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.569+0000 7ff212e00700 1 --2- 172.21.15.39:0/2941409451 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff20c15c150 0x7ff20c15c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:56.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.569+0000 7ff212e00700 1 --2- 172.21.15.39:0/2941409451 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff1f0064ee0 0x7ff1f0067390 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:56.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.569+0000 7ff212e00700 1 --2- 172.21.15.39:0/2941409451 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff20c070620 0x7ff20c149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:56.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.569+0000 7ff212e00700 1 --2- 172.21.15.39:0/2941409451 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff20c069bf0 0x7ff20c1f5800 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:56.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.569+0000 7ff212e00700 1 -- 172.21.15.39:0/2941409451 >> 172.21.15.39:0/2941409451 conn(0x7ff20c0d3680 msgr2=0x7ff20c0d0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:56.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.569+0000 7ff212e00700 1 -- 172.21.15.39:0/2941409451 shutdown_connections 2023-11-28T11:56:56.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.569+0000 7ff212e00700 1 -- 172.21.15.39:0/2941409451 wait complete. 2023-11-28T11:56:56.600 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T11:56:56.785 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.781+0000 7f4f5d59a700 1 Processor -- start 2023-11-28T11:56:56.785 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.781+0000 7f4f5d59a700 1 -- start start 2023-11-28T11:56:56.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.781+0000 7f4f5d59a700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4f5815c640 0x7f4f580d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:56.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.781+0000 7f4f5d59a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f58069e00 0x7f4f5806a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:56.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.781+0000 7f4f5d59a700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f5806c600 con 0x7f4f58071aa0 2023-11-28T11:56:56.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.781+0000 7f4f5d59a700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f5806cef0 con 0x7f4f5815c640 2023-11-28T11:56:56.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.781+0000 7f4f5d59a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5806a7c0 con 0x7f4f58069e00 2023-11-28T11:56:56.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.785+0000 7f4f57fff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4f5815c640 0x7f4f580d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:56.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.785+0000 7f4f57fff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4f5815c640 0x7f4f580d31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39432/0 (socket says 172.21.15.39:39432) 2023-11-28T11:56:56.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.785+0000 7f4f57fff700 1 -- 172.21.15.39:0/2756148545 learned_addr learned my addr 172.21.15.39:0/2756148545 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:56.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.785+0000 7f4f5cd99700 1 --2- 172.21.15.39:0/2756148545 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f58069e00 0x7f4f5806a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:56.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.785+0000 7f4f57fff700 1 -- 172.21.15.39:0/2756148545 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f58069e00 msgr2=0x7f4f5806a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:56.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.785+0000 7f4f57fff700 1 --2- 172.21.15.39:0/2756148545 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f58069e00 0x7f4f5806a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:56.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.785+0000 7f4f57fff700 1 -- 172.21.15.39:0/2756148545 >> v1:172.21.15.184:6789/0 conn(0x7f4f58071aa0 legacy=0x7f4f5806d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:56.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.785+0000 7f4f57fff700 1 -- 172.21.15.39:0/2756148545 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f580722f0 con 0x7f4f5815c640 2023-11-28T11:56:56.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.785+0000 7f4f57fff700 1 --2- 172.21.15.39:0/2756148545 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f5815c640 0x7f4f580d31e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4f48009910 tx=0x7f4f48009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a29275cc70a024ea server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:56.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.785+0000 7f4f577fe700 1 -- 172.21.15.39:0/2756148545 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4800ba60 con 0x7f4f5815c640 2023-11-28T11:56:56.791 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.785+0000 7f4f577fe700 1 -- 172.21.15.39:0/2756148545 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f4800bbc0 con 0x7f4f5815c640 2023-11-28T11:56:56.791 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.785+0000 7f4f577fe700 1 -- 172.21.15.39:0/2756148545 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f48009e60 con 0x7f4f5815c640 2023-11-28T11:56:56.792 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.785+0000 7f4f5d59a700 1 -- 172.21.15.39:0/2756148545 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f5815c640 msgr2=0x7f4f580d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:56.792 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.785+0000 7f4f5d59a700 1 --2- 172.21.15.39:0/2756148545 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f5815c640 0x7f4f580d31e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4f48009910 tx=0x7f4f48009c20 comp rx=0 tx=0).stop 2023-11-28T11:56:56.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.789+0000 7f4f5d59a700 1 -- 172.21.15.39:0/2756148545 shutdown_connections 2023-11-28T11:56:56.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.789+0000 7f4f5d59a700 1 --2- 172.21.15.39:0/2756148545 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f58069e00 0x7f4f5806a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:56.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.789+0000 7f4f5d59a700 1 --2- 172.21.15.39:0/2756148545 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f5815c640 0x7f4f580d31e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:56.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.789+0000 7f4f5d59a700 1 -- 172.21.15.39:0/2756148545 >> 172.21.15.39:0/2756148545 conn(0x7f4f580b6520 msgr2=0x7f4f58071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:56.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.789+0000 7f4f5d59a700 1 -- 172.21.15.39:0/2756148545 shutdown_connections 2023-11-28T11:56:56.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.789+0000 7f4f5d59a700 1 -- 172.21.15.39:0/2756148545 wait complete. 2023-11-28T11:56:56.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.789+0000 7f4f5d59a700 1 Processor -- start 2023-11-28T11:56:56.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.789+0000 7f4f5d59a700 1 -- start start 2023-11-28T11:56:56.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.793+0000 7f4f5d59a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f58069e00 0x7f4f581f1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:56.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.793+0000 7f4f5d59a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f58071aa0 0x7f4f580cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:56.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.793+0000 7f4f5d59a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f5815c640 0x7f4f580c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:56.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.793+0000 7f4f5d59a700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f580cca10 con 0x7f4f5815c640 2023-11-28T11:56:56.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.793+0000 7f4f5d59a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f580ca630 con 0x7f4f58071aa0 2023-11-28T11:56:56.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.793+0000 7f4f5d59a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f580ca910 con 0x7f4f58069e00 2023-11-28T11:56:56.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.793+0000 7f4f5cd99700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f5815c640 0x7f4f580c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:56.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.793+0000 7f4f4f7fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f58071aa0 0x7f4f580cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:56.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.793+0000 7f4f57fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f58069e00 0x7f4f581f1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:56.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.793+0000 7f4f5cd99700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f5815c640 0x7f4f580c7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39446/0 (socket says 172.21.15.39:39446) 2023-11-28T11:56:56.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.793+0000 7f4f5cd99700 1 -- 172.21.15.39:0/729448124 learned_addr learned my addr 172.21.15.39:0/729448124 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:56.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.793+0000 7f4f5cd99700 1 -- 172.21.15.39:0/729448124 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f58069e00 msgr2=0x7f4f581f1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:56.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.793+0000 7f4f5cd99700 1 --2- 172.21.15.39:0/729448124 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f58069e00 0x7f4f581f1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:56.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.793+0000 7f4f5cd99700 1 -- 172.21.15.39:0/729448124 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f58071aa0 msgr2=0x7f4f580cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:56.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.793+0000 7f4f5cd99700 1 --2- 172.21.15.39:0/729448124 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f58071aa0 0x7f4f580cc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:56.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.793+0000 7f4f5cd99700 1 -- 172.21.15.39:0/729448124 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f48009570 con 0x7f4f5815c640 2023-11-28T11:56:56.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.797+0000 7f4f5cd99700 1 --2- 172.21.15.39:0/729448124 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f5815c640 0x7f4f580c7b80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4f50007e40 tx=0x7f4f5000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:56.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.797+0000 7f4f557fa700 1 -- 172.21.15.39:0/729448124 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5000ed30 con 0x7f4f5815c640 2023-11-28T11:56:56.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.797+0000 7f4f557fa700 1 -- 172.21.15.39:0/729448124 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f50014420 con 0x7f4f5815c640 2023-11-28T11:56:56.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.797+0000 7f4f557fa700 1 -- 172.21.15.39:0/729448124 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f500147d0 con 0x7f4f5815c640 2023-11-28T11:56:56.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.797+0000 7f4f5d59a700 1 -- 172.21.15.39:0/729448124 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f5815ca10 con 0x7f4f5815c640 2023-11-28T11:56:56.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.797+0000 7f4f5d59a700 1 -- 172.21.15.39:0/729448124 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f5806da20 con 0x7f4f5815c640 2023-11-28T11:56:56.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.797+0000 7f4f5d59a700 1 -- 172.21.15.39:0/729448124 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f58072010 con 0x7f4f5815c640 2023-11-28T11:56:56.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.801+0000 7f4f557fa700 1 -- 172.21.15.39:0/729448124 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4f50012050 con 0x7f4f5815c640 2023-11-28T11:56:56.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.801+0000 7f4f557fa700 1 --2- 172.21.15.39:0/729448124 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4f38064ee0 0x7f4f38067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:56.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.801+0000 7f4f557fa700 1 -- 172.21.15.39:0/729448124 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4f500828e0 con 0x7f4f5815c640 2023-11-28T11:56:56.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.801+0000 7f4f57fff700 1 --2- 172.21.15.39:0/729448124 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4f38064ee0 0x7f4f38067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:56.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.801+0000 7f4f57fff700 1 --2- 172.21.15.39:0/729448124 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4f38064ee0 0x7f4f38067390 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4f48000c00 tx=0x7f4f48008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:56.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.809+0000 7f4f557fa700 1 -- 172.21.15.39:0/729448124 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4f50050590 con 0x7f4f5815c640 2023-11-28T11:56:57.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.997+0000 7f4f5d59a700 1 -- 172.21.15.39:0/729448124 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4f580ca770 con 0x7f4f5815c640 2023-11-28T11:56:57.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:56.997+0000 7f4f557fa700 1 -- 172.21.15.39:0/729448124 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4f580ca770 con 0x7f4f5815c640 2023-11-28T11:56:57.005 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.001+0000 7f4f5d59a700 1 -- 172.21.15.39:0/729448124 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4f38064ee0 msgr2=0x7f4f38067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:57.006 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.001+0000 7f4f5d59a700 1 --2- 172.21.15.39:0/729448124 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4f38064ee0 0x7f4f38067390 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4f48000c00 tx=0x7f4f48008030 comp rx=0 tx=0).stop 2023-11-28T11:56:57.006 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.001+0000 7f4f5d59a700 1 -- 172.21.15.39:0/729448124 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f5815c640 msgr2=0x7f4f580c7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:57.006 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.001+0000 7f4f5d59a700 1 --2- 172.21.15.39:0/729448124 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f5815c640 0x7f4f580c7b80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4f50007e40 tx=0x7f4f5000e3c0 comp rx=0 tx=0).stop 2023-11-28T11:56:57.006 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.001+0000 7f4f5d59a700 1 -- 172.21.15.39:0/729448124 shutdown_connections 2023-11-28T11:56:57.007 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.001+0000 7f4f5d59a700 1 --2- 172.21.15.39:0/729448124 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f5815c640 0x7f4f580c7b80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:57.007 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.001+0000 7f4f5d59a700 1 --2- 172.21.15.39:0/729448124 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4f38064ee0 0x7f4f38067390 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:57.007 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.001+0000 7f4f5d59a700 1 --2- 172.21.15.39:0/729448124 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f58071aa0 0x7f4f580cc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:57.007 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.001+0000 7f4f5d59a700 1 --2- 172.21.15.39:0/729448124 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f58069e00 0x7f4f581f1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:57.007 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.001+0000 7f4f5d59a700 1 -- 172.21.15.39:0/729448124 >> 172.21.15.39:0/729448124 conn(0x7f4f580b6520 msgr2=0x7f4f580b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:57.007 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.001+0000 7f4f5d59a700 1 -- 172.21.15.39:0/729448124 shutdown_connections 2023-11-28T11:56:57.007 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.001+0000 7f4f5d59a700 1 -- 172.21.15.39:0/729448124 wait complete. 2023-11-28T11:56:57.008 INFO:teuthology.orchestra.run.smithi039.stderr:listed 0 entries 2023-11-28T11:56:57.028 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi039.front.sepia.ceph.com... 2023-11-28T11:56:57.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:57.029 DEBUG:teuthology.orchestra.run.smithi039:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-11-28T11:56:57.074 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi039.stderr:ceph-fuse[41362]: fuse finished with error 0 and tester_r 0 2023-11-28T11:56:57.080 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:56:57.166 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi039.front.sepia.ceph.com 2023-11-28T11:56:57.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:57.167 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-11-28T11:56:57.198 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:56:57.430 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.425+0000 7f4815513700 1 Processor -- start 2023-11-28T11:56:57.430 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.425+0000 7f4815513700 1 -- start start 2023-11-28T11:56:57.433 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.429+0000 7f4815513700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f48100704b0 0x7f4810164960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:57.433 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.429+0000 7f4815513700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48100ad6c0 con 0x7f4810070080 2023-11-28T11:56:57.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.429+0000 7f4815513700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48100adc60 con 0x7f4810160710 2023-11-28T11:56:57.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.429+0000 7f4815513700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f481006b1c0 con 0x7f48100704b0 2023-11-28T11:56:57.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.429+0000 7f48067fc700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f4810070080 0x7f4810164250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35862/0 (socket says 172.21.15.39:35862) 2023-11-28T11:56:57.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.429+0000 7f48067fc700 1 -- 172.21.15.39:0/3560431386 learned_addr learned my addr 172.21.15.39:0/3560431386 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:56:57.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.429+0000 7f480f7fe700 1 --2- 172.21.15.39:0/3560431386 >> v2:172.21.15.39:3300/0 conn(0x7f48100704b0 0x7f4810164960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:57.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.429+0000 7f480e7fc700 1 -- 172.21.15.39:0/3560431386 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 966708412 0 0) 0x7f48100ad6c0 con 0x7f4810070080 2023-11-28T11:56:57.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.429+0000 7f480e7fc700 1 -- 172.21.15.39:0/3560431386 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47fc0035d0 con 0x7f4810070080 2023-11-28T11:56:57.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.429+0000 7f480e7fc700 1 -- 172.21.15.39:0/3560431386 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 999713929 0 0) 0x7f48100adc60 con 0x7f4810160710 2023-11-28T11:56:57.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.429+0000 7f480e7fc700 1 -- 172.21.15.39:0/3560431386 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48100ad6c0 con 0x7f4810160710 2023-11-28T11:56:57.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.429+0000 7f480f7fe700 1 -- 172.21.15.39:0/3560431386 >> v1:172.21.15.184:6789/0 conn(0x7f4810160710 legacy=0x7f48100cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:57.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.429+0000 7f480f7fe700 1 -- 172.21.15.39:0/3560431386 >> v1:172.21.15.39:6789/0 conn(0x7f4810070080 legacy=0x7f4810164250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:57.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.429+0000 7f480e7fc700 1 -- 172.21.15.39:0/3560431386 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 310944953 0 0) 0x7f47fc0035d0 con 0x7f4810070080 2023-11-28T11:56:57.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.429+0000 7f480f7fe700 1 -- 172.21.15.39:0/3560431386 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48100cca30 con 0x7f48100704b0 2023-11-28T11:56:57.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.429+0000 7f480f7fe700 1 --2- 172.21.15.39:0/3560431386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48100704b0 0x7f4810164960 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4808009850 tx=0x7f4808009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d15d69dd523a5a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:57.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.433+0000 7f480e7fc700 1 -- 172.21.15.39:0/3560431386 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4808011830 con 0x7f48100704b0 2023-11-28T11:56:57.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.433+0000 7f480e7fc700 1 -- 172.21.15.39:0/3560431386 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4808011990 con 0x7f48100704b0 2023-11-28T11:56:57.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.433+0000 7f480e7fc700 1 -- 172.21.15.39:0/3560431386 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4808011d40 con 0x7f48100704b0 2023-11-28T11:56:57.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.433+0000 7f4815513700 1 -- 172.21.15.39:0/3560431386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48100704b0 msgr2=0x7f4810164960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:57.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.433+0000 7f4815513700 1 --2- 172.21.15.39:0/3560431386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48100704b0 0x7f4810164960 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4808009850 tx=0x7f4808009b60 comp rx=0 tx=0).stop 2023-11-28T11:56:57.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.433+0000 7f4815513700 1 -- 172.21.15.39:0/3560431386 shutdown_connections 2023-11-28T11:56:57.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.433+0000 7f4815513700 1 --2- 172.21.15.39:0/3560431386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48100704b0 0x7f4810164960 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:57.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.433+0000 7f4815513700 1 -- 172.21.15.39:0/3560431386 >> 172.21.15.39:0/3560431386 conn(0x7f48100b0f80 msgr2=0x7f48100ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:57.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.433+0000 7f4815513700 1 -- 172.21.15.39:0/3560431386 shutdown_connections 2023-11-28T11:56:57.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.433+0000 7f4815513700 1 -- 172.21.15.39:0/3560431386 wait complete. 2023-11-28T11:56:57.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.437+0000 7f4815513700 1 Processor -- start 2023-11-28T11:56:57.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.437+0000 7f4815513700 1 -- start start 2023-11-28T11:56:57.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.437+0000 7f4815513700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4810070080 0x7f481015ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:57.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.437+0000 7f4815513700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48100704b0 0x7f4810159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:57.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.437+0000 7f4815513700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4810160710 0x7f48100b1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:57.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.437+0000 7f4815513700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48100b3110 con 0x7f4810070080 2023-11-28T11:56:57.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.437+0000 7f4815513700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4810159d90 con 0x7f4810160710 2023-11-28T11:56:57.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.437+0000 7f4815513700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48100b1dd0 con 0x7f48100704b0 2023-11-28T11:56:57.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.441+0000 7f480effd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4810070080 0x7f481015ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:57.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.441+0000 7f480effd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4810070080 0x7f481015ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39460/0 (socket says 172.21.15.39:39460) 2023-11-28T11:56:57.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.441+0000 7f480effd700 1 -- 172.21.15.39:0/510583314 learned_addr learned my addr 172.21.15.39:0/510583314 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:57.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.441+0000 7f480f7fe700 1 --2- 172.21.15.39:0/510583314 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4810160710 0x7f48100b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:57.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.441+0000 7f48067fc700 1 --2- 172.21.15.39:0/510583314 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48100704b0 0x7f4810159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:57.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.441+0000 7f480effd700 1 -- 172.21.15.39:0/510583314 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48100704b0 msgr2=0x7f4810159850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:57.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.441+0000 7f480effd700 1 --2- 172.21.15.39:0/510583314 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48100704b0 0x7f4810159850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:57.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.441+0000 7f480effd700 1 -- 172.21.15.39:0/510583314 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4810160710 msgr2=0x7f48100b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:57.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.441+0000 7f480effd700 1 --2- 172.21.15.39:0/510583314 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4810160710 0x7f48100b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:57.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.441+0000 7f480effd700 1 -- 172.21.15.39:0/510583314 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48080094b0 con 0x7f4810070080 2023-11-28T11:56:57.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.441+0000 7f48067fc700 1 --2- 172.21.15.39:0/510583314 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48100704b0 0x7f4810159850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:57.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.441+0000 7f480effd700 1 --2- 172.21.15.39:0/510583314 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4810070080 0x7f481015ccf0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f480000cc50 tx=0x7f480000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:57.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.441+0000 7f4807fff700 1 -- 172.21.15.39:0/510583314 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4800003c20 con 0x7f4810070080 2023-11-28T11:56:57.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.441+0000 7f4807fff700 1 -- 172.21.15.39:0/510583314 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4800003d80 con 0x7f4810070080 2023-11-28T11:56:57.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.441+0000 7f4807fff700 1 -- 172.21.15.39:0/510583314 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480000ab60 con 0x7f4810070080 2023-11-28T11:56:57.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.441+0000 7f4815513700 1 -- 172.21.15.39:0/510583314 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f481006b6b0 con 0x7f4810070080 2023-11-28T11:56:57.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.441+0000 7f4815513700 1 -- 172.21.15.39:0/510583314 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f481006b3d0 con 0x7f4810070080 2023-11-28T11:56:57.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.445+0000 7f4815513700 1 -- 172.21.15.39:0/510583314 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48100ad8f0 con 0x7f4810070080 2023-11-28T11:56:57.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.445+0000 7f4807fff700 1 -- 172.21.15.39:0/510583314 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4800010050 con 0x7f4810070080 2023-11-28T11:56:57.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.445+0000 7f4807fff700 1 --2- 172.21.15.39:0/510583314 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f47f0064ee0 0x7f47f0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:57.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.445+0000 7f4807fff700 1 -- 172.21.15.39:0/510583314 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f48000820a0 con 0x7f4810070080 2023-11-28T11:56:57.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.445+0000 7f48067fc700 1 --2- 172.21.15.39:0/510583314 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f47f0064ee0 0x7f47f0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:57.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.449+0000 7f48067fc700 1 --2- 172.21.15.39:0/510583314 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f47f0064ee0 0x7f47f0067390 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f48100c3a60 tx=0x7f47f8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:57.458 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.453+0000 7f4807fff700 1 -- 172.21.15.39:0/510583314 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f480004ff50 con 0x7f4810070080 2023-11-28T11:56:57.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.629+0000 7f4815513700 1 -- 172.21.15.39:0/510583314 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48100711c0 con 0x7f4810070080 2023-11-28T11:56:57.639 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.633+0000 7f4807fff700 1 -- 172.21.15.39:0/510583314 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+19652 (secure 0 0 0) 0x7f4800053570 con 0x7f4810070080 2023-11-28T11:56:57.639 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:56:57.640 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":29,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:56:44.439368+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:56:38.203736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:56:38.946498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:56:41.988334+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:56:57.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.637+0000 7f4815513700 1 -- 172.21.15.39:0/510583314 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f47f0064ee0 msgr2=0x7f47f0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:57.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.637+0000 7f4815513700 1 --2- 172.21.15.39:0/510583314 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f47f0064ee0 0x7f47f0067390 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f48100c3a60 tx=0x7f47f8009040 comp rx=0 tx=0).stop 2023-11-28T11:56:57.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.637+0000 7f4815513700 1 -- 172.21.15.39:0/510583314 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4810070080 msgr2=0x7f481015ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:57.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.637+0000 7f4815513700 1 --2- 172.21.15.39:0/510583314 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4810070080 0x7f481015ccf0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f480000cc50 tx=0x7f480000cf60 comp rx=0 tx=0).stop 2023-11-28T11:56:57.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.637+0000 7f4815513700 1 -- 172.21.15.39:0/510583314 shutdown_connections 2023-11-28T11:56:57.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.637+0000 7f4815513700 1 --2- 172.21.15.39:0/510583314 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f47f0064ee0 0x7f47f0067390 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:57.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.637+0000 7f4815513700 1 --2- 172.21.15.39:0/510583314 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4810160710 0x7f48100b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:57.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.637+0000 7f4815513700 1 --2- 172.21.15.39:0/510583314 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48100704b0 0x7f4810159850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:57.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.637+0000 7f4815513700 1 --2- 172.21.15.39:0/510583314 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4810070080 0x7f481015ccf0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:57.644 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.637+0000 7f4815513700 1 -- 172.21.15.39:0/510583314 >> 172.21.15.39:0/510583314 conn(0x7f48100b0f80 msgr2=0x7f4810160ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:57.644 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.637+0000 7f4815513700 1 -- 172.21.15.39:0/510583314 shutdown_connections 2023-11-28T11:56:57.644 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.637+0000 7f4815513700 1 -- 172.21.15.39:0/510583314 wait complete. 2023-11-28T11:56:57.664 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:56:57.852 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.849+0000 7f3a59c51700 1 Processor -- start 2023-11-28T11:56:57.852 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.849+0000 7f3a59c51700 1 -- start start 2023-11-28T11:56:57.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.849+0000 7f3a59c51700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3a541534a0 0x7f3a5415d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:57.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.849+0000 7f3a59c51700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3a54160920 0x7f3a540b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:57.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.849+0000 7f3a59c51700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3a540b6030 0x7f3a54070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:57.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.849+0000 7f3a59c51700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a5415d080 con 0x7f3a540b6030 2023-11-28T11:56:57.855 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.849+0000 7f3a59c51700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a54153870 con 0x7f3a54160920 2023-11-28T11:56:57.855 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.849+0000 7f3a59c51700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a540b6450 con 0x7f3a541534a0 2023-11-28T11:56:57.855 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.849+0000 7f3a53fff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3a540b6030 0x7f3a54070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:57.855 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.849+0000 7f3a52ffd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3a54160920 0x7f3a540b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:57.855 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.849+0000 7f3a52ffd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3a54160920 0x7f3a540b5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:47846/0 (socket says 172.21.15.39:47846) 2023-11-28T11:56:57.855 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.849+0000 7f3a53fff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3a540b6030 0x7f3a54070630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39468/0 (socket says 172.21.15.39:39468) 2023-11-28T11:56:57.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.849+0000 7f3a52ffd700 1 -- 172.21.15.39:0/4226962137 learned_addr learned my addr 172.21.15.39:0/4226962137 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:57.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.849+0000 7f3a537fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3a541534a0 0x7f3a5415d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:57.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.849+0000 7f3a52ffd700 1 -- 172.21.15.39:0/4226962137 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3a541534a0 msgr2=0x7f3a5415d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:57.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.849+0000 7f3a52ffd700 1 --2- 172.21.15.39:0/4226962137 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3a541534a0 0x7f3a5415d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:57.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.849+0000 7f3a52ffd700 1 -- 172.21.15.39:0/4226962137 >> v2:172.21.15.39:3300/0 conn(0x7f3a540b6030 msgr2=0x7f3a54070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:57.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.849+0000 7f3a52ffd700 1 --2- 172.21.15.39:0/4226962137 >> v2:172.21.15.39:3300/0 conn(0x7f3a540b6030 0x7f3a54070630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:57.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.849+0000 7f3a52ffd700 1 -- 172.21.15.39:0/4226962137 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a540b53c0 con 0x7f3a54160920 2023-11-28T11:56:57.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.853+0000 7f3a52ffd700 1 --2- 172.21.15.39:0/4226962137 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a54160920 0x7f3a540b5af0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3a5406cb80 tx=0x7f3a48009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=832005c14a35bed5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:57.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.853+0000 7f3a527fc700 1 -- 172.21.15.39:0/4226962137 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a48011830 con 0x7f3a54160920 2023-11-28T11:56:57.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.853+0000 7f3a527fc700 1 -- 172.21.15.39:0/4226962137 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a48011990 con 0x7f3a54160920 2023-11-28T11:56:57.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.853+0000 7f3a527fc700 1 -- 172.21.15.39:0/4226962137 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a48011d20 con 0x7f3a54160920 2023-11-28T11:56:57.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.853+0000 7f3a59c51700 1 -- 172.21.15.39:0/4226962137 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a54160920 msgr2=0x7f3a540b5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:57.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.853+0000 7f3a59c51700 1 --2- 172.21.15.39:0/4226962137 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a54160920 0x7f3a540b5af0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3a5406cb80 tx=0x7f3a48009bf0 comp rx=0 tx=0).stop 2023-11-28T11:56:57.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.853+0000 7f3a59c51700 1 -- 172.21.15.39:0/4226962137 shutdown_connections 2023-11-28T11:56:57.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.853+0000 7f3a59c51700 1 --2- 172.21.15.39:0/4226962137 >> v2:172.21.15.39:3300/0 conn(0x7f3a540b6030 0x7f3a54070630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:57.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.853+0000 7f3a59c51700 1 --2- 172.21.15.39:0/4226962137 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a54160920 0x7f3a540b5af0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:57.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.853+0000 7f3a59c51700 1 --2- 172.21.15.39:0/4226962137 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3a541534a0 0x7f3a5415d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:57.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.853+0000 7f3a59c51700 1 -- 172.21.15.39:0/4226962137 >> 172.21.15.39:0/4226962137 conn(0x7f3a5406bfc0 msgr2=0x7f3a5406c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:57.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.853+0000 7f3a59c51700 1 -- 172.21.15.39:0/4226962137 shutdown_connections 2023-11-28T11:56:57.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.853+0000 7f3a59c51700 1 -- 172.21.15.39:0/4226962137 wait complete. 2023-11-28T11:56:57.862 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.857+0000 7f3a59c51700 1 Processor -- start 2023-11-28T11:56:57.862 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.857+0000 7f3a59c51700 1 -- start start 2023-11-28T11:56:57.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.857+0000 7f3a59c51700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3a540b6030 0x7f3a54153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:57.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.857+0000 7f3a59c51700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a541534a0 0x7f3a541f2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:57.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.857+0000 7f3a59c51700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3a54160920 0x7f3a540cff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:57.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.857+0000 7f3a59c51700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a54156db0 con 0x7f3a540b6030 2023-11-28T11:56:57.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.857+0000 7f3a59c51700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5413dd20 con 0x7f3a541534a0 2023-11-28T11:56:57.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.857+0000 7f3a59c51700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a540d1290 con 0x7f3a54160920 2023-11-28T11:56:57.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.857+0000 7f3a537fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3a540b6030 0x7f3a54153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:57.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.861+0000 7f3a52ffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a541534a0 0x7f3a541f2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:57.865 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.861+0000 7f3a537fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3a540b6030 0x7f3a54153f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39482/0 (socket says 172.21.15.39:39482) 2023-11-28T11:56:57.865 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.861+0000 7f3a537fe700 1 -- 172.21.15.39:0/311071450 learned_addr learned my addr 172.21.15.39:0/311071450 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:57.865 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.861+0000 7f3a53fff700 1 --2- 172.21.15.39:0/311071450 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3a54160920 0x7f3a540cff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:57.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.861+0000 7f3a537fe700 1 -- 172.21.15.39:0/311071450 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3a54160920 msgr2=0x7f3a540cff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:57.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.861+0000 7f3a537fe700 1 --2- 172.21.15.39:0/311071450 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3a54160920 0x7f3a540cff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:57.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.861+0000 7f3a537fe700 1 -- 172.21.15.39:0/311071450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a541534a0 msgr2=0x7f3a541f2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:57.867 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.861+0000 7f3a537fe700 1 --2- 172.21.15.39:0/311071450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a541534a0 0x7f3a541f2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:57.867 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.861+0000 7f3a537fe700 1 -- 172.21.15.39:0/311071450 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a48009570 con 0x7f3a540b6030 2023-11-28T11:56:57.867 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.861+0000 7f3a53fff700 1 --2- 172.21.15.39:0/311071450 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3a54160920 0x7f3a540cff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:57.867 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.861+0000 7f3a52ffd700 1 --2- 172.21.15.39:0/311071450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a541534a0 0x7f3a541f2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:57.867 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.861+0000 7f3a537fe700 1 --2- 172.21.15.39:0/311071450 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3a540b6030 0x7f3a54153f20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3a4400ea00 tx=0x7f3a4400ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:57.867 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.861+0000 7f3a3bfff700 1 -- 172.21.15.39:0/311071450 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a44009720 con 0x7f3a540b6030 2023-11-28T11:56:57.867 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.861+0000 7f3a3bfff700 1 -- 172.21.15.39:0/311071450 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a4400c7f0 con 0x7f3a540b6030 2023-11-28T11:56:57.867 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.861+0000 7f3a3bfff700 1 -- 172.21.15.39:0/311071450 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4400cb60 con 0x7f3a540b6030 2023-11-28T11:56:57.867 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.861+0000 7f3a59c51700 1 -- 172.21.15.39:0/311071450 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a5415ca30 con 0x7f3a540b6030 2023-11-28T11:56:57.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.861+0000 7f3a59c51700 1 -- 172.21.15.39:0/311071450 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a540b56a0 con 0x7f3a540b6030 2023-11-28T11:56:57.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.865+0000 7f3a59c51700 1 -- 172.21.15.39:0/311071450 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a5415cd10 con 0x7f3a540b6030 2023-11-28T11:56:57.870 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.865+0000 7f3a3bfff700 1 -- 172.21.15.39:0/311071450 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3a44019030 con 0x7f3a540b6030 2023-11-28T11:56:57.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.865+0000 7f3a3bfff700 1 --2- 172.21.15.39:0/311071450 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3a40064ee0 0x7f3a40067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:57.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.869+0000 7f3a3bfff700 1 -- 172.21.15.39:0/311071450 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3a440821b0 con 0x7f3a540b6030 2023-11-28T11:56:57.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.869+0000 7f3a52ffd700 1 --2- 172.21.15.39:0/311071450 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3a40064ee0 0x7f3a40067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:57.874 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.869+0000 7f3a52ffd700 1 --2- 172.21.15.39:0/311071450 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3a40064ee0 0x7f3a40067390 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3a48000c00 tx=0x7f3a48008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:57.879 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:57.873+0000 7f3a3bfff700 1 -- 172.21.15.39:0/311071450 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3a4404fef0 con 0x7f3a540b6030 2023-11-28T11:56:58.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.053+0000 7f3a59c51700 1 -- 172.21.15.39:0/311071450 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a540726c0 con 0x7f3a540b6030 2023-11-28T11:56:58.063 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.057+0000 7f3a3bfff700 1 -- 172.21.15.39:0/311071450 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+19652 (secure 0 0 0) 0x7f3a44053510 con 0x7f3a540b6030 2023-11-28T11:56:58.063 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:56:58.063 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":29,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:56:44.439368+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:56:38.203736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:56:38.946498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:56:41.988334+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:56:58.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.061+0000 7f3a59c51700 1 -- 172.21.15.39:0/311071450 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3a40064ee0 msgr2=0x7f3a40067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:58.071 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.061+0000 7f3a59c51700 1 --2- 172.21.15.39:0/311071450 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3a40064ee0 0x7f3a40067390 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3a48000c00 tx=0x7f3a48008030 comp rx=0 tx=0).stop 2023-11-28T11:56:58.071 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.061+0000 7f3a59c51700 1 -- 172.21.15.39:0/311071450 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3a540b6030 msgr2=0x7f3a54153f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:58.071 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.061+0000 7f3a59c51700 1 --2- 172.21.15.39:0/311071450 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3a540b6030 0x7f3a54153f20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3a4400ea00 tx=0x7f3a4400ed10 comp rx=0 tx=0).stop 2023-11-28T11:56:58.071 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.061+0000 7f3a59c51700 1 -- 172.21.15.39:0/311071450 shutdown_connections 2023-11-28T11:56:58.071 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.061+0000 7f3a59c51700 1 --2- 172.21.15.39:0/311071450 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3a54160920 0x7f3a540cff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:58.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.061+0000 7f3a59c51700 1 --2- 172.21.15.39:0/311071450 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3a40064ee0 0x7f3a40067390 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:58.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.061+0000 7f3a59c51700 1 --2- 172.21.15.39:0/311071450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a541534a0 0x7f3a541f2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:58.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.061+0000 7f3a59c51700 1 --2- 172.21.15.39:0/311071450 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3a540b6030 0x7f3a54153f20 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:58.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.061+0000 7f3a59c51700 1 -- 172.21.15.39:0/311071450 >> 172.21.15.39:0/311071450 conn(0x7f3a5406bfc0 msgr2=0x7f3a5415f350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:58.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.065+0000 7f3a59c51700 1 -- 172.21.15.39:0/311071450 shutdown_connections 2023-11-28T11:56:58.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.065+0000 7f3a59c51700 1 -- 172.21.15.39:0/311071450 wait complete. 2023-11-28T11:56:58.090 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T11:56:58.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.273+0000 7f88089ce700 1 Processor -- start 2023-11-28T11:56:58.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.273+0000 7f88089ce700 1 -- start start 2023-11-28T11:56:58.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.273+0000 7f88089ce700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88040cc1a0 0x7f880415d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:58.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.273+0000 7f88089ce700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f880415d650 con 0x7f8804159cd0 2023-11-28T11:56:58.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.273+0000 7f88089ce700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f880415a0a0 con 0x7f880406ff10 2023-11-28T11:56:58.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.273+0000 7f88089ce700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f880406be80 con 0x7f88040cc1a0 2023-11-28T11:56:58.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.277+0000 7f88037fe700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f8804159cd0 0x7f880406c890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:37836/0 (socket says 172.21.15.39:37836) 2023-11-28T11:56:58.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.277+0000 7f88037fe700 1 -- 172.21.15.39:0/2687401076 learned_addr learned my addr 172.21.15.39:0/2687401076 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:56:58.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.277+0000 7f8802ffd700 1 --2- 172.21.15.39:0/2687401076 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88040cc1a0 0x7f880415d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:58.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.277+0000 7f88027fc700 1 -- 172.21.15.39:0/2687401076 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2872875829 0 0) 0x7f880415d650 con 0x7f8804159cd0 2023-11-28T11:56:58.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.277+0000 7f88027fc700 1 -- 172.21.15.39:0/2687401076 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87ec0035d0 con 0x7f8804159cd0 2023-11-28T11:56:58.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.277+0000 7f88027fc700 1 -- 172.21.15.39:0/2687401076 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1941719954 0 0) 0x7f880415a0a0 con 0x7f880406ff10 2023-11-28T11:56:58.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.277+0000 7f8802ffd700 1 -- 172.21.15.39:0/2687401076 >> v1:172.21.15.184:6789/0 conn(0x7f880406ff10 legacy=0x7f8804069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:58.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.277+0000 7f8802ffd700 1 -- 172.21.15.39:0/2687401076 >> v1:172.21.15.39:6789/0 conn(0x7f8804159cd0 legacy=0x7f880406c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:58.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.277+0000 7f8802ffd700 1 -- 172.21.15.39:0/2687401076 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88040cdf80 con 0x7f88040cc1a0 2023-11-28T11:56:58.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.277+0000 7f8802ffd700 1 --2- 172.21.15.39:0/2687401076 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88040cc1a0 0x7f880415d110 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f87f8009880 tx=0x7f87f8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2321d294768983c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:58.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.277+0000 7f88027fc700 1 -- 172.21.15.39:0/2687401076 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f8011830 con 0x7f88040cc1a0 2023-11-28T11:56:58.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.277+0000 7f88027fc700 1 -- 172.21.15.39:0/2687401076 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f8011990 con 0x7f88040cc1a0 2023-11-28T11:56:58.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.277+0000 7f88027fc700 1 -- 172.21.15.39:0/2687401076 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f8011d20 con 0x7f88040cc1a0 2023-11-28T11:56:58.284 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.281+0000 7f88089ce700 1 -- 172.21.15.39:0/2687401076 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88040cc1a0 msgr2=0x7f880415d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:58.284 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.281+0000 7f88089ce700 1 --2- 172.21.15.39:0/2687401076 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88040cc1a0 0x7f880415d110 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f87f8009880 tx=0x7f87f8009b90 comp rx=0 tx=0).stop 2023-11-28T11:56:58.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.281+0000 7f88089ce700 1 -- 172.21.15.39:0/2687401076 shutdown_connections 2023-11-28T11:56:58.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.281+0000 7f88089ce700 1 --2- 172.21.15.39:0/2687401076 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88040cc1a0 0x7f880415d110 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:58.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.281+0000 7f88089ce700 1 -- 172.21.15.39:0/2687401076 >> 172.21.15.39:0/2687401076 conn(0x7f88040cf280 msgr2=0x7f88040cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:58.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.281+0000 7f88089ce700 1 -- 172.21.15.39:0/2687401076 shutdown_connections 2023-11-28T11:56:58.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.281+0000 7f88089ce700 1 -- 172.21.15.39:0/2687401076 wait complete. 2023-11-28T11:56:58.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.281+0000 7f88089ce700 1 Processor -- start 2023-11-28T11:56:58.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.285+0000 7f88089ce700 1 -- start start 2023-11-28T11:56:58.290 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.285+0000 7f88089ce700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f880406ff10 0x7f88040c5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:58.291 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.285+0000 7f88089ce700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88040cc1a0 0x7f8804158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:58.291 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.285+0000 7f88089ce700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8804159cd0 0x7f88041531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:58.291 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.285+0000 7f88089ce700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88040b1650 con 0x7f880406ff10 2023-11-28T11:56:58.291 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.285+0000 7f88089ce700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88041588d0 con 0x7f8804159cd0 2023-11-28T11:56:58.291 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.285+0000 7f88089ce700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8804153700 con 0x7f88040cc1a0 2023-11-28T11:56:58.291 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.285+0000 7f88037fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f880406ff10 0x7f88040c5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:58.291 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.285+0000 7f88037fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f880406ff10 0x7f88040c5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44978/0 (socket says 172.21.15.39:44978) 2023-11-28T11:56:58.291 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.285+0000 7f88037fe700 1 -- 172.21.15.39:0/3359049143 learned_addr learned my addr 172.21.15.39:0/3359049143 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:58.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.285+0000 7f8803fff700 1 --2- 172.21.15.39:0/3359049143 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8804159cd0 0x7f88041531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:58.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.285+0000 7f8802ffd700 1 --2- 172.21.15.39:0/3359049143 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88040cc1a0 0x7f8804158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:58.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.285+0000 7f8803fff700 1 -- 172.21.15.39:0/3359049143 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88040cc1a0 msgr2=0x7f8804158390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:58.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.285+0000 7f8803fff700 1 --2- 172.21.15.39:0/3359049143 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88040cc1a0 0x7f8804158390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:58.293 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.285+0000 7f8803fff700 1 -- 172.21.15.39:0/3359049143 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f880406ff10 msgr2=0x7f88040c5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:58.293 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.285+0000 7f8803fff700 1 --2- 172.21.15.39:0/3359049143 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f880406ff10 0x7f88040c5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:58.293 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.285+0000 7f8803fff700 1 -- 172.21.15.39:0/3359049143 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f80094b0 con 0x7f8804159cd0 2023-11-28T11:56:58.293 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.289+0000 7f8803fff700 1 --2- 172.21.15.39:0/3359049143 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8804159cd0 0x7f88041531c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f87fc00cbe0 tx=0x7f87fc00cef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:58.294 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.289+0000 7f87ebfff700 1 -- 172.21.15.39:0/3359049143 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc003e50 con 0x7f8804159cd0 2023-11-28T11:56:58.294 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.289+0000 7f87ebfff700 1 -- 172.21.15.39:0/3359049143 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87fc00a650 con 0x7f8804159cd0 2023-11-28T11:56:58.294 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.289+0000 7f87ebfff700 1 -- 172.21.15.39:0/3359049143 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc00aa00 con 0x7f8804159cd0 2023-11-28T11:56:58.294 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.289+0000 7f88089ce700 1 -- 172.21.15.39:0/3359049143 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f880406c090 con 0x7f8804159cd0 2023-11-28T11:56:58.294 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.289+0000 7f88089ce700 1 -- 172.21.15.39:0/3359049143 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88040ce260 con 0x7f8804159cd0 2023-11-28T11:56:58.295 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.289+0000 7f88089ce700 1 -- 172.21.15.39:0/3359049143 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f880406c370 con 0x7f8804159cd0 2023-11-28T11:56:58.296 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.293+0000 7f87ebfff700 1 -- 172.21.15.39:0/3359049143 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f87fc019030 con 0x7f8804159cd0 2023-11-28T11:56:58.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.293+0000 7f87ebfff700 1 --2- 172.21.15.39:0/3359049143 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f87f0064f30 0x7f87f00673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:58.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.293+0000 7f87ebfff700 1 -- 172.21.15.39:0/3359049143 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f87fc081a70 con 0x7f8804159cd0 2023-11-28T11:56:58.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.293+0000 7f88037fe700 1 --2- 172.21.15.39:0/3359049143 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f87f0064f30 0x7f87f00673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:58.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.297+0000 7f88037fe700 1 --2- 172.21.15.39:0/3359049143 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f87f0064f30 0x7f87f00673e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f87f4005930 tx=0x7f87f4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:58.307 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.301+0000 7f87ebfff700 1 -- 172.21.15.39:0/3359049143 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f87fc04f8b0 con 0x7f8804159cd0 2023-11-28T11:56:58.517 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.513+0000 7f88089ce700 1 -- 172.21.15.39:0/3359049143 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f88040cca80 con 0x7f8804159cd0 2023-11-28T11:56:58.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.725+0000 7f87ebfff700 1 -- 172.21.15.39:0/3359049143 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f87fc052ed0 con 0x7f8804159cd0 2023-11-28T11:56:58.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.729+0000 7f88089ce700 1 -- 172.21.15.39:0/3359049143 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f87f0064f30 msgr2=0x7f87f00673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:58.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.729+0000 7f88089ce700 1 --2- 172.21.15.39:0/3359049143 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f87f0064f30 0x7f87f00673e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f87f4005930 tx=0x7f87f4009040 comp rx=0 tx=0).stop 2023-11-28T11:56:58.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.729+0000 7f88089ce700 1 -- 172.21.15.39:0/3359049143 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8804159cd0 msgr2=0x7f88041531c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:58.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.729+0000 7f88089ce700 1 --2- 172.21.15.39:0/3359049143 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8804159cd0 0x7f88041531c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f87fc00cbe0 tx=0x7f87fc00cef0 comp rx=0 tx=0).stop 2023-11-28T11:56:58.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.729+0000 7f88089ce700 1 -- 172.21.15.39:0/3359049143 shutdown_connections 2023-11-28T11:56:58.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.729+0000 7f88089ce700 1 --2- 172.21.15.39:0/3359049143 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f87f0064f30 0x7f87f00673e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:58.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.729+0000 7f88089ce700 1 --2- 172.21.15.39:0/3359049143 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8804159cd0 0x7f88041531c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:58.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.729+0000 7f88089ce700 1 --2- 172.21.15.39:0/3359049143 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88040cc1a0 0x7f8804158390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:58.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.729+0000 7f88089ce700 1 --2- 172.21.15.39:0/3359049143 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f880406ff10 0x7f88040c5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:58.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.729+0000 7f88089ce700 1 -- 172.21.15.39:0/3359049143 >> 172.21.15.39:0/3359049143 conn(0x7f88040cf280 msgr2=0x7f8804069bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:58.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.729+0000 7f88089ce700 1 -- 172.21.15.39:0/3359049143 shutdown_connections 2023-11-28T11:56:58.737 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.729+0000 7f88089ce700 1 -- 172.21.15.39:0/3359049143 wait complete. 2023-11-28T11:56:58.761 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-11-28T11:56:58.761 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T11:56:58.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.941+0000 7f7e76cd1700 1 Processor -- start 2023-11-28T11:56:58.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.941+0000 7f7e76cd1700 1 -- start start 2023-11-28T11:56:58.949 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.945+0000 7f7e76cd1700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7e700cdc50 0x7f7e70069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:58.949 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.945+0000 7f7e76cd1700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7e7006ff10 0x7f7e70070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:58.949 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.945+0000 7f7e76cd1700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e700708b0 con 0x7f7e7015e190 2023-11-28T11:56:58.949 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.945+0000 7f7e76cd1700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e7015e560 con 0x7f7e7006ff10 2023-11-28T11:56:58.949 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.945+0000 7f7e76cd1700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e7006be80 con 0x7f7e700cdc50 2023-11-28T11:56:58.950 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.945+0000 7f7e75ccf700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f7e7015e190 0x7f7e70161560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:37844/0 (socket says 172.21.15.39:37844) 2023-11-28T11:56:58.950 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.945+0000 7f7e75ccf700 1 -- 172.21.15.39:0/3245934787 learned_addr learned my addr 172.21.15.39:0/3245934787 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:56:58.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.945+0000 7f7e764d0700 1 --2- 172.21.15.39:0/3245934787 >> v2:172.21.15.39:3300/0 conn(0x7f7e7006ff10 0x7f7e70070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:58.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.945+0000 7f7e754ce700 1 --2- 172.21.15.39:0/3245934787 >> v2:172.21.15.184:3300/0 conn(0x7f7e700cdc50 0x7f7e70069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:58.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.945+0000 7f7e74ccd700 1 -- 172.21.15.39:0/3245934787 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4118480950 0 0) 0x7f7e700708b0 con 0x7f7e7015e190 2023-11-28T11:56:58.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.945+0000 7f7e74ccd700 1 -- 172.21.15.39:0/3245934787 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e5c0035d0 con 0x7f7e7015e190 2023-11-28T11:56:58.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.945+0000 7f7e764d0700 1 -- 172.21.15.39:0/3245934787 >> v2:172.21.15.184:3300/0 conn(0x7f7e700cdc50 msgr2=0x7f7e70069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:58.952 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.945+0000 7f7e764d0700 1 --2- 172.21.15.39:0/3245934787 >> v2:172.21.15.184:3300/0 conn(0x7f7e700cdc50 0x7f7e70069bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:58.952 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.945+0000 7f7e764d0700 1 -- 172.21.15.39:0/3245934787 >> v1:172.21.15.39:6789/0 conn(0x7f7e7015e190 legacy=0x7f7e70161560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:58.952 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.945+0000 7f7e764d0700 1 -- 172.21.15.39:0/3245934787 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e700ce0a0 con 0x7f7e7006ff10 2023-11-28T11:56:58.952 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.945+0000 7f7e754ce700 1 --2- 172.21.15.39:0/3245934787 >> v2:172.21.15.184:3300/0 conn(0x7f7e700cdc50 0x7f7e70069bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:58.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.945+0000 7f7e764d0700 1 --2- 172.21.15.39:0/3245934787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e7006ff10 0x7f7e70070370 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7e700c55a0 tx=0x7f7e6800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35f5eb5c708718e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:58.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.945+0000 7f7e74ccd700 1 -- 172.21.15.39:0/3245934787 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6800e070 con 0x7f7e7006ff10 2023-11-28T11:56:58.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.949+0000 7f7e74ccd700 1 -- 172.21.15.39:0/3245934787 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6800bb20 con 0x7f7e7006ff10 2023-11-28T11:56:58.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.949+0000 7f7e74ccd700 1 -- 172.21.15.39:0/3245934787 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e68012430 con 0x7f7e7006ff10 2023-11-28T11:56:58.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.949+0000 7f7e76cd1700 1 -- 172.21.15.39:0/3245934787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e7006ff10 msgr2=0x7f7e70070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:58.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.949+0000 7f7e76cd1700 1 --2- 172.21.15.39:0/3245934787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e7006ff10 0x7f7e70070370 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7e700c55a0 tx=0x7f7e6800b330 comp rx=0 tx=0).stop 2023-11-28T11:56:58.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.949+0000 7f7e76cd1700 1 -- 172.21.15.39:0/3245934787 shutdown_connections 2023-11-28T11:56:58.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.949+0000 7f7e76cd1700 1 --2- 172.21.15.39:0/3245934787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e7006ff10 0x7f7e70070370 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:58.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.949+0000 7f7e76cd1700 1 --2- 172.21.15.39:0/3245934787 >> v2:172.21.15.184:3300/0 conn(0x7f7e700cdc50 0x7f7e70069bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:58.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.949+0000 7f7e76cd1700 1 -- 172.21.15.39:0/3245934787 >> 172.21.15.39:0/3245934787 conn(0x7f7e700cf280 msgr2=0x7f7e700cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:58.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.949+0000 7f7e76cd1700 1 -- 172.21.15.39:0/3245934787 shutdown_connections 2023-11-28T11:56:58.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.949+0000 7f7e76cd1700 1 -- 172.21.15.39:0/3245934787 wait complete. 2023-11-28T11:56:58.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.953+0000 7f7e76cd1700 1 Processor -- start 2023-11-28T11:56:58.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.953+0000 7f7e76cd1700 1 -- start start 2023-11-28T11:56:58.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.953+0000 7f7e76cd1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e7006ff10 0x7f7e70159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:58.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.953+0000 7f7e76cd1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e700cdc50 0x7f7e70155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:58.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.953+0000 7f7e76cd1700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e7015e190 0x7f7e7015f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:58.960 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.953+0000 7f7e76cd1700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e701572f0 con 0x7f7e7015e190 2023-11-28T11:56:58.960 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.953+0000 7f7e76cd1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e70158b60 con 0x7f7e700cdc50 2023-11-28T11:56:58.960 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.953+0000 7f7e76cd1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e70157540 con 0x7f7e7006ff10 2023-11-28T11:56:58.960 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.953+0000 7f7e764d0700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e7015e190 0x7f7e7015f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:58.960 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.953+0000 7f7e764d0700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e7015e190 0x7f7e7015f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44990/0 (socket says 172.21.15.39:44990) 2023-11-28T11:56:58.960 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.953+0000 7f7e764d0700 1 -- 172.21.15.39:0/2097505356 learned_addr learned my addr 172.21.15.39:0/2097505356 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:56:58.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.953+0000 7f7e754ce700 1 --2- 172.21.15.39:0/2097505356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e700cdc50 0x7f7e70155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:58.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.953+0000 7f7e75ccf700 1 --2- 172.21.15.39:0/2097505356 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e7006ff10 0x7f7e70159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:58.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.957+0000 7f7e764d0700 1 -- 172.21.15.39:0/2097505356 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e7006ff10 msgr2=0x7f7e70159010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:58.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.957+0000 7f7e764d0700 1 --2- 172.21.15.39:0/2097505356 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e7006ff10 0x7f7e70159010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:58.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.957+0000 7f7e764d0700 1 -- 172.21.15.39:0/2097505356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e700cdc50 msgr2=0x7f7e70155ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:58.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.957+0000 7f7e764d0700 1 --2- 172.21.15.39:0/2097505356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e700cdc50 0x7f7e70155ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:58.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.957+0000 7f7e764d0700 1 -- 172.21.15.39:0/2097505356 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e600094b0 con 0x7f7e7015e190 2023-11-28T11:56:58.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.957+0000 7f7e75ccf700 1 --2- 172.21.15.39:0/2097505356 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e7006ff10 0x7f7e70159010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:56:58.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.957+0000 7f7e764d0700 1 --2- 172.21.15.39:0/2097505356 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e7015e190 0x7f7e7015f750 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7e68014040 tx=0x7f7e68004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:58.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.957+0000 7f7e667fc700 1 -- 172.21.15.39:0/2097505356 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e68012430 con 0x7f7e7015e190 2023-11-28T11:56:58.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.957+0000 7f7e667fc700 1 -- 172.21.15.39:0/2097505356 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e68020070 con 0x7f7e7015e190 2023-11-28T11:56:58.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.957+0000 7f7e76cd1700 1 -- 172.21.15.39:0/2097505356 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e68009a70 con 0x7f7e7015e190 2023-11-28T11:56:58.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.957+0000 7f7e667fc700 1 -- 172.21.15.39:0/2097505356 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e68004280 con 0x7f7e7015e190 2023-11-28T11:56:58.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.957+0000 7f7e76cd1700 1 -- 172.21.15.39:0/2097505356 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e700af990 con 0x7f7e7015e190 2023-11-28T11:56:58.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.957+0000 7f7e76cd1700 1 -- 172.21.15.39:0/2097505356 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e700ce330 con 0x7f7e7015e190 2023-11-28T11:56:58.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.961+0000 7f7e667fc700 1 -- 172.21.15.39:0/2097505356 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7e680043e0 con 0x7f7e7015e190 2023-11-28T11:56:58.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.961+0000 7f7e667fc700 1 --2- 172.21.15.39:0/2097505356 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7e54064ee0 0x7f7e54067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:58.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.961+0000 7f7e667fc700 1 -- 172.21.15.39:0/2097505356 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7e68022070 con 0x7f7e7015e190 2023-11-28T11:56:58.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.961+0000 7f7e75ccf700 1 --2- 172.21.15.39:0/2097505356 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7e54064ee0 0x7f7e54067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:58.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.965+0000 7f7e75ccf700 1 --2- 172.21.15.39:0/2097505356 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7e54064ee0 0x7f7e54067390 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0011e0 tx=0x7f7e6c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:58.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:58.969+0000 7f7e667fc700 1 -- 172.21.15.39:0/2097505356 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7e68052380 con 0x7f7e7015e190 2023-11-28T11:56:59.184 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:59.181+0000 7f7e76cd1700 1 -- 172.21.15.39:0/2097505356 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7e70073230 con 0x7f7e7015e190 2023-11-28T11:56:59.708 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:56:59.716 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:56:59.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:59.733+0000 7f7e667fc700 1 -- 172.21.15.39:0/2097505356 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7e680559a0 con 0x7f7e7015e190 2023-11-28T11:56:59.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:59.737+0000 7f7e76cd1700 1 -- 172.21.15.39:0/2097505356 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7e54064ee0 msgr2=0x7f7e54067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:59.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:59.737+0000 7f7e76cd1700 1 --2- 172.21.15.39:0/2097505356 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7e54064ee0 0x7f7e54067390 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0011e0 tx=0x7f7e6c009040 comp rx=0 tx=0).stop 2023-11-28T11:56:59.744 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:59.737+0000 7f7e76cd1700 1 -- 172.21.15.39:0/2097505356 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e7015e190 msgr2=0x7f7e7015f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:59.744 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:59.737+0000 7f7e76cd1700 1 --2- 172.21.15.39:0/2097505356 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e7015e190 0x7f7e7015f750 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7e68014040 tx=0x7f7e68004af0 comp rx=0 tx=0).stop 2023-11-28T11:56:59.744 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:59.737+0000 7f7e76cd1700 1 -- 172.21.15.39:0/2097505356 shutdown_connections 2023-11-28T11:56:59.744 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:59.737+0000 7f7e76cd1700 1 --2- 172.21.15.39:0/2097505356 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e7015e190 0x7f7e7015f750 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:59.744 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:59.737+0000 7f7e76cd1700 1 --2- 172.21.15.39:0/2097505356 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7e54064ee0 0x7f7e54067390 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:59.744 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:59.737+0000 7f7e76cd1700 1 --2- 172.21.15.39:0/2097505356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e700cdc50 0x7f7e70155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:59.744 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:59.737+0000 7f7e76cd1700 1 --2- 172.21.15.39:0/2097505356 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e7006ff10 0x7f7e70159010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:59.744 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:59.737+0000 7f7e76cd1700 1 -- 172.21.15.39:0/2097505356 >> 172.21.15.39:0/2097505356 conn(0x7f7e700cf280 msgr2=0x7f7e70069bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:59.744 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:59.737+0000 7f7e76cd1700 1 -- 172.21.15.39:0/2097505356 shutdown_connections 2023-11-28T11:56:59.744 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:56:59.737+0000 7f7e76cd1700 1 -- 172.21.15.39:0/2097505356 wait complete. 2023-11-28T11:56:59.765 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T11:56:59.766 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:57:00.018 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.013+0000 7f80a4958700 1 Processor -- start 2023-11-28T11:57:00.018 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.013+0000 7f80a4958700 1 -- start start 2023-11-28T11:57:00.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.017+0000 7f80a4958700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f80a015c1a0 0x7f80a006c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:00.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.017+0000 7f80a4958700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f80a00cdeb0 0x7f80a0070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:00.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.017+0000 7f80a4958700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80a00709d0 con 0x7f80a00705c0 2023-11-28T11:57:00.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.017+0000 7f80a4958700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80a0069bf0 con 0x7f80a00cdeb0 2023-11-28T11:57:00.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.017+0000 7f80a4958700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80a00adf90 con 0x7f80a015c1a0 2023-11-28T11:57:00.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.017+0000 7f809effd700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f80a00cdeb0 0x7f80a0070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:00.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.017+0000 7f809effd700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f80a00cdeb0 0x7f80a0070080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44992/0 (socket says 172.21.15.39:44992) 2023-11-28T11:57:00.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.017+0000 7f809effd700 1 -- 172.21.15.39:0/3537917185 learned_addr learned my addr 172.21.15.39:0/3537917185 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:00.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.017+0000 7f809ffff700 1 --1- 172.21.15.39:0/3537917185 >> v1:172.21.15.39:6789/0 conn(0x7f80a00705c0 0x7f80a015fd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:37858/0 (socket says 172.21.15.39:37858) 2023-11-28T11:57:00.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.017+0000 7f809f7fe700 1 --2- 172.21.15.39:0/3537917185 >> v2:172.21.15.184:3300/0 conn(0x7f80a015c1a0 0x7f80a006c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:00.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.017+0000 7f809effd700 1 -- 172.21.15.39:0/3537917185 >> v2:172.21.15.184:3300/0 conn(0x7f80a015c1a0 msgr2=0x7f80a006c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:00.023 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.017+0000 7f809effd700 1 --2- 172.21.15.39:0/3537917185 >> v2:172.21.15.184:3300/0 conn(0x7f80a015c1a0 0x7f80a006c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:00.023 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.017+0000 7f809effd700 1 -- 172.21.15.39:0/3537917185 >> v1:172.21.15.39:6789/0 conn(0x7f80a00705c0 legacy=0x7f80a015fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:00.023 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.017+0000 7f809effd700 1 -- 172.21.15.39:0/3537917185 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a00ce370 con 0x7f80a00cdeb0 2023-11-28T11:57:00.023 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.017+0000 7f809effd700 1 --2- 172.21.15.39:0/3537917185 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80a00cdeb0 0x7f80a0070080 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f80a0070ef0 tx=0x7f8094009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=103dc2414c41fdbf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:00.023 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.017+0000 7f809e7fc700 1 -- 172.21.15.39:0/3537917185 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809400b8a0 con 0x7f80a00cdeb0 2023-11-28T11:57:00.023 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.017+0000 7f809e7fc700 1 -- 172.21.15.39:0/3537917185 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809400ba00 con 0x7f80a00cdeb0 2023-11-28T11:57:00.024 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.017+0000 7f809e7fc700 1 -- 172.21.15.39:0/3537917185 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809400bd90 con 0x7f80a00cdeb0 2023-11-28T11:57:00.027 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.021+0000 7f80a4958700 1 -- 172.21.15.39:0/3537917185 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80a00cdeb0 msgr2=0x7f80a0070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:00.027 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.021+0000 7f80a4958700 1 --2- 172.21.15.39:0/3537917185 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80a00cdeb0 0x7f80a0070080 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f80a0070ef0 tx=0x7f8094009bf0 comp rx=0 tx=0).stop 2023-11-28T11:57:00.027 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.021+0000 7f80a4958700 1 -- 172.21.15.39:0/3537917185 shutdown_connections 2023-11-28T11:57:00.027 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.021+0000 7f80a4958700 1 --2- 172.21.15.39:0/3537917185 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80a00cdeb0 0x7f80a0070080 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:00.027 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.021+0000 7f80a4958700 1 --2- 172.21.15.39:0/3537917185 >> v2:172.21.15.184:3300/0 conn(0x7f80a015c1a0 0x7f80a006c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:00.027 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.021+0000 7f80a4958700 1 -- 172.21.15.39:0/3537917185 >> 172.21.15.39:0/3537917185 conn(0x7f80a00b0f80 msgr2=0x7f80a00ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:00.027 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.021+0000 7f80a4958700 1 -- 172.21.15.39:0/3537917185 shutdown_connections 2023-11-28T11:57:00.027 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.021+0000 7f80a4958700 1 -- 172.21.15.39:0/3537917185 wait complete. 2023-11-28T11:57:00.028 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.021+0000 7f80a4958700 1 Processor -- start 2023-11-28T11:57:00.028 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.025+0000 7f80a4958700 1 -- start start 2023-11-28T11:57:00.030 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.025+0000 7f80a4958700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80a00705c0 0x7f80a0156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:00.030 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.025+0000 7f80a4958700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80a00cdeb0 0x7f80a00b4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:00.031 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.025+0000 7f80a4958700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80a015c1a0 0x7f80a015a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:00.031 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.025+0000 7f80a4958700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a00c2d20 con 0x7f80a00cdeb0 2023-11-28T11:57:00.031 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.025+0000 7f80a4958700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a01f9210 con 0x7f80a00705c0 2023-11-28T11:57:00.031 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.025+0000 7f80a4958700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a0156680 con 0x7f80a015c1a0 2023-11-28T11:57:00.031 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.025+0000 7f809effd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80a00cdeb0 0x7f80a00b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:00.032 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.025+0000 7f809effd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80a00cdeb0 0x7f80a00b4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44994/0 (socket says 172.21.15.39:44994) 2023-11-28T11:57:00.032 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.025+0000 7f809effd700 1 -- 172.21.15.39:0/867596529 learned_addr learned my addr 172.21.15.39:0/867596529 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:00.032 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.025+0000 7f809f7fe700 1 --2- 172.21.15.39:0/867596529 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80a00705c0 0x7f80a0156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:00.032 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.025+0000 7f809ffff700 1 --2- 172.21.15.39:0/867596529 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80a015c1a0 0x7f80a015a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:00.032 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.025+0000 7f809effd700 1 -- 172.21.15.39:0/867596529 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80a015c1a0 msgr2=0x7f80a015a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:00.032 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.025+0000 7f809effd700 1 --2- 172.21.15.39:0/867596529 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80a015c1a0 0x7f80a015a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:00.032 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.025+0000 7f809effd700 1 -- 172.21.15.39:0/867596529 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80a00705c0 msgr2=0x7f80a0156140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:00.032 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.025+0000 7f809effd700 1 --2- 172.21.15.39:0/867596529 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80a00705c0 0x7f80a0156140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:00.032 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.025+0000 7f809effd700 1 -- 172.21.15.39:0/867596529 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8094009570 con 0x7f80a00cdeb0 2023-11-28T11:57:00.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.029+0000 7f809effd700 1 --2- 172.21.15.39:0/867596529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80a00cdeb0 0x7f80a00b4100 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8094013000 tx=0x7f8094004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:00.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.029+0000 7f8087fff700 1 -- 172.21.15.39:0/867596529 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80940036c0 con 0x7f80a00cdeb0 2023-11-28T11:57:00.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.029+0000 7f8087fff700 1 -- 172.21.15.39:0/867596529 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809401f070 con 0x7f80a00cdeb0 2023-11-28T11:57:00.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.029+0000 7f8087fff700 1 -- 172.21.15.39:0/867596529 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8094003a80 con 0x7f80a00cdeb0 2023-11-28T11:57:00.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.029+0000 7f80a4958700 1 -- 172.21.15.39:0/867596529 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a00cc780 con 0x7f80a00cdeb0 2023-11-28T11:57:00.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.029+0000 7f80a4958700 1 -- 172.21.15.39:0/867596529 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a00cc4a0 con 0x7f80a00cdeb0 2023-11-28T11:57:00.038 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.029+0000 7f80a4958700 1 -- 172.21.15.39:0/867596529 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80a006cdf0 con 0x7f80a00cdeb0 2023-11-28T11:57:00.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.029+0000 7f8087fff700 1 -- 172.21.15.39:0/867596529 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f809402a020 con 0x7f80a00cdeb0 2023-11-28T11:57:00.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.033+0000 7f8087fff700 1 --2- 172.21.15.39:0/867596529 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f808c064ee0 0x7f808c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:00.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.033+0000 7f8087fff700 1 -- 172.21.15.39:0/867596529 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8094083920 con 0x7f80a00cdeb0 2023-11-28T11:57:00.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.033+0000 7f809f7fe700 1 --2- 172.21.15.39:0/867596529 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f808c064ee0 0x7f808c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:00.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.033+0000 7f809f7fe700 1 --2- 172.21.15.39:0/867596529 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f808c064ee0 0x7f808c067390 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8090007a60 tx=0x7f8090008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:00.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.037+0000 7f8087fff700 1 -- 172.21.15.39:0/867596529 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f80940517d0 con 0x7f80a00cdeb0 2023-11-28T11:57:00.252 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.249+0000 7f80a4958700 1 -- 172.21.15.39:0/867596529 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80a0073cb0 con 0x7f80a00cdeb0 2023-11-28T11:57:00.253 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.249+0000 7f8087fff700 1 -- 172.21.15.39:0/867596529 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4647 (secure 0 0 0) 0x7f8094054df0 con 0x7f80a00cdeb0 2023-11-28T11:57:00.254 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:57:00.254 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4265,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1518942402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":1518942402},{"type":"v1","addr":"172.21.15.184:6837","nonce":1518942402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/1834562481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":1834562481},{"type":"v1","addr":"172.21.15.39:6833","nonce":1834562481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2470756838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2470756838},{"type":"v1","addr":"172.21.15.39:6835","nonce":2470756838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:56:39.894634+0000","modified":"2023-11-28T11:56:59.724929+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6835/516507254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":516507254},{"type":"v1","addr":"172.21.15.184:6835","nonce":516507254}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T11:57:00.256 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.249+0000 7f80a4958700 1 -- 172.21.15.39:0/867596529 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f808c064ee0 msgr2=0x7f808c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:00.256 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.249+0000 7f80a4958700 1 --2- 172.21.15.39:0/867596529 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f808c064ee0 0x7f808c067390 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8090007a60 tx=0x7f8090008040 comp rx=0 tx=0).stop 2023-11-28T11:57:00.256 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.253+0000 7f80a4958700 1 -- 172.21.15.39:0/867596529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80a00cdeb0 msgr2=0x7f80a00b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:00.256 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.253+0000 7f80a4958700 1 --2- 172.21.15.39:0/867596529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80a00cdeb0 0x7f80a00b4100 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8094013000 tx=0x7f8094004770 comp rx=0 tx=0).stop 2023-11-28T11:57:00.258 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.253+0000 7f80a4958700 1 -- 172.21.15.39:0/867596529 shutdown_connections 2023-11-28T11:57:00.258 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.253+0000 7f80a4958700 1 --2- 172.21.15.39:0/867596529 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80a015c1a0 0x7f80a015a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:00.258 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.253+0000 7f80a4958700 1 --2- 172.21.15.39:0/867596529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80a00cdeb0 0x7f80a00b4100 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:00.258 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.253+0000 7f80a4958700 1 --2- 172.21.15.39:0/867596529 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f808c064ee0 0x7f808c067390 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:00.258 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.253+0000 7f80a4958700 1 --2- 172.21.15.39:0/867596529 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80a00705c0 0x7f80a0156140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:00.258 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.253+0000 7f80a4958700 1 -- 172.21.15.39:0/867596529 >> 172.21.15.39:0/867596529 conn(0x7f80a00b0f80 msgr2=0x7f80a0159b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:00.259 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.253+0000 7f80a4958700 1 -- 172.21.15.39:0/867596529 shutdown_connections 2023-11-28T11:57:00.259 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.253+0000 7f80a4958700 1 -- 172.21.15.39:0/867596529 wait complete. 2023-11-28T11:57:00.259 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 9 2023-11-28T11:57:00.283 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:57:00.464 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.461+0000 7f872ac66700 1 Processor -- start 2023-11-28T11:57:00.465 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.461+0000 7f872ac66700 1 -- start start 2023-11-28T11:57:00.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.461+0000 7f872ac66700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f872415c640 0x7f87240d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:00.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.461+0000 7f872ac66700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f8724071aa0 0x7f872406d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:00.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.461+0000 7f872ac66700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f872406c600 con 0x7f8724069e00 2023-11-28T11:57:00.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.461+0000 7f872ac66700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f872406cef0 con 0x7f8724071aa0 2023-11-28T11:57:00.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.461+0000 7f872ac66700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87240722f0 con 0x7f872415c640 2023-11-28T11:57:00.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.461+0000 7f8729c64700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f872415c640 0x7f87240d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:00.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.461+0000 7f8729463700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f8724071aa0 0x7f872406d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:00.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.461+0000 7f8729c64700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f872415c640 0x7f87240d31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:42664/0 (socket says 172.21.15.39:42664) 2023-11-28T11:57:00.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.461+0000 7f8729c64700 1 -- 172.21.15.39:0/221557291 learned_addr learned my addr 172.21.15.39:0/221557291 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:00.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.461+0000 7f8729c64700 1 -- 172.21.15.39:0/221557291 >> v2:172.21.15.39:3300/0 conn(0x7f8724071aa0 msgr2=0x7f872406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:00.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.461+0000 7f8729c64700 1 --2- 172.21.15.39:0/221557291 >> v2:172.21.15.39:3300/0 conn(0x7f8724071aa0 0x7f872406d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:00.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.461+0000 7f8729c64700 1 -- 172.21.15.39:0/221557291 >> v1:172.21.15.39:6789/0 conn(0x7f8724069e00 legacy=0x7f87240d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:00.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.461+0000 7f8729c64700 1 -- 172.21.15.39:0/221557291 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872415ca10 con 0x7f872415c640 2023-11-28T11:57:00.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.465+0000 7f8729c64700 1 --2- 172.21.15.39:0/221557291 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f872415c640 0x7f87240d31e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f872406e290 tx=0x7f8720009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=550c131b4345f649 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:00.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.465+0000 7f8728c62700 1 -- 172.21.15.39:0/221557291 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8720011830 con 0x7f872415c640 2023-11-28T11:57:00.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.465+0000 7f8728c62700 1 -- 172.21.15.39:0/221557291 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8720011990 con 0x7f872415c640 2023-11-28T11:57:00.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.465+0000 7f8728c62700 1 -- 172.21.15.39:0/221557291 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8720011d20 con 0x7f872415c640 2023-11-28T11:57:00.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.465+0000 7f872ac66700 1 -- 172.21.15.39:0/221557291 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f872415c640 msgr2=0x7f87240d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:00.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.465+0000 7f872ac66700 1 --2- 172.21.15.39:0/221557291 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f872415c640 0x7f87240d31e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f872406e290 tx=0x7f8720009bf0 comp rx=0 tx=0).stop 2023-11-28T11:57:00.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.465+0000 7f872ac66700 1 -- 172.21.15.39:0/221557291 shutdown_connections 2023-11-28T11:57:00.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.465+0000 7f872ac66700 1 --2- 172.21.15.39:0/221557291 >> v2:172.21.15.39:3300/0 conn(0x7f8724071aa0 0x7f872406d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:00.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.465+0000 7f872ac66700 1 --2- 172.21.15.39:0/221557291 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f872415c640 0x7f87240d31e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:00.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.465+0000 7f872ac66700 1 -- 172.21.15.39:0/221557291 >> 172.21.15.39:0/221557291 conn(0x7f87240b6520 msgr2=0x7f8724071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:00.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.465+0000 7f872ac66700 1 -- 172.21.15.39:0/221557291 shutdown_connections 2023-11-28T11:57:00.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.465+0000 7f872ac66700 1 -- 172.21.15.39:0/221557291 wait complete. 2023-11-28T11:57:00.473 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.469+0000 7f872ac66700 1 Processor -- start 2023-11-28T11:57:00.473 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.469+0000 7f872ac66700 1 -- start start 2023-11-28T11:57:00.474 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.469+0000 7f872ac66700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8724069e00 0x7f87240cc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:00.474 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.469+0000 7f872ac66700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8724071aa0 0x7f87240cad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:00.475 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.469+0000 7f872ac66700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f872415c640 0x7f87240b0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:00.475 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.469+0000 7f872ac66700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87240cb560 con 0x7f8724071aa0 2023-11-28T11:57:00.475 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.469+0000 7f872ac66700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87240cb840 con 0x7f8724069e00 2023-11-28T11:57:00.475 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.469+0000 7f872ac66700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87240cbb20 con 0x7f872415c640 2023-11-28T11:57:00.476 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.469+0000 7f8729463700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8724071aa0 0x7f87240cad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:00.476 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.469+0000 7f8729463700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8724071aa0 0x7f87240cad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45016/0 (socket says 172.21.15.39:45016) 2023-11-28T11:57:00.476 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.469+0000 7f8729463700 1 -- 172.21.15.39:0/4212238668 learned_addr learned my addr 172.21.15.39:0/4212238668 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:00.476 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.469+0000 7f8729c64700 1 --2- 172.21.15.39:0/4212238668 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8724069e00 0x7f87240cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:00.476 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.469+0000 7f872a465700 1 --2- 172.21.15.39:0/4212238668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f872415c640 0x7f87240b0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:00.476 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.469+0000 7f8729463700 1 -- 172.21.15.39:0/4212238668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f872415c640 msgr2=0x7f87240b0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:00.476 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.469+0000 7f8729463700 1 --2- 172.21.15.39:0/4212238668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f872415c640 0x7f87240b0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:00.476 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.469+0000 7f8729463700 1 -- 172.21.15.39:0/4212238668 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8724069e00 msgr2=0x7f87240cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:00.476 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.469+0000 7f8729463700 1 --2- 172.21.15.39:0/4212238668 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8724069e00 0x7f87240cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:00.477 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.469+0000 7f8729463700 1 -- 172.21.15.39:0/4212238668 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8720009570 con 0x7f8724071aa0 2023-11-28T11:57:00.477 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.473+0000 7f8729463700 1 --2- 172.21.15.39:0/4212238668 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8724071aa0 0x7f87240cad30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f871400e9d0 tx=0x7f871400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:00.477 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.473+0000 7f871a7fc700 1 -- 172.21.15.39:0/4212238668 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8714009720 con 0x7f8724071aa0 2023-11-28T11:57:00.477 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.473+0000 7f871a7fc700 1 -- 172.21.15.39:0/4212238668 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871400c850 con 0x7f8724071aa0 2023-11-28T11:57:00.477 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.473+0000 7f871a7fc700 1 -- 172.21.15.39:0/4212238668 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871400cbc0 con 0x7f8724071aa0 2023-11-28T11:57:00.478 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.473+0000 7f872ac66700 1 -- 172.21.15.39:0/4212238668 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f872406c830 con 0x7f8724071aa0 2023-11-28T11:57:00.478 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.473+0000 7f872ac66700 1 -- 172.21.15.39:0/4212238668 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8724072010 con 0x7f8724071aa0 2023-11-28T11:57:00.478 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.473+0000 7f872ac66700 1 -- 172.21.15.39:0/4212238668 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f872406cb10 con 0x7f8724071aa0 2023-11-28T11:57:00.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.473+0000 7f871a7fc700 1 -- 172.21.15.39:0/4212238668 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8714019030 con 0x7f8724071aa0 2023-11-28T11:57:00.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.477+0000 7f871a7fc700 1 --2- 172.21.15.39:0/4212238668 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8708064ee0 0x7f8708067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:00.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.477+0000 7f871a7fc700 1 -- 172.21.15.39:0/4212238668 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8714082140 con 0x7f8724071aa0 2023-11-28T11:57:00.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.477+0000 7f8729c64700 1 --2- 172.21.15.39:0/4212238668 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8708064ee0 0x7f8708067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:00.483 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.477+0000 7f8729c64700 1 --2- 172.21.15.39:0/4212238668 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8708064ee0 0x7f8708067390 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8720000c00 tx=0x7f8720008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:00.487 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.481+0000 7f871a7fc700 1 -- 172.21.15.39:0/4212238668 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f871404fff0 con 0x7f8724071aa0 2023-11-28T11:57:00.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.657+0000 7f872ac66700 1 -- 172.21.15.39:0/4212238668 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8724073cb0 con 0x7f8724071aa0 2023-11-28T11:57:00.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.661+0000 7f871a7fc700 1 -- 172.21.15.39:0/4212238668 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+19652 (secure 0 0 0) 0x7f8714053610 con 0x7f8724071aa0 2023-11-28T11:57:00.666 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:57:00.666 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":29,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:56:44.439368+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:56:38.203736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:56:38.946498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:56:41.988334+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:57:00.668 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.665+0000 7f872ac66700 1 -- 172.21.15.39:0/4212238668 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8708064ee0 msgr2=0x7f8708067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:00.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.665+0000 7f872ac66700 1 --2- 172.21.15.39:0/4212238668 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8708064ee0 0x7f8708067390 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8720000c00 tx=0x7f8720008030 comp rx=0 tx=0).stop 2023-11-28T11:57:00.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.665+0000 7f872ac66700 1 -- 172.21.15.39:0/4212238668 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8724071aa0 msgr2=0x7f87240cad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:00.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.665+0000 7f872ac66700 1 --2- 172.21.15.39:0/4212238668 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8724071aa0 0x7f87240cad30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f871400e9d0 tx=0x7f871400ece0 comp rx=0 tx=0).stop 2023-11-28T11:57:00.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.665+0000 7f872ac66700 1 -- 172.21.15.39:0/4212238668 shutdown_connections 2023-11-28T11:57:00.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.665+0000 7f872ac66700 1 --2- 172.21.15.39:0/4212238668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f872415c640 0x7f87240b0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:00.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.665+0000 7f872ac66700 1 --2- 172.21.15.39:0/4212238668 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8724071aa0 0x7f87240cad30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:00.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.665+0000 7f872ac66700 1 --2- 172.21.15.39:0/4212238668 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8708064ee0 0x7f8708067390 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:00.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.665+0000 7f872ac66700 1 --2- 172.21.15.39:0/4212238668 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8724069e00 0x7f87240cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:00.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.665+0000 7f872ac66700 1 -- 172.21.15.39:0/4212238668 >> 172.21.15.39:0/4212238668 conn(0x7f87240b6520 msgr2=0x7f872406d310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:00.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.665+0000 7f872ac66700 1 -- 172.21.15.39:0/4212238668 shutdown_connections 2023-11-28T11:57:00.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.665+0000 7f872ac66700 1 -- 172.21.15.39:0/4212238668 wait complete. 2023-11-28T11:57:00.690 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T11:57:00.690 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:57:00.873 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.869+0000 7ffadd5dc700 1 Processor -- start 2023-11-28T11:57:00.873 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.869+0000 7ffadd5dc700 1 -- start start 2023-11-28T11:57:00.878 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.869+0000 7ffadd5dc700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ffad80b43a0 0x7ffad815e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:00.878 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.869+0000 7ffadd5dc700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ffad80b1640 0x7ffad8070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:00.878 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.869+0000 7ffadd5dc700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffad815a550 con 0x7ffad80c9040 2023-11-28T11:57:00.878 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.869+0000 7ffadd5dc700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffad806b0a0 con 0x7ffad80b1640 2023-11-28T11:57:00.878 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.869+0000 7ffadd5dc700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffad80caac0 con 0x7ffad80b43a0 2023-11-28T11:57:00.878 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.873+0000 7ffadcddb700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7ffad80c9040 0x7ffad8069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:37876/0 (socket says 172.21.15.39:37876) 2023-11-28T11:57:00.878 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.873+0000 7ffadcddb700 1 -- 172.21.15.39:0/3310382848 learned_addr learned my addr 172.21.15.39:0/3310382848 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:00.878 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.873+0000 7ffacf7fe700 1 --2- 172.21.15.39:0/3310382848 >> v2:172.21.15.39:3300/0 conn(0x7ffad80b1640 0x7ffad8070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:00.878 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.873+0000 7ffad7fff700 1 --2- 172.21.15.39:0/3310382848 >> v2:172.21.15.184:3300/0 conn(0x7ffad80b43a0 0x7ffad815e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:00.878 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.873+0000 7ffad77fe700 1 -- 172.21.15.39:0/3310382848 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3447411756 0 0) 0x7ffad0001490 con 0x7ffad80c9040 2023-11-28T11:57:00.879 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.873+0000 7ffad77fe700 1 -- 172.21.15.39:0/3310382848 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffac40035d0 con 0x7ffad80c9040 2023-11-28T11:57:00.879 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.873+0000 7ffacf7fe700 1 -- 172.21.15.39:0/3310382848 >> v2:172.21.15.184:3300/0 conn(0x7ffad80b43a0 msgr2=0x7ffad815e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:00.879 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.873+0000 7ffacf7fe700 1 --2- 172.21.15.39:0/3310382848 >> v2:172.21.15.184:3300/0 conn(0x7ffad80b43a0 0x7ffad815e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:00.879 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.873+0000 7ffacf7fe700 1 -- 172.21.15.39:0/3310382848 >> v1:172.21.15.39:6789/0 conn(0x7ffad80c9040 legacy=0x7ffad8069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:00.879 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.873+0000 7ffacf7fe700 1 -- 172.21.15.39:0/3310382848 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad80cada0 con 0x7ffad80b1640 2023-11-28T11:57:00.880 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.873+0000 7ffacf7fe700 1 --2- 172.21.15.39:0/3310382848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffad80b1640 0x7ffad8070080 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ffad806fe80 tx=0x7ffac0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee1679c252f2532 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:00.880 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.873+0000 7ffad77fe700 1 -- 172.21.15.39:0/3310382848 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac0011830 con 0x7ffad80b1640 2023-11-28T11:57:00.880 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.873+0000 7ffad77fe700 1 -- 172.21.15.39:0/3310382848 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac0011990 con 0x7ffad80b1640 2023-11-28T11:57:00.880 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.873+0000 7ffad77fe700 1 -- 172.21.15.39:0/3310382848 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac0011d00 con 0x7ffad80b1640 2023-11-28T11:57:00.880 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.873+0000 7ffadd5dc700 1 -- 172.21.15.39:0/3310382848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffad80b1640 msgr2=0x7ffad8070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:00.880 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.873+0000 7ffadd5dc700 1 --2- 172.21.15.39:0/3310382848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffad80b1640 0x7ffad8070080 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ffad806fe80 tx=0x7ffac0009b30 comp rx=0 tx=0).stop 2023-11-28T11:57:00.880 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.877+0000 7ffadd5dc700 1 -- 172.21.15.39:0/3310382848 shutdown_connections 2023-11-28T11:57:00.880 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.877+0000 7ffadd5dc700 1 --2- 172.21.15.39:0/3310382848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffad80b1640 0x7ffad8070080 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:00.880 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.877+0000 7ffadd5dc700 1 --2- 172.21.15.39:0/3310382848 >> v2:172.21.15.184:3300/0 conn(0x7ffad80b43a0 0x7ffad815e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:00.880 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.877+0000 7ffadd5dc700 1 -- 172.21.15.39:0/3310382848 >> 172.21.15.39:0/3310382848 conn(0x7ffad80b0f80 msgr2=0x7ffad80ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:00.881 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.877+0000 7ffadd5dc700 1 -- 172.21.15.39:0/3310382848 shutdown_connections 2023-11-28T11:57:00.881 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.877+0000 7ffadd5dc700 1 -- 172.21.15.39:0/3310382848 wait complete. 2023-11-28T11:57:00.883 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.877+0000 7ffadd5dc700 1 Processor -- start 2023-11-28T11:57:00.884 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.881+0000 7ffadd5dc700 1 -- start start 2023-11-28T11:57:00.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.881+0000 7ffadd5dc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffad80b1640 0x7ffad80c6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:00.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.881+0000 7ffadd5dc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffad80b43a0 0x7ffad80c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:00.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.881+0000 7ffadd5dc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffad80c9040 0x7ffad81f51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:00.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.881+0000 7ffadd5dc700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad815c9a0 con 0x7ffad80b43a0 2023-11-28T11:57:00.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.881+0000 7ffadd5dc700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad815cc80 con 0x7ffad80c9040 2023-11-28T11:57:00.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.881+0000 7ffadd5dc700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad815cf60 con 0x7ffad80b1640 2023-11-28T11:57:00.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.881+0000 7ffacf7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffad80b43a0 0x7ffad80c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:00.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.881+0000 7ffacf7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffad80b43a0 0x7ffad80c7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45036/0 (socket says 172.21.15.39:45036) 2023-11-28T11:57:00.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.881+0000 7ffacf7fe700 1 -- 172.21.15.39:0/530101131 learned_addr learned my addr 172.21.15.39:0/530101131 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:00.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.881+0000 7ffadcddb700 1 --2- 172.21.15.39:0/530101131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffad80c9040 0x7ffad81f51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:00.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.881+0000 7ffad7fff700 1 --2- 172.21.15.39:0/530101131 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffad80b1640 0x7ffad80c6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:00.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.881+0000 7ffacf7fe700 1 -- 172.21.15.39:0/530101131 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffad80b1640 msgr2=0x7ffad80c6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:00.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.881+0000 7ffacf7fe700 1 --2- 172.21.15.39:0/530101131 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffad80b1640 0x7ffad80c6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:00.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.881+0000 7ffacf7fe700 1 -- 172.21.15.39:0/530101131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffad80c9040 msgr2=0x7ffad81f51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:00.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.881+0000 7ffacf7fe700 1 --2- 172.21.15.39:0/530101131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffad80c9040 0x7ffad81f51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:00.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.881+0000 7ffacf7fe700 1 -- 172.21.15.39:0/530101131 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac00094b0 con 0x7ffad80b43a0 2023-11-28T11:57:00.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.885+0000 7ffacf7fe700 1 --2- 172.21.15.39:0/530101131 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffad80b43a0 0x7ffad80c7f20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ffac0014040 tx=0x7ffac0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:00.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.885+0000 7ffad57fa700 1 -- 172.21.15.39:0/530101131 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac0004510 con 0x7ffad80b43a0 2023-11-28T11:57:00.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.885+0000 7ffad57fa700 1 -- 172.21.15.39:0/530101131 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac001e070 con 0x7ffad80b43a0 2023-11-28T11:57:00.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.885+0000 7ffadd5dc700 1 -- 172.21.15.39:0/530101131 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffad806b5d0 con 0x7ffad80b43a0 2023-11-28T11:57:00.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.885+0000 7ffad57fa700 1 -- 172.21.15.39:0/530101131 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac00038c0 con 0x7ffad80b43a0 2023-11-28T11:57:00.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.885+0000 7ffadd5dc700 1 -- 172.21.15.39:0/530101131 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad806b2f0 con 0x7ffad80b43a0 2023-11-28T11:57:00.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.885+0000 7ffadd5dc700 1 -- 172.21.15.39:0/530101131 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffad815eb10 con 0x7ffad80b43a0 2023-11-28T11:57:00.893 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.889+0000 7ffad57fa700 1 -- 172.21.15.39:0/530101131 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ffac000f050 con 0x7ffad80b43a0 2023-11-28T11:57:00.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.889+0000 7ffad57fa700 1 --2- 172.21.15.39:0/530101131 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ffab8064ee0 0x7ffab8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:00.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.889+0000 7ffad57fa700 1 -- 172.21.15.39:0/530101131 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ffac0083090 con 0x7ffad80b43a0 2023-11-28T11:57:00.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.889+0000 7ffad7fff700 1 --2- 172.21.15.39:0/530101131 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ffab8064ee0 0x7ffab8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:00.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.893+0000 7ffad7fff700 1 --2- 172.21.15.39:0/530101131 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ffab8064ee0 0x7ffab8067390 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ffad80adda0 tx=0x7ffac8009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:00.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:00.897+0000 7ffad57fa700 1 -- 172.21.15.39:0/530101131 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ffac0050f40 con 0x7ffad80b43a0 2023-11-28T11:57:01.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.073+0000 7ffadd5dc700 1 -- 172.21.15.39:0/530101131 --> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffad815d0d0 con 0x7ffab8064ee0 2023-11-28T11:57:01.096 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.093+0000 7ffad57fa700 1 -- 172.21.15.39:0/530101131 <== mgr.4104 v2:172.21.15.184:6832/36166 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367140 (secure 0 0 0) 0x7ffad815d0d0 con 0x7ffab8064ee0 2023-11-28T11:57:01.103 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:57:01.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.101+0000 7ffadd5dc700 1 -- 172.21.15.39:0/530101131 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ffab8064ee0 msgr2=0x7ffab8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:01.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.101+0000 7ffadd5dc700 1 --2- 172.21.15.39:0/530101131 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ffab8064ee0 0x7ffab8067390 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ffad80adda0 tx=0x7ffac8009240 comp rx=0 tx=0).stop 2023-11-28T11:57:01.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.101+0000 7ffadd5dc700 1 -- 172.21.15.39:0/530101131 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffad80b43a0 msgr2=0x7ffad80c7f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:01.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.101+0000 7ffadd5dc700 1 --2- 172.21.15.39:0/530101131 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffad80b43a0 0x7ffad80c7f20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ffac0014040 tx=0x7ffac0004770 comp rx=0 tx=0).stop 2023-11-28T11:57:01.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.101+0000 7ffadd5dc700 1 -- 172.21.15.39:0/530101131 shutdown_connections 2023-11-28T11:57:01.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.101+0000 7ffadd5dc700 1 --2- 172.21.15.39:0/530101131 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ffab8064ee0 0x7ffab8067390 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:01.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.101+0000 7ffadd5dc700 1 --2- 172.21.15.39:0/530101131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffad80c9040 0x7ffad81f51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:01.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.101+0000 7ffadd5dc700 1 --2- 172.21.15.39:0/530101131 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffad80b43a0 0x7ffad80c7f20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:01.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.101+0000 7ffadd5dc700 1 --2- 172.21.15.39:0/530101131 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffad80b1640 0x7ffad80c6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:01.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.101+0000 7ffadd5dc700 1 -- 172.21.15.39:0/530101131 >> 172.21.15.39:0/530101131 conn(0x7ffad80b0f80 msgr2=0x7ffad80aef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:01.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.101+0000 7ffadd5dc700 1 -- 172.21.15.39:0/530101131 shutdown_connections 2023-11-28T11:57:01.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.101+0000 7ffadd5dc700 1 -- 172.21.15.39:0/530101131 wait complete. 2023-11-28T11:57:01.109 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2023-11-28T11:57:01.128 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2023-11-28T11:57:00.552671+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594754,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67684,"kb_used_data":3620,"kb_used_omap":0,"kb_used_meta":64000,"kb_avail":754907036,"statfs":{"total":773094113280,"available":773024804864,"internally_reserved":0,"allocated":3706880,"data_stored":2193365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65536000},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2056,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005572"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.571140+0000","last_change":"2023-11-28T11:56:43.976015+0000","last_active":"2023-11-28T11:56:44.571140+0000","last_peered":"2023-11-28T11:56:44.571140+0000","last_clean":"2023-11-28T11:56:44.571140+0000","last_became_active":"2023-11-28T11:56:43.975574+0000","last_became_peered":"2023-11-28T11:56:43.975574+0000","last_unstale":"2023-11-28T11:56:44.571140+0000","last_undegraded":"2023-11-28T11:56:44.571140+0000","last_fullsized":"2023-11-28T11:56:44.571140+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:41:50.763478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"24'4","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.992613+0000","last_change":"2023-11-28T11:56:39.473674+0000","last_active":"2023-11-28T11:56:43.992613+0000","last_peered":"2023-11-28T11:56:43.992613+0000","last_clean":"2023-11-28T11:56:43.992613+0000","last_became_active":"2023-11-28T11:56:39.473370+0000","last_became_peered":"2023-11-28T11:56:39.473370+0000","last_unstale":"2023-11-28T11:56:43.992613+0000","last_undegraded":"2023-11-28T11:56:43.992613+0000","last_fullsized":"2023-11-28T11:56:43.992613+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:10:58.488198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.959383+0000","last_change":"2023-11-28T11:56:39.939184+0000","last_active":"2023-11-28T11:56:43.959383+0000","last_peered":"2023-11-28T11:56:43.959383+0000","last_clean":"2023-11-28T11:56:43.959383+0000","last_became_active":"2023-11-28T11:56:39.938917+0000","last_became_peered":"2023-11-28T11:56:39.938917+0000","last_unstale":"2023-11-28T11:56:43.959383+0000","last_undegraded":"2023-11-28T11:56:43.959383+0000","last_fullsized":"2023-11-28T11:56:43.959383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:15:38.977863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.452044+0000","last_change":"2023-11-28T11:56:43.982000+0000","last_active":"2023-11-28T11:56:44.452044+0000","last_peered":"2023-11-28T11:56:44.452044+0000","last_clean":"2023-11-28T11:56:44.452044+0000","last_became_active":"2023-11-28T11:56:43.981537+0000","last_became_peered":"2023-11-28T11:56:43.981537+0000","last_unstale":"2023-11-28T11:56:44.452044+0000","last_undegraded":"2023-11-28T11:56:44.452044+0000","last_fullsized":"2023-11-28T11:56:44.452044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:13:42.258047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"24'1","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.962647+0000","last_change":"2023-11-28T11:56:39.451094+0000","last_active":"2023-11-28T11:56:43.962647+0000","last_peered":"2023-11-28T11:56:43.962647+0000","last_clean":"2023-11-28T11:56:43.962647+0000","last_became_active":"2023-11-28T11:56:39.450680+0000","last_became_peered":"2023-11-28T11:56:39.450680+0000","last_unstale":"2023-11-28T11:56:43.962647+0000","last_undegraded":"2023-11-28T11:56:43.962647+0000","last_fullsized":"2023-11-28T11:56:43.962647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:35:56.115422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952725+0000","last_change":"2023-11-28T11:56:39.938474+0000","last_active":"2023-11-28T11:56:43.952725+0000","last_peered":"2023-11-28T11:56:43.952725+0000","last_clean":"2023-11-28T11:56:43.952725+0000","last_became_active":"2023-11-28T11:56:39.938090+0000","last_became_peered":"2023-11-28T11:56:39.938090+0000","last_unstale":"2023-11-28T11:56:43.952725+0000","last_undegraded":"2023-11-28T11:56:43.952725+0000","last_fullsized":"2023-11-28T11:56:43.952725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:13:17.325195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.570857+0000","last_change":"2023-11-28T11:56:43.992668+0000","last_active":"2023-11-28T11:56:44.570857+0000","last_peered":"2023-11-28T11:56:44.570857+0000","last_clean":"2023-11-28T11:56:44.570857+0000","last_became_active":"2023-11-28T11:56:43.991547+0000","last_became_peered":"2023-11-28T11:56:43.991547+0000","last_unstale":"2023-11-28T11:56:44.570857+0000","last_undegraded":"2023-11-28T11:56:44.570857+0000","last_fullsized":"2023-11-28T11:56:44.570857+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:20:35.086687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"24'2","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.966791+0000","last_change":"2023-11-28T11:56:39.464222+0000","last_active":"2023-11-28T11:56:43.966791+0000","last_peered":"2023-11-28T11:56:43.966791+0000","last_clean":"2023-11-28T11:56:43.966791+0000","last_became_active":"2023-11-28T11:56:39.463797+0000","last_became_peered":"2023-11-28T11:56:39.463797+0000","last_unstale":"2023-11-28T11:56:43.966791+0000","last_undegraded":"2023-11-28T11:56:43.966791+0000","last_fullsized":"2023-11-28T11:56:43.966791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:52:48.600084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.959592+0000","last_change":"2023-11-28T11:56:39.932813+0000","last_active":"2023-11-28T11:56:43.959592+0000","last_peered":"2023-11-28T11:56:43.959592+0000","last_clean":"2023-11-28T11:56:43.959592+0000","last_became_active":"2023-11-28T11:56:39.928772+0000","last_became_peered":"2023-11-28T11:56:39.928772+0000","last_unstale":"2023-11-28T11:56:43.959592+0000","last_undegraded":"2023-11-28T11:56:43.959592+0000","last_fullsized":"2023-11-28T11:56:43.959592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:10:06.958523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.572062+0000","last_change":"2023-11-28T11:56:43.979370+0000","last_active":"2023-11-28T11:56:44.572062+0000","last_peered":"2023-11-28T11:56:44.572062+0000","last_clean":"2023-11-28T11:56:44.572062+0000","last_became_active":"2023-11-28T11:56:43.978938+0000","last_became_peered":"2023-11-28T11:56:43.978938+0000","last_unstale":"2023-11-28T11:56:44.572062+0000","last_undegraded":"2023-11-28T11:56:44.572062+0000","last_fullsized":"2023-11-28T11:56:44.572062+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:03:18.915760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.963646+0000","last_change":"2023-11-28T11:56:39.468476+0000","last_active":"2023-11-28T11:56:43.963646+0000","last_peered":"2023-11-28T11:56:43.963646+0000","last_clean":"2023-11-28T11:56:43.963646+0000","last_became_active":"2023-11-28T11:56:39.468201+0000","last_became_peered":"2023-11-28T11:56:39.468201+0000","last_unstale":"2023-11-28T11:56:43.963646+0000","last_undegraded":"2023-11-28T11:56:43.963646+0000","last_fullsized":"2023-11-28T11:56:43.963646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:30:31.377988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.959975+0000","last_change":"2023-11-28T11:56:39.928619+0000","last_active":"2023-11-28T11:56:43.959975+0000","last_peered":"2023-11-28T11:56:43.959975+0000","last_clean":"2023-11-28T11:56:43.959975+0000","last_became_active":"2023-11-28T11:56:39.928248+0000","last_became_peered":"2023-11-28T11:56:39.928248+0000","last_unstale":"2023-11-28T11:56:43.959975+0000","last_undegraded":"2023-11-28T11:56:43.959975+0000","last_fullsized":"2023-11-28T11:56:43.959975+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:24:26.563114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.574561+0000","last_change":"2023-11-28T11:56:43.998827+0000","last_active":"2023-11-28T11:56:44.574561+0000","last_peered":"2023-11-28T11:56:44.574561+0000","last_clean":"2023-11-28T11:56:44.574561+0000","last_became_active":"2023-11-28T11:56:43.998452+0000","last_became_peered":"2023-11-28T11:56:43.998452+0000","last_unstale":"2023-11-28T11:56:44.574561+0000","last_undegraded":"2023-11-28T11:56:44.574561+0000","last_fullsized":"2023-11-28T11:56:44.574561+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:34:39.710811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"24'1","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960780+0000","last_change":"2023-11-28T11:56:39.468234+0000","last_active":"2023-11-28T11:56:43.960780+0000","last_peered":"2023-11-28T11:56:43.960780+0000","last_clean":"2023-11-28T11:56:43.960780+0000","last_became_active":"2023-11-28T11:56:39.467925+0000","last_became_peered":"2023-11-28T11:56:39.467925+0000","last_unstale":"2023-11-28T11:56:43.960780+0000","last_undegraded":"2023-11-28T11:56:43.960780+0000","last_fullsized":"2023-11-28T11:56:43.960780+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:55:31.090691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.964769+0000","last_change":"2023-11-28T11:56:39.949606+0000","last_active":"2023-11-28T11:56:43.964769+0000","last_peered":"2023-11-28T11:56:43.964769+0000","last_clean":"2023-11-28T11:56:43.964769+0000","last_became_active":"2023-11-28T11:56:39.949364+0000","last_became_peered":"2023-11-28T11:56:39.949364+0000","last_unstale":"2023-11-28T11:56:43.964769+0000","last_undegraded":"2023-11-28T11:56:43.964769+0000","last_fullsized":"2023-11-28T11:56:43.964769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:02:46.928803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.453070+0000","last_change":"2023-11-28T11:56:43.992539+0000","last_active":"2023-11-28T11:56:44.453070+0000","last_peered":"2023-11-28T11:56:44.453070+0000","last_clean":"2023-11-28T11:56:44.453070+0000","last_became_active":"2023-11-28T11:56:43.992153+0000","last_became_peered":"2023-11-28T11:56:43.992153+0000","last_unstale":"2023-11-28T11:56:44.453070+0000","last_undegraded":"2023-11-28T11:56:44.453070+0000","last_fullsized":"2023-11-28T11:56:44.453070+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:33:16.305779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.959859+0000","last_change":"2023-11-28T11:56:39.470430+0000","last_active":"2023-11-28T11:56:43.959859+0000","last_peered":"2023-11-28T11:56:43.959859+0000","last_clean":"2023-11-28T11:56:43.959859+0000","last_became_active":"2023-11-28T11:56:39.470148+0000","last_became_peered":"2023-11-28T11:56:39.470148+0000","last_unstale":"2023-11-28T11:56:43.959859+0000","last_undegraded":"2023-11-28T11:56:43.959859+0000","last_fullsized":"2023-11-28T11:56:43.959859+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:26:50.340796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.958145+0000","last_change":"2023-11-28T11:56:39.951730+0000","last_active":"2023-11-28T11:56:43.958145+0000","last_peered":"2023-11-28T11:56:43.958145+0000","last_clean":"2023-11-28T11:56:43.958145+0000","last_became_active":"2023-11-28T11:56:39.951434+0000","last_became_peered":"2023-11-28T11:56:39.951434+0000","last_unstale":"2023-11-28T11:56:43.958145+0000","last_undegraded":"2023-11-28T11:56:43.958145+0000","last_fullsized":"2023-11-28T11:56:43.958145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:15:38.977863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.452332+0000","last_change":"2023-11-28T11:56:43.970823+0000","last_active":"2023-11-28T11:56:44.452332+0000","last_peered":"2023-11-28T11:56:44.452332+0000","last_clean":"2023-11-28T11:56:44.452332+0000","last_became_active":"2023-11-28T11:56:43.970344+0000","last_became_peered":"2023-11-28T11:56:43.970344+0000","last_unstale":"2023-11-28T11:56:44.452332+0000","last_undegraded":"2023-11-28T11:56:44.452332+0000","last_fullsized":"2023-11-28T11:56:44.452332+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:10:38.878879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.965575+0000","last_change":"2023-11-28T11:56:39.469964+0000","last_active":"2023-11-28T11:56:43.965575+0000","last_peered":"2023-11-28T11:56:43.965575+0000","last_clean":"2023-11-28T11:56:43.965575+0000","last_became_active":"2023-11-28T11:56:39.469642+0000","last_became_peered":"2023-11-28T11:56:39.469642+0000","last_unstale":"2023-11-28T11:56:43.965575+0000","last_undegraded":"2023-11-28T11:56:43.965575+0000","last_fullsized":"2023-11-28T11:56:43.965575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:52:05.494184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.973209+0000","last_change":"2023-11-28T11:56:39.935588+0000","last_active":"2023-11-28T11:56:43.973209+0000","last_peered":"2023-11-28T11:56:43.973209+0000","last_clean":"2023-11-28T11:56:43.973209+0000","last_became_active":"2023-11-28T11:56:39.935271+0000","last_became_peered":"2023-11-28T11:56:39.935271+0000","last_unstale":"2023-11-28T11:56:43.973209+0000","last_undegraded":"2023-11-28T11:56:43.973209+0000","last_fullsized":"2023-11-28T11:56:43.973209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:58:24.629436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.458194+0000","last_change":"2023-11-28T11:56:43.990219+0000","last_active":"2023-11-28T11:56:44.458194+0000","last_peered":"2023-11-28T11:56:44.458194+0000","last_clean":"2023-11-28T11:56:44.458194+0000","last_became_active":"2023-11-28T11:56:43.981571+0000","last_became_peered":"2023-11-28T11:56:43.981571+0000","last_unstale":"2023-11-28T11:56:44.458194+0000","last_undegraded":"2023-11-28T11:56:44.458194+0000","last_fullsized":"2023-11-28T11:56:44.458194+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:46:26.561526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952505+0000","last_change":"2023-11-28T11:56:39.464266+0000","last_active":"2023-11-28T11:56:43.952505+0000","last_peered":"2023-11-28T11:56:43.952505+0000","last_clean":"2023-11-28T11:56:43.952505+0000","last_became_active":"2023-11-28T11:56:39.463801+0000","last_became_peered":"2023-11-28T11:56:39.463801+0000","last_unstale":"2023-11-28T11:56:43.952505+0000","last_undegraded":"2023-11-28T11:56:43.952505+0000","last_fullsized":"2023-11-28T11:56:43.952505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:49:49.321158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.956171+0000","last_change":"2023-11-28T11:56:39.951261+0000","last_active":"2023-11-28T11:56:43.956171+0000","last_peered":"2023-11-28T11:56:43.956171+0000","last_clean":"2023-11-28T11:56:43.956171+0000","last_became_active":"2023-11-28T11:56:39.950979+0000","last_became_peered":"2023-11-28T11:56:39.950979+0000","last_unstale":"2023-11-28T11:56:43.956171+0000","last_undegraded":"2023-11-28T11:56:43.956171+0000","last_fullsized":"2023-11-28T11:56:43.956171+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:57:45.608044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952252+0000","last_change":"2023-11-28T11:56:39.944382+0000","last_active":"2023-11-28T11:56:43.952252+0000","last_peered":"2023-11-28T11:56:43.952252+0000","last_clean":"2023-11-28T11:56:43.952252+0000","last_became_active":"2023-11-28T11:56:39.944076+0000","last_became_peered":"2023-11-28T11:56:39.944076+0000","last_unstale":"2023-11-28T11:56:43.952252+0000","last_undegraded":"2023-11-28T11:56:43.952252+0000","last_fullsized":"2023-11-28T11:56:43.952252+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:39:50.872604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.992745+0000","last_change":"2023-11-28T11:56:39.473681+0000","last_active":"2023-11-28T11:56:43.992745+0000","last_peered":"2023-11-28T11:56:43.992745+0000","last_clean":"2023-11-28T11:56:43.992745+0000","last_became_active":"2023-11-28T11:56:39.473403+0000","last_became_peered":"2023-11-28T11:56:39.473403+0000","last_unstale":"2023-11-28T11:56:43.992745+0000","last_undegraded":"2023-11-28T11:56:43.992745+0000","last_fullsized":"2023-11-28T11:56:43.992745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:37:08.555596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.453581+0000","last_change":"2023-11-28T11:56:43.973549+0000","last_active":"2023-11-28T11:56:44.453581+0000","last_peered":"2023-11-28T11:56:44.453581+0000","last_clean":"2023-11-28T11:56:44.453581+0000","last_became_active":"2023-11-28T11:56:43.968940+0000","last_became_peered":"2023-11-28T11:56:43.968940+0000","last_unstale":"2023-11-28T11:56:44.453581+0000","last_undegraded":"2023-11-28T11:56:44.453581+0000","last_fullsized":"2023-11-28T11:56:44.453581+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:14:02.695573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952607+0000","last_change":"2023-11-28T11:56:39.937083+0000","last_active":"2023-11-28T11:56:43.952607+0000","last_peered":"2023-11-28T11:56:43.952607+0000","last_clean":"2023-11-28T11:56:43.952607+0000","last_became_active":"2023-11-28T11:56:39.935699+0000","last_became_peered":"2023-11-28T11:56:39.935699+0000","last_unstale":"2023-11-28T11:56:43.952607+0000","last_undegraded":"2023-11-28T11:56:43.952607+0000","last_fullsized":"2023-11-28T11:56:43.952607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:53:07.604891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.961314+0000","last_change":"2023-11-28T11:56:39.470488+0000","last_active":"2023-11-28T11:56:43.961314+0000","last_peered":"2023-11-28T11:56:43.961314+0000","last_clean":"2023-11-28T11:56:43.961314+0000","last_became_active":"2023-11-28T11:56:39.470200+0000","last_became_peered":"2023-11-28T11:56:39.470200+0000","last_unstale":"2023-11-28T11:56:43.961314+0000","last_undegraded":"2023-11-28T11:56:43.961314+0000","last_fullsized":"2023-11-28T11:56:43.961314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:09:04.506578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.571178+0000","last_change":"2023-11-28T11:56:43.991311+0000","last_active":"2023-11-28T11:56:44.571178+0000","last_peered":"2023-11-28T11:56:44.571178+0000","last_clean":"2023-11-28T11:56:44.571178+0000","last_became_active":"2023-11-28T11:56:43.990921+0000","last_became_peered":"2023-11-28T11:56:43.990921+0000","last_unstale":"2023-11-28T11:56:44.571178+0000","last_undegraded":"2023-11-28T11:56:44.571178+0000","last_fullsized":"2023-11-28T11:56:44.571178+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:34:39.710811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"24'3","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.953829+0000","last_change":"2023-11-28T11:56:39.472359+0000","last_active":"2023-11-28T11:56:43.953829+0000","last_peered":"2023-11-28T11:56:43.953829+0000","last_clean":"2023-11-28T11:56:43.953829+0000","last_became_active":"2023-11-28T11:56:39.471986+0000","last_became_peered":"2023-11-28T11:56:39.471986+0000","last_unstale":"2023-11-28T11:56:43.953829+0000","last_undegraded":"2023-11-28T11:56:43.953829+0000","last_fullsized":"2023-11-28T11:56:43.953829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:03:49.467652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.966867+0000","last_change":"2023-11-28T11:56:39.944231+0000","last_active":"2023-11-28T11:56:43.966867+0000","last_peered":"2023-11-28T11:56:43.966867+0000","last_clean":"2023-11-28T11:56:43.966867+0000","last_became_active":"2023-11-28T11:56:39.943953+0000","last_became_peered":"2023-11-28T11:56:39.943953+0000","last_unstale":"2023-11-28T11:56:43.966867+0000","last_undegraded":"2023-11-28T11:56:43.966867+0000","last_fullsized":"2023-11-28T11:56:43.966867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:39:50.872604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.572486+0000","last_change":"2023-11-28T11:56:43.983283+0000","last_active":"2023-11-28T11:56:44.572486+0000","last_peered":"2023-11-28T11:56:44.572486+0000","last_clean":"2023-11-28T11:56:44.572486+0000","last_became_active":"2023-11-28T11:56:43.982914+0000","last_became_peered":"2023-11-28T11:56:43.982914+0000","last_unstale":"2023-11-28T11:56:44.572486+0000","last_undegraded":"2023-11-28T11:56:44.572486+0000","last_fullsized":"2023-11-28T11:56:44.572486+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:57:38.845826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"29'8","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:48.793609+0000","last_change":"2023-11-28T11:56:39.466223+0000","last_active":"2023-11-28T11:56:48.793609+0000","last_peered":"2023-11-28T11:56:48.793609+0000","last_clean":"2023-11-28T11:56:48.793609+0000","last_became_active":"2023-11-28T11:56:39.461006+0000","last_became_peered":"2023-11-28T11:56:39.461006+0000","last_unstale":"2023-11-28T11:56:48.793609+0000","last_undegraded":"2023-11-28T11:56:48.793609+0000","last_fullsized":"2023-11-28T11:56:48.793609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:55:09.019742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960058+0000","last_change":"2023-11-28T11:56:39.928004+0000","last_active":"2023-11-28T11:56:43.960058+0000","last_peered":"2023-11-28T11:56:43.960058+0000","last_clean":"2023-11-28T11:56:43.960058+0000","last_became_active":"2023-11-28T11:56:39.927741+0000","last_became_peered":"2023-11-28T11:56:39.927741+0000","last_unstale":"2023-11-28T11:56:43.960058+0000","last_undegraded":"2023-11-28T11:56:43.960058+0000","last_fullsized":"2023-11-28T11:56:43.960058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:13:59.194749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.574749+0000","last_change":"2023-11-28T11:56:43.983971+0000","last_active":"2023-11-28T11:56:44.574749+0000","last_peered":"2023-11-28T11:56:44.574749+0000","last_clean":"2023-11-28T11:56:44.574749+0000","last_became_active":"2023-11-28T11:56:43.983532+0000","last_became_peered":"2023-11-28T11:56:43.983532+0000","last_unstale":"2023-11-28T11:56:44.574749+0000","last_undegraded":"2023-11-28T11:56:44.574749+0000","last_fullsized":"2023-11-28T11:56:44.574749+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:03:18.915760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960769+0000","last_change":"2023-11-28T11:56:39.937495+0000","last_active":"2023-11-28T11:56:43.960769+0000","last_peered":"2023-11-28T11:56:43.960769+0000","last_clean":"2023-11-28T11:56:43.960769+0000","last_became_active":"2023-11-28T11:56:39.937200+0000","last_became_peered":"2023-11-28T11:56:39.937200+0000","last_unstale":"2023-11-28T11:56:43.960769+0000","last_undegraded":"2023-11-28T11:56:43.960769+0000","last_fullsized":"2023-11-28T11:56:43.960769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:44:11.120518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.956246+0000","last_change":"2023-11-28T11:56:34.384408+0000","last_active":"2023-11-28T11:56:43.956246+0000","last_peered":"2023-11-28T11:56:43.956246+0000","last_clean":"2023-11-28T11:56:43.956246+0000","last_became_active":"2023-11-28T11:56:34.384036+0000","last_became_peered":"2023-11-28T11:56:34.384036+0000","last_unstale":"2023-11-28T11:56:43.956246+0000","last_undegraded":"2023-11-28T11:56:43.956246+0000","last_fullsized":"2023-11-28T11:56:43.956246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:58:55.003786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'1","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.458376+0000","last_change":"2023-11-28T11:56:39.470484+0000","last_active":"2023-11-28T11:56:44.458376+0000","last_peered":"2023-11-28T11:56:44.458376+0000","last_clean":"2023-11-28T11:56:44.458376+0000","last_became_active":"2023-11-28T11:56:39.469964+0000","last_became_peered":"2023-11-28T11:56:39.469964+0000","last_unstale":"2023-11-28T11:56:44.458376+0000","last_undegraded":"2023-11-28T11:56:44.458376+0000","last_fullsized":"2023-11-28T11:56:44.458376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:31:51.668232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.571117+0000","last_change":"2023-11-28T11:56:43.992603+0000","last_active":"2023-11-28T11:56:44.571117+0000","last_peered":"2023-11-28T11:56:44.571117+0000","last_clean":"2023-11-28T11:56:44.571117+0000","last_became_active":"2023-11-28T11:56:43.992111+0000","last_became_peered":"2023-11-28T11:56:43.992111+0000","last_unstale":"2023-11-28T11:56:44.571117+0000","last_undegraded":"2023-11-28T11:56:44.571117+0000","last_fullsized":"2023-11-28T11:56:44.571117+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:18:10.194854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952381+0000","last_change":"2023-11-28T11:56:39.935642+0000","last_active":"2023-11-28T11:56:43.952381+0000","last_peered":"2023-11-28T11:56:43.952381+0000","last_clean":"2023-11-28T11:56:43.952381+0000","last_became_active":"2023-11-28T11:56:39.935396+0000","last_became_peered":"2023-11-28T11:56:39.935396+0000","last_unstale":"2023-11-28T11:56:43.952381+0000","last_undegraded":"2023-11-28T11:56:43.952381+0000","last_fullsized":"2023-11-28T11:56:43.952381+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:08:24.197240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.971041+0000","last_change":"2023-11-28T11:56:34.384088+0000","last_active":"2023-11-28T11:56:43.971041+0000","last_peered":"2023-11-28T11:56:43.971041+0000","last_clean":"2023-11-28T11:56:43.971041+0000","last_became_active":"2023-11-28T11:56:34.383631+0000","last_became_peered":"2023-11-28T11:56:34.383631+0000","last_unstale":"2023-11-28T11:56:43.971041+0000","last_undegraded":"2023-11-28T11:56:43.971041+0000","last_fullsized":"2023-11-28T11:56:43.971041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:15:42.772333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"24'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.959213+0000","last_change":"2023-11-28T11:56:39.458173+0000","last_active":"2023-11-28T11:56:43.959213+0000","last_peered":"2023-11-28T11:56:43.959213+0000","last_clean":"2023-11-28T11:56:43.959213+0000","last_became_active":"2023-11-28T11:56:39.457898+0000","last_became_peered":"2023-11-28T11:56:39.457898+0000","last_unstale":"2023-11-28T11:56:43.959213+0000","last_undegraded":"2023-11-28T11:56:43.959213+0000","last_fullsized":"2023-11-28T11:56:43.959213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:54.418908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.452674+0000","last_change":"2023-11-28T11:56:43.982368+0000","last_active":"2023-11-28T11:56:44.452674+0000","last_peered":"2023-11-28T11:56:44.452674+0000","last_clean":"2023-11-28T11:56:44.452674+0000","last_became_active":"2023-11-28T11:56:43.981885+0000","last_became_peered":"2023-11-28T11:56:43.981885+0000","last_unstale":"2023-11-28T11:56:44.452674+0000","last_undegraded":"2023-11-28T11:56:44.452674+0000","last_fullsized":"2023-11-28T11:56:44.452674+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:01:03.447360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960222+0000","last_change":"2023-11-28T11:56:39.937832+0000","last_active":"2023-11-28T11:56:43.960222+0000","last_peered":"2023-11-28T11:56:43.960222+0000","last_clean":"2023-11-28T11:56:43.960222+0000","last_became_active":"2023-11-28T11:56:39.937160+0000","last_became_peered":"2023-11-28T11:56:39.937160+0000","last_unstale":"2023-11-28T11:56:43.960222+0000","last_undegraded":"2023-11-28T11:56:43.960222+0000","last_fullsized":"2023-11-28T11:56:43.960222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:44.472020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.954123+0000","last_change":"2023-11-28T11:56:34.386399+0000","last_active":"2023-11-28T11:56:43.954123+0000","last_peered":"2023-11-28T11:56:43.954123+0000","last_clean":"2023-11-28T11:56:43.954123+0000","last_became_active":"2023-11-28T11:56:34.385994+0000","last_became_peered":"2023-11-28T11:56:34.385994+0000","last_unstale":"2023-11-28T11:56:43.954123+0000","last_undegraded":"2023-11-28T11:56:43.954123+0000","last_fullsized":"2023-11-28T11:56:43.954123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:58:02.172295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.968562+0000","last_change":"2023-11-28T11:56:39.469089+0000","last_active":"2023-11-28T11:56:43.968562+0000","last_peered":"2023-11-28T11:56:43.968562+0000","last_clean":"2023-11-28T11:56:43.968562+0000","last_became_active":"2023-11-28T11:56:39.468762+0000","last_became_peered":"2023-11-28T11:56:39.468762+0000","last_unstale":"2023-11-28T11:56:43.968562+0000","last_undegraded":"2023-11-28T11:56:43.968562+0000","last_fullsized":"2023-11-28T11:56:43.968562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:15:59.693915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.452323+0000","last_change":"2023-11-28T11:56:43.994532+0000","last_active":"2023-11-28T11:56:44.452323+0000","last_peered":"2023-11-28T11:56:44.452323+0000","last_clean":"2023-11-28T11:56:44.452323+0000","last_became_active":"2023-11-28T11:56:43.993975+0000","last_became_peered":"2023-11-28T11:56:43.993975+0000","last_unstale":"2023-11-28T11:56:44.452323+0000","last_undegraded":"2023-11-28T11:56:44.452323+0000","last_fullsized":"2023-11-28T11:56:44.452323+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:09:56.519261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.967511+0000","last_change":"2023-11-28T11:56:39.947689+0000","last_active":"2023-11-28T11:56:43.967511+0000","last_peered":"2023-11-28T11:56:43.967511+0000","last_clean":"2023-11-28T11:56:43.967511+0000","last_became_active":"2023-11-28T11:56:39.947425+0000","last_became_peered":"2023-11-28T11:56:39.947425+0000","last_unstale":"2023-11-28T11:56:43.967511+0000","last_undegraded":"2023-11-28T11:56:43.967511+0000","last_fullsized":"2023-11-28T11:56:43.967511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:49:14.776024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.968711+0000","last_change":"2023-11-28T11:56:34.384999+0000","last_active":"2023-11-28T11:56:43.968711+0000","last_peered":"2023-11-28T11:56:43.968711+0000","last_clean":"2023-11-28T11:56:43.968711+0000","last_became_active":"2023-11-28T11:56:34.384531+0000","last_became_peered":"2023-11-28T11:56:34.384531+0000","last_unstale":"2023-11-28T11:56:43.968711+0000","last_undegraded":"2023-11-28T11:56:43.968711+0000","last_fullsized":"2023-11-28T11:56:43.968711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:09:50.083366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.966872+0000","last_change":"2023-11-28T11:56:39.468628+0000","last_active":"2023-11-28T11:56:43.966872+0000","last_peered":"2023-11-28T11:56:43.966872+0000","last_clean":"2023-11-28T11:56:43.966872+0000","last_became_active":"2023-11-28T11:56:39.467602+0000","last_became_peered":"2023-11-28T11:56:39.467602+0000","last_unstale":"2023-11-28T11:56:43.966872+0000","last_undegraded":"2023-11-28T11:56:43.966872+0000","last_fullsized":"2023-11-28T11:56:43.966872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:49:49.321158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.457910+0000","last_change":"2023-11-28T11:56:43.989103+0000","last_active":"2023-11-28T11:56:44.457910+0000","last_peered":"2023-11-28T11:56:44.457910+0000","last_clean":"2023-11-28T11:56:44.457910+0000","last_became_active":"2023-11-28T11:56:43.981649+0000","last_became_peered":"2023-11-28T11:56:43.981649+0000","last_unstale":"2023-11-28T11:56:44.457910+0000","last_undegraded":"2023-11-28T11:56:44.457910+0000","last_fullsized":"2023-11-28T11:56:44.457910+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:38:25.615361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.968481+0000","last_change":"2023-11-28T11:56:39.942485+0000","last_active":"2023-11-28T11:56:43.968481+0000","last_peered":"2023-11-28T11:56:43.968481+0000","last_clean":"2023-11-28T11:56:43.968481+0000","last_became_active":"2023-11-28T11:56:39.941112+0000","last_became_peered":"2023-11-28T11:56:39.941112+0000","last_unstale":"2023-11-28T11:56:43.968481+0000","last_undegraded":"2023-11-28T11:56:43.968481+0000","last_fullsized":"2023-11-28T11:56:43.968481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:47:39.671110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960251+0000","last_change":"2023-11-28T11:56:39.467432+0000","last_active":"2023-11-28T11:56:43.960251+0000","last_peered":"2023-11-28T11:56:43.960251+0000","last_clean":"2023-11-28T11:56:43.960251+0000","last_became_active":"2023-11-28T11:56:39.466982+0000","last_became_peered":"2023-11-28T11:56:39.466982+0000","last_unstale":"2023-11-28T11:56:43.960251+0000","last_undegraded":"2023-11-28T11:56:43.960251+0000","last_fullsized":"2023-11-28T11:56:43.960251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:35:56.115422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.965360+0000","last_change":"2023-11-28T11:56:34.389076+0000","last_active":"2023-11-28T11:56:43.965360+0000","last_peered":"2023-11-28T11:56:43.965360+0000","last_clean":"2023-11-28T11:56:43.965360+0000","last_became_active":"2023-11-28T11:56:34.388689+0000","last_became_peered":"2023-11-28T11:56:34.388689+0000","last_unstale":"2023-11-28T11:56:43.965360+0000","last_undegraded":"2023-11-28T11:56:43.965360+0000","last_fullsized":"2023-11-28T11:56:43.965360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:20.936349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.457737+0000","last_change":"2023-11-28T11:56:43.989060+0000","last_active":"2023-11-28T11:56:44.457737+0000","last_peered":"2023-11-28T11:56:44.457737+0000","last_clean":"2023-11-28T11:56:44.457737+0000","last_became_active":"2023-11-28T11:56:43.981599+0000","last_became_peered":"2023-11-28T11:56:43.981599+0000","last_unstale":"2023-11-28T11:56:44.457737+0000","last_undegraded":"2023-11-28T11:56:44.457737+0000","last_fullsized":"2023-11-28T11:56:44.457737+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:04:37.482968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.971330+0000","last_change":"2023-11-28T11:56:39.953419+0000","last_active":"2023-11-28T11:56:43.971330+0000","last_peered":"2023-11-28T11:56:43.971330+0000","last_clean":"2023-11-28T11:56:43.971330+0000","last_became_active":"2023-11-28T11:56:39.950287+0000","last_became_peered":"2023-11-28T11:56:39.950287+0000","last_unstale":"2023-11-28T11:56:43.971330+0000","last_undegraded":"2023-11-28T11:56:43.971330+0000","last_fullsized":"2023-11-28T11:56:43.971330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:15:38.977863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.965505+0000","last_change":"2023-11-28T11:56:39.467239+0000","last_active":"2023-11-28T11:56:43.965505+0000","last_peered":"2023-11-28T11:56:43.965505+0000","last_clean":"2023-11-28T11:56:43.965505+0000","last_became_active":"2023-11-28T11:56:39.466964+0000","last_became_peered":"2023-11-28T11:56:39.466964+0000","last_unstale":"2023-11-28T11:56:43.965505+0000","last_undegraded":"2023-11-28T11:56:43.965505+0000","last_fullsized":"2023-11-28T11:56:43.965505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:54.418908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.962524+0000","last_change":"2023-11-28T11:56:34.486178+0000","last_active":"2023-11-28T11:56:43.962524+0000","last_peered":"2023-11-28T11:56:43.962524+0000","last_clean":"2023-11-28T11:56:43.962524+0000","last_became_active":"2023-11-28T11:56:34.485702+0000","last_became_peered":"2023-11-28T11:56:34.485702+0000","last_unstale":"2023-11-28T11:56:43.962524+0000","last_undegraded":"2023-11-28T11:56:43.962524+0000","last_fullsized":"2023-11-28T11:56:43.962524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:06.323407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.570721+0000","last_change":"2023-11-28T11:56:43.979672+0000","last_active":"2023-11-28T11:56:44.570721+0000","last_peered":"2023-11-28T11:56:44.570721+0000","last_clean":"2023-11-28T11:56:44.570721+0000","last_became_active":"2023-11-28T11:56:43.978974+0000","last_became_peered":"2023-11-28T11:56:43.978974+0000","last_unstale":"2023-11-28T11:56:44.570721+0000","last_undegraded":"2023-11-28T11:56:44.570721+0000","last_fullsized":"2023-11-28T11:56:44.570721+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:15.285239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.974511+0000","last_change":"2023-11-28T11:56:39.957142+0000","last_active":"2023-11-28T11:56:43.974511+0000","last_peered":"2023-11-28T11:56:43.974511+0000","last_clean":"2023-11-28T11:56:43.974511+0000","last_became_active":"2023-11-28T11:56:39.956844+0000","last_became_peered":"2023-11-28T11:56:39.956844+0000","last_unstale":"2023-11-28T11:56:43.974511+0000","last_undegraded":"2023-11-28T11:56:43.974511+0000","last_fullsized":"2023-11-28T11:56:43.974511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:04.287216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.957703+0000","last_change":"2023-11-28T11:56:39.474271+0000","last_active":"2023-11-28T11:56:43.957703+0000","last_peered":"2023-11-28T11:56:43.957703+0000","last_clean":"2023-11-28T11:56:43.957703+0000","last_became_active":"2023-11-28T11:56:39.473993+0000","last_became_peered":"2023-11-28T11:56:39.473993+0000","last_unstale":"2023-11-28T11:56:43.957703+0000","last_undegraded":"2023-11-28T11:56:43.957703+0000","last_fullsized":"2023-11-28T11:56:43.957703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:20:01.703553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952292+0000","last_change":"2023-11-28T11:56:34.387293+0000","last_active":"2023-11-28T11:56:43.952292+0000","last_peered":"2023-11-28T11:56:43.952292+0000","last_clean":"2023-11-28T11:56:43.952292+0000","last_became_active":"2023-11-28T11:56:34.386976+0000","last_became_peered":"2023-11-28T11:56:34.386976+0000","last_unstale":"2023-11-28T11:56:43.952292+0000","last_undegraded":"2023-11-28T11:56:43.952292+0000","last_fullsized":"2023-11-28T11:56:43.952292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:32.704729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.570544+0000","last_change":"2023-11-28T11:56:43.995313+0000","last_active":"2023-11-28T11:56:44.570544+0000","last_peered":"2023-11-28T11:56:44.570544+0000","last_clean":"2023-11-28T11:56:44.570544+0000","last_became_active":"2023-11-28T11:56:43.994793+0000","last_became_peered":"2023-11-28T11:56:43.994793+0000","last_unstale":"2023-11-28T11:56:44.570544+0000","last_undegraded":"2023-11-28T11:56:44.570544+0000","last_fullsized":"2023-11-28T11:56:44.570544+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:38:23.071293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.953439+0000","last_change":"2023-11-28T11:56:39.927130+0000","last_active":"2023-11-28T11:56:43.953439+0000","last_peered":"2023-11-28T11:56:43.953439+0000","last_clean":"2023-11-28T11:56:43.953439+0000","last_became_active":"2023-11-28T11:56:39.926834+0000","last_became_peered":"2023-11-28T11:56:39.926834+0000","last_unstale":"2023-11-28T11:56:43.953439+0000","last_undegraded":"2023-11-28T11:56:43.953439+0000","last_fullsized":"2023-11-28T11:56:43.953439+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:03:50.474199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952514+0000","last_change":"2023-11-28T11:56:39.460516+0000","last_active":"2023-11-28T11:56:43.952514+0000","last_peered":"2023-11-28T11:56:43.952514+0000","last_clean":"2023-11-28T11:56:43.952514+0000","last_became_active":"2023-11-28T11:56:39.460151+0000","last_became_peered":"2023-11-28T11:56:39.460151+0000","last_unstale":"2023-11-28T11:56:43.952514+0000","last_undegraded":"2023-11-28T11:56:43.952514+0000","last_fullsized":"2023-11-28T11:56:43.952514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:52:05.494184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.972495+0000","last_change":"2023-11-28T11:56:34.389222+0000","last_active":"2023-11-28T11:56:43.972495+0000","last_peered":"2023-11-28T11:56:43.972495+0000","last_clean":"2023-11-28T11:56:43.972495+0000","last_became_active":"2023-11-28T11:56:34.388671+0000","last_became_peered":"2023-11-28T11:56:34.388671+0000","last_unstale":"2023-11-28T11:56:43.972495+0000","last_undegraded":"2023-11-28T11:56:43.972495+0000","last_fullsized":"2023-11-28T11:56:43.972495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:32.704729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952429+0000","last_change":"2023-11-28T11:56:28.472008+0000","last_active":"2023-11-28T11:56:43.952429+0000","last_peered":"2023-11-28T11:56:43.952429+0000","last_clean":"2023-11-28T11:56:43.952429+0000","last_became_active":"2023-11-28T11:56:28.469273+0000","last_became_peered":"2023-11-28T11:56:28.469273+0000","last_unstale":"2023-11-28T11:56:43.952429+0000","last_undegraded":"2023-11-28T11:56:43.952429+0000","last_fullsized":"2023-11-28T11:56:43.952429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:27.291192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:27.291192+0000","last_clean_scrub_stamp":"2023-11-28T11:56:27.291192+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:14:48.860420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.571768+0000","last_change":"2023-11-28T11:56:43.982227+0000","last_active":"2023-11-28T11:56:44.571768+0000","last_peered":"2023-11-28T11:56:44.571768+0000","last_clean":"2023-11-28T11:56:44.571768+0000","last_became_active":"2023-11-28T11:56:43.980406+0000","last_became_peered":"2023-11-28T11:56:43.980406+0000","last_unstale":"2023-11-28T11:56:44.571768+0000","last_undegraded":"2023-11-28T11:56:44.571768+0000","last_fullsized":"2023-11-28T11:56:44.571768+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:18:10.194854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.971411+0000","last_change":"2023-11-28T11:56:39.945082+0000","last_active":"2023-11-28T11:56:43.971411+0000","last_peered":"2023-11-28T11:56:43.971411+0000","last_clean":"2023-11-28T11:56:43.971411+0000","last_became_active":"2023-11-28T11:56:39.943905+0000","last_became_peered":"2023-11-28T11:56:39.943905+0000","last_unstale":"2023-11-28T11:56:43.971411+0000","last_undegraded":"2023-11-28T11:56:43.971411+0000","last_fullsized":"2023-11-28T11:56:43.971411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:59:04.313406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952622+0000","last_change":"2023-11-28T11:56:39.465139+0000","last_active":"2023-11-28T11:56:43.952622+0000","last_peered":"2023-11-28T11:56:43.952622+0000","last_clean":"2023-11-28T11:56:43.952622+0000","last_became_active":"2023-11-28T11:56:39.464873+0000","last_became_peered":"2023-11-28T11:56:39.464873+0000","last_unstale":"2023-11-28T11:56:43.952622+0000","last_undegraded":"2023-11-28T11:56:43.952622+0000","last_fullsized":"2023-11-28T11:56:43.952622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:15:59.693915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.453970+0000","last_change":"2023-11-28T11:56:43.985102+0000","last_active":"2023-11-28T11:56:44.453970+0000","last_peered":"2023-11-28T11:56:44.453970+0000","last_clean":"2023-11-28T11:56:44.453970+0000","last_became_active":"2023-11-28T11:56:43.981972+0000","last_became_peered":"2023-11-28T11:56:43.981972+0000","last_unstale":"2023-11-28T11:56:44.453970+0000","last_undegraded":"2023-11-28T11:56:44.453970+0000","last_fullsized":"2023-11-28T11:56:44.453970+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:55:56.798336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.962406+0000","last_change":"2023-11-28T11:56:39.927380+0000","last_active":"2023-11-28T11:56:43.962406+0000","last_peered":"2023-11-28T11:56:43.962406+0000","last_clean":"2023-11-28T11:56:43.962406+0000","last_became_active":"2023-11-28T11:56:39.927049+0000","last_became_peered":"2023-11-28T11:56:39.927049+0000","last_unstale":"2023-11-28T11:56:43.962406+0000","last_undegraded":"2023-11-28T11:56:43.962406+0000","last_fullsized":"2023-11-28T11:56:43.962406+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:53:07.604891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960844+0000","last_change":"2023-11-28T11:56:39.465718+0000","last_active":"2023-11-28T11:56:43.960844+0000","last_peered":"2023-11-28T11:56:43.960844+0000","last_clean":"2023-11-28T11:56:43.960844+0000","last_became_active":"2023-11-28T11:56:39.465452+0000","last_became_peered":"2023-11-28T11:56:39.465452+0000","last_unstale":"2023-11-28T11:56:43.960844+0000","last_undegraded":"2023-11-28T11:56:43.960844+0000","last_fullsized":"2023-11-28T11:56:43.960844+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:52:05.494184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.570452+0000","last_change":"2023-11-28T11:56:43.982616+0000","last_active":"2023-11-28T11:56:44.570452+0000","last_peered":"2023-11-28T11:56:44.570452+0000","last_clean":"2023-11-28T11:56:44.570452+0000","last_became_active":"2023-11-28T11:56:43.982223+0000","last_became_peered":"2023-11-28T11:56:43.982223+0000","last_unstale":"2023-11-28T11:56:44.570452+0000","last_undegraded":"2023-11-28T11:56:44.570452+0000","last_fullsized":"2023-11-28T11:56:44.570452+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:03:46.537759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.963773+0000","last_change":"2023-11-28T11:56:39.941619+0000","last_active":"2023-11-28T11:56:43.963773+0000","last_peered":"2023-11-28T11:56:43.963773+0000","last_clean":"2023-11-28T11:56:43.963773+0000","last_became_active":"2023-11-28T11:56:39.941343+0000","last_became_peered":"2023-11-28T11:56:39.941343+0000","last_unstale":"2023-11-28T11:56:43.963773+0000","last_undegraded":"2023-11-28T11:56:43.963773+0000","last_fullsized":"2023-11-28T11:56:43.963773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:09:05.982770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960394+0000","last_change":"2023-11-28T11:56:39.469027+0000","last_active":"2023-11-28T11:56:43.960394+0000","last_peered":"2023-11-28T11:56:43.960394+0000","last_clean":"2023-11-28T11:56:43.960394+0000","last_became_active":"2023-11-28T11:56:39.468738+0000","last_became_peered":"2023-11-28T11:56:39.468738+0000","last_unstale":"2023-11-28T11:56:43.960394+0000","last_undegraded":"2023-11-28T11:56:43.960394+0000","last_fullsized":"2023-11-28T11:56:43.960394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:55:09.019742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.573769+0000","last_change":"2023-11-28T11:56:44.002367+0000","last_active":"2023-11-28T11:56:44.573769+0000","last_peered":"2023-11-28T11:56:44.573769+0000","last_clean":"2023-11-28T11:56:44.573769+0000","last_became_active":"2023-11-28T11:56:44.002098+0000","last_became_peered":"2023-11-28T11:56:44.002098+0000","last_unstale":"2023-11-28T11:56:44.573769+0000","last_undegraded":"2023-11-28T11:56:44.573769+0000","last_fullsized":"2023-11-28T11:56:44.573769+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:34:06.872250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960453+0000","last_change":"2023-11-28T11:56:39.934523+0000","last_active":"2023-11-28T11:56:43.960453+0000","last_peered":"2023-11-28T11:56:43.960453+0000","last_clean":"2023-11-28T11:56:43.960453+0000","last_became_active":"2023-11-28T11:56:39.926004+0000","last_became_peered":"2023-11-28T11:56:39.926004+0000","last_unstale":"2023-11-28T11:56:43.960453+0000","last_undegraded":"2023-11-28T11:56:43.960453+0000","last_fullsized":"2023-11-28T11:56:43.960453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:39:50.872604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"24'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.954294+0000","last_change":"2023-11-28T11:56:39.464276+0000","last_active":"2023-11-28T11:56:43.954294+0000","last_peered":"2023-11-28T11:56:43.954294+0000","last_clean":"2023-11-28T11:56:43.954294+0000","last_became_active":"2023-11-28T11:56:39.463731+0000","last_became_peered":"2023-11-28T11:56:39.463731+0000","last_unstale":"2023-11-28T11:56:43.954294+0000","last_undegraded":"2023-11-28T11:56:43.954294+0000","last_fullsized":"2023-11-28T11:56:43.954294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:52:48.600084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.570251+0000","last_change":"2023-11-28T11:56:43.988077+0000","last_active":"2023-11-28T11:56:44.570251+0000","last_peered":"2023-11-28T11:56:44.570251+0000","last_clean":"2023-11-28T11:56:44.570251+0000","last_became_active":"2023-11-28T11:56:43.987519+0000","last_became_peered":"2023-11-28T11:56:43.987519+0000","last_unstale":"2023-11-28T11:56:44.570251+0000","last_undegraded":"2023-11-28T11:56:44.570251+0000","last_fullsized":"2023-11-28T11:56:44.570251+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:27:49.851056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960239+0000","last_change":"2023-11-28T11:56:39.943627+0000","last_active":"2023-11-28T11:56:43.960239+0000","last_peered":"2023-11-28T11:56:43.960239+0000","last_clean":"2023-11-28T11:56:43.960239+0000","last_became_active":"2023-11-28T11:56:39.943358+0000","last_became_peered":"2023-11-28T11:56:39.943358+0000","last_unstale":"2023-11-28T11:56:43.960239+0000","last_undegraded":"2023-11-28T11:56:43.960239+0000","last_fullsized":"2023-11-28T11:56:43.960239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:54:54.554070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.963730+0000","last_change":"2023-11-28T11:56:39.459974+0000","last_active":"2023-11-28T11:56:43.963730+0000","last_peered":"2023-11-28T11:56:43.963730+0000","last_clean":"2023-11-28T11:56:43.963730+0000","last_became_active":"2023-11-28T11:56:39.459621+0000","last_became_peered":"2023-11-28T11:56:39.459621+0000","last_unstale":"2023-11-28T11:56:43.963730+0000","last_undegraded":"2023-11-28T11:56:43.963730+0000","last_fullsized":"2023-11-28T11:56:43.963730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:57:44.601498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.569869+0000","last_change":"2023-11-28T11:56:43.987926+0000","last_active":"2023-11-28T11:56:44.569869+0000","last_peered":"2023-11-28T11:56:44.569869+0000","last_clean":"2023-11-28T11:56:44.569869+0000","last_became_active":"2023-11-28T11:56:43.987447+0000","last_became_peered":"2023-11-28T11:56:43.987447+0000","last_unstale":"2023-11-28T11:56:44.569869+0000","last_undegraded":"2023-11-28T11:56:44.569869+0000","last_fullsized":"2023-11-28T11:56:44.569869+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:48:08.970147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960270+0000","last_change":"2023-11-28T11:56:39.944531+0000","last_active":"2023-11-28T11:56:43.960270+0000","last_peered":"2023-11-28T11:56:43.960270+0000","last_clean":"2023-11-28T11:56:43.960270+0000","last_became_active":"2023-11-28T11:56:39.944262+0000","last_became_peered":"2023-11-28T11:56:39.944262+0000","last_unstale":"2023-11-28T11:56:43.960270+0000","last_undegraded":"2023-11-28T11:56:43.960270+0000","last_fullsized":"2023-11-28T11:56:43.960270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:36:30.674628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.953951+0000","last_change":"2023-11-28T11:56:39.468498+0000","last_active":"2023-11-28T11:56:43.953951+0000","last_peered":"2023-11-28T11:56:43.953951+0000","last_clean":"2023-11-28T11:56:43.953951+0000","last_became_active":"2023-11-28T11:56:39.468198+0000","last_became_peered":"2023-11-28T11:56:39.468198+0000","last_unstale":"2023-11-28T11:56:43.953951+0000","last_undegraded":"2023-11-28T11:56:43.953951+0000","last_fullsized":"2023-11-28T11:56:43.953951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:30:31.377988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.569939+0000","last_change":"2023-11-28T11:56:43.996490+0000","last_active":"2023-11-28T11:56:44.569939+0000","last_peered":"2023-11-28T11:56:44.569939+0000","last_clean":"2023-11-28T11:56:44.569939+0000","last_became_active":"2023-11-28T11:56:43.996074+0000","last_became_peered":"2023-11-28T11:56:43.996074+0000","last_unstale":"2023-11-28T11:56:44.569939+0000","last_undegraded":"2023-11-28T11:56:44.569939+0000","last_fullsized":"2023-11-28T11:56:44.569939+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:01:51.310559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960636+0000","last_change":"2023-11-28T11:56:39.946101+0000","last_active":"2023-11-28T11:56:43.960636+0000","last_peered":"2023-11-28T11:56:43.960636+0000","last_clean":"2023-11-28T11:56:43.960636+0000","last_became_active":"2023-11-28T11:56:39.945797+0000","last_became_peered":"2023-11-28T11:56:39.945797+0000","last_unstale":"2023-11-28T11:56:43.960636+0000","last_undegraded":"2023-11-28T11:56:43.960636+0000","last_fullsized":"2023-11-28T11:56:43.960636+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:04:33.061948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.954377+0000","last_change":"2023-11-28T11:56:39.468642+0000","last_active":"2023-11-28T11:56:43.954377+0000","last_peered":"2023-11-28T11:56:43.954377+0000","last_clean":"2023-11-28T11:56:43.954377+0000","last_became_active":"2023-11-28T11:56:39.468261+0000","last_became_peered":"2023-11-28T11:56:39.468261+0000","last_unstale":"2023-11-28T11:56:43.954377+0000","last_undegraded":"2023-11-28T11:56:43.954377+0000","last_fullsized":"2023-11-28T11:56:43.954377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:09:04.506578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.569358+0000","last_change":"2023-11-28T11:56:44.001612+0000","last_active":"2023-11-28T11:56:44.569358+0000","last_peered":"2023-11-28T11:56:44.569358+0000","last_clean":"2023-11-28T11:56:44.569358+0000","last_became_active":"2023-11-28T11:56:44.001218+0000","last_became_peered":"2023-11-28T11:56:44.001218+0000","last_unstale":"2023-11-28T11:56:44.569358+0000","last_undegraded":"2023-11-28T11:56:44.569358+0000","last_fullsized":"2023-11-28T11:56:44.569358+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:47.972845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.962655+0000","last_change":"2023-11-28T11:56:39.937560+0000","last_active":"2023-11-28T11:56:43.962655+0000","last_peered":"2023-11-28T11:56:43.962655+0000","last_clean":"2023-11-28T11:56:43.962655+0000","last_became_active":"2023-11-28T11:56:39.935813+0000","last_became_peered":"2023-11-28T11:56:39.935813+0000","last_unstale":"2023-11-28T11:56:43.962655+0000","last_undegraded":"2023-11-28T11:56:43.962655+0000","last_fullsized":"2023-11-28T11:56:43.962655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:39:50.872604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.954504+0000","last_change":"2023-11-28T11:56:39.460965+0000","last_active":"2023-11-28T11:56:43.954504+0000","last_peered":"2023-11-28T11:56:43.954504+0000","last_clean":"2023-11-28T11:56:43.954504+0000","last_became_active":"2023-11-28T11:56:39.460589+0000","last_became_peered":"2023-11-28T11:56:39.460589+0000","last_unstale":"2023-11-28T11:56:43.954504+0000","last_undegraded":"2023-11-28T11:56:43.954504+0000","last_fullsized":"2023-11-28T11:56:43.954504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:14:49.707818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.571715+0000","last_change":"2023-11-28T11:56:43.975101+0000","last_active":"2023-11-28T11:56:44.571715+0000","last_peered":"2023-11-28T11:56:44.571715+0000","last_clean":"2023-11-28T11:56:44.571715+0000","last_became_active":"2023-11-28T11:56:43.974532+0000","last_became_peered":"2023-11-28T11:56:43.974532+0000","last_unstale":"2023-11-28T11:56:44.571715+0000","last_undegraded":"2023-11-28T11:56:44.571715+0000","last_fullsized":"2023-11-28T11:56:44.571715+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:34:06.872250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.570363+0000","last_change":"2023-11-28T11:56:43.980824+0000","last_active":"2023-11-28T11:56:44.570363+0000","last_peered":"2023-11-28T11:56:44.570363+0000","last_clean":"2023-11-28T11:56:44.570363+0000","last_became_active":"2023-11-28T11:56:43.978868+0000","last_became_peered":"2023-11-28T11:56:43.978868+0000","last_unstale":"2023-11-28T11:56:44.570363+0000","last_undegraded":"2023-11-28T11:56:44.570363+0000","last_fullsized":"2023-11-28T11:56:44.570363+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:03:18.915760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"24'8","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.953542+0000","last_change":"2023-11-28T11:56:39.463107+0000","last_active":"2023-11-28T11:56:43.953542+0000","last_peered":"2023-11-28T11:56:43.953542+0000","last_clean":"2023-11-28T11:56:43.953542+0000","last_became_active":"2023-11-28T11:56:39.462771+0000","last_became_peered":"2023-11-28T11:56:39.462771+0000","last_unstale":"2023-11-28T11:56:43.953542+0000","last_undegraded":"2023-11-28T11:56:43.953542+0000","last_fullsized":"2023-11-28T11:56:43.953542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:26:50.340796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.959057+0000","last_change":"2023-11-28T11:56:39.935086+0000","last_active":"2023-11-28T11:56:43.959057+0000","last_peered":"2023-11-28T11:56:43.959057+0000","last_clean":"2023-11-28T11:56:43.959057+0000","last_became_active":"2023-11-28T11:56:39.934832+0000","last_became_peered":"2023-11-28T11:56:39.934832+0000","last_unstale":"2023-11-28T11:56:43.959057+0000","last_undegraded":"2023-11-28T11:56:43.959057+0000","last_fullsized":"2023-11-28T11:56:43.959057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:10:06.958523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.575548+0000","last_change":"2023-11-28T11:56:43.996688+0000","last_active":"2023-11-28T11:56:44.575548+0000","last_peered":"2023-11-28T11:56:44.575548+0000","last_clean":"2023-11-28T11:56:44.575548+0000","last_became_active":"2023-11-28T11:56:43.996253+0000","last_became_peered":"2023-11-28T11:56:43.996253+0000","last_unstale":"2023-11-28T11:56:44.575548+0000","last_undegraded":"2023-11-28T11:56:44.575548+0000","last_fullsized":"2023-11-28T11:56:44.575548+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:20:35.086687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952840+0000","last_change":"2023-11-28T11:56:39.471710+0000","last_active":"2023-11-28T11:56:43.952840+0000","last_peered":"2023-11-28T11:56:43.952840+0000","last_clean":"2023-11-28T11:56:43.952840+0000","last_became_active":"2023-11-28T11:56:39.471423+0000","last_became_peered":"2023-11-28T11:56:39.471423+0000","last_unstale":"2023-11-28T11:56:43.952840+0000","last_undegraded":"2023-11-28T11:56:43.952840+0000","last_fullsized":"2023-11-28T11:56:43.952840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:41.737631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.974564+0000","last_change":"2023-11-28T11:56:39.932531+0000","last_active":"2023-11-28T11:56:43.974564+0000","last_peered":"2023-11-28T11:56:43.974564+0000","last_clean":"2023-11-28T11:56:43.974564+0000","last_became_active":"2023-11-28T11:56:39.932235+0000","last_became_peered":"2023-11-28T11:56:39.932235+0000","last_unstale":"2023-11-28T11:56:43.974564+0000","last_undegraded":"2023-11-28T11:56:43.974564+0000","last_fullsized":"2023-11-28T11:56:43.974564+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:37:59.805024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960058+0000","last_change":"2023-11-28T11:56:39.459466+0000","last_active":"2023-11-28T11:56:43.960058+0000","last_peered":"2023-11-28T11:56:43.960058+0000","last_clean":"2023-11-28T11:56:43.960058+0000","last_became_active":"2023-11-28T11:56:39.459207+0000","last_became_peered":"2023-11-28T11:56:39.459207+0000","last_unstale":"2023-11-28T11:56:43.960058+0000","last_undegraded":"2023-11-28T11:56:43.960058+0000","last_fullsized":"2023-11-28T11:56:43.960058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:21:06.192836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.966700+0000","last_change":"2023-11-28T11:56:39.947121+0000","last_active":"2023-11-28T11:56:43.966700+0000","last_peered":"2023-11-28T11:56:43.966700+0000","last_clean":"2023-11-28T11:56:43.966700+0000","last_became_active":"2023-11-28T11:56:39.944854+0000","last_became_peered":"2023-11-28T11:56:39.944854+0000","last_unstale":"2023-11-28T11:56:43.966700+0000","last_undegraded":"2023-11-28T11:56:43.966700+0000","last_fullsized":"2023-11-28T11:56:43.966700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:53:07.604891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.572743+0000","last_change":"2023-11-28T11:56:43.976187+0000","last_active":"2023-11-28T11:56:44.572743+0000","last_peered":"2023-11-28T11:56:44.572743+0000","last_clean":"2023-11-28T11:56:44.572743+0000","last_became_active":"2023-11-28T11:56:43.975691+0000","last_became_peered":"2023-11-28T11:56:43.975691+0000","last_unstale":"2023-11-28T11:56:44.572743+0000","last_undegraded":"2023-11-28T11:56:44.572743+0000","last_fullsized":"2023-11-28T11:56:44.572743+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:38:23.071293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"24'2","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952993+0000","last_change":"2023-11-28T11:56:39.473334+0000","last_active":"2023-11-28T11:56:43.952993+0000","last_peered":"2023-11-28T11:56:43.952993+0000","last_clean":"2023-11-28T11:56:43.952993+0000","last_became_active":"2023-11-28T11:56:39.472989+0000","last_became_peered":"2023-11-28T11:56:39.472989+0000","last_unstale":"2023-11-28T11:56:43.952993+0000","last_undegraded":"2023-11-28T11:56:43.952993+0000","last_fullsized":"2023-11-28T11:56:43.952993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:36:29.668082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.953207+0000","last_change":"2023-11-28T11:56:39.942962+0000","last_active":"2023-11-28T11:56:43.953207+0000","last_peered":"2023-11-28T11:56:43.953207+0000","last_clean":"2023-11-28T11:56:43.953207+0000","last_became_active":"2023-11-28T11:56:39.942628+0000","last_became_peered":"2023-11-28T11:56:39.942628+0000","last_unstale":"2023-11-28T11:56:43.953207+0000","last_undegraded":"2023-11-28T11:56:43.953207+0000","last_fullsized":"2023-11-28T11:56:43.953207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:09:53.018437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.571109+0000","last_change":"2023-11-28T11:56:43.983804+0000","last_active":"2023-11-28T11:56:44.571109+0000","last_peered":"2023-11-28T11:56:44.571109+0000","last_clean":"2023-11-28T11:56:44.571109+0000","last_became_active":"2023-11-28T11:56:43.983397+0000","last_became_peered":"2023-11-28T11:56:43.983397+0000","last_unstale":"2023-11-28T11:56:44.571109+0000","last_undegraded":"2023-11-28T11:56:44.571109+0000","last_fullsized":"2023-11-28T11:56:44.571109+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:16.749468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.953340+0000","last_change":"2023-11-28T11:56:39.938472+0000","last_active":"2023-11-28T11:56:43.953340+0000","last_peered":"2023-11-28T11:56:43.953340+0000","last_clean":"2023-11-28T11:56:43.953340+0000","last_became_active":"2023-11-28T11:56:39.938186+0000","last_became_peered":"2023-11-28T11:56:39.938186+0000","last_unstale":"2023-11-28T11:56:43.953340+0000","last_undegraded":"2023-11-28T11:56:43.953340+0000","last_fullsized":"2023-11-28T11:56:43.953340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:30:32.384534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952481+0000","last_change":"2023-11-28T11:56:39.947611+0000","last_active":"2023-11-28T11:56:43.952481+0000","last_peered":"2023-11-28T11:56:43.952481+0000","last_clean":"2023-11-28T11:56:43.952481+0000","last_became_active":"2023-11-28T11:56:39.947364+0000","last_became_peered":"2023-11-28T11:56:39.947364+0000","last_unstale":"2023-11-28T11:56:43.952481+0000","last_undegraded":"2023-11-28T11:56:43.952481+0000","last_fullsized":"2023-11-28T11:56:43.952481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:49:14.776024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.959741+0000","last_change":"2023-11-28T11:56:39.928631+0000","last_active":"2023-11-28T11:56:43.959741+0000","last_peered":"2023-11-28T11:56:43.959741+0000","last_clean":"2023-11-28T11:56:43.959741+0000","last_became_active":"2023-11-28T11:56:39.928360+0000","last_became_peered":"2023-11-28T11:56:39.928360+0000","last_unstale":"2023-11-28T11:56:43.959741+0000","last_undegraded":"2023-11-28T11:56:43.959741+0000","last_fullsized":"2023-11-28T11:56:43.959741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:09:53.018437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.954058+0000","last_change":"2023-11-28T11:56:39.935151+0000","last_active":"2023-11-28T11:56:43.954058+0000","last_peered":"2023-11-28T11:56:43.954058+0000","last_clean":"2023-11-28T11:56:43.954058+0000","last_became_active":"2023-11-28T11:56:39.934811+0000","last_became_peered":"2023-11-28T11:56:39.934811+0000","last_unstale":"2023-11-28T11:56:43.954058+0000","last_undegraded":"2023-11-28T11:56:43.954058+0000","last_fullsized":"2023-11-28T11:56:43.954058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:24:26.563114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.968635+0000","last_change":"2023-11-28T11:56:39.940870+0000","last_active":"2023-11-28T11:56:43.968635+0000","last_peered":"2023-11-28T11:56:43.968635+0000","last_clean":"2023-11-28T11:56:43.968635+0000","last_became_active":"2023-11-28T11:56:39.940598+0000","last_became_peered":"2023-11-28T11:56:39.940598+0000","last_unstale":"2023-11-28T11:56:43.968635+0000","last_undegraded":"2023-11-28T11:56:43.968635+0000","last_fullsized":"2023-11-28T11:56:43.968635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:14:50.714365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.966611+0000","last_change":"2023-11-28T11:56:39.953168+0000","last_active":"2023-11-28T11:56:43.966611+0000","last_peered":"2023-11-28T11:56:43.966611+0000","last_clean":"2023-11-28T11:56:43.966611+0000","last_became_active":"2023-11-28T11:56:39.951968+0000","last_became_peered":"2023-11-28T11:56:39.951968+0000","last_unstale":"2023-11-28T11:56:43.966611+0000","last_undegraded":"2023-11-28T11:56:43.966611+0000","last_fullsized":"2023-11-28T11:56:43.966611+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:08:24.197240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.970835+0000","last_change":"2023-11-28T11:56:39.946593+0000","last_active":"2023-11-28T11:56:43.970835+0000","last_peered":"2023-11-28T11:56:43.970835+0000","last_clean":"2023-11-28T11:56:43.970835+0000","last_became_active":"2023-11-28T11:56:39.944862+0000","last_became_peered":"2023-11-28T11:56:39.944862+0000","last_unstale":"2023-11-28T11:56:43.970835+0000","last_undegraded":"2023-11-28T11:56:43.970835+0000","last_fullsized":"2023-11-28T11:56:43.970835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:13:17.325195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.971180+0000","last_change":"2023-11-28T11:56:39.941059+0000","last_active":"2023-11-28T11:56:43.971180+0000","last_peered":"2023-11-28T11:56:43.971180+0000","last_clean":"2023-11-28T11:56:43.971180+0000","last_became_active":"2023-11-28T11:56:39.940781+0000","last_became_peered":"2023-11-28T11:56:39.940781+0000","last_unstale":"2023-11-28T11:56:43.971180+0000","last_undegraded":"2023-11-28T11:56:43.971180+0000","last_fullsized":"2023-11-28T11:56:43.971180+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:50:59.351619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952193+0000","last_change":"2023-11-28T11:56:39.950678+0000","last_active":"2023-11-28T11:56:43.952193+0000","last_peered":"2023-11-28T11:56:43.952193+0000","last_clean":"2023-11-28T11:56:43.952193+0000","last_became_active":"2023-11-28T11:56:39.948033+0000","last_became_peered":"2023-11-28T11:56:39.948033+0000","last_unstale":"2023-11-28T11:56:43.952193+0000","last_undegraded":"2023-11-28T11:56:43.952193+0000","last_fullsized":"2023-11-28T11:56:43.952193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:13:17.325195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952347+0000","last_change":"2023-11-28T11:56:39.926747+0000","last_active":"2023-11-28T11:56:43.952347+0000","last_peered":"2023-11-28T11:56:43.952347+0000","last_clean":"2023-11-28T11:56:43.952347+0000","last_became_active":"2023-11-28T11:56:39.926475+0000","last_became_peered":"2023-11-28T11:56:39.926475+0000","last_unstale":"2023-11-28T11:56:43.952347+0000","last_undegraded":"2023-11-28T11:56:43.952347+0000","last_fullsized":"2023-11-28T11:56:43.952347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:10:35.378054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.957922+0000","last_change":"2023-11-28T11:56:39.952645+0000","last_active":"2023-11-28T11:56:43.957922+0000","last_peered":"2023-11-28T11:56:43.957922+0000","last_clean":"2023-11-28T11:56:43.957922+0000","last_became_active":"2023-11-28T11:56:39.952363+0000","last_became_peered":"2023-11-28T11:56:39.952363+0000","last_unstale":"2023-11-28T11:56:43.957922+0000","last_undegraded":"2023-11-28T11:56:43.957922+0000","last_fullsized":"2023-11-28T11:56:43.957922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:43:39.611494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952872+0000","last_change":"2023-11-28T11:56:39.947249+0000","last_active":"2023-11-28T11:56:43.952872+0000","last_peered":"2023-11-28T11:56:43.952872+0000","last_clean":"2023-11-28T11:56:43.952872+0000","last_became_active":"2023-11-28T11:56:39.946423+0000","last_became_peered":"2023-11-28T11:56:39.946423+0000","last_unstale":"2023-11-28T11:56:43.952872+0000","last_undegraded":"2023-11-28T11:56:43.952872+0000","last_fullsized":"2023-11-28T11:56:43.952872+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:49:14.776024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960364+0000","last_change":"2023-11-28T11:56:39.934479+0000","last_active":"2023-11-28T11:56:43.960364+0000","last_peered":"2023-11-28T11:56:43.960364+0000","last_clean":"2023-11-28T11:56:43.960364+0000","last_became_active":"2023-11-28T11:56:39.928161+0000","last_became_peered":"2023-11-28T11:56:39.928161+0000","last_unstale":"2023-11-28T11:56:43.960364+0000","last_undegraded":"2023-11-28T11:56:43.960364+0000","last_fullsized":"2023-11-28T11:56:43.960364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:54:26.952553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.963038+0000","last_change":"2023-11-28T11:56:39.941392+0000","last_active":"2023-11-28T11:56:43.963038+0000","last_peered":"2023-11-28T11:56:43.963038+0000","last_clean":"2023-11-28T11:56:43.963038+0000","last_became_active":"2023-11-28T11:56:39.940495+0000","last_became_peered":"2023-11-28T11:56:39.940495+0000","last_unstale":"2023-11-28T11:56:43.963038+0000","last_undegraded":"2023-11-28T11:56:43.963038+0000","last_fullsized":"2023-11-28T11:56:43.963038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:20:02.710099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.962307+0000","last_change":"2023-11-28T11:56:39.945287+0000","last_active":"2023-11-28T11:56:43.962307+0000","last_peered":"2023-11-28T11:56:43.962307+0000","last_clean":"2023-11-28T11:56:43.962307+0000","last_became_active":"2023-11-28T11:56:39.942342+0000","last_became_peered":"2023-11-28T11:56:39.942342+0000","last_unstale":"2023-11-28T11:56:43.962307+0000","last_undegraded":"2023-11-28T11:56:43.962307+0000","last_fullsized":"2023-11-28T11:56:43.962307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:10:35.378054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.992453+0000","last_change":"2023-11-28T11:56:39.934499+0000","last_active":"2023-11-28T11:56:43.992453+0000","last_peered":"2023-11-28T11:56:43.992453+0000","last_clean":"2023-11-28T11:56:43.992453+0000","last_became_active":"2023-11-28T11:56:39.934253+0000","last_became_peered":"2023-11-28T11:56:39.934253+0000","last_unstale":"2023-11-28T11:56:43.992453+0000","last_undegraded":"2023-11-28T11:56:43.992453+0000","last_fullsized":"2023-11-28T11:56:43.992453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:45:29.746371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.959288+0000","last_change":"2023-11-28T11:56:39.941319+0000","last_active":"2023-11-28T11:56:43.959288+0000","last_peered":"2023-11-28T11:56:43.959288+0000","last_clean":"2023-11-28T11:56:43.959288+0000","last_became_active":"2023-11-28T11:56:39.941012+0000","last_became_peered":"2023-11-28T11:56:39.941012+0000","last_unstale":"2023-11-28T11:56:43.959288+0000","last_undegraded":"2023-11-28T11:56:43.959288+0000","last_fullsized":"2023-11-28T11:56:43.959288+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:08:24.197240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952737+0000","last_change":"2023-11-28T11:56:39.950163+0000","last_active":"2023-11-28T11:56:43.952737+0000","last_peered":"2023-11-28T11:56:43.952737+0000","last_clean":"2023-11-28T11:56:43.952737+0000","last_became_active":"2023-11-28T11:56:39.949823+0000","last_became_peered":"2023-11-28T11:56:39.949823+0000","last_unstale":"2023-11-28T11:56:43.952737+0000","last_undegraded":"2023-11-28T11:56:43.952737+0000","last_fullsized":"2023-11-28T11:56:43.952737+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:53:07.604891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.965275+0000","last_change":"2023-11-28T11:56:39.945909+0000","last_active":"2023-11-28T11:56:43.965275+0000","last_peered":"2023-11-28T11:56:43.965275+0000","last_clean":"2023-11-28T11:56:43.965275+0000","last_became_active":"2023-11-28T11:56:39.945628+0000","last_became_peered":"2023-11-28T11:56:39.945628+0000","last_unstale":"2023-11-28T11:56:43.965275+0000","last_undegraded":"2023-11-28T11:56:43.965275+0000","last_fullsized":"2023-11-28T11:56:43.965275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:47:39.671110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.967426+0000","last_change":"2023-11-28T11:56:39.949059+0000","last_active":"2023-11-28T11:56:43.967426+0000","last_peered":"2023-11-28T11:56:43.967426+0000","last_clean":"2023-11-28T11:56:43.967426+0000","last_became_active":"2023-11-28T11:56:39.948795+0000","last_became_peered":"2023-11-28T11:56:39.948795+0000","last_unstale":"2023-11-28T11:56:43.967426+0000","last_undegraded":"2023-11-28T11:56:43.967426+0000","last_fullsized":"2023-11-28T11:56:43.967426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:10:59.494745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.964659+0000","last_change":"2023-11-28T11:56:39.955527+0000","last_active":"2023-11-28T11:56:43.964659+0000","last_peered":"2023-11-28T11:56:43.964659+0000","last_clean":"2023-11-28T11:56:43.964659+0000","last_became_active":"2023-11-28T11:56:39.955190+0000","last_became_peered":"2023-11-28T11:56:39.955190+0000","last_unstale":"2023-11-28T11:56:43.964659+0000","last_undegraded":"2023-11-28T11:56:43.964659+0000","last_fullsized":"2023-11-28T11:56:43.964659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:31:52.674778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.963692+0000","last_change":"2023-11-28T11:56:39.950894+0000","last_active":"2023-11-28T11:56:43.963692+0000","last_peered":"2023-11-28T11:56:43.963692+0000","last_clean":"2023-11-28T11:56:43.963692+0000","last_became_active":"2023-11-28T11:56:39.950572+0000","last_became_peered":"2023-11-28T11:56:39.950572+0000","last_unstale":"2023-11-28T11:56:43.963692+0000","last_undegraded":"2023-11-28T11:56:43.963692+0000","last_fullsized":"2023-11-28T11:56:43.963692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:33:44.652949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.961221+0000","last_change":"2023-11-28T11:56:39.943609+0000","last_active":"2023-11-28T11:56:43.961221+0000","last_peered":"2023-11-28T11:56:43.961221+0000","last_clean":"2023-11-28T11:56:43.961221+0000","last_became_active":"2023-11-28T11:56:39.943334+0000","last_became_peered":"2023-11-28T11:56:39.943334+0000","last_unstale":"2023-11-28T11:56:43.961221+0000","last_undegraded":"2023-11-28T11:56:43.961221+0000","last_fullsized":"2023-11-28T11:56:43.961221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:15:38.977863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.991532+0000","last_change":"2023-11-28T11:56:39.937893+0000","last_active":"2023-11-28T11:56:43.991532+0000","last_peered":"2023-11-28T11:56:43.991532+0000","last_clean":"2023-11-28T11:56:43.991532+0000","last_became_active":"2023-11-28T11:56:39.936035+0000","last_became_peered":"2023-11-28T11:56:39.936035+0000","last_unstale":"2023-11-28T11:56:43.991532+0000","last_undegraded":"2023-11-28T11:56:43.991532+0000","last_fullsized":"2023-11-28T11:56:43.991532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:48:05.469323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.962560+0000","last_change":"2023-11-28T11:56:39.948688+0000","last_active":"2023-11-28T11:56:43.962560+0000","last_peered":"2023-11-28T11:56:43.962560+0000","last_clean":"2023-11-28T11:56:43.962560+0000","last_became_active":"2023-11-28T11:56:39.948372+0000","last_became_peered":"2023-11-28T11:56:39.948372+0000","last_unstale":"2023-11-28T11:56:43.962560+0000","last_undegraded":"2023-11-28T11:56:43.962560+0000","last_fullsized":"2023-11-28T11:56:43.962560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:49:14.776024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952119+0000","last_change":"2023-11-28T11:56:39.950877+0000","last_active":"2023-11-28T11:56:43.952119+0000","last_peered":"2023-11-28T11:56:43.952119+0000","last_clean":"2023-11-28T11:56:43.952119+0000","last_became_active":"2023-11-28T11:56:39.949415+0000","last_became_peered":"2023-11-28T11:56:39.949415+0000","last_unstale":"2023-11-28T11:56:43.952119+0000","last_undegraded":"2023-11-28T11:56:43.952119+0000","last_fullsized":"2023-11-28T11:56:43.952119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:15:38.977863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.959490+0000","last_change":"2023-11-28T11:56:39.940463+0000","last_active":"2023-11-28T11:56:43.959490+0000","last_peered":"2023-11-28T11:56:43.959490+0000","last_clean":"2023-11-28T11:56:43.959490+0000","last_became_active":"2023-11-28T11:56:39.940181+0000","last_became_peered":"2023-11-28T11:56:39.940181+0000","last_unstale":"2023-11-28T11:56:43.959490+0000","last_undegraded":"2023-11-28T11:56:43.959490+0000","last_fullsized":"2023-11-28T11:56:43.959490+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:39:27.124421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960539+0000","last_change":"2023-11-28T11:56:39.933634+0000","last_active":"2023-11-28T11:56:43.960539+0000","last_peered":"2023-11-28T11:56:43.960539+0000","last_clean":"2023-11-28T11:56:43.960539+0000","last_became_active":"2023-11-28T11:56:39.933388+0000","last_became_peered":"2023-11-28T11:56:39.933388+0000","last_unstale":"2023-11-28T11:56:43.960539+0000","last_undegraded":"2023-11-28T11:56:43.960539+0000","last_fullsized":"2023-11-28T11:56:43.960539+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:35:17.292824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.953846+0000","last_change":"2023-11-28T11:56:39.929640+0000","last_active":"2023-11-28T11:56:43.953846+0000","last_peered":"2023-11-28T11:56:43.953846+0000","last_clean":"2023-11-28T11:56:43.953846+0000","last_became_active":"2023-11-28T11:56:39.926154+0000","last_became_peered":"2023-11-28T11:56:39.926154+0000","last_unstale":"2023-11-28T11:56:43.953846+0000","last_undegraded":"2023-11-28T11:56:43.953846+0000","last_fullsized":"2023-11-28T11:56:43.953846+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:09:05.513124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.963588+0000","last_change":"2023-11-28T11:56:39.927473+0000","last_active":"2023-11-28T11:56:43.963588+0000","last_peered":"2023-11-28T11:56:43.963588+0000","last_clean":"2023-11-28T11:56:43.963588+0000","last_became_active":"2023-11-28T11:56:39.927002+0000","last_became_peered":"2023-11-28T11:56:39.927002+0000","last_unstale":"2023-11-28T11:56:43.963588+0000","last_undegraded":"2023-11-28T11:56:43.963588+0000","last_fullsized":"2023-11-28T11:56:43.963588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:53:05.931879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.961138+0000","last_change":"2023-11-28T11:56:39.956928+0000","last_active":"2023-11-28T11:56:43.961138+0000","last_peered":"2023-11-28T11:56:43.961138+0000","last_clean":"2023-11-28T11:56:43.961138+0000","last_became_active":"2023-11-28T11:56:39.956676+0000","last_became_peered":"2023-11-28T11:56:39.956676+0000","last_unstale":"2023-11-28T11:56:43.961138+0000","last_undegraded":"2023-11-28T11:56:43.961138+0000","last_fullsized":"2023-11-28T11:56:43.961138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:24:26.563114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.959783+0000","last_change":"2023-11-28T11:56:39.948454+0000","last_active":"2023-11-28T11:56:43.959783+0000","last_peered":"2023-11-28T11:56:43.959783+0000","last_clean":"2023-11-28T11:56:43.959783+0000","last_became_active":"2023-11-28T11:56:39.948186+0000","last_became_peered":"2023-11-28T11:56:39.948186+0000","last_unstale":"2023-11-28T11:56:43.959783+0000","last_undegraded":"2023-11-28T11:56:43.959783+0000","last_fullsized":"2023-11-28T11:56:43.959783+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:55:32.097238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4386,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9300,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362540,"statfs":{"total":96636764160,"available":96627240960,"internally_reserved":0,"allocated":929792,"data_stored":719785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3959999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3779999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8116,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363724,"statfs":{"total":96636764160,"available":96628453376,"internally_reserved":0,"allocated":307200,"data_stored":125597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.351}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.385}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2709999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3100000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8188,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363652,"statfs":{"total":96636764160,"available":96628379648,"internally_reserved":0,"allocated":315392,"data_stored":126233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.484}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5840000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6679999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1819999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7649999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8264,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363576,"statfs":{"total":96636764160,"available":96628301824,"internally_reserved":0,"allocated":327680,"data_stored":129257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.327}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8184,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363656,"statfs":{"total":96636764160,"available":96628383744,"internally_reserved":0,"allocated":311296,"data_stored":125687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1890000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3009999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.353}]}]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8244,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363596,"statfs":{"total":96636764160,"available":96628322304,"internally_reserved":0,"allocated":307200,"data_stored":125597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1850000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4510000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4019999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8380000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.883}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9350000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7669999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8116,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363724,"statfs":{"total":96636764160,"available":96628453376,"internally_reserved":0,"allocated":307200,"data_stored":125597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4390000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.341}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9272,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362568,"statfs":{"total":96636764160,"available":96627269632,"internally_reserved":0,"allocated":901120,"data_stored":715612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:57:01.135 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:57:01.371 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.365+0000 7fd01c8fa700 1 Processor -- start 2023-11-28T11:57:01.371 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.365+0000 7fd01c8fa700 1 -- start start 2023-11-28T11:57:01.373 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.369+0000 7fd01c8fa700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0180c8d10 0x7fd0180cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:01.373 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.369+0000 7fd01c8fa700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd01815a850 con 0x7fd018069d60 2023-11-28T11:57:01.374 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.369+0000 7fd01c8fa700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0180cada0 con 0x7fd01815a480 2023-11-28T11:57:01.374 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.369+0000 7fd01c8fa700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0180ce060 con 0x7fd0180c8d10 2023-11-28T11:57:01.374 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.369+0000 7fd016d9d700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fd018069d60 0x7fd01806a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:37890/0 (socket says 172.21.15.39:37890) 2023-11-28T11:57:01.374 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.369+0000 7fd016d9d700 1 -- 172.21.15.39:0/1032068573 learned_addr learned my addr 172.21.15.39:0/1032068573 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:01.375 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.369+0000 7fd015d9b700 1 --2- 172.21.15.39:0/1032068573 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0180c8d10 0x7fd0180cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:01.375 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.369+0000 7fd01559a700 1 -- 172.21.15.39:0/1032068573 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1915252024 0 0) 0x7fd01815a850 con 0x7fd018069d60 2023-11-28T11:57:01.375 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.369+0000 7fd01559a700 1 -- 172.21.15.39:0/1032068573 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0000035d0 con 0x7fd018069d60 2023-11-28T11:57:01.376 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.369+0000 7fd015d9b700 1 -- 172.21.15.39:0/1032068573 >> v1:172.21.15.184:6789/0 conn(0x7fd01815a480 legacy=0x7fd0180cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:01.376 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.369+0000 7fd01559a700 1 -- 172.21.15.39:0/1032068573 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3029682710 0 0) 0x7fd0180cada0 con 0x7fd01815a480 2023-11-28T11:57:01.376 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.369+0000 7fd015d9b700 1 -- 172.21.15.39:0/1032068573 >> v1:172.21.15.39:6789/0 conn(0x7fd018069d60 legacy=0x7fd01806a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:01.376 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.369+0000 7fd015d9b700 1 -- 172.21.15.39:0/1032068573 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0180ce300 con 0x7fd0180c8d10 2023-11-28T11:57:01.376 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.369+0000 7fd015d9b700 1 --2- 172.21.15.39:0/1032068573 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0180c8d10 0x7fd0180cc9a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd00c009880 tx=0x7fd00c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f687fc56d9857a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:01.377 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.373+0000 7fd01559a700 1 -- 172.21.15.39:0/1032068573 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0100015f0 con 0x7fd0180c8d10 2023-11-28T11:57:01.377 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.373+0000 7fd01559a700 1 -- 172.21.15.39:0/1032068573 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00c010590 con 0x7fd0180c8d10 2023-11-28T11:57:01.377 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.373+0000 7fd01559a700 1 -- 172.21.15.39:0/1032068573 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00c010940 con 0x7fd0180c8d10 2023-11-28T11:57:01.377 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.373+0000 7fd01c8fa700 1 -- 172.21.15.39:0/1032068573 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0180c8d10 msgr2=0x7fd0180cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:01.377 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.373+0000 7fd01c8fa700 1 --2- 172.21.15.39:0/1032068573 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0180c8d10 0x7fd0180cc9a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd00c009880 tx=0x7fd00c009b90 comp rx=0 tx=0).stop 2023-11-28T11:57:01.378 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.373+0000 7fd01c8fa700 1 -- 172.21.15.39:0/1032068573 shutdown_connections 2023-11-28T11:57:01.378 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.373+0000 7fd01c8fa700 1 --2- 172.21.15.39:0/1032068573 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0180c8d10 0x7fd0180cc9a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:01.378 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.373+0000 7fd01c8fa700 1 -- 172.21.15.39:0/1032068573 >> 172.21.15.39:0/1032068573 conn(0x7fd0180cf350 msgr2=0x7fd0180b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:01.378 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.373+0000 7fd01c8fa700 1 -- 172.21.15.39:0/1032068573 shutdown_connections 2023-11-28T11:57:01.378 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.373+0000 7fd01c8fa700 1 -- 172.21.15.39:0/1032068573 wait complete. 2023-11-28T11:57:01.382 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.377+0000 7fd01c8fa700 1 Processor -- start 2023-11-28T11:57:01.382 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.377+0000 7fd01c8fa700 1 -- start start 2023-11-28T11:57:01.383 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.377+0000 7fd01c8fa700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd018069d60 0x7fd0180b1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:01.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.377+0000 7fd01c8fa700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0180c8d10 0x7fd018146420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:01.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.377+0000 7fd01c8fa700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd01815a480 0x7fd01815ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:01.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.377+0000 7fd01c8fa700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0180b20a0 con 0x7fd0180c8d10 2023-11-28T11:57:01.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.377+0000 7fd01c8fa700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd018146fe0 con 0x7fd018069d60 2023-11-28T11:57:01.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.377+0000 7fd01c8fa700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0181472c0 con 0x7fd01815a480 2023-11-28T11:57:01.385 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.381+0000 7fd015d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0180c8d10 0x7fd018146420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:01.385 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.381+0000 7fd01659c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd018069d60 0x7fd0180b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:01.385 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.381+0000 7fd015d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0180c8d10 0x7fd018146420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45040/0 (socket says 172.21.15.39:45040) 2023-11-28T11:57:01.385 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.381+0000 7fd015d9b700 1 -- 172.21.15.39:0/2988428001 learned_addr learned my addr 172.21.15.39:0/2988428001 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:01.385 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.381+0000 7fd016d9d700 1 --2- 172.21.15.39:0/2988428001 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd01815a480 0x7fd01815ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:01.385 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.381+0000 7fd015d9b700 1 -- 172.21.15.39:0/2988428001 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd01815a480 msgr2=0x7fd01815ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:01.385 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.381+0000 7fd015d9b700 1 --2- 172.21.15.39:0/2988428001 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd01815a480 0x7fd01815ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:01.385 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.381+0000 7fd015d9b700 1 -- 172.21.15.39:0/2988428001 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd018069d60 msgr2=0x7fd0180b1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:01.385 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.381+0000 7fd015d9b700 1 --2- 172.21.15.39:0/2988428001 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd018069d60 0x7fd0180b1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:01.386 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.381+0000 7fd015d9b700 1 -- 172.21.15.39:0/2988428001 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd00c0094b0 con 0x7fd0180c8d10 2023-11-28T11:57:01.387 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.381+0000 7fd015d9b700 1 --2- 172.21.15.39:0/2988428001 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0180c8d10 0x7fd018146420 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd01806b9d0 tx=0x7fd00c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:01.387 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.381+0000 7fd006ffd700 1 -- 172.21.15.39:0/2988428001 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00c004510 con 0x7fd0180c8d10 2023-11-28T11:57:01.387 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.381+0000 7fd006ffd700 1 -- 172.21.15.39:0/2988428001 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00c0036c0 con 0x7fd0180c8d10 2023-11-28T11:57:01.387 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.381+0000 7fd006ffd700 1 -- 172.21.15.39:0/2988428001 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00c003a70 con 0x7fd0180c8d10 2023-11-28T11:57:01.387 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.381+0000 7fd01c8fa700 1 -- 172.21.15.39:0/2988428001 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0180add50 con 0x7fd0180c8d10 2023-11-28T11:57:01.387 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.381+0000 7fd01c8fa700 1 -- 172.21.15.39:0/2988428001 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0180caa30 con 0x7fd0180c8d10 2023-11-28T11:57:01.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.385+0000 7fd01c8fa700 1 -- 172.21.15.39:0/2988428001 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0180ca6e0 con 0x7fd0180c8d10 2023-11-28T11:57:01.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.385+0000 7fd006ffd700 1 -- 172.21.15.39:0/2988428001 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd00c00f050 con 0x7fd0180c8d10 2023-11-28T11:57:01.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.385+0000 7fd006ffd700 1 --2- 172.21.15.39:0/2988428001 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcff8064ee0 0x7fcff8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:01.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.385+0000 7fd006ffd700 1 -- 172.21.15.39:0/2988428001 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd00c083630 con 0x7fd0180c8d10 2023-11-28T11:57:01.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.389+0000 7fd01659c700 1 --2- 172.21.15.39:0/2988428001 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcff8064ee0 0x7fcff8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:01.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.389+0000 7fd01659c700 1 --2- 172.21.15.39:0/2988428001 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcff8064ee0 0x7fcff8067390 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd0080014a0 tx=0x7fd008009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:01.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.393+0000 7fd006ffd700 1 -- 172.21.15.39:0/2988428001 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd00c0513f0 con 0x7fd0180c8d10 2023-11-28T11:57:01.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.573+0000 7fd01c8fa700 1 -- 172.21.15.39:0/2988428001 --> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd018147430 con 0x7fcff8064ee0 2023-11-28T11:57:01.595 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.589+0000 7fd006ffd700 1 -- 172.21.15.39:0/2988428001 <== mgr.4104 v2:172.21.15.184:6832/36166 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367140 (secure 0 0 0) 0x7fd018147430 con 0x7fcff8064ee0 2023-11-28T11:57:01.599 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:57:01.606 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.601+0000 7fd01c8fa700 1 -- 172.21.15.39:0/2988428001 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcff8064ee0 msgr2=0x7fcff8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:01.606 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.601+0000 7fd01c8fa700 1 --2- 172.21.15.39:0/2988428001 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcff8064ee0 0x7fcff8067390 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd0080014a0 tx=0x7fd008009040 comp rx=0 tx=0).stop 2023-11-28T11:57:01.606 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.601+0000 7fd01c8fa700 1 -- 172.21.15.39:0/2988428001 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0180c8d10 msgr2=0x7fd018146420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:01.606 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.601+0000 7fd01c8fa700 1 --2- 172.21.15.39:0/2988428001 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0180c8d10 0x7fd018146420 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd01806b9d0 tx=0x7fd00c004770 comp rx=0 tx=0).stop 2023-11-28T11:57:01.606 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.601+0000 7fd01c8fa700 1 -- 172.21.15.39:0/2988428001 shutdown_connections 2023-11-28T11:57:01.606 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.601+0000 7fd01c8fa700 1 --2- 172.21.15.39:0/2988428001 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd01815a480 0x7fd01815ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:01.606 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.601+0000 7fd01c8fa700 1 --2- 172.21.15.39:0/2988428001 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0180c8d10 0x7fd018146420 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:01.606 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.601+0000 7fd01c8fa700 1 --2- 172.21.15.39:0/2988428001 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcff8064ee0 0x7fcff8067390 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:01.606 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.601+0000 7fd01c8fa700 1 --2- 172.21.15.39:0/2988428001 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd018069d60 0x7fd0180b1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:01.606 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.601+0000 7fd01c8fa700 1 -- 172.21.15.39:0/2988428001 >> 172.21.15.39:0/2988428001 conn(0x7fd0180cf350 msgr2=0x7fd01806d430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:01.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.601+0000 7fd01c8fa700 1 -- 172.21.15.39:0/2988428001 shutdown_connections 2023-11-28T11:57:01.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.601+0000 7fd01c8fa700 1 -- 172.21.15.39:0/2988428001 wait complete. 2023-11-28T11:57:01.608 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2023-11-28T11:57:01.628 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2023-11-28T11:57:00.552671+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594754,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67684,"kb_used_data":3620,"kb_used_omap":0,"kb_used_meta":64000,"kb_avail":754907036,"statfs":{"total":773094113280,"available":773024804864,"internally_reserved":0,"allocated":3706880,"data_stored":2193365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65536000},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2056,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005572"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.571140+0000","last_change":"2023-11-28T11:56:43.976015+0000","last_active":"2023-11-28T11:56:44.571140+0000","last_peered":"2023-11-28T11:56:44.571140+0000","last_clean":"2023-11-28T11:56:44.571140+0000","last_became_active":"2023-11-28T11:56:43.975574+0000","last_became_peered":"2023-11-28T11:56:43.975574+0000","last_unstale":"2023-11-28T11:56:44.571140+0000","last_undegraded":"2023-11-28T11:56:44.571140+0000","last_fullsized":"2023-11-28T11:56:44.571140+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:41:50.763478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"24'4","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.992613+0000","last_change":"2023-11-28T11:56:39.473674+0000","last_active":"2023-11-28T11:56:43.992613+0000","last_peered":"2023-11-28T11:56:43.992613+0000","last_clean":"2023-11-28T11:56:43.992613+0000","last_became_active":"2023-11-28T11:56:39.473370+0000","last_became_peered":"2023-11-28T11:56:39.473370+0000","last_unstale":"2023-11-28T11:56:43.992613+0000","last_undegraded":"2023-11-28T11:56:43.992613+0000","last_fullsized":"2023-11-28T11:56:43.992613+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:10:58.488198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.959383+0000","last_change":"2023-11-28T11:56:39.939184+0000","last_active":"2023-11-28T11:56:43.959383+0000","last_peered":"2023-11-28T11:56:43.959383+0000","last_clean":"2023-11-28T11:56:43.959383+0000","last_became_active":"2023-11-28T11:56:39.938917+0000","last_became_peered":"2023-11-28T11:56:39.938917+0000","last_unstale":"2023-11-28T11:56:43.959383+0000","last_undegraded":"2023-11-28T11:56:43.959383+0000","last_fullsized":"2023-11-28T11:56:43.959383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:15:38.977863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.452044+0000","last_change":"2023-11-28T11:56:43.982000+0000","last_active":"2023-11-28T11:56:44.452044+0000","last_peered":"2023-11-28T11:56:44.452044+0000","last_clean":"2023-11-28T11:56:44.452044+0000","last_became_active":"2023-11-28T11:56:43.981537+0000","last_became_peered":"2023-11-28T11:56:43.981537+0000","last_unstale":"2023-11-28T11:56:44.452044+0000","last_undegraded":"2023-11-28T11:56:44.452044+0000","last_fullsized":"2023-11-28T11:56:44.452044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:13:42.258047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"24'1","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.962647+0000","last_change":"2023-11-28T11:56:39.451094+0000","last_active":"2023-11-28T11:56:43.962647+0000","last_peered":"2023-11-28T11:56:43.962647+0000","last_clean":"2023-11-28T11:56:43.962647+0000","last_became_active":"2023-11-28T11:56:39.450680+0000","last_became_peered":"2023-11-28T11:56:39.450680+0000","last_unstale":"2023-11-28T11:56:43.962647+0000","last_undegraded":"2023-11-28T11:56:43.962647+0000","last_fullsized":"2023-11-28T11:56:43.962647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:35:56.115422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952725+0000","last_change":"2023-11-28T11:56:39.938474+0000","last_active":"2023-11-28T11:56:43.952725+0000","last_peered":"2023-11-28T11:56:43.952725+0000","last_clean":"2023-11-28T11:56:43.952725+0000","last_became_active":"2023-11-28T11:56:39.938090+0000","last_became_peered":"2023-11-28T11:56:39.938090+0000","last_unstale":"2023-11-28T11:56:43.952725+0000","last_undegraded":"2023-11-28T11:56:43.952725+0000","last_fullsized":"2023-11-28T11:56:43.952725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:13:17.325195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.570857+0000","last_change":"2023-11-28T11:56:43.992668+0000","last_active":"2023-11-28T11:56:44.570857+0000","last_peered":"2023-11-28T11:56:44.570857+0000","last_clean":"2023-11-28T11:56:44.570857+0000","last_became_active":"2023-11-28T11:56:43.991547+0000","last_became_peered":"2023-11-28T11:56:43.991547+0000","last_unstale":"2023-11-28T11:56:44.570857+0000","last_undegraded":"2023-11-28T11:56:44.570857+0000","last_fullsized":"2023-11-28T11:56:44.570857+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:20:35.086687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"24'2","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.966791+0000","last_change":"2023-11-28T11:56:39.464222+0000","last_active":"2023-11-28T11:56:43.966791+0000","last_peered":"2023-11-28T11:56:43.966791+0000","last_clean":"2023-11-28T11:56:43.966791+0000","last_became_active":"2023-11-28T11:56:39.463797+0000","last_became_peered":"2023-11-28T11:56:39.463797+0000","last_unstale":"2023-11-28T11:56:43.966791+0000","last_undegraded":"2023-11-28T11:56:43.966791+0000","last_fullsized":"2023-11-28T11:56:43.966791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:52:48.600084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.959592+0000","last_change":"2023-11-28T11:56:39.932813+0000","last_active":"2023-11-28T11:56:43.959592+0000","last_peered":"2023-11-28T11:56:43.959592+0000","last_clean":"2023-11-28T11:56:43.959592+0000","last_became_active":"2023-11-28T11:56:39.928772+0000","last_became_peered":"2023-11-28T11:56:39.928772+0000","last_unstale":"2023-11-28T11:56:43.959592+0000","last_undegraded":"2023-11-28T11:56:43.959592+0000","last_fullsized":"2023-11-28T11:56:43.959592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:10:06.958523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.572062+0000","last_change":"2023-11-28T11:56:43.979370+0000","last_active":"2023-11-28T11:56:44.572062+0000","last_peered":"2023-11-28T11:56:44.572062+0000","last_clean":"2023-11-28T11:56:44.572062+0000","last_became_active":"2023-11-28T11:56:43.978938+0000","last_became_peered":"2023-11-28T11:56:43.978938+0000","last_unstale":"2023-11-28T11:56:44.572062+0000","last_undegraded":"2023-11-28T11:56:44.572062+0000","last_fullsized":"2023-11-28T11:56:44.572062+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:03:18.915760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.963646+0000","last_change":"2023-11-28T11:56:39.468476+0000","last_active":"2023-11-28T11:56:43.963646+0000","last_peered":"2023-11-28T11:56:43.963646+0000","last_clean":"2023-11-28T11:56:43.963646+0000","last_became_active":"2023-11-28T11:56:39.468201+0000","last_became_peered":"2023-11-28T11:56:39.468201+0000","last_unstale":"2023-11-28T11:56:43.963646+0000","last_undegraded":"2023-11-28T11:56:43.963646+0000","last_fullsized":"2023-11-28T11:56:43.963646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:30:31.377988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.959975+0000","last_change":"2023-11-28T11:56:39.928619+0000","last_active":"2023-11-28T11:56:43.959975+0000","last_peered":"2023-11-28T11:56:43.959975+0000","last_clean":"2023-11-28T11:56:43.959975+0000","last_became_active":"2023-11-28T11:56:39.928248+0000","last_became_peered":"2023-11-28T11:56:39.928248+0000","last_unstale":"2023-11-28T11:56:43.959975+0000","last_undegraded":"2023-11-28T11:56:43.959975+0000","last_fullsized":"2023-11-28T11:56:43.959975+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:24:26.563114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.574561+0000","last_change":"2023-11-28T11:56:43.998827+0000","last_active":"2023-11-28T11:56:44.574561+0000","last_peered":"2023-11-28T11:56:44.574561+0000","last_clean":"2023-11-28T11:56:44.574561+0000","last_became_active":"2023-11-28T11:56:43.998452+0000","last_became_peered":"2023-11-28T11:56:43.998452+0000","last_unstale":"2023-11-28T11:56:44.574561+0000","last_undegraded":"2023-11-28T11:56:44.574561+0000","last_fullsized":"2023-11-28T11:56:44.574561+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:34:39.710811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"24'1","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960780+0000","last_change":"2023-11-28T11:56:39.468234+0000","last_active":"2023-11-28T11:56:43.960780+0000","last_peered":"2023-11-28T11:56:43.960780+0000","last_clean":"2023-11-28T11:56:43.960780+0000","last_became_active":"2023-11-28T11:56:39.467925+0000","last_became_peered":"2023-11-28T11:56:39.467925+0000","last_unstale":"2023-11-28T11:56:43.960780+0000","last_undegraded":"2023-11-28T11:56:43.960780+0000","last_fullsized":"2023-11-28T11:56:43.960780+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:55:31.090691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.964769+0000","last_change":"2023-11-28T11:56:39.949606+0000","last_active":"2023-11-28T11:56:43.964769+0000","last_peered":"2023-11-28T11:56:43.964769+0000","last_clean":"2023-11-28T11:56:43.964769+0000","last_became_active":"2023-11-28T11:56:39.949364+0000","last_became_peered":"2023-11-28T11:56:39.949364+0000","last_unstale":"2023-11-28T11:56:43.964769+0000","last_undegraded":"2023-11-28T11:56:43.964769+0000","last_fullsized":"2023-11-28T11:56:43.964769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:02:46.928803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.453070+0000","last_change":"2023-11-28T11:56:43.992539+0000","last_active":"2023-11-28T11:56:44.453070+0000","last_peered":"2023-11-28T11:56:44.453070+0000","last_clean":"2023-11-28T11:56:44.453070+0000","last_became_active":"2023-11-28T11:56:43.992153+0000","last_became_peered":"2023-11-28T11:56:43.992153+0000","last_unstale":"2023-11-28T11:56:44.453070+0000","last_undegraded":"2023-11-28T11:56:44.453070+0000","last_fullsized":"2023-11-28T11:56:44.453070+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:33:16.305779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.959859+0000","last_change":"2023-11-28T11:56:39.470430+0000","last_active":"2023-11-28T11:56:43.959859+0000","last_peered":"2023-11-28T11:56:43.959859+0000","last_clean":"2023-11-28T11:56:43.959859+0000","last_became_active":"2023-11-28T11:56:39.470148+0000","last_became_peered":"2023-11-28T11:56:39.470148+0000","last_unstale":"2023-11-28T11:56:43.959859+0000","last_undegraded":"2023-11-28T11:56:43.959859+0000","last_fullsized":"2023-11-28T11:56:43.959859+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:26:50.340796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.958145+0000","last_change":"2023-11-28T11:56:39.951730+0000","last_active":"2023-11-28T11:56:43.958145+0000","last_peered":"2023-11-28T11:56:43.958145+0000","last_clean":"2023-11-28T11:56:43.958145+0000","last_became_active":"2023-11-28T11:56:39.951434+0000","last_became_peered":"2023-11-28T11:56:39.951434+0000","last_unstale":"2023-11-28T11:56:43.958145+0000","last_undegraded":"2023-11-28T11:56:43.958145+0000","last_fullsized":"2023-11-28T11:56:43.958145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:15:38.977863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.452332+0000","last_change":"2023-11-28T11:56:43.970823+0000","last_active":"2023-11-28T11:56:44.452332+0000","last_peered":"2023-11-28T11:56:44.452332+0000","last_clean":"2023-11-28T11:56:44.452332+0000","last_became_active":"2023-11-28T11:56:43.970344+0000","last_became_peered":"2023-11-28T11:56:43.970344+0000","last_unstale":"2023-11-28T11:56:44.452332+0000","last_undegraded":"2023-11-28T11:56:44.452332+0000","last_fullsized":"2023-11-28T11:56:44.452332+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:10:38.878879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.965575+0000","last_change":"2023-11-28T11:56:39.469964+0000","last_active":"2023-11-28T11:56:43.965575+0000","last_peered":"2023-11-28T11:56:43.965575+0000","last_clean":"2023-11-28T11:56:43.965575+0000","last_became_active":"2023-11-28T11:56:39.469642+0000","last_became_peered":"2023-11-28T11:56:39.469642+0000","last_unstale":"2023-11-28T11:56:43.965575+0000","last_undegraded":"2023-11-28T11:56:43.965575+0000","last_fullsized":"2023-11-28T11:56:43.965575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:52:05.494184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.973209+0000","last_change":"2023-11-28T11:56:39.935588+0000","last_active":"2023-11-28T11:56:43.973209+0000","last_peered":"2023-11-28T11:56:43.973209+0000","last_clean":"2023-11-28T11:56:43.973209+0000","last_became_active":"2023-11-28T11:56:39.935271+0000","last_became_peered":"2023-11-28T11:56:39.935271+0000","last_unstale":"2023-11-28T11:56:43.973209+0000","last_undegraded":"2023-11-28T11:56:43.973209+0000","last_fullsized":"2023-11-28T11:56:43.973209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:58:24.629436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.458194+0000","last_change":"2023-11-28T11:56:43.990219+0000","last_active":"2023-11-28T11:56:44.458194+0000","last_peered":"2023-11-28T11:56:44.458194+0000","last_clean":"2023-11-28T11:56:44.458194+0000","last_became_active":"2023-11-28T11:56:43.981571+0000","last_became_peered":"2023-11-28T11:56:43.981571+0000","last_unstale":"2023-11-28T11:56:44.458194+0000","last_undegraded":"2023-11-28T11:56:44.458194+0000","last_fullsized":"2023-11-28T11:56:44.458194+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:46:26.561526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952505+0000","last_change":"2023-11-28T11:56:39.464266+0000","last_active":"2023-11-28T11:56:43.952505+0000","last_peered":"2023-11-28T11:56:43.952505+0000","last_clean":"2023-11-28T11:56:43.952505+0000","last_became_active":"2023-11-28T11:56:39.463801+0000","last_became_peered":"2023-11-28T11:56:39.463801+0000","last_unstale":"2023-11-28T11:56:43.952505+0000","last_undegraded":"2023-11-28T11:56:43.952505+0000","last_fullsized":"2023-11-28T11:56:43.952505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:49:49.321158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.956171+0000","last_change":"2023-11-28T11:56:39.951261+0000","last_active":"2023-11-28T11:56:43.956171+0000","last_peered":"2023-11-28T11:56:43.956171+0000","last_clean":"2023-11-28T11:56:43.956171+0000","last_became_active":"2023-11-28T11:56:39.950979+0000","last_became_peered":"2023-11-28T11:56:39.950979+0000","last_unstale":"2023-11-28T11:56:43.956171+0000","last_undegraded":"2023-11-28T11:56:43.956171+0000","last_fullsized":"2023-11-28T11:56:43.956171+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:57:45.608044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952252+0000","last_change":"2023-11-28T11:56:39.944382+0000","last_active":"2023-11-28T11:56:43.952252+0000","last_peered":"2023-11-28T11:56:43.952252+0000","last_clean":"2023-11-28T11:56:43.952252+0000","last_became_active":"2023-11-28T11:56:39.944076+0000","last_became_peered":"2023-11-28T11:56:39.944076+0000","last_unstale":"2023-11-28T11:56:43.952252+0000","last_undegraded":"2023-11-28T11:56:43.952252+0000","last_fullsized":"2023-11-28T11:56:43.952252+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:39:50.872604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.992745+0000","last_change":"2023-11-28T11:56:39.473681+0000","last_active":"2023-11-28T11:56:43.992745+0000","last_peered":"2023-11-28T11:56:43.992745+0000","last_clean":"2023-11-28T11:56:43.992745+0000","last_became_active":"2023-11-28T11:56:39.473403+0000","last_became_peered":"2023-11-28T11:56:39.473403+0000","last_unstale":"2023-11-28T11:56:43.992745+0000","last_undegraded":"2023-11-28T11:56:43.992745+0000","last_fullsized":"2023-11-28T11:56:43.992745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:37:08.555596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.453581+0000","last_change":"2023-11-28T11:56:43.973549+0000","last_active":"2023-11-28T11:56:44.453581+0000","last_peered":"2023-11-28T11:56:44.453581+0000","last_clean":"2023-11-28T11:56:44.453581+0000","last_became_active":"2023-11-28T11:56:43.968940+0000","last_became_peered":"2023-11-28T11:56:43.968940+0000","last_unstale":"2023-11-28T11:56:44.453581+0000","last_undegraded":"2023-11-28T11:56:44.453581+0000","last_fullsized":"2023-11-28T11:56:44.453581+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:14:02.695573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952607+0000","last_change":"2023-11-28T11:56:39.937083+0000","last_active":"2023-11-28T11:56:43.952607+0000","last_peered":"2023-11-28T11:56:43.952607+0000","last_clean":"2023-11-28T11:56:43.952607+0000","last_became_active":"2023-11-28T11:56:39.935699+0000","last_became_peered":"2023-11-28T11:56:39.935699+0000","last_unstale":"2023-11-28T11:56:43.952607+0000","last_undegraded":"2023-11-28T11:56:43.952607+0000","last_fullsized":"2023-11-28T11:56:43.952607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:53:07.604891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.961314+0000","last_change":"2023-11-28T11:56:39.470488+0000","last_active":"2023-11-28T11:56:43.961314+0000","last_peered":"2023-11-28T11:56:43.961314+0000","last_clean":"2023-11-28T11:56:43.961314+0000","last_became_active":"2023-11-28T11:56:39.470200+0000","last_became_peered":"2023-11-28T11:56:39.470200+0000","last_unstale":"2023-11-28T11:56:43.961314+0000","last_undegraded":"2023-11-28T11:56:43.961314+0000","last_fullsized":"2023-11-28T11:56:43.961314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:09:04.506578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.571178+0000","last_change":"2023-11-28T11:56:43.991311+0000","last_active":"2023-11-28T11:56:44.571178+0000","last_peered":"2023-11-28T11:56:44.571178+0000","last_clean":"2023-11-28T11:56:44.571178+0000","last_became_active":"2023-11-28T11:56:43.990921+0000","last_became_peered":"2023-11-28T11:56:43.990921+0000","last_unstale":"2023-11-28T11:56:44.571178+0000","last_undegraded":"2023-11-28T11:56:44.571178+0000","last_fullsized":"2023-11-28T11:56:44.571178+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:34:39.710811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"24'3","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.953829+0000","last_change":"2023-11-28T11:56:39.472359+0000","last_active":"2023-11-28T11:56:43.953829+0000","last_peered":"2023-11-28T11:56:43.953829+0000","last_clean":"2023-11-28T11:56:43.953829+0000","last_became_active":"2023-11-28T11:56:39.471986+0000","last_became_peered":"2023-11-28T11:56:39.471986+0000","last_unstale":"2023-11-28T11:56:43.953829+0000","last_undegraded":"2023-11-28T11:56:43.953829+0000","last_fullsized":"2023-11-28T11:56:43.953829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:03:49.467652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.966867+0000","last_change":"2023-11-28T11:56:39.944231+0000","last_active":"2023-11-28T11:56:43.966867+0000","last_peered":"2023-11-28T11:56:43.966867+0000","last_clean":"2023-11-28T11:56:43.966867+0000","last_became_active":"2023-11-28T11:56:39.943953+0000","last_became_peered":"2023-11-28T11:56:39.943953+0000","last_unstale":"2023-11-28T11:56:43.966867+0000","last_undegraded":"2023-11-28T11:56:43.966867+0000","last_fullsized":"2023-11-28T11:56:43.966867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:39:50.872604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.572486+0000","last_change":"2023-11-28T11:56:43.983283+0000","last_active":"2023-11-28T11:56:44.572486+0000","last_peered":"2023-11-28T11:56:44.572486+0000","last_clean":"2023-11-28T11:56:44.572486+0000","last_became_active":"2023-11-28T11:56:43.982914+0000","last_became_peered":"2023-11-28T11:56:43.982914+0000","last_unstale":"2023-11-28T11:56:44.572486+0000","last_undegraded":"2023-11-28T11:56:44.572486+0000","last_fullsized":"2023-11-28T11:56:44.572486+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:57:38.845826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"29'8","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:48.793609+0000","last_change":"2023-11-28T11:56:39.466223+0000","last_active":"2023-11-28T11:56:48.793609+0000","last_peered":"2023-11-28T11:56:48.793609+0000","last_clean":"2023-11-28T11:56:48.793609+0000","last_became_active":"2023-11-28T11:56:39.461006+0000","last_became_peered":"2023-11-28T11:56:39.461006+0000","last_unstale":"2023-11-28T11:56:48.793609+0000","last_undegraded":"2023-11-28T11:56:48.793609+0000","last_fullsized":"2023-11-28T11:56:48.793609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:55:09.019742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960058+0000","last_change":"2023-11-28T11:56:39.928004+0000","last_active":"2023-11-28T11:56:43.960058+0000","last_peered":"2023-11-28T11:56:43.960058+0000","last_clean":"2023-11-28T11:56:43.960058+0000","last_became_active":"2023-11-28T11:56:39.927741+0000","last_became_peered":"2023-11-28T11:56:39.927741+0000","last_unstale":"2023-11-28T11:56:43.960058+0000","last_undegraded":"2023-11-28T11:56:43.960058+0000","last_fullsized":"2023-11-28T11:56:43.960058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:13:59.194749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.574749+0000","last_change":"2023-11-28T11:56:43.983971+0000","last_active":"2023-11-28T11:56:44.574749+0000","last_peered":"2023-11-28T11:56:44.574749+0000","last_clean":"2023-11-28T11:56:44.574749+0000","last_became_active":"2023-11-28T11:56:43.983532+0000","last_became_peered":"2023-11-28T11:56:43.983532+0000","last_unstale":"2023-11-28T11:56:44.574749+0000","last_undegraded":"2023-11-28T11:56:44.574749+0000","last_fullsized":"2023-11-28T11:56:44.574749+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:03:18.915760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960769+0000","last_change":"2023-11-28T11:56:39.937495+0000","last_active":"2023-11-28T11:56:43.960769+0000","last_peered":"2023-11-28T11:56:43.960769+0000","last_clean":"2023-11-28T11:56:43.960769+0000","last_became_active":"2023-11-28T11:56:39.937200+0000","last_became_peered":"2023-11-28T11:56:39.937200+0000","last_unstale":"2023-11-28T11:56:43.960769+0000","last_undegraded":"2023-11-28T11:56:43.960769+0000","last_fullsized":"2023-11-28T11:56:43.960769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:44:11.120518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.956246+0000","last_change":"2023-11-28T11:56:34.384408+0000","last_active":"2023-11-28T11:56:43.956246+0000","last_peered":"2023-11-28T11:56:43.956246+0000","last_clean":"2023-11-28T11:56:43.956246+0000","last_became_active":"2023-11-28T11:56:34.384036+0000","last_became_peered":"2023-11-28T11:56:34.384036+0000","last_unstale":"2023-11-28T11:56:43.956246+0000","last_undegraded":"2023-11-28T11:56:43.956246+0000","last_fullsized":"2023-11-28T11:56:43.956246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:58:55.003786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'1","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.458376+0000","last_change":"2023-11-28T11:56:39.470484+0000","last_active":"2023-11-28T11:56:44.458376+0000","last_peered":"2023-11-28T11:56:44.458376+0000","last_clean":"2023-11-28T11:56:44.458376+0000","last_became_active":"2023-11-28T11:56:39.469964+0000","last_became_peered":"2023-11-28T11:56:39.469964+0000","last_unstale":"2023-11-28T11:56:44.458376+0000","last_undegraded":"2023-11-28T11:56:44.458376+0000","last_fullsized":"2023-11-28T11:56:44.458376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:31:51.668232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.571117+0000","last_change":"2023-11-28T11:56:43.992603+0000","last_active":"2023-11-28T11:56:44.571117+0000","last_peered":"2023-11-28T11:56:44.571117+0000","last_clean":"2023-11-28T11:56:44.571117+0000","last_became_active":"2023-11-28T11:56:43.992111+0000","last_became_peered":"2023-11-28T11:56:43.992111+0000","last_unstale":"2023-11-28T11:56:44.571117+0000","last_undegraded":"2023-11-28T11:56:44.571117+0000","last_fullsized":"2023-11-28T11:56:44.571117+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:18:10.194854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952381+0000","last_change":"2023-11-28T11:56:39.935642+0000","last_active":"2023-11-28T11:56:43.952381+0000","last_peered":"2023-11-28T11:56:43.952381+0000","last_clean":"2023-11-28T11:56:43.952381+0000","last_became_active":"2023-11-28T11:56:39.935396+0000","last_became_peered":"2023-11-28T11:56:39.935396+0000","last_unstale":"2023-11-28T11:56:43.952381+0000","last_undegraded":"2023-11-28T11:56:43.952381+0000","last_fullsized":"2023-11-28T11:56:43.952381+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:08:24.197240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.971041+0000","last_change":"2023-11-28T11:56:34.384088+0000","last_active":"2023-11-28T11:56:43.971041+0000","last_peered":"2023-11-28T11:56:43.971041+0000","last_clean":"2023-11-28T11:56:43.971041+0000","last_became_active":"2023-11-28T11:56:34.383631+0000","last_became_peered":"2023-11-28T11:56:34.383631+0000","last_unstale":"2023-11-28T11:56:43.971041+0000","last_undegraded":"2023-11-28T11:56:43.971041+0000","last_fullsized":"2023-11-28T11:56:43.971041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:15:42.772333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"24'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.959213+0000","last_change":"2023-11-28T11:56:39.458173+0000","last_active":"2023-11-28T11:56:43.959213+0000","last_peered":"2023-11-28T11:56:43.959213+0000","last_clean":"2023-11-28T11:56:43.959213+0000","last_became_active":"2023-11-28T11:56:39.457898+0000","last_became_peered":"2023-11-28T11:56:39.457898+0000","last_unstale":"2023-11-28T11:56:43.959213+0000","last_undegraded":"2023-11-28T11:56:43.959213+0000","last_fullsized":"2023-11-28T11:56:43.959213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:54.418908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.452674+0000","last_change":"2023-11-28T11:56:43.982368+0000","last_active":"2023-11-28T11:56:44.452674+0000","last_peered":"2023-11-28T11:56:44.452674+0000","last_clean":"2023-11-28T11:56:44.452674+0000","last_became_active":"2023-11-28T11:56:43.981885+0000","last_became_peered":"2023-11-28T11:56:43.981885+0000","last_unstale":"2023-11-28T11:56:44.452674+0000","last_undegraded":"2023-11-28T11:56:44.452674+0000","last_fullsized":"2023-11-28T11:56:44.452674+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:01:03.447360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960222+0000","last_change":"2023-11-28T11:56:39.937832+0000","last_active":"2023-11-28T11:56:43.960222+0000","last_peered":"2023-11-28T11:56:43.960222+0000","last_clean":"2023-11-28T11:56:43.960222+0000","last_became_active":"2023-11-28T11:56:39.937160+0000","last_became_peered":"2023-11-28T11:56:39.937160+0000","last_unstale":"2023-11-28T11:56:43.960222+0000","last_undegraded":"2023-11-28T11:56:43.960222+0000","last_fullsized":"2023-11-28T11:56:43.960222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:44.472020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.954123+0000","last_change":"2023-11-28T11:56:34.386399+0000","last_active":"2023-11-28T11:56:43.954123+0000","last_peered":"2023-11-28T11:56:43.954123+0000","last_clean":"2023-11-28T11:56:43.954123+0000","last_became_active":"2023-11-28T11:56:34.385994+0000","last_became_peered":"2023-11-28T11:56:34.385994+0000","last_unstale":"2023-11-28T11:56:43.954123+0000","last_undegraded":"2023-11-28T11:56:43.954123+0000","last_fullsized":"2023-11-28T11:56:43.954123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:58:02.172295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.968562+0000","last_change":"2023-11-28T11:56:39.469089+0000","last_active":"2023-11-28T11:56:43.968562+0000","last_peered":"2023-11-28T11:56:43.968562+0000","last_clean":"2023-11-28T11:56:43.968562+0000","last_became_active":"2023-11-28T11:56:39.468762+0000","last_became_peered":"2023-11-28T11:56:39.468762+0000","last_unstale":"2023-11-28T11:56:43.968562+0000","last_undegraded":"2023-11-28T11:56:43.968562+0000","last_fullsized":"2023-11-28T11:56:43.968562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:15:59.693915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.452323+0000","last_change":"2023-11-28T11:56:43.994532+0000","last_active":"2023-11-28T11:56:44.452323+0000","last_peered":"2023-11-28T11:56:44.452323+0000","last_clean":"2023-11-28T11:56:44.452323+0000","last_became_active":"2023-11-28T11:56:43.993975+0000","last_became_peered":"2023-11-28T11:56:43.993975+0000","last_unstale":"2023-11-28T11:56:44.452323+0000","last_undegraded":"2023-11-28T11:56:44.452323+0000","last_fullsized":"2023-11-28T11:56:44.452323+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:09:56.519261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.967511+0000","last_change":"2023-11-28T11:56:39.947689+0000","last_active":"2023-11-28T11:56:43.967511+0000","last_peered":"2023-11-28T11:56:43.967511+0000","last_clean":"2023-11-28T11:56:43.967511+0000","last_became_active":"2023-11-28T11:56:39.947425+0000","last_became_peered":"2023-11-28T11:56:39.947425+0000","last_unstale":"2023-11-28T11:56:43.967511+0000","last_undegraded":"2023-11-28T11:56:43.967511+0000","last_fullsized":"2023-11-28T11:56:43.967511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:49:14.776024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.968711+0000","last_change":"2023-11-28T11:56:34.384999+0000","last_active":"2023-11-28T11:56:43.968711+0000","last_peered":"2023-11-28T11:56:43.968711+0000","last_clean":"2023-11-28T11:56:43.968711+0000","last_became_active":"2023-11-28T11:56:34.384531+0000","last_became_peered":"2023-11-28T11:56:34.384531+0000","last_unstale":"2023-11-28T11:56:43.968711+0000","last_undegraded":"2023-11-28T11:56:43.968711+0000","last_fullsized":"2023-11-28T11:56:43.968711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:09:50.083366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.966872+0000","last_change":"2023-11-28T11:56:39.468628+0000","last_active":"2023-11-28T11:56:43.966872+0000","last_peered":"2023-11-28T11:56:43.966872+0000","last_clean":"2023-11-28T11:56:43.966872+0000","last_became_active":"2023-11-28T11:56:39.467602+0000","last_became_peered":"2023-11-28T11:56:39.467602+0000","last_unstale":"2023-11-28T11:56:43.966872+0000","last_undegraded":"2023-11-28T11:56:43.966872+0000","last_fullsized":"2023-11-28T11:56:43.966872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:49:49.321158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.457910+0000","last_change":"2023-11-28T11:56:43.989103+0000","last_active":"2023-11-28T11:56:44.457910+0000","last_peered":"2023-11-28T11:56:44.457910+0000","last_clean":"2023-11-28T11:56:44.457910+0000","last_became_active":"2023-11-28T11:56:43.981649+0000","last_became_peered":"2023-11-28T11:56:43.981649+0000","last_unstale":"2023-11-28T11:56:44.457910+0000","last_undegraded":"2023-11-28T11:56:44.457910+0000","last_fullsized":"2023-11-28T11:56:44.457910+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:38:25.615361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.968481+0000","last_change":"2023-11-28T11:56:39.942485+0000","last_active":"2023-11-28T11:56:43.968481+0000","last_peered":"2023-11-28T11:56:43.968481+0000","last_clean":"2023-11-28T11:56:43.968481+0000","last_became_active":"2023-11-28T11:56:39.941112+0000","last_became_peered":"2023-11-28T11:56:39.941112+0000","last_unstale":"2023-11-28T11:56:43.968481+0000","last_undegraded":"2023-11-28T11:56:43.968481+0000","last_fullsized":"2023-11-28T11:56:43.968481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:47:39.671110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960251+0000","last_change":"2023-11-28T11:56:39.467432+0000","last_active":"2023-11-28T11:56:43.960251+0000","last_peered":"2023-11-28T11:56:43.960251+0000","last_clean":"2023-11-28T11:56:43.960251+0000","last_became_active":"2023-11-28T11:56:39.466982+0000","last_became_peered":"2023-11-28T11:56:39.466982+0000","last_unstale":"2023-11-28T11:56:43.960251+0000","last_undegraded":"2023-11-28T11:56:43.960251+0000","last_fullsized":"2023-11-28T11:56:43.960251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:35:56.115422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.965360+0000","last_change":"2023-11-28T11:56:34.389076+0000","last_active":"2023-11-28T11:56:43.965360+0000","last_peered":"2023-11-28T11:56:43.965360+0000","last_clean":"2023-11-28T11:56:43.965360+0000","last_became_active":"2023-11-28T11:56:34.388689+0000","last_became_peered":"2023-11-28T11:56:34.388689+0000","last_unstale":"2023-11-28T11:56:43.965360+0000","last_undegraded":"2023-11-28T11:56:43.965360+0000","last_fullsized":"2023-11-28T11:56:43.965360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:20.936349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.457737+0000","last_change":"2023-11-28T11:56:43.989060+0000","last_active":"2023-11-28T11:56:44.457737+0000","last_peered":"2023-11-28T11:56:44.457737+0000","last_clean":"2023-11-28T11:56:44.457737+0000","last_became_active":"2023-11-28T11:56:43.981599+0000","last_became_peered":"2023-11-28T11:56:43.981599+0000","last_unstale":"2023-11-28T11:56:44.457737+0000","last_undegraded":"2023-11-28T11:56:44.457737+0000","last_fullsized":"2023-11-28T11:56:44.457737+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:04:37.482968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.971330+0000","last_change":"2023-11-28T11:56:39.953419+0000","last_active":"2023-11-28T11:56:43.971330+0000","last_peered":"2023-11-28T11:56:43.971330+0000","last_clean":"2023-11-28T11:56:43.971330+0000","last_became_active":"2023-11-28T11:56:39.950287+0000","last_became_peered":"2023-11-28T11:56:39.950287+0000","last_unstale":"2023-11-28T11:56:43.971330+0000","last_undegraded":"2023-11-28T11:56:43.971330+0000","last_fullsized":"2023-11-28T11:56:43.971330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:15:38.977863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.965505+0000","last_change":"2023-11-28T11:56:39.467239+0000","last_active":"2023-11-28T11:56:43.965505+0000","last_peered":"2023-11-28T11:56:43.965505+0000","last_clean":"2023-11-28T11:56:43.965505+0000","last_became_active":"2023-11-28T11:56:39.466964+0000","last_became_peered":"2023-11-28T11:56:39.466964+0000","last_unstale":"2023-11-28T11:56:43.965505+0000","last_undegraded":"2023-11-28T11:56:43.965505+0000","last_fullsized":"2023-11-28T11:56:43.965505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:54.418908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.962524+0000","last_change":"2023-11-28T11:56:34.486178+0000","last_active":"2023-11-28T11:56:43.962524+0000","last_peered":"2023-11-28T11:56:43.962524+0000","last_clean":"2023-11-28T11:56:43.962524+0000","last_became_active":"2023-11-28T11:56:34.485702+0000","last_became_peered":"2023-11-28T11:56:34.485702+0000","last_unstale":"2023-11-28T11:56:43.962524+0000","last_undegraded":"2023-11-28T11:56:43.962524+0000","last_fullsized":"2023-11-28T11:56:43.962524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:06.323407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.570721+0000","last_change":"2023-11-28T11:56:43.979672+0000","last_active":"2023-11-28T11:56:44.570721+0000","last_peered":"2023-11-28T11:56:44.570721+0000","last_clean":"2023-11-28T11:56:44.570721+0000","last_became_active":"2023-11-28T11:56:43.978974+0000","last_became_peered":"2023-11-28T11:56:43.978974+0000","last_unstale":"2023-11-28T11:56:44.570721+0000","last_undegraded":"2023-11-28T11:56:44.570721+0000","last_fullsized":"2023-11-28T11:56:44.570721+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:15.285239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.974511+0000","last_change":"2023-11-28T11:56:39.957142+0000","last_active":"2023-11-28T11:56:43.974511+0000","last_peered":"2023-11-28T11:56:43.974511+0000","last_clean":"2023-11-28T11:56:43.974511+0000","last_became_active":"2023-11-28T11:56:39.956844+0000","last_became_peered":"2023-11-28T11:56:39.956844+0000","last_unstale":"2023-11-28T11:56:43.974511+0000","last_undegraded":"2023-11-28T11:56:43.974511+0000","last_fullsized":"2023-11-28T11:56:43.974511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:04.287216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.957703+0000","last_change":"2023-11-28T11:56:39.474271+0000","last_active":"2023-11-28T11:56:43.957703+0000","last_peered":"2023-11-28T11:56:43.957703+0000","last_clean":"2023-11-28T11:56:43.957703+0000","last_became_active":"2023-11-28T11:56:39.473993+0000","last_became_peered":"2023-11-28T11:56:39.473993+0000","last_unstale":"2023-11-28T11:56:43.957703+0000","last_undegraded":"2023-11-28T11:56:43.957703+0000","last_fullsized":"2023-11-28T11:56:43.957703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:20:01.703553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952292+0000","last_change":"2023-11-28T11:56:34.387293+0000","last_active":"2023-11-28T11:56:43.952292+0000","last_peered":"2023-11-28T11:56:43.952292+0000","last_clean":"2023-11-28T11:56:43.952292+0000","last_became_active":"2023-11-28T11:56:34.386976+0000","last_became_peered":"2023-11-28T11:56:34.386976+0000","last_unstale":"2023-11-28T11:56:43.952292+0000","last_undegraded":"2023-11-28T11:56:43.952292+0000","last_fullsized":"2023-11-28T11:56:43.952292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:32.704729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.570544+0000","last_change":"2023-11-28T11:56:43.995313+0000","last_active":"2023-11-28T11:56:44.570544+0000","last_peered":"2023-11-28T11:56:44.570544+0000","last_clean":"2023-11-28T11:56:44.570544+0000","last_became_active":"2023-11-28T11:56:43.994793+0000","last_became_peered":"2023-11-28T11:56:43.994793+0000","last_unstale":"2023-11-28T11:56:44.570544+0000","last_undegraded":"2023-11-28T11:56:44.570544+0000","last_fullsized":"2023-11-28T11:56:44.570544+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:38:23.071293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.953439+0000","last_change":"2023-11-28T11:56:39.927130+0000","last_active":"2023-11-28T11:56:43.953439+0000","last_peered":"2023-11-28T11:56:43.953439+0000","last_clean":"2023-11-28T11:56:43.953439+0000","last_became_active":"2023-11-28T11:56:39.926834+0000","last_became_peered":"2023-11-28T11:56:39.926834+0000","last_unstale":"2023-11-28T11:56:43.953439+0000","last_undegraded":"2023-11-28T11:56:43.953439+0000","last_fullsized":"2023-11-28T11:56:43.953439+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:03:50.474199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952514+0000","last_change":"2023-11-28T11:56:39.460516+0000","last_active":"2023-11-28T11:56:43.952514+0000","last_peered":"2023-11-28T11:56:43.952514+0000","last_clean":"2023-11-28T11:56:43.952514+0000","last_became_active":"2023-11-28T11:56:39.460151+0000","last_became_peered":"2023-11-28T11:56:39.460151+0000","last_unstale":"2023-11-28T11:56:43.952514+0000","last_undegraded":"2023-11-28T11:56:43.952514+0000","last_fullsized":"2023-11-28T11:56:43.952514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:52:05.494184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.972495+0000","last_change":"2023-11-28T11:56:34.389222+0000","last_active":"2023-11-28T11:56:43.972495+0000","last_peered":"2023-11-28T11:56:43.972495+0000","last_clean":"2023-11-28T11:56:43.972495+0000","last_became_active":"2023-11-28T11:56:34.388671+0000","last_became_peered":"2023-11-28T11:56:34.388671+0000","last_unstale":"2023-11-28T11:56:43.972495+0000","last_undegraded":"2023-11-28T11:56:43.972495+0000","last_fullsized":"2023-11-28T11:56:43.972495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:32.704729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952429+0000","last_change":"2023-11-28T11:56:28.472008+0000","last_active":"2023-11-28T11:56:43.952429+0000","last_peered":"2023-11-28T11:56:43.952429+0000","last_clean":"2023-11-28T11:56:43.952429+0000","last_became_active":"2023-11-28T11:56:28.469273+0000","last_became_peered":"2023-11-28T11:56:28.469273+0000","last_unstale":"2023-11-28T11:56:43.952429+0000","last_undegraded":"2023-11-28T11:56:43.952429+0000","last_fullsized":"2023-11-28T11:56:43.952429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:27.291192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:27.291192+0000","last_clean_scrub_stamp":"2023-11-28T11:56:27.291192+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:14:48.860420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.571768+0000","last_change":"2023-11-28T11:56:43.982227+0000","last_active":"2023-11-28T11:56:44.571768+0000","last_peered":"2023-11-28T11:56:44.571768+0000","last_clean":"2023-11-28T11:56:44.571768+0000","last_became_active":"2023-11-28T11:56:43.980406+0000","last_became_peered":"2023-11-28T11:56:43.980406+0000","last_unstale":"2023-11-28T11:56:44.571768+0000","last_undegraded":"2023-11-28T11:56:44.571768+0000","last_fullsized":"2023-11-28T11:56:44.571768+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:18:10.194854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.971411+0000","last_change":"2023-11-28T11:56:39.945082+0000","last_active":"2023-11-28T11:56:43.971411+0000","last_peered":"2023-11-28T11:56:43.971411+0000","last_clean":"2023-11-28T11:56:43.971411+0000","last_became_active":"2023-11-28T11:56:39.943905+0000","last_became_peered":"2023-11-28T11:56:39.943905+0000","last_unstale":"2023-11-28T11:56:43.971411+0000","last_undegraded":"2023-11-28T11:56:43.971411+0000","last_fullsized":"2023-11-28T11:56:43.971411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:59:04.313406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952622+0000","last_change":"2023-11-28T11:56:39.465139+0000","last_active":"2023-11-28T11:56:43.952622+0000","last_peered":"2023-11-28T11:56:43.952622+0000","last_clean":"2023-11-28T11:56:43.952622+0000","last_became_active":"2023-11-28T11:56:39.464873+0000","last_became_peered":"2023-11-28T11:56:39.464873+0000","last_unstale":"2023-11-28T11:56:43.952622+0000","last_undegraded":"2023-11-28T11:56:43.952622+0000","last_fullsized":"2023-11-28T11:56:43.952622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:15:59.693915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.453970+0000","last_change":"2023-11-28T11:56:43.985102+0000","last_active":"2023-11-28T11:56:44.453970+0000","last_peered":"2023-11-28T11:56:44.453970+0000","last_clean":"2023-11-28T11:56:44.453970+0000","last_became_active":"2023-11-28T11:56:43.981972+0000","last_became_peered":"2023-11-28T11:56:43.981972+0000","last_unstale":"2023-11-28T11:56:44.453970+0000","last_undegraded":"2023-11-28T11:56:44.453970+0000","last_fullsized":"2023-11-28T11:56:44.453970+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:55:56.798336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.962406+0000","last_change":"2023-11-28T11:56:39.927380+0000","last_active":"2023-11-28T11:56:43.962406+0000","last_peered":"2023-11-28T11:56:43.962406+0000","last_clean":"2023-11-28T11:56:43.962406+0000","last_became_active":"2023-11-28T11:56:39.927049+0000","last_became_peered":"2023-11-28T11:56:39.927049+0000","last_unstale":"2023-11-28T11:56:43.962406+0000","last_undegraded":"2023-11-28T11:56:43.962406+0000","last_fullsized":"2023-11-28T11:56:43.962406+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:53:07.604891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960844+0000","last_change":"2023-11-28T11:56:39.465718+0000","last_active":"2023-11-28T11:56:43.960844+0000","last_peered":"2023-11-28T11:56:43.960844+0000","last_clean":"2023-11-28T11:56:43.960844+0000","last_became_active":"2023-11-28T11:56:39.465452+0000","last_became_peered":"2023-11-28T11:56:39.465452+0000","last_unstale":"2023-11-28T11:56:43.960844+0000","last_undegraded":"2023-11-28T11:56:43.960844+0000","last_fullsized":"2023-11-28T11:56:43.960844+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:52:05.494184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.570452+0000","last_change":"2023-11-28T11:56:43.982616+0000","last_active":"2023-11-28T11:56:44.570452+0000","last_peered":"2023-11-28T11:56:44.570452+0000","last_clean":"2023-11-28T11:56:44.570452+0000","last_became_active":"2023-11-28T11:56:43.982223+0000","last_became_peered":"2023-11-28T11:56:43.982223+0000","last_unstale":"2023-11-28T11:56:44.570452+0000","last_undegraded":"2023-11-28T11:56:44.570452+0000","last_fullsized":"2023-11-28T11:56:44.570452+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:03:46.537759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.963773+0000","last_change":"2023-11-28T11:56:39.941619+0000","last_active":"2023-11-28T11:56:43.963773+0000","last_peered":"2023-11-28T11:56:43.963773+0000","last_clean":"2023-11-28T11:56:43.963773+0000","last_became_active":"2023-11-28T11:56:39.941343+0000","last_became_peered":"2023-11-28T11:56:39.941343+0000","last_unstale":"2023-11-28T11:56:43.963773+0000","last_undegraded":"2023-11-28T11:56:43.963773+0000","last_fullsized":"2023-11-28T11:56:43.963773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:09:05.982770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960394+0000","last_change":"2023-11-28T11:56:39.469027+0000","last_active":"2023-11-28T11:56:43.960394+0000","last_peered":"2023-11-28T11:56:43.960394+0000","last_clean":"2023-11-28T11:56:43.960394+0000","last_became_active":"2023-11-28T11:56:39.468738+0000","last_became_peered":"2023-11-28T11:56:39.468738+0000","last_unstale":"2023-11-28T11:56:43.960394+0000","last_undegraded":"2023-11-28T11:56:43.960394+0000","last_fullsized":"2023-11-28T11:56:43.960394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:55:09.019742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.573769+0000","last_change":"2023-11-28T11:56:44.002367+0000","last_active":"2023-11-28T11:56:44.573769+0000","last_peered":"2023-11-28T11:56:44.573769+0000","last_clean":"2023-11-28T11:56:44.573769+0000","last_became_active":"2023-11-28T11:56:44.002098+0000","last_became_peered":"2023-11-28T11:56:44.002098+0000","last_unstale":"2023-11-28T11:56:44.573769+0000","last_undegraded":"2023-11-28T11:56:44.573769+0000","last_fullsized":"2023-11-28T11:56:44.573769+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:34:06.872250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960453+0000","last_change":"2023-11-28T11:56:39.934523+0000","last_active":"2023-11-28T11:56:43.960453+0000","last_peered":"2023-11-28T11:56:43.960453+0000","last_clean":"2023-11-28T11:56:43.960453+0000","last_became_active":"2023-11-28T11:56:39.926004+0000","last_became_peered":"2023-11-28T11:56:39.926004+0000","last_unstale":"2023-11-28T11:56:43.960453+0000","last_undegraded":"2023-11-28T11:56:43.960453+0000","last_fullsized":"2023-11-28T11:56:43.960453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:39:50.872604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"24'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.954294+0000","last_change":"2023-11-28T11:56:39.464276+0000","last_active":"2023-11-28T11:56:43.954294+0000","last_peered":"2023-11-28T11:56:43.954294+0000","last_clean":"2023-11-28T11:56:43.954294+0000","last_became_active":"2023-11-28T11:56:39.463731+0000","last_became_peered":"2023-11-28T11:56:39.463731+0000","last_unstale":"2023-11-28T11:56:43.954294+0000","last_undegraded":"2023-11-28T11:56:43.954294+0000","last_fullsized":"2023-11-28T11:56:43.954294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:52:48.600084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.570251+0000","last_change":"2023-11-28T11:56:43.988077+0000","last_active":"2023-11-28T11:56:44.570251+0000","last_peered":"2023-11-28T11:56:44.570251+0000","last_clean":"2023-11-28T11:56:44.570251+0000","last_became_active":"2023-11-28T11:56:43.987519+0000","last_became_peered":"2023-11-28T11:56:43.987519+0000","last_unstale":"2023-11-28T11:56:44.570251+0000","last_undegraded":"2023-11-28T11:56:44.570251+0000","last_fullsized":"2023-11-28T11:56:44.570251+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:27:49.851056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960239+0000","last_change":"2023-11-28T11:56:39.943627+0000","last_active":"2023-11-28T11:56:43.960239+0000","last_peered":"2023-11-28T11:56:43.960239+0000","last_clean":"2023-11-28T11:56:43.960239+0000","last_became_active":"2023-11-28T11:56:39.943358+0000","last_became_peered":"2023-11-28T11:56:39.943358+0000","last_unstale":"2023-11-28T11:56:43.960239+0000","last_undegraded":"2023-11-28T11:56:43.960239+0000","last_fullsized":"2023-11-28T11:56:43.960239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:54:54.554070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.963730+0000","last_change":"2023-11-28T11:56:39.459974+0000","last_active":"2023-11-28T11:56:43.963730+0000","last_peered":"2023-11-28T11:56:43.963730+0000","last_clean":"2023-11-28T11:56:43.963730+0000","last_became_active":"2023-11-28T11:56:39.459621+0000","last_became_peered":"2023-11-28T11:56:39.459621+0000","last_unstale":"2023-11-28T11:56:43.963730+0000","last_undegraded":"2023-11-28T11:56:43.963730+0000","last_fullsized":"2023-11-28T11:56:43.963730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:57:44.601498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.569869+0000","last_change":"2023-11-28T11:56:43.987926+0000","last_active":"2023-11-28T11:56:44.569869+0000","last_peered":"2023-11-28T11:56:44.569869+0000","last_clean":"2023-11-28T11:56:44.569869+0000","last_became_active":"2023-11-28T11:56:43.987447+0000","last_became_peered":"2023-11-28T11:56:43.987447+0000","last_unstale":"2023-11-28T11:56:44.569869+0000","last_undegraded":"2023-11-28T11:56:44.569869+0000","last_fullsized":"2023-11-28T11:56:44.569869+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:48:08.970147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960270+0000","last_change":"2023-11-28T11:56:39.944531+0000","last_active":"2023-11-28T11:56:43.960270+0000","last_peered":"2023-11-28T11:56:43.960270+0000","last_clean":"2023-11-28T11:56:43.960270+0000","last_became_active":"2023-11-28T11:56:39.944262+0000","last_became_peered":"2023-11-28T11:56:39.944262+0000","last_unstale":"2023-11-28T11:56:43.960270+0000","last_undegraded":"2023-11-28T11:56:43.960270+0000","last_fullsized":"2023-11-28T11:56:43.960270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:36:30.674628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.953951+0000","last_change":"2023-11-28T11:56:39.468498+0000","last_active":"2023-11-28T11:56:43.953951+0000","last_peered":"2023-11-28T11:56:43.953951+0000","last_clean":"2023-11-28T11:56:43.953951+0000","last_became_active":"2023-11-28T11:56:39.468198+0000","last_became_peered":"2023-11-28T11:56:39.468198+0000","last_unstale":"2023-11-28T11:56:43.953951+0000","last_undegraded":"2023-11-28T11:56:43.953951+0000","last_fullsized":"2023-11-28T11:56:43.953951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:30:31.377988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.569939+0000","last_change":"2023-11-28T11:56:43.996490+0000","last_active":"2023-11-28T11:56:44.569939+0000","last_peered":"2023-11-28T11:56:44.569939+0000","last_clean":"2023-11-28T11:56:44.569939+0000","last_became_active":"2023-11-28T11:56:43.996074+0000","last_became_peered":"2023-11-28T11:56:43.996074+0000","last_unstale":"2023-11-28T11:56:44.569939+0000","last_undegraded":"2023-11-28T11:56:44.569939+0000","last_fullsized":"2023-11-28T11:56:44.569939+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:01:51.310559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960636+0000","last_change":"2023-11-28T11:56:39.946101+0000","last_active":"2023-11-28T11:56:43.960636+0000","last_peered":"2023-11-28T11:56:43.960636+0000","last_clean":"2023-11-28T11:56:43.960636+0000","last_became_active":"2023-11-28T11:56:39.945797+0000","last_became_peered":"2023-11-28T11:56:39.945797+0000","last_unstale":"2023-11-28T11:56:43.960636+0000","last_undegraded":"2023-11-28T11:56:43.960636+0000","last_fullsized":"2023-11-28T11:56:43.960636+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:04:33.061948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.954377+0000","last_change":"2023-11-28T11:56:39.468642+0000","last_active":"2023-11-28T11:56:43.954377+0000","last_peered":"2023-11-28T11:56:43.954377+0000","last_clean":"2023-11-28T11:56:43.954377+0000","last_became_active":"2023-11-28T11:56:39.468261+0000","last_became_peered":"2023-11-28T11:56:39.468261+0000","last_unstale":"2023-11-28T11:56:43.954377+0000","last_undegraded":"2023-11-28T11:56:43.954377+0000","last_fullsized":"2023-11-28T11:56:43.954377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:09:04.506578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.569358+0000","last_change":"2023-11-28T11:56:44.001612+0000","last_active":"2023-11-28T11:56:44.569358+0000","last_peered":"2023-11-28T11:56:44.569358+0000","last_clean":"2023-11-28T11:56:44.569358+0000","last_became_active":"2023-11-28T11:56:44.001218+0000","last_became_peered":"2023-11-28T11:56:44.001218+0000","last_unstale":"2023-11-28T11:56:44.569358+0000","last_undegraded":"2023-11-28T11:56:44.569358+0000","last_fullsized":"2023-11-28T11:56:44.569358+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:47.972845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.962655+0000","last_change":"2023-11-28T11:56:39.937560+0000","last_active":"2023-11-28T11:56:43.962655+0000","last_peered":"2023-11-28T11:56:43.962655+0000","last_clean":"2023-11-28T11:56:43.962655+0000","last_became_active":"2023-11-28T11:56:39.935813+0000","last_became_peered":"2023-11-28T11:56:39.935813+0000","last_unstale":"2023-11-28T11:56:43.962655+0000","last_undegraded":"2023-11-28T11:56:43.962655+0000","last_fullsized":"2023-11-28T11:56:43.962655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:39:50.872604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.954504+0000","last_change":"2023-11-28T11:56:39.460965+0000","last_active":"2023-11-28T11:56:43.954504+0000","last_peered":"2023-11-28T11:56:43.954504+0000","last_clean":"2023-11-28T11:56:43.954504+0000","last_became_active":"2023-11-28T11:56:39.460589+0000","last_became_peered":"2023-11-28T11:56:39.460589+0000","last_unstale":"2023-11-28T11:56:43.954504+0000","last_undegraded":"2023-11-28T11:56:43.954504+0000","last_fullsized":"2023-11-28T11:56:43.954504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:14:49.707818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.571715+0000","last_change":"2023-11-28T11:56:43.975101+0000","last_active":"2023-11-28T11:56:44.571715+0000","last_peered":"2023-11-28T11:56:44.571715+0000","last_clean":"2023-11-28T11:56:44.571715+0000","last_became_active":"2023-11-28T11:56:43.974532+0000","last_became_peered":"2023-11-28T11:56:43.974532+0000","last_unstale":"2023-11-28T11:56:44.571715+0000","last_undegraded":"2023-11-28T11:56:44.571715+0000","last_fullsized":"2023-11-28T11:56:44.571715+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:34:06.872250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.570363+0000","last_change":"2023-11-28T11:56:43.980824+0000","last_active":"2023-11-28T11:56:44.570363+0000","last_peered":"2023-11-28T11:56:44.570363+0000","last_clean":"2023-11-28T11:56:44.570363+0000","last_became_active":"2023-11-28T11:56:43.978868+0000","last_became_peered":"2023-11-28T11:56:43.978868+0000","last_unstale":"2023-11-28T11:56:44.570363+0000","last_undegraded":"2023-11-28T11:56:44.570363+0000","last_fullsized":"2023-11-28T11:56:44.570363+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:03:18.915760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"24'8","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.953542+0000","last_change":"2023-11-28T11:56:39.463107+0000","last_active":"2023-11-28T11:56:43.953542+0000","last_peered":"2023-11-28T11:56:43.953542+0000","last_clean":"2023-11-28T11:56:43.953542+0000","last_became_active":"2023-11-28T11:56:39.462771+0000","last_became_peered":"2023-11-28T11:56:39.462771+0000","last_unstale":"2023-11-28T11:56:43.953542+0000","last_undegraded":"2023-11-28T11:56:43.953542+0000","last_fullsized":"2023-11-28T11:56:43.953542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:26:50.340796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.959057+0000","last_change":"2023-11-28T11:56:39.935086+0000","last_active":"2023-11-28T11:56:43.959057+0000","last_peered":"2023-11-28T11:56:43.959057+0000","last_clean":"2023-11-28T11:56:43.959057+0000","last_became_active":"2023-11-28T11:56:39.934832+0000","last_became_peered":"2023-11-28T11:56:39.934832+0000","last_unstale":"2023-11-28T11:56:43.959057+0000","last_undegraded":"2023-11-28T11:56:43.959057+0000","last_fullsized":"2023-11-28T11:56:43.959057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:10:06.958523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.575548+0000","last_change":"2023-11-28T11:56:43.996688+0000","last_active":"2023-11-28T11:56:44.575548+0000","last_peered":"2023-11-28T11:56:44.575548+0000","last_clean":"2023-11-28T11:56:44.575548+0000","last_became_active":"2023-11-28T11:56:43.996253+0000","last_became_peered":"2023-11-28T11:56:43.996253+0000","last_unstale":"2023-11-28T11:56:44.575548+0000","last_undegraded":"2023-11-28T11:56:44.575548+0000","last_fullsized":"2023-11-28T11:56:44.575548+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:20:35.086687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952840+0000","last_change":"2023-11-28T11:56:39.471710+0000","last_active":"2023-11-28T11:56:43.952840+0000","last_peered":"2023-11-28T11:56:43.952840+0000","last_clean":"2023-11-28T11:56:43.952840+0000","last_became_active":"2023-11-28T11:56:39.471423+0000","last_became_peered":"2023-11-28T11:56:39.471423+0000","last_unstale":"2023-11-28T11:56:43.952840+0000","last_undegraded":"2023-11-28T11:56:43.952840+0000","last_fullsized":"2023-11-28T11:56:43.952840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:41.737631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.974564+0000","last_change":"2023-11-28T11:56:39.932531+0000","last_active":"2023-11-28T11:56:43.974564+0000","last_peered":"2023-11-28T11:56:43.974564+0000","last_clean":"2023-11-28T11:56:43.974564+0000","last_became_active":"2023-11-28T11:56:39.932235+0000","last_became_peered":"2023-11-28T11:56:39.932235+0000","last_unstale":"2023-11-28T11:56:43.974564+0000","last_undegraded":"2023-11-28T11:56:43.974564+0000","last_fullsized":"2023-11-28T11:56:43.974564+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:37:59.805024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960058+0000","last_change":"2023-11-28T11:56:39.459466+0000","last_active":"2023-11-28T11:56:43.960058+0000","last_peered":"2023-11-28T11:56:43.960058+0000","last_clean":"2023-11-28T11:56:43.960058+0000","last_became_active":"2023-11-28T11:56:39.459207+0000","last_became_peered":"2023-11-28T11:56:39.459207+0000","last_unstale":"2023-11-28T11:56:43.960058+0000","last_undegraded":"2023-11-28T11:56:43.960058+0000","last_fullsized":"2023-11-28T11:56:43.960058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:21:06.192836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.966700+0000","last_change":"2023-11-28T11:56:39.947121+0000","last_active":"2023-11-28T11:56:43.966700+0000","last_peered":"2023-11-28T11:56:43.966700+0000","last_clean":"2023-11-28T11:56:43.966700+0000","last_became_active":"2023-11-28T11:56:39.944854+0000","last_became_peered":"2023-11-28T11:56:39.944854+0000","last_unstale":"2023-11-28T11:56:43.966700+0000","last_undegraded":"2023-11-28T11:56:43.966700+0000","last_fullsized":"2023-11-28T11:56:43.966700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:53:07.604891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.572743+0000","last_change":"2023-11-28T11:56:43.976187+0000","last_active":"2023-11-28T11:56:44.572743+0000","last_peered":"2023-11-28T11:56:44.572743+0000","last_clean":"2023-11-28T11:56:44.572743+0000","last_became_active":"2023-11-28T11:56:43.975691+0000","last_became_peered":"2023-11-28T11:56:43.975691+0000","last_unstale":"2023-11-28T11:56:44.572743+0000","last_undegraded":"2023-11-28T11:56:44.572743+0000","last_fullsized":"2023-11-28T11:56:44.572743+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:38:23.071293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"24'2","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952993+0000","last_change":"2023-11-28T11:56:39.473334+0000","last_active":"2023-11-28T11:56:43.952993+0000","last_peered":"2023-11-28T11:56:43.952993+0000","last_clean":"2023-11-28T11:56:43.952993+0000","last_became_active":"2023-11-28T11:56:39.472989+0000","last_became_peered":"2023-11-28T11:56:39.472989+0000","last_unstale":"2023-11-28T11:56:43.952993+0000","last_undegraded":"2023-11-28T11:56:43.952993+0000","last_fullsized":"2023-11-28T11:56:43.952993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:36:29.668082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.953207+0000","last_change":"2023-11-28T11:56:39.942962+0000","last_active":"2023-11-28T11:56:43.953207+0000","last_peered":"2023-11-28T11:56:43.953207+0000","last_clean":"2023-11-28T11:56:43.953207+0000","last_became_active":"2023-11-28T11:56:39.942628+0000","last_became_peered":"2023-11-28T11:56:39.942628+0000","last_unstale":"2023-11-28T11:56:43.953207+0000","last_undegraded":"2023-11-28T11:56:43.953207+0000","last_fullsized":"2023-11-28T11:56:43.953207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:09:53.018437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.571109+0000","last_change":"2023-11-28T11:56:43.983804+0000","last_active":"2023-11-28T11:56:44.571109+0000","last_peered":"2023-11-28T11:56:44.571109+0000","last_clean":"2023-11-28T11:56:44.571109+0000","last_became_active":"2023-11-28T11:56:43.983397+0000","last_became_peered":"2023-11-28T11:56:43.983397+0000","last_unstale":"2023-11-28T11:56:44.571109+0000","last_undegraded":"2023-11-28T11:56:44.571109+0000","last_fullsized":"2023-11-28T11:56:44.571109+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:16.749468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.953340+0000","last_change":"2023-11-28T11:56:39.938472+0000","last_active":"2023-11-28T11:56:43.953340+0000","last_peered":"2023-11-28T11:56:43.953340+0000","last_clean":"2023-11-28T11:56:43.953340+0000","last_became_active":"2023-11-28T11:56:39.938186+0000","last_became_peered":"2023-11-28T11:56:39.938186+0000","last_unstale":"2023-11-28T11:56:43.953340+0000","last_undegraded":"2023-11-28T11:56:43.953340+0000","last_fullsized":"2023-11-28T11:56:43.953340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:30:32.384534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952481+0000","last_change":"2023-11-28T11:56:39.947611+0000","last_active":"2023-11-28T11:56:43.952481+0000","last_peered":"2023-11-28T11:56:43.952481+0000","last_clean":"2023-11-28T11:56:43.952481+0000","last_became_active":"2023-11-28T11:56:39.947364+0000","last_became_peered":"2023-11-28T11:56:39.947364+0000","last_unstale":"2023-11-28T11:56:43.952481+0000","last_undegraded":"2023-11-28T11:56:43.952481+0000","last_fullsized":"2023-11-28T11:56:43.952481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:49:14.776024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.959741+0000","last_change":"2023-11-28T11:56:39.928631+0000","last_active":"2023-11-28T11:56:43.959741+0000","last_peered":"2023-11-28T11:56:43.959741+0000","last_clean":"2023-11-28T11:56:43.959741+0000","last_became_active":"2023-11-28T11:56:39.928360+0000","last_became_peered":"2023-11-28T11:56:39.928360+0000","last_unstale":"2023-11-28T11:56:43.959741+0000","last_undegraded":"2023-11-28T11:56:43.959741+0000","last_fullsized":"2023-11-28T11:56:43.959741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:09:53.018437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.954058+0000","last_change":"2023-11-28T11:56:39.935151+0000","last_active":"2023-11-28T11:56:43.954058+0000","last_peered":"2023-11-28T11:56:43.954058+0000","last_clean":"2023-11-28T11:56:43.954058+0000","last_became_active":"2023-11-28T11:56:39.934811+0000","last_became_peered":"2023-11-28T11:56:39.934811+0000","last_unstale":"2023-11-28T11:56:43.954058+0000","last_undegraded":"2023-11-28T11:56:43.954058+0000","last_fullsized":"2023-11-28T11:56:43.954058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:24:26.563114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.968635+0000","last_change":"2023-11-28T11:56:39.940870+0000","last_active":"2023-11-28T11:56:43.968635+0000","last_peered":"2023-11-28T11:56:43.968635+0000","last_clean":"2023-11-28T11:56:43.968635+0000","last_became_active":"2023-11-28T11:56:39.940598+0000","last_became_peered":"2023-11-28T11:56:39.940598+0000","last_unstale":"2023-11-28T11:56:43.968635+0000","last_undegraded":"2023-11-28T11:56:43.968635+0000","last_fullsized":"2023-11-28T11:56:43.968635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:14:50.714365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.966611+0000","last_change":"2023-11-28T11:56:39.953168+0000","last_active":"2023-11-28T11:56:43.966611+0000","last_peered":"2023-11-28T11:56:43.966611+0000","last_clean":"2023-11-28T11:56:43.966611+0000","last_became_active":"2023-11-28T11:56:39.951968+0000","last_became_peered":"2023-11-28T11:56:39.951968+0000","last_unstale":"2023-11-28T11:56:43.966611+0000","last_undegraded":"2023-11-28T11:56:43.966611+0000","last_fullsized":"2023-11-28T11:56:43.966611+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:08:24.197240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.970835+0000","last_change":"2023-11-28T11:56:39.946593+0000","last_active":"2023-11-28T11:56:43.970835+0000","last_peered":"2023-11-28T11:56:43.970835+0000","last_clean":"2023-11-28T11:56:43.970835+0000","last_became_active":"2023-11-28T11:56:39.944862+0000","last_became_peered":"2023-11-28T11:56:39.944862+0000","last_unstale":"2023-11-28T11:56:43.970835+0000","last_undegraded":"2023-11-28T11:56:43.970835+0000","last_fullsized":"2023-11-28T11:56:43.970835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:13:17.325195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.971180+0000","last_change":"2023-11-28T11:56:39.941059+0000","last_active":"2023-11-28T11:56:43.971180+0000","last_peered":"2023-11-28T11:56:43.971180+0000","last_clean":"2023-11-28T11:56:43.971180+0000","last_became_active":"2023-11-28T11:56:39.940781+0000","last_became_peered":"2023-11-28T11:56:39.940781+0000","last_unstale":"2023-11-28T11:56:43.971180+0000","last_undegraded":"2023-11-28T11:56:43.971180+0000","last_fullsized":"2023-11-28T11:56:43.971180+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:50:59.351619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952193+0000","last_change":"2023-11-28T11:56:39.950678+0000","last_active":"2023-11-28T11:56:43.952193+0000","last_peered":"2023-11-28T11:56:43.952193+0000","last_clean":"2023-11-28T11:56:43.952193+0000","last_became_active":"2023-11-28T11:56:39.948033+0000","last_became_peered":"2023-11-28T11:56:39.948033+0000","last_unstale":"2023-11-28T11:56:43.952193+0000","last_undegraded":"2023-11-28T11:56:43.952193+0000","last_fullsized":"2023-11-28T11:56:43.952193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:13:17.325195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952347+0000","last_change":"2023-11-28T11:56:39.926747+0000","last_active":"2023-11-28T11:56:43.952347+0000","last_peered":"2023-11-28T11:56:43.952347+0000","last_clean":"2023-11-28T11:56:43.952347+0000","last_became_active":"2023-11-28T11:56:39.926475+0000","last_became_peered":"2023-11-28T11:56:39.926475+0000","last_unstale":"2023-11-28T11:56:43.952347+0000","last_undegraded":"2023-11-28T11:56:43.952347+0000","last_fullsized":"2023-11-28T11:56:43.952347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:10:35.378054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.957922+0000","last_change":"2023-11-28T11:56:39.952645+0000","last_active":"2023-11-28T11:56:43.957922+0000","last_peered":"2023-11-28T11:56:43.957922+0000","last_clean":"2023-11-28T11:56:43.957922+0000","last_became_active":"2023-11-28T11:56:39.952363+0000","last_became_peered":"2023-11-28T11:56:39.952363+0000","last_unstale":"2023-11-28T11:56:43.957922+0000","last_undegraded":"2023-11-28T11:56:43.957922+0000","last_fullsized":"2023-11-28T11:56:43.957922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:43:39.611494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952872+0000","last_change":"2023-11-28T11:56:39.947249+0000","last_active":"2023-11-28T11:56:43.952872+0000","last_peered":"2023-11-28T11:56:43.952872+0000","last_clean":"2023-11-28T11:56:43.952872+0000","last_became_active":"2023-11-28T11:56:39.946423+0000","last_became_peered":"2023-11-28T11:56:39.946423+0000","last_unstale":"2023-11-28T11:56:43.952872+0000","last_undegraded":"2023-11-28T11:56:43.952872+0000","last_fullsized":"2023-11-28T11:56:43.952872+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:49:14.776024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960364+0000","last_change":"2023-11-28T11:56:39.934479+0000","last_active":"2023-11-28T11:56:43.960364+0000","last_peered":"2023-11-28T11:56:43.960364+0000","last_clean":"2023-11-28T11:56:43.960364+0000","last_became_active":"2023-11-28T11:56:39.928161+0000","last_became_peered":"2023-11-28T11:56:39.928161+0000","last_unstale":"2023-11-28T11:56:43.960364+0000","last_undegraded":"2023-11-28T11:56:43.960364+0000","last_fullsized":"2023-11-28T11:56:43.960364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:54:26.952553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.963038+0000","last_change":"2023-11-28T11:56:39.941392+0000","last_active":"2023-11-28T11:56:43.963038+0000","last_peered":"2023-11-28T11:56:43.963038+0000","last_clean":"2023-11-28T11:56:43.963038+0000","last_became_active":"2023-11-28T11:56:39.940495+0000","last_became_peered":"2023-11-28T11:56:39.940495+0000","last_unstale":"2023-11-28T11:56:43.963038+0000","last_undegraded":"2023-11-28T11:56:43.963038+0000","last_fullsized":"2023-11-28T11:56:43.963038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:20:02.710099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.962307+0000","last_change":"2023-11-28T11:56:39.945287+0000","last_active":"2023-11-28T11:56:43.962307+0000","last_peered":"2023-11-28T11:56:43.962307+0000","last_clean":"2023-11-28T11:56:43.962307+0000","last_became_active":"2023-11-28T11:56:39.942342+0000","last_became_peered":"2023-11-28T11:56:39.942342+0000","last_unstale":"2023-11-28T11:56:43.962307+0000","last_undegraded":"2023-11-28T11:56:43.962307+0000","last_fullsized":"2023-11-28T11:56:43.962307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:10:35.378054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.992453+0000","last_change":"2023-11-28T11:56:39.934499+0000","last_active":"2023-11-28T11:56:43.992453+0000","last_peered":"2023-11-28T11:56:43.992453+0000","last_clean":"2023-11-28T11:56:43.992453+0000","last_became_active":"2023-11-28T11:56:39.934253+0000","last_became_peered":"2023-11-28T11:56:39.934253+0000","last_unstale":"2023-11-28T11:56:43.992453+0000","last_undegraded":"2023-11-28T11:56:43.992453+0000","last_fullsized":"2023-11-28T11:56:43.992453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:45:29.746371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.959288+0000","last_change":"2023-11-28T11:56:39.941319+0000","last_active":"2023-11-28T11:56:43.959288+0000","last_peered":"2023-11-28T11:56:43.959288+0000","last_clean":"2023-11-28T11:56:43.959288+0000","last_became_active":"2023-11-28T11:56:39.941012+0000","last_became_peered":"2023-11-28T11:56:39.941012+0000","last_unstale":"2023-11-28T11:56:43.959288+0000","last_undegraded":"2023-11-28T11:56:43.959288+0000","last_fullsized":"2023-11-28T11:56:43.959288+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:08:24.197240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952737+0000","last_change":"2023-11-28T11:56:39.950163+0000","last_active":"2023-11-28T11:56:43.952737+0000","last_peered":"2023-11-28T11:56:43.952737+0000","last_clean":"2023-11-28T11:56:43.952737+0000","last_became_active":"2023-11-28T11:56:39.949823+0000","last_became_peered":"2023-11-28T11:56:39.949823+0000","last_unstale":"2023-11-28T11:56:43.952737+0000","last_undegraded":"2023-11-28T11:56:43.952737+0000","last_fullsized":"2023-11-28T11:56:43.952737+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:53:07.604891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.965275+0000","last_change":"2023-11-28T11:56:39.945909+0000","last_active":"2023-11-28T11:56:43.965275+0000","last_peered":"2023-11-28T11:56:43.965275+0000","last_clean":"2023-11-28T11:56:43.965275+0000","last_became_active":"2023-11-28T11:56:39.945628+0000","last_became_peered":"2023-11-28T11:56:39.945628+0000","last_unstale":"2023-11-28T11:56:43.965275+0000","last_undegraded":"2023-11-28T11:56:43.965275+0000","last_fullsized":"2023-11-28T11:56:43.965275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:47:39.671110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.967426+0000","last_change":"2023-11-28T11:56:39.949059+0000","last_active":"2023-11-28T11:56:43.967426+0000","last_peered":"2023-11-28T11:56:43.967426+0000","last_clean":"2023-11-28T11:56:43.967426+0000","last_became_active":"2023-11-28T11:56:39.948795+0000","last_became_peered":"2023-11-28T11:56:39.948795+0000","last_unstale":"2023-11-28T11:56:43.967426+0000","last_undegraded":"2023-11-28T11:56:43.967426+0000","last_fullsized":"2023-11-28T11:56:43.967426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:10:59.494745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.964659+0000","last_change":"2023-11-28T11:56:39.955527+0000","last_active":"2023-11-28T11:56:43.964659+0000","last_peered":"2023-11-28T11:56:43.964659+0000","last_clean":"2023-11-28T11:56:43.964659+0000","last_became_active":"2023-11-28T11:56:39.955190+0000","last_became_peered":"2023-11-28T11:56:39.955190+0000","last_unstale":"2023-11-28T11:56:43.964659+0000","last_undegraded":"2023-11-28T11:56:43.964659+0000","last_fullsized":"2023-11-28T11:56:43.964659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:31:52.674778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.963692+0000","last_change":"2023-11-28T11:56:39.950894+0000","last_active":"2023-11-28T11:56:43.963692+0000","last_peered":"2023-11-28T11:56:43.963692+0000","last_clean":"2023-11-28T11:56:43.963692+0000","last_became_active":"2023-11-28T11:56:39.950572+0000","last_became_peered":"2023-11-28T11:56:39.950572+0000","last_unstale":"2023-11-28T11:56:43.963692+0000","last_undegraded":"2023-11-28T11:56:43.963692+0000","last_fullsized":"2023-11-28T11:56:43.963692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:33:44.652949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.961221+0000","last_change":"2023-11-28T11:56:39.943609+0000","last_active":"2023-11-28T11:56:43.961221+0000","last_peered":"2023-11-28T11:56:43.961221+0000","last_clean":"2023-11-28T11:56:43.961221+0000","last_became_active":"2023-11-28T11:56:39.943334+0000","last_became_peered":"2023-11-28T11:56:39.943334+0000","last_unstale":"2023-11-28T11:56:43.961221+0000","last_undegraded":"2023-11-28T11:56:43.961221+0000","last_fullsized":"2023-11-28T11:56:43.961221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:15:38.977863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.991532+0000","last_change":"2023-11-28T11:56:39.937893+0000","last_active":"2023-11-28T11:56:43.991532+0000","last_peered":"2023-11-28T11:56:43.991532+0000","last_clean":"2023-11-28T11:56:43.991532+0000","last_became_active":"2023-11-28T11:56:39.936035+0000","last_became_peered":"2023-11-28T11:56:39.936035+0000","last_unstale":"2023-11-28T11:56:43.991532+0000","last_undegraded":"2023-11-28T11:56:43.991532+0000","last_fullsized":"2023-11-28T11:56:43.991532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:48:05.469323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.962560+0000","last_change":"2023-11-28T11:56:39.948688+0000","last_active":"2023-11-28T11:56:43.962560+0000","last_peered":"2023-11-28T11:56:43.962560+0000","last_clean":"2023-11-28T11:56:43.962560+0000","last_became_active":"2023-11-28T11:56:39.948372+0000","last_became_peered":"2023-11-28T11:56:39.948372+0000","last_unstale":"2023-11-28T11:56:43.962560+0000","last_undegraded":"2023-11-28T11:56:43.962560+0000","last_fullsized":"2023-11-28T11:56:43.962560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:49:14.776024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952119+0000","last_change":"2023-11-28T11:56:39.950877+0000","last_active":"2023-11-28T11:56:43.952119+0000","last_peered":"2023-11-28T11:56:43.952119+0000","last_clean":"2023-11-28T11:56:43.952119+0000","last_became_active":"2023-11-28T11:56:39.949415+0000","last_became_peered":"2023-11-28T11:56:39.949415+0000","last_unstale":"2023-11-28T11:56:43.952119+0000","last_undegraded":"2023-11-28T11:56:43.952119+0000","last_fullsized":"2023-11-28T11:56:43.952119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:15:38.977863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.959490+0000","last_change":"2023-11-28T11:56:39.940463+0000","last_active":"2023-11-28T11:56:43.959490+0000","last_peered":"2023-11-28T11:56:43.959490+0000","last_clean":"2023-11-28T11:56:43.959490+0000","last_became_active":"2023-11-28T11:56:39.940181+0000","last_became_peered":"2023-11-28T11:56:39.940181+0000","last_unstale":"2023-11-28T11:56:43.959490+0000","last_undegraded":"2023-11-28T11:56:43.959490+0000","last_fullsized":"2023-11-28T11:56:43.959490+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:39:27.124421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960539+0000","last_change":"2023-11-28T11:56:39.933634+0000","last_active":"2023-11-28T11:56:43.960539+0000","last_peered":"2023-11-28T11:56:43.960539+0000","last_clean":"2023-11-28T11:56:43.960539+0000","last_became_active":"2023-11-28T11:56:39.933388+0000","last_became_peered":"2023-11-28T11:56:39.933388+0000","last_unstale":"2023-11-28T11:56:43.960539+0000","last_undegraded":"2023-11-28T11:56:43.960539+0000","last_fullsized":"2023-11-28T11:56:43.960539+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:35:17.292824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.953846+0000","last_change":"2023-11-28T11:56:39.929640+0000","last_active":"2023-11-28T11:56:43.953846+0000","last_peered":"2023-11-28T11:56:43.953846+0000","last_clean":"2023-11-28T11:56:43.953846+0000","last_became_active":"2023-11-28T11:56:39.926154+0000","last_became_peered":"2023-11-28T11:56:39.926154+0000","last_unstale":"2023-11-28T11:56:43.953846+0000","last_undegraded":"2023-11-28T11:56:43.953846+0000","last_fullsized":"2023-11-28T11:56:43.953846+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:09:05.513124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.963588+0000","last_change":"2023-11-28T11:56:39.927473+0000","last_active":"2023-11-28T11:56:43.963588+0000","last_peered":"2023-11-28T11:56:43.963588+0000","last_clean":"2023-11-28T11:56:43.963588+0000","last_became_active":"2023-11-28T11:56:39.927002+0000","last_became_peered":"2023-11-28T11:56:39.927002+0000","last_unstale":"2023-11-28T11:56:43.963588+0000","last_undegraded":"2023-11-28T11:56:43.963588+0000","last_fullsized":"2023-11-28T11:56:43.963588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:53:05.931879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.961138+0000","last_change":"2023-11-28T11:56:39.956928+0000","last_active":"2023-11-28T11:56:43.961138+0000","last_peered":"2023-11-28T11:56:43.961138+0000","last_clean":"2023-11-28T11:56:43.961138+0000","last_became_active":"2023-11-28T11:56:39.956676+0000","last_became_peered":"2023-11-28T11:56:39.956676+0000","last_unstale":"2023-11-28T11:56:43.961138+0000","last_undegraded":"2023-11-28T11:56:43.961138+0000","last_fullsized":"2023-11-28T11:56:43.961138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:24:26.563114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.959783+0000","last_change":"2023-11-28T11:56:39.948454+0000","last_active":"2023-11-28T11:56:43.959783+0000","last_peered":"2023-11-28T11:56:43.959783+0000","last_clean":"2023-11-28T11:56:43.959783+0000","last_became_active":"2023-11-28T11:56:39.948186+0000","last_became_peered":"2023-11-28T11:56:39.948186+0000","last_unstale":"2023-11-28T11:56:43.959783+0000","last_undegraded":"2023-11-28T11:56:43.959783+0000","last_fullsized":"2023-11-28T11:56:43.959783+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:55:32.097238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4386,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9300,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362540,"statfs":{"total":96636764160,"available":96627240960,"internally_reserved":0,"allocated":929792,"data_stored":719785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3959999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3779999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8116,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363724,"statfs":{"total":96636764160,"available":96628453376,"internally_reserved":0,"allocated":307200,"data_stored":125597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.351}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.385}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2709999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3100000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8188,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363652,"statfs":{"total":96636764160,"available":96628379648,"internally_reserved":0,"allocated":315392,"data_stored":126233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.484}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5840000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6679999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1819999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7649999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8264,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363576,"statfs":{"total":96636764160,"available":96628301824,"internally_reserved":0,"allocated":327680,"data_stored":129257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.327}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8184,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363656,"statfs":{"total":96636764160,"available":96628383744,"internally_reserved":0,"allocated":311296,"data_stored":125687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1890000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3009999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.353}]}]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8244,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363596,"statfs":{"total":96636764160,"available":96628322304,"internally_reserved":0,"allocated":307200,"data_stored":125597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1850000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4510000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4019999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8380000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.883}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9350000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7669999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8116,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363724,"statfs":{"total":96636764160,"available":96628453376,"internally_reserved":0,"allocated":307200,"data_stored":125597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4390000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.341}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9272,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362568,"statfs":{"total":96636764160,"available":96627269632,"internally_reserved":0,"allocated":901120,"data_stored":715612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:57:01.634 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T11:57:01.634 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-28T11:57:01.634 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-28T11:57:01.635 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-28T11:57:01.635 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-28T11:57:01.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.853+0000 7f36962b1700 1 Processor -- start 2023-11-28T11:57:01.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.853+0000 7f36962b1700 1 -- start start 2023-11-28T11:57:01.860 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.853+0000 7f36962b1700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3690160710 0x7f36900cc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:01.861 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.853+0000 7f36962b1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36900cc860 0x7f3690070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:01.861 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.857+0000 7f36962b1700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36900ad6c0 con 0x7f36900705c0 2023-11-28T11:57:01.861 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.857+0000 7f36962b1700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3690070a60 con 0x7f3690160710 2023-11-28T11:57:01.861 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.857+0000 7f36962b1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f369006b1c0 con 0x7f36900cc860 2023-11-28T11:57:01.861 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.857+0000 7f3695ab0700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f36900705c0 0x7f3690069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:37898/0 (socket says 172.21.15.39:37898) 2023-11-28T11:57:01.861 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.857+0000 7f3695ab0700 1 -- 172.21.15.39:0/268429002 learned_addr learned my addr 172.21.15.39:0/268429002 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:01.862 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.857+0000 7f3694aae700 1 --2- 172.21.15.39:0/268429002 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36900cc860 0x7f3690070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:01.862 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.857+0000 7f36952af700 1 --2- 172.21.15.39:0/268429002 >> v2:172.21.15.184:3300/0 conn(0x7f3690160710 0x7f36900cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:01.862 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.857+0000 7f3687fff700 1 -- 172.21.15.39:0/268429002 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1363528114 0 0) 0x7f36900ad6c0 con 0x7f36900705c0 2023-11-28T11:57:01.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.857+0000 7f3687fff700 1 -- 172.21.15.39:0/268429002 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f367c0035d0 con 0x7f36900705c0 2023-11-28T11:57:01.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.857+0000 7f3694aae700 1 -- 172.21.15.39:0/268429002 >> v2:172.21.15.184:3300/0 conn(0x7f3690160710 msgr2=0x7f36900cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:01.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.857+0000 7f3694aae700 1 --2- 172.21.15.39:0/268429002 >> v2:172.21.15.184:3300/0 conn(0x7f3690160710 0x7f36900cc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:01.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.857+0000 7f3694aae700 1 -- 172.21.15.39:0/268429002 >> v1:172.21.15.39:6789/0 conn(0x7f36900705c0 legacy=0x7f3690069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:01.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.857+0000 7f3694aae700 1 -- 172.21.15.39:0/268429002 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36900adc60 con 0x7f36900cc860 2023-11-28T11:57:01.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.857+0000 7f36952af700 1 --2- 172.21.15.39:0/268429002 >> v2:172.21.15.184:3300/0 conn(0x7f3690160710 0x7f36900cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:01.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.857+0000 7f3694aae700 1 --2- 172.21.15.39:0/268429002 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36900cc860 0x7f3690070080 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3680009850 tx=0x7f3680009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25c0bcfb0a6bbb94 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:01.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.857+0000 7f3687fff700 1 -- 172.21.15.39:0/268429002 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3680011830 con 0x7f36900cc860 2023-11-28T11:57:01.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.857+0000 7f3687fff700 1 -- 172.21.15.39:0/268429002 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3680011990 con 0x7f36900cc860 2023-11-28T11:57:01.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.857+0000 7f3687fff700 1 -- 172.21.15.39:0/268429002 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3680011d40 con 0x7f36900cc860 2023-11-28T11:57:01.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.857+0000 7f36962b1700 1 -- 172.21.15.39:0/268429002 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36900cc860 msgr2=0x7f3690070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:01.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.857+0000 7f36962b1700 1 --2- 172.21.15.39:0/268429002 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36900cc860 0x7f3690070080 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3680009850 tx=0x7f3680009b60 comp rx=0 tx=0).stop 2023-11-28T11:57:01.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.861+0000 7f36962b1700 1 -- 172.21.15.39:0/268429002 shutdown_connections 2023-11-28T11:57:01.865 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.861+0000 7f36962b1700 1 --2- 172.21.15.39:0/268429002 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36900cc860 0x7f3690070080 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:01.865 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.861+0000 7f36962b1700 1 --2- 172.21.15.39:0/268429002 >> v2:172.21.15.184:3300/0 conn(0x7f3690160710 0x7f36900cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:01.865 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.861+0000 7f36962b1700 1 -- 172.21.15.39:0/268429002 >> 172.21.15.39:0/268429002 conn(0x7f36900b0f80 msgr2=0x7f36900ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:01.865 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.861+0000 7f36962b1700 1 -- 172.21.15.39:0/268429002 shutdown_connections 2023-11-28T11:57:01.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.861+0000 7f36962b1700 1 -- 172.21.15.39:0/268429002 wait complete. 2023-11-28T11:57:01.867 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.861+0000 7f36962b1700 1 Processor -- start 2023-11-28T11:57:01.867 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.861+0000 7f36962b1700 1 -- start start 2023-11-28T11:57:01.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.865+0000 7f36962b1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36900705c0 0x7f36900b1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:01.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.865+0000 7f36962b1700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f36900cc860 0x7f36900b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:01.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.865+0000 7f36962b1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3690160710 0x7f36901f5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:01.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.865+0000 7f36962b1700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36900b2b30 con 0x7f36900cc860 2023-11-28T11:57:01.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.865+0000 7f36962b1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3690162020 con 0x7f36900705c0 2023-11-28T11:57:01.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.865+0000 7f36962b1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f369015b640 con 0x7f3690160710 2023-11-28T11:57:01.870 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.865+0000 7f3694aae700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f36900cc860 0x7f36900b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:01.870 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.865+0000 7f3694aae700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f36900cc860 0x7f36900b1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45056/0 (socket says 172.21.15.39:45056) 2023-11-28T11:57:01.870 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.865+0000 7f3694aae700 1 -- 172.21.15.39:0/2118810440 learned_addr learned my addr 172.21.15.39:0/2118810440 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:01.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.865+0000 7f3695ab0700 1 --2- 172.21.15.39:0/2118810440 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3690160710 0x7f36901f5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:01.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.865+0000 7f36952af700 1 --2- 172.21.15.39:0/2118810440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36900705c0 0x7f36900b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:01.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.865+0000 7f3694aae700 1 -- 172.21.15.39:0/2118810440 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3690160710 msgr2=0x7f36901f5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:01.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.865+0000 7f3694aae700 1 --2- 172.21.15.39:0/2118810440 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3690160710 0x7f36901f5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:01.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.865+0000 7f3694aae700 1 -- 172.21.15.39:0/2118810440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36900705c0 msgr2=0x7f36900b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:01.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.865+0000 7f3694aae700 1 --2- 172.21.15.39:0/2118810440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36900705c0 0x7f36900b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:01.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.865+0000 7f3694aae700 1 -- 172.21.15.39:0/2118810440 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f368c0094b0 con 0x7f36900cc860 2023-11-28T11:57:01.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.865+0000 7f3694aae700 1 --2- 172.21.15.39:0/2118810440 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f36900cc860 0x7f36900b1b80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f369006b300 tx=0x7f3680004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:01.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.865+0000 7f3685ffb700 1 -- 172.21.15.39:0/2118810440 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3680004480 con 0x7f36900cc860 2023-11-28T11:57:01.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.865+0000 7f3685ffb700 1 -- 172.21.15.39:0/2118810440 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368001f070 con 0x7f36900cc860 2023-11-28T11:57:01.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.865+0000 7f3685ffb700 1 -- 172.21.15.39:0/2118810440 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36800038e0 con 0x7f36900cc860 2023-11-28T11:57:01.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.865+0000 7f36962b1700 1 -- 172.21.15.39:0/2118810440 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36800094b0 con 0x7f36900cc860 2023-11-28T11:57:01.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.865+0000 7f36962b1700 1 -- 172.21.15.39:0/2118810440 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f369006b6b0 con 0x7f36900cc860 2023-11-28T11:57:01.873 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.869+0000 7f36962b1700 1 -- 172.21.15.39:0/2118810440 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f369006b3d0 con 0x7f36900cc860 2023-11-28T11:57:01.873 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.869+0000 7f3685ffb700 1 -- 172.21.15.39:0/2118810440 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f368002a020 con 0x7f36900cc860 2023-11-28T11:57:01.875 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.869+0000 7f3685ffb700 1 --2- 172.21.15.39:0/2118810440 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3674064ee0 0x7f3674067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:01.875 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.869+0000 7f3685ffb700 1 -- 172.21.15.39:0/2118810440 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f36800837e0 con 0x7f36900cc860 2023-11-28T11:57:01.876 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.869+0000 7f36952af700 1 --2- 172.21.15.39:0/2118810440 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3674064ee0 0x7f3674067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:01.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.873+0000 7f36952af700 1 --2- 172.21.15.39:0/2118810440 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3674064ee0 0x7f3674067390 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f368c009c70 tx=0x7f368c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:01.881 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:01.877+0000 7f3685ffb700 1 -- 172.21.15.39:0/2118810440 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f36800515a0 con 0x7f36900cc860 2023-11-28T11:57:02.097 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.093+0000 7f36962b1700 1 -- 172.21.15.39:0/2118810440 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f36900ad8f0 con 0x7f36900cc860 2023-11-28T11:57:02.105 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.101+0000 7f3685ffb700 1 -- 172.21.15.39:0/2118810440 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+161634 (secure 0 0 0) 0x7f3680006ce0 con 0x7f36900cc860 2023-11-28T11:57:02.106 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:57:02.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.105+0000 7f36962b1700 1 -- 172.21.15.39:0/2118810440 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3674064ee0 msgr2=0x7f3674067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:02.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.105+0000 7f36962b1700 1 --2- 172.21.15.39:0/2118810440 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3674064ee0 0x7f3674067390 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f368c009c70 tx=0x7f368c008040 comp rx=0 tx=0).stop 2023-11-28T11:57:02.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.105+0000 7f36962b1700 1 -- 172.21.15.39:0/2118810440 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f36900cc860 msgr2=0x7f36900b1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:02.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.105+0000 7f36962b1700 1 --2- 172.21.15.39:0/2118810440 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f36900cc860 0x7f36900b1b80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f369006b300 tx=0x7f3680004770 comp rx=0 tx=0).stop 2023-11-28T11:57:02.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.105+0000 7f36962b1700 1 -- 172.21.15.39:0/2118810440 shutdown_connections 2023-11-28T11:57:02.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.105+0000 7f36962b1700 1 --2- 172.21.15.39:0/2118810440 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3690160710 0x7f36901f5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:02.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.105+0000 7f36962b1700 1 --2- 172.21.15.39:0/2118810440 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f36900cc860 0x7f36900b1b80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:02.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.105+0000 7f36962b1700 1 --2- 172.21.15.39:0/2118810440 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3674064ee0 0x7f3674067390 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:02.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.105+0000 7f36962b1700 1 --2- 172.21.15.39:0/2118810440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36900705c0 0x7f36900b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:02.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.105+0000 7f36962b1700 1 -- 172.21.15.39:0/2118810440 >> 172.21.15.39:0/2118810440 conn(0x7f36900b0f80 msgr2=0x7f36900c4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:02.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.105+0000 7f36962b1700 1 -- 172.21.15.39:0/2118810440 shutdown_connections 2023-11-28T11:57:02.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.105+0000 7f36962b1700 1 -- 172.21.15.39:0/2118810440 wait complete. 2023-11-28T11:57:02.132 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":5,"active_gid":4104,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":36166},{"type":"v1","addr":"172.21.15.184:6833","nonce":36166}]},"active_addr":"172.21.15.184:6833/36166","active_change":"2023-11-28T11:56:20.522654+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4106,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.184:0","nonce":1571850645}]},{"addrvec":[{"type":"v2","addr":"172.21.15.184:0","nonce":694629328}]},{"addrvec":[{"type":"v2","addr":"172.21.15.184:0","nonce":95684380}]},{"addrvec":[{"type":"v2","addr":"172.21.15.184:0","nonce":3864431066}]}]} 2023-11-28T11:57:02.135 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-28T11:57:02.135 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-28T11:57:02.136 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:57:02.309 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.305+0000 7fc37f053700 1 Processor -- start 2023-11-28T11:57:02.309 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.305+0000 7fc37f053700 1 -- start start 2023-11-28T11:57:02.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.305+0000 7fc37f053700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc378071aa0 0x7fc37806d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:02.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.305+0000 7fc37f053700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc378069e00 0x7fc37806a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:02.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.309+0000 7fc37f053700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc37806c600 con 0x7fc37815c640 2023-11-28T11:57:02.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.309+0000 7fc37f053700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc37806cef0 con 0x7fc378069e00 2023-11-28T11:57:02.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.309+0000 7fc37f053700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3780d38f0 con 0x7fc378071aa0 2023-11-28T11:57:02.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.309+0000 7fc37e852700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc378069e00 0x7fc37806a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:02.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.309+0000 7fc37e051700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fc37815c640 0x7fc3780d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:57208/0 (socket says 172.21.15.39:57208) 2023-11-28T11:57:02.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.309+0000 7fc37e051700 1 -- 172.21.15.39:0/804495691 learned_addr learned my addr 172.21.15.39:0/804495691 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:02.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.309+0000 7fc37d850700 1 --2- 172.21.15.39:0/804495691 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc378071aa0 0x7fc37806d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:02.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.309+0000 7fc37d04f700 1 -- 172.21.15.39:0/804495691 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1446571569 0 0) 0x7fc37806c600 con 0x7fc37815c640 2023-11-28T11:57:02.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.309+0000 7fc37e852700 1 -- 172.21.15.39:0/804495691 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc378071aa0 msgr2=0x7fc37806d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:02.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.309+0000 7fc37e852700 1 --2- 172.21.15.39:0/804495691 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc378071aa0 0x7fc37806d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:02.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.309+0000 7fc37e852700 1 -- 172.21.15.39:0/804495691 >> v1:172.21.15.184:6789/0 conn(0x7fc37815c640 legacy=0x7fc3780d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:02.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.309+0000 7fc37e852700 1 -- 172.21.15.39:0/804495691 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3780722f0 con 0x7fc378069e00 2023-11-28T11:57:02.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.309+0000 7fc37e852700 1 --2- 172.21.15.39:0/804495691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc378069e00 0x7fc37806a280 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc370009d90 tx=0x7fc37000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1892a436246bb61d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:02.315 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.309+0000 7fc37d04f700 1 -- 172.21.15.39:0/804495691 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37000e070 con 0x7fc378069e00 2023-11-28T11:57:02.315 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.309+0000 7fc37d04f700 1 -- 172.21.15.39:0/804495691 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc37000bb20 con 0x7fc378069e00 2023-11-28T11:57:02.315 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.309+0000 7fc37d04f700 1 -- 172.21.15.39:0/804495691 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc370012430 con 0x7fc378069e00 2023-11-28T11:57:02.316 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.313+0000 7fc37f053700 1 -- 172.21.15.39:0/804495691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc378069e00 msgr2=0x7fc37806a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:02.316 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.313+0000 7fc37f053700 1 --2- 172.21.15.39:0/804495691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc378069e00 0x7fc37806a280 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc370009d90 tx=0x7fc37000b330 comp rx=0 tx=0).stop 2023-11-28T11:57:02.318 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.313+0000 7fc37f053700 1 -- 172.21.15.39:0/804495691 shutdown_connections 2023-11-28T11:57:02.318 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.313+0000 7fc37f053700 1 --2- 172.21.15.39:0/804495691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc378069e00 0x7fc37806a280 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:02.318 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.313+0000 7fc37f053700 1 --2- 172.21.15.39:0/804495691 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc378071aa0 0x7fc37806d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:02.318 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.313+0000 7fc37f053700 1 -- 172.21.15.39:0/804495691 >> 172.21.15.39:0/804495691 conn(0x7fc3780b6520 msgr2=0x7fc378071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:02.318 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.313+0000 7fc37f053700 1 -- 172.21.15.39:0/804495691 shutdown_connections 2023-11-28T11:57:02.318 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.313+0000 7fc37f053700 1 -- 172.21.15.39:0/804495691 wait complete. 2023-11-28T11:57:02.319 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.313+0000 7fc37f053700 1 Processor -- start 2023-11-28T11:57:02.319 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.313+0000 7fc37f053700 1 -- start start 2023-11-28T11:57:02.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.317+0000 7fc37f053700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc378069e00 0x7fc3780b0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:02.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.317+0000 7fc37f053700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc378071aa0 0x7fc3780c6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:02.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.317+0000 7fc37f053700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc37815c640 0x7fc37815f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:02.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.317+0000 7fc37f053700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3780c7410 con 0x7fc378069e00 2023-11-28T11:57:02.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.317+0000 7fc37f053700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37815f730 con 0x7fc37815c640 2023-11-28T11:57:02.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.317+0000 7fc37f053700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3780c76b0 con 0x7fc378071aa0 2023-11-28T11:57:02.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.317+0000 7fc37e051700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc378069e00 0x7fc3780b0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:02.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.317+0000 7fc37e051700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc378069e00 0x7fc3780b0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45066/0 (socket says 172.21.15.39:45066) 2023-11-28T11:57:02.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.317+0000 7fc37e051700 1 -- 172.21.15.39:0/100857798 learned_addr learned my addr 172.21.15.39:0/100857798 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:02.322 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.317+0000 7fc37d850700 1 --2- 172.21.15.39:0/100857798 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc378071aa0 0x7fc3780c6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:02.322 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.317+0000 7fc37e852700 1 --2- 172.21.15.39:0/100857798 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc37815c640 0x7fc37815f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:02.322 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.317+0000 7fc37e051700 1 -- 172.21.15.39:0/100857798 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc378071aa0 msgr2=0x7fc3780c6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:02.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.317+0000 7fc37e051700 1 --2- 172.21.15.39:0/100857798 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc378071aa0 0x7fc3780c6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:02.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.317+0000 7fc37e051700 1 -- 172.21.15.39:0/100857798 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc37815c640 msgr2=0x7fc37815f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:02.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.317+0000 7fc37e051700 1 --2- 172.21.15.39:0/100857798 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc37815c640 0x7fc37815f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:02.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.317+0000 7fc37e051700 1 -- 172.21.15.39:0/100857798 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc370009a70 con 0x7fc378069e00 2023-11-28T11:57:02.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.317+0000 7fc37d850700 1 --2- 172.21.15.39:0/100857798 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc378071aa0 0x7fc3780c6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:57:02.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.317+0000 7fc37e051700 1 --2- 172.21.15.39:0/100857798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc378069e00 0x7fc3780b0e90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc37400c550 tx=0x7fc37400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:02.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.317+0000 7fc36effd700 1 -- 172.21.15.39:0/100857798 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc374004ca0 con 0x7fc378069e00 2023-11-28T11:57:02.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.317+0000 7fc36effd700 1 -- 172.21.15.39:0/100857798 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc374004e00 con 0x7fc378069e00 2023-11-28T11:57:02.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.317+0000 7fc36effd700 1 -- 172.21.15.39:0/100857798 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc374007310 con 0x7fc378069e00 2023-11-28T11:57:02.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.317+0000 7fc37f053700 1 -- 172.21.15.39:0/100857798 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc378072010 con 0x7fc378069e00 2023-11-28T11:57:02.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.317+0000 7fc37f053700 1 -- 172.21.15.39:0/100857798 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc37815ca10 con 0x7fc378069e00 2023-11-28T11:57:02.324 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.321+0000 7fc37f053700 1 -- 172.21.15.39:0/100857798 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc37806c830 con 0x7fc378069e00 2023-11-28T11:57:02.325 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.321+0000 7fc36effd700 1 -- 172.21.15.39:0/100857798 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc37401a020 con 0x7fc378069e00 2023-11-28T11:57:02.327 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.321+0000 7fc36effd700 1 --2- 172.21.15.39:0/100857798 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc35c064ee0 0x7fc35c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:02.327 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.321+0000 7fc36effd700 1 -- 172.21.15.39:0/100857798 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc374081e30 con 0x7fc378069e00 2023-11-28T11:57:02.328 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.321+0000 7fc37d850700 1 --2- 172.21.15.39:0/100857798 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc35c064ee0 0x7fc35c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:02.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.325+0000 7fc37d850700 1 --2- 172.21.15.39:0/100857798 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc35c064ee0 0x7fc35c067390 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc37815a9a0 tx=0x7fc368008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:02.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.329+0000 7fc36effd700 1 -- 172.21.15.39:0/100857798 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc37404fbf0 con 0x7fc378069e00 2023-11-28T11:57:02.502 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.497+0000 7fc37f053700 1 -- 172.21.15.39:0/100857798 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc378073cb0 con 0x7fc378069e00 2023-11-28T11:57:02.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.501+0000 7fc36effd700 1 -- 172.21.15.39:0/100857798 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+19652 (secure 0 0 0) 0x7fc374053210 con 0x7fc378069e00 2023-11-28T11:57:02.504 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:57:02.505 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":29,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:56:44.439368+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:56:38.203736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:56:38.946498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:56:41.988334+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:57:02.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.505+0000 7fc37f053700 1 -- 172.21.15.39:0/100857798 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc35c064ee0 msgr2=0x7fc35c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:02.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.505+0000 7fc37f053700 1 --2- 172.21.15.39:0/100857798 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc35c064ee0 0x7fc35c067390 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc37815a9a0 tx=0x7fc368008040 comp rx=0 tx=0).stop 2023-11-28T11:57:02.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.505+0000 7fc37f053700 1 -- 172.21.15.39:0/100857798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc378069e00 msgr2=0x7fc3780b0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:02.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.505+0000 7fc37f053700 1 --2- 172.21.15.39:0/100857798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc378069e00 0x7fc3780b0e90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc37400c550 tx=0x7fc37400c860 comp rx=0 tx=0).stop 2023-11-28T11:57:02.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.505+0000 7fc37f053700 1 -- 172.21.15.39:0/100857798 shutdown_connections 2023-11-28T11:57:02.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.505+0000 7fc37f053700 1 --2- 172.21.15.39:0/100857798 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc35c064ee0 0x7fc35c067390 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:02.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.505+0000 7fc37f053700 1 --2- 172.21.15.39:0/100857798 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc37815c640 0x7fc37815f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:02.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.505+0000 7fc37f053700 1 --2- 172.21.15.39:0/100857798 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc378071aa0 0x7fc3780c6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:02.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.505+0000 7fc37f053700 1 --2- 172.21.15.39:0/100857798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc378069e00 0x7fc3780b0e90 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:02.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.505+0000 7fc37f053700 1 -- 172.21.15.39:0/100857798 >> 172.21.15.39:0/100857798 conn(0x7fc3780b6520 msgr2=0x7fc37815b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:02.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.505+0000 7fc37f053700 1 -- 172.21.15.39:0/100857798 shutdown_connections 2023-11-28T11:57:02.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.505+0000 7fc37f053700 1 -- 172.21.15.39:0/100857798 wait complete. 2023-11-28T11:57:02.534 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-28T11:57:02.534 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:57:02.718 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.713+0000 7f98e97a0700 1 Processor -- start 2023-11-28T11:57:02.718 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.713+0000 7f98e97a0700 1 -- start start 2023-11-28T11:57:02.720 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.717+0000 7f98e97a0700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98e40d0e30 0x7f98e40d1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:02.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.717+0000 7f98e97a0700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98e40d1740 con 0x7f98e40cfa50 2023-11-28T11:57:02.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.717+0000 7f98e97a0700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98e415d780 con 0x7f98e40cfec0 2023-11-28T11:57:02.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.717+0000 7f98e97a0700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e40cec90 con 0x7f98e40d0e30 2023-11-28T11:57:02.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.717+0000 7f98e27fc700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f98e40cfa50 0x7f98e40d2730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:37910/0 (socket says 172.21.15.39:37910) 2023-11-28T11:57:02.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.717+0000 7f98e27fc700 1 -- 172.21.15.39:0/1024067001 learned_addr learned my addr 172.21.15.39:0/1024067001 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:02.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.717+0000 7f98e2ffd700 1 --2- 172.21.15.39:0/1024067001 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98e40d0e30 0x7f98e40d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:02.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.717+0000 7f98e1ffb700 1 -- 172.21.15.39:0/1024067001 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1345074649 0 0) 0x7f98e40d1740 con 0x7f98e40cfa50 2023-11-28T11:57:02.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.717+0000 7f98e1ffb700 1 -- 172.21.15.39:0/1024067001 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98cc0035d0 con 0x7f98e40cfa50 2023-11-28T11:57:02.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.717+0000 7f98e2ffd700 1 -- 172.21.15.39:0/1024067001 >> v1:172.21.15.184:6789/0 conn(0x7f98e40cfec0 legacy=0x7f98e415c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:02.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.717+0000 7f98e1ffb700 1 -- 172.21.15.39:0/1024067001 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 356149892 0 0) 0x7f98e415d780 con 0x7f98e40cfec0 2023-11-28T11:57:02.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.717+0000 7f98e2ffd700 1 -- 172.21.15.39:0/1024067001 >> v1:172.21.15.39:6789/0 conn(0x7f98e40cfa50 legacy=0x7f98e40d2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:02.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.717+0000 7f98e2ffd700 1 -- 172.21.15.39:0/1024067001 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e40cef70 con 0x7f98e40d0e30 2023-11-28T11:57:02.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.717+0000 7f98e2ffd700 1 --2- 172.21.15.39:0/1024067001 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98e40d0e30 0x7f98e40d1200 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f98d4009880 tx=0x7f98d4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=310c068254cf5ed5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:02.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.717+0000 7f98e1ffb700 1 -- 172.21.15.39:0/1024067001 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d4011830 con 0x7f98e40d0e30 2023-11-28T11:57:02.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.717+0000 7f98e1ffb700 1 -- 172.21.15.39:0/1024067001 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d4011990 con 0x7f98e40d0e30 2023-11-28T11:57:02.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.717+0000 7f98e1ffb700 1 -- 172.21.15.39:0/1024067001 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d4011d20 con 0x7f98e40d0e30 2023-11-28T11:57:02.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.721+0000 7f98e97a0700 1 -- 172.21.15.39:0/1024067001 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98e40d0e30 msgr2=0x7f98e40d1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:02.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.721+0000 7f98e97a0700 1 --2- 172.21.15.39:0/1024067001 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98e40d0e30 0x7f98e40d1200 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f98d4009880 tx=0x7f98d4009b90 comp rx=0 tx=0).stop 2023-11-28T11:57:02.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.721+0000 7f98e97a0700 1 -- 172.21.15.39:0/1024067001 shutdown_connections 2023-11-28T11:57:02.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.721+0000 7f98e97a0700 1 --2- 172.21.15.39:0/1024067001 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98e40d0e30 0x7f98e40d1200 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:02.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.721+0000 7f98e97a0700 1 -- 172.21.15.39:0/1024067001 >> 172.21.15.39:0/1024067001 conn(0x7f98e406e100 msgr2=0x7f98e406e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:02.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.721+0000 7f98e97a0700 1 -- 172.21.15.39:0/1024067001 shutdown_connections 2023-11-28T11:57:02.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.721+0000 7f98e97a0700 1 -- 172.21.15.39:0/1024067001 wait complete. 2023-11-28T11:57:02.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.721+0000 7f98e97a0700 1 Processor -- start 2023-11-28T11:57:02.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.725+0000 7f98e97a0700 1 -- start start 2023-11-28T11:57:02.732 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.725+0000 7f98e97a0700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98e40cfa50 0x7f98e415b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:02.732 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.725+0000 7f98e97a0700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98e40cfec0 0x7f98e41421e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:02.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.725+0000 7f98e97a0700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98e40d0e30 0x7f98e40cd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:02.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.725+0000 7f98e97a0700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e40c7860 con 0x7f98e40cfec0 2023-11-28T11:57:02.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.725+0000 7f98e97a0700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e415a4a0 con 0x7f98e40d0e30 2023-11-28T11:57:02.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.725+0000 7f98e97a0700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e415a780 con 0x7f98e40cfa50 2023-11-28T11:57:02.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.725+0000 7f98e27fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98e40cfec0 0x7f98e41421e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:02.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.725+0000 7f98e27fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98e40cfec0 0x7f98e41421e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45076/0 (socket says 172.21.15.39:45076) 2023-11-28T11:57:02.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.725+0000 7f98e27fc700 1 -- 172.21.15.39:0/991879327 learned_addr learned my addr 172.21.15.39:0/991879327 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:02.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.725+0000 7f98e2ffd700 1 --2- 172.21.15.39:0/991879327 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98e40cfa50 0x7f98e415b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:02.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.725+0000 7f98e3fff700 1 --2- 172.21.15.39:0/991879327 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98e40d0e30 0x7f98e40cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:02.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.725+0000 7f98e27fc700 1 -- 172.21.15.39:0/991879327 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98e40cfa50 msgr2=0x7f98e415b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:02.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.725+0000 7f98e27fc700 1 --2- 172.21.15.39:0/991879327 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98e40cfa50 0x7f98e415b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:02.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.725+0000 7f98e27fc700 1 -- 172.21.15.39:0/991879327 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98e40d0e30 msgr2=0x7f98e40cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:02.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.725+0000 7f98e27fc700 1 --2- 172.21.15.39:0/991879327 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98e40d0e30 0x7f98e40cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:02.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.725+0000 7f98e27fc700 1 -- 172.21.15.39:0/991879327 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d40094b0 con 0x7f98e40cfec0 2023-11-28T11:57:02.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.725+0000 7f98e27fc700 1 --2- 172.21.15.39:0/991879327 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98e40cfec0 0x7f98e41421e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f98d800c4d0 tx=0x7f98d800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:02.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.729+0000 7f98cb7fe700 1 -- 172.21.15.39:0/991879327 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d8005d90 con 0x7f98e40cfec0 2023-11-28T11:57:02.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.729+0000 7f98cb7fe700 1 -- 172.21.15.39:0/991879327 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d80070d0 con 0x7f98e40cfec0 2023-11-28T11:57:02.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.729+0000 7f98e97a0700 1 -- 172.21.15.39:0/991879327 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e40cf530 con 0x7f98e40cfec0 2023-11-28T11:57:02.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.729+0000 7f98cb7fe700 1 -- 172.21.15.39:0/991879327 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d8007440 con 0x7f98e40cfec0 2023-11-28T11:57:02.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.729+0000 7f98e97a0700 1 -- 172.21.15.39:0/991879327 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e40cf250 con 0x7f98e40cfec0 2023-11-28T11:57:02.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.729+0000 7f98e97a0700 1 -- 172.21.15.39:0/991879327 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98e415c560 con 0x7f98e40cfec0 2023-11-28T11:57:02.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.729+0000 7f98cb7fe700 1 -- 172.21.15.39:0/991879327 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f98d8019030 con 0x7f98e40cfec0 2023-11-28T11:57:02.737 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.733+0000 7f98cb7fe700 1 --2- 172.21.15.39:0/991879327 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f98d0064ee0 0x7f98d0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:02.737 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.733+0000 7f98cb7fe700 1 -- 172.21.15.39:0/991879327 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f98d80814a0 con 0x7f98e40cfec0 2023-11-28T11:57:02.737 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.733+0000 7f98e2ffd700 1 --2- 172.21.15.39:0/991879327 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f98d0064ee0 0x7f98d0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:02.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.733+0000 7f98e2ffd700 1 --2- 172.21.15.39:0/991879327 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f98d0064ee0 0x7f98d0067390 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f98d40090b0 tx=0x7f98d401c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:02.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.741+0000 7f98cb7fe700 1 -- 172.21.15.39:0/991879327 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f98d804a400 con 0x7f98e40cfec0 2023-11-28T11:57:02.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.929+0000 7f98e97a0700 1 -- 172.21.15.39:0/991879327 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98e40726c0 con 0x7f98e40cfec0 2023-11-28T11:57:02.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.929+0000 7f98cb7fe700 1 -- 172.21.15.39:0/991879327 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+19652 (secure 0 0 0) 0x7f98d804f290 con 0x7f98e40cfec0 2023-11-28T11:57:02.936 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:57:02.936 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":29,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:56:44.439368+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:56:38.203736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:56:38.946498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:56:41.988334+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:57:02.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.933+0000 7f98e97a0700 1 -- 172.21.15.39:0/991879327 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f98d0064ee0 msgr2=0x7f98d0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:02.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.933+0000 7f98e97a0700 1 --2- 172.21.15.39:0/991879327 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f98d0064ee0 0x7f98d0067390 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f98d40090b0 tx=0x7f98d401c040 comp rx=0 tx=0).stop 2023-11-28T11:57:02.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.933+0000 7f98e97a0700 1 -- 172.21.15.39:0/991879327 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98e40cfec0 msgr2=0x7f98e41421e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:02.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.933+0000 7f98e97a0700 1 --2- 172.21.15.39:0/991879327 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98e40cfec0 0x7f98e41421e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f98d800c4d0 tx=0x7f98d800c7e0 comp rx=0 tx=0).stop 2023-11-28T11:57:02.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.933+0000 7f98e97a0700 1 -- 172.21.15.39:0/991879327 shutdown_connections 2023-11-28T11:57:02.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.933+0000 7f98e97a0700 1 --2- 172.21.15.39:0/991879327 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f98d0064ee0 0x7f98d0067390 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:02.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.933+0000 7f98e97a0700 1 --2- 172.21.15.39:0/991879327 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98e40d0e30 0x7f98e40cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:02.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.933+0000 7f98e97a0700 1 --2- 172.21.15.39:0/991879327 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98e40cfec0 0x7f98e41421e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:02.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.933+0000 7f98e97a0700 1 --2- 172.21.15.39:0/991879327 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98e40cfa50 0x7f98e415b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:02.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.933+0000 7f98e97a0700 1 -- 172.21.15.39:0/991879327 >> 172.21.15.39:0/991879327 conn(0x7f98e406e100 msgr2=0x7f98e40b9300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:02.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.933+0000 7f98e97a0700 1 -- 172.21.15.39:0/991879327 shutdown_connections 2023-11-28T11:57:02.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:02.933+0000 7f98e97a0700 1 -- 172.21.15.39:0/991879327 wait complete. 2023-11-28T11:57:02.963 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-28T11:57:02.964 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-28T11:57:02.964 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-28T11:57:02.965 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-28T11:57:02.965 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-28T11:57:02.965 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-28T11:57:02.966 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-28T11:57:02.966 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-28T11:57:03.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.201+0000 7f8eb0762700 1 Processor -- start 2023-11-28T11:57:03.206 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.201+0000 7f8eb0762700 1 -- start start 2023-11-28T11:57:03.207 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.201+0000 7f8eb0762700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ea8070130 0x7f8ea8070500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.207 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.201+0000 7f8eb0762700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f8ea80cc290 0x7f8ea80cc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.207 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.201+0000 7f8eb0762700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea815bca0 con 0x7f8ea815beb0 2023-11-28T11:57:03.208 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.201+0000 7f8eb0762700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea806a5c0 con 0x7f8ea80cc290 2023-11-28T11:57:03.208 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.201+0000 7f8eb0762700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea8070a40 con 0x7f8ea8070130 2023-11-28T11:57:03.208 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.201+0000 7f8eadcfd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f8ea80cc290 0x7f8ea80cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.208 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.201+0000 7f8eadcfd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f8ea80cc290 0x7f8ea80cc700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:42750/0 (socket says 172.21.15.39:42750) 2023-11-28T11:57:03.209 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.201+0000 7f8eadcfd700 1 -- 172.21.15.39:0/126867574 learned_addr learned my addr 172.21.15.39:0/126867574 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:03.209 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.205+0000 7f8eae4fe700 1 --2- 172.21.15.39:0/126867574 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ea8070130 0x7f8ea8070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.209 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.205+0000 7f8eadcfd700 1 -- 172.21.15.39:0/126867574 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ea8070130 msgr2=0x7f8ea8070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:03.209 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.205+0000 7f8eadcfd700 1 --2- 172.21.15.39:0/126867574 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ea8070130 0x7f8ea8070500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.209 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.205+0000 7f8eadcfd700 1 -- 172.21.15.39:0/126867574 >> v1:172.21.15.184:6789/0 conn(0x7f8ea815beb0 legacy=0x7f8ea815c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:03.209 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.205+0000 7f8eadcfd700 1 -- 172.21.15.39:0/126867574 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea8069c90 con 0x7f8ea80cc290 2023-11-28T11:57:03.210 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.205+0000 7f077cabc700 1 Processor -- start 2023-11-28T11:57:03.210 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.205+0000 7f077cabc700 1 -- start start 2023-11-28T11:57:03.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.205+0000 7f8eadcfd700 1 --2- 172.21.15.39:0/126867574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ea80cc290 0x7f8ea80cc700 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4009f90 tx=0x7f8ea4009670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbc079d7c40094cf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.205+0000 7f8ead4fc700 1 -- 172.21.15.39:0/126867574 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea40098b0 con 0x7f8ea80cc290 2023-11-28T11:57:03.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.205+0000 7f8ead4fc700 1 -- 172.21.15.39:0/126867574 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea4004230 con 0x7f8ea80cc290 2023-11-28T11:57:03.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.205+0000 7f8ead4fc700 1 -- 172.21.15.39:0/126867574 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea40045c0 con 0x7f8ea80cc290 2023-11-28T11:57:03.212 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.205+0000 7f077cabc700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f07780705a0 0x7f077815b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.212 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7f077659c700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f07780cf1a0 0x7f07780cc290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:57230/0 (socket says 172.21.15.39:57230) 2023-11-28T11:57:03.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7f077659c700 1 -- 172.21.15.39:0/1722458378 learned_addr learned my addr 172.21.15.39:0/1722458378 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:03.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7f077cabc700 1 -- 172.21.15.39:0/1722458378 --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077806a5c0 con 0x7f0778070130 2023-11-28T11:57:03.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7f8eb0762700 1 -- 172.21.15.39:0/126867574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ea80cc290 msgr2=0x7f8ea80cc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7f8eb0762700 1 --2- 172.21.15.39:0/126867574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ea80cc290 0x7f8ea80cc700 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4009f90 tx=0x7f8ea4009670 comp rx=0 tx=0).stop 2023-11-28T11:57:03.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7fc8fd9fc700 1 Processor -- start 2023-11-28T11:57:03.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7f077cabc700 1 -- 172.21.15.39:0/1722458378 --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0778069c90 con 0x7f07780cf1a0 2023-11-28T11:57:03.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7f077cabc700 1 -- 172.21.15.39:0/1722458378 --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0778069f70 con 0x7f07780705a0 2023-11-28T11:57:03.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7f0776d9d700 1 --2- 172.21.15.39:0/1722458378 >> v2:172.21.15.39:3300/0 conn(0x7f07780705a0 0x7f077815b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7f0775d9b700 1 -- 172.21.15.39:0/1722458378 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3654987581 0 0) 0x7f0778069c90 con 0x7f07780cf1a0 2023-11-28T11:57:03.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7f0775d9b700 1 -- 172.21.15.39:0/1722458378 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07640035d0 con 0x7f07780cf1a0 2023-11-28T11:57:03.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7f0775d9b700 1 -- 172.21.15.39:0/1722458378 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1643766045 0 0) 0x7f077806a5c0 con 0x7f0778070130 2023-11-28T11:57:03.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7f0775d9b700 1 -- 172.21.15.39:0/1722458378 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0778069c90 con 0x7f0778070130 2023-11-28T11:57:03.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7f0775d9b700 1 -- 172.21.15.39:0/1722458378 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1182937715 0 0) 0x7f07640035d0 con 0x7f07780cf1a0 2023-11-28T11:57:03.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7f0775d9b700 1 -- 172.21.15.39:0/1722458378 >> v2:172.21.15.39:3300/0 conn(0x7f07780705a0 msgr2=0x7f077815b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:03.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7f0775d9b700 1 --2- 172.21.15.39:0/1722458378 >> v2:172.21.15.39:3300/0 conn(0x7f07780705a0 0x7f077815b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7f0775d9b700 1 -- 172.21.15.39:0/1722458378 >> v1:172.21.15.39:6789/0 conn(0x7f0778070130 legacy=0x7f077815ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7f0775d9b700 1 -- 172.21.15.39:0/1722458378 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077806a250 con 0x7f07780cf1a0 2023-11-28T11:57:03.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7f0775d9b700 1 -- 172.21.15.39:0/1722458378 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4013383302 0 0) 0x7f0768001670 con 0x7f07780cf1a0 2023-11-28T11:57:03.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7f0775d9b700 1 -- 172.21.15.39:0/1722458378 >> v1:172.21.15.184:6789/0 conn(0x7f07780cf1a0 legacy=0x7f07780cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7f0775d9b700 1 --2- 172.21.15.39:0/1722458378 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0764003c00 0x7f0764003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7f0775d9b700 1 --2- 172.21.15.39:0/1722458378 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0764004870 0x7f0764004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7f0775d9b700 1 --2- 172.21.15.39:0/1722458378 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0764009a20 0x7f0764005240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7f0775d9b700 1 -- 172.21.15.39:0/1722458378 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0778069f70 con 0x7f0764003c00 2023-11-28T11:57:03.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7f0775d9b700 1 -- 172.21.15.39:0/1722458378 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07640148e0 con 0x7f0764004870 2023-11-28T11:57:03.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7f0775d9b700 1 -- 172.21.15.39:0/1722458378 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0764014aa0 con 0x7f0764009a20 2023-11-28T11:57:03.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7f0776d9d700 1 --2- 172.21.15.39:0/1722458378 >> v2:172.21.15.39:3300/0 conn(0x7f07780705a0 0x7f077815b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:03.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7fc8fd9fc700 1 -- start start 2023-11-28T11:57:03.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7f8eb0762700 1 -- 172.21.15.39:0/126867574 shutdown_connections 2023-11-28T11:57:03.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7f8eb0762700 1 --2- 172.21.15.39:0/126867574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ea80cc290 0x7f8ea80cc700 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7f8eb0762700 1 --2- 172.21.15.39:0/126867574 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ea8070130 0x7f8ea8070500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7f8eb0762700 1 -- 172.21.15.39:0/126867574 >> 172.21.15.39:0/126867574 conn(0x7f8ea80ce6c0 msgr2=0x7f8ea80cea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:03.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7f077659c700 1 --2- 172.21.15.39:0/1722458378 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0764003c00 0x7f0764003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7fc8fd9fc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8f00e6d20 0x7fc8f004f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7f8eb0762700 1 -- 172.21.15.39:0/126867574 shutdown_connections 2023-11-28T11:57:03.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7f8eb0762700 1 -- 172.21.15.39:0/126867574 wait complete. 2023-11-28T11:57:03.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7f077659c700 1 -- 172.21.15.39:0/1722458378 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0764009a20 msgr2=0x7f0764005240 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-28T11:57:03.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7f077659c700 1 --2- 172.21.15.39:0/1722458378 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0764009a20 0x7f0764005240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7f077659c700 1 -- 172.21.15.39:0/1722458378 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0764004870 msgr2=0x7f0764004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:03.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7f077659c700 1 --2- 172.21.15.39:0/1722458378 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0764004870 0x7f0764004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7f077659c700 1 -- 172.21.15.39:0/1722458378 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07640035d0 con 0x7f0764003c00 2023-11-28T11:57:03.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7fc8fd9fc700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc8f0036d40 0x7fc8f0052ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7fc8fc9fa700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8f00e6d20 0x7fc8f004f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7fc8fc9fa700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8f00e6d20 0x7fc8f004f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:48236/0 (socket says 172.21.15.39:48236) 2023-11-28T11:57:03.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.209+0000 7f077659c700 1 --2- 172.21.15.39:0/1722458378 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0764003c00 0x7f0764003ff0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f076800c160 tx=0x7f07640058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b1bb98785f66250 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.213+0000 7fc8f7fff700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fc8f0051170 0x7fc8f0036630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:57240/0 (socket says 172.21.15.39:57240) 2023-11-28T11:57:03.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.213+0000 7fbc6d31a700 1 Processor -- start 2023-11-28T11:57:03.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.213+0000 7fc8fc9fa700 1 -- 172.21.15.39:0/2643363482 learned_addr learned my addr 172.21.15.39:0/2643363482 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:03.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.213+0000 7f0775d9b700 1 -- 172.21.15.39:0/1722458378 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076800ccc0 con 0x7f0764003c00 2023-11-28T11:57:03.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.213+0000 7fbc6d31a700 1 -- start start 2023-11-28T11:57:03.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.213+0000 7f0776d9d700 1 -- 172.21.15.39:0/1722458378 reap_dead start 2023-11-28T11:57:03.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.213+0000 7f0775d9b700 1 -- 172.21.15.39:0/1722458378 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076800ce20 con 0x7f0764003c00 2023-11-28T11:57:03.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.213+0000 7fc8fd9fc700 1 -- 172.21.15.39:0/2643363482 --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8f0033940 con 0x7fc8f0051170 2023-11-28T11:57:03.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.213+0000 7f0775d9b700 1 -- 172.21.15.39:0/1722458378 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0768005b80 con 0x7f0764003c00 2023-11-28T11:57:03.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.213+0000 7fc8fd1fb700 1 --2- 172.21.15.39:0/2643363482 >> v2:172.21.15.184:3300/0 conn(0x7fc8f0036d40 0x7fc8f0052ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.213+0000 7fc8fd9fc700 1 -- 172.21.15.39:0/2643363482 --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f0048570 con 0x7fc8f0036d40 2023-11-28T11:57:03.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.213+0000 7fc8fd9fc700 1 -- 172.21.15.39:0/2643363482 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f0033c20 con 0x7fc8f00e6d20 2023-11-28T11:57:03.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.213+0000 7f077cabc700 1 -- 172.21.15.39:0/1722458378 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0764003c00 msgr2=0x7f0764003ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.213+0000 7f077cabc700 1 --2- 172.21.15.39:0/1722458378 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0764003c00 0x7f0764003ff0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f076800c160 tx=0x7f07640058a0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.213+0000 7fc8f77fe700 1 -- 172.21.15.39:0/2643363482 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 276313384 0 0) 0x7fc8f0033940 con 0x7fc8f0051170 2023-11-28T11:57:03.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.213+0000 7fc8f77fe700 1 -- 172.21.15.39:0/2643363482 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8e80035d0 con 0x7fc8f0051170 2023-11-28T11:57:03.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.213+0000 7f077cabc700 1 -- 172.21.15.39:0/1722458378 shutdown_connections 2023-11-28T11:57:03.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.213+0000 7f077cabc700 1 --2- 172.21.15.39:0/1722458378 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0764003c00 0x7f0764003ff0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.213+0000 7f077cabc700 1 -- 172.21.15.39:0/1722458378 >> 172.21.15.39:0/1722458378 conn(0x7f07780ce6c0 msgr2=0x7f07780cea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:03.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.213+0000 7f8eb0762700 1 Processor -- start 2023-11-28T11:57:03.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.213+0000 7f8eb0762700 1 -- start start 2023-11-28T11:57:03.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.213+0000 7fc8f77fe700 1 -- 172.21.15.39:0/2643363482 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 813856069 0 0) 0x7fc8e80035d0 con 0x7fc8f0051170 2023-11-28T11:57:03.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.213+0000 7fc8f77fe700 1 -- 172.21.15.39:0/2643363482 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8f00e6d20 msgr2=0x7fc8f004f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:03.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.213+0000 7fc8f77fe700 1 --2- 172.21.15.39:0/2643363482 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8f00e6d20 0x7fc8f004f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.213+0000 7fc8f77fe700 1 -- 172.21.15.39:0/2643363482 >> v2:172.21.15.184:3300/0 conn(0x7fc8f0036d40 msgr2=0x7fc8f0052ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:03.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.213+0000 7fc8f77fe700 1 --2- 172.21.15.39:0/2643363482 >> v2:172.21.15.184:3300/0 conn(0x7fc8f0036d40 0x7fc8f0052ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.213+0000 7fc8f77fe700 1 -- 172.21.15.39:0/2643363482 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f0033f00 con 0x7fc8f0051170 2023-11-28T11:57:03.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.213+0000 7fc8f77fe700 1 -- 172.21.15.39:0/2643363482 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4013383302 0 0) 0x7fc8e4001670 con 0x7fc8f0051170 2023-11-28T11:57:03.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.213+0000 7fc8f77fe700 1 -- 172.21.15.39:0/2643363482 >> v1:172.21.15.184:6789/0 conn(0x7fc8f0051170 legacy=0x7fc8f0036630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.213+0000 7fc8f77fe700 1 --2- 172.21.15.39:0/2643363482 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc8e8003a20 0x7fc8e8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.213+0000 7fc8f77fe700 1 --2- 172.21.15.39:0/2643363482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8e8004450 0x7fc8e8004910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.213+0000 7fc8f77fe700 1 --2- 172.21.15.39:0/2643363482 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8e8005030 0x7fc8e800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.213+0000 7fc8f77fe700 1 -- 172.21.15.39:0/2643363482 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f0048570 con 0x7fc8e8003a20 2023-11-28T11:57:03.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.213+0000 7fc8f77fe700 1 -- 172.21.15.39:0/2643363482 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f0033c20 con 0x7fc8e8004450 2023-11-28T11:57:03.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.213+0000 7fc8f77fe700 1 -- 172.21.15.39:0/2643363482 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e800bf70 con 0x7fc8e8005030 2023-11-28T11:57:03.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.213+0000 7fbc6d31a700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fbc600e2d80 0x7fbc600528c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.213+0000 7f077cabc700 1 -- 172.21.15.39:0/1722458378 shutdown_connections 2023-11-28T11:57:03.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.213+0000 7f077cabc700 1 -- 172.21.15.39:0/1722458378 wait complete. 2023-11-28T11:57:03.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fc8f7fff700 1 --2- 172.21.15.39:0/2643363482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8e8004450 0x7fc8e8004910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fc8fd1fb700 1 --2- 172.21.15.39:0/2643363482 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8e8005030 0x7fc8e800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fbc6d31a700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc6003a820 con 0x7fbc6003a450 2023-11-28T11:57:03.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fbc6d31a700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc600e3210 con 0x7fbc60036770 2023-11-28T11:57:03.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fbc6d31a700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc600060c0 con 0x7fbc600e2d80 2023-11-28T11:57:03.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7f8eb0762700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8ea8070130 0x7f8ea814ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7f8eb0762700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ea80cc290 0x7f8ea81f55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7f8eb0762700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ea815beb0 0x7f8ea814c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7f8eb0762700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea81f64e0 con 0x7f8ea8070130 2023-11-28T11:57:03.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7f8eb0762700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea80b29b0 con 0x7f8ea80cc290 2023-11-28T11:57:03.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7f8eb0762700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea8151010 con 0x7f8ea815beb0 2023-11-28T11:57:03.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fc8f7fff700 1 -- 172.21.15.39:0/2643363482 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8e8005030 msgr2=0x7fc8e800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:03.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fc8f7fff700 1 --2- 172.21.15.39:0/2643363482 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8e8005030 0x7fc8e800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fc8f7fff700 1 -- 172.21.15.39:0/2643363482 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc8e8003a20 msgr2=0x7fc8e8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:03.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fc8f7fff700 1 --2- 172.21.15.39:0/2643363482 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc8e8003a20 0x7fc8e8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fbc667fc700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fbc600e2d80 0x7fbc600528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fbc66ffd700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fbc6003a450 0x7fbc6004f340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:37934/0 (socket says 172.21.15.39:37934) 2023-11-28T11:57:03.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fbc66ffd700 1 -- 172.21.15.39:0/3820191099 learned_addr learned my addr 172.21.15.39:0/3820191099 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:03.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7f1e3a124700 1 Processor -- start 2023-11-28T11:57:03.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fb7cf03e700 1 Processor -- start 2023-11-28T11:57:03.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.213+0000 7fac32529700 1 Processor -- start 2023-11-28T11:57:03.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.213+0000 7fac32529700 1 -- start start 2023-11-28T11:57:03.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fac32529700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fac2c163e50 0x7fac2c165030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fac32529700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fac2c06c220 0x7fac2c0c3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fac32529700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac2c06c670 0x7fac2c0c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fac32529700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac2c06cb00 con 0x7fac2c163e50 2023-11-28T11:57:03.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fac32529700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac2c0caf90 con 0x7fac2c06c220 2023-11-28T11:57:03.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fac32529700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c0cb270 con 0x7fac2c06c670 2023-11-28T11:57:03.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7f8eadcfd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ea80cc290 0x7f8ea81f55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7f8eadcfd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ea80cc290 0x7f8ea81f55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:42792/0 (socket says 172.21.15.39:42792) 2023-11-28T11:57:03.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7f8eadcfd700 1 -- 172.21.15.39:0/1325344395 learned_addr learned my addr 172.21.15.39:0/1325344395 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:03.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fc8f7fff700 1 -- 172.21.15.39:0/2643363482 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f0033f00 con 0x7fc8e8004450 2023-11-28T11:57:03.234 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fb7cf03e700 1 -- start start 2023-11-28T11:57:03.234 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fac31d28700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac2c06c670 0x7fac2c0c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.234 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7f1e3a124700 1 -- start start 2023-11-28T11:57:03.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fac31d28700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac2c06c670 0x7fac2c0c3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:48264/0 (socket says 172.21.15.39:48264) 2023-11-28T11:57:03.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7f8eadcfd700 1 -- 172.21.15.39:0/1325344395 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ea815beb0 msgr2=0x7f8ea814c4c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T11:57:03.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7f8eadcfd700 1 --2- 172.21.15.39:0/1325344395 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ea815beb0 0x7f8ea814c4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7f8eadcfd700 1 -- 172.21.15.39:0/1325344395 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8ea8070130 msgr2=0x7f8ea814ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7f8eadcfd700 1 --2- 172.21.15.39:0/1325344395 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8ea8070130 0x7f8ea814ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.236 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fac31d28700 1 -- 172.21.15.39:0/352344109 learned_addr learned my addr 172.21.15.39:0/352344109 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:03.236 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fac30d26700 1 --2- 172.21.15.39:0/352344109 >> v2:172.21.15.184:3300/0 conn(0x7fac2c06c220 0x7fac2c0c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.236 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fbc667fc700 1 -- 172.21.15.39:0/3820191099 >> v1:172.21.15.184:6789/0 conn(0x7fbc60036770 legacy=0x7fbc600064e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.236 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fbc667fc700 1 -- 172.21.15.39:0/3820191099 >> v1:172.21.15.39:6789/0 conn(0x7fbc6003a450 legacy=0x7fbc6004f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.236 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fbc667fc700 1 -- 172.21.15.39:0/3820191099 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc600e34f0 con 0x7fbc600e2d80 2023-11-28T11:57:03.236 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fbc65ffb700 1 -- 172.21.15.39:0/3820191099 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2877127345 0 0) 0x7fbc6003a820 con 0x7fbc6003a450 2023-11-28T11:57:03.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7f8eadcfd700 1 -- 172.21.15.39:0/1325344395 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea4009e00 con 0x7f8ea80cc290 2023-11-28T11:57:03.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fc8f7fff700 1 --2- 172.21.15.39:0/2643363482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8e8004450 0x7fc8e8004910 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc8e400c260 tx=0x7fc8e80058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2b02996ec376131 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7f5505219700 1 Processor -- start 2023-11-28T11:57:03.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7f5505219700 1 -- start start 2023-11-28T11:57:03.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7f8eadcfd700 1 --2- 172.21.15.39:0/1325344395 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ea80cc290 0x7f8ea81f55b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8ea80719a0 tx=0x7f8ea4004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fc8f77fe700 1 -- 172.21.15.39:0/2643363482 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e4007bc0 con 0x7fc8e8004450 2023-11-28T11:57:03.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fc8f77fe700 1 -- 172.21.15.39:0/2643363482 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e400cd80 con 0x7fc8e8004450 2023-11-28T11:57:03.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fc8f77fe700 1 -- 172.21.15.39:0/2643363482 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e4005b00 con 0x7fc8e8004450 2023-11-28T11:57:03.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fbc667fc700 1 --2- 172.21.15.39:0/3820191099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc600e2d80 0x7fbc600528c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c009850 tx=0x7fbc5c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96f2644fab685581 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fac30d26700 1 -- 172.21.15.39:0/352344109 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac2c06c670 msgr2=0x7fac2c0c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:03.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fac30d26700 1 --2- 172.21.15.39:0/352344109 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac2c06c670 0x7fac2c0c3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fb7cf03e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7c806d4c0 0x7fb7c816b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fb7cf03e700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7c8164080 con 0x7fb7c80cdfb0 2023-11-28T11:57:03.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fb7cf03e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7c8069bf0 con 0x7fb7c8163cb0 2023-11-28T11:57:03.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fb7cf03e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c80cc290 con 0x7fb7c806d4c0 2023-11-28T11:57:03.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7fac31527700 1 --2- 172.21.15.39:0/352344109 >> v2:172.21.15.39:3300/0 conn(0x7fac2c163e50 0x7fac2c165030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.241 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7f8e9effd700 1 -- 172.21.15.39:0/1325344395 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4004030 con 0x7f8ea80cc290 2023-11-28T11:57:03.241 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7f8e9effd700 1 -- 172.21.15.39:0/1325344395 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea40038d0 con 0x7f8ea80cc290 2023-11-28T11:57:03.241 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7f077cabc700 1 Processor -- start 2023-11-28T11:57:03.241 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.217+0000 7f1e3a124700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e340704b0 0x7f1e34164960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7fb7c7fff700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fb7c80cdfb0 0x7fb7c806cdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:37942/0 (socket says 172.21.15.39:37942) 2023-11-28T11:57:03.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7fac30d26700 1 -- 172.21.15.39:0/352344109 >> v2:172.21.15.39:3300/0 conn(0x7fac2c163e50 msgr2=0x7fac2c165030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:03.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7fc8fd9fc700 1 -- 172.21.15.39:0/2643363482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8e8004450 msgr2=0x7fc8e8004910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7fc8fd9fc700 1 --2- 172.21.15.39:0/2643363482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8e8004450 0x7fc8e8004910 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc8e400c260 tx=0x7fc8e80058a0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7f077cabc700 1 -- start start 2023-11-28T11:57:03.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7fac30d26700 1 --2- 172.21.15.39:0/352344109 >> v2:172.21.15.39:3300/0 conn(0x7fac2c163e50 0x7fac2c165030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7fbc65ffb700 1 -- 172.21.15.39:0/3820191099 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c011830 con 0x7fbc600e2d80 2023-11-28T11:57:03.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7fbc65ffb700 1 -- 172.21.15.39:0/3820191099 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5c011990 con 0x7fbc600e2d80 2023-11-28T11:57:03.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7fbc65ffb700 1 -- 172.21.15.39:0/3820191099 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c011d20 con 0x7fbc600e2d80 2023-11-28T11:57:03.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7fb7cd5db700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7c806d4c0 0x7fb7c816b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7fb7c7fff700 1 -- 172.21.15.39:0/3304942612 learned_addr learned my addr 172.21.15.39:0/3304942612 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:03.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7fc8fd1fb700 1 -- 172.21.15.39:0/2643363482 reap_dead start 2023-11-28T11:57:03.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7fc8fd9fc700 1 -- 172.21.15.39:0/2643363482 shutdown_connections 2023-11-28T11:57:03.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7fc8fd9fc700 1 -- 172.21.15.39:0/2643363482 >> 172.21.15.39:0/2643363482 conn(0x7fc8f0051630 msgr2=0x7fc8f0051a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:03.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7f8e9effd700 1 -- 172.21.15.39:0/1325344395 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4003c60 con 0x7f8ea80cc290 2023-11-28T11:57:03.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7f8eb0762700 1 -- 172.21.15.39:0/1325344395 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea806a250 con 0x7f8ea80cc290 2023-11-28T11:57:03.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7f1e39923700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e340704b0 0x7f1e34164960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7fb7cd5db700 1 -- 172.21.15.39:0/3304942612 >> v1:172.21.15.184:6789/0 conn(0x7fb7c8163cb0 legacy=0x7fb7c8164cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7fac30d26700 1 -- 172.21.15.39:0/352344109 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac2c0cb550 con 0x7fac2c06c220 2023-11-28T11:57:03.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7f8eb0762700 1 -- 172.21.15.39:0/1325344395 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea8069f70 con 0x7f8ea80cc290 2023-11-28T11:57:03.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7f5505219700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5500159590 0x7f550006bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.247 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7fb7cd5db700 1 -- 172.21.15.39:0/3304942612 >> v1:172.21.15.39:6789/0 conn(0x7fb7c80cdfb0 legacy=0x7fb7c806cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.247 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7f5505219700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f550006afa0 0x7f550006c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.247 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7fc8fd9fc700 1 -- 172.21.15.39:0/2643363482 shutdown_connections 2023-11-28T11:57:03.248 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7fb7cd5db700 1 -- 172.21.15.39:0/3304942612 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c80cc4a0 con 0x7fb7c806d4c0 2023-11-28T11:57:03.248 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7fac31527700 1 --2- 172.21.15.39:0/352344109 >> v2:172.21.15.39:3300/0 conn(0x7fac2c163e50 0x7fac2c165030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:57:03.248 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7f1e38921700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f1e34070080 0x7f1e34164250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:57260/0 (socket says 172.21.15.39:57260) 2023-11-28T11:57:03.248 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7f5505219700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f550006b510 con 0x7f55001591c0 2023-11-28T11:57:03.249 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7f5505219700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55000b0c00 con 0x7f550006afa0 2023-11-28T11:57:03.249 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7f5505219700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55000b0ee0 con 0x7f5500159590 2023-11-28T11:57:03.249 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7f077cabc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0764003c00 0x7f077814acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.249 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7fc8fd9fc700 1 -- 172.21.15.39:0/2643363482 wait complete. 2023-11-28T11:57:03.249 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7f077cabc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07780af8c0 0x7f07780afd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.250 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7f1e38921700 1 -- 172.21.15.39:0/3758201913 learned_addr learned my addr 172.21.15.39:0/3758201913 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:03.250 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7f1e3a124700 1 -- 172.21.15.39:0/3758201913 --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e340ad6c0 con 0x7f1e34160710 2023-11-28T11:57:03.250 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7f1e3a124700 1 -- 172.21.15.39:0/3758201913 --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e340adc60 con 0x7f1e34070080 2023-11-28T11:57:03.250 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7f1e3a124700 1 -- 172.21.15.39:0/3758201913 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3406b1c0 con 0x7f1e340704b0 2023-11-28T11:57:03.250 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7f54ff59e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f550006afa0 0x7f550006c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.250 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7f54ff59e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f550006afa0 0x7f550006c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:42800/0 (socket says 172.21.15.39:42800) 2023-11-28T11:57:03.251 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7f54ff59e700 1 -- 172.21.15.39:0/2626285161 learned_addr learned my addr 172.21.15.39:0/2626285161 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:03.251 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7f8eb0762700 1 -- 172.21.15.39:0/1325344395 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8ea814f720 con 0x7f8ea80cc290 2023-11-28T11:57:03.251 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7fbc6d31a700 1 -- 172.21.15.39:0/3820191099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc600e2d80 msgr2=0x7fbc600528c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.251 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7fbc6d31a700 1 --2- 172.21.15.39:0/3820191099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc600e2d80 0x7fbc600528c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c009850 tx=0x7fbc5c009b60 comp rx=0 tx=0).stop 2023-11-28T11:57:03.252 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7f077cabc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07780ae020 0x7f07780ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.252 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7f077cabc700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07780b0270 con 0x7f07780ae020 2023-11-28T11:57:03.252 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7f077cabc700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07780ae9e0 con 0x7f07780af8c0 2023-11-28T11:57:03.252 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7f077cabc700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07780c21f0 con 0x7f0764003c00 2023-11-28T11:57:03.252 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7fb7cd5db700 1 --2- 172.21.15.39:0/3304942612 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7c806d4c0 0x7fb7c816b630 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc009880 tx=0x7fb7bc009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ef588dfd805fb39 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.252 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7fac30d26700 1 --2- 172.21.15.39:0/352344109 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac2c06c220 0x7fac2c0c3770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0d1300 tx=0x7fac1c009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a95c67593d9b25a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.253 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7f54fe59c700 1 --2- 172.21.15.39:0/2626285161 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5500159590 0x7f550006bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.253 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7fb7c77fe700 1 -- 172.21.15.39:0/3304942612 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc011830 con 0x7fb7c806d4c0 2023-11-28T11:57:03.253 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7f077659c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0764003c00 0x7f077814acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.253 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7f077659c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0764003c00 0x7f077814acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:48302/0 (socket says 172.21.15.39:48302) 2023-11-28T11:57:03.253 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7f077659c700 1 -- 172.21.15.39:0/306214860 learned_addr learned my addr 172.21.15.39:0/306214860 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:03.254 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7f0776d9d700 1 --2- 172.21.15.39:0/306214860 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07780ae020 0x7f07780ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.254 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7f076dd9b700 1 --2- 172.21.15.39:0/306214860 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07780af8c0 0x7f07780afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.254 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7f54ff59e700 1 -- 172.21.15.39:0/2626285161 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5500159590 msgr2=0x7f550006bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:03.254 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7f54ff59e700 1 --2- 172.21.15.39:0/2626285161 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5500159590 0x7f550006bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.254 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7f54ff59e700 1 -- 172.21.15.39:0/2626285161 >> v1:172.21.15.184:6789/0 conn(0x7f55001591c0 legacy=0x7f55000ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.254 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7f54ff59e700 1 -- 172.21.15.39:0/2626285161 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55000ca280 con 0x7f550006afa0 2023-11-28T11:57:03.255 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7fb7c77fe700 1 -- 172.21.15.39:0/3304942612 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7bc011990 con 0x7fb7c806d4c0 2023-11-28T11:57:03.255 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7fb7c77fe700 1 -- 172.21.15.39:0/3304942612 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc011d20 con 0x7fb7c806d4c0 2023-11-28T11:57:03.255 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7f1e39923700 1 -- 172.21.15.39:0/3758201913 >> v1:172.21.15.184:6789/0 conn(0x7f1e34070080 legacy=0x7f1e34164250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:03.255 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7f1e39923700 1 -- 172.21.15.39:0/3758201913 >> v1:172.21.15.39:6789/0 conn(0x7f1e34160710 legacy=0x7f1e340cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.255 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7f1e39923700 1 -- 172.21.15.39:0/3758201913 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e340cca30 con 0x7f1e340704b0 2023-11-28T11:57:03.256 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7fbc6d31a700 1 -- 172.21.15.39:0/3820191099 shutdown_connections 2023-11-28T11:57:03.256 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7fbc6d31a700 1 --2- 172.21.15.39:0/3820191099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc600e2d80 0x7fbc600528c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.256 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7fbc6d31a700 1 -- 172.21.15.39:0/3820191099 >> 172.21.15.39:0/3820191099 conn(0x7fbc60051770 msgr2=0x7fbc60051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:03.256 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7fac23fff700 1 -- 172.21.15.39:0/352344109 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c011830 con 0x7fac2c06c220 2023-11-28T11:57:03.256 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7fac23fff700 1 -- 172.21.15.39:0/352344109 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1c011990 con 0x7fac2c06c220 2023-11-28T11:57:03.256 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.221+0000 7fac23fff700 1 -- 172.21.15.39:0/352344109 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c011d40 con 0x7fac2c06c220 2023-11-28T11:57:03.257 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7f1e39923700 1 --2- 172.21.15.39:0/3758201913 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e340704b0 0x7f1e34164960 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1e24009880 tx=0x7f1e24009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f84ec72e16cfd4a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.257 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7f0776d9d700 1 -- 172.21.15.39:0/306214860 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0764003c00 msgr2=0x7f077814acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.257 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7fbc6d31a700 1 -- 172.21.15.39:0/3820191099 shutdown_connections 2023-11-28T11:57:03.258 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7f0776d9d700 1 --2- 172.21.15.39:0/306214860 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0764003c00 0x7f077814acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.258 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7f0776d9d700 1 -- 172.21.15.39:0/306214860 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07780af8c0 msgr2=0x7f07780afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.258 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7f54ff59e700 1 --2- 172.21.15.39:0/2626285161 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f550006afa0 0x7f550006c040 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f54f8009e50 tx=0x7f54f800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f99f2f949d63a47 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.258 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7f0776d9d700 1 --2- 172.21.15.39:0/306214860 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07780af8c0 0x7f07780afd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.259 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7fc8fd9fc700 1 Processor -- start 2023-11-28T11:57:03.259 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7fb7cf03e700 1 -- 172.21.15.39:0/3304942612 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7c806d4c0 msgr2=0x7fb7c816b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.259 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7fb7cf03e700 1 --2- 172.21.15.39:0/3304942612 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7c806d4c0 0x7fb7c816b630 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc009880 tx=0x7fb7bc009b90 comp rx=0 tx=0).stop 2023-11-28T11:57:03.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7f0776d9d700 1 -- 172.21.15.39:0/306214860 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077814f720 con 0x7f07780ae020 2023-11-28T11:57:03.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7f0776d9d700 1 --2- 172.21.15.39:0/306214860 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07780ae020 0x7f07780ae4a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f077806ff30 tx=0x7f077000b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7f1e2bfff700 1 -- 172.21.15.39:0/3758201913 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e24004230 con 0x7f1e340704b0 2023-11-28T11:57:03.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7fb7cf03e700 1 -- 172.21.15.39:0/3304942612 shutdown_connections 2023-11-28T11:57:03.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7f1e2bfff700 1 -- 172.21.15.39:0/3758201913 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e24004390 con 0x7f1e340704b0 2023-11-28T11:57:03.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7f1e2bfff700 1 -- 172.21.15.39:0/3758201913 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e240036c0 con 0x7f1e340704b0 2023-11-28T11:57:03.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7f54fdd9b700 1 -- 172.21.15.39:0/2626285161 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f800e070 con 0x7f550006afa0 2023-11-28T11:57:03.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7f54fdd9b700 1 -- 172.21.15.39:0/2626285161 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f800b9c0 con 0x7f550006afa0 2023-11-28T11:57:03.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7f54fdd9b700 1 -- 172.21.15.39:0/2626285161 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f800bd70 con 0x7f550006afa0 2023-11-28T11:57:03.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7fbc6d31a700 1 -- 172.21.15.39:0/3820191099 wait complete. 2023-11-28T11:57:03.262 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7fb7cf03e700 1 --2- 172.21.15.39:0/3304942612 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7c806d4c0 0x7fb7c816b630 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.262 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7fb7cf03e700 1 -- 172.21.15.39:0/3304942612 >> 172.21.15.39:0/3304942612 conn(0x7fb7c80cf350 msgr2=0x7fb7c80b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:03.262 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7f076f7fe700 1 -- 172.21.15.39:0/306214860 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0770010040 con 0x7f07780ae020 2023-11-28T11:57:03.262 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7f076f7fe700 1 -- 172.21.15.39:0/306214860 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0770003a40 con 0x7f07780ae020 2023-11-28T11:57:03.262 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7f076f7fe700 1 -- 172.21.15.39:0/306214860 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0770003dd0 con 0x7f07780ae020 2023-11-28T11:57:03.263 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7f1e3a124700 1 -- 172.21.15.39:0/3758201913 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e340704b0 msgr2=0x7f1e34164960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.263 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7f1e3a124700 1 --2- 172.21.15.39:0/3758201913 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e340704b0 0x7f1e34164960 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1e24009880 tx=0x7f1e24009b90 comp rx=0 tx=0).stop 2023-11-28T11:57:03.263 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7f077cabc700 1 -- 172.21.15.39:0/306214860 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0778070a20 con 0x7f07780ae020 2023-11-28T11:57:03.263 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7f077cabc700 1 -- 172.21.15.39:0/306214860 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0778159790 con 0x7f07780ae020 2023-11-28T11:57:03.263 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7f5505219700 1 -- 172.21.15.39:0/2626285161 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f550006afa0 msgr2=0x7f550006c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7f5505219700 1 --2- 172.21.15.39:0/2626285161 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f550006afa0 0x7f550006c040 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f54f8009e50 tx=0x7f54f800b330 comp rx=0 tx=0).stop 2023-11-28T11:57:03.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7fac32529700 1 -- 172.21.15.39:0/352344109 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac2c06c220 msgr2=0x7fac2c0c3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7fac32529700 1 --2- 172.21.15.39:0/352344109 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac2c06c220 0x7fac2c0c3770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0d1300 tx=0x7fac1c009b30 comp rx=0 tx=0).stop 2023-11-28T11:57:03.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7f1e3a124700 1 -- 172.21.15.39:0/3758201913 shutdown_connections 2023-11-28T11:57:03.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7f1e3a124700 1 --2- 172.21.15.39:0/3758201913 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e340704b0 0x7f1e34164960 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7f1e3a124700 1 -- 172.21.15.39:0/3758201913 >> 172.21.15.39:0/3758201913 conn(0x7f1e340b0f80 msgr2=0x7f1e340ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:03.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7fb7cf03e700 1 -- 172.21.15.39:0/3304942612 shutdown_connections 2023-11-28T11:57:03.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7fb7cf03e700 1 -- 172.21.15.39:0/3304942612 wait complete. 2023-11-28T11:57:03.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7fac32529700 1 -- 172.21.15.39:0/352344109 shutdown_connections 2023-11-28T11:57:03.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7fac32529700 1 --2- 172.21.15.39:0/352344109 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac2c06c670 0x7fac2c0c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7f8e9effd700 1 -- 172.21.15.39:0/1325344395 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8ea400e040 con 0x7f8ea80cc290 2023-11-28T11:57:03.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7fac32529700 1 --2- 172.21.15.39:0/352344109 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac2c06c220 0x7fac2c0c3770 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7fac32529700 1 --2- 172.21.15.39:0/352344109 >> v2:172.21.15.39:3300/0 conn(0x7fac2c163e50 0x7fac2c165030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7fac32529700 1 -- 172.21.15.39:0/352344109 >> 172.21.15.39:0/352344109 conn(0x7fac2c099af0 msgr2=0x7fac2c0d07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:03.267 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7fc8fd9fc700 1 -- start start 2023-11-28T11:57:03.267 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7fc8fd9fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc8e8004450 0x7fc8f0048d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.267 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7f8e9effd700 1 --2- 172.21.15.39:0/1325344395 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8e8c064fb0 0x7f8e8c067460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7fc8fd9fc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8f00db1e0 0x7fc8f00e93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7fc8fd9fc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8f00db650 0x7fc8f00e98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7fc8fd9fc700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f00d7700 con 0x7fc8e8004450 2023-11-28T11:57:03.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7fc8fd9fc700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f00dc760 con 0x7fc8f00db1e0 2023-11-28T11:57:03.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7fc8fd9fc700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f00dcbf0 con 0x7fc8f00db650 2023-11-28T11:57:03.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7f5505219700 1 -- 172.21.15.39:0/2626285161 shutdown_connections 2023-11-28T11:57:03.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7f5505219700 1 --2- 172.21.15.39:0/2626285161 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f550006afa0 0x7f550006c040 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7f5505219700 1 --2- 172.21.15.39:0/2626285161 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5500159590 0x7f550006bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7f5505219700 1 -- 172.21.15.39:0/2626285161 >> 172.21.15.39:0/2626285161 conn(0x7f55000cf350 msgr2=0x7f55000b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:03.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7f8e9effd700 1 -- 172.21.15.39:0/1325344395 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8ea4013070 con 0x7f8ea80cc290 2023-11-28T11:57:03.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7f8e9effd700 1 --2- 172.21.15.39:0/1325344395 >> [v2:172.21.15.39:6800/36179,v1:172.21.15.39:6801/36179] conn(0x7f8e8c06eb10 0x7f8e8c070f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7f8e9effd700 1 -- 172.21.15.39:0/1325344395 --> [v2:172.21.15.39:6800/36179,v1:172.21.15.39:6801/36179] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8e8c071610 con 0x7f8e8c06eb10 2023-11-28T11:57:03.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7f8e9effd700 1 -- 172.21.15.39:0/1325344395 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ea4083f70 con 0x7f8ea80cc290 2023-11-28T11:57:03.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7f8eae4fe700 1 --2- 172.21.15.39:0/1325344395 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8e8c064fb0 0x7f8e8c067460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7fc8fc9fa700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc8e8004450 0x7fc8f0048d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7fc8fc9fa700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc8e8004450 0x7fc8f0048d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45140/0 (socket says 172.21.15.39:45140) 2023-11-28T11:57:03.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7fc8fc9fa700 1 -- 172.21.15.39:0/4260573788 learned_addr learned my addr 172.21.15.39:0/4260573788 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:03.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7fc8fd1fb700 1 --2- 172.21.15.39:0/4260573788 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8f00db650 0x7fc8f00e98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7f1e3a124700 1 -- 172.21.15.39:0/3758201913 shutdown_connections 2023-11-28T11:57:03.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7f1e3a124700 1 -- 172.21.15.39:0/3758201913 wait complete. 2023-11-28T11:57:03.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7fac32529700 1 -- 172.21.15.39:0/352344109 shutdown_connections 2023-11-28T11:57:03.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.225+0000 7f5505219700 1 -- 172.21.15.39:0/2626285161 shutdown_connections 2023-11-28T11:57:03.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.229+0000 7f8eaecff700 1 --2- 172.21.15.39:0/1325344395 >> [v2:172.21.15.39:6800/36179,v1:172.21.15.39:6801/36179] conn(0x7f8e8c06eb10 0x7f8e8c070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.229+0000 7fc8fc9fa700 1 -- 172.21.15.39:0/4260573788 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8f00db650 msgr2=0x7fc8f00e98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.229+0000 7fc8fc9fa700 1 --2- 172.21.15.39:0/4260573788 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8f00db650 0x7fc8f00e98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.229+0000 7fc8fc9fa700 1 -- 172.21.15.39:0/4260573788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8f00db1e0 msgr2=0x7fc8f00e93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.229+0000 7fbc6d31a700 1 Processor -- start 2023-11-28T11:57:03.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.229+0000 7f5505219700 1 -- 172.21.15.39:0/2626285161 wait complete. 2023-11-28T11:57:03.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.229+0000 7fc8f7fff700 1 --2- 172.21.15.39:0/4260573788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8f00db1e0 0x7fc8f00e93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.229+0000 7fbc6d31a700 1 -- start start 2023-11-28T11:57:03.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.229+0000 7fc8fc9fa700 1 --2- 172.21.15.39:0/4260573788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8f00db1e0 0x7fc8f00e93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.229+0000 7fb7cf03e700 1 Processor -- start 2023-11-28T11:57:03.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.229+0000 7fc8fc9fa700 1 -- 172.21.15.39:0/4260573788 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f0052780 con 0x7fc8e8004450 2023-11-28T11:57:03.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.229+0000 7fc8f7fff700 1 --2- 172.21.15.39:0/4260573788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8f00db1e0 0x7fc8f00e93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:57:03.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.229+0000 7fac32529700 1 -- 172.21.15.39:0/352344109 wait complete. 2023-11-28T11:57:03.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.229+0000 7f077cabc700 1 -- 172.21.15.39:0/306214860 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f077814b1f0 con 0x7f07780ae020 2023-11-28T11:57:03.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.229+0000 7f8eaecff700 1 --2- 172.21.15.39:0/1325344395 >> [v2:172.21.15.39:6800/36179,v1:172.21.15.39:6801/36179] conn(0x7f8e8c06eb10 0x7f8e8c070f40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.229+0000 7fbc6d31a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc60036770 0x7fbc600e5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.229+0000 7fbc6d31a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc6003a450 0x7fbc60178960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.229+0000 7fbc6d31a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc600e2d80 0x7fbc600ddff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.229+0000 7f8eae4fe700 1 --2- 172.21.15.39:0/1325344395 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8e8c064fb0 0x7f8e8c067460 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8ea815b0c0 tx=0x7f8e98008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.229+0000 7fbc66ffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc60036770 0x7fbc600e5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.229+0000 7fbc66ffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc60036770 0x7fbc600e5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:42822/0 (socket says 172.21.15.39:42822) 2023-11-28T11:57:03.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.229+0000 7fbc66ffd700 1 -- 172.21.15.39:0/395291160 learned_addr learned my addr 172.21.15.39:0/395291160 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:03.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.229+0000 7fb7cf03e700 1 -- start start 2023-11-28T11:57:03.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.229+0000 7fb7cf03e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7c806d4c0 0x7fb7c8162520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.229+0000 7fb7cf03e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7c80cdfb0 0x7fb7c8161e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.229+0000 7fb7cf03e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7c8163cb0 0x7fb7c81eadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.229+0000 7fb7cf03e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c8162e30 con 0x7fb7c80cdfb0 2023-11-28T11:57:03.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.229+0000 7fb7cf03e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c81ea920 con 0x7fb7c8163cb0 2023-11-28T11:57:03.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.229+0000 7fb7cf03e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c8162340 con 0x7fb7c806d4c0 2023-11-28T11:57:03.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.229+0000 7f1e3a124700 1 Processor -- start 2023-11-28T11:57:03.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.229+0000 7fc8fc9fa700 1 --2- 172.21.15.39:0/4260573788 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc8e8004450 0x7fc8f0048d50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec00e7c0 tx=0x7fc8ec00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.229+0000 7fbc667fc700 1 --2- 172.21.15.39:0/395291160 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc6003a450 0x7fbc60178960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.229+0000 7f076f7fe700 1 -- 172.21.15.39:0/306214860 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f077000b840 con 0x7f07780ae020 2023-11-28T11:57:03.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.229+0000 7f1e3a124700 1 -- start start 2023-11-28T11:57:03.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.229+0000 7f8e9effd700 1 -- 172.21.15.39:0/1325344395 <== osd.0 v2:172.21.15.39:6800/36179 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f8e8c071610 con 0x7f8e8c06eb10 2023-11-28T11:57:03.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7fbc6d31a700 1 -- 172.21.15.39:0/395291160 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc600e4ec0 con 0x7fbc600e2d80 2023-11-28T11:57:03.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7fbc6d31a700 1 -- 172.21.15.39:0/395291160 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc600e42b0 con 0x7fbc60036770 2023-11-28T11:57:03.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7fbc6d31a700 1 -- 172.21.15.39:0/395291160 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc600e4590 con 0x7fbc6003a450 2023-11-28T11:57:03.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7fc8f57fa700 1 -- 172.21.15.39:0/4260573788 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec004220 con 0x7fc8e8004450 2023-11-28T11:57:03.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7fc8f57fa700 1 -- 172.21.15.39:0/4260573788 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ec0043a0 con 0x7fc8e8004450 2023-11-28T11:57:03.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7fb7c7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7c80cdfb0 0x7fb7c8161e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7f5505219700 1 Processor -- start 2023-11-28T11:57:03.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7fc8fd9fc700 1 -- 172.21.15.39:0/4260573788 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8f00341e0 con 0x7fc8e8004450 2023-11-28T11:57:03.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7fb7c7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7c80cdfb0 0x7fb7c8161e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45146/0 (socket says 172.21.15.39:45146) 2023-11-28T11:57:03.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7f5505219700 1 -- start start 2023-11-28T11:57:03.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7fb7c7fff700 1 -- 172.21.15.39:0/2878828646 learned_addr learned my addr 172.21.15.39:0/2878828646 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:03.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7fc8f57fa700 1 -- 172.21.15.39:0/4260573788 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec0036c0 con 0x7fc8e8004450 2023-11-28T11:57:03.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7fc8fd9fc700 1 -- 172.21.15.39:0/4260573788 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f0037a00 con 0x7fc8e8004450 2023-11-28T11:57:03.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7fac32529700 1 Processor -- start 2023-11-28T11:57:03.284 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7fb7cd5db700 1 --2- 172.21.15.39:0/2878828646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7c8163cb0 0x7fb7c81eadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.284 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7fb7ccdda700 1 --2- 172.21.15.39:0/2878828646 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7c806d4c0 0x7fb7c8162520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.284 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7f1e3a124700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e34070080 0x7f1e3415ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.284 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7f1e3a124700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e340704b0 0x7f1e341f93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.284 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7f1e3a124700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e34160710 0x7f1e341f98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.284 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7f1e3a124700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e34158160 con 0x7f1e34160710 2023-11-28T11:57:03.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7f1e3a124700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3415a490 con 0x7f1e340704b0 2023-11-28T11:57:03.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7f1e3a124700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e34162710 con 0x7f1e34070080 2023-11-28T11:57:03.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7f1e39923700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e34160710 0x7f1e341f98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7f1e39923700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e34160710 0x7f1e341f98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45158/0 (socket says 172.21.15.39:45158) 2023-11-28T11:57:03.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7f1e39923700 1 -- 172.21.15.39:0/122659937 learned_addr learned my addr 172.21.15.39:0/122659937 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:03.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7fbc677fe700 1 --2- 172.21.15.39:0/395291160 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc600e2d80 0x7fbc600ddff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7fc8fd9fc700 1 -- 172.21.15.39:0/4260573788 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc8f00053f0 con 0x7fc8e8004450 2023-11-28T11:57:03.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7f5505219700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f550006afa0 0x7f5500158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7f5505219700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f55001591c0 0x7f550015b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7f5505219700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5500159590 0x7f55000b3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7f5505219700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55000c6b10 con 0x7f550006afa0 2023-11-28T11:57:03.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7f5505219700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55000c6df0 con 0x7f5500159590 2023-11-28T11:57:03.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7f5505219700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55000c70d0 con 0x7f55001591c0 2023-11-28T11:57:03.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7fbc66ffd700 1 -- 172.21.15.39:0/395291160 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc6003a450 msgr2=0x7fbc60178960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7fbc66ffd700 1 --2- 172.21.15.39:0/395291160 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc6003a450 0x7fbc60178960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7fbc66ffd700 1 -- 172.21.15.39:0/395291160 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc600e2d80 msgr2=0x7fbc600ddff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7fbc66ffd700 1 --2- 172.21.15.39:0/395291160 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc600e2d80 0x7fbc600ddff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7fbc66ffd700 1 -- 172.21.15.39:0/395291160 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc5c0094b0 con 0x7fbc60036770 2023-11-28T11:57:03.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7f1e39923700 1 -- 172.21.15.39:0/122659937 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e34070080 msgr2=0x7f1e3415ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7f1e39923700 1 --2- 172.21.15.39:0/122659937 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e34070080 0x7f1e3415ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7f1e39923700 1 -- 172.21.15.39:0/122659937 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e340704b0 msgr2=0x7f1e341f93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7f1e39923700 1 --2- 172.21.15.39:0/122659937 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e340704b0 0x7f1e341f93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7f1e39923700 1 -- 172.21.15.39:0/122659937 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e240094b0 con 0x7f1e34160710 2023-11-28T11:57:03.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7fb7c7fff700 1 -- 172.21.15.39:0/2878828646 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7c806d4c0 msgr2=0x7fb7c8162520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7f54ff59e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5500159590 0x7f55000b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.289 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7f54ff59e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5500159590 0x7f55000b3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:42858/0 (socket says 172.21.15.39:42858) 2023-11-28T11:57:03.289 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7f54ff59e700 1 -- 172.21.15.39:0/1449476735 learned_addr learned my addr 172.21.15.39:0/1449476735 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:03.289 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7f54fe59c700 1 --2- 172.21.15.39:0/1449476735 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f55001591c0 0x7f550015b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.289 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7f076f7fe700 1 --2- 172.21.15.39:0/306214860 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0758064f10 0x7f07580673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.289 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7f076f7fe700 1 -- 172.21.15.39:0/306214860 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f07700820e0 con 0x7f07780ae020 2023-11-28T11:57:03.289 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7f076f7fe700 1 --2- 172.21.15.39:0/306214860 >> [v2:172.21.15.184:6800/36504,v1:172.21.15.184:6801/36504] conn(0x7f075806ebe0 0x7f0758071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.289 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7f076f7fe700 1 -- 172.21.15.39:0/306214860 --> [v2:172.21.15.184:6800/36504,v1:172.21.15.184:6801/36504] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f07580716e0 con 0x7f075806ebe0 2023-11-28T11:57:03.289 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7f076f7fe700 1 -- 172.21.15.39:0/306214860 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0770084700 con 0x7f07780ae020 2023-11-28T11:57:03.290 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7f1e39923700 1 --2- 172.21.15.39:0/122659937 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e34160710 0x7f1e341f98e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1e24009bd0 tx=0x7f1e24004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.290 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7fb7c7fff700 1 --2- 172.21.15.39:0/2878828646 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7c806d4c0 0x7fb7c8162520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.290 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7fb7c7fff700 1 -- 172.21.15.39:0/2878828646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7c8163cb0 msgr2=0x7fb7c81eadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.290 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7fb7c7fff700 1 --2- 172.21.15.39:0/2878828646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7c8163cb0 0x7fb7c81eadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.291 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7fb7c7fff700 1 -- 172.21.15.39:0/2878828646 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7bc0094b0 con 0x7fb7c80cdfb0 2023-11-28T11:57:03.291 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7fb7ccdda700 1 --2- 172.21.15.39:0/2878828646 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7c806d4c0 0x7fb7c8162520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:57:03.291 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7fb7cd5db700 1 --2- 172.21.15.39:0/2878828646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7c8163cb0 0x7fb7c81eadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:57:03.291 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.233+0000 7f077659c700 1 --2- 172.21.15.39:0/306214860 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0758064f10 0x7f07580673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.291 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7f54ff59e700 1 -- 172.21.15.39:0/1449476735 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f55001591c0 msgr2=0x7f550015b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7f54ff59e700 1 --2- 172.21.15.39:0/1449476735 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f55001591c0 0x7f550015b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7f54ff59e700 1 -- 172.21.15.39:0/1449476735 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f550006afa0 msgr2=0x7f5500158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7f54ff59e700 1 --2- 172.21.15.39:0/1449476735 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f550006afa0 0x7f5500158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7f54ff59e700 1 -- 172.21.15.39:0/1449476735 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f8009b30 con 0x7f5500159590 2023-11-28T11:57:03.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7fb7c7fff700 1 --2- 172.21.15.39:0/2878828646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7c80cdfb0 0x7fb7c8161e00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb7b800c700 tx=0x7fb7b800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7f1e29ffb700 1 -- 172.21.15.39:0/122659937 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e24006ea0 con 0x7f1e34160710 2023-11-28T11:57:03.293 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7f076dd9b700 1 --2- 172.21.15.39:0/306214860 >> [v2:172.21.15.184:6800/36504,v1:172.21.15.184:6801/36504] conn(0x7f075806ebe0 0x7f0758071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.293 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7fb7c57fa700 1 -- 172.21.15.39:0/2878828646 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b8005d90 con 0x7fb7c80cdfb0 2023-11-28T11:57:03.293 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7f54ff59e700 1 --2- 172.21.15.39:0/1449476735 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5500159590 0x7f55000b3500 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f54f8012000 tx=0x7f54f8004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.294 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7fb7c57fa700 1 -- 172.21.15.39:0/2878828646 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b80070d0 con 0x7fb7c80cdfb0 2023-11-28T11:57:03.294 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7fb7cf03e700 1 -- 172.21.15.39:0/2878828646 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7c8069e40 con 0x7fb7c80cdfb0 2023-11-28T11:57:03.294 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7f1e29ffb700 1 -- 172.21.15.39:0/122659937 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2401f070 con 0x7f1e34160710 2023-11-28T11:57:03.294 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7f1e29ffb700 1 -- 172.21.15.39:0/122659937 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e24011870 con 0x7f1e34160710 2023-11-28T11:57:03.294 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7f1e3a124700 1 -- 172.21.15.39:0/122659937 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e3406b6b0 con 0x7f1e34160710 2023-11-28T11:57:03.295 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7fb7cf03e700 1 -- 172.21.15.39:0/2878828646 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7c80cc780 con 0x7fb7c80cdfb0 2023-11-28T11:57:03.295 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7f1e3a124700 1 -- 172.21.15.39:0/122659937 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e3406b3d0 con 0x7f1e34160710 2023-11-28T11:57:03.295 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7fbc66ffd700 1 --2- 172.21.15.39:0/395291160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc60036770 0x7fbc600e5350 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbc5800c550 tx=0x7fbc5800c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.295 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7fb7c57fa700 1 -- 172.21.15.39:0/2878828646 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b8007440 con 0x7fb7c80cdfb0 2023-11-28T11:57:03.297 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7fc8f57fa700 1 -- 172.21.15.39:0/4260573788 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc8ec022070 con 0x7fc8e8004450 2023-11-28T11:57:03.297 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7fbc4f7fe700 1 -- 172.21.15.39:0/395291160 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc58004ca0 con 0x7fbc60036770 2023-11-28T11:57:03.297 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7f1e3a124700 1 -- 172.21.15.39:0/122659937 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1e340ad8f0 con 0x7f1e34160710 2023-11-28T11:57:03.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7fbc4f7fe700 1 -- 172.21.15.39:0/395291160 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc58004e00 con 0x7fbc60036770 2023-11-28T11:57:03.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7fbc4f7fe700 1 -- 172.21.15.39:0/395291160 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc58007310 con 0x7fbc60036770 2023-11-28T11:57:03.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7fac32529700 1 -- start start 2023-11-28T11:57:03.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7fac32529700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac2c06c220 0x7fac2c14af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7fac32529700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac2c06c670 0x7fac2c0c4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7fac32529700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac2c163e50 0x7fac2c152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7fac32529700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c153f20 con 0x7fac2c06c670 2023-11-28T11:57:03.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7fac32529700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c148700 con 0x7fac2c06c220 2023-11-28T11:57:03.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7fac32529700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c0c9e80 con 0x7fac2c163e50 2023-11-28T11:57:03.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7f076dd9b700 1 --2- 172.21.15.39:0/306214860 >> [v2:172.21.15.184:6800/36504,v1:172.21.15.184:6801/36504] conn(0x7f075806ebe0 0x7f0758071010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7fac31d28700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac2c163e50 0x7fac2c152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7f54e77fe700 1 -- 172.21.15.39:0/1449476735 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f80048f0 con 0x7f5500159590 2023-11-28T11:57:03.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7f54e77fe700 1 -- 172.21.15.39:0/1449476735 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f80099b0 con 0x7f5500159590 2023-11-28T11:57:03.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7f54e77fe700 1 -- 172.21.15.39:0/1449476735 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f801c680 con 0x7f5500159590 2023-11-28T11:57:03.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7f077659c700 1 --2- 172.21.15.39:0/306214860 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0758064f10 0x7f07580673c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0768001050 tx=0x7f0768007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7fb7cf03e700 1 -- 172.21.15.39:0/2878828646 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb7c806a120 con 0x7fb7c80cdfb0 2023-11-28T11:57:03.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7fac31d28700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac2c163e50 0x7fac2c152230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:48352/0 (socket says 172.21.15.39:48352) 2023-11-28T11:57:03.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7fac31d28700 1 -- 172.21.15.39:0/3587128939 learned_addr learned my addr 172.21.15.39:0/3587128939 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:03.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7fac31527700 1 --2- 172.21.15.39:0/3587128939 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac2c06c220 0x7fac2c14af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7fac30d26700 1 --2- 172.21.15.39:0/3587128939 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac2c06c670 0x7fac2c0c4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.241+0000 7fac31d28700 1 -- 172.21.15.39:0/3587128939 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac2c06c220 msgr2=0x7fac2c14af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.241+0000 7fac31d28700 1 --2- 172.21.15.39:0/3587128939 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac2c06c220 0x7fac2c14af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.241+0000 7fac31d28700 1 -- 172.21.15.39:0/3587128939 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac2c06c670 msgr2=0x7fac2c0c4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.241+0000 7fac31d28700 1 --2- 172.21.15.39:0/3587128939 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac2c06c670 0x7fac2c0c4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7fbc6d31a700 1 -- 172.21.15.39:0/395291160 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc600e3ab0 con 0x7fbc60036770 2023-11-28T11:57:03.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7fbc6d31a700 1 -- 172.21.15.39:0/395291160 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc600e37d0 con 0x7fbc60036770 2023-11-28T11:57:03.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.237+0000 7fc8f57fa700 1 --2- 172.21.15.39:0/4260573788 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc8dc064f10 0x7fc8dc0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.241+0000 7fc8f57fa700 1 -- 172.21.15.39:0/4260573788 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc8ec081970 con 0x7fc8e8004450 2023-11-28T11:57:03.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.241+0000 7fc8f57fa700 1 --2- 172.21.15.39:0/4260573788 >> [v2:172.21.15.39:6823/36182,v1:172.21.15.39:6825/36182] conn(0x7fc8dc06eb60 0x7fc8dc070f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.241+0000 7fc8f57fa700 1 -- 172.21.15.39:0/4260573788 --> [v2:172.21.15.39:6823/36182,v1:172.21.15.39:6825/36182] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc8dc071660 con 0x7fc8dc06eb60 2023-11-28T11:57:03.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.241+0000 7fac31d28700 1 -- 172.21.15.39:0/3587128939 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac1c0094b0 con 0x7fac2c163e50 2023-11-28T11:57:03.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.241+0000 7f5505219700 1 -- 172.21.15.39:0/1449476735 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55000caeb0 con 0x7f5500159590 2023-11-28T11:57:03.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.241+0000 7f5505219700 1 -- 172.21.15.39:0/1449476735 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55000cd920 con 0x7f5500159590 2023-11-28T11:57:03.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.241+0000 7f076f7fe700 1 -- 172.21.15.39:0/306214860 <== osd.4 v2:172.21.15.184:6800/36504 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f07580716e0 con 0x7f075806ebe0 2023-11-28T11:57:03.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.241+0000 7fc8fd1fb700 1 --2- 172.21.15.39:0/4260573788 >> [v2:172.21.15.39:6823/36182,v1:172.21.15.39:6825/36182] conn(0x7fc8dc06eb60 0x7fc8dc070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.304 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.241+0000 7fc8f7fff700 1 --2- 172.21.15.39:0/4260573788 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc8dc064f10 0x7fc8dc0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.304 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.241+0000 7fc8f57fa700 1 -- 172.21.15.39:0/4260573788 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8ec009400 con 0x7fc8e8004450 2023-11-28T11:57:03.304 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.241+0000 7f5505219700 1 -- 172.21.15.39:0/1449476735 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f55000cc6e0 con 0x7f5500159590 2023-11-28T11:57:03.304 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.241+0000 7fbc6d31a700 1 -- 172.21.15.39:0/395291160 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbc60052e00 con 0x7fbc60036770 2023-11-28T11:57:03.304 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.241+0000 7fb7c57fa700 1 -- 172.21.15.39:0/2878828646 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb7b8019030 con 0x7fb7c80cdfb0 2023-11-28T11:57:03.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.241+0000 7f1e29ffb700 1 -- 172.21.15.39:0/122659937 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1e2402a020 con 0x7f1e34160710 2023-11-28T11:57:03.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.241+0000 7fc8f7fff700 1 --2- 172.21.15.39:0/4260573788 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc8dc064f10 0x7fc8dc0673c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc8e4015040 tx=0x7fc8e400a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.241+0000 7fbc4f7fe700 1 -- 172.21.15.39:0/395291160 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbc5801a020 con 0x7fbc60036770 2023-11-28T11:57:03.306 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.241+0000 7fc8fd1fb700 1 --2- 172.21.15.39:0/4260573788 >> [v2:172.21.15.39:6823/36182,v1:172.21.15.39:6825/36182] conn(0x7fc8dc06eb60 0x7fc8dc070f90 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.306 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.245+0000 7f1e29ffb700 1 --2- 172.21.15.39:0/122659937 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1e18064fb0 0x7f1e18067460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.306 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.245+0000 7f1e29ffb700 1 -- 172.21.15.39:0/122659937 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1e24083ff0 con 0x7f1e34160710 2023-11-28T11:57:03.307 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.241+0000 7fac31d28700 1 --2- 172.21.15.39:0/3587128939 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac2c163e50 0x7fac2c152230 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fac28007b20 tx=0x7fac28007e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.307 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.241+0000 7fac21ffb700 1 -- 172.21.15.39:0/3587128939 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac28017070 con 0x7fac2c163e50 2023-11-28T11:57:03.307 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.241+0000 7fac21ffb700 1 -- 172.21.15.39:0/3587128939 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2800f040 con 0x7fac2c163e50 2023-11-28T11:57:03.307 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.241+0000 7fac21ffb700 1 -- 172.21.15.39:0/3587128939 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac28003c80 con 0x7fac2c163e50 2023-11-28T11:57:03.307 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.245+0000 7fac32529700 1 -- 172.21.15.39:0/3587128939 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac2c0cd150 con 0x7fac2c163e50 2023-11-28T11:57:03.307 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.245+0000 7fac32529700 1 -- 172.21.15.39:0/3587128939 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac2c164220 con 0x7fac2c163e50 2023-11-28T11:57:03.308 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.245+0000 7fc8f57fa700 1 -- 172.21.15.39:0/4260573788 <== osd.1 v2:172.21.15.39:6823/36182 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fc8dc071660 con 0x7fc8dc06eb60 2023-11-28T11:57:03.308 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.245+0000 7fbc4f7fe700 1 --2- 172.21.15.39:0/395291160 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fbc54064ee0 0x7fbc54067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.308 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.245+0000 7fbc4f7fe700 1 -- 172.21.15.39:0/395291160 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbc58081e80 con 0x7fbc60036770 2023-11-28T11:57:03.308 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.245+0000 7fbc4f7fe700 1 --2- 172.21.15.39:0/395291160 >> [v2:172.21.15.39:6808/36183,v1:172.21.15.39:6810/36183] conn(0x7fbc5406ea30 0x7fbc54070e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.308 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.245+0000 7fbc4f7fe700 1 -- 172.21.15.39:0/395291160 --> [v2:172.21.15.39:6808/36183,v1:172.21.15.39:6810/36183] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbc54071530 con 0x7fbc5406ea30 2023-11-28T11:57:03.308 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.245+0000 7f1e29ffb700 1 --2- 172.21.15.39:0/122659937 >> [v2:172.21.15.39:6809/36181,v1:172.21.15.39:6811/36181] conn(0x7f1e1806ec80 0x7f1e180710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.309 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.245+0000 7f1e29ffb700 1 -- 172.21.15.39:0/122659937 --> [v2:172.21.15.39:6809/36181,v1:172.21.15.39:6811/36181] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1e18071780 con 0x7f1e1806ec80 2023-11-28T11:57:03.309 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.245+0000 7f1e29ffb700 1 -- 172.21.15.39:0/122659937 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1e240843a0 con 0x7f1e34160710 2023-11-28T11:57:03.309 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.245+0000 7f1e39122700 1 --2- 172.21.15.39:0/122659937 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1e18064fb0 0x7f1e18067460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.309 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.245+0000 7f1e38921700 1 --2- 172.21.15.39:0/122659937 >> [v2:172.21.15.39:6809/36181,v1:172.21.15.39:6811/36181] conn(0x7f1e1806ec80 0x7f1e180710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.309 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.245+0000 7fb7c57fa700 1 --2- 172.21.15.39:0/2878828646 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb7b4064ee0 0x7fb7b4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.309 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.245+0000 7fb7c57fa700 1 -- 172.21.15.39:0/2878828646 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb7b80814f0 con 0x7fb7c80cdfb0 2023-11-28T11:57:03.309 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.245+0000 7fb7c57fa700 1 --2- 172.21.15.39:0/2878828646 >> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] conn(0x7fb7b406eb30 0x7fb7b4070f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.309 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.245+0000 7fb7c57fa700 1 -- 172.21.15.39:0/2878828646 --> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb7b4071630 con 0x7fb7b406eb30 2023-11-28T11:57:03.309 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.245+0000 7fb7c57fa700 1 -- 172.21.15.39:0/2878828646 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7b8083bc0 con 0x7fb7c80cdfb0 2023-11-28T11:57:03.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.245+0000 7fac32529700 1 -- 172.21.15.39:0/3587128939 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fac2c0cd2e0 con 0x7fac2c163e50 2023-11-28T11:57:03.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.245+0000 7f54e77fe700 1 -- 172.21.15.39:0/1449476735 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f54f8022030 con 0x7f5500159590 2023-11-28T11:57:03.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.245+0000 7f54e77fe700 1 --2- 172.21.15.39:0/1449476735 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f54ec064fb0 0x7f54ec067460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.245+0000 7f54e77fe700 1 -- 172.21.15.39:0/1449476735 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f54f8083fd0 con 0x7f5500159590 2023-11-28T11:57:03.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.245+0000 7f54e77fe700 1 --2- 172.21.15.39:0/1449476735 >> [v2:172.21.15.184:6809/36506,v1:172.21.15.184:6811/36506] conn(0x7f54ec06ec80 0x7f54ec0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.245+0000 7f54e77fe700 1 -- 172.21.15.39:0/1449476735 --> [v2:172.21.15.184:6809/36506,v1:172.21.15.184:6811/36506] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f54ec071780 con 0x7f54ec06ec80 2023-11-28T11:57:03.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.245+0000 7f54e77fe700 1 -- 172.21.15.39:0/1449476735 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54f8084380 con 0x7f5500159590 2023-11-28T11:57:03.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.245+0000 7fbc667fc700 1 --2- 172.21.15.39:0/395291160 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fbc54064ee0 0x7fbc54067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.245+0000 7f1e38921700 1 --2- 172.21.15.39:0/122659937 >> [v2:172.21.15.39:6809/36181,v1:172.21.15.39:6811/36181] conn(0x7f1e1806ec80 0x7f1e180710b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.245+0000 7fb7ccdda700 1 --2- 172.21.15.39:0/2878828646 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb7b4064ee0 0x7fb7b4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.245+0000 7fbc677fe700 1 --2- 172.21.15.39:0/395291160 >> [v2:172.21.15.39:6808/36183,v1:172.21.15.39:6810/36183] conn(0x7fbc5406ea30 0x7fbc54070e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.245+0000 7fb7cd5db700 1 --2- 172.21.15.39:0/2878828646 >> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] conn(0x7fb7b406eb30 0x7fb7b4070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.245+0000 7f54fe59c700 1 --2- 172.21.15.39:0/1449476735 >> [v2:172.21.15.184:6809/36506,v1:172.21.15.184:6811/36506] conn(0x7f54ec06ec80 0x7f54ec0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.245+0000 7f54fed9d700 1 --2- 172.21.15.39:0/1449476735 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f54ec064fb0 0x7f54ec067460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.245+0000 7fbc4f7fe700 1 -- 172.21.15.39:0/395291160 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc5804fbc0 con 0x7fbc60036770 2023-11-28T11:57:03.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.245+0000 7fbc677fe700 1 --2- 172.21.15.39:0/395291160 >> [v2:172.21.15.39:6808/36183,v1:172.21.15.39:6810/36183] conn(0x7fbc5406ea30 0x7fbc54070e60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.249+0000 7fbc667fc700 1 --2- 172.21.15.39:0/395291160 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fbc54064ee0 0x7fbc54067390 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c014040 tx=0x7fbc5c01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.245+0000 7f1e39122700 1 --2- 172.21.15.39:0/122659937 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1e18064fb0 0x7f1e18067460 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1e30000f60 tx=0x7f1e30007a60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.249+0000 7fb7ccdda700 1 --2- 172.21.15.39:0/2878828646 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb7b4064ee0 0x7fb7b4067390 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb7c81ebf90 tx=0x7fb7c0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.249+0000 7fb7cd5db700 1 --2- 172.21.15.39:0/2878828646 >> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] conn(0x7fb7b406eb30 0x7fb7b4070f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.249+0000 7fac21ffb700 1 -- 172.21.15.39:0/3587128939 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fac2800d7d0 con 0x7fac2c163e50 2023-11-28T11:57:03.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.249+0000 7f54fe59c700 1 --2- 172.21.15.39:0/1449476735 >> [v2:172.21.15.184:6809/36506,v1:172.21.15.184:6811/36506] conn(0x7f54ec06ec80 0x7f54ec0710b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.249+0000 7fbc4f7fe700 1 -- 172.21.15.39:0/395291160 <== osd.2 v2:172.21.15.39:6808/36183 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fbc54071530 con 0x7fbc5406ea30 2023-11-28T11:57:03.315 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.249+0000 7f1e29ffb700 1 -- 172.21.15.39:0/122659937 <== osd.3 v2:172.21.15.39:6809/36181 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1e18071780 con 0x7f1e1806ec80 2023-11-28T11:57:03.315 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.249+0000 7fac21ffb700 1 --2- 172.21.15.39:0/3587128939 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fac10064ee0 0x7fac10067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.315 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.249+0000 7fac21ffb700 1 -- 172.21.15.39:0/3587128939 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fac28081db0 con 0x7fac2c163e50 2023-11-28T11:57:03.315 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.249+0000 7f54fed9d700 1 --2- 172.21.15.39:0/1449476735 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f54ec064fb0 0x7f54ec067460 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f54f0000f60 tx=0x7f54f0007a60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.316 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.249+0000 7f54e77fe700 1 -- 172.21.15.39:0/1449476735 <== osd.7 v2:172.21.15.184:6809/36506 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f54ec071780 con 0x7f54ec06ec80 2023-11-28T11:57:03.316 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.249+0000 7fb7c57fa700 1 -- 172.21.15.39:0/2878828646 <== osd.5 v2:172.21.15.184:6808/36505 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb7b4071630 con 0x7fb7b406eb30 2023-11-28T11:57:03.316 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.249+0000 7fac21ffb700 1 --2- 172.21.15.39:0/3587128939 >> [v2:172.21.15.184:6821/36507,v1:172.21.15.184:6824/36507] conn(0x7fac1006eb30 0x7fac10070f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.316 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.249+0000 7fac31527700 1 --2- 172.21.15.39:0/3587128939 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fac10064ee0 0x7fac10067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.316 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.249+0000 7fac21ffb700 1 -- 172.21.15.39:0/3587128939 --> [v2:172.21.15.184:6821/36507,v1:172.21.15.184:6824/36507] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fac10071630 con 0x7fac1006eb30 2023-11-28T11:57:03.317 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.249+0000 7fac21ffb700 1 -- 172.21.15.39:0/3587128939 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fac28084390 con 0x7fac2c163e50 2023-11-28T11:57:03.317 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.249+0000 7fac31527700 1 --2- 172.21.15.39:0/3587128939 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fac10064ee0 0x7fac10067390 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fac2400aae0 tx=0x7fac24008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.317 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.253+0000 7fac30d26700 1 --2- 172.21.15.39:0/3587128939 >> [v2:172.21.15.184:6821/36507,v1:172.21.15.184:6824/36507] conn(0x7fac1006eb30 0x7fac10070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.317 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.257+0000 7fac30d26700 1 --2- 172.21.15.39:0/3587128939 >> [v2:172.21.15.184:6821/36507,v1:172.21.15.184:6824/36507] conn(0x7fac1006eb30 0x7fac10070f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.317 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.257+0000 7fac21ffb700 1 -- 172.21.15.39:0/3587128939 <== osd.6 v2:172.21.15.184:6821/36507 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fac10071630 con 0x7fac1006eb30 2023-11-28T11:57:03.318 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.265+0000 7f8eb0762700 1 -- 172.21.15.39:0/1325344395 --> [v2:172.21.15.39:6800/36179,v1:172.21.15.39:6801/36179] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8ea815bca0 con 0x7f8e8c06eb10 2023-11-28T11:57:03.318 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.269+0000 7f8e9effd700 1 -- 172.21.15.39:0/1325344395 <== osd.0 v2:172.21.15.39:6800/36179 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8ea815bca0 con 0x7f8e8c06eb10 2023-11-28T11:57:03.318 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.269+0000 7f8eb0762700 1 -- 172.21.15.39:0/1325344395 >> [v2:172.21.15.39:6800/36179,v1:172.21.15.39:6801/36179] conn(0x7f8e8c06eb10 msgr2=0x7f8e8c070f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.318 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.269+0000 7f8eb0762700 1 --2- 172.21.15.39:0/1325344395 >> [v2:172.21.15.39:6800/36179,v1:172.21.15.39:6801/36179] conn(0x7f8e8c06eb10 0x7f8e8c070f40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.319 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.269+0000 7f8eb0762700 1 -- 172.21.15.39:0/1325344395 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8e8c064fb0 msgr2=0x7f8e8c067460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.319 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.269+0000 7f8eb0762700 1 --2- 172.21.15.39:0/1325344395 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8e8c064fb0 0x7f8e8c067460 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8ea815b0c0 tx=0x7f8e98008040 comp rx=0 tx=0).stop 2023-11-28T11:57:03.319 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.269+0000 7f8eb0762700 1 -- 172.21.15.39:0/1325344395 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ea80cc290 msgr2=0x7f8ea81f55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.319 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.269+0000 7f8eb0762700 1 --2- 172.21.15.39:0/1325344395 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ea80cc290 0x7f8ea81f55b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8ea80719a0 tx=0x7f8ea4004770 comp rx=0 tx=0).stop 2023-11-28T11:57:03.319 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.269+0000 7f8eaecff700 1 -- 172.21.15.39:0/1325344395 reap_dead start 2023-11-28T11:57:03.319 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.269+0000 7f8eb0762700 1 -- 172.21.15.39:0/1325344395 shutdown_connections 2023-11-28T11:57:03.319 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.269+0000 7f8eb0762700 1 -- 172.21.15.39:0/1325344395 >> 172.21.15.39:0/1325344395 conn(0x7f8ea80ce6c0 msgr2=0x7f8ea8158ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:03.319 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.273+0000 7f1e3a124700 1 -- 172.21.15.39:0/122659937 --> [v2:172.21.15.39:6809/36181,v1:172.21.15.39:6811/36181] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1e34073cb0 con 0x7f1e1806ec80 2023-11-28T11:57:03.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.273+0000 7f8eb0762700 1 -- 172.21.15.39:0/1325344395 shutdown_connections 2023-11-28T11:57:03.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.273+0000 7f8eb0762700 1 -- 172.21.15.39:0/1325344395 wait complete. 2023-11-28T11:57:03.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.273+0000 7f1e29ffb700 1 -- 172.21.15.39:0/122659937 <== osd.3 v2:172.21.15.39:6809/36181 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1e34073cb0 con 0x7f1e1806ec80 2023-11-28T11:57:03.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.277+0000 7fbc6d31a700 1 -- 172.21.15.39:0/395291160 --> [v2:172.21.15.39:6808/36183,v1:172.21.15.39:6810/36183] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbc60005530 con 0x7fbc5406ea30 2023-11-28T11:57:03.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.277+0000 7f1e3a124700 1 -- 172.21.15.39:0/122659937 >> [v2:172.21.15.39:6809/36181,v1:172.21.15.39:6811/36181] conn(0x7f1e1806ec80 msgr2=0x7f1e180710b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.277+0000 7f1e3a124700 1 --2- 172.21.15.39:0/122659937 >> [v2:172.21.15.39:6809/36181,v1:172.21.15.39:6811/36181] conn(0x7f1e1806ec80 0x7f1e180710b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.277+0000 7f1e3a124700 1 -- 172.21.15.39:0/122659937 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1e18064fb0 msgr2=0x7f1e18067460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.277+0000 7f1e3a124700 1 --2- 172.21.15.39:0/122659937 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1e18064fb0 0x7f1e18067460 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1e30000f60 tx=0x7f1e30007a60 comp rx=0 tx=0).stop 2023-11-28T11:57:03.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.277+0000 7f1e3a124700 1 -- 172.21.15.39:0/122659937 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e34160710 msgr2=0x7f1e341f98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.322 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.277+0000 7f1e3a124700 1 --2- 172.21.15.39:0/122659937 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e34160710 0x7f1e341f98e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1e24009bd0 tx=0x7f1e24004770 comp rx=0 tx=0).stop 2023-11-28T11:57:03.322 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.277+0000 7fbc4f7fe700 1 -- 172.21.15.39:0/395291160 <== osd.2 v2:172.21.15.39:6808/36183 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbc60005530 con 0x7fbc5406ea30 2023-11-28T11:57:03.322 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.277+0000 7f077cabc700 1 -- 172.21.15.39:0/306214860 --> [v2:172.21.15.184:6800/36504,v1:172.21.15.184:6801/36504] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f07780c2330 con 0x7f075806ebe0 2023-11-28T11:57:03.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.277+0000 7f1e39923700 1 -- 172.21.15.39:0/122659937 reap_dead start 2023-11-28T11:57:03.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.277+0000 7f1e3a124700 1 -- 172.21.15.39:0/122659937 shutdown_connections 2023-11-28T11:57:03.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.277+0000 7f1e3a124700 1 -- 172.21.15.39:0/122659937 >> 172.21.15.39:0/122659937 conn(0x7f1e340b0f80 msgr2=0x7f1e34060660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:03.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.277+0000 7f1e3a124700 1 -- 172.21.15.39:0/122659937 shutdown_connections 2023-11-28T11:57:03.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.277+0000 7fb7cf03e700 1 -- 172.21.15.39:0/2878828646 --> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb7c81eaa90 con 0x7fb7b406eb30 2023-11-28T11:57:03.324 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.277+0000 7f1e3a124700 1 -- 172.21.15.39:0/122659937 wait complete. 2023-11-28T11:57:03.324 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.277+0000 7fc8fd9fc700 1 -- 172.21.15.39:0/4260573788 --> [v2:172.21.15.39:6823/36182,v1:172.21.15.39:6825/36182] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc8f00090f0 con 0x7fc8dc06eb60 2023-11-28T11:57:03.324 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.277+0000 7fbc6d31a700 1 -- 172.21.15.39:0/395291160 >> [v2:172.21.15.39:6808/36183,v1:172.21.15.39:6810/36183] conn(0x7fbc5406ea30 msgr2=0x7fbc54070e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.324 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.277+0000 7fbc6d31a700 1 --2- 172.21.15.39:0/395291160 >> [v2:172.21.15.39:6808/36183,v1:172.21.15.39:6810/36183] conn(0x7fbc5406ea30 0x7fbc54070e60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.325 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.277+0000 7f076f7fe700 1 -- 172.21.15.39:0/306214860 <== osd.4 v2:172.21.15.184:6800/36504 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f07600016a0 con 0x7f075806ebe0 2023-11-28T11:57:03.325 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.277+0000 7fbc6d31a700 1 -- 172.21.15.39:0/395291160 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fbc54064ee0 msgr2=0x7fbc54067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.325 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.277+0000 7fbc6d31a700 1 --2- 172.21.15.39:0/395291160 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fbc54064ee0 0x7fbc54067390 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c014040 tx=0x7fbc5c01c040 comp rx=0 tx=0).stop 2023-11-28T11:57:03.325 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.277+0000 7fbc6d31a700 1 -- 172.21.15.39:0/395291160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc60036770 msgr2=0x7fbc600e5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.325 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.277+0000 7fbc6d31a700 1 --2- 172.21.15.39:0/395291160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc60036770 0x7fbc600e5350 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbc5800c550 tx=0x7fbc5800c860 comp rx=0 tx=0).stop 2023-11-28T11:57:03.325 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.277+0000 7fbc677fe700 1 -- 172.21.15.39:0/395291160 reap_dead start 2023-11-28T11:57:03.326 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.277+0000 7fb7c57fa700 1 -- 172.21.15.39:0/2878828646 <== osd.5 v2:172.21.15.184:6808/36505 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb7c81eaa90 con 0x7fb7b406eb30 2023-11-28T11:57:03.326 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.277+0000 7fbc6d31a700 1 -- 172.21.15.39:0/395291160 shutdown_connections 2023-11-28T11:57:03.326 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.277+0000 7fbc6d31a700 1 -- 172.21.15.39:0/395291160 >> 172.21.15.39:0/395291160 conn(0x7fbc60051770 msgr2=0x7fbc60035720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:03.326 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.277+0000 7fb7cf03e700 1 -- 172.21.15.39:0/2878828646 >> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] conn(0x7fb7b406eb30 msgr2=0x7fb7b4070f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.326 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.277+0000 7fb7cf03e700 1 --2- 172.21.15.39:0/2878828646 >> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] conn(0x7fb7b406eb30 0x7fb7b4070f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.327 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.277+0000 7fc8f57fa700 1 -- 172.21.15.39:0/4260573788 <== osd.1 v2:172.21.15.39:6823/36182 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc8f00090f0 con 0x7fc8dc06eb60 2023-11-28T11:57:03.327 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.277+0000 7fbc6d31a700 1 -- 172.21.15.39:0/395291160 shutdown_connections 2023-11-28T11:57:03.327 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.281+0000 7f077cabc700 1 -- 172.21.15.39:0/306214860 >> [v2:172.21.15.184:6800/36504,v1:172.21.15.184:6801/36504] conn(0x7f075806ebe0 msgr2=0x7f0758071010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.327 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.281+0000 7f077cabc700 1 --2- 172.21.15.39:0/306214860 >> [v2:172.21.15.184:6800/36504,v1:172.21.15.184:6801/36504] conn(0x7f075806ebe0 0x7f0758071010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.328 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.281+0000 7fb7cf03e700 1 -- 172.21.15.39:0/2878828646 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb7b4064ee0 msgr2=0x7fb7b4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.328 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.281+0000 7fb7cf03e700 1 --2- 172.21.15.39:0/2878828646 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb7b4064ee0 0x7fb7b4067390 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb7c81ebf90 tx=0x7fb7c0009040 comp rx=0 tx=0).stop 2023-11-28T11:57:03.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.277+0000 7fbc6d31a700 1 -- 172.21.15.39:0/395291160 wait complete. 2023-11-28T11:57:03.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.281+0000 7f077cabc700 1 -- 172.21.15.39:0/306214860 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0758064f10 msgr2=0x7f07580673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.281+0000 7f077cabc700 1 --2- 172.21.15.39:0/306214860 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0758064f10 0x7f07580673c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0768001050 tx=0x7f0768007000 comp rx=0 tx=0).stop 2023-11-28T11:57:03.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.281+0000 7f077cabc700 1 -- 172.21.15.39:0/306214860 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07780ae020 msgr2=0x7f07780ae4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.281+0000 7f077cabc700 1 --2- 172.21.15.39:0/306214860 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07780ae020 0x7f07780ae4a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f077806ff30 tx=0x7f077000b390 comp rx=0 tx=0).stop 2023-11-28T11:57:03.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.281+0000 7f0776d9d700 1 -- 172.21.15.39:0/306214860 reap_dead start 2023-11-28T11:57:03.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.281+0000 7f077cabc700 1 -- 172.21.15.39:0/306214860 shutdown_connections 2023-11-28T11:57:03.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.281+0000 7f077cabc700 1 -- 172.21.15.39:0/306214860 >> 172.21.15.39:0/306214860 conn(0x7f07780ce6c0 msgr2=0x7f07780b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:03.330 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.281+0000 7f077cabc700 1 -- 172.21.15.39:0/306214860 shutdown_connections 2023-11-28T11:57:03.330 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.281+0000 7fb7cf03e700 1 -- 172.21.15.39:0/2878828646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7c80cdfb0 msgr2=0x7fb7c8161e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.330 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.281+0000 7fb7cf03e700 1 --2- 172.21.15.39:0/2878828646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7c80cdfb0 0x7fb7c8161e00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb7b800c700 tx=0x7fb7b800cac0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.330 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.281+0000 7fb7cd5db700 1 -- 172.21.15.39:0/2878828646 reap_dead start 2023-11-28T11:57:03.330 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.281+0000 7fb7cf03e700 1 -- 172.21.15.39:0/2878828646 shutdown_connections 2023-11-28T11:57:03.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.281+0000 7fb7cf03e700 1 -- 172.21.15.39:0/2878828646 >> 172.21.15.39:0/2878828646 conn(0x7fb7c80cf350 msgr2=0x7fb7c80ae770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:03.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.281+0000 7fb7cf03e700 1 -- 172.21.15.39:0/2878828646 shutdown_connections 2023-11-28T11:57:03.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.281+0000 7fb7cf03e700 1 -- 172.21.15.39:0/2878828646 wait complete. 2023-11-28T11:57:03.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.281+0000 7fc8fd9fc700 1 -- 172.21.15.39:0/4260573788 >> [v2:172.21.15.39:6823/36182,v1:172.21.15.39:6825/36182] conn(0x7fc8dc06eb60 msgr2=0x7fc8dc070f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.281+0000 7fc8fd9fc700 1 --2- 172.21.15.39:0/4260573788 >> [v2:172.21.15.39:6823/36182,v1:172.21.15.39:6825/36182] conn(0x7fc8dc06eb60 0x7fc8dc070f90 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.281+0000 7fc8fd9fc700 1 -- 172.21.15.39:0/4260573788 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc8dc064f10 msgr2=0x7fc8dc0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.281+0000 7fc8fd9fc700 1 --2- 172.21.15.39:0/4260573788 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc8dc064f10 0x7fc8dc0673c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc8e4015040 tx=0x7fc8e400a000 comp rx=0 tx=0).stop 2023-11-28T11:57:03.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.281+0000 7fc8fd9fc700 1 -- 172.21.15.39:0/4260573788 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc8e8004450 msgr2=0x7fc8f0048d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.281+0000 7fc8fd9fc700 1 --2- 172.21.15.39:0/4260573788 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc8e8004450 0x7fc8f0048d50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec00e7c0 tx=0x7fc8ec00eb80 comp rx=0 tx=0).stop 2023-11-28T11:57:03.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.281+0000 7fc8fd1fb700 1 -- 172.21.15.39:0/4260573788 reap_dead start 2023-11-28T11:57:03.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.281+0000 7fc8fd9fc700 1 -- 172.21.15.39:0/4260573788 shutdown_connections 2023-11-28T11:57:03.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.281+0000 7fc8fd9fc700 1 -- 172.21.15.39:0/4260573788 >> 172.21.15.39:0/4260573788 conn(0x7fc8f0051630 msgr2=0x7fc8f0034420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:03.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.285+0000 7f077cabc700 1 -- 172.21.15.39:0/306214860 wait complete. 2023-11-28T11:57:03.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.285+0000 7f5505219700 1 -- 172.21.15.39:0/1449476735 --> [v2:172.21.15.184:6809/36506,v1:172.21.15.184:6811/36506] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f55000c2ff0 con 0x7f54ec06ec80 2023-11-28T11:57:03.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.285+0000 7fc8fd9fc700 1 -- 172.21.15.39:0/4260573788 shutdown_connections 2023-11-28T11:57:03.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.285+0000 7fc8fd9fc700 1 -- 172.21.15.39:0/4260573788 wait complete. 2023-11-28T11:57:03.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.285+0000 7f54e77fe700 1 -- 172.21.15.39:0/1449476735 <== osd.7 v2:172.21.15.184:6809/36506 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f55000c2ff0 con 0x7f54ec06ec80 2023-11-28T11:57:03.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.285+0000 7fac32529700 1 -- 172.21.15.39:0/3587128939 --> [v2:172.21.15.184:6821/36507,v1:172.21.15.184:6824/36507] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fac2c0c7180 con 0x7fac1006eb30 2023-11-28T11:57:03.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.285+0000 7f54e57fa700 1 -- 172.21.15.39:0/1449476735 >> [v2:172.21.15.184:6809/36506,v1:172.21.15.184:6811/36506] conn(0x7f54ec06ec80 msgr2=0x7f54ec0710b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.285+0000 7f54e57fa700 1 --2- 172.21.15.39:0/1449476735 >> [v2:172.21.15.184:6809/36506,v1:172.21.15.184:6811/36506] conn(0x7f54ec06ec80 0x7f54ec0710b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.289+0000 7f54e57fa700 1 -- 172.21.15.39:0/1449476735 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f54ec064fb0 msgr2=0x7f54ec067460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.289+0000 7f54e57fa700 1 --2- 172.21.15.39:0/1449476735 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f54ec064fb0 0x7f54ec067460 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f54f0000f60 tx=0x7f54f0007a60 comp rx=0 tx=0).stop 2023-11-28T11:57:03.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.289+0000 7f54e57fa700 1 -- 172.21.15.39:0/1449476735 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5500159590 msgr2=0x7f55000b3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.289+0000 7f54e57fa700 1 --2- 172.21.15.39:0/1449476735 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5500159590 0x7f55000b3500 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f54f8012000 tx=0x7f54f8004af0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.289+0000 7f54ff59e700 1 -- 172.21.15.39:0/1449476735 reap_dead start 2023-11-28T11:57:03.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.289+0000 7fac21ffb700 1 -- 172.21.15.39:0/3587128939 <== osd.6 v2:172.21.15.184:6821/36507 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fac1c022040 con 0x7fac1006eb30 2023-11-28T11:57:03.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.289+0000 7fac32529700 1 -- 172.21.15.39:0/3587128939 >> [v2:172.21.15.184:6821/36507,v1:172.21.15.184:6824/36507] conn(0x7fac1006eb30 msgr2=0x7fac10070f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.289+0000 7fac32529700 1 --2- 172.21.15.39:0/3587128939 >> [v2:172.21.15.184:6821/36507,v1:172.21.15.184:6824/36507] conn(0x7fac1006eb30 0x7fac10070f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.293+0000 7f54e57fa700 1 -- 172.21.15.39:0/1449476735 shutdown_connections 2023-11-28T11:57:03.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.293+0000 7f54e57fa700 1 -- 172.21.15.39:0/1449476735 >> 172.21.15.39:0/1449476735 conn(0x7f55000cf350 msgr2=0x7f5500153430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:03.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.293+0000 7fac32529700 1 -- 172.21.15.39:0/3587128939 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fac10064ee0 msgr2=0x7fac10067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.293+0000 7fac32529700 1 --2- 172.21.15.39:0/3587128939 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fac10064ee0 0x7fac10067390 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fac2400aae0 tx=0x7fac24008040 comp rx=0 tx=0).stop 2023-11-28T11:57:03.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.293+0000 7fac32529700 1 -- 172.21.15.39:0/3587128939 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac2c163e50 msgr2=0x7fac2c152230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.293+0000 7fac32529700 1 --2- 172.21.15.39:0/3587128939 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac2c163e50 0x7fac2c152230 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fac28007b20 tx=0x7fac28007e30 comp rx=0 tx=0).stop 2023-11-28T11:57:03.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.293+0000 7fac31d28700 1 -- 172.21.15.39:0/3587128939 reap_dead start 2023-11-28T11:57:03.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.293+0000 7f54e57fa700 1 -- 172.21.15.39:0/1449476735 shutdown_connections 2023-11-28T11:57:03.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.293+0000 7f54e57fa700 1 -- 172.21.15.39:0/1449476735 wait complete. 2023-11-28T11:57:03.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.293+0000 7fac32529700 1 -- 172.21.15.39:0/3587128939 shutdown_connections 2023-11-28T11:57:03.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.293+0000 7fac32529700 1 -- 172.21.15.39:0/3587128939 >> 172.21.15.39:0/3587128939 conn(0x7fac2c099af0 msgr2=0x7fac2c0d07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:03.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.297+0000 7fac32529700 1 -- 172.21.15.39:0/3587128939 shutdown_connections 2023-11-28T11:57:03.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.297+0000 7fac32529700 1 -- 172.21.15.39:0/3587128939 wait complete. 2023-11-28T11:57:03.338 INFO:teuthology.orchestra.run.smithi039.stdout:60129542154 2023-11-28T11:57:03.339 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-28T11:57:03.340 INFO:teuthology.orchestra.run.smithi039.stdout:64424509450 2023-11-28T11:57:03.340 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-28T11:57:03.341 INFO:teuthology.orchestra.run.smithi039.stdout:64424509450 2023-11-28T11:57:03.341 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-28T11:57:03.342 INFO:teuthology.orchestra.run.smithi039.stdout:60129542154 2023-11-28T11:57:03.342 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-28T11:57:03.343 INFO:teuthology.orchestra.run.smithi039.stdout:64424509450 2023-11-28T11:57:03.343 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-28T11:57:03.344 INFO:teuthology.orchestra.run.smithi039.stdout:64424509450 2023-11-28T11:57:03.344 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-28T11:57:03.345 INFO:teuthology.orchestra.run.smithi039.stdout:64424509450 2023-11-28T11:57:03.345 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-28T11:57:03.346 INFO:teuthology.orchestra.run.smithi039.stdout:64424509450 2023-11-28T11:57:03.346 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-28T11:57:03.634 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.629+0000 7f85daeae700 1 Processor -- start 2023-11-28T11:57:03.634 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.629+0000 7f4f51dd2700 1 Processor -- start 2023-11-28T11:57:03.634 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.629+0000 7f85daeae700 1 -- start start 2023-11-28T11:57:03.635 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.629+0000 7f4f51dd2700 1 -- start start 2023-11-28T11:57:03.635 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.629+0000 7f3ab601e700 1 Processor -- start 2023-11-28T11:57:03.635 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.629+0000 7f6e60192700 1 Processor -- start 2023-11-28T11:57:03.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.629+0000 7f6e60192700 1 -- start start 2023-11-28T11:57:03.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.629+0000 7f3ab601e700 1 -- start start 2023-11-28T11:57:03.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.633+0000 7f4f51dd2700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f4f4c15c640 0x7f4f4c0d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.637 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.633+0000 7f4f51dd2700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4f4c069e00 0x7f4f4c06a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.637 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.633+0000 7f4f51dd2700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f4c06c600 con 0x7f4f4c071aa0 2023-11-28T11:57:03.637 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.633+0000 7f4f51dd2700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f4c06cef0 con 0x7f4f4c069e00 2023-11-28T11:57:03.637 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.633+0000 7f4f51dd2700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f4c06a7c0 con 0x7f4f4c15c640 2023-11-28T11:57:03.637 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.633+0000 7f85daeae700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85d4070840 0x7f85d4167180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.637 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.633+0000 7f85daeae700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85d406bb00 con 0x7f85d40cc290 2023-11-28T11:57:03.638 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.633+0000 7f85daeae700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85d40cc7c0 con 0x7f85d415c1f0 2023-11-28T11:57:03.638 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.633+0000 7f85daeae700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d406acc0 con 0x7f85d4070840 2023-11-28T11:57:03.638 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.633+0000 7f85d8c4a700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f85d415c1f0 0x7f85d406a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:57276/0 (socket says 172.21.15.39:57276) 2023-11-28T11:57:03.638 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.633+0000 7f85d8c4a700 1 -- 172.21.15.39:0/1272603535 learned_addr learned my addr 172.21.15.39:0/1272603535 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:03.638 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.633+0000 7f4f4bfff700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f4f4c071aa0 0x7f4f4c06d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:37960/0 (socket says 172.21.15.39:37960) 2023-11-28T11:57:03.638 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.633+0000 7f4f4bfff700 1 -- 172.21.15.39:0/2094893376 learned_addr learned my addr 172.21.15.39:0/2094893376 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:03.638 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.633+0000 7f4f50dd0700 1 --2- 172.21.15.39:0/2094893376 >> v2:172.21.15.184:3300/0 conn(0x7f4f4c15c640 0x7f4f4c0d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.639 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.633+0000 7f3ab601e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3ab015d510 0x7f3ab00b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.639 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.633+0000 7f85d944b700 1 --2- 172.21.15.39:0/1272603535 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85d4070840 0x7f85d4167180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.639 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.633+0000 7f4f515d1700 1 --2- 172.21.15.39:0/2094893376 >> v2:172.21.15.39:3300/0 conn(0x7f4f4c069e00 0x7f4f4c06a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.640 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.633+0000 7f85d3fff700 1 --1- 172.21.15.39:0/1272603535 >> v1:172.21.15.39:6789/0 conn(0x7f85d40cc290 0x7f85d4070130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:37954/0 (socket says 172.21.15.39:37954) 2023-11-28T11:57:03.640 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.633+0000 7f3ab601e700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab015d080 con 0x7f3ab01534a0 2023-11-28T11:57:03.640 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.633+0000 7f3ab601e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab0153870 con 0x7f3ab00b6030 2023-11-28T11:57:03.640 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.633+0000 7f3ab601e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ab015d970 con 0x7f3ab015d510 2023-11-28T11:57:03.640 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.633+0000 7f3aaeffd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3ab015d510 0x7f3ab00b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.641 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.633+0000 7f4f4b7fe700 1 -- 172.21.15.39:0/2094893376 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 707845807 0 0) 0x7f4f4c06c600 con 0x7f4f4c071aa0 2023-11-28T11:57:03.641 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.633+0000 7f4f4b7fe700 1 -- 172.21.15.39:0/2094893376 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f340035d0 con 0x7f4f4c071aa0 2023-11-28T11:57:03.641 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.633+0000 7f3aaf7fe700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f3ab01534a0 0x7f3ab0160920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:37964/0 (socket says 172.21.15.39:37964) 2023-11-28T11:57:03.641 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.633+0000 7f3aaf7fe700 1 -- 172.21.15.39:0/3282363103 learned_addr learned my addr 172.21.15.39:0/3282363103 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:03.642 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.633+0000 7f4f515d1700 1 -- 172.21.15.39:0/2094893376 >> v2:172.21.15.184:3300/0 conn(0x7f4f4c15c640 msgr2=0x7f4f4c0d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:03.642 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.633+0000 7f4f515d1700 1 --2- 172.21.15.39:0/2094893376 >> v2:172.21.15.184:3300/0 conn(0x7f4f4c15c640 0x7f4f4c0d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.642 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.633+0000 7f4f515d1700 1 -- 172.21.15.39:0/2094893376 >> v1:172.21.15.39:6789/0 conn(0x7f4f4c071aa0 legacy=0x7f4f4c06d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.642 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.633+0000 7f4f515d1700 1 -- 172.21.15.39:0/2094893376 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f4c0722f0 con 0x7f4f4c069e00 2023-11-28T11:57:03.642 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.633+0000 7f6e60192700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6e5815d510 0x7f6e580b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.633+0000 7f85d37fe700 1 -- 172.21.15.39:0/1272603535 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3888537844 0 0) 0x7f85d40cc7c0 con 0x7f85d415c1f0 2023-11-28T11:57:03.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.633+0000 7f85d37fe700 1 -- 172.21.15.39:0/1272603535 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85c40035d0 con 0x7f85d415c1f0 2023-11-28T11:57:03.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.633+0000 7f3aae7fc700 1 -- 172.21.15.39:0/3282363103 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3063338661 0 0) 0x7f3ab0153870 con 0x7f3ab00b6030 2023-11-28T11:57:03.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.633+0000 7f3aae7fc700 1 -- 172.21.15.39:0/3282363103 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a980035d0 con 0x7f3ab00b6030 2023-11-28T11:57:03.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.633+0000 7f85d37fe700 1 -- 172.21.15.39:0/1272603535 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1652232510 0 0) 0x7f85d406bb00 con 0x7f85d40cc290 2023-11-28T11:57:03.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f85d37fe700 1 -- 172.21.15.39:0/1272603535 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85d40cc7c0 con 0x7f85d40cc290 2023-11-28T11:57:03.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f85d37fe700 1 -- 172.21.15.39:0/1272603535 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1903548755 0 0) 0x7f85c40035d0 con 0x7f85d415c1f0 2023-11-28T11:57:03.644 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f85d37fe700 1 -- 172.21.15.39:0/1272603535 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85d4070840 msgr2=0x7f85d4167180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:03.644 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f85d37fe700 1 --2- 172.21.15.39:0/1272603535 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85d4070840 0x7f85d4167180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.644 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f85d37fe700 1 -- 172.21.15.39:0/1272603535 >> v1:172.21.15.39:6789/0 conn(0x7f85d40cc290 legacy=0x7f85d4070130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.644 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f6e60192700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e5815d080 con 0x7f6e580b6030 2023-11-28T11:57:03.644 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f6e60192700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e58153870 con 0x7f6e581534a0 2023-11-28T11:57:03.644 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f6e60192700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e5815d970 con 0x7f6e5815d510 2023-11-28T11:57:03.644 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f6e5d72d700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6e5815d510 0x7f6e580b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.645 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f6e5d72d700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6e5815d510 0x7f6e580b5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45188/0 (socket says 172.21.15.39:45188) 2023-11-28T11:57:03.645 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f6e5d72d700 1 -- 172.21.15.39:0/3606648936 learned_addr learned my addr 172.21.15.39:0/3606648936 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:03.645 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f3aaeffd700 1 -- 172.21.15.39:0/3282363103 >> v1:172.21.15.184:6789/0 conn(0x7f3ab00b6030 legacy=0x7f3ab0070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.645 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f85d37fe700 1 -- 172.21.15.39:0/1272603535 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d40aba70 con 0x7f85d415c1f0 2023-11-28T11:57:03.645 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f85d37fe700 1 -- 172.21.15.39:0/1272603535 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4013383302 0 0) 0x7f85c0001670 con 0x7f85d415c1f0 2023-11-28T11:57:03.645 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f85d37fe700 1 -- 172.21.15.39:0/1272603535 >> v1:172.21.15.184:6789/0 conn(0x7f85d415c1f0 legacy=0x7f85d406a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.645 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f85d37fe700 1 --2- 172.21.15.39:0/1272603535 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85c4003bb0 0x7f85c4003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.646 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f85d37fe700 1 --2- 172.21.15.39:0/1272603535 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85c4004870 0x7f85c4004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.646 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f85d37fe700 1 --2- 172.21.15.39:0/1272603535 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85c4005220 0x7f85c400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.646 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f85d37fe700 1 -- 172.21.15.39:0/1272603535 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d406acc0 con 0x7f85c4005220 2023-11-28T11:57:03.646 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f85d37fe700 1 -- 172.21.15.39:0/1272603535 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c400bfd0 con 0x7f85c4004870 2023-11-28T11:57:03.646 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f85d37fe700 1 -- 172.21.15.39:0/1272603535 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c400c190 con 0x7f85c4003bb0 2023-11-28T11:57:03.646 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f4f515d1700 1 --2- 172.21.15.39:0/2094893376 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f4c069e00 0x7f4f4c06a280 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c06e290 tx=0x7f4f3c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a0a98c3f33dd79d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.647 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f3aae7fc700 1 -- 172.21.15.39:0/3282363103 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4136447817 0 0) 0x7f3ab015d080 con 0x7f3ab01534a0 2023-11-28T11:57:03.647 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f3aaeffd700 1 -- 172.21.15.39:0/3282363103 >> v1:172.21.15.39:6789/0 conn(0x7f3ab01534a0 legacy=0x7f3ab0160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.647 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f3aaeffd700 1 -- 172.21.15.39:0/3282363103 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab00b6430 con 0x7f3ab015d510 2023-11-28T11:57:03.647 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f85d8c4a700 1 --2- 172.21.15.39:0/1272603535 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85c4003bb0 0x7f85c4003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.647 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f6e5d72d700 1 -- 172.21.15.39:0/3606648936 >> v1:172.21.15.184:6789/0 conn(0x7f6e581534a0 legacy=0x7f6e58160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.647 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f6e5d72d700 1 -- 172.21.15.39:0/3606648936 >> v1:172.21.15.39:6789/0 conn(0x7f6e580b6030 legacy=0x7f6e58070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.648 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f85d3fff700 1 --2- 172.21.15.39:0/1272603535 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85c4004870 0x7f85c4004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.648 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f6e5d72d700 1 -- 172.21.15.39:0/3606648936 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e580b6430 con 0x7f6e5815d510 2023-11-28T11:57:03.648 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f85d944b700 1 --2- 172.21.15.39:0/1272603535 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85c4005220 0x7f85c400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f4f4b7fe700 1 -- 172.21.15.39:0/2094893376 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c011830 con 0x7f4f4c069e00 2023-11-28T11:57:03.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f4f4b7fe700 1 -- 172.21.15.39:0/2094893376 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3c011990 con 0x7f4f4c069e00 2023-11-28T11:57:03.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f4f4b7fe700 1 -- 172.21.15.39:0/2094893376 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c011d20 con 0x7f4f4c069e00 2023-11-28T11:57:03.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f3aaeffd700 1 --2- 172.21.15.39:0/3282363103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ab015d510 0x7f3ab00b5af0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4009850 tx=0x7f3aa4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5dddd6bba703ad3a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f6e5d72d700 1 --2- 172.21.15.39:0/3606648936 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e5815d510 0x7f6e580b5af0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6e48009910 tx=0x7f6e48009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c7c4c9637214101 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f85d3fff700 1 -- 172.21.15.39:0/1272603535 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85c4003bb0 msgr2=0x7f85c4003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:03.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f85d3fff700 1 --2- 172.21.15.39:0/1272603535 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85c4003bb0 0x7f85c4003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f85d3fff700 1 -- 172.21.15.39:0/1272603535 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85c4005220 msgr2=0x7f85c400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:03.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f85d3fff700 1 --2- 172.21.15.39:0/1272603535 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85c4005220 0x7f85c400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f85d3fff700 1 -- 172.21.15.39:0/1272603535 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d40aba70 con 0x7f85c4004870 2023-11-28T11:57:03.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f6e5cf2c700 1 -- 172.21.15.39:0/3606648936 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4800ba60 con 0x7f6e5815d510 2023-11-28T11:57:03.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f3aae7fc700 1 -- 172.21.15.39:0/3282363103 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4011830 con 0x7f3ab015d510 2023-11-28T11:57:03.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f6e5cf2c700 1 -- 172.21.15.39:0/3606648936 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4800bbc0 con 0x7f6e5815d510 2023-11-28T11:57:03.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f6e5cf2c700 1 -- 172.21.15.39:0/3606648936 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e48009e60 con 0x7f6e5815d510 2023-11-28T11:57:03.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f85d3fff700 1 --2- 172.21.15.39:0/1272603535 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85c4004870 0x7f85c4004ce0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f85d40cc6f0 tx=0x7f85c40058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48fe3de73330026 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f3aae7fc700 1 -- 172.21.15.39:0/3282363103 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa4011990 con 0x7f3ab015d510 2023-11-28T11:57:03.652 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.637+0000 7f3aae7fc700 1 -- 172.21.15.39:0/3282363103 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4011d40 con 0x7f3ab015d510 2023-11-28T11:57:03.652 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.641+0000 7f85d37fe700 1 -- 172.21.15.39:0/1272603535 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c8005ac0 con 0x7f85c4004870 2023-11-28T11:57:03.652 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.641+0000 7f85d37fe700 1 -- 172.21.15.39:0/1272603535 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c8005c20 con 0x7f85c4004870 2023-11-28T11:57:03.652 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.641+0000 7f85d37fe700 1 -- 172.21.15.39:0/1272603535 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c80070d0 con 0x7f85c4004870 2023-11-28T11:57:03.652 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.641+0000 7f85daeae700 1 -- 172.21.15.39:0/1272603535 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85c4004870 msgr2=0x7f85c4004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.652 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.641+0000 7f85daeae700 1 --2- 172.21.15.39:0/1272603535 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85c4004870 0x7f85c4004ce0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f85d40cc6f0 tx=0x7f85c40058a0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.652 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.641+0000 7f85d944b700 1 -- 172.21.15.39:0/1272603535 reap_dead start 2023-11-28T11:57:03.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.641+0000 7f3ab601e700 1 -- 172.21.15.39:0/3282363103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ab015d510 msgr2=0x7f3ab00b5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.641+0000 7f3ab601e700 1 --2- 172.21.15.39:0/3282363103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ab015d510 0x7f3ab00b5af0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4009850 tx=0x7f3aa4009b60 comp rx=0 tx=0).stop 2023-11-28T11:57:03.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.641+0000 7f85daeae700 1 -- 172.21.15.39:0/1272603535 shutdown_connections 2023-11-28T11:57:03.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.641+0000 7f85daeae700 1 -- 172.21.15.39:0/1272603535 >> 172.21.15.39:0/1272603535 conn(0x7f85d40ce6c0 msgr2=0x7f85d40cea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:03.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.641+0000 7f6e60192700 1 -- 172.21.15.39:0/3606648936 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e5815d510 msgr2=0x7f6e580b5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.641+0000 7f6e60192700 1 --2- 172.21.15.39:0/3606648936 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e5815d510 0x7f6e580b5af0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6e48009910 tx=0x7f6e48009c20 comp rx=0 tx=0).stop 2023-11-28T11:57:03.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.641+0000 7f3ab601e700 1 -- 172.21.15.39:0/3282363103 shutdown_connections 2023-11-28T11:57:03.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.641+0000 7f3ab601e700 1 --2- 172.21.15.39:0/3282363103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ab015d510 0x7f3ab00b5af0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.641+0000 7f3ab601e700 1 -- 172.21.15.39:0/3282363103 >> 172.21.15.39:0/3282363103 conn(0x7f3ab006bfc0 msgr2=0x7f3ab006c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:03.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.641+0000 7f6e60192700 1 -- 172.21.15.39:0/3606648936 shutdown_connections 2023-11-28T11:57:03.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.641+0000 7f6e60192700 1 --2- 172.21.15.39:0/3606648936 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e5815d510 0x7f6e580b5af0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.655 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.641+0000 7f6e60192700 1 -- 172.21.15.39:0/3606648936 >> 172.21.15.39:0/3606648936 conn(0x7f6e5806bfc0 msgr2=0x7f6e5806c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:03.655 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.641+0000 7f3ab601e700 1 -- 172.21.15.39:0/3282363103 shutdown_connections 2023-11-28T11:57:03.655 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.641+0000 7f6e60192700 1 -- 172.21.15.39:0/3606648936 shutdown_connections 2023-11-28T11:57:03.656 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.641+0000 7f4f51dd2700 1 -- 172.21.15.39:0/2094893376 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f4c069e00 msgr2=0x7f4f4c06a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.656 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.641+0000 7f4f51dd2700 1 --2- 172.21.15.39:0/2094893376 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f4c069e00 0x7f4f4c06a280 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c06e290 tx=0x7f4f3c009b30 comp rx=0 tx=0).stop 2023-11-28T11:57:03.656 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.641+0000 7f85daeae700 1 -- 172.21.15.39:0/1272603535 shutdown_connections 2023-11-28T11:57:03.656 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.641+0000 7f4f51dd2700 1 -- 172.21.15.39:0/2094893376 shutdown_connections 2023-11-28T11:57:03.657 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.641+0000 7f4f51dd2700 1 --2- 172.21.15.39:0/2094893376 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f4c069e00 0x7f4f4c06a280 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.657 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.641+0000 7f4f51dd2700 1 --2- 172.21.15.39:0/2094893376 >> v2:172.21.15.184:3300/0 conn(0x7f4f4c15c640 0x7f4f4c0d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.657 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.641+0000 7f4f51dd2700 1 -- 172.21.15.39:0/2094893376 >> 172.21.15.39:0/2094893376 conn(0x7f4f4c0b6520 msgr2=0x7f4f4c071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:03.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.641+0000 7f3ab601e700 1 -- 172.21.15.39:0/3282363103 wait complete. 2023-11-28T11:57:03.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.641+0000 7f85daeae700 1 -- 172.21.15.39:0/1272603535 wait complete. 2023-11-28T11:57:03.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.641+0000 7f4f51dd2700 1 -- 172.21.15.39:0/2094893376 shutdown_connections 2023-11-28T11:57:03.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.641+0000 7f6e60192700 1 -- 172.21.15.39:0/3606648936 wait complete. 2023-11-28T11:57:03.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.641+0000 7f4f51dd2700 1 -- 172.21.15.39:0/2094893376 wait complete. 2023-11-28T11:57:03.660 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.645+0000 7f6e60192700 1 Processor -- start 2023-11-28T11:57:03.660 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.645+0000 7f6e60192700 1 -- start start 2023-11-28T11:57:03.661 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.645+0000 7f3ab601e700 1 Processor -- start 2023-11-28T11:57:03.661 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.645+0000 7f3ab601e700 1 -- start start 2023-11-28T11:57:03.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.645+0000 7f6e60192700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e580b6030 0x7f6e581487b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.645+0000 7f6e60192700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e581534a0 0x7f6e5814a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.645+0000 7f6e60192700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e5815d510 0x7f6e58153a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.645+0000 7f6e60192700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e58148cf0 con 0x7f6e581534a0 2023-11-28T11:57:03.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.645+0000 7f6e60192700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5814ad60 con 0x7f6e5815d510 2023-11-28T11:57:03.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.645+0000 7f6e60192700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5814b040 con 0x7f6e580b6030 2023-11-28T11:57:03.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.645+0000 7f85daeae700 1 Processor -- start 2023-11-28T11:57:03.664 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.645+0000 7f6e5e72f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e5815d510 0x7f6e58153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.664 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.645+0000 7f6e5e72f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e5815d510 0x7f6e58153a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:42906/0 (socket says 172.21.15.39:42906) 2023-11-28T11:57:03.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.645+0000 7f6e5e72f700 1 -- 172.21.15.39:0/2188275601 learned_addr learned my addr 172.21.15.39:0/2188275601 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:03.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.645+0000 7f6e5d72d700 1 --2- 172.21.15.39:0/2188275601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e581534a0 0x7f6e5814a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.645+0000 7f3ab601e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ab00b6030 0x7f3ab0148720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.645+0000 7f3ab601e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ab01534a0 0x7f3ab0155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.645+0000 7f3ab601e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ab015d510 0x7f3ab00d2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.645+0000 7f3ab601e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab01569d0 con 0x7f3ab00b6030 2023-11-28T11:57:03.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.645+0000 7f3ab601e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab0148c60 con 0x7f3ab01534a0 2023-11-28T11:57:03.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.645+0000 7f3ab601e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab0155dc0 con 0x7f3ab015d510 2023-11-28T11:57:03.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7f6e5df2e700 1 --2- 172.21.15.39:0/2188275601 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e580b6030 0x7f6e581487b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.668 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7f3aaeffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ab01534a0 0x7f3ab0155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.668 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.645+0000 7f85daeae700 1 -- start start 2023-11-28T11:57:03.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7fc82dbaa700 1 Processor -- start 2023-11-28T11:57:03.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7f6e5e72f700 1 -- 172.21.15.39:0/2188275601 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e580b6030 msgr2=0x7f6e581487b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7f6e5e72f700 1 --2- 172.21.15.39:0/2188275601 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e580b6030 0x7f6e581487b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7f6e5e72f700 1 -- 172.21.15.39:0/2188275601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e581534a0 msgr2=0x7f6e5814a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7f6e5e72f700 1 --2- 172.21.15.39:0/2188275601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e581534a0 0x7f6e5814a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7f6e5e72f700 1 -- 172.21.15.39:0/2188275601 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e48009570 con 0x7f6e5815d510 2023-11-28T11:57:03.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7f3aaffff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ab015d510 0x7f3ab00d2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7f3aaeffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ab01534a0 0x7f3ab0155300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:42920/0 (socket says 172.21.15.39:42920) 2023-11-28T11:57:03.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7f3aaeffd700 1 -- 172.21.15.39:0/1962196358 learned_addr learned my addr 172.21.15.39:0/1962196358 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:03.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7f3aaf7fe700 1 --2- 172.21.15.39:0/1962196358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ab00b6030 0x7f3ab0148720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7f3aaeffd700 1 -- 172.21.15.39:0/1962196358 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ab015d510 msgr2=0x7f3ab00d2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7f3aaeffd700 1 --2- 172.21.15.39:0/1962196358 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ab015d510 0x7f3ab00d2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7f3aaeffd700 1 -- 172.21.15.39:0/1962196358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ab00b6030 msgr2=0x7f3ab0148720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7f3aaeffd700 1 --2- 172.21.15.39:0/1962196358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ab00b6030 0x7f3ab0148720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7f3aaeffd700 1 -- 172.21.15.39:0/1962196358 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa40094b0 con 0x7f3ab01534a0 2023-11-28T11:57:03.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7f3aaf7fe700 1 --2- 172.21.15.39:0/1962196358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ab00b6030 0x7f3ab0148720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:57:03.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7f85daeae700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85c4004870 0x7f85d4154900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7f85daeae700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85d406cf40 0x7f85d406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7f85daeae700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85d40afb60 0x7f85d40affd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7f85daeae700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d406d8d0 con 0x7f85c4004870 2023-11-28T11:57:03.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7f85daeae700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d40af510 con 0x7f85d40afb60 2023-11-28T11:57:03.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7f85daeae700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d40ae970 con 0x7f85d406cf40 2023-11-28T11:57:03.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7f4f51dd2700 1 Processor -- start 2023-11-28T11:57:03.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7f4f51dd2700 1 -- start start 2023-11-28T11:57:03.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7f4f51dd2700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f4c069e00 0x7f4f4c0c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7f4f51dd2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f4c071aa0 0x7f4f4c0ce310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7f4f51dd2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f4c15c640 0x7f4f4c0ce850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7f4f51dd2700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c0c9700 con 0x7f4f4c069e00 2023-11-28T11:57:03.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7f4f51dd2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c0cd7a0 con 0x7f4f4c071aa0 2023-11-28T11:57:03.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7f4f51dd2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c09bd50 con 0x7f4f4c15c640 2023-11-28T11:57:03.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7fc82dbaa700 1 -- start start 2023-11-28T11:57:03.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7fc82dbaa700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc8281534a0 0x7fc82815d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7fc82dbaa700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc8280b6200 0x7fc828070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7fc82dbaa700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc82815d080 con 0x7fc828160920 2023-11-28T11:57:03.679 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7fc82dbaa700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc828153870 con 0x7fc8281534a0 2023-11-28T11:57:03.679 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7fc82dbaa700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8280b53c0 con 0x7fc8280b6200 2023-11-28T11:57:03.679 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7fc827fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc8280b6200 0x7fc828070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.679 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7fc827fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc8280b6200 0x7fc828070630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:42936/0 (socket says 172.21.15.39:42936) 2023-11-28T11:57:03.680 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7fc827fff700 1 -- 172.21.15.39:0/2285831908 learned_addr learned my addr 172.21.15.39:0/2285831908 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:03.680 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7f3aaeffd700 1 --2- 172.21.15.39:0/1962196358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ab01534a0 0x7f3ab0155300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4014040 tx=0x7f3aa4004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.680 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f85d944b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85d40afb60 0x7f85d40affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f85d8c4a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85c4004870 0x7f85d4154900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f85d3fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85d406cf40 0x7f85d406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f85d3fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85d406cf40 0x7f85d406d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:48380/0 (socket says 172.21.15.39:48380) 2023-11-28T11:57:03.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f85d3fff700 1 -- 172.21.15.39:0/1195249266 learned_addr learned my addr 172.21.15.39:0/1195249266 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:03.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f85d8c4a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85c4004870 0x7f85d4154900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45226/0 (socket says 172.21.15.39:45226) 2023-11-28T11:57:03.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f4f4bfff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f4c071aa0 0x7f4f4c0ce310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f4f50dd0700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f4c069e00 0x7f4f4c0c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.649+0000 7f6e5e72f700 1 --2- 172.21.15.39:0/2188275601 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e5815d510 0x7f6e58153a20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6e5000cc50 tx=0x7f6e5000cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7fc8277fe700 1 --2- 172.21.15.39:0/2285831908 >> v2:172.21.15.39:3300/0 conn(0x7fc8281534a0 0x7fc82815d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f6d069e8700 1 Processor -- start 2023-11-28T11:57:03.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f4f50dd0700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f4c069e00 0x7f4f4c0c91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45232/0 (socket says 172.21.15.39:45232) 2023-11-28T11:57:03.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f4f50dd0700 1 -- 172.21.15.39:0/3305059393 learned_addr learned my addr 172.21.15.39:0/3305059393 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:03.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f85d3fff700 1 -- 172.21.15.39:0/1195249266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85d40afb60 msgr2=0x7f85d40affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f85d3fff700 1 --2- 172.21.15.39:0/1195249266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85d40afb60 0x7f85d40affd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f85d3fff700 1 -- 172.21.15.39:0/1195249266 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85c4004870 msgr2=0x7f85d4154900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f85d3fff700 1 --2- 172.21.15.39:0/1195249266 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85c4004870 0x7f85d4154900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f85d3fff700 1 -- 172.21.15.39:0/1195249266 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d40ac030 con 0x7f85d406cf40 2023-11-28T11:57:03.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f3a97fff700 1 -- 172.21.15.39:0/1962196358 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4004510 con 0x7f3ab01534a0 2023-11-28T11:57:03.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f3a97fff700 1 -- 172.21.15.39:0/1962196358 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa401e070 con 0x7f3ab01534a0 2023-11-28T11:57:03.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f3a97fff700 1 -- 172.21.15.39:0/1962196358 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4004510 con 0x7f3ab01534a0 2023-11-28T11:57:03.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f4f515d1700 1 --2- 172.21.15.39:0/3305059393 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f4c15c640 0x7f4f4c0ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.689 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f6d069e8700 1 -- start start 2023-11-28T11:57:03.690 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f4f50dd0700 1 -- 172.21.15.39:0/3305059393 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f4c15c640 msgr2=0x7f4f4c0ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.690 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f4f50dd0700 1 --2- 172.21.15.39:0/3305059393 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f4c15c640 0x7f4f4c0ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.690 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f4f50dd0700 1 -- 172.21.15.39:0/3305059393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f4c071aa0 msgr2=0x7f4f4c0ce310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.690 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f4f50dd0700 1 --2- 172.21.15.39:0/3305059393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f4c071aa0 0x7f4f4c0ce310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.690 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f4f50dd0700 1 -- 172.21.15.39:0/3305059393 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3c0094b0 con 0x7f4f4c069e00 2023-11-28T11:57:03.690 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f4f4bfff700 1 --2- 172.21.15.39:0/3305059393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f4c071aa0 0x7f4f4c0ce310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:57:03.692 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7fc827fff700 1 -- 172.21.15.39:0/2285831908 >> v2:172.21.15.39:3300/0 conn(0x7fc8281534a0 msgr2=0x7fc82815d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:03.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7fc827fff700 1 --2- 172.21.15.39:0/2285831908 >> v2:172.21.15.39:3300/0 conn(0x7fc8281534a0 0x7fc82815d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7fc827fff700 1 -- 172.21.15.39:0/2285831908 >> v1:172.21.15.184:6789/0 conn(0x7fc828160920 legacy=0x7fc8280b5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.694 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7fc827fff700 1 -- 172.21.15.39:0/2285831908 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8280b56a0 con 0x7fc8280b6200 2023-11-28T11:57:03.694 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f85d3fff700 1 --2- 172.21.15.39:0/1195249266 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85d406cf40 0x7f85d406d390 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f85c400c160 tx=0x7f85c80012b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.695 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f3ab601e700 1 -- 172.21.15.39:0/1962196358 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ab00b56a0 con 0x7f3ab01534a0 2023-11-28T11:57:03.695 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f3ab601e700 1 -- 172.21.15.39:0/1962196358 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ab00b53c0 con 0x7f3ab01534a0 2023-11-28T11:57:03.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f6e4e7fc700 1 -- 172.21.15.39:0/2188275601 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e50003c20 con 0x7f6e5815d510 2023-11-28T11:57:03.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f6e4e7fc700 1 -- 172.21.15.39:0/2188275601 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e50003d80 con 0x7f6e5815d510 2023-11-28T11:57:03.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f6e4e7fc700 1 -- 172.21.15.39:0/2188275601 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5000ab60 con 0x7f6e5815d510 2023-11-28T11:57:03.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f6e60192700 1 -- 172.21.15.39:0/2188275601 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e580b56a0 con 0x7f6e5815d510 2023-11-28T11:57:03.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f6e60192700 1 -- 172.21.15.39:0/2188275601 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e580b53c0 con 0x7f6e5815d510 2023-11-28T11:57:03.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f4f50dd0700 1 --2- 172.21.15.39:0/3305059393 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f4c069e00 0x7f4f4c0c91c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4f4400efc0 tx=0x7f4f4400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f6d069e8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d00160710 0x7f6d000cc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f6d069e8700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6d00070790 0x7f6d00164250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f6d069e8700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d000ad6c0 con 0x7f6d000cc860 2023-11-28T11:57:03.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f6d069e8700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d0006b1c0 con 0x7f6d00070790 2023-11-28T11:57:03.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7f6d069e8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d000adc60 con 0x7f6d00160710 2023-11-28T11:57:03.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7fc827fff700 1 --2- 172.21.15.39:0/2285831908 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8280b6200 0x7fc828070630 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc828071f60 tx=0x7fc82000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4ccc5310c1bd9cf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.653+0000 7fbe37d1e700 1 Processor -- start 2023-11-28T11:57:03.701 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7f4f497fa700 1 -- 172.21.15.39:0/3305059393 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4400cdc0 con 0x7f4f4c069e00 2023-11-28T11:57:03.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7f4f497fa700 1 -- 172.21.15.39:0/3305059393 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f4400f040 con 0x7f4f4c069e00 2023-11-28T11:57:03.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7f4f497fa700 1 -- 172.21.15.39:0/3305059393 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4400cdc0 con 0x7f4f4c069e00 2023-11-28T11:57:03.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7f6d061e7700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6d00070790 0x7f6d00164250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7f6d059e6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d00160710 0x7f6d000cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7f6d061e7700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6d00070790 0x7f6d00164250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:42966/0 (socket says 172.21.15.39:42966) 2023-11-28T11:57:03.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7f6d061e7700 1 -- 172.21.15.39:0/359937773 learned_addr learned my addr 172.21.15.39:0/359937773 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:03.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7fbe37d1e700 1 -- start start 2023-11-28T11:57:03.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7f85d17fa700 1 -- 172.21.15.39:0/1195249266 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c8005e10 con 0x7f85d406cf40 2023-11-28T11:57:03.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7f85d17fa700 1 -- 172.21.15.39:0/1195249266 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c8004aa0 con 0x7f85d406cf40 2023-11-28T11:57:03.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7f85d17fa700 1 -- 172.21.15.39:0/1195249266 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c8004e50 con 0x7f85d406cf40 2023-11-28T11:57:03.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7fc826ffd700 1 -- 172.21.15.39:0/2285831908 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82000e070 con 0x7fc8280b6200 2023-11-28T11:57:03.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7fc826ffd700 1 -- 172.21.15.39:0/2285831908 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82000b910 con 0x7fc8280b6200 2023-11-28T11:57:03.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7fc826ffd700 1 -- 172.21.15.39:0/2285831908 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82000bcc0 con 0x7fc8280b6200 2023-11-28T11:57:03.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7f6e60192700 1 -- 172.21.15.39:0/2188275601 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e5815ca30 con 0x7f6e5815d510 2023-11-28T11:57:03.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7f85daeae700 1 -- 172.21.15.39:0/1195249266 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85d40abd50 con 0x7f85d406cf40 2023-11-28T11:57:03.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7f85daeae700 1 -- 172.21.15.39:0/1195249266 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d40ad560 con 0x7f85d406cf40 2023-11-28T11:57:03.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7f6d059e6700 1 -- 172.21.15.39:0/359937773 >> v2:172.21.15.184:3300/0 conn(0x7f6d00070790 msgr2=0x7f6d00164250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:03.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7f6d059e6700 1 --2- 172.21.15.39:0/359937773 >> v2:172.21.15.184:3300/0 conn(0x7f6d00070790 0x7f6d00164250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7f6d059e6700 1 -- 172.21.15.39:0/359937773 >> v1:172.21.15.184:6789/0 conn(0x7f6d000cc860 legacy=0x7f6d00070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:03.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7f6d059e6700 1 -- 172.21.15.39:0/359937773 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d0006b3d0 con 0x7f6d00160710 2023-11-28T11:57:03.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7f4f51dd2700 1 -- 172.21.15.39:0/3305059393 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f4c15ca10 con 0x7f4f4c069e00 2023-11-28T11:57:03.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7f3ab601e700 1 -- 172.21.15.39:0/1962196358 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ab015ca30 con 0x7f3ab01534a0 2023-11-28T11:57:03.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7f6d059e6700 1 --2- 172.21.15.39:0/359937773 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d00160710 0x7f6d000cc320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4009d90 tx=0x7f6cf400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f656f42f341ab30d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7f6d049e4700 1 -- 172.21.15.39:0/359937773 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf400e070 con 0x7f6d00160710 2023-11-28T11:57:03.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7f6d049e4700 1 -- 172.21.15.39:0/359937773 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf400bae0 con 0x7f6d00160710 2023-11-28T11:57:03.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7f6d049e4700 1 -- 172.21.15.39:0/359937773 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf400be70 con 0x7f6d00160710 2023-11-28T11:57:03.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7fbe37d1e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fbe300b4e10 0x7fbe300d23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7fbe37d1e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbe300d0380 0x7fbe300d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7fbe37d1e700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe300b7950 con 0x7fbe3015c210 2023-11-28T11:57:03.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7fbe37d1e700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe300d0d60 con 0x7fbe300d0380 2023-11-28T11:57:03.709 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7fbe37d1e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe300b5710 con 0x7fbe300b4e10 2023-11-28T11:57:03.709 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7f6e4e7fc700 1 -- 172.21.15.39:0/2188275601 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6e50010050 con 0x7f6e5815d510 2023-11-28T11:57:03.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7f3a97fff700 1 -- 172.21.15.39:0/1962196358 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3aa402a020 con 0x7f3ab01534a0 2023-11-28T11:57:03.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7fc82dbaa700 1 -- 172.21.15.39:0/2285831908 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8280b6200 msgr2=0x7fc828070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7fc82dbaa700 1 --2- 172.21.15.39:0/2285831908 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8280b6200 0x7fc828070630 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc828071f60 tx=0x7fc82000b330 comp rx=0 tx=0).stop 2023-11-28T11:57:03.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7fc82dbaa700 1 -- 172.21.15.39:0/2285831908 shutdown_connections 2023-11-28T11:57:03.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7fc82dbaa700 1 --2- 172.21.15.39:0/2285831908 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8280b6200 0x7fc828070630 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7fc82dbaa700 1 --2- 172.21.15.39:0/2285831908 >> v2:172.21.15.39:3300/0 conn(0x7fc8281534a0 0x7fc82815d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.711 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7fc82dbaa700 1 -- 172.21.15.39:0/2285831908 >> 172.21.15.39:0/2285831908 conn(0x7fc82806bfc0 msgr2=0x7fc82806c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:03.711 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7fbe35aba700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fbe3015c210 0x7fbe3015c5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:37994/0 (socket says 172.21.15.39:37994) 2023-11-28T11:57:03.711 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7fbe352b9700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fbe300b4e10 0x7fbe300d23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.711 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7fbe35aba700 1 -- 172.21.15.39:0/2700793461 learned_addr learned my addr 172.21.15.39:0/2700793461 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:03.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7f6d069e8700 1 -- 172.21.15.39:0/359937773 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d00160710 msgr2=0x7f6d000cc320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7f6d069e8700 1 --2- 172.21.15.39:0/359937773 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d00160710 0x7f6d000cc320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4009d90 tx=0x7f6cf400b330 comp rx=0 tx=0).stop 2023-11-28T11:57:03.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7f4f51dd2700 1 -- 172.21.15.39:0/3305059393 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f4c06da20 con 0x7f4f4c069e00 2023-11-28T11:57:03.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.657+0000 7fbe352b9700 1 -- 172.21.15.39:0/2700793461 >> v2:172.21.15.39:3300/0 conn(0x7fbe300d0380 msgr2=0x7fbe300d0820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T11:57:03.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.661+0000 7f6d069e8700 1 -- 172.21.15.39:0/359937773 shutdown_connections 2023-11-28T11:57:03.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.661+0000 7f6d069e8700 1 --2- 172.21.15.39:0/359937773 >> v2:172.21.15.184:3300/0 conn(0x7f6d00070790 0x7f6d00164250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.661+0000 7f6d069e8700 1 --2- 172.21.15.39:0/359937773 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d00160710 0x7f6d000cc320 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.661+0000 7f6d069e8700 1 -- 172.21.15.39:0/359937773 >> 172.21.15.39:0/359937773 conn(0x7f6d000b0f80 msgr2=0x7f6d000ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:03.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.661+0000 7fbe362bb700 1 --2- 172.21.15.39:0/2700793461 >> v2:172.21.15.39:3300/0 conn(0x7fbe300d0380 0x7fbe300d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.661+0000 7f6e4e7fc700 1 --2- 172.21.15.39:0/2188275601 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6e3c064fe0 0x7f6e3c067490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.661+0000 7f6e4e7fc700 1 -- 172.21.15.39:0/2188275601 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6e50082110 con 0x7f6e5815d510 2023-11-28T11:57:03.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.661+0000 7f3a97fff700 1 --2- 172.21.15.39:0/1962196358 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3a9c064f40 0x7f3a9c0673f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.661+0000 7f3a97fff700 1 -- 172.21.15.39:0/1962196358 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3aa4082d70 con 0x7f3ab01534a0 2023-11-28T11:57:03.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.661+0000 7f3aaf7fe700 1 --2- 172.21.15.39:0/1962196358 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3a9c064f40 0x7f3a9c0673f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.661+0000 7f85d17fa700 1 -- 172.21.15.39:0/1195249266 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f85c8010070 con 0x7f85d406cf40 2023-11-28T11:57:03.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.661+0000 7f85daeae700 1 -- 172.21.15.39:0/1195249266 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85d40726c0 con 0x7f85d406cf40 2023-11-28T11:57:03.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.661+0000 7f85d17fa700 1 --2- 172.21.15.39:0/1195249266 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f85b8064fb0 0x7f85b8067460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.661+0000 7f85d17fa700 1 -- 172.21.15.39:0/1195249266 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f85c8083150 con 0x7f85d406cf40 2023-11-28T11:57:03.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.661+0000 7f6d069e8700 1 -- 172.21.15.39:0/359937773 shutdown_connections 2023-11-28T11:57:03.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.661+0000 7f4f51dd2700 1 -- 172.21.15.39:0/3305059393 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f4c072010 con 0x7f4f4c069e00 2023-11-28T11:57:03.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.661+0000 7fc82dbaa700 1 -- 172.21.15.39:0/2285831908 shutdown_connections 2023-11-28T11:57:03.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.661+0000 7fc82dbaa700 1 -- 172.21.15.39:0/2285831908 wait complete. 2023-11-28T11:57:03.717 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.661+0000 7fbe352b9700 1 --2- 172.21.15.39:0/2700793461 >> v2:172.21.15.39:3300/0 conn(0x7fbe300d0380 0x7fbe300d0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.717 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.661+0000 7fbe352b9700 1 -- 172.21.15.39:0/2700793461 >> v1:172.21.15.39:6789/0 conn(0x7fbe3015c210 legacy=0x7fbe3015c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.717 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.661+0000 7fbe352b9700 1 -- 172.21.15.39:0/2700793461 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe300b7bd0 con 0x7fbe300b4e10 2023-11-28T11:57:03.717 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.661+0000 7fbe362bb700 1 --2- 172.21.15.39:0/2700793461 >> v2:172.21.15.39:3300/0 conn(0x7fbe300d0380 0x7fbe300d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:57:03.717 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.661+0000 7fbe352b9700 1 --2- 172.21.15.39:0/2700793461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe300b4e10 0x7fbe300d23e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbe3006fef0 tx=0x7fbe24009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca86d6ed0af8c7bd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.717 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.661+0000 7f85d8c4a700 1 --2- 172.21.15.39:0/1195249266 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f85b8064fb0 0x7f85b8067460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.718 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.661+0000 7f6e5df2e700 1 --2- 172.21.15.39:0/2188275601 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6e3c064fe0 0x7f6e3c067490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.718 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.661+0000 7f6d069e8700 1 -- 172.21.15.39:0/359937773 wait complete. 2023-11-28T11:57:03.718 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.661+0000 7f4f497fa700 1 -- 172.21.15.39:0/3305059393 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4f440359c0 con 0x7f4f4c069e00 2023-11-28T11:57:03.718 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.661+0000 7f6e5df2e700 1 --2- 172.21.15.39:0/2188275601 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6e3c064fe0 0x7f6e3c067490 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6e54007fd0 tx=0x7f6e54009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.661+0000 7f3aaf7fe700 1 --2- 172.21.15.39:0/1962196358 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3a9c064f40 0x7f3a9c0673f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3aa0000f60 tx=0x7f3aa0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.661+0000 7f6d069e8700 1 Processor -- start 2023-11-28T11:57:03.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.665+0000 7f85d8c4a700 1 --2- 172.21.15.39:0/1195249266 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f85b8064fb0 0x7f85b8067460 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f85c00049a0 tx=0x7f85c00016b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.720 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.665+0000 7f6d069e8700 1 -- start start 2023-11-28T11:57:03.720 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.665+0000 7fc82dbaa700 1 Processor -- start 2023-11-28T11:57:03.720 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.665+0000 7fc82dbaa700 1 -- start start 2023-11-28T11:57:03.720 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.665+0000 7f748d271700 1 Processor -- start 2023-11-28T11:57:03.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.665+0000 7f748d271700 1 -- start start 2023-11-28T11:57:03.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.665+0000 7f6d069e8700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d00070790 0x7f6d0015be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.665+0000 7f6d069e8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d000cc860 0x7f6d001fb510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.665+0000 7f6d069e8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d00160710 0x7f6d000af180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.665+0000 7f6d069e8700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d001ff0a0 con 0x7f6d00070790 2023-11-28T11:57:03.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.665+0000 7f6d069e8700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0015f980 con 0x7f6d000cc860 2023-11-28T11:57:03.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.665+0000 7f6d069e8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d001fedc0 con 0x7f6d00160710 2023-11-28T11:57:03.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.665+0000 7f6d059e6700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d00070790 0x7f6d0015be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.665+0000 7f6d051e5700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d000cc860 0x7f6d001fb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.665+0000 7f6d059e6700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d00070790 0x7f6d0015be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45250/0 (socket says 172.21.15.39:45250) 2023-11-28T11:57:03.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.665+0000 7f6d059e6700 1 -- 172.21.15.39:0/2967338178 learned_addr learned my addr 172.21.15.39:0/2967338178 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:03.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.665+0000 7f4f497fa700 1 --2- 172.21.15.39:0/3305059393 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4f38064f40 0x7f4f380673f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.665+0000 7f6d061e7700 1 --2- 172.21.15.39:0/2967338178 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d00160710 0x7f6d000af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.665+0000 7f4f497fa700 1 -- 172.21.15.39:0/3305059393 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4f44082200 con 0x7f4f4c069e00 2023-11-28T11:57:03.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.665+0000 7f6d061e7700 1 -- 172.21.15.39:0/2967338178 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d000cc860 msgr2=0x7f6d001fb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.665+0000 7f4f4bfff700 1 --2- 172.21.15.39:0/3305059393 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4f38064f40 0x7f4f380673f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.665+0000 7fc82dbaa700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8280b6200 0x7fc82815bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.665+0000 7fc82dbaa700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8281534a0 0x7fc828154a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.665+0000 7fc82dbaa700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc828160920 0x7fc828154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.665+0000 7f6d061e7700 1 --2- 172.21.15.39:0/2967338178 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d000cc860 0x7f6d001fb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.665+0000 7f6d061e7700 1 -- 172.21.15.39:0/2967338178 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d00070790 msgr2=0x7f6d0015be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.665+0000 7f6d061e7700 1 --2- 172.21.15.39:0/2967338178 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d00070790 0x7f6d0015be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.665+0000 7fc82dbaa700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc828158280 con 0x7fc828160920 2023-11-28T11:57:03.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.665+0000 7fc82dbaa700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc828150270 con 0x7fc8281534a0 2023-11-28T11:57:03.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.665+0000 7fc82dbaa700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8281f6360 con 0x7fc8280b6200 2023-11-28T11:57:03.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.665+0000 7f6d061e7700 1 -- 172.21.15.39:0/2967338178 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf4009a70 con 0x7f6d00160710 2023-11-28T11:57:03.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.665+0000 7f6d059e6700 1 --2- 172.21.15.39:0/2967338178 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d00070790 0x7f6d0015be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:03.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.665+0000 7fc8277fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8280b6200 0x7fc82815bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.665+0000 7fc8277fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8280b6200 0x7fc82815bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:48408/0 (socket says 172.21.15.39:48408) 2023-11-28T11:57:03.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.665+0000 7fc8277fe700 1 -- 172.21.15.39:0/35152174 learned_addr learned my addr 172.21.15.39:0/35152174 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:03.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.665+0000 7fc81ffff700 1 --2- 172.21.15.39:0/35152174 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8281534a0 0x7fc828154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.665+0000 7fc827fff700 1 --2- 172.21.15.39:0/35152174 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc828160920 0x7fc828154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.665+0000 7f6d061e7700 1 --2- 172.21.15.39:0/2967338178 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d00160710 0x7f6d000af180 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6d000cdbd0 tx=0x7f6cf800eaa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.665+0000 7f6e4e7fc700 1 -- 172.21.15.39:0/2188275601 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6e5004ff50 con 0x7f6e5815d510 2023-11-28T11:57:03.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.665+0000 7fc8277fe700 1 -- 172.21.15.39:0/35152174 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8281534a0 msgr2=0x7fc828154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.669+0000 7fc8277fe700 1 --2- 172.21.15.39:0/35152174 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8281534a0 0x7fc828154a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.669+0000 7fc8277fe700 1 -- 172.21.15.39:0/35152174 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc828160920 msgr2=0x7fc828154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.669+0000 7fc8277fe700 1 --2- 172.21.15.39:0/35152174 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc828160920 0x7fc828154fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.669+0000 7fc8277fe700 1 -- 172.21.15.39:0/35152174 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc820009b30 con 0x7fc8280b6200 2023-11-28T11:57:03.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.669+0000 7fc81ffff700 1 --2- 172.21.15.39:0/35152174 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8281534a0 0x7fc828154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:03.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.669+0000 7fc827fff700 1 --2- 172.21.15.39:0/35152174 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc828160920 0x7fc828154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:03.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.669+0000 7f4f4bfff700 1 --2- 172.21.15.39:0/3305059393 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4f38064f40 0x7f4f380673f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c0ccb80 tx=0x7f4f40009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.669+0000 7f748d271700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74880cfa50 0x7f74880d2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.669+0000 7fc8277fe700 1 --2- 172.21.15.39:0/35152174 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8280b6200 0x7fc82815bcc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc81800e9d0 tx=0x7fc81800ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.669+0000 7f748d271700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f748815d780 con 0x7f74880cfec0 2023-11-28T11:57:03.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.669+0000 7f748d271700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74880cec90 con 0x7f74880d0e30 2023-11-28T11:57:03.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.669+0000 7f748d271700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74880cef70 con 0x7f74880cfa50 2023-11-28T11:57:03.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.669+0000 7f74867fc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74880cfa50 0x7f74880d2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.669+0000 7f7487fff700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f74880cfec0 0x7f74880d2c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:38006/0 (socket says 172.21.15.39:38006) 2023-11-28T11:57:03.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.669+0000 7f7487fff700 1 -- 172.21.15.39:0/2627063186 learned_addr learned my addr 172.21.15.39:0/2627063186 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:03.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.669+0000 7f74867fc700 1 -- 172.21.15.39:0/2627063186 >> v1:172.21.15.184:6789/0 conn(0x7f74880d0e30 legacy=0x7f74880d1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.669+0000 7f74867fc700 1 -- 172.21.15.39:0/2627063186 >> v1:172.21.15.39:6789/0 conn(0x7f74880cfec0 legacy=0x7f74880d2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.669+0000 7f74867fc700 1 -- 172.21.15.39:0/2627063186 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74880cf250 con 0x7f74880cfa50 2023-11-28T11:57:03.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.669+0000 7f74867fc700 1 --2- 172.21.15.39:0/2627063186 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74880cfa50 0x7f74880d2730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f747c009880 tx=0x7f747c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b70371adaa42332 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.669+0000 7fc824ff9700 1 -- 172.21.15.39:0/35152174 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81800ee70 con 0x7fc8280b6200 2023-11-28T11:57:03.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.669+0000 7f6cfe7fc700 1 -- 172.21.15.39:0/2967338178 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8013680 con 0x7f6d00160710 2023-11-28T11:57:03.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.669+0000 7f6d069e8700 1 -- 172.21.15.39:0/2967338178 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d000ad8f0 con 0x7f6d00160710 2023-11-28T11:57:03.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.669+0000 7f6cfe7fc700 1 -- 172.21.15.39:0/2967338178 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf80137e0 con 0x7f6d00160710 2023-11-28T11:57:03.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.669+0000 7f6d069e8700 1 -- 172.21.15.39:0/2967338178 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d0006b6b0 con 0x7f6d00160710 2023-11-28T11:57:03.732 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.669+0000 7fc824ff9700 1 -- 172.21.15.39:0/35152174 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81800c850 con 0x7fc8280b6200 2023-11-28T11:57:03.732 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.669+0000 7fc82dbaa700 1 -- 172.21.15.39:0/35152174 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc82815cd10 con 0x7fc8280b6200 2023-11-28T11:57:03.732 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.669+0000 7fc824ff9700 1 -- 172.21.15.39:0/35152174 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81800cbc0 con 0x7fc8280b6200 2023-11-28T11:57:03.732 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.669+0000 7f7485ffb700 1 -- 172.21.15.39:0/2627063186 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747c011830 con 0x7f74880cfa50 2023-11-28T11:57:03.732 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.669+0000 7f7485ffb700 1 -- 172.21.15.39:0/2627063186 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f747c011990 con 0x7f74880cfa50 2023-11-28T11:57:03.732 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.669+0000 7f7485ffb700 1 -- 172.21.15.39:0/2627063186 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747c011d20 con 0x7f74880cfa50 2023-11-28T11:57:03.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.669+0000 7f85d17fa700 1 -- 172.21.15.39:0/1195249266 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f85c8054940 con 0x7f85d406cf40 2023-11-28T11:57:03.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.669+0000 7f6cfe7fc700 1 -- 172.21.15.39:0/2967338178 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8013b50 con 0x7f6d00160710 2023-11-28T11:57:03.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.669+0000 7fc82dbaa700 1 -- 172.21.15.39:0/35152174 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc82815ca30 con 0x7fc8280b6200 2023-11-28T11:57:03.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.673+0000 7f748d271700 1 -- 172.21.15.39:0/2627063186 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74880cfa50 msgr2=0x7f74880d2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.673+0000 7f748d271700 1 --2- 172.21.15.39:0/2627063186 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74880cfa50 0x7f74880d2730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f747c009880 tx=0x7f747c009b90 comp rx=0 tx=0).stop 2023-11-28T11:57:03.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.673+0000 7f6d069e8700 1 -- 172.21.15.39:0/2967338178 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce8005310 con 0x7f6d00160710 2023-11-28T11:57:03.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.673+0000 7fc82dbaa700 1 -- 172.21.15.39:0/35152174 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8280b7f10 con 0x7fc8280b6200 2023-11-28T11:57:03.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.673+0000 7f4f497fa700 1 -- 172.21.15.39:0/3305059393 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4f440500b0 con 0x7f4f4c069e00 2023-11-28T11:57:03.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.673+0000 7fbe34ab8700 1 -- 172.21.15.39:0/2700793461 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe24011830 con 0x7fbe300b4e10 2023-11-28T11:57:03.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.673+0000 7fbe34ab8700 1 -- 172.21.15.39:0/2700793461 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe24011990 con 0x7fbe300b4e10 2023-11-28T11:57:03.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.673+0000 7fbe34ab8700 1 -- 172.21.15.39:0/2700793461 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe24011d20 con 0x7fbe300b4e10 2023-11-28T11:57:03.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.673+0000 7f748d271700 1 -- 172.21.15.39:0/2627063186 shutdown_connections 2023-11-28T11:57:03.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.673+0000 7f748d271700 1 --2- 172.21.15.39:0/2627063186 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74880cfa50 0x7f74880d2730 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.673+0000 7f748d271700 1 -- 172.21.15.39:0/2627063186 >> 172.21.15.39:0/2627063186 conn(0x7f748806e100 msgr2=0x7f748806e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:03.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.673+0000 7fbe37d1e700 1 -- 172.21.15.39:0/2700793461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe300b4e10 msgr2=0x7fbe300d23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.673+0000 7fbe37d1e700 1 --2- 172.21.15.39:0/2700793461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe300b4e10 0x7fbe300d23e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbe3006fef0 tx=0x7fbe24009b30 comp rx=0 tx=0).stop 2023-11-28T11:57:03.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.673+0000 7f6cfe7fc700 1 -- 172.21.15.39:0/2967338178 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6cf8019030 con 0x7f6d00160710 2023-11-28T11:57:03.737 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.673+0000 7f748d271700 1 -- 172.21.15.39:0/2627063186 shutdown_connections 2023-11-28T11:57:03.737 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.673+0000 7f748d271700 1 -- 172.21.15.39:0/2627063186 wait complete. 2023-11-28T11:57:03.737 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.673+0000 7fbe37d1e700 1 -- 172.21.15.39:0/2700793461 shutdown_connections 2023-11-28T11:57:03.737 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.673+0000 7fbe37d1e700 1 --2- 172.21.15.39:0/2700793461 >> v2:172.21.15.39:3300/0 conn(0x7fbe300d0380 0x7fbe300d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.737 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.673+0000 7fbe37d1e700 1 --2- 172.21.15.39:0/2700793461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe300b4e10 0x7fbe300d23e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.737 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.673+0000 7fbe37d1e700 1 -- 172.21.15.39:0/2700793461 >> 172.21.15.39:0/2700793461 conn(0x7fbe3006bfe0 msgr2=0x7fbe3006c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:03.737 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.673+0000 7fc824ff9700 1 -- 172.21.15.39:0/35152174 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc818019030 con 0x7fc8280b6200 2023-11-28T11:57:03.738 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.677+0000 7f3a97fff700 1 -- 172.21.15.39:0/1962196358 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3aa4087070 con 0x7f3ab01534a0 2023-11-28T11:57:03.738 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.677+0000 7f6cfe7fc700 1 --2- 172.21.15.39:0/2967338178 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6ce4064ee0 0x7f6ce4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.738 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.677+0000 7f6cfe7fc700 1 -- 172.21.15.39:0/2967338178 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6cf8081e70 con 0x7f6d00160710 2023-11-28T11:57:03.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.677+0000 7fc824ff9700 1 --2- 172.21.15.39:0/35152174 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc808064ee0 0x7fc808067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.677+0000 7fc824ff9700 1 -- 172.21.15.39:0/35152174 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc818082140 con 0x7fc8280b6200 2023-11-28T11:57:03.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.677+0000 7fbe37d1e700 1 -- 172.21.15.39:0/2700793461 shutdown_connections 2023-11-28T11:57:03.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.677+0000 7f6d059e6700 1 --2- 172.21.15.39:0/2967338178 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6ce4064ee0 0x7f6ce4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.677+0000 7fc81ffff700 1 --2- 172.21.15.39:0/35152174 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc808064ee0 0x7fc808067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.677+0000 7f748d271700 1 Processor -- start 2023-11-28T11:57:03.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.677+0000 7fbe37d1e700 1 -- 172.21.15.39:0/2700793461 wait complete. 2023-11-28T11:57:03.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.677+0000 7f748d271700 1 -- start start 2023-11-28T11:57:03.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.681+0000 7f6d059e6700 1 --2- 172.21.15.39:0/2967338178 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6ce4064ee0 0x7f6ce4067390 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4000f80 tx=0x7f6cf4011000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.681+0000 7f6cfe7fc700 1 -- 172.21.15.39:0/2967338178 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6cf8053660 con 0x7f6d00160710 2023-11-28T11:57:03.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.681+0000 7fc81ffff700 1 --2- 172.21.15.39:0/35152174 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc808064ee0 0x7fc808067390 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc8281566b0 tx=0x7fc810009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.681+0000 7f748d271700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74880cfa50 0x7f748814f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.681+0000 7f748d271700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74880cfec0 0x7f74880c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.681+0000 7f748d271700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74880d0e30 0x7f7488151630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.681+0000 7f748d271700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74881f6550 con 0x7f74880cfec0 2023-11-28T11:57:03.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.681+0000 7f748d271700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74880ca510 con 0x7f74880d0e30 2023-11-28T11:57:03.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.681+0000 7f748d271700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74881f60c0 con 0x7f74880cfa50 2023-11-28T11:57:03.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.681+0000 7fbe37d1e700 1 Processor -- start 2023-11-28T11:57:03.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.681+0000 7f7486ffd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74880cfa50 0x7f748814f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.681+0000 7f7486ffd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74880cfa50 0x7f748814f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:48436/0 (socket says 172.21.15.39:48436) 2023-11-28T11:57:03.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.681+0000 7f7486ffd700 1 -- 172.21.15.39:0/2688632469 learned_addr learned my addr 172.21.15.39:0/2688632469 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:03.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.681+0000 7f7487fff700 1 --2- 172.21.15.39:0/2688632469 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74880d0e30 0x7f7488151630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.681+0000 7f7486ffd700 1 -- 172.21.15.39:0/2688632469 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74880d0e30 msgr2=0x7f7488151630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.681+0000 7f7486ffd700 1 --2- 172.21.15.39:0/2688632469 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74880d0e30 0x7f7488151630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.681+0000 7f7486ffd700 1 -- 172.21.15.39:0/2688632469 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74880cfec0 msgr2=0x7f74880c9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.681+0000 7f7486ffd700 1 --2- 172.21.15.39:0/2688632469 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74880cfec0 0x7f74880c9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.681+0000 7f7486ffd700 1 -- 172.21.15.39:0/2688632469 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747c0094b0 con 0x7f74880cfa50 2023-11-28T11:57:03.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.681+0000 7fbe37d1e700 1 -- start start 2023-11-28T11:57:03.744 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.681+0000 7f7486ffd700 1 --2- 172.21.15.39:0/2688632469 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74880cfa50 0x7f748814f1b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f747800c530 tx=0x7f747800c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.681+0000 7fbe37d1e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe300b4e10 0x7fbe3014f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.681+0000 7fbe37d1e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe300d0380 0x7fbe30150060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.681+0000 7fbe37d1e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe3015c210 0x7fbe30152980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.681+0000 7fbe37d1e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3014fb50 con 0x7fbe300b4e10 2023-11-28T11:57:03.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.681+0000 7fbe37d1e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3014f5c0 con 0x7fbe3015c210 2023-11-28T11:57:03.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.681+0000 7fbe37d1e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe30159710 con 0x7fbe300d0380 2023-11-28T11:57:03.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.685+0000 7fbe35aba700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe300b4e10 0x7fbe3014f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.685+0000 7fbe35aba700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe300b4e10 0x7fbe3014f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45276/0 (socket says 172.21.15.39:45276) 2023-11-28T11:57:03.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.685+0000 7fbe35aba700 1 -- 172.21.15.39:0/4181288273 learned_addr learned my addr 172.21.15.39:0/4181288273 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:03.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.685+0000 7fbe362bb700 1 --2- 172.21.15.39:0/4181288273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe3015c210 0x7fbe30152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.685+0000 7fbe35aba700 1 -- 172.21.15.39:0/4181288273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe300d0380 msgr2=0x7fbe30150060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.685+0000 7fbe35aba700 1 --2- 172.21.15.39:0/4181288273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe300d0380 0x7fbe30150060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.685+0000 7fbe35aba700 1 -- 172.21.15.39:0/4181288273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe3015c210 msgr2=0x7fbe30152980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:03.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.685+0000 7fbe35aba700 1 --2- 172.21.15.39:0/4181288273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe3015c210 0x7fbe30152980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:03.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.685+0000 7fbe35aba700 1 -- 172.21.15.39:0/4181288273 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe240094b0 con 0x7fbe300b4e10 2023-11-28T11:57:03.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.685+0000 7fbe35aba700 1 --2- 172.21.15.39:0/4181288273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe300b4e10 0x7fbe3014f080 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbe2000cb20 tx=0x7fbe2000cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.685+0000 7f746f7fe700 1 -- 172.21.15.39:0/2688632469 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74780052d0 con 0x7f74880cfa50 2023-11-28T11:57:03.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.685+0000 7f746f7fe700 1 -- 172.21.15.39:0/2688632469 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7478005430 con 0x7f74880cfa50 2023-11-28T11:57:03.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.685+0000 7f746f7fe700 1 -- 172.21.15.39:0/2688632469 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74780055a0 con 0x7f74880cfa50 2023-11-28T11:57:03.747 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.685+0000 7fbe2e7fc700 1 -- 172.21.15.39:0/4181288273 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2000a770 con 0x7fbe300b4e10 2023-11-28T11:57:03.747 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.685+0000 7fbe2e7fc700 1 -- 172.21.15.39:0/4181288273 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe2000a8d0 con 0x7fbe300b4e10 2023-11-28T11:57:03.747 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.685+0000 7fbe2e7fc700 1 -- 172.21.15.39:0/4181288273 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2000ac40 con 0x7fbe300b4e10 2023-11-28T11:57:03.747 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.685+0000 7fc824ff9700 1 -- 172.21.15.39:0/35152174 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc81804ff00 con 0x7fc8280b6200 2023-11-28T11:57:03.747 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.685+0000 7fbe37d1e700 1 -- 172.21.15.39:0/4181288273 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe30069c90 con 0x7fbe300b4e10 2023-11-28T11:57:03.747 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.685+0000 7fbe37d1e700 1 -- 172.21.15.39:0/4181288273 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe300b7eb0 con 0x7fbe300b4e10 2023-11-28T11:57:03.748 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.685+0000 7f748d271700 1 -- 172.21.15.39:0/2688632469 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f748815c560 con 0x7f74880cfa50 2023-11-28T11:57:03.748 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.685+0000 7f748d271700 1 -- 172.21.15.39:0/2688632469 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74880cf530 con 0x7f74880cfa50 2023-11-28T11:57:03.748 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.689+0000 7fbe2e7fc700 1 -- 172.21.15.39:0/4181288273 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbe20010070 con 0x7fbe300b4e10 2023-11-28T11:57:03.748 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.689+0000 7f748d271700 1 -- 172.21.15.39:0/2688632469 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7468005310 con 0x7f74880cfa50 2023-11-28T11:57:03.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.689+0000 7f746f7fe700 1 -- 172.21.15.39:0/2688632469 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7478019030 con 0x7f74880cfa50 2023-11-28T11:57:03.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.693+0000 7f746f7fe700 1 --2- 172.21.15.39:0/2688632469 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7474064fb0 0x7f7474067460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.693+0000 7f746f7fe700 1 -- 172.21.15.39:0/2688632469 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7478081420 con 0x7f74880cfa50 2023-11-28T11:57:03.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.693+0000 7fbe37d1e700 1 -- 172.21.15.39:0/4181288273 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe30069f70 con 0x7fbe300b4e10 2023-11-28T11:57:03.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.693+0000 7f74867fc700 1 --2- 172.21.15.39:0/2688632469 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7474064fb0 0x7f7474067460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.693+0000 7f74867fc700 1 --2- 172.21.15.39:0/2688632469 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7474064fb0 0x7f7474067460 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f748806cab0 tx=0x7f747c010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.693+0000 7fbe2e7fc700 1 --2- 172.21.15.39:0/4181288273 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fbe1c064f30 0x7fbe1c0673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:03.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.693+0000 7fbe2e7fc700 1 -- 172.21.15.39:0/4181288273 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbe20081ec0 con 0x7fbe300b4e10 2023-11-28T11:57:03.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.693+0000 7fbe352b9700 1 --2- 172.21.15.39:0/4181288273 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fbe1c064f30 0x7fbe1c0673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:03.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.697+0000 7fbe352b9700 1 --2- 172.21.15.39:0/4181288273 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fbe1c064f30 0x7fbe1c0673e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbe30135b70 tx=0x7fbe24010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:03.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.701+0000 7f746f7fe700 1 -- 172.21.15.39:0/2688632469 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f747804f260 con 0x7f74880cfa50 2023-11-28T11:57:03.751 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:03.701+0000 7fbe2e7fc700 1 -- 172.21.15.39:0/4181288273 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbe2004fe10 con 0x7fbe300b4e10 2023-11-28T11:57:04.023 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.017+0000 7f4f51dd2700 1 -- 172.21.15.39:0/3305059393 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f4f4c1f7480 con 0x7f4f4c069e00 2023-11-28T11:57:04.028 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.025+0000 7f4f497fa700 1 -- 172.21.15.39:0/3305059393 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4f440536d0 con 0x7f4f4c069e00 2023-11-28T11:57:04.029 INFO:teuthology.orchestra.run.smithi039.stdout:64424509449 2023-11-28T11:57:04.031 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.025+0000 7f85daeae700 1 -- 172.21.15.39:0/1195249266 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f85d40726c0 con 0x7f85d406cf40 2023-11-28T11:57:04.031 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.025+0000 7f6e60192700 1 -- 172.21.15.39:0/2188275601 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6e580726c0 con 0x7f6e5815d510 2023-11-28T11:57:04.032 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.025+0000 7f4f51dd2700 1 -- 172.21.15.39:0/3305059393 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4f38064f40 msgr2=0x7f4f380673f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:04.032 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.025+0000 7f4f51dd2700 1 --2- 172.21.15.39:0/3305059393 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4f38064f40 0x7f4f380673f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c0ccb80 tx=0x7f4f40009040 comp rx=0 tx=0).stop 2023-11-28T11:57:04.032 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.025+0000 7f4f51dd2700 1 -- 172.21.15.39:0/3305059393 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f4c069e00 msgr2=0x7f4f4c0c91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:04.032 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.025+0000 7f4f51dd2700 1 --2- 172.21.15.39:0/3305059393 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f4c069e00 0x7f4f4c0c91c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4f4400efc0 tx=0x7f4f4400c3a0 comp rx=0 tx=0).stop 2023-11-28T11:57:04.032 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.029+0000 7f4f51dd2700 1 -- 172.21.15.39:0/3305059393 shutdown_connections 2023-11-28T11:57:04.032 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.029+0000 7f4f51dd2700 1 --2- 172.21.15.39:0/3305059393 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f4c15c640 0x7f4f4c0ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:04.032 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.029+0000 7f4f51dd2700 1 --2- 172.21.15.39:0/3305059393 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4f38064f40 0x7f4f380673f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:04.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.029+0000 7f4f51dd2700 1 --2- 172.21.15.39:0/3305059393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f4c071aa0 0x7f4f4c0ce310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:04.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.029+0000 7f4f51dd2700 1 --2- 172.21.15.39:0/3305059393 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4f4c069e00 0x7f4f4c0c91c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:04.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.029+0000 7f4f51dd2700 1 -- 172.21.15.39:0/3305059393 >> 172.21.15.39:0/3305059393 conn(0x7f4f4c0b6520 msgr2=0x7f4f4c0b23d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:04.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.029+0000 7f85d17fa700 1 -- 172.21.15.39:0/1195249266 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f85c8054530 con 0x7f85d406cf40 2023-11-28T11:57:04.035 INFO:teuthology.orchestra.run.smithi039.stdout:60129542153 2023-11-28T11:57:04.036 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.029+0000 7f6e4e7fc700 1 -- 172.21.15.39:0/2188275601 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6e50053570 con 0x7f6e5815d510 2023-11-28T11:57:04.036 INFO:teuthology.orchestra.run.smithi039.stdout:64424509449 2023-11-28T11:57:04.036 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.029+0000 7f4f51dd2700 1 -- 172.21.15.39:0/3305059393 shutdown_connections 2023-11-28T11:57:04.036 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.029+0000 7f4f51dd2700 1 -- 172.21.15.39:0/3305059393 wait complete. 2023-11-28T11:57:04.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.033+0000 7f85daeae700 1 -- 172.21.15.39:0/1195249266 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f85b8064fb0 msgr2=0x7f85b8067460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:04.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.033+0000 7f85daeae700 1 --2- 172.21.15.39:0/1195249266 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f85b8064fb0 0x7f85b8067460 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f85c00049a0 tx=0x7f85c00016b0 comp rx=0 tx=0).stop 2023-11-28T11:57:04.038 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.033+0000 7f6e60192700 1 -- 172.21.15.39:0/2188275601 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6e3c064fe0 msgr2=0x7f6e3c067490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:04.038 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.033+0000 7f6e60192700 1 --2- 172.21.15.39:0/2188275601 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6e3c064fe0 0x7f6e3c067490 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6e54007fd0 tx=0x7f6e54009040 comp rx=0 tx=0).stop 2023-11-28T11:57:04.038 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.033+0000 7f6e60192700 1 -- 172.21.15.39:0/2188275601 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e5815d510 msgr2=0x7f6e58153a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:04.038 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.033+0000 7f6e60192700 1 --2- 172.21.15.39:0/2188275601 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e5815d510 0x7f6e58153a20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6e5000cc50 tx=0x7f6e5000cf60 comp rx=0 tx=0).stop 2023-11-28T11:57:04.038 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.033+0000 7f6e60192700 1 -- 172.21.15.39:0/2188275601 shutdown_connections 2023-11-28T11:57:04.038 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.033+0000 7f6e60192700 1 --2- 172.21.15.39:0/2188275601 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6e3c064fe0 0x7f6e3c067490 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:04.038 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.033+0000 7f6e60192700 1 --2- 172.21.15.39:0/2188275601 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e5815d510 0x7f6e58153a20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:04.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.033+0000 7f6e60192700 1 --2- 172.21.15.39:0/2188275601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e581534a0 0x7f6e5814a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:04.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.033+0000 7f6e60192700 1 --2- 172.21.15.39:0/2188275601 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e580b6030 0x7f6e581487b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:04.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.033+0000 7f6e60192700 1 -- 172.21.15.39:0/2188275601 >> 172.21.15.39:0/2188275601 conn(0x7f6e5806bfc0 msgr2=0x7f6e5815dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:04.040 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.033+0000 7f85daeae700 1 -- 172.21.15.39:0/1195249266 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85d406cf40 msgr2=0x7f85d406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:04.040 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.033+0000 7f85daeae700 1 --2- 172.21.15.39:0/1195249266 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85d406cf40 0x7f85d406d390 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f85c400c160 tx=0x7f85c80012b0 comp rx=0 tx=0).stop 2023-11-28T11:57:04.040 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.033+0000 7f85daeae700 1 -- 172.21.15.39:0/1195249266 shutdown_connections 2023-11-28T11:57:04.040 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.033+0000 7f85daeae700 1 --2- 172.21.15.39:0/1195249266 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f85b8064fb0 0x7f85b8067460 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:04.040 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.033+0000 7f85daeae700 1 --2- 172.21.15.39:0/1195249266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85d40afb60 0x7f85d40affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:04.040 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.033+0000 7f85daeae700 1 --2- 172.21.15.39:0/1195249266 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85d406cf40 0x7f85d406d390 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:04.040 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.033+0000 7f85daeae700 1 --2- 172.21.15.39:0/1195249266 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85c4004870 0x7f85d4154900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:04.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.033+0000 7f6e60192700 1 -- 172.21.15.39:0/2188275601 shutdown_connections 2023-11-28T11:57:04.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.033+0000 7f6e60192700 1 -- 172.21.15.39:0/2188275601 wait complete. 2023-11-28T11:57:04.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.033+0000 7f85daeae700 1 -- 172.21.15.39:0/1195249266 >> 172.21.15.39:0/1195249266 conn(0x7f85d40ce6c0 msgr2=0x7f85d40ca8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:04.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.033+0000 7f85daeae700 1 -- 172.21.15.39:0/1195249266 shutdown_connections 2023-11-28T11:57:04.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.033+0000 7f85daeae700 1 -- 172.21.15.39:0/1195249266 wait complete. 2023-11-28T11:57:04.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.033+0000 7f6d069e8700 1 -- 172.21.15.39:0/2967338178 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6ce80055c0 con 0x7f6d00160710 2023-11-28T11:57:04.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.037+0000 7f6cfe7fc700 1 -- 172.21.15.39:0/2967338178 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6cf8017020 con 0x7f6d00160710 2023-11-28T11:57:04.042 INFO:teuthology.orchestra.run.smithi039.stdout:60129542153 2023-11-28T11:57:04.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.041+0000 7f6d069e8700 1 -- 172.21.15.39:0/2967338178 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6ce4064ee0 msgr2=0x7f6ce4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:04.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.041+0000 7f6d069e8700 1 --2- 172.21.15.39:0/2967338178 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6ce4064ee0 0x7f6ce4067390 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4000f80 tx=0x7f6cf4011000 comp rx=0 tx=0).stop 2023-11-28T11:57:04.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.041+0000 7f6d069e8700 1 -- 172.21.15.39:0/2967338178 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d00160710 msgr2=0x7f6d000af180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:04.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.041+0000 7f6d069e8700 1 --2- 172.21.15.39:0/2967338178 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d00160710 0x7f6d000af180 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6d000cdbd0 tx=0x7f6cf800eaa0 comp rx=0 tx=0).stop 2023-11-28T11:57:04.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.041+0000 7f6d069e8700 1 -- 172.21.15.39:0/2967338178 shutdown_connections 2023-11-28T11:57:04.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.041+0000 7f6d069e8700 1 --2- 172.21.15.39:0/2967338178 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d00160710 0x7f6d000af180 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:04.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.041+0000 7f6d069e8700 1 --2- 172.21.15.39:0/2967338178 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6ce4064ee0 0x7f6ce4067390 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:04.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.041+0000 7f6d069e8700 1 --2- 172.21.15.39:0/2967338178 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d000cc860 0x7f6d001fb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:04.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.041+0000 7f6d069e8700 1 --2- 172.21.15.39:0/2967338178 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d00070790 0x7f6d0015be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:04.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.041+0000 7f6d069e8700 1 -- 172.21.15.39:0/2967338178 >> 172.21.15.39:0/2967338178 conn(0x7f6d000b0f80 msgr2=0x7f6d00069bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:04.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.041+0000 7f3ab601e700 1 -- 172.21.15.39:0/1962196358 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3ab0156b40 con 0x7f3ab01534a0 2023-11-28T11:57:04.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.041+0000 7f6d069e8700 1 -- 172.21.15.39:0/2967338178 shutdown_connections 2023-11-28T11:57:04.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.041+0000 7f6d069e8700 1 -- 172.21.15.39:0/2967338178 wait complete. 2023-11-28T11:57:04.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.041+0000 7f3a97fff700 1 -- 172.21.15.39:0/1962196358 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3aa4020020 con 0x7f3ab01534a0 2023-11-28T11:57:04.047 INFO:teuthology.orchestra.run.smithi039.stdout:64424509449 2023-11-28T11:57:04.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.049+0000 7f3ab601e700 1 -- 172.21.15.39:0/1962196358 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3a9c064f40 msgr2=0x7f3a9c0673f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:04.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.049+0000 7f3ab601e700 1 --2- 172.21.15.39:0/1962196358 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3a9c064f40 0x7f3a9c0673f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3aa0000f60 tx=0x7f3aa0009040 comp rx=0 tx=0).stop 2023-11-28T11:57:04.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.049+0000 7f3ab601e700 1 -- 172.21.15.39:0/1962196358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ab01534a0 msgr2=0x7f3ab0155300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:04.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.049+0000 7f3ab601e700 1 --2- 172.21.15.39:0/1962196358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ab01534a0 0x7f3ab0155300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4014040 tx=0x7f3aa4004770 comp rx=0 tx=0).stop 2023-11-28T11:57:04.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.049+0000 7fc82dbaa700 1 -- 172.21.15.39:0/35152174 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc8280726c0 con 0x7fc8280b6200 2023-11-28T11:57:04.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.049+0000 7f3ab601e700 1 -- 172.21.15.39:0/1962196358 shutdown_connections 2023-11-28T11:57:04.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.049+0000 7f3ab601e700 1 --2- 172.21.15.39:0/1962196358 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ab015d510 0x7f3ab00d2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:04.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.049+0000 7f3ab601e700 1 --2- 172.21.15.39:0/1962196358 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3a9c064f40 0x7f3a9c0673f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:04.054 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.049+0000 7f3ab601e700 1 --2- 172.21.15.39:0/1962196358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ab01534a0 0x7f3ab0155300 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:04.054 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.049+0000 7f3ab601e700 1 --2- 172.21.15.39:0/1962196358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ab00b6030 0x7f3ab0148720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:04.054 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.049+0000 7f3ab601e700 1 -- 172.21.15.39:0/1962196358 >> 172.21.15.39:0/1962196358 conn(0x7f3ab006bfc0 msgr2=0x7f3ab015af30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:04.054 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.049+0000 7f3ab601e700 1 -- 172.21.15.39:0/1962196358 shutdown_connections 2023-11-28T11:57:04.054 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.049+0000 7f3ab601e700 1 -- 172.21.15.39:0/1962196358 wait complete. 2023-11-28T11:57:04.054 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.049+0000 7fc824ff9700 1 -- 172.21.15.39:0/35152174 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc818053520 con 0x7fc8280b6200 2023-11-28T11:57:04.054 INFO:teuthology.orchestra.run.smithi039.stdout:64424509449 2023-11-28T11:57:04.055 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.049+0000 7fbe37d1e700 1 -- 172.21.15.39:0/4181288273 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fbe300b54f0 con 0x7fbe300b4e10 2023-11-28T11:57:04.056 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.053+0000 7fbe2e7fc700 1 -- 172.21.15.39:0/4181288273 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbe20054e60 con 0x7fbe300b4e10 2023-11-28T11:57:04.059 INFO:teuthology.orchestra.run.smithi039.stdout:64424509449 2023-11-28T11:57:04.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.053+0000 7fc82dbaa700 1 -- 172.21.15.39:0/35152174 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc808064ee0 msgr2=0x7fc808067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:04.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.053+0000 7fc82dbaa700 1 --2- 172.21.15.39:0/35152174 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc808064ee0 0x7fc808067390 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc8281566b0 tx=0x7fc810009040 comp rx=0 tx=0).stop 2023-11-28T11:57:04.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.053+0000 7fbe37d1e700 1 -- 172.21.15.39:0/4181288273 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fbe1c064f30 msgr2=0x7fbe1c0673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:04.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.053+0000 7fbe37d1e700 1 --2- 172.21.15.39:0/4181288273 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fbe1c064f30 0x7fbe1c0673e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbe30135b70 tx=0x7fbe24010000 comp rx=0 tx=0).stop 2023-11-28T11:57:04.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.053+0000 7fbe37d1e700 1 -- 172.21.15.39:0/4181288273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe300b4e10 msgr2=0x7fbe3014f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:04.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.053+0000 7fbe37d1e700 1 --2- 172.21.15.39:0/4181288273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe300b4e10 0x7fbe3014f080 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbe2000cb20 tx=0x7fbe2000cb50 comp rx=0 tx=0).stop 2023-11-28T11:57:04.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.053+0000 7fc82dbaa700 1 -- 172.21.15.39:0/35152174 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8280b6200 msgr2=0x7fc82815bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:04.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.053+0000 7fbe37d1e700 1 -- 172.21.15.39:0/4181288273 shutdown_connections 2023-11-28T11:57:04.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.053+0000 7fbe37d1e700 1 --2- 172.21.15.39:0/4181288273 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fbe1c064f30 0x7fbe1c0673e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:04.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.053+0000 7fbe37d1e700 1 --2- 172.21.15.39:0/4181288273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe3015c210 0x7fbe30152980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:04.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.053+0000 7fbe37d1e700 1 --2- 172.21.15.39:0/4181288273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe300d0380 0x7fbe30150060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:04.062 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.053+0000 7fbe37d1e700 1 --2- 172.21.15.39:0/4181288273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe300b4e10 0x7fbe3014f080 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:04.062 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.053+0000 7fbe37d1e700 1 -- 172.21.15.39:0/4181288273 >> 172.21.15.39:0/4181288273 conn(0x7fbe3006bfe0 msgr2=0x7fbe30070a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:04.062 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.053+0000 7fc82dbaa700 1 --2- 172.21.15.39:0/35152174 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8280b6200 0x7fc82815bcc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc81800e9d0 tx=0x7fc81800ece0 comp rx=0 tx=0).stop 2023-11-28T11:57:04.062 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.057+0000 7fbe37d1e700 1 -- 172.21.15.39:0/4181288273 shutdown_connections 2023-11-28T11:57:04.062 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.057+0000 7fbe37d1e700 1 -- 172.21.15.39:0/4181288273 wait complete. 2023-11-28T11:57:04.063 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.057+0000 7fc82dbaa700 1 -- 172.21.15.39:0/35152174 shutdown_connections 2023-11-28T11:57:04.063 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.057+0000 7fc82dbaa700 1 --2- 172.21.15.39:0/35152174 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc828160920 0x7fc828154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:04.063 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.057+0000 7fc82dbaa700 1 --2- 172.21.15.39:0/35152174 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc808064ee0 0x7fc808067390 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:04.063 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.057+0000 7fc82dbaa700 1 --2- 172.21.15.39:0/35152174 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8281534a0 0x7fc828154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:04.063 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.057+0000 7fc82dbaa700 1 --2- 172.21.15.39:0/35152174 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8280b6200 0x7fc82815bcc0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:04.063 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.057+0000 7fc82dbaa700 1 -- 172.21.15.39:0/35152174 >> 172.21.15.39:0/35152174 conn(0x7fc82806bfc0 msgr2=0x7fc8280d17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:04.063 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.057+0000 7fc82dbaa700 1 -- 172.21.15.39:0/35152174 shutdown_connections 2023-11-28T11:57:04.063 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.057+0000 7fc82dbaa700 1 -- 172.21.15.39:0/35152174 wait complete. 2023-11-28T11:57:04.065 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.4 2023-11-28T11:57:04.069 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.5 2023-11-28T11:57:04.070 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.0 2023-11-28T11:57:04.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.065+0000 7f748d271700 1 -- 172.21.15.39:0/2688632469 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f74680055c0 con 0x7f74880cfa50 2023-11-28T11:57:04.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.065+0000 7f746f7fe700 1 -- 172.21.15.39:0/2688632469 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7478052880 con 0x7f74880cfa50 2023-11-28T11:57:04.070 INFO:teuthology.orchestra.run.smithi039.stdout:64424509449 2023-11-28T11:57:04.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.069+0000 7f748d271700 1 -- 172.21.15.39:0/2688632469 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7474064fb0 msgr2=0x7f7474067460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:04.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.069+0000 7f748d271700 1 --2- 172.21.15.39:0/2688632469 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7474064fb0 0x7f7474067460 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f748806cab0 tx=0x7f747c010000 comp rx=0 tx=0).stop 2023-11-28T11:57:04.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.069+0000 7f748d271700 1 -- 172.21.15.39:0/2688632469 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74880cfa50 msgr2=0x7f748814f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:04.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.069+0000 7f748d271700 1 --2- 172.21.15.39:0/2688632469 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74880cfa50 0x7f748814f1b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f747800c530 tx=0x7f747800c840 comp rx=0 tx=0).stop 2023-11-28T11:57:04.073 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.2 2023-11-28T11:57:04.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.069+0000 7f748d271700 1 -- 172.21.15.39:0/2688632469 shutdown_connections 2023-11-28T11:57:04.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.069+0000 7f748d271700 1 --2- 172.21.15.39:0/2688632469 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7474064fb0 0x7f7474067460 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:04.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.069+0000 7f748d271700 1 --2- 172.21.15.39:0/2688632469 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74880d0e30 0x7f7488151630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:04.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.069+0000 7f748d271700 1 --2- 172.21.15.39:0/2688632469 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74880cfec0 0x7f74880c9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:04.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.069+0000 7f748d271700 1 --2- 172.21.15.39:0/2688632469 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74880cfa50 0x7f748814f1b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:04.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.069+0000 7f748d271700 1 -- 172.21.15.39:0/2688632469 >> 172.21.15.39:0/2688632469 conn(0x7f748806e100 msgr2=0x7f74880d4420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:04.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.069+0000 7f748d271700 1 -- 172.21.15.39:0/2688632469 shutdown_connections 2023-11-28T11:57:04.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:04.069+0000 7f748d271700 1 -- 172.21.15.39:0/2688632469 wait complete. 2023-11-28T11:57:04.080 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.3 2023-11-28T11:57:04.083 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.6 2023-11-28T11:57:04.085 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.1 2023-11-28T11:57:04.092 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.7 2023-11-28T11:57:05.066 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-28T11:57:05.069 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-28T11:57:05.071 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-28T11:57:05.074 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-28T11:57:05.081 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-28T11:57:05.084 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-28T11:57:05.086 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-28T11:57:05.093 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-28T11:57:05.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.265+0000 7ff48d030700 1 Processor -- start 2023-11-28T11:57:05.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.265+0000 7ff48d030700 1 -- start start 2023-11-28T11:57:05.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.265+0000 7ff48d030700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff48815c050 0x7ff488160700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.265+0000 7ff48d030700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff48815c420 0x7ff488070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.265+0000 7ff48d030700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff4880cdf20 0x7ff4880705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.265+0000 7ff48d030700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff488160c40 con 0x7ff4880cdf20 2023-11-28T11:57:05.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.265+0000 7ff48d030700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff488069c90 con 0x7ff48815c050 2023-11-28T11:57:05.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.265+0000 7ff48d030700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4880cf5f0 con 0x7ff48815c420 2023-11-28T11:57:05.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.269+0000 7ff48659c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff48815c420 0x7ff488070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.269+0000 7ff48659c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff48815c420 0x7ff488070080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:48458/0 (socket says 172.21.15.39:48458) 2023-11-28T11:57:05.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.269+0000 7ff48659c700 1 -- 172.21.15.39:0/715157059 learned_addr learned my addr 172.21.15.39:0/715157059 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:05.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.269+0000 7ff48759e700 1 --2- 172.21.15.39:0/715157059 >> v2:172.21.15.39:3300/0 conn(0x7ff4880cdf20 0x7ff4880705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.269+0000 7ff486d9d700 1 --2- 172.21.15.39:0/715157059 >> v2:172.21.15.184:3300/0 conn(0x7ff48815c050 0x7ff488160700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.269+0000 7ff48659c700 1 -- 172.21.15.39:0/715157059 >> v2:172.21.15.184:3300/0 conn(0x7ff48815c050 msgr2=0x7ff488160700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:05.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.269+0000 7ff48659c700 1 --2- 172.21.15.39:0/715157059 >> v2:172.21.15.184:3300/0 conn(0x7ff48815c050 0x7ff488160700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.269+0000 7ff48659c700 1 -- 172.21.15.39:0/715157059 >> v2:172.21.15.39:3300/0 conn(0x7ff4880cdf20 msgr2=0x7ff4880705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:05.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.269+0000 7ff48659c700 1 --2- 172.21.15.39:0/715157059 >> v2:172.21.15.39:3300/0 conn(0x7ff4880cdf20 0x7ff4880705c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.269+0000 7ff48659c700 1 -- 172.21.15.39:0/715157059 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4880ce4e0 con 0x7ff48815c420 2023-11-28T11:57:05.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.269+0000 7ff48659c700 1 --2- 172.21.15.39:0/715157059 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff48815c420 0x7ff488070080 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff48806fb30 tx=0x7ff47c009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b45bf6f3b1f704ba server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:05.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.269+0000 7ff485d9b700 1 -- 172.21.15.39:0/715157059 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c00b8a0 con 0x7ff48815c420 2023-11-28T11:57:05.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.269+0000 7ff485d9b700 1 -- 172.21.15.39:0/715157059 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47c00ba00 con 0x7ff48815c420 2023-11-28T11:57:05.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.269+0000 7ff485d9b700 1 -- 172.21.15.39:0/715157059 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c00bd90 con 0x7ff48815c420 2023-11-28T11:57:05.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.273+0000 7ff48d030700 1 -- 172.21.15.39:0/715157059 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff48815c420 msgr2=0x7ff488070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.273+0000 7ff48d030700 1 --2- 172.21.15.39:0/715157059 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff48815c420 0x7ff488070080 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff48806fb30 tx=0x7ff47c009bf0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.273+0000 7ff48d030700 1 -- 172.21.15.39:0/715157059 shutdown_connections 2023-11-28T11:57:05.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.273+0000 7ff48d030700 1 --2- 172.21.15.39:0/715157059 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff48815c420 0x7ff488070080 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.273+0000 7ff48d030700 1 --2- 172.21.15.39:0/715157059 >> v2:172.21.15.39:3300/0 conn(0x7ff4880cdf20 0x7ff4880705c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.273+0000 7ff48d030700 1 --2- 172.21.15.39:0/715157059 >> v2:172.21.15.184:3300/0 conn(0x7ff48815c050 0x7ff488160700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.273+0000 7ff48d030700 1 -- 172.21.15.39:0/715157059 >> 172.21.15.39:0/715157059 conn(0x7ff4880b0f90 msgr2=0x7ff4880ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:05.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.273+0000 7ff48d030700 1 -- 172.21.15.39:0/715157059 shutdown_connections 2023-11-28T11:57:05.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.273+0000 7ff48d030700 1 -- 172.21.15.39:0/715157059 wait complete. 2023-11-28T11:57:05.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.277+0000 7ff48d030700 1 Processor -- start 2023-11-28T11:57:05.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.277+0000 7ff48d030700 1 -- start start 2023-11-28T11:57:05.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.277+0000 7ff48d030700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4880cdf20 0x7ff4881fe940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.284 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.281+0000 7ff48d030700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff48815c050 0x7ff48806c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.284 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.281+0000 7ff48d030700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff48815c420 0x7ff48806c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.284 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.281+0000 7ff486d9d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4880cdf20 0x7ff4881fe940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.281+0000 7ff48d030700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4880c44f0 con 0x7ff48815c050 2023-11-28T11:57:05.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.281+0000 7ff48d030700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48815b670 con 0x7ff4880cdf20 2023-11-28T11:57:05.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.281+0000 7ff48d030700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff48815c890 con 0x7ff48815c420 2023-11-28T11:57:05.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.281+0000 7ff48759e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff48815c420 0x7ff48806c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.281+0000 7ff48759e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff48815c420 0x7ff48806c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:48464/0 (socket says 172.21.15.39:48464) 2023-11-28T11:57:05.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.281+0000 7ff48759e700 1 -- 172.21.15.39:0/701563582 learned_addr learned my addr 172.21.15.39:0/701563582 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:05.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.281+0000 7ff48659c700 1 --2- 172.21.15.39:0/701563582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff48815c050 0x7ff48806c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.281+0000 7ff48759e700 1 -- 172.21.15.39:0/701563582 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4880cdf20 msgr2=0x7ff4881fe940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.281+0000 7ff48759e700 1 --2- 172.21.15.39:0/701563582 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4880cdf20 0x7ff4881fe940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.281+0000 7ff48759e700 1 -- 172.21.15.39:0/701563582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff48815c050 msgr2=0x7ff48806c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.281+0000 7ff48759e700 1 --2- 172.21.15.39:0/701563582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff48815c050 0x7ff48806c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.281+0000 7ff48759e700 1 -- 172.21.15.39:0/701563582 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47c009570 con 0x7ff48815c420 2023-11-28T11:57:05.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.281+0000 7ff48759e700 1 --2- 172.21.15.39:0/701563582 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff48815c420 0x7ff48806c9b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff480007e90 tx=0x7ff48000e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:05.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.281+0000 7ff46f7fe700 1 -- 172.21.15.39:0/701563582 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48000ede0 con 0x7ff48815c420 2023-11-28T11:57:05.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.281+0000 7ff46f7fe700 1 -- 172.21.15.39:0/701563582 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff480014420 con 0x7ff48815c420 2023-11-28T11:57:05.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.281+0000 7ff46f7fe700 1 -- 172.21.15.39:0/701563582 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4800147d0 con 0x7ff48815c420 2023-11-28T11:57:05.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.281+0000 7ff48d030700 1 -- 172.21.15.39:0/701563582 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4880cc6a0 con 0x7ff48815c420 2023-11-28T11:57:05.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.281+0000 7ff48d030700 1 -- 172.21.15.39:0/701563582 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4880cc3c0 con 0x7ff48815c420 2023-11-28T11:57:05.289 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.285+0000 7ff48d030700 1 -- 172.21.15.39:0/701563582 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4880cc980 con 0x7ff48815c420 2023-11-28T11:57:05.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.285+0000 7ff46f7fe700 1 -- 172.21.15.39:0/701563582 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff480012050 con 0x7ff48815c420 2023-11-28T11:57:05.293 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.289+0000 7ff46f7fe700 1 --2- 172.21.15.39:0/701563582 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff474064ee0 0x7ff474067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.293 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.289+0000 7ff46f7fe700 1 -- 172.21.15.39:0/701563582 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff4800828b0 con 0x7ff48815c420 2023-11-28T11:57:05.294 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.289+0000 7ff486d9d700 1 --2- 172.21.15.39:0/701563582 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff474064ee0 0x7ff474067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.295 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.289+0000 7ff486d9d700 1 --2- 172.21.15.39:0/701563582 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff474064ee0 0x7ff474067390 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff478009a00 tx=0x7ff478008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:05.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.293+0000 7ff46f7fe700 1 -- 172.21.15.39:0/701563582 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff480050580 con 0x7ff48815c420 2023-11-28T11:57:05.317 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.309+0000 7fb7edab8700 1 Processor -- start 2023-11-28T11:57:05.317 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.309+0000 7fb7edab8700 1 -- start start 2023-11-28T11:57:05.317 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.313+0000 7fb7edab8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7e80cdf20 0x7fb7e80cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.317 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.313+0000 7fb7edab8700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e80cf6d0 con 0x7fb7e80add80 2023-11-28T11:57:05.317 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.313+0000 7fb7edab8700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e8169450 con 0x7fb7e80ad910 2023-11-28T11:57:05.317 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.313+0000 7fb7edab8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e816ccc0 con 0x7fb7e80cdf20 2023-11-28T11:57:05.318 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.313+0000 7fb7e7fff700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fb7e80ad910 0x7fb7e816d1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:57338/0 (socket says 172.21.15.39:57338) 2023-11-28T11:57:05.318 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.313+0000 7fb7e7fff700 1 -- 172.21.15.39:0/505490685 learned_addr learned my addr 172.21.15.39:0/505490685 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:05.318 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.313+0000 7fb7ecab6700 1 --2- 172.21.15.39:0/505490685 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7e80cdf20 0x7fb7e80cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.319 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.313+0000 7fb7e77fe700 1 -- 172.21.15.39:0/505490685 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2589657216 0 0) 0x7fb7e8169450 con 0x7fb7e80ad910 2023-11-28T11:57:05.319 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.313+0000 7fb7ecab6700 1 -- 172.21.15.39:0/505490685 >> v1:172.21.15.184:6789/0 conn(0x7fb7e80ad910 legacy=0x7fb7e816d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.319 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.313+0000 7fb7ecab6700 1 -- 172.21.15.39:0/505490685 >> v1:172.21.15.39:6789/0 conn(0x7fb7e80add80 legacy=0x7fb7e8069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.319 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.313+0000 7fb7ecab6700 1 -- 172.21.15.39:0/505490685 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e80cca80 con 0x7fb7e80cdf20 2023-11-28T11:57:05.319 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.313+0000 7fb7ecab6700 1 --2- 172.21.15.39:0/505490685 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7e80cdf20 0x7fb7e80cf190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80ccc70 tx=0x7fb7d8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85817b3fd98403e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:05.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.313+0000 7fb7e77fe700 1 -- 172.21.15.39:0/505490685 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d8004020 con 0x7fb7e80cdf20 2023-11-28T11:57:05.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.317+0000 7fb7e77fe700 1 -- 172.21.15.39:0/505490685 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d8004180 con 0x7fb7e80cdf20 2023-11-28T11:57:05.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.317+0000 7fb7e77fe700 1 -- 172.21.15.39:0/505490685 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d8004530 con 0x7fb7e80cdf20 2023-11-28T11:57:05.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.317+0000 7fb7edab8700 1 -- 172.21.15.39:0/505490685 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7e80cdf20 msgr2=0x7fb7e80cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.317+0000 7fb7edab8700 1 --2- 172.21.15.39:0/505490685 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7e80cdf20 0x7fb7e80cf190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80ccc70 tx=0x7fb7d8009b60 comp rx=0 tx=0).stop 2023-11-28T11:57:05.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.317+0000 7fb7edab8700 1 -- 172.21.15.39:0/505490685 shutdown_connections 2023-11-28T11:57:05.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.317+0000 7fb7edab8700 1 --2- 172.21.15.39:0/505490685 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7e80cdf20 0x7fb7e80cf190 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.324 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.317+0000 7fb7edab8700 1 -- 172.21.15.39:0/505490685 >> 172.21.15.39:0/505490685 conn(0x7fb7e80b0f90 msgr2=0x7fb7e80ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:05.324 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.317+0000 7fb7edab8700 1 -- 172.21.15.39:0/505490685 shutdown_connections 2023-11-28T11:57:05.325 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.317+0000 7fb7edab8700 1 -- 172.21.15.39:0/505490685 wait complete. 2023-11-28T11:57:05.327 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.321+0000 7fb7edab8700 1 Processor -- start 2023-11-28T11:57:05.327 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.321+0000 7fb7edab8700 1 -- start start 2023-11-28T11:57:05.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.325+0000 7fb7edab8700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7e80ad910 0x7fb7e8088bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.330 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.325+0000 7fb7edab8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7e80add80 0x7fb7e80ae700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.325+0000 7fb7edab8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7e80cdf20 0x7fb7e806ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.325+0000 7fb7ecab6700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7e80ad910 0x7fb7e8088bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.325+0000 7fb7edab8700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e80c5f80 con 0x7fb7e80ad910 2023-11-28T11:57:05.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.325+0000 7fb7e7fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7e80add80 0x7fb7e80ae700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.325+0000 7fb7e7fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7e80add80 0x7fb7e80ae700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:48480/0 (socket says 172.21.15.39:48480) 2023-11-28T11:57:05.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.325+0000 7fb7e7fff700 1 -- 172.21.15.39:0/2422332443 learned_addr learned my addr 172.21.15.39:0/2422332443 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:05.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.325+0000 7fb7ecab6700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7e80ad910 0x7fb7e8088bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45298/0 (socket says 172.21.15.39:45298) 2023-11-28T11:57:05.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.325+0000 7fb7ed2b7700 1 --2- 172.21.15.39:0/2422332443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7e80cdf20 0x7fb7e806ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.325+0000 7fb7edab8700 1 -- 172.21.15.39:0/2422332443 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e80b43e0 con 0x7fb7e80cdf20 2023-11-28T11:57:05.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.325+0000 7fb7edab8700 1 -- 172.21.15.39:0/2422332443 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e8089130 con 0x7fb7e80add80 2023-11-28T11:57:05.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.329+0000 7fb7e7fff700 1 -- 172.21.15.39:0/2422332443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7e80cdf20 msgr2=0x7fb7e806ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.329+0000 7fb7e7fff700 1 --2- 172.21.15.39:0/2422332443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7e80cdf20 0x7fb7e806ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.329+0000 7fb7e7fff700 1 -- 172.21.15.39:0/2422332443 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7e80ad910 msgr2=0x7fb7e8088bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.329+0000 7fb7e7fff700 1 --2- 172.21.15.39:0/2422332443 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7e80ad910 0x7fb7e8088bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.329+0000 7fb7e7fff700 1 -- 172.21.15.39:0/2422332443 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d80094b0 con 0x7fb7e80add80 2023-11-28T11:57:05.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.329+0000 7fb7ecab6700 1 --2- 172.21.15.39:0/2422332443 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7e80ad910 0x7fb7e8088bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:05.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.329+0000 7fb7e7fff700 1 --2- 172.21.15.39:0/2422332443 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7e80add80 0x7fb7e80ae700 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000ccb0 tx=0x7fb7e000a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:05.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.329+0000 7fb7e57fa700 1 -- 172.21.15.39:0/2422332443 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e000aaf0 con 0x7fb7e80add80 2023-11-28T11:57:05.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.329+0000 7fb7e57fa700 1 -- 172.21.15.39:0/2422332443 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e000ac50 con 0x7fb7e80add80 2023-11-28T11:57:05.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.329+0000 7fb7e57fa700 1 -- 172.21.15.39:0/2422332443 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e00070d0 con 0x7fb7e80add80 2023-11-28T11:57:05.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.329+0000 7fb7edab8700 1 -- 172.21.15.39:0/2422332443 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e80cc7a0 con 0x7fb7e80add80 2023-11-28T11:57:05.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.329+0000 7fb7edab8700 1 -- 172.21.15.39:0/2422332443 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e80cc4c0 con 0x7fb7e80add80 2023-11-28T11:57:05.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.329+0000 7fb7edab8700 1 -- 172.21.15.39:0/2422332443 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7e816d8b0 con 0x7fb7e80add80 2023-11-28T11:57:05.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.337+0000 7fb7e57fa700 1 -- 172.21.15.39:0/2422332443 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb7e001a030 con 0x7fb7e80add80 2023-11-28T11:57:05.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.337+0000 7fb7e57fa700 1 --2- 172.21.15.39:0/2422332443 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb7d4064f60 0x7fb7d4067410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.337+0000 7fb7e57fa700 1 -- 172.21.15.39:0/2422332443 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb7e0082420 con 0x7fb7e80add80 2023-11-28T11:57:05.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.341+0000 7fb7ecab6700 1 --2- 172.21.15.39:0/2422332443 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb7d4064f60 0x7fb7d4067410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.341+0000 7fb7ecab6700 1 --2- 172.21.15.39:0/2422332443 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb7d4064f60 0x7fb7d4067410 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80ccc70 tx=0x7fb7d801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:05.350 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.345+0000 7fb7e57fa700 1 -- 172.21.15.39:0/2422332443 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb7e0050200 con 0x7fb7e80add80 2023-11-28T11:57:05.354 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.349+0000 7f2ff759e700 1 Processor -- start 2023-11-28T11:57:05.354 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.349+0000 7f2ff759e700 1 -- start start 2023-11-28T11:57:05.356 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.349+0000 7f2ff759e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f2ff8160420 0x7f2ff81607f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.356 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.349+0000 7f2ff759e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ff80cdf20 0x7f2ff8164c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.360 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.353+0000 7f2ff759e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ff8165170 con 0x7f2ff80c8da0 2023-11-28T11:57:05.360 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.357+0000 7f2ff6d9d700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f2ff80c8da0 0x7f2ff8070080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:57354/0 (socket says 172.21.15.39:57354) 2023-11-28T11:57:05.360 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.357+0000 7f2ff6d9d700 1 -- 172.21.15.39:0/4045975618 learned_addr learned my addr 172.21.15.39:0/4045975618 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:05.360 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.357+0000 7f2ff659c700 1 --2- 172.21.15.39:0/4045975618 >> v2:172.21.15.39:3300/0 conn(0x7f2ff8160420 0x7f2ff81607f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.361 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.357+0000 7f2ff759e700 1 -- 172.21.15.39:0/4045975618 --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ff8069c90 con 0x7f2ff8160420 2023-11-28T11:57:05.361 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.357+0000 7f2ff5d9b700 1 --2- 172.21.15.39:0/4045975618 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ff80cdf20 0x7f2ff8164c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.361 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.357+0000 7f2ff759e700 1 -- 172.21.15.39:0/4045975618 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff80cf430 con 0x7f2ff80cdf20 2023-11-28T11:57:05.361 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.357+0000 7f2ff559a700 1 -- 172.21.15.39:0/4045975618 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2174109610 0 0) 0x7f2ff8165170 con 0x7f2ff80c8da0 2023-11-28T11:57:05.362 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.357+0000 7f2ff559a700 1 -- 172.21.15.39:0/4045975618 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fe00035d0 con 0x7f2ff80c8da0 2023-11-28T11:57:05.362 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.357+0000 7f2ff659c700 1 -- 172.21.15.39:0/4045975618 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ff80cdf20 msgr2=0x7f2ff8164c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:05.362 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.357+0000 7f2ff659c700 1 --2- 172.21.15.39:0/4045975618 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ff80cdf20 0x7f2ff8164c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.362 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.357+0000 7f2ff659c700 1 -- 172.21.15.39:0/4045975618 >> v1:172.21.15.184:6789/0 conn(0x7f2ff80c8da0 legacy=0x7f2ff8070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.362 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.357+0000 7f2ff559a700 1 -- 172.21.15.39:0/4045975618 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1253245261 0 0) 0x7f2fe00035d0 con 0x7f2ff80c8da0 2023-11-28T11:57:05.363 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.357+0000 7f2ff659c700 1 -- 172.21.15.39:0/4045975618 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff80ce4b0 con 0x7f2ff8160420 2023-11-28T11:57:05.363 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.357+0000 7f2ff659c700 1 --2- 172.21.15.39:0/4045975618 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ff8160420 0x7f2ff81607f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2fec009850 tx=0x7f2fec009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c70651c943b0dbbd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:05.365 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.357+0000 7f2ff559a700 1 -- 172.21.15.39:0/4045975618 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8001670 con 0x7f2ff8160420 2023-11-28T11:57:05.365 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.357+0000 7f2ff559a700 1 -- 172.21.15.39:0/4045975618 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fec004030 con 0x7f2ff8160420 2023-11-28T11:57:05.365 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.357+0000 7f2ff559a700 1 -- 172.21.15.39:0/4045975618 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fec0043e0 con 0x7f2ff8160420 2023-11-28T11:57:05.365 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.361+0000 7f2ff759e700 1 -- 172.21.15.39:0/4045975618 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ff8160420 msgr2=0x7f2ff81607f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.365 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.361+0000 7f2ff759e700 1 --2- 172.21.15.39:0/4045975618 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ff8160420 0x7f2ff81607f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2fec009850 tx=0x7f2fec009b60 comp rx=0 tx=0).stop 2023-11-28T11:57:05.366 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.361+0000 7f2ff759e700 1 -- 172.21.15.39:0/4045975618 shutdown_connections 2023-11-28T11:57:05.366 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.361+0000 7f2ff759e700 1 --2- 172.21.15.39:0/4045975618 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ff80cdf20 0x7f2ff8164c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.366 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.361+0000 7f2ff759e700 1 --2- 172.21.15.39:0/4045975618 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ff8160420 0x7f2ff81607f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.366 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.361+0000 7f2ff759e700 1 -- 172.21.15.39:0/4045975618 >> 172.21.15.39:0/4045975618 conn(0x7f2ff80b0f90 msgr2=0x7f2ff80ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:05.367 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.361+0000 7f2ff759e700 1 -- 172.21.15.39:0/4045975618 shutdown_connections 2023-11-28T11:57:05.370 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.361+0000 7f2ff759e700 1 -- 172.21.15.39:0/4045975618 wait complete. 2023-11-28T11:57:05.370 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.365+0000 7f2ff759e700 1 Processor -- start 2023-11-28T11:57:05.370 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.365+0000 7f2ff759e700 1 -- start start 2023-11-28T11:57:05.372 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.369+0000 7f2ff759e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ff80c8da0 0x7f2ff81fd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.373 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.369+0000 7f2ff759e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ff80cdf20 0x7f2ff80b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.374 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.369+0000 7f2ff759e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ff8160420 0x7f2ff8162ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.375 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.369+0000 7f2ff759e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff8162a10 con 0x7f2ff80cdf20 2023-11-28T11:57:05.375 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.369+0000 7f2ff5d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ff80cdf20 0x7f2ff80b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.375 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.369+0000 7f2ff5d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ff80cdf20 0x7f2ff80b24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45314/0 (socket says 172.21.15.39:45314) 2023-11-28T11:57:05.375 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.369+0000 7f2ff5d9b700 1 -- 172.21.15.39:0/735413347 learned_addr learned my addr 172.21.15.39:0/735413347 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:05.375 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.369+0000 7f2ff6d9d700 1 --2- 172.21.15.39:0/735413347 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ff8160420 0x7f2ff8162ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.375 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.369+0000 7f2ff659c700 1 --2- 172.21.15.39:0/735413347 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ff80c8da0 0x7f2ff81fd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.375 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.369+0000 7f2ff759e700 1 -- 172.21.15.39:0/735413347 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff8161e40 con 0x7f2ff8160420 2023-11-28T11:57:05.375 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.369+0000 7f2ff759e700 1 -- 172.21.15.39:0/735413347 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff81620e0 con 0x7f2ff80c8da0 2023-11-28T11:57:05.377 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.369+0000 7f2ff6d9d700 1 -- 172.21.15.39:0/735413347 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ff80c8da0 msgr2=0x7f2ff81fd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.377 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.369+0000 7f2ff6d9d700 1 --2- 172.21.15.39:0/735413347 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ff80c8da0 0x7f2ff81fd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.377 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.369+0000 7f2ff6d9d700 1 -- 172.21.15.39:0/735413347 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ff80cdf20 msgr2=0x7f2ff80b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.377 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.369+0000 7f2ff6d9d700 1 --2- 172.21.15.39:0/735413347 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ff80cdf20 0x7f2ff80b24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.377 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.369+0000 7f2ff6d9d700 1 -- 172.21.15.39:0/735413347 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fec0094b0 con 0x7f2ff8160420 2023-11-28T11:57:05.377 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.373+0000 7f2ff6d9d700 1 --2- 172.21.15.39:0/735413347 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ff8160420 0x7f2ff8162ea0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2fe800c3e0 tx=0x7f2fe800c6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:05.377 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.373+0000 7f2fe6ffd700 1 -- 172.21.15.39:0/735413347 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8004ca0 con 0x7f2ff8160420 2023-11-28T11:57:05.377 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.373+0000 7f2ff759e700 1 -- 172.21.15.39:0/735413347 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ff80cc6a0 con 0x7f2ff8160420 2023-11-28T11:57:05.377 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.373+0000 7f2fe6ffd700 1 -- 172.21.15.39:0/735413347 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe8004e00 con 0x7f2ff8160420 2023-11-28T11:57:05.377 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.373+0000 7f2fe6ffd700 1 -- 172.21.15.39:0/735413347 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe80072d0 con 0x7f2ff8160420 2023-11-28T11:57:05.377 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.373+0000 7f2ff759e700 1 -- 172.21.15.39:0/735413347 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ff80cc3c0 con 0x7f2ff8160420 2023-11-28T11:57:05.380 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.377+0000 7f2ff759e700 1 -- 172.21.15.39:0/735413347 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ff80cc980 con 0x7f2ff8160420 2023-11-28T11:57:05.380 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.377+0000 7f2fe6ffd700 1 -- 172.21.15.39:0/735413347 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2fe801a020 con 0x7f2ff8160420 2023-11-28T11:57:05.383 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.377+0000 7f2fe6ffd700 1 --2- 172.21.15.39:0/735413347 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2fd8064ee0 0x7f2fd8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.383 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.377+0000 7f2fe6ffd700 1 -- 172.21.15.39:0/735413347 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2fe8081cb0 con 0x7f2ff8160420 2023-11-28T11:57:05.383 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.377+0000 7f2ff659c700 1 --2- 172.21.15.39:0/735413347 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2fd8064ee0 0x7f2fd8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.385+0000 7f2ff659c700 1 --2- 172.21.15.39:0/735413347 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2fd8064ee0 0x7f2fd8067390 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2fec0090b0 tx=0x7f2fec008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:05.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.389+0000 7f2fe6ffd700 1 -- 172.21.15.39:0/735413347 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2fe804f9f0 con 0x7f2ff8160420 2023-11-28T11:57:05.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.393+0000 7f49815a8700 1 Processor -- start 2023-11-28T11:57:05.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.393+0000 7f49815a8700 1 -- start start 2023-11-28T11:57:05.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.393+0000 7f49815a8700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f497c15c050 0x7f497c160700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.393+0000 7f49815a8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f497c15c420 0x7f497c070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.393+0000 7f49815a8700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f497c0cdf20 0x7f497c0705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.393+0000 7f49815a8700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f497c160c40 con 0x7f497c0cdf20 2023-11-28T11:57:05.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.393+0000 7f49815a8700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f497c069c90 con 0x7f497c15c050 2023-11-28T11:57:05.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.393+0000 7f49815a8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f497c0cf5f0 con 0x7f497c15c420 2023-11-28T11:57:05.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.397+0000 7f4980da7700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f497c0cdf20 0x7f497c0705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.397+0000 7f4980da7700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f497c0cdf20 0x7f497c0705c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45330/0 (socket says 172.21.15.39:45330) 2023-11-28T11:57:05.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.397+0000 7f4980da7700 1 -- 172.21.15.39:0/536385020 learned_addr learned my addr 172.21.15.39:0/536385020 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:05.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.397+0000 7f497bfff700 1 --2- 172.21.15.39:0/536385020 >> v2:172.21.15.184:3300/0 conn(0x7f497c15c050 0x7f497c160700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.397+0000 7f497b7fe700 1 --2- 172.21.15.39:0/536385020 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f497c15c420 0x7f497c070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.397+0000 7f497b7fe700 1 -- 172.21.15.39:0/536385020 >> v2:172.21.15.184:3300/0 conn(0x7f497c15c050 msgr2=0x7f497c160700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:05.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.397+0000 7f497b7fe700 1 --2- 172.21.15.39:0/536385020 >> v2:172.21.15.184:3300/0 conn(0x7f497c15c050 0x7f497c160700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.397+0000 7f497b7fe700 1 -- 172.21.15.39:0/536385020 >> v2:172.21.15.39:3300/0 conn(0x7f497c0cdf20 msgr2=0x7f497c0705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:05.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.397+0000 7f497b7fe700 1 --2- 172.21.15.39:0/536385020 >> v2:172.21.15.39:3300/0 conn(0x7f497c0cdf20 0x7f497c0705c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.397+0000 7f497b7fe700 1 -- 172.21.15.39:0/536385020 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f497c0ce4e0 con 0x7f497c15c420 2023-11-28T11:57:05.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.397+0000 7f4980da7700 1 --2- 172.21.15.39:0/536385020 >> v2:172.21.15.39:3300/0 conn(0x7f497c0cdf20 0x7f497c0705c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:05.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.397+0000 7f497b7fe700 1 --2- 172.21.15.39:0/536385020 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f497c15c420 0x7f497c070080 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f497c06fb30 tx=0x7f4970009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=132047200bba4485 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:05.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.397+0000 7f75bf891700 1 Processor -- start 2023-11-28T11:57:05.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.397+0000 7f75bf891700 1 -- start start 2023-11-28T11:57:05.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.397+0000 7f497affd700 1 -- 172.21.15.39:0/536385020 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4970011830 con 0x7f497c15c420 2023-11-28T11:57:05.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.397+0000 7f497affd700 1 -- 172.21.15.39:0/536385020 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4970011990 con 0x7f497c15c420 2023-11-28T11:57:05.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.397+0000 7f497affd700 1 -- 172.21.15.39:0/536385020 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4970011d20 con 0x7f497c15c420 2023-11-28T11:57:05.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.401+0000 7f75bf891700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f75b81534a0 0x7f75b815d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.401+0000 7f75bf891700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75b80b6200 0x7f75b8070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.401+0000 7f75bf891700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75b815d080 con 0x7f75b8160920 2023-11-28T11:57:05.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.401+0000 7f75bf891700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75b8153870 con 0x7f75b81534a0 2023-11-28T11:57:05.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.401+0000 7f75bf891700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b80b53c0 con 0x7f75b80b6200 2023-11-28T11:57:05.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.401+0000 7f75bd62d700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f75b81534a0 0x7f75b815d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.401+0000 7f75bd62d700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f75b81534a0 0x7f75b815d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45346/0 (socket says 172.21.15.39:45346) 2023-11-28T11:57:05.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.401+0000 7f75bd62d700 1 -- 172.21.15.39:0/3041859915 learned_addr learned my addr 172.21.15.39:0/3041859915 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:05.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.401+0000 7f49815a8700 1 -- 172.21.15.39:0/536385020 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f497c15c420 msgr2=0x7f497c070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.401+0000 7f49815a8700 1 --2- 172.21.15.39:0/536385020 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f497c15c420 0x7f497c070080 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f497c06fb30 tx=0x7f4970009b30 comp rx=0 tx=0).stop 2023-11-28T11:57:05.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.401+0000 7f75bd62d700 1 -- 172.21.15.39:0/3041859915 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75b80b6200 msgr2=0x7f75b8070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:05.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.401+0000 7f75bd62d700 1 --2- 172.21.15.39:0/3041859915 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75b80b6200 0x7f75b8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.401+0000 7f75bd62d700 1 -- 172.21.15.39:0/3041859915 >> v1:172.21.15.39:6789/0 conn(0x7f75b8160920 legacy=0x7f75b80b5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:05.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.401+0000 7f75bd62d700 1 -- 172.21.15.39:0/3041859915 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b80b56a0 con 0x7f75b81534a0 2023-11-28T11:57:05.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.401+0000 7f75bd62d700 1 --2- 172.21.15.39:0/3041859915 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f75b81534a0 0x7f75b815d510 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009910 tx=0x7f75b4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15edafe177b593d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:05.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.401+0000 7f75affff700 1 -- 172.21.15.39:0/3041859915 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b4004230 con 0x7f75b81534a0 2023-11-28T11:57:05.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.405+0000 7f68f17bf700 1 Processor -- start 2023-11-28T11:57:05.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.405+0000 7f68f17bf700 1 -- start start 2023-11-28T11:57:05.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.405+0000 7f75affff700 1 -- 172.21.15.39:0/3041859915 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b4004390 con 0x7f75b81534a0 2023-11-28T11:57:05.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.405+0000 7f75affff700 1 -- 172.21.15.39:0/3041859915 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b4004230 con 0x7f75b81534a0 2023-11-28T11:57:05.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.405+0000 7f49815a8700 1 -- 172.21.15.39:0/536385020 shutdown_connections 2023-11-28T11:57:05.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.405+0000 7f49815a8700 1 --2- 172.21.15.39:0/536385020 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f497c15c420 0x7f497c070080 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.405+0000 7f49815a8700 1 --2- 172.21.15.39:0/536385020 >> v2:172.21.15.39:3300/0 conn(0x7f497c0cdf20 0x7f497c0705c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.405+0000 7f49815a8700 1 --2- 172.21.15.39:0/536385020 >> v2:172.21.15.184:3300/0 conn(0x7f497c15c050 0x7f497c160700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.405+0000 7f49815a8700 1 -- 172.21.15.39:0/536385020 >> 172.21.15.39:0/536385020 conn(0x7f497c0b0f90 msgr2=0x7f497c0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:05.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.405+0000 7f75bf891700 1 -- 172.21.15.39:0/3041859915 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f75b81534a0 msgr2=0x7f75b815d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.405+0000 7f75bf891700 1 --2- 172.21.15.39:0/3041859915 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f75b81534a0 0x7f75b815d510 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009910 tx=0x7f75b4009c20 comp rx=0 tx=0).stop 2023-11-28T11:57:05.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.405+0000 7f49815a8700 1 -- 172.21.15.39:0/536385020 shutdown_connections 2023-11-28T11:57:05.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.405+0000 7f68f17bf700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f68ec15c640 0x7f68ec0d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.405+0000 7f68f17bf700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f68ec071aa0 0x7f68ec06d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.405+0000 7f68eaffd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f68ec15c640 0x7f68ec0d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.405+0000 7f68f17bf700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68ec06c600 con 0x7f68ec069e00 2023-11-28T11:57:05.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.405+0000 7f68f17bf700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68ec06cef0 con 0x7f68ec071aa0 2023-11-28T11:57:05.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.405+0000 7f68f17bf700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec0722f0 con 0x7f68ec15c640 2023-11-28T11:57:05.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.405+0000 7f68eaffd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f68ec15c640 0x7f68ec0d31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:48512/0 (socket says 172.21.15.39:48512) 2023-11-28T11:57:05.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.405+0000 7f68eaffd700 1 -- 172.21.15.39:0/1045766323 learned_addr learned my addr 172.21.15.39:0/1045766323 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:05.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.405+0000 7f68ea7fc700 1 --2- 172.21.15.39:0/1045766323 >> v2:172.21.15.184:3300/0 conn(0x7f68ec071aa0 0x7f68ec06d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.405+0000 7f68ea7fc700 1 -- 172.21.15.39:0/1045766323 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f68ec15c640 msgr2=0x7f68ec0d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:05.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.405+0000 7f68ea7fc700 1 --2- 172.21.15.39:0/1045766323 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f68ec15c640 0x7f68ec0d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.409+0000 7f68e9ffb700 1 -- 172.21.15.39:0/1045766323 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3716904523 0 0) 0x7f68ec06c600 con 0x7f68ec069e00 2023-11-28T11:57:05.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.405+0000 7f49815a8700 1 -- 172.21.15.39:0/536385020 wait complete. 2023-11-28T11:57:05.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.405+0000 7f75bf891700 1 -- 172.21.15.39:0/3041859915 shutdown_connections 2023-11-28T11:57:05.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.405+0000 7f75bf891700 1 --2- 172.21.15.39:0/3041859915 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75b80b6200 0x7f75b8070630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.405+0000 7f75bf891700 1 --2- 172.21.15.39:0/3041859915 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f75b81534a0 0x7f75b815d510 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.405+0000 7f75bf891700 1 -- 172.21.15.39:0/3041859915 >> 172.21.15.39:0/3041859915 conn(0x7f75b806bfc0 msgr2=0x7f75b806c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:05.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.405+0000 7f97dde34700 1 Processor -- start 2023-11-28T11:57:05.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.409+0000 7f97dde34700 1 -- start start 2023-11-28T11:57:05.414 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.409+0000 7f68ea7fc700 1 -- 172.21.15.39:0/1045766323 >> v1:172.21.15.39:6789/0 conn(0x7f68ec069e00 legacy=0x7f68ec0d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.414 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.409+0000 7f68ea7fc700 1 -- 172.21.15.39:0/1045766323 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ec15ca10 con 0x7f68ec071aa0 2023-11-28T11:57:05.414 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.409+0000 7f75bf891700 1 -- 172.21.15.39:0/3041859915 shutdown_connections 2023-11-28T11:57:05.415 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.409+0000 7f49815a8700 1 Processor -- start 2023-11-28T11:57:05.415 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.409+0000 7f49815a8700 1 -- start start 2023-11-28T11:57:05.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.409+0000 7f97dde34700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f97d8160b80 0x7f97d80b4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.409+0000 7f97dde34700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97d80ce830 0x7f97d806c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.409+0000 7f97dde34700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f97d806cd00 0x7f97d806ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.409+0000 7f97dde34700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97d806c330 con 0x7f97d806cd00 2023-11-28T11:57:05.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.409+0000 7f97dde34700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97d8160f50 con 0x7f97d8160b80 2023-11-28T11:57:05.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.409+0000 7f97dde34700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d80cecd0 con 0x7f97d80ce830 2023-11-28T11:57:05.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.409+0000 7f97d77fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f97d8160b80 0x7f97d80b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.409+0000 7f97d77fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f97d8160b80 0x7f97d80b4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:43074/0 (socket says 172.21.15.39:43074) 2023-11-28T11:57:05.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.409+0000 7f97d77fe700 1 -- 172.21.15.39:0/2326605394 learned_addr learned my addr 172.21.15.39:0/2326605394 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:05.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.409+0000 7f68ea7fc700 1 --2- 172.21.15.39:0/1045766323 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68ec071aa0 0x7f68ec06d310 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f68e4009d90 tx=0x7f68e400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6642b50c31ef2a9b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:05.417 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.409+0000 7f75bf891700 1 -- 172.21.15.39:0/3041859915 wait complete. 2023-11-28T11:57:05.417 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.409+0000 7f75bf891700 1 Processor -- start 2023-11-28T11:57:05.417 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f97d6ffd700 1 --2- 172.21.15.39:0/2326605394 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97d80ce830 0x7f97d806c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.417 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f97d77fe700 1 -- 172.21.15.39:0/2326605394 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97d80ce830 msgr2=0x7f97d806c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:05.417 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f97d77fe700 1 --2- 172.21.15.39:0/2326605394 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97d80ce830 0x7f97d806c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.418 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f97d77fe700 1 -- 172.21.15.39:0/2326605394 >> v2:172.21.15.39:3300/0 conn(0x7f97d806cd00 msgr2=0x7f97d806ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:05.418 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f97d77fe700 1 --2- 172.21.15.39:0/2326605394 >> v2:172.21.15.39:3300/0 conn(0x7f97d806cd00 0x7f97d806ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.418 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f97d77fe700 1 -- 172.21.15.39:0/2326605394 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d80cefb0 con 0x7f97d8160b80 2023-11-28T11:57:05.418 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f68e9ffb700 1 -- 172.21.15.39:0/1045766323 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e400e070 con 0x7f68ec071aa0 2023-11-28T11:57:05.418 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f49815a8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f497c0cdf20 0x7f497c1f1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.418 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f49815a8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f497c15c050 0x7f497c06c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f49815a8700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f497c15c420 0x7f497c0b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f49815a8700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497c0af780 con 0x7f497c15c420 2023-11-28T11:57:05.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f49815a8700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497c157c30 con 0x7f497c0cdf20 2023-11-28T11:57:05.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f68e9ffb700 1 -- 172.21.15.39:0/1045766323 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e400bb20 con 0x7f68ec071aa0 2023-11-28T11:57:05.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f49815a8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f497c157f10 con 0x7f497c15c050 2023-11-28T11:57:05.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f75bf891700 1 -- start start 2023-11-28T11:57:05.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f97d77fe700 1 --2- 172.21.15.39:0/2326605394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97d8160b80 0x7f97d80b4220 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f97d80710d0 tx=0x7f97cc009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6f135c350406473 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:05.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f68e9ffb700 1 -- 172.21.15.39:0/1045766323 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e4012430 con 0x7f68ec071aa0 2023-11-28T11:57:05.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f497b7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f497c15c050 0x7f497c06c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f497b7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f497c15c050 0x7f497c06c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:48538/0 (socket says 172.21.15.39:48538) 2023-11-28T11:57:05.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f497b7fe700 1 -- 172.21.15.39:0/2366707411 learned_addr learned my addr 172.21.15.39:0/2366707411 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:05.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f4980da7700 1 --2- 172.21.15.39:0/2366707411 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f497c15c420 0x7f497c0b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f97d67fc700 1 -- 172.21.15.39:0/2326605394 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc00b8a0 con 0x7f97d8160b80 2023-11-28T11:57:05.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f97d67fc700 1 -- 172.21.15.39:0/2326605394 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97cc00ba00 con 0x7f97d8160b80 2023-11-28T11:57:05.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f97d67fc700 1 -- 172.21.15.39:0/2326605394 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc00bd90 con 0x7f97d8160b80 2023-11-28T11:57:05.422 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f68f17bf700 1 -- 172.21.15.39:0/1045766323 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68ec071aa0 msgr2=0x7f68ec06d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.422 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f68f17bf700 1 --2- 172.21.15.39:0/1045766323 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68ec071aa0 0x7f68ec06d310 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f68e4009d90 tx=0x7f68e400b330 comp rx=0 tx=0).stop 2023-11-28T11:57:05.422 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f68f17bf700 1 -- 172.21.15.39:0/1045766323 shutdown_connections 2023-11-28T11:57:05.422 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f68f17bf700 1 --2- 172.21.15.39:0/1045766323 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68ec071aa0 0x7f68ec06d310 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.422 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f68f17bf700 1 --2- 172.21.15.39:0/1045766323 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f68ec15c640 0x7f68ec0d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.422 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f68f17bf700 1 -- 172.21.15.39:0/1045766323 >> 172.21.15.39:0/1045766323 conn(0x7f68ec0b6520 msgr2=0x7f68ec071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:05.423 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f97dde34700 1 -- 172.21.15.39:0/2326605394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97d8160b80 msgr2=0x7f97d80b4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.423 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f97dde34700 1 --2- 172.21.15.39:0/2326605394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97d8160b80 0x7f97d80b4220 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f97d80710d0 tx=0x7f97cc009bf0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.423 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f97dde34700 1 -- 172.21.15.39:0/2326605394 shutdown_connections 2023-11-28T11:57:05.423 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f97dde34700 1 --2- 172.21.15.39:0/2326605394 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97d80ce830 0x7f97d806c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.423 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f97dde34700 1 --2- 172.21.15.39:0/2326605394 >> v2:172.21.15.39:3300/0 conn(0x7f97d806cd00 0x7f97d806ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.423 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f97dde34700 1 --2- 172.21.15.39:0/2326605394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97d8160b80 0x7f97d80b4220 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.423 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f97dde34700 1 -- 172.21.15.39:0/2326605394 >> 172.21.15.39:0/2326605394 conn(0x7f97d80d2c00 msgr2=0x7f97d80d2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:05.423 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f75bf891700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75b80b6200 0x7f75b8150130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.423 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f75bf891700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f75b81534a0 0x7f75b8153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.424 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f75bf891700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75b8160920 0x7f75b8153f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.424 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f497b7fe700 1 -- 172.21.15.39:0/2366707411 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f497c0cdf20 msgr2=0x7f497c1f1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.424 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f497b7fe700 1 --2- 172.21.15.39:0/2366707411 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f497c0cdf20 0x7f497c1f1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.424 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f497b7fe700 1 -- 172.21.15.39:0/2366707411 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f497c15c420 msgr2=0x7f497c0b3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.424 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f497b7fe700 1 --2- 172.21.15.39:0/2366707411 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f497c15c420 0x7f497c0b3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.424 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f497b7fe700 1 -- 172.21.15.39:0/2366707411 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4974009b30 con 0x7f497c15c050 2023-11-28T11:57:05.424 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f497b7fe700 1 --2- 172.21.15.39:0/2366707411 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f497c15c050 0x7f497c06c140 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4970014040 tx=0x7f4970004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:05.425 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f97dde34700 1 -- 172.21.15.39:0/2326605394 shutdown_connections 2023-11-28T11:57:05.425 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f68f17bf700 1 -- 172.21.15.39:0/1045766323 shutdown_connections 2023-11-28T11:57:05.425 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f4978ff9700 1 -- 172.21.15.39:0/2366707411 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4970004590 con 0x7f497c15c050 2023-11-28T11:57:05.425 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f4978ff9700 1 -- 172.21.15.39:0/2366707411 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497001e070 con 0x7f497c15c050 2023-11-28T11:57:05.425 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f4978ff9700 1 -- 172.21.15.39:0/2366707411 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49700038c0 con 0x7f497c15c050 2023-11-28T11:57:05.426 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f75bd62d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75b80b6200 0x7f75b8150130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.426 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f75bd62d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75b80b6200 0x7f75b8150130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:48552/0 (socket says 172.21.15.39:48552) 2023-11-28T11:57:05.426 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.413+0000 7f97dde34700 1 -- 172.21.15.39:0/2326605394 wait complete. 2023-11-28T11:57:05.426 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.417+0000 7f75bce2c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f75b81534a0 0x7f75b8153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.427 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.417+0000 7f75bce2c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f75b81534a0 0x7f75b8153a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45370/0 (socket says 172.21.15.39:45370) 2023-11-28T11:57:05.427 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.417+0000 7f68f17bf700 1 -- 172.21.15.39:0/1045766323 wait complete. 2023-11-28T11:57:05.427 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.417+0000 7f75bd62d700 1 -- 172.21.15.39:0/3541042216 learned_addr learned my addr 172.21.15.39:0/3541042216 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:05.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.417+0000 7f49815a8700 1 -- 172.21.15.39:0/2366707411 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49700094b0 con 0x7f497c15c050 2023-11-28T11:57:05.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.417+0000 7f49815a8700 1 -- 172.21.15.39:0/2366707411 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f497c0cc6a0 con 0x7f497c15c050 2023-11-28T11:57:05.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.417+0000 7f75bf891700 1 -- 172.21.15.39:0/3541042216 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b8150a30 con 0x7f75b81534a0 2023-11-28T11:57:05.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.417+0000 7f75bf891700 1 -- 172.21.15.39:0/3541042216 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b81545b0 con 0x7f75b8160920 2023-11-28T11:57:05.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.417+0000 7f75bf891700 1 -- 172.21.15.39:0/3541042216 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b8154890 con 0x7f75b80b6200 2023-11-28T11:57:05.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.417+0000 7f75bde2e700 1 --2- 172.21.15.39:0/3541042216 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75b8160920 0x7f75b8153f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.429 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.417+0000 7f97dde34700 1 Processor -- start 2023-11-28T11:57:05.429 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.417+0000 7f97dde34700 1 -- start start 2023-11-28T11:57:05.429 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.421+0000 7f4978ff9700 1 -- 172.21.15.39:0/2366707411 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f497000f050 con 0x7f497c15c050 2023-11-28T11:57:05.429 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.421+0000 7f68f17bf700 1 Processor -- start 2023-11-28T11:57:05.430 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.421+0000 7f97dde34700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97d806cd00 0x7f97d8154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.430 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.421+0000 7f97dde34700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97d80ce830 0x7f97d81542b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.430 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.417+0000 7f75bce2c700 1 -- 172.21.15.39:0/3541042216 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75b80b6200 msgr2=0x7f75b8150130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.430 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.417+0000 7f75bce2c700 1 --2- 172.21.15.39:0/3541042216 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75b80b6200 0x7f75b8150130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.430 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.417+0000 7f75bce2c700 1 -- 172.21.15.39:0/3541042216 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75b8160920 msgr2=0x7f75b8153f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.430 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.417+0000 7f75bce2c700 1 --2- 172.21.15.39:0/3541042216 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75b8160920 0x7f75b8153f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.431 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.417+0000 7f75bce2c700 1 -- 172.21.15.39:0/3541042216 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b4009570 con 0x7f75b81534a0 2023-11-28T11:57:05.431 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.421+0000 7f97dde34700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97d8160b80 0x7f97d80b6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.431 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.421+0000 7f97dde34700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d80c7c80 con 0x7f97d8160b80 2023-11-28T11:57:05.431 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.421+0000 7f97dde34700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d80b5af0 con 0x7f97d80ce830 2023-11-28T11:57:05.431 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.421+0000 7f97dde34700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d80b6950 con 0x7f97d806cd00 2023-11-28T11:57:05.432 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.417+0000 7f75bce2c700 1 --2- 172.21.15.39:0/3541042216 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f75b81534a0 0x7f75b8153a40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f75a800c490 tx=0x7f75a8004660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:05.432 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.417+0000 7f75adffb700 1 -- 172.21.15.39:0/3541042216 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a8011790 con 0x7f75b81534a0 2023-11-28T11:57:05.432 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.417+0000 7f75adffb700 1 -- 172.21.15.39:0/3541042216 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a80118f0 con 0x7f75b81534a0 2023-11-28T11:57:05.432 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.417+0000 7f75adffb700 1 -- 172.21.15.39:0/3541042216 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a8011ca0 con 0x7f75b81534a0 2023-11-28T11:57:05.432 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.417+0000 7f75bf891700 1 -- 172.21.15.39:0/3541042216 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b815cd10 con 0x7f75b81534a0 2023-11-28T11:57:05.432 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.417+0000 7f75bf891700 1 -- 172.21.15.39:0/3541042216 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75b815ca30 con 0x7f75b81534a0 2023-11-28T11:57:05.432 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.421+0000 7f68f17bf700 1 -- start start 2023-11-28T11:57:05.433 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.421+0000 7f49815a8700 1 -- 172.21.15.39:0/2366707411 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f497c0cc3c0 con 0x7f497c15c050 2023-11-28T11:57:05.433 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.421+0000 7f97d77fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97d806cd00 0x7f97d8154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.433 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.421+0000 7f97d6ffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97d80ce830 0x7f97d81542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.433 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.421+0000 7f97d7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97d8160b80 0x7f97d80b6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.433 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.421+0000 7f97d77fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97d806cd00 0x7f97d8154f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:48556/0 (socket says 172.21.15.39:48556) 2023-11-28T11:57:05.433 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.421+0000 7f97d77fe700 1 -- 172.21.15.39:0/2286715694 learned_addr learned my addr 172.21.15.39:0/2286715694 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:05.433 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.421+0000 7f97d6ffd700 1 -- 172.21.15.39:0/2286715694 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97d806cd00 msgr2=0x7f97d8154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.433 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.421+0000 7f97d6ffd700 1 --2- 172.21.15.39:0/2286715694 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97d806cd00 0x7f97d8154f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.421+0000 7f97d6ffd700 1 -- 172.21.15.39:0/2286715694 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97d8160b80 msgr2=0x7f97d80b6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.421+0000 7f97d6ffd700 1 --2- 172.21.15.39:0/2286715694 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97d8160b80 0x7f97d80b6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.421+0000 7f97d6ffd700 1 -- 172.21.15.39:0/2286715694 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97cc009570 con 0x7f97d80ce830 2023-11-28T11:57:05.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.421+0000 7f75bf891700 1 -- 172.21.15.39:0/3541042216 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75b80b7f10 con 0x7f75b81534a0 2023-11-28T11:57:05.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.421+0000 7f4978ff9700 1 --2- 172.21.15.39:0/2366707411 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4968064f30 0x7f49680673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.421+0000 7f97d6ffd700 1 --2- 172.21.15.39:0/2286715694 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97d80ce830 0x7f97d81542b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f97d0007e30 tx=0x7f97d000e3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:05.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.421+0000 7f68f17bf700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f68ec069e00 0x7f68ec1fdf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.421+0000 7f4978ff9700 1 -- 172.21.15.39:0/2366707411 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4970082f40 con 0x7f497c15c050 2023-11-28T11:57:05.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.421+0000 7f97bffff700 1 -- 172.21.15.39:0/2286715694 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d000ed80 con 0x7f97d80ce830 2023-11-28T11:57:05.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.421+0000 7f97bffff700 1 -- 172.21.15.39:0/2286715694 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d0014420 con 0x7f97d80ce830 2023-11-28T11:57:05.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.421+0000 7f97bffff700 1 -- 172.21.15.39:0/2286715694 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d00147b0 con 0x7f97d80ce830 2023-11-28T11:57:05.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.421+0000 7f7589628700 1 Processor -- start 2023-11-28T11:57:05.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.425+0000 7f68f17bf700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f68ec071aa0 0x7f68ec0b3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.425+0000 7f497bfff700 1 --2- 172.21.15.39:0/2366707411 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4968064f30 0x7f49680673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.439 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.425+0000 7f68f17bf700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68ec15c640 0x7f68ec0d0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.439 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.425+0000 7f68f17bf700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec0b4150 con 0x7f68ec071aa0 2023-11-28T11:57:05.439 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.425+0000 7f68f17bf700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec15eba0 con 0x7f68ec15c640 2023-11-28T11:57:05.439 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.425+0000 7f68f17bf700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec0c7900 con 0x7f68ec069e00 2023-11-28T11:57:05.439 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.425+0000 7f97dde34700 1 -- 172.21.15.39:0/2286715694 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97d80b4760 con 0x7f97d80ce830 2023-11-28T11:57:05.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.421+0000 7f75adffb700 1 -- 172.21.15.39:0/3541042216 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f75a8010050 con 0x7f75b81534a0 2023-11-28T11:57:05.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.425+0000 7f75adffb700 1 --2- 172.21.15.39:0/3541042216 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f759c064f30 0x7f759c0673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.425+0000 7f68eb7fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68ec15c640 0x7f68ec0d0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.425+0000 7f68eb7fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68ec15c640 0x7f68ec0d0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:43108/0 (socket says 172.21.15.39:43108) 2023-11-28T11:57:05.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.425+0000 7f68eb7fe700 1 -- 172.21.15.39:0/4203523493 learned_addr learned my addr 172.21.15.39:0/4203523493 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:05.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.425+0000 7f75adffb700 1 -- 172.21.15.39:0/3541042216 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f75a800ce30 con 0x7f75b81534a0 2023-11-28T11:57:05.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.425+0000 7f97dde34700 1 -- 172.21.15.39:0/2286715694 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97d80cf290 con 0x7f97d80ce830 2023-11-28T11:57:05.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.425+0000 7f7589628700 1 -- start start 2023-11-28T11:57:05.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.425+0000 7f497bfff700 1 --2- 172.21.15.39:0/2366707411 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4968064f30 0x7f49680673e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f496c006b40 tx=0x7f496c006ad0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:05.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.425+0000 7f75bd62d700 1 --2- 172.21.15.39:0/3541042216 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f759c064f30 0x7f759c0673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.425+0000 7f68eaffd700 1 --2- 172.21.15.39:0/4203523493 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f68ec069e00 0x7f68ec1fdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.425+0000 7f68eb7fe700 1 -- 172.21.15.39:0/4203523493 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f68ec069e00 msgr2=0x7f68ec1fdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.425+0000 7f68eb7fe700 1 --2- 172.21.15.39:0/4203523493 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f68ec069e00 0x7f68ec1fdf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.425+0000 7f68eb7fe700 1 -- 172.21.15.39:0/4203523493 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f68ec071aa0 msgr2=0x7f68ec0b3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.425+0000 7f68eb7fe700 1 --2- 172.21.15.39:0/4203523493 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f68ec071aa0 0x7f68ec0b3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.425+0000 7f7589628700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f75840cac40 0x7f7584070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.425+0000 7f7589628700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f758406cb00 0x7f75840705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.425+0000 7f7589628700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f758406a450 con 0x7f75840cee60 2023-11-28T11:57:05.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.425+0000 7f7589628700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7584158760 con 0x7f75840cac40 2023-11-28T11:57:05.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.425+0000 7f7589628700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75840cca30 con 0x7f758406cb00 2023-11-28T11:57:05.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.425+0000 7f68eb7fe700 1 -- 172.21.15.39:0/4203523493 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e4009a70 con 0x7f68ec15c640 2023-11-28T11:57:05.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.425+0000 7f75bd62d700 1 --2- 172.21.15.39:0/3541042216 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f759c064f30 0x7f759c0673e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009150 tx=0x7f75b4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:05.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.425+0000 7f7583fff700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f75840cee60 0x7f75840cc320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:57368/0 (socket says 172.21.15.39:57368) 2023-11-28T11:57:05.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.425+0000 7f7583fff700 1 -- 172.21.15.39:0/1784526921 learned_addr learned my addr 172.21.15.39:0/1784526921 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:05.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.425+0000 7f75837fe700 1 --2- 172.21.15.39:0/1784526921 >> v2:172.21.15.39:3300/0 conn(0x7f75840cac40 0x7f7584070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.425+0000 7f7588e27700 1 --2- 172.21.15.39:0/1784526921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f758406cb00 0x7f75840705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.425+0000 7f68eb7fe700 1 --2- 172.21.15.39:0/4203523493 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68ec15c640 0x7f68ec0d0520 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f68e000c480 tx=0x7f68e000c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:05.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.429+0000 7f75837fe700 1 -- 172.21.15.39:0/1784526921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f758406cb00 msgr2=0x7f75840705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:05.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.429+0000 7f75837fe700 1 --2- 172.21.15.39:0/1784526921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f758406cb00 0x7f75840705c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.429+0000 7f75837fe700 1 -- 172.21.15.39:0/1784526921 >> v1:172.21.15.184:6789/0 conn(0x7f75840cee60 legacy=0x7f75840cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.429+0000 7f75837fe700 1 -- 172.21.15.39:0/1784526921 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75840ccc20 con 0x7f75840cac40 2023-11-28T11:57:05.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.429+0000 7f97dde34700 1 -- 172.21.15.39:0/2286715694 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97d80b48f0 con 0x7f97d80ce830 2023-11-28T11:57:05.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.429+0000 7f75837fe700 1 --2- 172.21.15.39:0/1784526921 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f75840cac40 0x7f7584070080 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7574009d90 tx=0x7f757400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d76207356c9002 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:05.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.429+0000 7f68d37fe700 1 -- 172.21.15.39:0/4203523493 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e00054e0 con 0x7f68ec15c640 2023-11-28T11:57:05.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.429+0000 7f68d37fe700 1 -- 172.21.15.39:0/4203523493 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e00036a0 con 0x7f68ec15c640 2023-11-28T11:57:05.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.429+0000 7f68d37fe700 1 -- 172.21.15.39:0/4203523493 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e0003a50 con 0x7f68ec15c640 2023-11-28T11:57:05.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.429+0000 7f68f17bf700 1 -- 172.21.15.39:0/4203523493 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68ec06c830 con 0x7f68ec15c640 2023-11-28T11:57:05.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.429+0000 7f68f17bf700 1 -- 172.21.15.39:0/4203523493 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68ec072010 con 0x7f68ec15c640 2023-11-28T11:57:05.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.429+0000 7f97bffff700 1 -- 172.21.15.39:0/2286715694 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f97d0012050 con 0x7f97d80ce830 2023-11-28T11:57:05.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.429+0000 7f68f17bf700 1 -- 172.21.15.39:0/4203523493 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68ec06cb10 con 0x7f68ec15c640 2023-11-28T11:57:05.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.433+0000 7f97bffff700 1 --2- 172.21.15.39:0/2286715694 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f97c4064f10 0x7f97c40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.433+0000 7f97bffff700 1 -- 172.21.15.39:0/2286715694 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f97d0082660 con 0x7f97d80ce830 2023-11-28T11:57:05.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.433+0000 7f68d37fe700 1 -- 172.21.15.39:0/4203523493 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f68e0019030 con 0x7f68ec15c640 2023-11-28T11:57:05.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.433+0000 7f4978ff9700 1 -- 172.21.15.39:0/2366707411 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f49700b3400 con 0x7f497c15c050 2023-11-28T11:57:05.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.433+0000 7f97d77fe700 1 --2- 172.21.15.39:0/2286715694 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f97c4064f10 0x7f97c40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.433+0000 7f68d37fe700 1 --2- 172.21.15.39:0/4203523493 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f68d8064ee0 0x7f68d8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.433+0000 7f68d37fe700 1 -- 172.21.15.39:0/4203523493 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f68e0081610 con 0x7f68ec15c640 2023-11-28T11:57:05.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.433+0000 7f75adffb700 1 -- 172.21.15.39:0/3541042216 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f75a80502a0 con 0x7f75b81534a0 2023-11-28T11:57:05.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.433+0000 7f97d77fe700 1 --2- 172.21.15.39:0/2286715694 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f97c4064f10 0x7f97c40673c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f97cc009150 tx=0x7f97cc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:05.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.433+0000 7f7582ffd700 1 -- 172.21.15.39:0/1784526921 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757400e070 con 0x7f75840cac40 2023-11-28T11:57:05.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.433+0000 7f68eaffd700 1 --2- 172.21.15.39:0/4203523493 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f68d8064ee0 0x7f68d8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.433+0000 7f7582ffd700 1 -- 172.21.15.39:0/1784526921 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7574003a40 con 0x7f75840cac40 2023-11-28T11:57:05.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.433+0000 7f7582ffd700 1 -- 172.21.15.39:0/1784526921 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7574003df0 con 0x7f75840cac40 2023-11-28T11:57:05.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.433+0000 7f7589628700 1 -- 172.21.15.39:0/1784526921 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f75840cac40 msgr2=0x7f7584070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.433+0000 7f7589628700 1 --2- 172.21.15.39:0/1784526921 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f75840cac40 0x7f7584070080 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7574009d90 tx=0x7f757400b330 comp rx=0 tx=0).stop 2023-11-28T11:57:05.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.433+0000 7f68eaffd700 1 --2- 172.21.15.39:0/4203523493 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f68d8064ee0 0x7f68d8067390 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f68dc011fd0 tx=0x7f68dc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:05.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.437+0000 7f7589628700 1 -- 172.21.15.39:0/1784526921 shutdown_connections 2023-11-28T11:57:05.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.437+0000 7f7589628700 1 --2- 172.21.15.39:0/1784526921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f758406cb00 0x7f75840705c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.452 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.437+0000 7f7589628700 1 --2- 172.21.15.39:0/1784526921 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f75840cac40 0x7f7584070080 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.452 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.437+0000 7f7589628700 1 -- 172.21.15.39:0/1784526921 >> 172.21.15.39:0/1784526921 conn(0x7f75840b0f90 msgr2=0x7f75840ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:05.452 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.437+0000 7f7589628700 1 -- 172.21.15.39:0/1784526921 shutdown_connections 2023-11-28T11:57:05.452 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.437+0000 7f7589628700 1 -- 172.21.15.39:0/1784526921 wait complete. 2023-11-28T11:57:05.452 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.437+0000 7f97bffff700 1 -- 172.21.15.39:0/2286715694 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f97d0050510 con 0x7f97d80ce830 2023-11-28T11:57:05.452 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.437+0000 7f7589628700 1 Processor -- start 2023-11-28T11:57:05.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.441+0000 7f7589628700 1 -- start start 2023-11-28T11:57:05.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.441+0000 7f68d37fe700 1 -- 172.21.15.39:0/4203523493 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f68e004f3d0 con 0x7f68ec15c640 2023-11-28T11:57:05.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.441+0000 7f7589628700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f758406cb00 0x7f75840b1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.441+0000 7f7589628700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f75840cac40 0x7f758415b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.441+0000 7f7589628700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75840cee60 0x7f7584155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.441+0000 7f7583fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f758406cb00 0x7f75840b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.441+0000 7f7589628700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75840b25c0 con 0x7f75840cac40 2023-11-28T11:57:05.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.441+0000 7f7589628700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75840b1d20 con 0x7f758406cb00 2023-11-28T11:57:05.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.441+0000 7f7589628700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75840b2000 con 0x7f75840cee60 2023-11-28T11:57:05.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.441+0000 7f7588e27700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75840cee60 0x7f7584155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.441+0000 7f7588e27700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75840cee60 0x7f7584155b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:48578/0 (socket says 172.21.15.39:48578) 2023-11-28T11:57:05.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.441+0000 7f7588e27700 1 -- 172.21.15.39:0/1553231712 learned_addr learned my addr 172.21.15.39:0/1553231712 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:05.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.445+0000 7f75837fe700 1 --2- 172.21.15.39:0/1553231712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f75840cac40 0x7f758415b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.445+0000 7f7588e27700 1 -- 172.21.15.39:0/1553231712 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f758406cb00 msgr2=0x7f75840b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.445+0000 7f7588e27700 1 --2- 172.21.15.39:0/1553231712 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f758406cb00 0x7f75840b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.445+0000 7f7588e27700 1 -- 172.21.15.39:0/1553231712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f75840cac40 msgr2=0x7f758415b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.445+0000 7f7583fff700 1 --2- 172.21.15.39:0/1553231712 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f758406cb00 0x7f75840b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:57:05.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.445+0000 7f7588e27700 1 --2- 172.21.15.39:0/1553231712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f75840cac40 0x7f758415b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.445+0000 7f7588e27700 1 -- 172.21.15.39:0/1553231712 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7574009a70 con 0x7f75840cee60 2023-11-28T11:57:05.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.445+0000 7f75837fe700 1 --2- 172.21.15.39:0/1553231712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f75840cac40 0x7f758415b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:57:05.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.445+0000 7f7588e27700 1 --2- 172.21.15.39:0/1553231712 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75840cee60 0x7f7584155b30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f757c00eb60 tx=0x7f757c00ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:05.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.445+0000 7f7580ff9700 1 -- 172.21.15.39:0/1553231712 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c009740 con 0x7f75840cee60 2023-11-28T11:57:05.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.445+0000 7f7580ff9700 1 -- 172.21.15.39:0/1553231712 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757c00c850 con 0x7f75840cee60 2023-11-28T11:57:05.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.445+0000 7f7580ff9700 1 -- 172.21.15.39:0/1553231712 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c00cbe0 con 0x7f75840cee60 2023-11-28T11:57:05.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.445+0000 7f7589628700 1 -- 172.21.15.39:0/1553231712 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f758406a0e0 con 0x7f75840cee60 2023-11-28T11:57:05.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.445+0000 7f7589628700 1 -- 172.21.15.39:0/1553231712 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7584069e00 con 0x7f75840cee60 2023-11-28T11:57:05.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.449+0000 7f7589628700 1 -- 172.21.15.39:0/1553231712 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75840c8da0 con 0x7f75840cee60 2023-11-28T11:57:05.457 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.449+0000 7f7580ff9700 1 -- 172.21.15.39:0/1553231712 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f757c019030 con 0x7f75840cee60 2023-11-28T11:57:05.457 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.453+0000 7f7580ff9700 1 --2- 172.21.15.39:0/1553231712 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7564064f30 0x7f75640673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:05.457 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.453+0000 7f7580ff9700 1 -- 172.21.15.39:0/1553231712 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f757c05bce0 con 0x7f75840cee60 2023-11-28T11:57:05.458 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.453+0000 7f7583fff700 1 --2- 172.21.15.39:0/1553231712 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7564064f30 0x7f75640673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:05.460 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.453+0000 7f7583fff700 1 --2- 172.21.15.39:0/1553231712 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7564064f30 0x7f75640673e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f756c005fd0 tx=0x7f756c0058a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:05.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.461+0000 7f7580ff9700 1 -- 172.21.15.39:0/1553231712 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f757c0506c0 con 0x7f75840cee60 2023-11-28T11:57:05.652 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.645+0000 7ff48d030700 1 -- 172.21.15.39:0/701563582 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7ff488073cb0 con 0x7ff48815c420 2023-11-28T11:57:05.652 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.649+0000 7ff46f7fe700 1 -- 172.21.15.39:0/701563582 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff480053ba0 con 0x7ff48815c420 2023-11-28T11:57:05.653 INFO:teuthology.orchestra.run.smithi039.stdout:64424509450 2023-11-28T11:57:05.660 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.657+0000 7ff48d030700 1 -- 172.21.15.39:0/701563582 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff474064ee0 msgr2=0x7ff474067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.660 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.657+0000 7ff48d030700 1 --2- 172.21.15.39:0/701563582 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff474064ee0 0x7ff474067390 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff478009a00 tx=0x7ff478008040 comp rx=0 tx=0).stop 2023-11-28T11:57:05.661 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.657+0000 7ff48d030700 1 -- 172.21.15.39:0/701563582 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff48815c420 msgr2=0x7ff48806c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.661 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.657+0000 7ff48d030700 1 --2- 172.21.15.39:0/701563582 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff48815c420 0x7ff48806c9b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff480007e90 tx=0x7ff48000e3c0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.661 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.657+0000 7ff48d030700 1 -- 172.21.15.39:0/701563582 shutdown_connections 2023-11-28T11:57:05.661 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.657+0000 7ff48d030700 1 --2- 172.21.15.39:0/701563582 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff48815c420 0x7ff48806c9b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.661 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.657+0000 7ff48d030700 1 --2- 172.21.15.39:0/701563582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff48815c050 0x7ff48806c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.661 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.657+0000 7ff48d030700 1 --2- 172.21.15.39:0/701563582 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff474064ee0 0x7ff474067390 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.661 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.657+0000 7ff48d030700 1 --2- 172.21.15.39:0/701563582 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4880cdf20 0x7ff4881fe940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.657+0000 7ff48d030700 1 -- 172.21.15.39:0/701563582 >> 172.21.15.39:0/701563582 conn(0x7ff4880b0f90 msgr2=0x7ff4880acea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:05.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.657+0000 7ff48d030700 1 -- 172.21.15.39:0/701563582 shutdown_connections 2023-11-28T11:57:05.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.657+0000 7ff48d030700 1 -- 172.21.15.39:0/701563582 wait complete. 2023-11-28T11:57:05.688 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.4 2023-11-28T11:57:05.688 DEBUG:teuthology.parallel:result is None 2023-11-28T11:57:05.692 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.689+0000 7fb7edab8700 1 -- 172.21.15.39:0/2422332443 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fb7e8073cb0 con 0x7fb7e80add80 2023-11-28T11:57:05.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.689+0000 7fb7e57fa700 1 -- 172.21.15.39:0/2422332443 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb7e0018090 con 0x7fb7e80add80 2023-11-28T11:57:05.696 INFO:teuthology.orchestra.run.smithi039.stdout:64424509450 2023-11-28T11:57:05.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.693+0000 7fb7edab8700 1 -- 172.21.15.39:0/2422332443 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb7d4064f60 msgr2=0x7fb7d4067410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.693+0000 7fb7edab8700 1 --2- 172.21.15.39:0/2422332443 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb7d4064f60 0x7fb7d4067410 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80ccc70 tx=0x7fb7d801c040 comp rx=0 tx=0).stop 2023-11-28T11:57:05.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.693+0000 7fb7edab8700 1 -- 172.21.15.39:0/2422332443 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7e80add80 msgr2=0x7fb7e80ae700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.693+0000 7fb7edab8700 1 --2- 172.21.15.39:0/2422332443 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7e80add80 0x7fb7e80ae700 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000ccb0 tx=0x7fb7e000a060 comp rx=0 tx=0).stop 2023-11-28T11:57:05.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.693+0000 7fb7edab8700 1 -- 172.21.15.39:0/2422332443 shutdown_connections 2023-11-28T11:57:05.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.693+0000 7fb7edab8700 1 --2- 172.21.15.39:0/2422332443 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb7d4064f60 0x7fb7d4067410 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.693+0000 7fb7edab8700 1 --2- 172.21.15.39:0/2422332443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7e80cdf20 0x7fb7e806ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.693+0000 7fb7edab8700 1 --2- 172.21.15.39:0/2422332443 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7e80add80 0x7fb7e80ae700 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.693+0000 7fb7edab8700 1 --2- 172.21.15.39:0/2422332443 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7e80ad910 0x7fb7e8088bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.693+0000 7fb7edab8700 1 -- 172.21.15.39:0/2422332443 >> 172.21.15.39:0/2422332443 conn(0x7fb7e80b0f90 msgr2=0x7fb7e806adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:05.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.693+0000 7fb7edab8700 1 -- 172.21.15.39:0/2422332443 shutdown_connections 2023-11-28T11:57:05.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.693+0000 7fb7edab8700 1 -- 172.21.15.39:0/2422332443 wait complete. 2023-11-28T11:57:05.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.701+0000 7f2ff759e700 1 -- 172.21.15.39:0/735413347 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2ff8162b80 con 0x7f2ff8160420 2023-11-28T11:57:05.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.701+0000 7f2fe6ffd700 1 -- 172.21.15.39:0/735413347 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2fe804f9f0 con 0x7f2ff8160420 2023-11-28T11:57:05.708 INFO:teuthology.orchestra.run.smithi039.stdout:60129542154 2023-11-28T11:57:05.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.705+0000 7f2ff759e700 1 -- 172.21.15.39:0/735413347 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2fd8064ee0 msgr2=0x7f2fd8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.711 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.705+0000 7f2ff759e700 1 --2- 172.21.15.39:0/735413347 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2fd8064ee0 0x7f2fd8067390 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2fec0090b0 tx=0x7f2fec008030 comp rx=0 tx=0).stop 2023-11-28T11:57:05.711 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.705+0000 7f2ff759e700 1 -- 172.21.15.39:0/735413347 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ff8160420 msgr2=0x7f2ff8162ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.711 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.705+0000 7f2ff759e700 1 --2- 172.21.15.39:0/735413347 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ff8160420 0x7f2ff8162ea0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2fe800c3e0 tx=0x7f2fe800c6f0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.711 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.705+0000 7f2ff759e700 1 -- 172.21.15.39:0/735413347 shutdown_connections 2023-11-28T11:57:05.711 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.705+0000 7f2ff759e700 1 --2- 172.21.15.39:0/735413347 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2fd8064ee0 0x7f2fd8067390 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.705+0000 7f2ff759e700 1 --2- 172.21.15.39:0/735413347 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ff8160420 0x7f2ff8162ea0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.705+0000 7f2ff759e700 1 --2- 172.21.15.39:0/735413347 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ff80cdf20 0x7f2ff80b24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.705+0000 7f2ff759e700 1 --2- 172.21.15.39:0/735413347 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ff80c8da0 0x7f2ff81fd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.705+0000 7f2ff759e700 1 -- 172.21.15.39:0/735413347 >> 172.21.15.39:0/735413347 conn(0x7f2ff80b0f90 msgr2=0x7f2ff80ae2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:05.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.705+0000 7f2ff759e700 1 -- 172.21.15.39:0/735413347 shutdown_connections 2023-11-28T11:57:05.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.705+0000 7f2ff759e700 1 -- 172.21.15.39:0/735413347 wait complete. 2023-11-28T11:57:05.723 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.5 2023-11-28T11:57:05.723 DEBUG:teuthology.parallel:result is None 2023-11-28T11:57:05.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.0 2023-11-28T11:57:05.737 DEBUG:teuthology.parallel:result is None 2023-11-28T11:57:05.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.737+0000 7f97dde34700 1 -- 172.21.15.39:0/2286715694 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f97d80b6ac0 con 0x7f97d80ce830 2023-11-28T11:57:05.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.737+0000 7f97bffff700 1 -- 172.21.15.39:0/2286715694 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f97d0053b30 con 0x7f97d80ce830 2023-11-28T11:57:05.742 INFO:teuthology.orchestra.run.smithi039.stdout:64424509450 2023-11-28T11:57:05.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.741+0000 7f97dde34700 1 -- 172.21.15.39:0/2286715694 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f97c4064f10 msgr2=0x7f97c40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.741+0000 7f97dde34700 1 --2- 172.21.15.39:0/2286715694 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f97c4064f10 0x7f97c40673c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f97cc009150 tx=0x7f97cc008030 comp rx=0 tx=0).stop 2023-11-28T11:57:05.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.741+0000 7f97dde34700 1 -- 172.21.15.39:0/2286715694 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97d80ce830 msgr2=0x7f97d81542b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.741+0000 7f97dde34700 1 --2- 172.21.15.39:0/2286715694 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97d80ce830 0x7f97d81542b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f97d0007e30 tx=0x7f97d000e3c0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.741+0000 7f97dde34700 1 -- 172.21.15.39:0/2286715694 shutdown_connections 2023-11-28T11:57:05.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.741+0000 7f97dde34700 1 --2- 172.21.15.39:0/2286715694 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97d8160b80 0x7f97d80b6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.741+0000 7f97dde34700 1 --2- 172.21.15.39:0/2286715694 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f97c4064f10 0x7f97c40673c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.741+0000 7f97dde34700 1 --2- 172.21.15.39:0/2286715694 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97d80ce830 0x7f97d81542b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.741+0000 7f97dde34700 1 --2- 172.21.15.39:0/2286715694 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97d806cd00 0x7f97d8154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.741+0000 7f97dde34700 1 -- 172.21.15.39:0/2286715694 >> 172.21.15.39:0/2286715694 conn(0x7f97d80d2c00 msgr2=0x7f97d80d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:05.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.741+0000 7f97dde34700 1 -- 172.21.15.39:0/2286715694 shutdown_connections 2023-11-28T11:57:05.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.741+0000 7f97dde34700 1 -- 172.21.15.39:0/2286715694 wait complete. 2023-11-28T11:57:05.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.745+0000 7f49815a8700 1 -- 172.21.15.39:0/2366707411 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f497c0cc980 con 0x7f497c15c050 2023-11-28T11:57:05.751 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.745+0000 7f4978ff9700 1 -- 172.21.15.39:0/2366707411 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4970015020 con 0x7f497c15c050 2023-11-28T11:57:05.751 INFO:teuthology.orchestra.run.smithi039.stdout:64424509450 2023-11-28T11:57:05.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.749+0000 7f49815a8700 1 -- 172.21.15.39:0/2366707411 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4968064f30 msgr2=0x7f49680673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.754 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.749+0000 7f49815a8700 1 --2- 172.21.15.39:0/2366707411 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4968064f30 0x7f49680673e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f496c006b40 tx=0x7f496c006ad0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.754 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.749+0000 7f49815a8700 1 -- 172.21.15.39:0/2366707411 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f497c15c050 msgr2=0x7f497c06c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.754 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.749+0000 7f49815a8700 1 --2- 172.21.15.39:0/2366707411 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f497c15c050 0x7f497c06c140 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4970014040 tx=0x7f4970004770 comp rx=0 tx=0).stop 2023-11-28T11:57:05.754 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.749+0000 7f49815a8700 1 -- 172.21.15.39:0/2366707411 shutdown_connections 2023-11-28T11:57:05.754 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.749+0000 7f49815a8700 1 --2- 172.21.15.39:0/2366707411 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f497c15c420 0x7f497c0b3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.754 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.749+0000 7f49815a8700 1 --2- 172.21.15.39:0/2366707411 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f497c15c050 0x7f497c06c140 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.754 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.749+0000 7f49815a8700 1 --2- 172.21.15.39:0/2366707411 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4968064f30 0x7f49680673e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.754 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.749+0000 7f49815a8700 1 --2- 172.21.15.39:0/2366707411 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f497c0cdf20 0x7f497c1f1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.754 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.749+0000 7f49815a8700 1 -- 172.21.15.39:0/2366707411 >> 172.21.15.39:0/2366707411 conn(0x7f497c0b0f90 msgr2=0x7f497c0b1640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:05.755 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.749+0000 7f49815a8700 1 -- 172.21.15.39:0/2366707411 shutdown_connections 2023-11-28T11:57:05.755 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.749+0000 7f49815a8700 1 -- 172.21.15.39:0/2366707411 wait complete. 2023-11-28T11:57:05.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.761+0000 7f75bf891700 1 -- 172.21.15.39:0/3541042216 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f75b80726c0 con 0x7f75b81534a0 2023-11-28T11:57:05.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.765+0000 7f75adffb700 1 -- 172.21.15.39:0/3541042216 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f75a8050440 con 0x7f75b81534a0 2023-11-28T11:57:05.769 INFO:teuthology.orchestra.run.smithi039.stdout:64424509450 2023-11-28T11:57:05.771 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.1 2023-11-28T11:57:05.771 DEBUG:teuthology.parallel:result is None 2023-11-28T11:57:05.772 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.3 2023-11-28T11:57:05.772 DEBUG:teuthology.parallel:result is None 2023-11-28T11:57:05.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.769+0000 7f75bf891700 1 -- 172.21.15.39:0/3541042216 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f759c064f30 msgr2=0x7f759c0673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.769+0000 7f75bf891700 1 --2- 172.21.15.39:0/3541042216 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f759c064f30 0x7f759c0673e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009150 tx=0x7f75b4008030 comp rx=0 tx=0).stop 2023-11-28T11:57:05.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.769+0000 7f75bf891700 1 -- 172.21.15.39:0/3541042216 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f75b81534a0 msgr2=0x7f75b8153a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.769+0000 7f75bf891700 1 --2- 172.21.15.39:0/3541042216 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f75b81534a0 0x7f75b8153a40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f75a800c490 tx=0x7f75a8004660 comp rx=0 tx=0).stop 2023-11-28T11:57:05.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.769+0000 7f75bf891700 1 -- 172.21.15.39:0/3541042216 shutdown_connections 2023-11-28T11:57:05.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.769+0000 7f75bf891700 1 --2- 172.21.15.39:0/3541042216 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f759c064f30 0x7f759c0673e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.769+0000 7f75bf891700 1 --2- 172.21.15.39:0/3541042216 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75b8160920 0x7f75b8153f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.769+0000 7f75bf891700 1 --2- 172.21.15.39:0/3541042216 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f75b81534a0 0x7f75b8153a40 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.769+0000 7f75bf891700 1 --2- 172.21.15.39:0/3541042216 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75b80b6200 0x7f75b8150130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.769+0000 7f75bf891700 1 -- 172.21.15.39:0/3541042216 >> 172.21.15.39:0/3541042216 conn(0x7f75b806bfc0 msgr2=0x7f75b81519f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:05.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.769+0000 7f75bf891700 1 -- 172.21.15.39:0/3541042216 shutdown_connections 2023-11-28T11:57:05.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.769+0000 7f75bf891700 1 -- 172.21.15.39:0/3541042216 wait complete. 2023-11-28T11:57:05.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.773+0000 7f68f17bf700 1 -- 172.21.15.39:0/4203523493 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f68ec073cb0 con 0x7f68ec15c640 2023-11-28T11:57:05.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.773+0000 7f68d37fe700 1 -- 172.21.15.39:0/4203523493 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f68e0017090 con 0x7f68ec15c640 2023-11-28T11:57:05.778 INFO:teuthology.orchestra.run.smithi039.stdout:60129542154 2023-11-28T11:57:05.782 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.777+0000 7f68f17bf700 1 -- 172.21.15.39:0/4203523493 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f68d8064ee0 msgr2=0x7f68d8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.777+0000 7f68f17bf700 1 --2- 172.21.15.39:0/4203523493 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f68d8064ee0 0x7f68d8067390 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f68dc011fd0 tx=0x7f68dc008040 comp rx=0 tx=0).stop 2023-11-28T11:57:05.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.777+0000 7f68f17bf700 1 -- 172.21.15.39:0/4203523493 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68ec15c640 msgr2=0x7f68ec0d0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.777+0000 7f68f17bf700 1 --2- 172.21.15.39:0/4203523493 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68ec15c640 0x7f68ec0d0520 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f68e000c480 tx=0x7f68e000c840 comp rx=0 tx=0).stop 2023-11-28T11:57:05.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.777+0000 7f68f17bf700 1 -- 172.21.15.39:0/4203523493 shutdown_connections 2023-11-28T11:57:05.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.777+0000 7f68f17bf700 1 --2- 172.21.15.39:0/4203523493 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f68d8064ee0 0x7f68d8067390 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.777+0000 7f68f17bf700 1 --2- 172.21.15.39:0/4203523493 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68ec15c640 0x7f68ec0d0520 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.777+0000 7f68f17bf700 1 --2- 172.21.15.39:0/4203523493 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f68ec071aa0 0x7f68ec0b3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.777+0000 7f68f17bf700 1 --2- 172.21.15.39:0/4203523493 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f68ec069e00 0x7f68ec1fdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.777+0000 7f68f17bf700 1 -- 172.21.15.39:0/4203523493 >> 172.21.15.39:0/4203523493 conn(0x7f68ec0b6520 msgr2=0x7f68ec06a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:05.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.777+0000 7f68f17bf700 1 -- 172.21.15.39:0/4203523493 shutdown_connections 2023-11-28T11:57:05.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.777+0000 7f68f17bf700 1 -- 172.21.15.39:0/4203523493 wait complete. 2023-11-28T11:57:05.786 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.781+0000 7f7589628700 1 -- 172.21.15.39:0/1553231712 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f7584073cb0 con 0x7f75840cee60 2023-11-28T11:57:05.786 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.781+0000 7f7580ff9700 1 -- 172.21.15.39:0/1553231712 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f757c017020 con 0x7f75840cee60 2023-11-28T11:57:05.787 INFO:teuthology.orchestra.run.smithi039.stdout:64424509450 2023-11-28T11:57:05.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.785+0000 7f7589628700 1 -- 172.21.15.39:0/1553231712 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7564064f30 msgr2=0x7f75640673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.785+0000 7f7589628700 1 --2- 172.21.15.39:0/1553231712 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7564064f30 0x7f75640673e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f756c005fd0 tx=0x7f756c0058a0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.785+0000 7f7589628700 1 -- 172.21.15.39:0/1553231712 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75840cee60 msgr2=0x7f7584155b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:05.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.785+0000 7f7589628700 1 --2- 172.21.15.39:0/1553231712 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75840cee60 0x7f7584155b30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f757c00eb60 tx=0x7f757c00ee70 comp rx=0 tx=0).stop 2023-11-28T11:57:05.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.785+0000 7f7589628700 1 -- 172.21.15.39:0/1553231712 shutdown_connections 2023-11-28T11:57:05.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.785+0000 7f7589628700 1 --2- 172.21.15.39:0/1553231712 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75840cee60 0x7f7584155b30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.785+0000 7f7589628700 1 --2- 172.21.15.39:0/1553231712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f75840cac40 0x7f758415b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.785+0000 7f7589628700 1 --2- 172.21.15.39:0/1553231712 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7564064f30 0x7f75640673e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.785+0000 7f7589628700 1 --2- 172.21.15.39:0/1553231712 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f758406cb00 0x7f75840b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:05.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.785+0000 7f7589628700 1 -- 172.21.15.39:0/1553231712 >> 172.21.15.39:0/1553231712 conn(0x7f75840b0f90 msgr2=0x7f7584157d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:05.791 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.6 2023-11-28T11:57:05.791 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.785+0000 7f7589628700 1 -- 172.21.15.39:0/1553231712 shutdown_connections 2023-11-28T11:57:05.792 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:05.785+0000 7f7589628700 1 -- 172.21.15.39:0/1553231712 wait complete. 2023-11-28T11:57:05.792 DEBUG:teuthology.parallel:result is None 2023-11-28T11:57:05.804 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.2 2023-11-28T11:57:05.804 DEBUG:teuthology.parallel:result is None 2023-11-28T11:57:05.811 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.7 2023-11-28T11:57:05.811 DEBUG:teuthology.parallel:result is None 2023-11-28T11:57:05.812 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-28T11:57:05.812 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:57:06.036 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.033+0000 7fdeb359e700 1 Processor -- start 2023-11-28T11:57:06.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.033+0000 7fdeb359e700 1 -- start start 2023-11-28T11:57:06.040 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.033+0000 7fdeb359e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fdeb415c640 0x7fdeb40d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:06.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.033+0000 7fdeb359e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fdeb4069e00 0x7fdeb406a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:06.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.033+0000 7fdeb359e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeb406c600 con 0x7fdeb4071aa0 2023-11-28T11:57:06.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.033+0000 7fdeb359e700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeb406cef0 con 0x7fdeb415c640 2023-11-28T11:57:06.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.033+0000 7fdeb359e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeb406a7c0 con 0x7fdeb4069e00 2023-11-28T11:57:06.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.033+0000 7fdeb259c700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fdeb415c640 0x7fdeb40d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:06.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.033+0000 7fdeb259c700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fdeb415c640 0x7fdeb40d31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45406/0 (socket says 172.21.15.39:45406) 2023-11-28T11:57:06.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.033+0000 7fdeb259c700 1 -- 172.21.15.39:0/3212358153 learned_addr learned my addr 172.21.15.39:0/3212358153 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:06.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.033+0000 7fdeb259c700 1 -- 172.21.15.39:0/3212358153 >> v2:172.21.15.184:3300/0 conn(0x7fdeb4069e00 msgr2=0x7fdeb406a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:06.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.033+0000 7fdeb259c700 1 --2- 172.21.15.39:0/3212358153 >> v2:172.21.15.184:3300/0 conn(0x7fdeb4069e00 0x7fdeb406a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:06.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.033+0000 7fdeb259c700 1 -- 172.21.15.39:0/3212358153 >> v1:172.21.15.184:6789/0 conn(0x7fdeb4071aa0 legacy=0x7fdeb406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:06.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.033+0000 7fdeb259c700 1 -- 172.21.15.39:0/3212358153 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb40722f0 con 0x7fdeb415c640 2023-11-28T11:57:06.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.033+0000 7fdeb259c700 1 --2- 172.21.15.39:0/3212358153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdeb415c640 0x7fdeb40d31e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdeb406ed60 tx=0x7fdea4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5250cf172555fcae server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:06.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.033+0000 7fdeb159a700 1 -- 172.21.15.39:0/3212358153 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea4004230 con 0x7fdeb415c640 2023-11-28T11:57:06.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.037+0000 7fdeb159a700 1 -- 172.21.15.39:0/3212358153 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea4004390 con 0x7fdeb415c640 2023-11-28T11:57:06.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.037+0000 7fdeb159a700 1 -- 172.21.15.39:0/3212358153 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea40036c0 con 0x7fdeb415c640 2023-11-28T11:57:06.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.037+0000 7fdeb359e700 1 -- 172.21.15.39:0/3212358153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdeb415c640 msgr2=0x7fdeb40d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:06.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.037+0000 7fdeb359e700 1 --2- 172.21.15.39:0/3212358153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdeb415c640 0x7fdeb40d31e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdeb406ed60 tx=0x7fdea4009bf0 comp rx=0 tx=0).stop 2023-11-28T11:57:06.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.037+0000 7fdeb359e700 1 -- 172.21.15.39:0/3212358153 shutdown_connections 2023-11-28T11:57:06.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.037+0000 7fdeb359e700 1 --2- 172.21.15.39:0/3212358153 >> v2:172.21.15.184:3300/0 conn(0x7fdeb4069e00 0x7fdeb406a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:06.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.037+0000 7fdeb359e700 1 --2- 172.21.15.39:0/3212358153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdeb415c640 0x7fdeb40d31e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:06.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.037+0000 7fdeb359e700 1 -- 172.21.15.39:0/3212358153 >> 172.21.15.39:0/3212358153 conn(0x7fdeb40b6520 msgr2=0x7fdeb4071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:06.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.037+0000 7fdeb359e700 1 -- 172.21.15.39:0/3212358153 shutdown_connections 2023-11-28T11:57:06.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.037+0000 7fdeb359e700 1 -- 172.21.15.39:0/3212358153 wait complete. 2023-11-28T11:57:06.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.041+0000 7fdeb359e700 1 Processor -- start 2023-11-28T11:57:06.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.041+0000 7fdeb359e700 1 -- start start 2023-11-28T11:57:06.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.041+0000 7fdeb359e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdeb4069e00 0x7fdeb40b3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:06.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.041+0000 7fdeb359e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdeb4071aa0 0x7fdeb409c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:06.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.041+0000 7fdeb359e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdeb415c640 0x7fdeb4159f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:06.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.041+0000 7fdeb359e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb409f670 con 0x7fdeb4071aa0 2023-11-28T11:57:06.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.041+0000 7fdeb359e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb409f950 con 0x7fdeb4069e00 2023-11-28T11:57:06.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.041+0000 7fdeb359e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb409fc30 con 0x7fdeb415c640 2023-11-28T11:57:06.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.041+0000 7fdeb1d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdeb4071aa0 0x7fdeb409c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:06.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.041+0000 7fdeb1d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdeb4071aa0 0x7fdeb409c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45414/0 (socket says 172.21.15.39:45414) 2023-11-28T11:57:06.050 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.041+0000 7fdeb1d9b700 1 -- 172.21.15.39:0/2536147177 learned_addr learned my addr 172.21.15.39:0/2536147177 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:06.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.041+0000 7fdeb259c700 1 --2- 172.21.15.39:0/2536147177 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdeb4069e00 0x7fdeb40b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:06.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.041+0000 7fdeb2d9d700 1 --2- 172.21.15.39:0/2536147177 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdeb415c640 0x7fdeb4159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:06.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.045+0000 7fdeb1d9b700 1 -- 172.21.15.39:0/2536147177 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdeb415c640 msgr2=0x7fdeb4159f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:06.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.045+0000 7fdeb1d9b700 1 --2- 172.21.15.39:0/2536147177 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdeb415c640 0x7fdeb4159f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:06.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.045+0000 7fdeb1d9b700 1 -- 172.21.15.39:0/2536147177 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdeb4069e00 msgr2=0x7fdeb40b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:06.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.045+0000 7fdeb1d9b700 1 --2- 172.21.15.39:0/2536147177 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdeb4069e00 0x7fdeb40b3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:06.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.045+0000 7fdeb1d9b700 1 -- 172.21.15.39:0/2536147177 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea4009570 con 0x7fdeb4071aa0 2023-11-28T11:57:06.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.045+0000 7fdeb2d9d700 1 --2- 172.21.15.39:0/2536147177 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdeb415c640 0x7fdeb4159f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:57:06.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.045+0000 7fdeb1d9b700 1 --2- 172.21.15.39:0/2536147177 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdeb4071aa0 0x7fdeb409c770 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdea800b4a0 tx=0x7fdea800b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:06.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.045+0000 7fdea2ffd700 1 -- 172.21.15.39:0/2536147177 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea8011830 con 0x7fdeb4071aa0 2023-11-28T11:57:06.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.045+0000 7fdea2ffd700 1 -- 172.21.15.39:0/2536147177 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea80119b0 con 0x7fdeb4071aa0 2023-11-28T11:57:06.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.045+0000 7fdea2ffd700 1 -- 172.21.15.39:0/2536147177 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea8011d60 con 0x7fdeb4071aa0 2023-11-28T11:57:06.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.045+0000 7fdeb359e700 1 -- 172.21.15.39:0/2536147177 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeb415ca10 con 0x7fdeb4071aa0 2023-11-28T11:57:06.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.045+0000 7fdeb359e700 1 -- 172.21.15.39:0/2536147177 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeb406da20 con 0x7fdeb4071aa0 2023-11-28T11:57:06.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.045+0000 7fdeb359e700 1 -- 172.21.15.39:0/2536147177 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeb4072010 con 0x7fdeb4071aa0 2023-11-28T11:57:06.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.049+0000 7fdea2ffd700 1 -- 172.21.15.39:0/2536147177 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdea8021070 con 0x7fdeb4071aa0 2023-11-28T11:57:06.054 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.049+0000 7fdea2ffd700 1 --2- 172.21.15.39:0/2536147177 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fde94064ee0 0x7fde94067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:06.054 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.049+0000 7fdea2ffd700 1 -- 172.21.15.39:0/2536147177 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdea80820e0 con 0x7fdeb4071aa0 2023-11-28T11:57:06.054 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.049+0000 7fdeb259c700 1 --2- 172.21.15.39:0/2536147177 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fde94064ee0 0x7fde94067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:06.056 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.049+0000 7fdeb259c700 1 --2- 172.21.15.39:0/2536147177 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fde94064ee0 0x7fde94067390 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdeb406ed60 tx=0x7fdea4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:06.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.057+0000 7fdea2ffd700 1 -- 172.21.15.39:0/2536147177 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdea804fe40 con 0x7fdeb4071aa0 2023-11-28T11:57:06.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.225+0000 7fdeb359e700 1 -- 172.21.15.39:0/2536147177 --> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdeb409f7b0 con 0x7fde94064ee0 2023-11-28T11:57:06.250 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.245+0000 7fdea2ffd700 1 -- 172.21.15.39:0/2536147177 <== mgr.4104 v2:172.21.15.184:6832/36166 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367190 (secure 0 0 0) 0x7fdeb409f7b0 con 0x7fde94064ee0 2023-11-28T11:57:06.259 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:57:06.262 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.253+0000 7fdeb359e700 1 -- 172.21.15.39:0/2536147177 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fde94064ee0 msgr2=0x7fde94067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:06.262 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.253+0000 7fdeb359e700 1 --2- 172.21.15.39:0/2536147177 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fde94064ee0 0x7fde94067390 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdeb406ed60 tx=0x7fdea4008030 comp rx=0 tx=0).stop 2023-11-28T11:57:06.262 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.253+0000 7fdeb359e700 1 -- 172.21.15.39:0/2536147177 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdeb4071aa0 msgr2=0x7fdeb409c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:06.262 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.253+0000 7fdeb359e700 1 --2- 172.21.15.39:0/2536147177 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdeb4071aa0 0x7fdeb409c770 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdea800b4a0 tx=0x7fdea800b7b0 comp rx=0 tx=0).stop 2023-11-28T11:57:06.262 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.253+0000 7fdeb359e700 1 -- 172.21.15.39:0/2536147177 shutdown_connections 2023-11-28T11:57:06.262 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.253+0000 7fdeb359e700 1 --2- 172.21.15.39:0/2536147177 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdeb415c640 0x7fdeb4159f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:06.263 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.253+0000 7fdeb359e700 1 --2- 172.21.15.39:0/2536147177 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdeb4071aa0 0x7fdeb409c770 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:06.263 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.253+0000 7fdeb359e700 1 --2- 172.21.15.39:0/2536147177 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fde94064ee0 0x7fde94067390 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:06.263 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.253+0000 7fdeb359e700 1 --2- 172.21.15.39:0/2536147177 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdeb4069e00 0x7fdeb40b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:06.263 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.253+0000 7fdeb359e700 1 -- 172.21.15.39:0/2536147177 >> 172.21.15.39:0/2536147177 conn(0x7fdeb40b6520 msgr2=0x7fdeb40d16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:06.263 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.253+0000 7fdeb359e700 1 -- 172.21.15.39:0/2536147177 shutdown_connections 2023-11-28T11:57:06.263 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.253+0000 7fdeb359e700 1 -- 172.21.15.39:0/2536147177 wait complete. 2023-11-28T11:57:06.263 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2023-11-28T11:57:06.284 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2023-11-28T11:57:04.554550+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594895,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67684,"kb_used_data":3620,"kb_used_omap":0,"kb_used_meta":64000,"kb_avail":754907036,"statfs":{"total":773094113280,"available":773024804864,"internally_reserved":0,"allocated":3706880,"data_stored":2193647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65536000},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005865"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.571140+0000","last_change":"2023-11-28T11:56:43.976015+0000","last_active":"2023-11-28T11:56:44.571140+0000","last_peered":"2023-11-28T11:56:44.571140+0000","last_clean":"2023-11-28T11:56:44.571140+0000","last_became_active":"2023-11-28T11:56:43.975574+0000","last_became_peered":"2023-11-28T11:56:43.975574+0000","last_unstale":"2023-11-28T11:56:44.571140+0000","last_undegraded":"2023-11-28T11:56:44.571140+0000","last_fullsized":"2023-11-28T11:56:44.571140+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:41:50.763478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"24'4","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.992613+0000","last_change":"2023-11-28T11:56:39.473674+0000","last_active":"2023-11-28T11:56:43.992613+0000","last_peered":"2023-11-28T11:56:43.992613+0000","last_clean":"2023-11-28T11:56:43.992613+0000","last_became_active":"2023-11-28T11:56:39.473370+0000","last_became_peered":"2023-11-28T11:56:39.473370+0000","last_unstale":"2023-11-28T11:56:43.992613+0000","last_undegraded":"2023-11-28T11:56:43.992613+0000","last_fullsized":"2023-11-28T11:56:43.992613+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:10:58.488198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.959383+0000","last_change":"2023-11-28T11:56:39.939184+0000","last_active":"2023-11-28T11:56:43.959383+0000","last_peered":"2023-11-28T11:56:43.959383+0000","last_clean":"2023-11-28T11:56:43.959383+0000","last_became_active":"2023-11-28T11:56:39.938917+0000","last_became_peered":"2023-11-28T11:56:39.938917+0000","last_unstale":"2023-11-28T11:56:43.959383+0000","last_undegraded":"2023-11-28T11:56:43.959383+0000","last_fullsized":"2023-11-28T11:56:43.959383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:15:38.977863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.452044+0000","last_change":"2023-11-28T11:56:43.982000+0000","last_active":"2023-11-28T11:56:44.452044+0000","last_peered":"2023-11-28T11:56:44.452044+0000","last_clean":"2023-11-28T11:56:44.452044+0000","last_became_active":"2023-11-28T11:56:43.981537+0000","last_became_peered":"2023-11-28T11:56:43.981537+0000","last_unstale":"2023-11-28T11:56:44.452044+0000","last_undegraded":"2023-11-28T11:56:44.452044+0000","last_fullsized":"2023-11-28T11:56:44.452044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:13:42.258047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"24'1","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.962647+0000","last_change":"2023-11-28T11:56:39.451094+0000","last_active":"2023-11-28T11:56:43.962647+0000","last_peered":"2023-11-28T11:56:43.962647+0000","last_clean":"2023-11-28T11:56:43.962647+0000","last_became_active":"2023-11-28T11:56:39.450680+0000","last_became_peered":"2023-11-28T11:56:39.450680+0000","last_unstale":"2023-11-28T11:56:43.962647+0000","last_undegraded":"2023-11-28T11:56:43.962647+0000","last_fullsized":"2023-11-28T11:56:43.962647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:35:56.115422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952725+0000","last_change":"2023-11-28T11:56:39.938474+0000","last_active":"2023-11-28T11:56:43.952725+0000","last_peered":"2023-11-28T11:56:43.952725+0000","last_clean":"2023-11-28T11:56:43.952725+0000","last_became_active":"2023-11-28T11:56:39.938090+0000","last_became_peered":"2023-11-28T11:56:39.938090+0000","last_unstale":"2023-11-28T11:56:43.952725+0000","last_undegraded":"2023-11-28T11:56:43.952725+0000","last_fullsized":"2023-11-28T11:56:43.952725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:13:17.325195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.570857+0000","last_change":"2023-11-28T11:56:43.992668+0000","last_active":"2023-11-28T11:56:44.570857+0000","last_peered":"2023-11-28T11:56:44.570857+0000","last_clean":"2023-11-28T11:56:44.570857+0000","last_became_active":"2023-11-28T11:56:43.991547+0000","last_became_peered":"2023-11-28T11:56:43.991547+0000","last_unstale":"2023-11-28T11:56:44.570857+0000","last_undegraded":"2023-11-28T11:56:44.570857+0000","last_fullsized":"2023-11-28T11:56:44.570857+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:20:35.086687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"24'2","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.966791+0000","last_change":"2023-11-28T11:56:39.464222+0000","last_active":"2023-11-28T11:56:43.966791+0000","last_peered":"2023-11-28T11:56:43.966791+0000","last_clean":"2023-11-28T11:56:43.966791+0000","last_became_active":"2023-11-28T11:56:39.463797+0000","last_became_peered":"2023-11-28T11:56:39.463797+0000","last_unstale":"2023-11-28T11:56:43.966791+0000","last_undegraded":"2023-11-28T11:56:43.966791+0000","last_fullsized":"2023-11-28T11:56:43.966791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:52:48.600084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.959592+0000","last_change":"2023-11-28T11:56:39.932813+0000","last_active":"2023-11-28T11:56:43.959592+0000","last_peered":"2023-11-28T11:56:43.959592+0000","last_clean":"2023-11-28T11:56:43.959592+0000","last_became_active":"2023-11-28T11:56:39.928772+0000","last_became_peered":"2023-11-28T11:56:39.928772+0000","last_unstale":"2023-11-28T11:56:43.959592+0000","last_undegraded":"2023-11-28T11:56:43.959592+0000","last_fullsized":"2023-11-28T11:56:43.959592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:10:06.958523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.572062+0000","last_change":"2023-11-28T11:56:43.979370+0000","last_active":"2023-11-28T11:56:44.572062+0000","last_peered":"2023-11-28T11:56:44.572062+0000","last_clean":"2023-11-28T11:56:44.572062+0000","last_became_active":"2023-11-28T11:56:43.978938+0000","last_became_peered":"2023-11-28T11:56:43.978938+0000","last_unstale":"2023-11-28T11:56:44.572062+0000","last_undegraded":"2023-11-28T11:56:44.572062+0000","last_fullsized":"2023-11-28T11:56:44.572062+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:03:18.915760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.963646+0000","last_change":"2023-11-28T11:56:39.468476+0000","last_active":"2023-11-28T11:56:43.963646+0000","last_peered":"2023-11-28T11:56:43.963646+0000","last_clean":"2023-11-28T11:56:43.963646+0000","last_became_active":"2023-11-28T11:56:39.468201+0000","last_became_peered":"2023-11-28T11:56:39.468201+0000","last_unstale":"2023-11-28T11:56:43.963646+0000","last_undegraded":"2023-11-28T11:56:43.963646+0000","last_fullsized":"2023-11-28T11:56:43.963646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:30:31.377988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.959975+0000","last_change":"2023-11-28T11:56:39.928619+0000","last_active":"2023-11-28T11:56:43.959975+0000","last_peered":"2023-11-28T11:56:43.959975+0000","last_clean":"2023-11-28T11:56:43.959975+0000","last_became_active":"2023-11-28T11:56:39.928248+0000","last_became_peered":"2023-11-28T11:56:39.928248+0000","last_unstale":"2023-11-28T11:56:43.959975+0000","last_undegraded":"2023-11-28T11:56:43.959975+0000","last_fullsized":"2023-11-28T11:56:43.959975+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:24:26.563114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.574561+0000","last_change":"2023-11-28T11:56:43.998827+0000","last_active":"2023-11-28T11:56:44.574561+0000","last_peered":"2023-11-28T11:56:44.574561+0000","last_clean":"2023-11-28T11:56:44.574561+0000","last_became_active":"2023-11-28T11:56:43.998452+0000","last_became_peered":"2023-11-28T11:56:43.998452+0000","last_unstale":"2023-11-28T11:56:44.574561+0000","last_undegraded":"2023-11-28T11:56:44.574561+0000","last_fullsized":"2023-11-28T11:56:44.574561+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:34:39.710811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"24'1","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960780+0000","last_change":"2023-11-28T11:56:39.468234+0000","last_active":"2023-11-28T11:56:43.960780+0000","last_peered":"2023-11-28T11:56:43.960780+0000","last_clean":"2023-11-28T11:56:43.960780+0000","last_became_active":"2023-11-28T11:56:39.467925+0000","last_became_peered":"2023-11-28T11:56:39.467925+0000","last_unstale":"2023-11-28T11:56:43.960780+0000","last_undegraded":"2023-11-28T11:56:43.960780+0000","last_fullsized":"2023-11-28T11:56:43.960780+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:55:31.090691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.964769+0000","last_change":"2023-11-28T11:56:39.949606+0000","last_active":"2023-11-28T11:56:43.964769+0000","last_peered":"2023-11-28T11:56:43.964769+0000","last_clean":"2023-11-28T11:56:43.964769+0000","last_became_active":"2023-11-28T11:56:39.949364+0000","last_became_peered":"2023-11-28T11:56:39.949364+0000","last_unstale":"2023-11-28T11:56:43.964769+0000","last_undegraded":"2023-11-28T11:56:43.964769+0000","last_fullsized":"2023-11-28T11:56:43.964769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:02:46.928803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.453070+0000","last_change":"2023-11-28T11:56:43.992539+0000","last_active":"2023-11-28T11:56:44.453070+0000","last_peered":"2023-11-28T11:56:44.453070+0000","last_clean":"2023-11-28T11:56:44.453070+0000","last_became_active":"2023-11-28T11:56:43.992153+0000","last_became_peered":"2023-11-28T11:56:43.992153+0000","last_unstale":"2023-11-28T11:56:44.453070+0000","last_undegraded":"2023-11-28T11:56:44.453070+0000","last_fullsized":"2023-11-28T11:56:44.453070+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:33:16.305779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.959859+0000","last_change":"2023-11-28T11:56:39.470430+0000","last_active":"2023-11-28T11:56:43.959859+0000","last_peered":"2023-11-28T11:56:43.959859+0000","last_clean":"2023-11-28T11:56:43.959859+0000","last_became_active":"2023-11-28T11:56:39.470148+0000","last_became_peered":"2023-11-28T11:56:39.470148+0000","last_unstale":"2023-11-28T11:56:43.959859+0000","last_undegraded":"2023-11-28T11:56:43.959859+0000","last_fullsized":"2023-11-28T11:56:43.959859+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:26:50.340796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.958145+0000","last_change":"2023-11-28T11:56:39.951730+0000","last_active":"2023-11-28T11:56:43.958145+0000","last_peered":"2023-11-28T11:56:43.958145+0000","last_clean":"2023-11-28T11:56:43.958145+0000","last_became_active":"2023-11-28T11:56:39.951434+0000","last_became_peered":"2023-11-28T11:56:39.951434+0000","last_unstale":"2023-11-28T11:56:43.958145+0000","last_undegraded":"2023-11-28T11:56:43.958145+0000","last_fullsized":"2023-11-28T11:56:43.958145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:15:38.977863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.452332+0000","last_change":"2023-11-28T11:56:43.970823+0000","last_active":"2023-11-28T11:56:44.452332+0000","last_peered":"2023-11-28T11:56:44.452332+0000","last_clean":"2023-11-28T11:56:44.452332+0000","last_became_active":"2023-11-28T11:56:43.970344+0000","last_became_peered":"2023-11-28T11:56:43.970344+0000","last_unstale":"2023-11-28T11:56:44.452332+0000","last_undegraded":"2023-11-28T11:56:44.452332+0000","last_fullsized":"2023-11-28T11:56:44.452332+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:10:38.878879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.965575+0000","last_change":"2023-11-28T11:56:39.469964+0000","last_active":"2023-11-28T11:56:43.965575+0000","last_peered":"2023-11-28T11:56:43.965575+0000","last_clean":"2023-11-28T11:56:43.965575+0000","last_became_active":"2023-11-28T11:56:39.469642+0000","last_became_peered":"2023-11-28T11:56:39.469642+0000","last_unstale":"2023-11-28T11:56:43.965575+0000","last_undegraded":"2023-11-28T11:56:43.965575+0000","last_fullsized":"2023-11-28T11:56:43.965575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:52:05.494184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.973209+0000","last_change":"2023-11-28T11:56:39.935588+0000","last_active":"2023-11-28T11:56:43.973209+0000","last_peered":"2023-11-28T11:56:43.973209+0000","last_clean":"2023-11-28T11:56:43.973209+0000","last_became_active":"2023-11-28T11:56:39.935271+0000","last_became_peered":"2023-11-28T11:56:39.935271+0000","last_unstale":"2023-11-28T11:56:43.973209+0000","last_undegraded":"2023-11-28T11:56:43.973209+0000","last_fullsized":"2023-11-28T11:56:43.973209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:58:24.629436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.458194+0000","last_change":"2023-11-28T11:56:43.990219+0000","last_active":"2023-11-28T11:56:44.458194+0000","last_peered":"2023-11-28T11:56:44.458194+0000","last_clean":"2023-11-28T11:56:44.458194+0000","last_became_active":"2023-11-28T11:56:43.981571+0000","last_became_peered":"2023-11-28T11:56:43.981571+0000","last_unstale":"2023-11-28T11:56:44.458194+0000","last_undegraded":"2023-11-28T11:56:44.458194+0000","last_fullsized":"2023-11-28T11:56:44.458194+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:46:26.561526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952505+0000","last_change":"2023-11-28T11:56:39.464266+0000","last_active":"2023-11-28T11:56:43.952505+0000","last_peered":"2023-11-28T11:56:43.952505+0000","last_clean":"2023-11-28T11:56:43.952505+0000","last_became_active":"2023-11-28T11:56:39.463801+0000","last_became_peered":"2023-11-28T11:56:39.463801+0000","last_unstale":"2023-11-28T11:56:43.952505+0000","last_undegraded":"2023-11-28T11:56:43.952505+0000","last_fullsized":"2023-11-28T11:56:43.952505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:49:49.321158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.956171+0000","last_change":"2023-11-28T11:56:39.951261+0000","last_active":"2023-11-28T11:56:43.956171+0000","last_peered":"2023-11-28T11:56:43.956171+0000","last_clean":"2023-11-28T11:56:43.956171+0000","last_became_active":"2023-11-28T11:56:39.950979+0000","last_became_peered":"2023-11-28T11:56:39.950979+0000","last_unstale":"2023-11-28T11:56:43.956171+0000","last_undegraded":"2023-11-28T11:56:43.956171+0000","last_fullsized":"2023-11-28T11:56:43.956171+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:57:45.608044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952252+0000","last_change":"2023-11-28T11:56:39.944382+0000","last_active":"2023-11-28T11:56:43.952252+0000","last_peered":"2023-11-28T11:56:43.952252+0000","last_clean":"2023-11-28T11:56:43.952252+0000","last_became_active":"2023-11-28T11:56:39.944076+0000","last_became_peered":"2023-11-28T11:56:39.944076+0000","last_unstale":"2023-11-28T11:56:43.952252+0000","last_undegraded":"2023-11-28T11:56:43.952252+0000","last_fullsized":"2023-11-28T11:56:43.952252+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:39:50.872604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.992745+0000","last_change":"2023-11-28T11:56:39.473681+0000","last_active":"2023-11-28T11:56:43.992745+0000","last_peered":"2023-11-28T11:56:43.992745+0000","last_clean":"2023-11-28T11:56:43.992745+0000","last_became_active":"2023-11-28T11:56:39.473403+0000","last_became_peered":"2023-11-28T11:56:39.473403+0000","last_unstale":"2023-11-28T11:56:43.992745+0000","last_undegraded":"2023-11-28T11:56:43.992745+0000","last_fullsized":"2023-11-28T11:56:43.992745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:37:08.555596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.453581+0000","last_change":"2023-11-28T11:56:43.973549+0000","last_active":"2023-11-28T11:56:44.453581+0000","last_peered":"2023-11-28T11:56:44.453581+0000","last_clean":"2023-11-28T11:56:44.453581+0000","last_became_active":"2023-11-28T11:56:43.968940+0000","last_became_peered":"2023-11-28T11:56:43.968940+0000","last_unstale":"2023-11-28T11:56:44.453581+0000","last_undegraded":"2023-11-28T11:56:44.453581+0000","last_fullsized":"2023-11-28T11:56:44.453581+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:14:02.695573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952607+0000","last_change":"2023-11-28T11:56:39.937083+0000","last_active":"2023-11-28T11:56:43.952607+0000","last_peered":"2023-11-28T11:56:43.952607+0000","last_clean":"2023-11-28T11:56:43.952607+0000","last_became_active":"2023-11-28T11:56:39.935699+0000","last_became_peered":"2023-11-28T11:56:39.935699+0000","last_unstale":"2023-11-28T11:56:43.952607+0000","last_undegraded":"2023-11-28T11:56:43.952607+0000","last_fullsized":"2023-11-28T11:56:43.952607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:53:07.604891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.961314+0000","last_change":"2023-11-28T11:56:39.470488+0000","last_active":"2023-11-28T11:56:43.961314+0000","last_peered":"2023-11-28T11:56:43.961314+0000","last_clean":"2023-11-28T11:56:43.961314+0000","last_became_active":"2023-11-28T11:56:39.470200+0000","last_became_peered":"2023-11-28T11:56:39.470200+0000","last_unstale":"2023-11-28T11:56:43.961314+0000","last_undegraded":"2023-11-28T11:56:43.961314+0000","last_fullsized":"2023-11-28T11:56:43.961314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:09:04.506578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.571178+0000","last_change":"2023-11-28T11:56:43.991311+0000","last_active":"2023-11-28T11:56:44.571178+0000","last_peered":"2023-11-28T11:56:44.571178+0000","last_clean":"2023-11-28T11:56:44.571178+0000","last_became_active":"2023-11-28T11:56:43.990921+0000","last_became_peered":"2023-11-28T11:56:43.990921+0000","last_unstale":"2023-11-28T11:56:44.571178+0000","last_undegraded":"2023-11-28T11:56:44.571178+0000","last_fullsized":"2023-11-28T11:56:44.571178+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:34:39.710811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"24'3","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.953829+0000","last_change":"2023-11-28T11:56:39.472359+0000","last_active":"2023-11-28T11:56:43.953829+0000","last_peered":"2023-11-28T11:56:43.953829+0000","last_clean":"2023-11-28T11:56:43.953829+0000","last_became_active":"2023-11-28T11:56:39.471986+0000","last_became_peered":"2023-11-28T11:56:39.471986+0000","last_unstale":"2023-11-28T11:56:43.953829+0000","last_undegraded":"2023-11-28T11:56:43.953829+0000","last_fullsized":"2023-11-28T11:56:43.953829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:03:49.467652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.966867+0000","last_change":"2023-11-28T11:56:39.944231+0000","last_active":"2023-11-28T11:56:43.966867+0000","last_peered":"2023-11-28T11:56:43.966867+0000","last_clean":"2023-11-28T11:56:43.966867+0000","last_became_active":"2023-11-28T11:56:39.943953+0000","last_became_peered":"2023-11-28T11:56:39.943953+0000","last_unstale":"2023-11-28T11:56:43.966867+0000","last_undegraded":"2023-11-28T11:56:43.966867+0000","last_fullsized":"2023-11-28T11:56:43.966867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:39:50.872604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.572486+0000","last_change":"2023-11-28T11:56:43.983283+0000","last_active":"2023-11-28T11:56:44.572486+0000","last_peered":"2023-11-28T11:56:44.572486+0000","last_clean":"2023-11-28T11:56:44.572486+0000","last_became_active":"2023-11-28T11:56:43.982914+0000","last_became_peered":"2023-11-28T11:56:43.982914+0000","last_unstale":"2023-11-28T11:56:44.572486+0000","last_undegraded":"2023-11-28T11:56:44.572486+0000","last_fullsized":"2023-11-28T11:56:44.572486+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:57:38.845826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"29'10","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:57.078587+0000","last_change":"2023-11-28T11:56:39.466223+0000","last_active":"2023-11-28T11:56:57.078587+0000","last_peered":"2023-11-28T11:56:57.078587+0000","last_clean":"2023-11-28T11:56:57.078587+0000","last_became_active":"2023-11-28T11:56:39.461006+0000","last_became_peered":"2023-11-28T11:56:39.461006+0000","last_unstale":"2023-11-28T11:56:57.078587+0000","last_undegraded":"2023-11-28T11:56:57.078587+0000","last_fullsized":"2023-11-28T11:56:57.078587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:55:09.019742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3745,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960058+0000","last_change":"2023-11-28T11:56:39.928004+0000","last_active":"2023-11-28T11:56:43.960058+0000","last_peered":"2023-11-28T11:56:43.960058+0000","last_clean":"2023-11-28T11:56:43.960058+0000","last_became_active":"2023-11-28T11:56:39.927741+0000","last_became_peered":"2023-11-28T11:56:39.927741+0000","last_unstale":"2023-11-28T11:56:43.960058+0000","last_undegraded":"2023-11-28T11:56:43.960058+0000","last_fullsized":"2023-11-28T11:56:43.960058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:13:59.194749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.574749+0000","last_change":"2023-11-28T11:56:43.983971+0000","last_active":"2023-11-28T11:56:44.574749+0000","last_peered":"2023-11-28T11:56:44.574749+0000","last_clean":"2023-11-28T11:56:44.574749+0000","last_became_active":"2023-11-28T11:56:43.983532+0000","last_became_peered":"2023-11-28T11:56:43.983532+0000","last_unstale":"2023-11-28T11:56:44.574749+0000","last_undegraded":"2023-11-28T11:56:44.574749+0000","last_fullsized":"2023-11-28T11:56:44.574749+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:03:18.915760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960769+0000","last_change":"2023-11-28T11:56:39.937495+0000","last_active":"2023-11-28T11:56:43.960769+0000","last_peered":"2023-11-28T11:56:43.960769+0000","last_clean":"2023-11-28T11:56:43.960769+0000","last_became_active":"2023-11-28T11:56:39.937200+0000","last_became_peered":"2023-11-28T11:56:39.937200+0000","last_unstale":"2023-11-28T11:56:43.960769+0000","last_undegraded":"2023-11-28T11:56:43.960769+0000","last_fullsized":"2023-11-28T11:56:43.960769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:44:11.120518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.956246+0000","last_change":"2023-11-28T11:56:34.384408+0000","last_active":"2023-11-28T11:56:43.956246+0000","last_peered":"2023-11-28T11:56:43.956246+0000","last_clean":"2023-11-28T11:56:43.956246+0000","last_became_active":"2023-11-28T11:56:34.384036+0000","last_became_peered":"2023-11-28T11:56:34.384036+0000","last_unstale":"2023-11-28T11:56:43.956246+0000","last_undegraded":"2023-11-28T11:56:43.956246+0000","last_fullsized":"2023-11-28T11:56:43.956246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:58:55.003786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'1","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.458376+0000","last_change":"2023-11-28T11:56:39.470484+0000","last_active":"2023-11-28T11:56:44.458376+0000","last_peered":"2023-11-28T11:56:44.458376+0000","last_clean":"2023-11-28T11:56:44.458376+0000","last_became_active":"2023-11-28T11:56:39.469964+0000","last_became_peered":"2023-11-28T11:56:39.469964+0000","last_unstale":"2023-11-28T11:56:44.458376+0000","last_undegraded":"2023-11-28T11:56:44.458376+0000","last_fullsized":"2023-11-28T11:56:44.458376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:31:51.668232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.571117+0000","last_change":"2023-11-28T11:56:43.992603+0000","last_active":"2023-11-28T11:56:44.571117+0000","last_peered":"2023-11-28T11:56:44.571117+0000","last_clean":"2023-11-28T11:56:44.571117+0000","last_became_active":"2023-11-28T11:56:43.992111+0000","last_became_peered":"2023-11-28T11:56:43.992111+0000","last_unstale":"2023-11-28T11:56:44.571117+0000","last_undegraded":"2023-11-28T11:56:44.571117+0000","last_fullsized":"2023-11-28T11:56:44.571117+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:18:10.194854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952381+0000","last_change":"2023-11-28T11:56:39.935642+0000","last_active":"2023-11-28T11:56:43.952381+0000","last_peered":"2023-11-28T11:56:43.952381+0000","last_clean":"2023-11-28T11:56:43.952381+0000","last_became_active":"2023-11-28T11:56:39.935396+0000","last_became_peered":"2023-11-28T11:56:39.935396+0000","last_unstale":"2023-11-28T11:56:43.952381+0000","last_undegraded":"2023-11-28T11:56:43.952381+0000","last_fullsized":"2023-11-28T11:56:43.952381+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:08:24.197240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.971041+0000","last_change":"2023-11-28T11:56:34.384088+0000","last_active":"2023-11-28T11:56:43.971041+0000","last_peered":"2023-11-28T11:56:43.971041+0000","last_clean":"2023-11-28T11:56:43.971041+0000","last_became_active":"2023-11-28T11:56:34.383631+0000","last_became_peered":"2023-11-28T11:56:34.383631+0000","last_unstale":"2023-11-28T11:56:43.971041+0000","last_undegraded":"2023-11-28T11:56:43.971041+0000","last_fullsized":"2023-11-28T11:56:43.971041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:15:42.772333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"24'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.959213+0000","last_change":"2023-11-28T11:56:39.458173+0000","last_active":"2023-11-28T11:56:43.959213+0000","last_peered":"2023-11-28T11:56:43.959213+0000","last_clean":"2023-11-28T11:56:43.959213+0000","last_became_active":"2023-11-28T11:56:39.457898+0000","last_became_peered":"2023-11-28T11:56:39.457898+0000","last_unstale":"2023-11-28T11:56:43.959213+0000","last_undegraded":"2023-11-28T11:56:43.959213+0000","last_fullsized":"2023-11-28T11:56:43.959213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:54.418908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.452674+0000","last_change":"2023-11-28T11:56:43.982368+0000","last_active":"2023-11-28T11:56:44.452674+0000","last_peered":"2023-11-28T11:56:44.452674+0000","last_clean":"2023-11-28T11:56:44.452674+0000","last_became_active":"2023-11-28T11:56:43.981885+0000","last_became_peered":"2023-11-28T11:56:43.981885+0000","last_unstale":"2023-11-28T11:56:44.452674+0000","last_undegraded":"2023-11-28T11:56:44.452674+0000","last_fullsized":"2023-11-28T11:56:44.452674+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:01:03.447360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960222+0000","last_change":"2023-11-28T11:56:39.937832+0000","last_active":"2023-11-28T11:56:43.960222+0000","last_peered":"2023-11-28T11:56:43.960222+0000","last_clean":"2023-11-28T11:56:43.960222+0000","last_became_active":"2023-11-28T11:56:39.937160+0000","last_became_peered":"2023-11-28T11:56:39.937160+0000","last_unstale":"2023-11-28T11:56:43.960222+0000","last_undegraded":"2023-11-28T11:56:43.960222+0000","last_fullsized":"2023-11-28T11:56:43.960222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:44.472020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.954123+0000","last_change":"2023-11-28T11:56:34.386399+0000","last_active":"2023-11-28T11:56:43.954123+0000","last_peered":"2023-11-28T11:56:43.954123+0000","last_clean":"2023-11-28T11:56:43.954123+0000","last_became_active":"2023-11-28T11:56:34.385994+0000","last_became_peered":"2023-11-28T11:56:34.385994+0000","last_unstale":"2023-11-28T11:56:43.954123+0000","last_undegraded":"2023-11-28T11:56:43.954123+0000","last_fullsized":"2023-11-28T11:56:43.954123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:58:02.172295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.968562+0000","last_change":"2023-11-28T11:56:39.469089+0000","last_active":"2023-11-28T11:56:43.968562+0000","last_peered":"2023-11-28T11:56:43.968562+0000","last_clean":"2023-11-28T11:56:43.968562+0000","last_became_active":"2023-11-28T11:56:39.468762+0000","last_became_peered":"2023-11-28T11:56:39.468762+0000","last_unstale":"2023-11-28T11:56:43.968562+0000","last_undegraded":"2023-11-28T11:56:43.968562+0000","last_fullsized":"2023-11-28T11:56:43.968562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:15:59.693915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.452323+0000","last_change":"2023-11-28T11:56:43.994532+0000","last_active":"2023-11-28T11:56:44.452323+0000","last_peered":"2023-11-28T11:56:44.452323+0000","last_clean":"2023-11-28T11:56:44.452323+0000","last_became_active":"2023-11-28T11:56:43.993975+0000","last_became_peered":"2023-11-28T11:56:43.993975+0000","last_unstale":"2023-11-28T11:56:44.452323+0000","last_undegraded":"2023-11-28T11:56:44.452323+0000","last_fullsized":"2023-11-28T11:56:44.452323+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:09:56.519261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.967511+0000","last_change":"2023-11-28T11:56:39.947689+0000","last_active":"2023-11-28T11:56:43.967511+0000","last_peered":"2023-11-28T11:56:43.967511+0000","last_clean":"2023-11-28T11:56:43.967511+0000","last_became_active":"2023-11-28T11:56:39.947425+0000","last_became_peered":"2023-11-28T11:56:39.947425+0000","last_unstale":"2023-11-28T11:56:43.967511+0000","last_undegraded":"2023-11-28T11:56:43.967511+0000","last_fullsized":"2023-11-28T11:56:43.967511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:49:14.776024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.968711+0000","last_change":"2023-11-28T11:56:34.384999+0000","last_active":"2023-11-28T11:56:43.968711+0000","last_peered":"2023-11-28T11:56:43.968711+0000","last_clean":"2023-11-28T11:56:43.968711+0000","last_became_active":"2023-11-28T11:56:34.384531+0000","last_became_peered":"2023-11-28T11:56:34.384531+0000","last_unstale":"2023-11-28T11:56:43.968711+0000","last_undegraded":"2023-11-28T11:56:43.968711+0000","last_fullsized":"2023-11-28T11:56:43.968711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:09:50.083366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.966872+0000","last_change":"2023-11-28T11:56:39.468628+0000","last_active":"2023-11-28T11:56:43.966872+0000","last_peered":"2023-11-28T11:56:43.966872+0000","last_clean":"2023-11-28T11:56:43.966872+0000","last_became_active":"2023-11-28T11:56:39.467602+0000","last_became_peered":"2023-11-28T11:56:39.467602+0000","last_unstale":"2023-11-28T11:56:43.966872+0000","last_undegraded":"2023-11-28T11:56:43.966872+0000","last_fullsized":"2023-11-28T11:56:43.966872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:49:49.321158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.457910+0000","last_change":"2023-11-28T11:56:43.989103+0000","last_active":"2023-11-28T11:56:44.457910+0000","last_peered":"2023-11-28T11:56:44.457910+0000","last_clean":"2023-11-28T11:56:44.457910+0000","last_became_active":"2023-11-28T11:56:43.981649+0000","last_became_peered":"2023-11-28T11:56:43.981649+0000","last_unstale":"2023-11-28T11:56:44.457910+0000","last_undegraded":"2023-11-28T11:56:44.457910+0000","last_fullsized":"2023-11-28T11:56:44.457910+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:38:25.615361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.968481+0000","last_change":"2023-11-28T11:56:39.942485+0000","last_active":"2023-11-28T11:56:43.968481+0000","last_peered":"2023-11-28T11:56:43.968481+0000","last_clean":"2023-11-28T11:56:43.968481+0000","last_became_active":"2023-11-28T11:56:39.941112+0000","last_became_peered":"2023-11-28T11:56:39.941112+0000","last_unstale":"2023-11-28T11:56:43.968481+0000","last_undegraded":"2023-11-28T11:56:43.968481+0000","last_fullsized":"2023-11-28T11:56:43.968481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:47:39.671110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960251+0000","last_change":"2023-11-28T11:56:39.467432+0000","last_active":"2023-11-28T11:56:43.960251+0000","last_peered":"2023-11-28T11:56:43.960251+0000","last_clean":"2023-11-28T11:56:43.960251+0000","last_became_active":"2023-11-28T11:56:39.466982+0000","last_became_peered":"2023-11-28T11:56:39.466982+0000","last_unstale":"2023-11-28T11:56:43.960251+0000","last_undegraded":"2023-11-28T11:56:43.960251+0000","last_fullsized":"2023-11-28T11:56:43.960251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:35:56.115422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.965360+0000","last_change":"2023-11-28T11:56:34.389076+0000","last_active":"2023-11-28T11:56:43.965360+0000","last_peered":"2023-11-28T11:56:43.965360+0000","last_clean":"2023-11-28T11:56:43.965360+0000","last_became_active":"2023-11-28T11:56:34.388689+0000","last_became_peered":"2023-11-28T11:56:34.388689+0000","last_unstale":"2023-11-28T11:56:43.965360+0000","last_undegraded":"2023-11-28T11:56:43.965360+0000","last_fullsized":"2023-11-28T11:56:43.965360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:20.936349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.457737+0000","last_change":"2023-11-28T11:56:43.989060+0000","last_active":"2023-11-28T11:56:44.457737+0000","last_peered":"2023-11-28T11:56:44.457737+0000","last_clean":"2023-11-28T11:56:44.457737+0000","last_became_active":"2023-11-28T11:56:43.981599+0000","last_became_peered":"2023-11-28T11:56:43.981599+0000","last_unstale":"2023-11-28T11:56:44.457737+0000","last_undegraded":"2023-11-28T11:56:44.457737+0000","last_fullsized":"2023-11-28T11:56:44.457737+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:04:37.482968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.971330+0000","last_change":"2023-11-28T11:56:39.953419+0000","last_active":"2023-11-28T11:56:43.971330+0000","last_peered":"2023-11-28T11:56:43.971330+0000","last_clean":"2023-11-28T11:56:43.971330+0000","last_became_active":"2023-11-28T11:56:39.950287+0000","last_became_peered":"2023-11-28T11:56:39.950287+0000","last_unstale":"2023-11-28T11:56:43.971330+0000","last_undegraded":"2023-11-28T11:56:43.971330+0000","last_fullsized":"2023-11-28T11:56:43.971330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:15:38.977863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.965505+0000","last_change":"2023-11-28T11:56:39.467239+0000","last_active":"2023-11-28T11:56:43.965505+0000","last_peered":"2023-11-28T11:56:43.965505+0000","last_clean":"2023-11-28T11:56:43.965505+0000","last_became_active":"2023-11-28T11:56:39.466964+0000","last_became_peered":"2023-11-28T11:56:39.466964+0000","last_unstale":"2023-11-28T11:56:43.965505+0000","last_undegraded":"2023-11-28T11:56:43.965505+0000","last_fullsized":"2023-11-28T11:56:43.965505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:54.418908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.962524+0000","last_change":"2023-11-28T11:56:34.486178+0000","last_active":"2023-11-28T11:56:43.962524+0000","last_peered":"2023-11-28T11:56:43.962524+0000","last_clean":"2023-11-28T11:56:43.962524+0000","last_became_active":"2023-11-28T11:56:34.485702+0000","last_became_peered":"2023-11-28T11:56:34.485702+0000","last_unstale":"2023-11-28T11:56:43.962524+0000","last_undegraded":"2023-11-28T11:56:43.962524+0000","last_fullsized":"2023-11-28T11:56:43.962524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:06.323407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.570721+0000","last_change":"2023-11-28T11:56:43.979672+0000","last_active":"2023-11-28T11:56:44.570721+0000","last_peered":"2023-11-28T11:56:44.570721+0000","last_clean":"2023-11-28T11:56:44.570721+0000","last_became_active":"2023-11-28T11:56:43.978974+0000","last_became_peered":"2023-11-28T11:56:43.978974+0000","last_unstale":"2023-11-28T11:56:44.570721+0000","last_undegraded":"2023-11-28T11:56:44.570721+0000","last_fullsized":"2023-11-28T11:56:44.570721+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:15.285239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.974511+0000","last_change":"2023-11-28T11:56:39.957142+0000","last_active":"2023-11-28T11:56:43.974511+0000","last_peered":"2023-11-28T11:56:43.974511+0000","last_clean":"2023-11-28T11:56:43.974511+0000","last_became_active":"2023-11-28T11:56:39.956844+0000","last_became_peered":"2023-11-28T11:56:39.956844+0000","last_unstale":"2023-11-28T11:56:43.974511+0000","last_undegraded":"2023-11-28T11:56:43.974511+0000","last_fullsized":"2023-11-28T11:56:43.974511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:04.287216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.957703+0000","last_change":"2023-11-28T11:56:39.474271+0000","last_active":"2023-11-28T11:56:43.957703+0000","last_peered":"2023-11-28T11:56:43.957703+0000","last_clean":"2023-11-28T11:56:43.957703+0000","last_became_active":"2023-11-28T11:56:39.473993+0000","last_became_peered":"2023-11-28T11:56:39.473993+0000","last_unstale":"2023-11-28T11:56:43.957703+0000","last_undegraded":"2023-11-28T11:56:43.957703+0000","last_fullsized":"2023-11-28T11:56:43.957703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:20:01.703553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952292+0000","last_change":"2023-11-28T11:56:34.387293+0000","last_active":"2023-11-28T11:56:43.952292+0000","last_peered":"2023-11-28T11:56:43.952292+0000","last_clean":"2023-11-28T11:56:43.952292+0000","last_became_active":"2023-11-28T11:56:34.386976+0000","last_became_peered":"2023-11-28T11:56:34.386976+0000","last_unstale":"2023-11-28T11:56:43.952292+0000","last_undegraded":"2023-11-28T11:56:43.952292+0000","last_fullsized":"2023-11-28T11:56:43.952292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:32.704729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.570544+0000","last_change":"2023-11-28T11:56:43.995313+0000","last_active":"2023-11-28T11:56:44.570544+0000","last_peered":"2023-11-28T11:56:44.570544+0000","last_clean":"2023-11-28T11:56:44.570544+0000","last_became_active":"2023-11-28T11:56:43.994793+0000","last_became_peered":"2023-11-28T11:56:43.994793+0000","last_unstale":"2023-11-28T11:56:44.570544+0000","last_undegraded":"2023-11-28T11:56:44.570544+0000","last_fullsized":"2023-11-28T11:56:44.570544+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:38:23.071293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.953439+0000","last_change":"2023-11-28T11:56:39.927130+0000","last_active":"2023-11-28T11:56:43.953439+0000","last_peered":"2023-11-28T11:56:43.953439+0000","last_clean":"2023-11-28T11:56:43.953439+0000","last_became_active":"2023-11-28T11:56:39.926834+0000","last_became_peered":"2023-11-28T11:56:39.926834+0000","last_unstale":"2023-11-28T11:56:43.953439+0000","last_undegraded":"2023-11-28T11:56:43.953439+0000","last_fullsized":"2023-11-28T11:56:43.953439+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:03:50.474199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952514+0000","last_change":"2023-11-28T11:56:39.460516+0000","last_active":"2023-11-28T11:56:43.952514+0000","last_peered":"2023-11-28T11:56:43.952514+0000","last_clean":"2023-11-28T11:56:43.952514+0000","last_became_active":"2023-11-28T11:56:39.460151+0000","last_became_peered":"2023-11-28T11:56:39.460151+0000","last_unstale":"2023-11-28T11:56:43.952514+0000","last_undegraded":"2023-11-28T11:56:43.952514+0000","last_fullsized":"2023-11-28T11:56:43.952514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:52:05.494184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.972495+0000","last_change":"2023-11-28T11:56:34.389222+0000","last_active":"2023-11-28T11:56:43.972495+0000","last_peered":"2023-11-28T11:56:43.972495+0000","last_clean":"2023-11-28T11:56:43.972495+0000","last_became_active":"2023-11-28T11:56:34.388671+0000","last_became_peered":"2023-11-28T11:56:34.388671+0000","last_unstale":"2023-11-28T11:56:43.972495+0000","last_undegraded":"2023-11-28T11:56:43.972495+0000","last_fullsized":"2023-11-28T11:56:43.972495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:32.704729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952429+0000","last_change":"2023-11-28T11:56:28.472008+0000","last_active":"2023-11-28T11:56:43.952429+0000","last_peered":"2023-11-28T11:56:43.952429+0000","last_clean":"2023-11-28T11:56:43.952429+0000","last_became_active":"2023-11-28T11:56:28.469273+0000","last_became_peered":"2023-11-28T11:56:28.469273+0000","last_unstale":"2023-11-28T11:56:43.952429+0000","last_undegraded":"2023-11-28T11:56:43.952429+0000","last_fullsized":"2023-11-28T11:56:43.952429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:27.291192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:27.291192+0000","last_clean_scrub_stamp":"2023-11-28T11:56:27.291192+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:14:48.860420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.571768+0000","last_change":"2023-11-28T11:56:43.982227+0000","last_active":"2023-11-28T11:56:44.571768+0000","last_peered":"2023-11-28T11:56:44.571768+0000","last_clean":"2023-11-28T11:56:44.571768+0000","last_became_active":"2023-11-28T11:56:43.980406+0000","last_became_peered":"2023-11-28T11:56:43.980406+0000","last_unstale":"2023-11-28T11:56:44.571768+0000","last_undegraded":"2023-11-28T11:56:44.571768+0000","last_fullsized":"2023-11-28T11:56:44.571768+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:18:10.194854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.971411+0000","last_change":"2023-11-28T11:56:39.945082+0000","last_active":"2023-11-28T11:56:43.971411+0000","last_peered":"2023-11-28T11:56:43.971411+0000","last_clean":"2023-11-28T11:56:43.971411+0000","last_became_active":"2023-11-28T11:56:39.943905+0000","last_became_peered":"2023-11-28T11:56:39.943905+0000","last_unstale":"2023-11-28T11:56:43.971411+0000","last_undegraded":"2023-11-28T11:56:43.971411+0000","last_fullsized":"2023-11-28T11:56:43.971411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:59:04.313406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952622+0000","last_change":"2023-11-28T11:56:39.465139+0000","last_active":"2023-11-28T11:56:43.952622+0000","last_peered":"2023-11-28T11:56:43.952622+0000","last_clean":"2023-11-28T11:56:43.952622+0000","last_became_active":"2023-11-28T11:56:39.464873+0000","last_became_peered":"2023-11-28T11:56:39.464873+0000","last_unstale":"2023-11-28T11:56:43.952622+0000","last_undegraded":"2023-11-28T11:56:43.952622+0000","last_fullsized":"2023-11-28T11:56:43.952622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:15:59.693915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.453970+0000","last_change":"2023-11-28T11:56:43.985102+0000","last_active":"2023-11-28T11:56:44.453970+0000","last_peered":"2023-11-28T11:56:44.453970+0000","last_clean":"2023-11-28T11:56:44.453970+0000","last_became_active":"2023-11-28T11:56:43.981972+0000","last_became_peered":"2023-11-28T11:56:43.981972+0000","last_unstale":"2023-11-28T11:56:44.453970+0000","last_undegraded":"2023-11-28T11:56:44.453970+0000","last_fullsized":"2023-11-28T11:56:44.453970+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:55:56.798336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.962406+0000","last_change":"2023-11-28T11:56:39.927380+0000","last_active":"2023-11-28T11:56:43.962406+0000","last_peered":"2023-11-28T11:56:43.962406+0000","last_clean":"2023-11-28T11:56:43.962406+0000","last_became_active":"2023-11-28T11:56:39.927049+0000","last_became_peered":"2023-11-28T11:56:39.927049+0000","last_unstale":"2023-11-28T11:56:43.962406+0000","last_undegraded":"2023-11-28T11:56:43.962406+0000","last_fullsized":"2023-11-28T11:56:43.962406+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:53:07.604891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960844+0000","last_change":"2023-11-28T11:56:39.465718+0000","last_active":"2023-11-28T11:56:43.960844+0000","last_peered":"2023-11-28T11:56:43.960844+0000","last_clean":"2023-11-28T11:56:43.960844+0000","last_became_active":"2023-11-28T11:56:39.465452+0000","last_became_peered":"2023-11-28T11:56:39.465452+0000","last_unstale":"2023-11-28T11:56:43.960844+0000","last_undegraded":"2023-11-28T11:56:43.960844+0000","last_fullsized":"2023-11-28T11:56:43.960844+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:52:05.494184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.570452+0000","last_change":"2023-11-28T11:56:43.982616+0000","last_active":"2023-11-28T11:56:44.570452+0000","last_peered":"2023-11-28T11:56:44.570452+0000","last_clean":"2023-11-28T11:56:44.570452+0000","last_became_active":"2023-11-28T11:56:43.982223+0000","last_became_peered":"2023-11-28T11:56:43.982223+0000","last_unstale":"2023-11-28T11:56:44.570452+0000","last_undegraded":"2023-11-28T11:56:44.570452+0000","last_fullsized":"2023-11-28T11:56:44.570452+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:03:46.537759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.963773+0000","last_change":"2023-11-28T11:56:39.941619+0000","last_active":"2023-11-28T11:56:43.963773+0000","last_peered":"2023-11-28T11:56:43.963773+0000","last_clean":"2023-11-28T11:56:43.963773+0000","last_became_active":"2023-11-28T11:56:39.941343+0000","last_became_peered":"2023-11-28T11:56:39.941343+0000","last_unstale":"2023-11-28T11:56:43.963773+0000","last_undegraded":"2023-11-28T11:56:43.963773+0000","last_fullsized":"2023-11-28T11:56:43.963773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:09:05.982770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960394+0000","last_change":"2023-11-28T11:56:39.469027+0000","last_active":"2023-11-28T11:56:43.960394+0000","last_peered":"2023-11-28T11:56:43.960394+0000","last_clean":"2023-11-28T11:56:43.960394+0000","last_became_active":"2023-11-28T11:56:39.468738+0000","last_became_peered":"2023-11-28T11:56:39.468738+0000","last_unstale":"2023-11-28T11:56:43.960394+0000","last_undegraded":"2023-11-28T11:56:43.960394+0000","last_fullsized":"2023-11-28T11:56:43.960394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:55:09.019742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.573769+0000","last_change":"2023-11-28T11:56:44.002367+0000","last_active":"2023-11-28T11:56:44.573769+0000","last_peered":"2023-11-28T11:56:44.573769+0000","last_clean":"2023-11-28T11:56:44.573769+0000","last_became_active":"2023-11-28T11:56:44.002098+0000","last_became_peered":"2023-11-28T11:56:44.002098+0000","last_unstale":"2023-11-28T11:56:44.573769+0000","last_undegraded":"2023-11-28T11:56:44.573769+0000","last_fullsized":"2023-11-28T11:56:44.573769+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:34:06.872250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960453+0000","last_change":"2023-11-28T11:56:39.934523+0000","last_active":"2023-11-28T11:56:43.960453+0000","last_peered":"2023-11-28T11:56:43.960453+0000","last_clean":"2023-11-28T11:56:43.960453+0000","last_became_active":"2023-11-28T11:56:39.926004+0000","last_became_peered":"2023-11-28T11:56:39.926004+0000","last_unstale":"2023-11-28T11:56:43.960453+0000","last_undegraded":"2023-11-28T11:56:43.960453+0000","last_fullsized":"2023-11-28T11:56:43.960453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:39:50.872604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"24'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.954294+0000","last_change":"2023-11-28T11:56:39.464276+0000","last_active":"2023-11-28T11:56:43.954294+0000","last_peered":"2023-11-28T11:56:43.954294+0000","last_clean":"2023-11-28T11:56:43.954294+0000","last_became_active":"2023-11-28T11:56:39.463731+0000","last_became_peered":"2023-11-28T11:56:39.463731+0000","last_unstale":"2023-11-28T11:56:43.954294+0000","last_undegraded":"2023-11-28T11:56:43.954294+0000","last_fullsized":"2023-11-28T11:56:43.954294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:52:48.600084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.570251+0000","last_change":"2023-11-28T11:56:43.988077+0000","last_active":"2023-11-28T11:56:44.570251+0000","last_peered":"2023-11-28T11:56:44.570251+0000","last_clean":"2023-11-28T11:56:44.570251+0000","last_became_active":"2023-11-28T11:56:43.987519+0000","last_became_peered":"2023-11-28T11:56:43.987519+0000","last_unstale":"2023-11-28T11:56:44.570251+0000","last_undegraded":"2023-11-28T11:56:44.570251+0000","last_fullsized":"2023-11-28T11:56:44.570251+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:27:49.851056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960239+0000","last_change":"2023-11-28T11:56:39.943627+0000","last_active":"2023-11-28T11:56:43.960239+0000","last_peered":"2023-11-28T11:56:43.960239+0000","last_clean":"2023-11-28T11:56:43.960239+0000","last_became_active":"2023-11-28T11:56:39.943358+0000","last_became_peered":"2023-11-28T11:56:39.943358+0000","last_unstale":"2023-11-28T11:56:43.960239+0000","last_undegraded":"2023-11-28T11:56:43.960239+0000","last_fullsized":"2023-11-28T11:56:43.960239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:54:54.554070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.963730+0000","last_change":"2023-11-28T11:56:39.459974+0000","last_active":"2023-11-28T11:56:43.963730+0000","last_peered":"2023-11-28T11:56:43.963730+0000","last_clean":"2023-11-28T11:56:43.963730+0000","last_became_active":"2023-11-28T11:56:39.459621+0000","last_became_peered":"2023-11-28T11:56:39.459621+0000","last_unstale":"2023-11-28T11:56:43.963730+0000","last_undegraded":"2023-11-28T11:56:43.963730+0000","last_fullsized":"2023-11-28T11:56:43.963730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:57:44.601498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.569869+0000","last_change":"2023-11-28T11:56:43.987926+0000","last_active":"2023-11-28T11:56:44.569869+0000","last_peered":"2023-11-28T11:56:44.569869+0000","last_clean":"2023-11-28T11:56:44.569869+0000","last_became_active":"2023-11-28T11:56:43.987447+0000","last_became_peered":"2023-11-28T11:56:43.987447+0000","last_unstale":"2023-11-28T11:56:44.569869+0000","last_undegraded":"2023-11-28T11:56:44.569869+0000","last_fullsized":"2023-11-28T11:56:44.569869+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:48:08.970147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960270+0000","last_change":"2023-11-28T11:56:39.944531+0000","last_active":"2023-11-28T11:56:43.960270+0000","last_peered":"2023-11-28T11:56:43.960270+0000","last_clean":"2023-11-28T11:56:43.960270+0000","last_became_active":"2023-11-28T11:56:39.944262+0000","last_became_peered":"2023-11-28T11:56:39.944262+0000","last_unstale":"2023-11-28T11:56:43.960270+0000","last_undegraded":"2023-11-28T11:56:43.960270+0000","last_fullsized":"2023-11-28T11:56:43.960270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:36:30.674628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.953951+0000","last_change":"2023-11-28T11:56:39.468498+0000","last_active":"2023-11-28T11:56:43.953951+0000","last_peered":"2023-11-28T11:56:43.953951+0000","last_clean":"2023-11-28T11:56:43.953951+0000","last_became_active":"2023-11-28T11:56:39.468198+0000","last_became_peered":"2023-11-28T11:56:39.468198+0000","last_unstale":"2023-11-28T11:56:43.953951+0000","last_undegraded":"2023-11-28T11:56:43.953951+0000","last_fullsized":"2023-11-28T11:56:43.953951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:30:31.377988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.569939+0000","last_change":"2023-11-28T11:56:43.996490+0000","last_active":"2023-11-28T11:56:44.569939+0000","last_peered":"2023-11-28T11:56:44.569939+0000","last_clean":"2023-11-28T11:56:44.569939+0000","last_became_active":"2023-11-28T11:56:43.996074+0000","last_became_peered":"2023-11-28T11:56:43.996074+0000","last_unstale":"2023-11-28T11:56:44.569939+0000","last_undegraded":"2023-11-28T11:56:44.569939+0000","last_fullsized":"2023-11-28T11:56:44.569939+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:01:51.310559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960636+0000","last_change":"2023-11-28T11:56:39.946101+0000","last_active":"2023-11-28T11:56:43.960636+0000","last_peered":"2023-11-28T11:56:43.960636+0000","last_clean":"2023-11-28T11:56:43.960636+0000","last_became_active":"2023-11-28T11:56:39.945797+0000","last_became_peered":"2023-11-28T11:56:39.945797+0000","last_unstale":"2023-11-28T11:56:43.960636+0000","last_undegraded":"2023-11-28T11:56:43.960636+0000","last_fullsized":"2023-11-28T11:56:43.960636+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:04:33.061948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.954377+0000","last_change":"2023-11-28T11:56:39.468642+0000","last_active":"2023-11-28T11:56:43.954377+0000","last_peered":"2023-11-28T11:56:43.954377+0000","last_clean":"2023-11-28T11:56:43.954377+0000","last_became_active":"2023-11-28T11:56:39.468261+0000","last_became_peered":"2023-11-28T11:56:39.468261+0000","last_unstale":"2023-11-28T11:56:43.954377+0000","last_undegraded":"2023-11-28T11:56:43.954377+0000","last_fullsized":"2023-11-28T11:56:43.954377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:09:04.506578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.569358+0000","last_change":"2023-11-28T11:56:44.001612+0000","last_active":"2023-11-28T11:56:44.569358+0000","last_peered":"2023-11-28T11:56:44.569358+0000","last_clean":"2023-11-28T11:56:44.569358+0000","last_became_active":"2023-11-28T11:56:44.001218+0000","last_became_peered":"2023-11-28T11:56:44.001218+0000","last_unstale":"2023-11-28T11:56:44.569358+0000","last_undegraded":"2023-11-28T11:56:44.569358+0000","last_fullsized":"2023-11-28T11:56:44.569358+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:47.972845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.962655+0000","last_change":"2023-11-28T11:56:39.937560+0000","last_active":"2023-11-28T11:56:43.962655+0000","last_peered":"2023-11-28T11:56:43.962655+0000","last_clean":"2023-11-28T11:56:43.962655+0000","last_became_active":"2023-11-28T11:56:39.935813+0000","last_became_peered":"2023-11-28T11:56:39.935813+0000","last_unstale":"2023-11-28T11:56:43.962655+0000","last_undegraded":"2023-11-28T11:56:43.962655+0000","last_fullsized":"2023-11-28T11:56:43.962655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:39:50.872604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.954504+0000","last_change":"2023-11-28T11:56:39.460965+0000","last_active":"2023-11-28T11:56:43.954504+0000","last_peered":"2023-11-28T11:56:43.954504+0000","last_clean":"2023-11-28T11:56:43.954504+0000","last_became_active":"2023-11-28T11:56:39.460589+0000","last_became_peered":"2023-11-28T11:56:39.460589+0000","last_unstale":"2023-11-28T11:56:43.954504+0000","last_undegraded":"2023-11-28T11:56:43.954504+0000","last_fullsized":"2023-11-28T11:56:43.954504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:14:49.707818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.571715+0000","last_change":"2023-11-28T11:56:43.975101+0000","last_active":"2023-11-28T11:56:44.571715+0000","last_peered":"2023-11-28T11:56:44.571715+0000","last_clean":"2023-11-28T11:56:44.571715+0000","last_became_active":"2023-11-28T11:56:43.974532+0000","last_became_peered":"2023-11-28T11:56:43.974532+0000","last_unstale":"2023-11-28T11:56:44.571715+0000","last_undegraded":"2023-11-28T11:56:44.571715+0000","last_fullsized":"2023-11-28T11:56:44.571715+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:34:06.872250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.570363+0000","last_change":"2023-11-28T11:56:43.980824+0000","last_active":"2023-11-28T11:56:44.570363+0000","last_peered":"2023-11-28T11:56:44.570363+0000","last_clean":"2023-11-28T11:56:44.570363+0000","last_became_active":"2023-11-28T11:56:43.978868+0000","last_became_peered":"2023-11-28T11:56:43.978868+0000","last_unstale":"2023-11-28T11:56:44.570363+0000","last_undegraded":"2023-11-28T11:56:44.570363+0000","last_fullsized":"2023-11-28T11:56:44.570363+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:03:18.915760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"24'8","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.953542+0000","last_change":"2023-11-28T11:56:39.463107+0000","last_active":"2023-11-28T11:56:43.953542+0000","last_peered":"2023-11-28T11:56:43.953542+0000","last_clean":"2023-11-28T11:56:43.953542+0000","last_became_active":"2023-11-28T11:56:39.462771+0000","last_became_peered":"2023-11-28T11:56:39.462771+0000","last_unstale":"2023-11-28T11:56:43.953542+0000","last_undegraded":"2023-11-28T11:56:43.953542+0000","last_fullsized":"2023-11-28T11:56:43.953542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:26:50.340796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.959057+0000","last_change":"2023-11-28T11:56:39.935086+0000","last_active":"2023-11-28T11:56:43.959057+0000","last_peered":"2023-11-28T11:56:43.959057+0000","last_clean":"2023-11-28T11:56:43.959057+0000","last_became_active":"2023-11-28T11:56:39.934832+0000","last_became_peered":"2023-11-28T11:56:39.934832+0000","last_unstale":"2023-11-28T11:56:43.959057+0000","last_undegraded":"2023-11-28T11:56:43.959057+0000","last_fullsized":"2023-11-28T11:56:43.959057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:10:06.958523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.575548+0000","last_change":"2023-11-28T11:56:43.996688+0000","last_active":"2023-11-28T11:56:44.575548+0000","last_peered":"2023-11-28T11:56:44.575548+0000","last_clean":"2023-11-28T11:56:44.575548+0000","last_became_active":"2023-11-28T11:56:43.996253+0000","last_became_peered":"2023-11-28T11:56:43.996253+0000","last_unstale":"2023-11-28T11:56:44.575548+0000","last_undegraded":"2023-11-28T11:56:44.575548+0000","last_fullsized":"2023-11-28T11:56:44.575548+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:20:35.086687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952840+0000","last_change":"2023-11-28T11:56:39.471710+0000","last_active":"2023-11-28T11:56:43.952840+0000","last_peered":"2023-11-28T11:56:43.952840+0000","last_clean":"2023-11-28T11:56:43.952840+0000","last_became_active":"2023-11-28T11:56:39.471423+0000","last_became_peered":"2023-11-28T11:56:39.471423+0000","last_unstale":"2023-11-28T11:56:43.952840+0000","last_undegraded":"2023-11-28T11:56:43.952840+0000","last_fullsized":"2023-11-28T11:56:43.952840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:41.737631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.974564+0000","last_change":"2023-11-28T11:56:39.932531+0000","last_active":"2023-11-28T11:56:43.974564+0000","last_peered":"2023-11-28T11:56:43.974564+0000","last_clean":"2023-11-28T11:56:43.974564+0000","last_became_active":"2023-11-28T11:56:39.932235+0000","last_became_peered":"2023-11-28T11:56:39.932235+0000","last_unstale":"2023-11-28T11:56:43.974564+0000","last_undegraded":"2023-11-28T11:56:43.974564+0000","last_fullsized":"2023-11-28T11:56:43.974564+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:37:59.805024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960058+0000","last_change":"2023-11-28T11:56:39.459466+0000","last_active":"2023-11-28T11:56:43.960058+0000","last_peered":"2023-11-28T11:56:43.960058+0000","last_clean":"2023-11-28T11:56:43.960058+0000","last_became_active":"2023-11-28T11:56:39.459207+0000","last_became_peered":"2023-11-28T11:56:39.459207+0000","last_unstale":"2023-11-28T11:56:43.960058+0000","last_undegraded":"2023-11-28T11:56:43.960058+0000","last_fullsized":"2023-11-28T11:56:43.960058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:21:06.192836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.966700+0000","last_change":"2023-11-28T11:56:39.947121+0000","last_active":"2023-11-28T11:56:43.966700+0000","last_peered":"2023-11-28T11:56:43.966700+0000","last_clean":"2023-11-28T11:56:43.966700+0000","last_became_active":"2023-11-28T11:56:39.944854+0000","last_became_peered":"2023-11-28T11:56:39.944854+0000","last_unstale":"2023-11-28T11:56:43.966700+0000","last_undegraded":"2023-11-28T11:56:43.966700+0000","last_fullsized":"2023-11-28T11:56:43.966700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:53:07.604891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.572743+0000","last_change":"2023-11-28T11:56:43.976187+0000","last_active":"2023-11-28T11:56:44.572743+0000","last_peered":"2023-11-28T11:56:44.572743+0000","last_clean":"2023-11-28T11:56:44.572743+0000","last_became_active":"2023-11-28T11:56:43.975691+0000","last_became_peered":"2023-11-28T11:56:43.975691+0000","last_unstale":"2023-11-28T11:56:44.572743+0000","last_undegraded":"2023-11-28T11:56:44.572743+0000","last_fullsized":"2023-11-28T11:56:44.572743+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:38:23.071293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"24'2","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952993+0000","last_change":"2023-11-28T11:56:39.473334+0000","last_active":"2023-11-28T11:56:43.952993+0000","last_peered":"2023-11-28T11:56:43.952993+0000","last_clean":"2023-11-28T11:56:43.952993+0000","last_became_active":"2023-11-28T11:56:39.472989+0000","last_became_peered":"2023-11-28T11:56:39.472989+0000","last_unstale":"2023-11-28T11:56:43.952993+0000","last_undegraded":"2023-11-28T11:56:43.952993+0000","last_fullsized":"2023-11-28T11:56:43.952993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:36:29.668082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.953207+0000","last_change":"2023-11-28T11:56:39.942962+0000","last_active":"2023-11-28T11:56:43.953207+0000","last_peered":"2023-11-28T11:56:43.953207+0000","last_clean":"2023-11-28T11:56:43.953207+0000","last_became_active":"2023-11-28T11:56:39.942628+0000","last_became_peered":"2023-11-28T11:56:39.942628+0000","last_unstale":"2023-11-28T11:56:43.953207+0000","last_undegraded":"2023-11-28T11:56:43.953207+0000","last_fullsized":"2023-11-28T11:56:43.953207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:09:53.018437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.571109+0000","last_change":"2023-11-28T11:56:43.983804+0000","last_active":"2023-11-28T11:56:44.571109+0000","last_peered":"2023-11-28T11:56:44.571109+0000","last_clean":"2023-11-28T11:56:44.571109+0000","last_became_active":"2023-11-28T11:56:43.983397+0000","last_became_peered":"2023-11-28T11:56:43.983397+0000","last_unstale":"2023-11-28T11:56:44.571109+0000","last_undegraded":"2023-11-28T11:56:44.571109+0000","last_fullsized":"2023-11-28T11:56:44.571109+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:16.749468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.953340+0000","last_change":"2023-11-28T11:56:39.938472+0000","last_active":"2023-11-28T11:56:43.953340+0000","last_peered":"2023-11-28T11:56:43.953340+0000","last_clean":"2023-11-28T11:56:43.953340+0000","last_became_active":"2023-11-28T11:56:39.938186+0000","last_became_peered":"2023-11-28T11:56:39.938186+0000","last_unstale":"2023-11-28T11:56:43.953340+0000","last_undegraded":"2023-11-28T11:56:43.953340+0000","last_fullsized":"2023-11-28T11:56:43.953340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:30:32.384534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952481+0000","last_change":"2023-11-28T11:56:39.947611+0000","last_active":"2023-11-28T11:56:43.952481+0000","last_peered":"2023-11-28T11:56:43.952481+0000","last_clean":"2023-11-28T11:56:43.952481+0000","last_became_active":"2023-11-28T11:56:39.947364+0000","last_became_peered":"2023-11-28T11:56:39.947364+0000","last_unstale":"2023-11-28T11:56:43.952481+0000","last_undegraded":"2023-11-28T11:56:43.952481+0000","last_fullsized":"2023-11-28T11:56:43.952481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:49:14.776024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.959741+0000","last_change":"2023-11-28T11:56:39.928631+0000","last_active":"2023-11-28T11:56:43.959741+0000","last_peered":"2023-11-28T11:56:43.959741+0000","last_clean":"2023-11-28T11:56:43.959741+0000","last_became_active":"2023-11-28T11:56:39.928360+0000","last_became_peered":"2023-11-28T11:56:39.928360+0000","last_unstale":"2023-11-28T11:56:43.959741+0000","last_undegraded":"2023-11-28T11:56:43.959741+0000","last_fullsized":"2023-11-28T11:56:43.959741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:09:53.018437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.954058+0000","last_change":"2023-11-28T11:56:39.935151+0000","last_active":"2023-11-28T11:56:43.954058+0000","last_peered":"2023-11-28T11:56:43.954058+0000","last_clean":"2023-11-28T11:56:43.954058+0000","last_became_active":"2023-11-28T11:56:39.934811+0000","last_became_peered":"2023-11-28T11:56:39.934811+0000","last_unstale":"2023-11-28T11:56:43.954058+0000","last_undegraded":"2023-11-28T11:56:43.954058+0000","last_fullsized":"2023-11-28T11:56:43.954058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:24:26.563114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.968635+0000","last_change":"2023-11-28T11:56:39.940870+0000","last_active":"2023-11-28T11:56:43.968635+0000","last_peered":"2023-11-28T11:56:43.968635+0000","last_clean":"2023-11-28T11:56:43.968635+0000","last_became_active":"2023-11-28T11:56:39.940598+0000","last_became_peered":"2023-11-28T11:56:39.940598+0000","last_unstale":"2023-11-28T11:56:43.968635+0000","last_undegraded":"2023-11-28T11:56:43.968635+0000","last_fullsized":"2023-11-28T11:56:43.968635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:14:50.714365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.966611+0000","last_change":"2023-11-28T11:56:39.953168+0000","last_active":"2023-11-28T11:56:43.966611+0000","last_peered":"2023-11-28T11:56:43.966611+0000","last_clean":"2023-11-28T11:56:43.966611+0000","last_became_active":"2023-11-28T11:56:39.951968+0000","last_became_peered":"2023-11-28T11:56:39.951968+0000","last_unstale":"2023-11-28T11:56:43.966611+0000","last_undegraded":"2023-11-28T11:56:43.966611+0000","last_fullsized":"2023-11-28T11:56:43.966611+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:08:24.197240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.970835+0000","last_change":"2023-11-28T11:56:39.946593+0000","last_active":"2023-11-28T11:56:43.970835+0000","last_peered":"2023-11-28T11:56:43.970835+0000","last_clean":"2023-11-28T11:56:43.970835+0000","last_became_active":"2023-11-28T11:56:39.944862+0000","last_became_peered":"2023-11-28T11:56:39.944862+0000","last_unstale":"2023-11-28T11:56:43.970835+0000","last_undegraded":"2023-11-28T11:56:43.970835+0000","last_fullsized":"2023-11-28T11:56:43.970835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:13:17.325195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.971180+0000","last_change":"2023-11-28T11:56:39.941059+0000","last_active":"2023-11-28T11:56:43.971180+0000","last_peered":"2023-11-28T11:56:43.971180+0000","last_clean":"2023-11-28T11:56:43.971180+0000","last_became_active":"2023-11-28T11:56:39.940781+0000","last_became_peered":"2023-11-28T11:56:39.940781+0000","last_unstale":"2023-11-28T11:56:43.971180+0000","last_undegraded":"2023-11-28T11:56:43.971180+0000","last_fullsized":"2023-11-28T11:56:43.971180+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:50:59.351619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952193+0000","last_change":"2023-11-28T11:56:39.950678+0000","last_active":"2023-11-28T11:56:43.952193+0000","last_peered":"2023-11-28T11:56:43.952193+0000","last_clean":"2023-11-28T11:56:43.952193+0000","last_became_active":"2023-11-28T11:56:39.948033+0000","last_became_peered":"2023-11-28T11:56:39.948033+0000","last_unstale":"2023-11-28T11:56:43.952193+0000","last_undegraded":"2023-11-28T11:56:43.952193+0000","last_fullsized":"2023-11-28T11:56:43.952193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:13:17.325195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952347+0000","last_change":"2023-11-28T11:56:39.926747+0000","last_active":"2023-11-28T11:56:43.952347+0000","last_peered":"2023-11-28T11:56:43.952347+0000","last_clean":"2023-11-28T11:56:43.952347+0000","last_became_active":"2023-11-28T11:56:39.926475+0000","last_became_peered":"2023-11-28T11:56:39.926475+0000","last_unstale":"2023-11-28T11:56:43.952347+0000","last_undegraded":"2023-11-28T11:56:43.952347+0000","last_fullsized":"2023-11-28T11:56:43.952347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:10:35.378054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.957922+0000","last_change":"2023-11-28T11:56:39.952645+0000","last_active":"2023-11-28T11:56:43.957922+0000","last_peered":"2023-11-28T11:56:43.957922+0000","last_clean":"2023-11-28T11:56:43.957922+0000","last_became_active":"2023-11-28T11:56:39.952363+0000","last_became_peered":"2023-11-28T11:56:39.952363+0000","last_unstale":"2023-11-28T11:56:43.957922+0000","last_undegraded":"2023-11-28T11:56:43.957922+0000","last_fullsized":"2023-11-28T11:56:43.957922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:43:39.611494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952872+0000","last_change":"2023-11-28T11:56:39.947249+0000","last_active":"2023-11-28T11:56:43.952872+0000","last_peered":"2023-11-28T11:56:43.952872+0000","last_clean":"2023-11-28T11:56:43.952872+0000","last_became_active":"2023-11-28T11:56:39.946423+0000","last_became_peered":"2023-11-28T11:56:39.946423+0000","last_unstale":"2023-11-28T11:56:43.952872+0000","last_undegraded":"2023-11-28T11:56:43.952872+0000","last_fullsized":"2023-11-28T11:56:43.952872+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:49:14.776024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960364+0000","last_change":"2023-11-28T11:56:39.934479+0000","last_active":"2023-11-28T11:56:43.960364+0000","last_peered":"2023-11-28T11:56:43.960364+0000","last_clean":"2023-11-28T11:56:43.960364+0000","last_became_active":"2023-11-28T11:56:39.928161+0000","last_became_peered":"2023-11-28T11:56:39.928161+0000","last_unstale":"2023-11-28T11:56:43.960364+0000","last_undegraded":"2023-11-28T11:56:43.960364+0000","last_fullsized":"2023-11-28T11:56:43.960364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:54:26.952553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.963038+0000","last_change":"2023-11-28T11:56:39.941392+0000","last_active":"2023-11-28T11:56:43.963038+0000","last_peered":"2023-11-28T11:56:43.963038+0000","last_clean":"2023-11-28T11:56:43.963038+0000","last_became_active":"2023-11-28T11:56:39.940495+0000","last_became_peered":"2023-11-28T11:56:39.940495+0000","last_unstale":"2023-11-28T11:56:43.963038+0000","last_undegraded":"2023-11-28T11:56:43.963038+0000","last_fullsized":"2023-11-28T11:56:43.963038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:20:02.710099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.962307+0000","last_change":"2023-11-28T11:56:39.945287+0000","last_active":"2023-11-28T11:56:43.962307+0000","last_peered":"2023-11-28T11:56:43.962307+0000","last_clean":"2023-11-28T11:56:43.962307+0000","last_became_active":"2023-11-28T11:56:39.942342+0000","last_became_peered":"2023-11-28T11:56:39.942342+0000","last_unstale":"2023-11-28T11:56:43.962307+0000","last_undegraded":"2023-11-28T11:56:43.962307+0000","last_fullsized":"2023-11-28T11:56:43.962307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:10:35.378054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.992453+0000","last_change":"2023-11-28T11:56:39.934499+0000","last_active":"2023-11-28T11:56:43.992453+0000","last_peered":"2023-11-28T11:56:43.992453+0000","last_clean":"2023-11-28T11:56:43.992453+0000","last_became_active":"2023-11-28T11:56:39.934253+0000","last_became_peered":"2023-11-28T11:56:39.934253+0000","last_unstale":"2023-11-28T11:56:43.992453+0000","last_undegraded":"2023-11-28T11:56:43.992453+0000","last_fullsized":"2023-11-28T11:56:43.992453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:45:29.746371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.959288+0000","last_change":"2023-11-28T11:56:39.941319+0000","last_active":"2023-11-28T11:56:43.959288+0000","last_peered":"2023-11-28T11:56:43.959288+0000","last_clean":"2023-11-28T11:56:43.959288+0000","last_became_active":"2023-11-28T11:56:39.941012+0000","last_became_peered":"2023-11-28T11:56:39.941012+0000","last_unstale":"2023-11-28T11:56:43.959288+0000","last_undegraded":"2023-11-28T11:56:43.959288+0000","last_fullsized":"2023-11-28T11:56:43.959288+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:08:24.197240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952737+0000","last_change":"2023-11-28T11:56:39.950163+0000","last_active":"2023-11-28T11:56:43.952737+0000","last_peered":"2023-11-28T11:56:43.952737+0000","last_clean":"2023-11-28T11:56:43.952737+0000","last_became_active":"2023-11-28T11:56:39.949823+0000","last_became_peered":"2023-11-28T11:56:39.949823+0000","last_unstale":"2023-11-28T11:56:43.952737+0000","last_undegraded":"2023-11-28T11:56:43.952737+0000","last_fullsized":"2023-11-28T11:56:43.952737+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:53:07.604891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.965275+0000","last_change":"2023-11-28T11:56:39.945909+0000","last_active":"2023-11-28T11:56:43.965275+0000","last_peered":"2023-11-28T11:56:43.965275+0000","last_clean":"2023-11-28T11:56:43.965275+0000","last_became_active":"2023-11-28T11:56:39.945628+0000","last_became_peered":"2023-11-28T11:56:39.945628+0000","last_unstale":"2023-11-28T11:56:43.965275+0000","last_undegraded":"2023-11-28T11:56:43.965275+0000","last_fullsized":"2023-11-28T11:56:43.965275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:47:39.671110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.967426+0000","last_change":"2023-11-28T11:56:39.949059+0000","last_active":"2023-11-28T11:56:43.967426+0000","last_peered":"2023-11-28T11:56:43.967426+0000","last_clean":"2023-11-28T11:56:43.967426+0000","last_became_active":"2023-11-28T11:56:39.948795+0000","last_became_peered":"2023-11-28T11:56:39.948795+0000","last_unstale":"2023-11-28T11:56:43.967426+0000","last_undegraded":"2023-11-28T11:56:43.967426+0000","last_fullsized":"2023-11-28T11:56:43.967426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:10:59.494745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.964659+0000","last_change":"2023-11-28T11:56:39.955527+0000","last_active":"2023-11-28T11:56:43.964659+0000","last_peered":"2023-11-28T11:56:43.964659+0000","last_clean":"2023-11-28T11:56:43.964659+0000","last_became_active":"2023-11-28T11:56:39.955190+0000","last_became_peered":"2023-11-28T11:56:39.955190+0000","last_unstale":"2023-11-28T11:56:43.964659+0000","last_undegraded":"2023-11-28T11:56:43.964659+0000","last_fullsized":"2023-11-28T11:56:43.964659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:31:52.674778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.963692+0000","last_change":"2023-11-28T11:56:39.950894+0000","last_active":"2023-11-28T11:56:43.963692+0000","last_peered":"2023-11-28T11:56:43.963692+0000","last_clean":"2023-11-28T11:56:43.963692+0000","last_became_active":"2023-11-28T11:56:39.950572+0000","last_became_peered":"2023-11-28T11:56:39.950572+0000","last_unstale":"2023-11-28T11:56:43.963692+0000","last_undegraded":"2023-11-28T11:56:43.963692+0000","last_fullsized":"2023-11-28T11:56:43.963692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:33:44.652949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.961221+0000","last_change":"2023-11-28T11:56:39.943609+0000","last_active":"2023-11-28T11:56:43.961221+0000","last_peered":"2023-11-28T11:56:43.961221+0000","last_clean":"2023-11-28T11:56:43.961221+0000","last_became_active":"2023-11-28T11:56:39.943334+0000","last_became_peered":"2023-11-28T11:56:39.943334+0000","last_unstale":"2023-11-28T11:56:43.961221+0000","last_undegraded":"2023-11-28T11:56:43.961221+0000","last_fullsized":"2023-11-28T11:56:43.961221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:15:38.977863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.991532+0000","last_change":"2023-11-28T11:56:39.937893+0000","last_active":"2023-11-28T11:56:43.991532+0000","last_peered":"2023-11-28T11:56:43.991532+0000","last_clean":"2023-11-28T11:56:43.991532+0000","last_became_active":"2023-11-28T11:56:39.936035+0000","last_became_peered":"2023-11-28T11:56:39.936035+0000","last_unstale":"2023-11-28T11:56:43.991532+0000","last_undegraded":"2023-11-28T11:56:43.991532+0000","last_fullsized":"2023-11-28T11:56:43.991532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:48:05.469323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.962560+0000","last_change":"2023-11-28T11:56:39.948688+0000","last_active":"2023-11-28T11:56:43.962560+0000","last_peered":"2023-11-28T11:56:43.962560+0000","last_clean":"2023-11-28T11:56:43.962560+0000","last_became_active":"2023-11-28T11:56:39.948372+0000","last_became_peered":"2023-11-28T11:56:39.948372+0000","last_unstale":"2023-11-28T11:56:43.962560+0000","last_undegraded":"2023-11-28T11:56:43.962560+0000","last_fullsized":"2023-11-28T11:56:43.962560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:49:14.776024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952119+0000","last_change":"2023-11-28T11:56:39.950877+0000","last_active":"2023-11-28T11:56:43.952119+0000","last_peered":"2023-11-28T11:56:43.952119+0000","last_clean":"2023-11-28T11:56:43.952119+0000","last_became_active":"2023-11-28T11:56:39.949415+0000","last_became_peered":"2023-11-28T11:56:39.949415+0000","last_unstale":"2023-11-28T11:56:43.952119+0000","last_undegraded":"2023-11-28T11:56:43.952119+0000","last_fullsized":"2023-11-28T11:56:43.952119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:15:38.977863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.959490+0000","last_change":"2023-11-28T11:56:39.940463+0000","last_active":"2023-11-28T11:56:43.959490+0000","last_peered":"2023-11-28T11:56:43.959490+0000","last_clean":"2023-11-28T11:56:43.959490+0000","last_became_active":"2023-11-28T11:56:39.940181+0000","last_became_peered":"2023-11-28T11:56:39.940181+0000","last_unstale":"2023-11-28T11:56:43.959490+0000","last_undegraded":"2023-11-28T11:56:43.959490+0000","last_fullsized":"2023-11-28T11:56:43.959490+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:39:27.124421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960539+0000","last_change":"2023-11-28T11:56:39.933634+0000","last_active":"2023-11-28T11:56:43.960539+0000","last_peered":"2023-11-28T11:56:43.960539+0000","last_clean":"2023-11-28T11:56:43.960539+0000","last_became_active":"2023-11-28T11:56:39.933388+0000","last_became_peered":"2023-11-28T11:56:39.933388+0000","last_unstale":"2023-11-28T11:56:43.960539+0000","last_undegraded":"2023-11-28T11:56:43.960539+0000","last_fullsized":"2023-11-28T11:56:43.960539+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:35:17.292824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.953846+0000","last_change":"2023-11-28T11:56:39.929640+0000","last_active":"2023-11-28T11:56:43.953846+0000","last_peered":"2023-11-28T11:56:43.953846+0000","last_clean":"2023-11-28T11:56:43.953846+0000","last_became_active":"2023-11-28T11:56:39.926154+0000","last_became_peered":"2023-11-28T11:56:39.926154+0000","last_unstale":"2023-11-28T11:56:43.953846+0000","last_undegraded":"2023-11-28T11:56:43.953846+0000","last_fullsized":"2023-11-28T11:56:43.953846+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:09:05.513124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.963588+0000","last_change":"2023-11-28T11:56:39.927473+0000","last_active":"2023-11-28T11:56:43.963588+0000","last_peered":"2023-11-28T11:56:43.963588+0000","last_clean":"2023-11-28T11:56:43.963588+0000","last_became_active":"2023-11-28T11:56:39.927002+0000","last_became_peered":"2023-11-28T11:56:39.927002+0000","last_unstale":"2023-11-28T11:56:43.963588+0000","last_undegraded":"2023-11-28T11:56:43.963588+0000","last_fullsized":"2023-11-28T11:56:43.963588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:53:05.931879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.961138+0000","last_change":"2023-11-28T11:56:39.956928+0000","last_active":"2023-11-28T11:56:43.961138+0000","last_peered":"2023-11-28T11:56:43.961138+0000","last_clean":"2023-11-28T11:56:43.961138+0000","last_became_active":"2023-11-28T11:56:39.956676+0000","last_became_peered":"2023-11-28T11:56:39.956676+0000","last_unstale":"2023-11-28T11:56:43.961138+0000","last_undegraded":"2023-11-28T11:56:43.961138+0000","last_fullsized":"2023-11-28T11:56:43.961138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:24:26.563114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.959783+0000","last_change":"2023-11-28T11:56:39.948454+0000","last_active":"2023-11-28T11:56:43.959783+0000","last_peered":"2023-11-28T11:56:43.959783+0000","last_clean":"2023-11-28T11:56:43.959783+0000","last_became_active":"2023-11-28T11:56:39.948186+0000","last_became_peered":"2023-11-28T11:56:39.948186+0000","last_unstale":"2023-11-28T11:56:43.959783+0000","last_undegraded":"2023-11-28T11:56:43.959783+0000","last_fullsized":"2023-11-28T11:56:43.959783+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:55:32.097238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4527,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9300,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362540,"statfs":{"total":96636764160,"available":96627240960,"internally_reserved":0,"allocated":929792,"data_stored":719926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3740000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]}]},{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8116,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363724,"statfs":{"total":96636764160,"available":96628453376,"internally_reserved":0,"allocated":307200,"data_stored":125597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5740000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2689999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4370000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4059999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.464}]}]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8188,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363652,"statfs":{"total":96636764160,"available":96628379648,"internally_reserved":0,"allocated":315392,"data_stored":126233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3169999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.403}]}]},{"osd":4,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8264,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363576,"statfs":{"total":96636764160,"available":96628301824,"internally_reserved":0,"allocated":327680,"data_stored":129398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.335}]}]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8184,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363656,"statfs":{"total":96636764160,"available":96628383744,"internally_reserved":0,"allocated":311296,"data_stored":125687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2370000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0980000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]}]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8244,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363596,"statfs":{"total":96636764160,"available":96628322304,"internally_reserved":0,"allocated":307200,"data_stored":125597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2789999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8116,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363724,"statfs":{"total":96636764160,"available":96628453376,"internally_reserved":0,"allocated":307200,"data_stored":125597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1910000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3169999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542154,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9272,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362568,"statfs":{"total":96636764160,"available":96627269632,"internally_reserved":0,"allocated":901120,"data_stored":715612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.224}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.284}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:57:06.290 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:57:06.508 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.505+0000 7f82d1812700 1 Processor -- start 2023-11-28T11:57:06.509 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.505+0000 7f82d1812700 1 -- start start 2023-11-28T11:57:06.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.505+0000 7f82d1812700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f82cc15c1d0 0x7f82cc0b7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:06.511 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.505+0000 7f82d1812700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f82cc06a600 0x7f82cc0cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:06.511 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.505+0000 7f82d1812700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82cc0cfea0 con 0x7f82cc0cfa40 2023-11-28T11:57:06.511 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.505+0000 7f82d1812700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82cc06aa50 con 0x7f82cc15c1d0 2023-11-28T11:57:06.511 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.505+0000 7f82d1812700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc06b570 con 0x7f82cc06a600 2023-11-28T11:57:06.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.505+0000 7f82d1011700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f82cc0cfa40 0x7f82cc15fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:38022/0 (socket says 172.21.15.39:38022) 2023-11-28T11:57:06.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.505+0000 7f82d1011700 1 -- 172.21.15.39:0/2339188591 learned_addr learned my addr 172.21.15.39:0/2339188591 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:06.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.505+0000 7f82d0810700 1 --2- 172.21.15.39:0/2339188591 >> v2:172.21.15.184:3300/0 conn(0x7f82cc15c1d0 0x7f82cc0b7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:06.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.505+0000 7f82c3fff700 1 --2- 172.21.15.39:0/2339188591 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f82cc06a600 0x7f82cc0cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:06.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.505+0000 7f82c37fe700 1 -- 172.21.15.39:0/2339188591 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3437323633 0 0) 0x7f82cc0cfea0 con 0x7f82cc0cfa40 2023-11-28T11:57:06.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.509+0000 7f82c37fe700 1 -- 172.21.15.39:0/2339188591 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82b40035d0 con 0x7f82cc0cfa40 2023-11-28T11:57:06.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.509+0000 7f82d0810700 1 -- 172.21.15.39:0/2339188591 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f82cc06a600 msgr2=0x7f82cc0cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:06.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.509+0000 7f82d0810700 1 --2- 172.21.15.39:0/2339188591 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f82cc06a600 0x7f82cc0cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:06.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.509+0000 7f82d0810700 1 -- 172.21.15.39:0/2339188591 >> v1:172.21.15.39:6789/0 conn(0x7f82cc0cfa40 legacy=0x7f82cc15fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:06.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.509+0000 7f82d0810700 1 -- 172.21.15.39:0/2339188591 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82cc0b5c20 con 0x7f82cc15c1d0 2023-11-28T11:57:06.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.509+0000 7f82d0810700 1 --2- 172.21.15.39:0/2339188591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82cc15c1d0 0x7f82cc0b7b50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f82c8009850 tx=0x7f82c8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6b119e7ef75fda6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:06.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.509+0000 7f82c37fe700 1 -- 172.21.15.39:0/2339188591 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c8011830 con 0x7f82cc15c1d0 2023-11-28T11:57:06.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.509+0000 7f82c37fe700 1 -- 172.21.15.39:0/2339188591 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c8011990 con 0x7f82cc15c1d0 2023-11-28T11:57:06.514 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.509+0000 7f82c37fe700 1 -- 172.21.15.39:0/2339188591 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c8011d40 con 0x7f82cc15c1d0 2023-11-28T11:57:06.514 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.509+0000 7f82d1812700 1 -- 172.21.15.39:0/2339188591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82cc15c1d0 msgr2=0x7f82cc0b7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:06.514 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.509+0000 7f82d1812700 1 --2- 172.21.15.39:0/2339188591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82cc15c1d0 0x7f82cc0b7b50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f82c8009850 tx=0x7f82c8009b60 comp rx=0 tx=0).stop 2023-11-28T11:57:06.515 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.509+0000 7f82d1812700 1 -- 172.21.15.39:0/2339188591 shutdown_connections 2023-11-28T11:57:06.515 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.509+0000 7f82d1812700 1 --2- 172.21.15.39:0/2339188591 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f82cc06a600 0x7f82cc0cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:06.515 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.509+0000 7f82d1812700 1 --2- 172.21.15.39:0/2339188591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82cc15c1d0 0x7f82cc0b7b50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:06.515 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.509+0000 7f82d1812700 1 -- 172.21.15.39:0/2339188591 >> 172.21.15.39:0/2339188591 conn(0x7f82cc06be80 msgr2=0x7f82cc06c280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:06.515 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.509+0000 7f82d1812700 1 -- 172.21.15.39:0/2339188591 shutdown_connections 2023-11-28T11:57:06.515 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.509+0000 7f82d1812700 1 -- 172.21.15.39:0/2339188591 wait complete. 2023-11-28T11:57:06.516 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.513+0000 7f82d1812700 1 Processor -- start 2023-11-28T11:57:06.517 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.513+0000 7f82d1812700 1 -- start start 2023-11-28T11:57:06.518 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.513+0000 7f82d1812700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f82cc06a600 0x7f82cc14d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:06.518 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.513+0000 7f82d1812700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82cc0cfa40 0x7f82cc154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:06.518 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.513+0000 7f82d1812700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82cc15c1d0 0x7f82cc156510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:06.518 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.513+0000 7f82d1812700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc1554d0 con 0x7f82cc15c1d0 2023-11-28T11:57:06.519 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.513+0000 7f82d1812700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc154640 con 0x7f82cc0cfa40 2023-11-28T11:57:06.519 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.513+0000 7f82d1812700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc1548c0 con 0x7f82cc06a600 2023-11-28T11:57:06.519 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.513+0000 7f82d1011700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82cc15c1d0 0x7f82cc156510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:06.520 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.513+0000 7f82d1011700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82cc15c1d0 0x7f82cc156510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45416/0 (socket says 172.21.15.39:45416) 2023-11-28T11:57:06.520 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.513+0000 7f82d1011700 1 -- 172.21.15.39:0/3577369022 learned_addr learned my addr 172.21.15.39:0/3577369022 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:06.520 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.513+0000 7f82d0810700 1 --2- 172.21.15.39:0/3577369022 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f82cc06a600 0x7f82cc14d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:06.520 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.513+0000 7f82c3fff700 1 --2- 172.21.15.39:0/3577369022 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82cc0cfa40 0x7f82cc154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:06.520 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.513+0000 7f82d1011700 1 -- 172.21.15.39:0/3577369022 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f82cc06a600 msgr2=0x7f82cc14d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:06.520 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.513+0000 7f82d1011700 1 --2- 172.21.15.39:0/3577369022 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f82cc06a600 0x7f82cc14d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:06.520 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.513+0000 7f82d1011700 1 -- 172.21.15.39:0/3577369022 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82cc0cfa40 msgr2=0x7f82cc154100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:06.520 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.513+0000 7f82d1011700 1 --2- 172.21.15.39:0/3577369022 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82cc0cfa40 0x7f82cc154100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:06.520 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.513+0000 7f82d1011700 1 -- 172.21.15.39:0/3577369022 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c80094b0 con 0x7f82cc15c1d0 2023-11-28T11:57:06.521 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.517+0000 7f82d1011700 1 --2- 172.21.15.39:0/3577369022 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82cc15c1d0 0x7f82cc156510 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f82c400cb40 tx=0x7f82c400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:06.521 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.517+0000 7f82c17fa700 1 -- 172.21.15.39:0/3577369022 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c4007500 con 0x7f82cc15c1d0 2023-11-28T11:57:06.521 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.517+0000 7f82c17fa700 1 -- 172.21.15.39:0/3577369022 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c4007660 con 0x7f82cc15c1d0 2023-11-28T11:57:06.521 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.517+0000 7f82c17fa700 1 -- 172.21.15.39:0/3577369022 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c40079f0 con 0x7f82cc15c1d0 2023-11-28T11:57:06.521 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.517+0000 7f82d1812700 1 -- 172.21.15.39:0/3577369022 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82cc0b61e0 con 0x7f82cc15c1d0 2023-11-28T11:57:06.521 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.517+0000 7f82d1812700 1 -- 172.21.15.39:0/3577369022 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82cc0b5f00 con 0x7f82cc15c1d0 2023-11-28T11:57:06.523 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.517+0000 7f82d1812700 1 -- 172.21.15.39:0/3577369022 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82cc0b64c0 con 0x7f82cc15c1d0 2023-11-28T11:57:06.525 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.521+0000 7f82c17fa700 1 -- 172.21.15.39:0/3577369022 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f82c4019030 con 0x7f82cc15c1d0 2023-11-28T11:57:06.526 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.521+0000 7f82c17fa700 1 --2- 172.21.15.39:0/3577369022 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f82b8064f10 0x7f82b80673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:06.527 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.521+0000 7f82c17fa700 1 -- 172.21.15.39:0/3577369022 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f82c4081ab0 con 0x7f82cc15c1d0 2023-11-28T11:57:06.527 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.521+0000 7f82d0810700 1 --2- 172.21.15.39:0/3577369022 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f82b8064f10 0x7f82b80673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:06.528 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.525+0000 7f82d0810700 1 --2- 172.21.15.39:0/3577369022 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f82b8064f10 0x7f82b80673c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f82c80090b0 tx=0x7f82c801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:06.531 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.525+0000 7f82c17fa700 1 -- 172.21.15.39:0/3577369022 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f82c404f870 con 0x7f82cc15c1d0 2023-11-28T11:57:06.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.693+0000 7f82d1812700 1 -- 172.21.15.39:0/3577369022 --> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f82cc073cb0 con 0x7f82b8064f10 2023-11-28T11:57:06.717 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.713+0000 7f82c17fa700 1 -- 172.21.15.39:0/3577369022 <== mgr.4104 v2:172.21.15.184:6832/36166 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367190 (secure 0 0 0) 0x7f82cc073cb0 con 0x7f82b8064f10 2023-11-28T11:57:06.721 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:57:06.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.725+0000 7f82d1812700 1 -- 172.21.15.39:0/3577369022 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f82b8064f10 msgr2=0x7f82b80673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:06.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.725+0000 7f82d1812700 1 --2- 172.21.15.39:0/3577369022 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f82b8064f10 0x7f82b80673c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f82c80090b0 tx=0x7f82c801c040 comp rx=0 tx=0).stop 2023-11-28T11:57:06.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.725+0000 7f82d1812700 1 -- 172.21.15.39:0/3577369022 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82cc15c1d0 msgr2=0x7f82cc156510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:06.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.725+0000 7f82d1812700 1 --2- 172.21.15.39:0/3577369022 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82cc15c1d0 0x7f82cc156510 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f82c400cb40 tx=0x7f82c400cb70 comp rx=0 tx=0).stop 2023-11-28T11:57:06.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.725+0000 7f82d1812700 1 -- 172.21.15.39:0/3577369022 shutdown_connections 2023-11-28T11:57:06.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.725+0000 7f82d1812700 1 --2- 172.21.15.39:0/3577369022 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82cc15c1d0 0x7f82cc156510 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:06.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.725+0000 7f82d1812700 1 --2- 172.21.15.39:0/3577369022 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f82b8064f10 0x7f82b80673c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:06.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.725+0000 7f82d1812700 1 --2- 172.21.15.39:0/3577369022 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82cc0cfa40 0x7f82cc154100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:06.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.725+0000 7f82d1812700 1 --2- 172.21.15.39:0/3577369022 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f82cc06a600 0x7f82cc14d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:06.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.725+0000 7f82d1812700 1 -- 172.21.15.39:0/3577369022 >> 172.21.15.39:0/3577369022 conn(0x7f82cc06be80 msgr2=0x7f82cc070a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:06.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.725+0000 7f82d1812700 1 -- 172.21.15.39:0/3577369022 shutdown_connections 2023-11-28T11:57:06.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.725+0000 7f82d1812700 1 -- 172.21.15.39:0/3577369022 wait complete. 2023-11-28T11:57:06.730 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2023-11-28T11:57:06.750 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":43,"stamp":"2023-11-28T11:57:06.555761+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594895,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67684,"kb_used_data":3620,"kb_used_omap":0,"kb_used_meta":64000,"kb_avail":754907036,"statfs":{"total":773094113280,"available":773024804864,"internally_reserved":0,"allocated":3706880,"data_stored":2193647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65536000},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005888"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.571140+0000","last_change":"2023-11-28T11:56:43.976015+0000","last_active":"2023-11-28T11:56:44.571140+0000","last_peered":"2023-11-28T11:56:44.571140+0000","last_clean":"2023-11-28T11:56:44.571140+0000","last_became_active":"2023-11-28T11:56:43.975574+0000","last_became_peered":"2023-11-28T11:56:43.975574+0000","last_unstale":"2023-11-28T11:56:44.571140+0000","last_undegraded":"2023-11-28T11:56:44.571140+0000","last_fullsized":"2023-11-28T11:56:44.571140+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:41:50.763478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"24'4","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.992613+0000","last_change":"2023-11-28T11:56:39.473674+0000","last_active":"2023-11-28T11:56:43.992613+0000","last_peered":"2023-11-28T11:56:43.992613+0000","last_clean":"2023-11-28T11:56:43.992613+0000","last_became_active":"2023-11-28T11:56:39.473370+0000","last_became_peered":"2023-11-28T11:56:39.473370+0000","last_unstale":"2023-11-28T11:56:43.992613+0000","last_undegraded":"2023-11-28T11:56:43.992613+0000","last_fullsized":"2023-11-28T11:56:43.992613+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:10:58.488198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.959383+0000","last_change":"2023-11-28T11:56:39.939184+0000","last_active":"2023-11-28T11:56:43.959383+0000","last_peered":"2023-11-28T11:56:43.959383+0000","last_clean":"2023-11-28T11:56:43.959383+0000","last_became_active":"2023-11-28T11:56:39.938917+0000","last_became_peered":"2023-11-28T11:56:39.938917+0000","last_unstale":"2023-11-28T11:56:43.959383+0000","last_undegraded":"2023-11-28T11:56:43.959383+0000","last_fullsized":"2023-11-28T11:56:43.959383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:15:38.977863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.452044+0000","last_change":"2023-11-28T11:56:43.982000+0000","last_active":"2023-11-28T11:56:44.452044+0000","last_peered":"2023-11-28T11:56:44.452044+0000","last_clean":"2023-11-28T11:56:44.452044+0000","last_became_active":"2023-11-28T11:56:43.981537+0000","last_became_peered":"2023-11-28T11:56:43.981537+0000","last_unstale":"2023-11-28T11:56:44.452044+0000","last_undegraded":"2023-11-28T11:56:44.452044+0000","last_fullsized":"2023-11-28T11:56:44.452044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:13:42.258047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"24'1","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.962647+0000","last_change":"2023-11-28T11:56:39.451094+0000","last_active":"2023-11-28T11:56:43.962647+0000","last_peered":"2023-11-28T11:56:43.962647+0000","last_clean":"2023-11-28T11:56:43.962647+0000","last_became_active":"2023-11-28T11:56:39.450680+0000","last_became_peered":"2023-11-28T11:56:39.450680+0000","last_unstale":"2023-11-28T11:56:43.962647+0000","last_undegraded":"2023-11-28T11:56:43.962647+0000","last_fullsized":"2023-11-28T11:56:43.962647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:35:56.115422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952725+0000","last_change":"2023-11-28T11:56:39.938474+0000","last_active":"2023-11-28T11:56:43.952725+0000","last_peered":"2023-11-28T11:56:43.952725+0000","last_clean":"2023-11-28T11:56:43.952725+0000","last_became_active":"2023-11-28T11:56:39.938090+0000","last_became_peered":"2023-11-28T11:56:39.938090+0000","last_unstale":"2023-11-28T11:56:43.952725+0000","last_undegraded":"2023-11-28T11:56:43.952725+0000","last_fullsized":"2023-11-28T11:56:43.952725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:13:17.325195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.570857+0000","last_change":"2023-11-28T11:56:43.992668+0000","last_active":"2023-11-28T11:56:44.570857+0000","last_peered":"2023-11-28T11:56:44.570857+0000","last_clean":"2023-11-28T11:56:44.570857+0000","last_became_active":"2023-11-28T11:56:43.991547+0000","last_became_peered":"2023-11-28T11:56:43.991547+0000","last_unstale":"2023-11-28T11:56:44.570857+0000","last_undegraded":"2023-11-28T11:56:44.570857+0000","last_fullsized":"2023-11-28T11:56:44.570857+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:20:35.086687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"24'2","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.966791+0000","last_change":"2023-11-28T11:56:39.464222+0000","last_active":"2023-11-28T11:56:43.966791+0000","last_peered":"2023-11-28T11:56:43.966791+0000","last_clean":"2023-11-28T11:56:43.966791+0000","last_became_active":"2023-11-28T11:56:39.463797+0000","last_became_peered":"2023-11-28T11:56:39.463797+0000","last_unstale":"2023-11-28T11:56:43.966791+0000","last_undegraded":"2023-11-28T11:56:43.966791+0000","last_fullsized":"2023-11-28T11:56:43.966791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:52:48.600084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.959592+0000","last_change":"2023-11-28T11:56:39.932813+0000","last_active":"2023-11-28T11:56:43.959592+0000","last_peered":"2023-11-28T11:56:43.959592+0000","last_clean":"2023-11-28T11:56:43.959592+0000","last_became_active":"2023-11-28T11:56:39.928772+0000","last_became_peered":"2023-11-28T11:56:39.928772+0000","last_unstale":"2023-11-28T11:56:43.959592+0000","last_undegraded":"2023-11-28T11:56:43.959592+0000","last_fullsized":"2023-11-28T11:56:43.959592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:10:06.958523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.572062+0000","last_change":"2023-11-28T11:56:43.979370+0000","last_active":"2023-11-28T11:56:44.572062+0000","last_peered":"2023-11-28T11:56:44.572062+0000","last_clean":"2023-11-28T11:56:44.572062+0000","last_became_active":"2023-11-28T11:56:43.978938+0000","last_became_peered":"2023-11-28T11:56:43.978938+0000","last_unstale":"2023-11-28T11:56:44.572062+0000","last_undegraded":"2023-11-28T11:56:44.572062+0000","last_fullsized":"2023-11-28T11:56:44.572062+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:03:18.915760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.963646+0000","last_change":"2023-11-28T11:56:39.468476+0000","last_active":"2023-11-28T11:56:43.963646+0000","last_peered":"2023-11-28T11:56:43.963646+0000","last_clean":"2023-11-28T11:56:43.963646+0000","last_became_active":"2023-11-28T11:56:39.468201+0000","last_became_peered":"2023-11-28T11:56:39.468201+0000","last_unstale":"2023-11-28T11:56:43.963646+0000","last_undegraded":"2023-11-28T11:56:43.963646+0000","last_fullsized":"2023-11-28T11:56:43.963646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:30:31.377988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.959975+0000","last_change":"2023-11-28T11:56:39.928619+0000","last_active":"2023-11-28T11:56:43.959975+0000","last_peered":"2023-11-28T11:56:43.959975+0000","last_clean":"2023-11-28T11:56:43.959975+0000","last_became_active":"2023-11-28T11:56:39.928248+0000","last_became_peered":"2023-11-28T11:56:39.928248+0000","last_unstale":"2023-11-28T11:56:43.959975+0000","last_undegraded":"2023-11-28T11:56:43.959975+0000","last_fullsized":"2023-11-28T11:56:43.959975+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:24:26.563114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.574561+0000","last_change":"2023-11-28T11:56:43.998827+0000","last_active":"2023-11-28T11:56:44.574561+0000","last_peered":"2023-11-28T11:56:44.574561+0000","last_clean":"2023-11-28T11:56:44.574561+0000","last_became_active":"2023-11-28T11:56:43.998452+0000","last_became_peered":"2023-11-28T11:56:43.998452+0000","last_unstale":"2023-11-28T11:56:44.574561+0000","last_undegraded":"2023-11-28T11:56:44.574561+0000","last_fullsized":"2023-11-28T11:56:44.574561+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:34:39.710811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"24'1","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960780+0000","last_change":"2023-11-28T11:56:39.468234+0000","last_active":"2023-11-28T11:56:43.960780+0000","last_peered":"2023-11-28T11:56:43.960780+0000","last_clean":"2023-11-28T11:56:43.960780+0000","last_became_active":"2023-11-28T11:56:39.467925+0000","last_became_peered":"2023-11-28T11:56:39.467925+0000","last_unstale":"2023-11-28T11:56:43.960780+0000","last_undegraded":"2023-11-28T11:56:43.960780+0000","last_fullsized":"2023-11-28T11:56:43.960780+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:55:31.090691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.964769+0000","last_change":"2023-11-28T11:56:39.949606+0000","last_active":"2023-11-28T11:56:43.964769+0000","last_peered":"2023-11-28T11:56:43.964769+0000","last_clean":"2023-11-28T11:56:43.964769+0000","last_became_active":"2023-11-28T11:56:39.949364+0000","last_became_peered":"2023-11-28T11:56:39.949364+0000","last_unstale":"2023-11-28T11:56:43.964769+0000","last_undegraded":"2023-11-28T11:56:43.964769+0000","last_fullsized":"2023-11-28T11:56:43.964769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:02:46.928803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.453070+0000","last_change":"2023-11-28T11:56:43.992539+0000","last_active":"2023-11-28T11:56:44.453070+0000","last_peered":"2023-11-28T11:56:44.453070+0000","last_clean":"2023-11-28T11:56:44.453070+0000","last_became_active":"2023-11-28T11:56:43.992153+0000","last_became_peered":"2023-11-28T11:56:43.992153+0000","last_unstale":"2023-11-28T11:56:44.453070+0000","last_undegraded":"2023-11-28T11:56:44.453070+0000","last_fullsized":"2023-11-28T11:56:44.453070+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:33:16.305779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.959859+0000","last_change":"2023-11-28T11:56:39.470430+0000","last_active":"2023-11-28T11:56:43.959859+0000","last_peered":"2023-11-28T11:56:43.959859+0000","last_clean":"2023-11-28T11:56:43.959859+0000","last_became_active":"2023-11-28T11:56:39.470148+0000","last_became_peered":"2023-11-28T11:56:39.470148+0000","last_unstale":"2023-11-28T11:56:43.959859+0000","last_undegraded":"2023-11-28T11:56:43.959859+0000","last_fullsized":"2023-11-28T11:56:43.959859+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:26:50.340796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.958145+0000","last_change":"2023-11-28T11:56:39.951730+0000","last_active":"2023-11-28T11:56:43.958145+0000","last_peered":"2023-11-28T11:56:43.958145+0000","last_clean":"2023-11-28T11:56:43.958145+0000","last_became_active":"2023-11-28T11:56:39.951434+0000","last_became_peered":"2023-11-28T11:56:39.951434+0000","last_unstale":"2023-11-28T11:56:43.958145+0000","last_undegraded":"2023-11-28T11:56:43.958145+0000","last_fullsized":"2023-11-28T11:56:43.958145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:15:38.977863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.452332+0000","last_change":"2023-11-28T11:56:43.970823+0000","last_active":"2023-11-28T11:56:44.452332+0000","last_peered":"2023-11-28T11:56:44.452332+0000","last_clean":"2023-11-28T11:56:44.452332+0000","last_became_active":"2023-11-28T11:56:43.970344+0000","last_became_peered":"2023-11-28T11:56:43.970344+0000","last_unstale":"2023-11-28T11:56:44.452332+0000","last_undegraded":"2023-11-28T11:56:44.452332+0000","last_fullsized":"2023-11-28T11:56:44.452332+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:10:38.878879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.965575+0000","last_change":"2023-11-28T11:56:39.469964+0000","last_active":"2023-11-28T11:56:43.965575+0000","last_peered":"2023-11-28T11:56:43.965575+0000","last_clean":"2023-11-28T11:56:43.965575+0000","last_became_active":"2023-11-28T11:56:39.469642+0000","last_became_peered":"2023-11-28T11:56:39.469642+0000","last_unstale":"2023-11-28T11:56:43.965575+0000","last_undegraded":"2023-11-28T11:56:43.965575+0000","last_fullsized":"2023-11-28T11:56:43.965575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:52:05.494184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.973209+0000","last_change":"2023-11-28T11:56:39.935588+0000","last_active":"2023-11-28T11:56:43.973209+0000","last_peered":"2023-11-28T11:56:43.973209+0000","last_clean":"2023-11-28T11:56:43.973209+0000","last_became_active":"2023-11-28T11:56:39.935271+0000","last_became_peered":"2023-11-28T11:56:39.935271+0000","last_unstale":"2023-11-28T11:56:43.973209+0000","last_undegraded":"2023-11-28T11:56:43.973209+0000","last_fullsized":"2023-11-28T11:56:43.973209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:58:24.629436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.458194+0000","last_change":"2023-11-28T11:56:43.990219+0000","last_active":"2023-11-28T11:56:44.458194+0000","last_peered":"2023-11-28T11:56:44.458194+0000","last_clean":"2023-11-28T11:56:44.458194+0000","last_became_active":"2023-11-28T11:56:43.981571+0000","last_became_peered":"2023-11-28T11:56:43.981571+0000","last_unstale":"2023-11-28T11:56:44.458194+0000","last_undegraded":"2023-11-28T11:56:44.458194+0000","last_fullsized":"2023-11-28T11:56:44.458194+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:46:26.561526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952505+0000","last_change":"2023-11-28T11:56:39.464266+0000","last_active":"2023-11-28T11:56:43.952505+0000","last_peered":"2023-11-28T11:56:43.952505+0000","last_clean":"2023-11-28T11:56:43.952505+0000","last_became_active":"2023-11-28T11:56:39.463801+0000","last_became_peered":"2023-11-28T11:56:39.463801+0000","last_unstale":"2023-11-28T11:56:43.952505+0000","last_undegraded":"2023-11-28T11:56:43.952505+0000","last_fullsized":"2023-11-28T11:56:43.952505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:49:49.321158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.956171+0000","last_change":"2023-11-28T11:56:39.951261+0000","last_active":"2023-11-28T11:56:43.956171+0000","last_peered":"2023-11-28T11:56:43.956171+0000","last_clean":"2023-11-28T11:56:43.956171+0000","last_became_active":"2023-11-28T11:56:39.950979+0000","last_became_peered":"2023-11-28T11:56:39.950979+0000","last_unstale":"2023-11-28T11:56:43.956171+0000","last_undegraded":"2023-11-28T11:56:43.956171+0000","last_fullsized":"2023-11-28T11:56:43.956171+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:57:45.608044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952252+0000","last_change":"2023-11-28T11:56:39.944382+0000","last_active":"2023-11-28T11:56:43.952252+0000","last_peered":"2023-11-28T11:56:43.952252+0000","last_clean":"2023-11-28T11:56:43.952252+0000","last_became_active":"2023-11-28T11:56:39.944076+0000","last_became_peered":"2023-11-28T11:56:39.944076+0000","last_unstale":"2023-11-28T11:56:43.952252+0000","last_undegraded":"2023-11-28T11:56:43.952252+0000","last_fullsized":"2023-11-28T11:56:43.952252+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:39:50.872604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.992745+0000","last_change":"2023-11-28T11:56:39.473681+0000","last_active":"2023-11-28T11:56:43.992745+0000","last_peered":"2023-11-28T11:56:43.992745+0000","last_clean":"2023-11-28T11:56:43.992745+0000","last_became_active":"2023-11-28T11:56:39.473403+0000","last_became_peered":"2023-11-28T11:56:39.473403+0000","last_unstale":"2023-11-28T11:56:43.992745+0000","last_undegraded":"2023-11-28T11:56:43.992745+0000","last_fullsized":"2023-11-28T11:56:43.992745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:37:08.555596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.453581+0000","last_change":"2023-11-28T11:56:43.973549+0000","last_active":"2023-11-28T11:56:44.453581+0000","last_peered":"2023-11-28T11:56:44.453581+0000","last_clean":"2023-11-28T11:56:44.453581+0000","last_became_active":"2023-11-28T11:56:43.968940+0000","last_became_peered":"2023-11-28T11:56:43.968940+0000","last_unstale":"2023-11-28T11:56:44.453581+0000","last_undegraded":"2023-11-28T11:56:44.453581+0000","last_fullsized":"2023-11-28T11:56:44.453581+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:14:02.695573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952607+0000","last_change":"2023-11-28T11:56:39.937083+0000","last_active":"2023-11-28T11:56:43.952607+0000","last_peered":"2023-11-28T11:56:43.952607+0000","last_clean":"2023-11-28T11:56:43.952607+0000","last_became_active":"2023-11-28T11:56:39.935699+0000","last_became_peered":"2023-11-28T11:56:39.935699+0000","last_unstale":"2023-11-28T11:56:43.952607+0000","last_undegraded":"2023-11-28T11:56:43.952607+0000","last_fullsized":"2023-11-28T11:56:43.952607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:53:07.604891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.961314+0000","last_change":"2023-11-28T11:56:39.470488+0000","last_active":"2023-11-28T11:56:43.961314+0000","last_peered":"2023-11-28T11:56:43.961314+0000","last_clean":"2023-11-28T11:56:43.961314+0000","last_became_active":"2023-11-28T11:56:39.470200+0000","last_became_peered":"2023-11-28T11:56:39.470200+0000","last_unstale":"2023-11-28T11:56:43.961314+0000","last_undegraded":"2023-11-28T11:56:43.961314+0000","last_fullsized":"2023-11-28T11:56:43.961314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:09:04.506578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.571178+0000","last_change":"2023-11-28T11:56:43.991311+0000","last_active":"2023-11-28T11:56:44.571178+0000","last_peered":"2023-11-28T11:56:44.571178+0000","last_clean":"2023-11-28T11:56:44.571178+0000","last_became_active":"2023-11-28T11:56:43.990921+0000","last_became_peered":"2023-11-28T11:56:43.990921+0000","last_unstale":"2023-11-28T11:56:44.571178+0000","last_undegraded":"2023-11-28T11:56:44.571178+0000","last_fullsized":"2023-11-28T11:56:44.571178+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:34:39.710811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"24'3","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.953829+0000","last_change":"2023-11-28T11:56:39.472359+0000","last_active":"2023-11-28T11:56:43.953829+0000","last_peered":"2023-11-28T11:56:43.953829+0000","last_clean":"2023-11-28T11:56:43.953829+0000","last_became_active":"2023-11-28T11:56:39.471986+0000","last_became_peered":"2023-11-28T11:56:39.471986+0000","last_unstale":"2023-11-28T11:56:43.953829+0000","last_undegraded":"2023-11-28T11:56:43.953829+0000","last_fullsized":"2023-11-28T11:56:43.953829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:03:49.467652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.966867+0000","last_change":"2023-11-28T11:56:39.944231+0000","last_active":"2023-11-28T11:56:43.966867+0000","last_peered":"2023-11-28T11:56:43.966867+0000","last_clean":"2023-11-28T11:56:43.966867+0000","last_became_active":"2023-11-28T11:56:39.943953+0000","last_became_peered":"2023-11-28T11:56:39.943953+0000","last_unstale":"2023-11-28T11:56:43.966867+0000","last_undegraded":"2023-11-28T11:56:43.966867+0000","last_fullsized":"2023-11-28T11:56:43.966867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:39:50.872604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.572486+0000","last_change":"2023-11-28T11:56:43.983283+0000","last_active":"2023-11-28T11:56:44.572486+0000","last_peered":"2023-11-28T11:56:44.572486+0000","last_clean":"2023-11-28T11:56:44.572486+0000","last_became_active":"2023-11-28T11:56:43.982914+0000","last_became_peered":"2023-11-28T11:56:43.982914+0000","last_unstale":"2023-11-28T11:56:44.572486+0000","last_undegraded":"2023-11-28T11:56:44.572486+0000","last_fullsized":"2023-11-28T11:56:44.572486+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:57:38.845826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"29'10","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:57.078587+0000","last_change":"2023-11-28T11:56:39.466223+0000","last_active":"2023-11-28T11:56:57.078587+0000","last_peered":"2023-11-28T11:56:57.078587+0000","last_clean":"2023-11-28T11:56:57.078587+0000","last_became_active":"2023-11-28T11:56:39.461006+0000","last_became_peered":"2023-11-28T11:56:39.461006+0000","last_unstale":"2023-11-28T11:56:57.078587+0000","last_undegraded":"2023-11-28T11:56:57.078587+0000","last_fullsized":"2023-11-28T11:56:57.078587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:55:09.019742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3745,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960058+0000","last_change":"2023-11-28T11:56:39.928004+0000","last_active":"2023-11-28T11:56:43.960058+0000","last_peered":"2023-11-28T11:56:43.960058+0000","last_clean":"2023-11-28T11:56:43.960058+0000","last_became_active":"2023-11-28T11:56:39.927741+0000","last_became_peered":"2023-11-28T11:56:39.927741+0000","last_unstale":"2023-11-28T11:56:43.960058+0000","last_undegraded":"2023-11-28T11:56:43.960058+0000","last_fullsized":"2023-11-28T11:56:43.960058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:13:59.194749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.574749+0000","last_change":"2023-11-28T11:56:43.983971+0000","last_active":"2023-11-28T11:56:44.574749+0000","last_peered":"2023-11-28T11:56:44.574749+0000","last_clean":"2023-11-28T11:56:44.574749+0000","last_became_active":"2023-11-28T11:56:43.983532+0000","last_became_peered":"2023-11-28T11:56:43.983532+0000","last_unstale":"2023-11-28T11:56:44.574749+0000","last_undegraded":"2023-11-28T11:56:44.574749+0000","last_fullsized":"2023-11-28T11:56:44.574749+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:03:18.915760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960769+0000","last_change":"2023-11-28T11:56:39.937495+0000","last_active":"2023-11-28T11:56:43.960769+0000","last_peered":"2023-11-28T11:56:43.960769+0000","last_clean":"2023-11-28T11:56:43.960769+0000","last_became_active":"2023-11-28T11:56:39.937200+0000","last_became_peered":"2023-11-28T11:56:39.937200+0000","last_unstale":"2023-11-28T11:56:43.960769+0000","last_undegraded":"2023-11-28T11:56:43.960769+0000","last_fullsized":"2023-11-28T11:56:43.960769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:44:11.120518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.956246+0000","last_change":"2023-11-28T11:56:34.384408+0000","last_active":"2023-11-28T11:56:43.956246+0000","last_peered":"2023-11-28T11:56:43.956246+0000","last_clean":"2023-11-28T11:56:43.956246+0000","last_became_active":"2023-11-28T11:56:34.384036+0000","last_became_peered":"2023-11-28T11:56:34.384036+0000","last_unstale":"2023-11-28T11:56:43.956246+0000","last_undegraded":"2023-11-28T11:56:43.956246+0000","last_fullsized":"2023-11-28T11:56:43.956246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:58:55.003786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'1","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.458376+0000","last_change":"2023-11-28T11:56:39.470484+0000","last_active":"2023-11-28T11:56:44.458376+0000","last_peered":"2023-11-28T11:56:44.458376+0000","last_clean":"2023-11-28T11:56:44.458376+0000","last_became_active":"2023-11-28T11:56:39.469964+0000","last_became_peered":"2023-11-28T11:56:39.469964+0000","last_unstale":"2023-11-28T11:56:44.458376+0000","last_undegraded":"2023-11-28T11:56:44.458376+0000","last_fullsized":"2023-11-28T11:56:44.458376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:31:51.668232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.571117+0000","last_change":"2023-11-28T11:56:43.992603+0000","last_active":"2023-11-28T11:56:44.571117+0000","last_peered":"2023-11-28T11:56:44.571117+0000","last_clean":"2023-11-28T11:56:44.571117+0000","last_became_active":"2023-11-28T11:56:43.992111+0000","last_became_peered":"2023-11-28T11:56:43.992111+0000","last_unstale":"2023-11-28T11:56:44.571117+0000","last_undegraded":"2023-11-28T11:56:44.571117+0000","last_fullsized":"2023-11-28T11:56:44.571117+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:18:10.194854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952381+0000","last_change":"2023-11-28T11:56:39.935642+0000","last_active":"2023-11-28T11:56:43.952381+0000","last_peered":"2023-11-28T11:56:43.952381+0000","last_clean":"2023-11-28T11:56:43.952381+0000","last_became_active":"2023-11-28T11:56:39.935396+0000","last_became_peered":"2023-11-28T11:56:39.935396+0000","last_unstale":"2023-11-28T11:56:43.952381+0000","last_undegraded":"2023-11-28T11:56:43.952381+0000","last_fullsized":"2023-11-28T11:56:43.952381+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:08:24.197240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.971041+0000","last_change":"2023-11-28T11:56:34.384088+0000","last_active":"2023-11-28T11:56:43.971041+0000","last_peered":"2023-11-28T11:56:43.971041+0000","last_clean":"2023-11-28T11:56:43.971041+0000","last_became_active":"2023-11-28T11:56:34.383631+0000","last_became_peered":"2023-11-28T11:56:34.383631+0000","last_unstale":"2023-11-28T11:56:43.971041+0000","last_undegraded":"2023-11-28T11:56:43.971041+0000","last_fullsized":"2023-11-28T11:56:43.971041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:15:42.772333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"24'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.959213+0000","last_change":"2023-11-28T11:56:39.458173+0000","last_active":"2023-11-28T11:56:43.959213+0000","last_peered":"2023-11-28T11:56:43.959213+0000","last_clean":"2023-11-28T11:56:43.959213+0000","last_became_active":"2023-11-28T11:56:39.457898+0000","last_became_peered":"2023-11-28T11:56:39.457898+0000","last_unstale":"2023-11-28T11:56:43.959213+0000","last_undegraded":"2023-11-28T11:56:43.959213+0000","last_fullsized":"2023-11-28T11:56:43.959213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:54.418908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.452674+0000","last_change":"2023-11-28T11:56:43.982368+0000","last_active":"2023-11-28T11:56:44.452674+0000","last_peered":"2023-11-28T11:56:44.452674+0000","last_clean":"2023-11-28T11:56:44.452674+0000","last_became_active":"2023-11-28T11:56:43.981885+0000","last_became_peered":"2023-11-28T11:56:43.981885+0000","last_unstale":"2023-11-28T11:56:44.452674+0000","last_undegraded":"2023-11-28T11:56:44.452674+0000","last_fullsized":"2023-11-28T11:56:44.452674+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:01:03.447360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960222+0000","last_change":"2023-11-28T11:56:39.937832+0000","last_active":"2023-11-28T11:56:43.960222+0000","last_peered":"2023-11-28T11:56:43.960222+0000","last_clean":"2023-11-28T11:56:43.960222+0000","last_became_active":"2023-11-28T11:56:39.937160+0000","last_became_peered":"2023-11-28T11:56:39.937160+0000","last_unstale":"2023-11-28T11:56:43.960222+0000","last_undegraded":"2023-11-28T11:56:43.960222+0000","last_fullsized":"2023-11-28T11:56:43.960222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:44.472020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.954123+0000","last_change":"2023-11-28T11:56:34.386399+0000","last_active":"2023-11-28T11:56:43.954123+0000","last_peered":"2023-11-28T11:56:43.954123+0000","last_clean":"2023-11-28T11:56:43.954123+0000","last_became_active":"2023-11-28T11:56:34.385994+0000","last_became_peered":"2023-11-28T11:56:34.385994+0000","last_unstale":"2023-11-28T11:56:43.954123+0000","last_undegraded":"2023-11-28T11:56:43.954123+0000","last_fullsized":"2023-11-28T11:56:43.954123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:58:02.172295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.968562+0000","last_change":"2023-11-28T11:56:39.469089+0000","last_active":"2023-11-28T11:56:43.968562+0000","last_peered":"2023-11-28T11:56:43.968562+0000","last_clean":"2023-11-28T11:56:43.968562+0000","last_became_active":"2023-11-28T11:56:39.468762+0000","last_became_peered":"2023-11-28T11:56:39.468762+0000","last_unstale":"2023-11-28T11:56:43.968562+0000","last_undegraded":"2023-11-28T11:56:43.968562+0000","last_fullsized":"2023-11-28T11:56:43.968562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:15:59.693915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.452323+0000","last_change":"2023-11-28T11:56:43.994532+0000","last_active":"2023-11-28T11:56:44.452323+0000","last_peered":"2023-11-28T11:56:44.452323+0000","last_clean":"2023-11-28T11:56:44.452323+0000","last_became_active":"2023-11-28T11:56:43.993975+0000","last_became_peered":"2023-11-28T11:56:43.993975+0000","last_unstale":"2023-11-28T11:56:44.452323+0000","last_undegraded":"2023-11-28T11:56:44.452323+0000","last_fullsized":"2023-11-28T11:56:44.452323+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:09:56.519261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.967511+0000","last_change":"2023-11-28T11:56:39.947689+0000","last_active":"2023-11-28T11:56:43.967511+0000","last_peered":"2023-11-28T11:56:43.967511+0000","last_clean":"2023-11-28T11:56:43.967511+0000","last_became_active":"2023-11-28T11:56:39.947425+0000","last_became_peered":"2023-11-28T11:56:39.947425+0000","last_unstale":"2023-11-28T11:56:43.967511+0000","last_undegraded":"2023-11-28T11:56:43.967511+0000","last_fullsized":"2023-11-28T11:56:43.967511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:49:14.776024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.968711+0000","last_change":"2023-11-28T11:56:34.384999+0000","last_active":"2023-11-28T11:56:43.968711+0000","last_peered":"2023-11-28T11:56:43.968711+0000","last_clean":"2023-11-28T11:56:43.968711+0000","last_became_active":"2023-11-28T11:56:34.384531+0000","last_became_peered":"2023-11-28T11:56:34.384531+0000","last_unstale":"2023-11-28T11:56:43.968711+0000","last_undegraded":"2023-11-28T11:56:43.968711+0000","last_fullsized":"2023-11-28T11:56:43.968711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:09:50.083366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.966872+0000","last_change":"2023-11-28T11:56:39.468628+0000","last_active":"2023-11-28T11:56:43.966872+0000","last_peered":"2023-11-28T11:56:43.966872+0000","last_clean":"2023-11-28T11:56:43.966872+0000","last_became_active":"2023-11-28T11:56:39.467602+0000","last_became_peered":"2023-11-28T11:56:39.467602+0000","last_unstale":"2023-11-28T11:56:43.966872+0000","last_undegraded":"2023-11-28T11:56:43.966872+0000","last_fullsized":"2023-11-28T11:56:43.966872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:49:49.321158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.457910+0000","last_change":"2023-11-28T11:56:43.989103+0000","last_active":"2023-11-28T11:56:44.457910+0000","last_peered":"2023-11-28T11:56:44.457910+0000","last_clean":"2023-11-28T11:56:44.457910+0000","last_became_active":"2023-11-28T11:56:43.981649+0000","last_became_peered":"2023-11-28T11:56:43.981649+0000","last_unstale":"2023-11-28T11:56:44.457910+0000","last_undegraded":"2023-11-28T11:56:44.457910+0000","last_fullsized":"2023-11-28T11:56:44.457910+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:38:25.615361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.968481+0000","last_change":"2023-11-28T11:56:39.942485+0000","last_active":"2023-11-28T11:56:43.968481+0000","last_peered":"2023-11-28T11:56:43.968481+0000","last_clean":"2023-11-28T11:56:43.968481+0000","last_became_active":"2023-11-28T11:56:39.941112+0000","last_became_peered":"2023-11-28T11:56:39.941112+0000","last_unstale":"2023-11-28T11:56:43.968481+0000","last_undegraded":"2023-11-28T11:56:43.968481+0000","last_fullsized":"2023-11-28T11:56:43.968481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:47:39.671110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960251+0000","last_change":"2023-11-28T11:56:39.467432+0000","last_active":"2023-11-28T11:56:43.960251+0000","last_peered":"2023-11-28T11:56:43.960251+0000","last_clean":"2023-11-28T11:56:43.960251+0000","last_became_active":"2023-11-28T11:56:39.466982+0000","last_became_peered":"2023-11-28T11:56:39.466982+0000","last_unstale":"2023-11-28T11:56:43.960251+0000","last_undegraded":"2023-11-28T11:56:43.960251+0000","last_fullsized":"2023-11-28T11:56:43.960251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:35:56.115422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.965360+0000","last_change":"2023-11-28T11:56:34.389076+0000","last_active":"2023-11-28T11:56:43.965360+0000","last_peered":"2023-11-28T11:56:43.965360+0000","last_clean":"2023-11-28T11:56:43.965360+0000","last_became_active":"2023-11-28T11:56:34.388689+0000","last_became_peered":"2023-11-28T11:56:34.388689+0000","last_unstale":"2023-11-28T11:56:43.965360+0000","last_undegraded":"2023-11-28T11:56:43.965360+0000","last_fullsized":"2023-11-28T11:56:43.965360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:20.936349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.457737+0000","last_change":"2023-11-28T11:56:43.989060+0000","last_active":"2023-11-28T11:56:44.457737+0000","last_peered":"2023-11-28T11:56:44.457737+0000","last_clean":"2023-11-28T11:56:44.457737+0000","last_became_active":"2023-11-28T11:56:43.981599+0000","last_became_peered":"2023-11-28T11:56:43.981599+0000","last_unstale":"2023-11-28T11:56:44.457737+0000","last_undegraded":"2023-11-28T11:56:44.457737+0000","last_fullsized":"2023-11-28T11:56:44.457737+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:04:37.482968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.971330+0000","last_change":"2023-11-28T11:56:39.953419+0000","last_active":"2023-11-28T11:56:43.971330+0000","last_peered":"2023-11-28T11:56:43.971330+0000","last_clean":"2023-11-28T11:56:43.971330+0000","last_became_active":"2023-11-28T11:56:39.950287+0000","last_became_peered":"2023-11-28T11:56:39.950287+0000","last_unstale":"2023-11-28T11:56:43.971330+0000","last_undegraded":"2023-11-28T11:56:43.971330+0000","last_fullsized":"2023-11-28T11:56:43.971330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:15:38.977863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.965505+0000","last_change":"2023-11-28T11:56:39.467239+0000","last_active":"2023-11-28T11:56:43.965505+0000","last_peered":"2023-11-28T11:56:43.965505+0000","last_clean":"2023-11-28T11:56:43.965505+0000","last_became_active":"2023-11-28T11:56:39.466964+0000","last_became_peered":"2023-11-28T11:56:39.466964+0000","last_unstale":"2023-11-28T11:56:43.965505+0000","last_undegraded":"2023-11-28T11:56:43.965505+0000","last_fullsized":"2023-11-28T11:56:43.965505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:54.418908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.962524+0000","last_change":"2023-11-28T11:56:34.486178+0000","last_active":"2023-11-28T11:56:43.962524+0000","last_peered":"2023-11-28T11:56:43.962524+0000","last_clean":"2023-11-28T11:56:43.962524+0000","last_became_active":"2023-11-28T11:56:34.485702+0000","last_became_peered":"2023-11-28T11:56:34.485702+0000","last_unstale":"2023-11-28T11:56:43.962524+0000","last_undegraded":"2023-11-28T11:56:43.962524+0000","last_fullsized":"2023-11-28T11:56:43.962524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:06.323407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.570721+0000","last_change":"2023-11-28T11:56:43.979672+0000","last_active":"2023-11-28T11:56:44.570721+0000","last_peered":"2023-11-28T11:56:44.570721+0000","last_clean":"2023-11-28T11:56:44.570721+0000","last_became_active":"2023-11-28T11:56:43.978974+0000","last_became_peered":"2023-11-28T11:56:43.978974+0000","last_unstale":"2023-11-28T11:56:44.570721+0000","last_undegraded":"2023-11-28T11:56:44.570721+0000","last_fullsized":"2023-11-28T11:56:44.570721+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:15.285239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.974511+0000","last_change":"2023-11-28T11:56:39.957142+0000","last_active":"2023-11-28T11:56:43.974511+0000","last_peered":"2023-11-28T11:56:43.974511+0000","last_clean":"2023-11-28T11:56:43.974511+0000","last_became_active":"2023-11-28T11:56:39.956844+0000","last_became_peered":"2023-11-28T11:56:39.956844+0000","last_unstale":"2023-11-28T11:56:43.974511+0000","last_undegraded":"2023-11-28T11:56:43.974511+0000","last_fullsized":"2023-11-28T11:56:43.974511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:04.287216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.957703+0000","last_change":"2023-11-28T11:56:39.474271+0000","last_active":"2023-11-28T11:56:43.957703+0000","last_peered":"2023-11-28T11:56:43.957703+0000","last_clean":"2023-11-28T11:56:43.957703+0000","last_became_active":"2023-11-28T11:56:39.473993+0000","last_became_peered":"2023-11-28T11:56:39.473993+0000","last_unstale":"2023-11-28T11:56:43.957703+0000","last_undegraded":"2023-11-28T11:56:43.957703+0000","last_fullsized":"2023-11-28T11:56:43.957703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:20:01.703553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952292+0000","last_change":"2023-11-28T11:56:34.387293+0000","last_active":"2023-11-28T11:56:43.952292+0000","last_peered":"2023-11-28T11:56:43.952292+0000","last_clean":"2023-11-28T11:56:43.952292+0000","last_became_active":"2023-11-28T11:56:34.386976+0000","last_became_peered":"2023-11-28T11:56:34.386976+0000","last_unstale":"2023-11-28T11:56:43.952292+0000","last_undegraded":"2023-11-28T11:56:43.952292+0000","last_fullsized":"2023-11-28T11:56:43.952292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:32.704729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.570544+0000","last_change":"2023-11-28T11:56:43.995313+0000","last_active":"2023-11-28T11:56:44.570544+0000","last_peered":"2023-11-28T11:56:44.570544+0000","last_clean":"2023-11-28T11:56:44.570544+0000","last_became_active":"2023-11-28T11:56:43.994793+0000","last_became_peered":"2023-11-28T11:56:43.994793+0000","last_unstale":"2023-11-28T11:56:44.570544+0000","last_undegraded":"2023-11-28T11:56:44.570544+0000","last_fullsized":"2023-11-28T11:56:44.570544+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:38:23.071293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.953439+0000","last_change":"2023-11-28T11:56:39.927130+0000","last_active":"2023-11-28T11:56:43.953439+0000","last_peered":"2023-11-28T11:56:43.953439+0000","last_clean":"2023-11-28T11:56:43.953439+0000","last_became_active":"2023-11-28T11:56:39.926834+0000","last_became_peered":"2023-11-28T11:56:39.926834+0000","last_unstale":"2023-11-28T11:56:43.953439+0000","last_undegraded":"2023-11-28T11:56:43.953439+0000","last_fullsized":"2023-11-28T11:56:43.953439+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:03:50.474199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952514+0000","last_change":"2023-11-28T11:56:39.460516+0000","last_active":"2023-11-28T11:56:43.952514+0000","last_peered":"2023-11-28T11:56:43.952514+0000","last_clean":"2023-11-28T11:56:43.952514+0000","last_became_active":"2023-11-28T11:56:39.460151+0000","last_became_peered":"2023-11-28T11:56:39.460151+0000","last_unstale":"2023-11-28T11:56:43.952514+0000","last_undegraded":"2023-11-28T11:56:43.952514+0000","last_fullsized":"2023-11-28T11:56:43.952514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:52:05.494184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.972495+0000","last_change":"2023-11-28T11:56:34.389222+0000","last_active":"2023-11-28T11:56:43.972495+0000","last_peered":"2023-11-28T11:56:43.972495+0000","last_clean":"2023-11-28T11:56:43.972495+0000","last_became_active":"2023-11-28T11:56:34.388671+0000","last_became_peered":"2023-11-28T11:56:34.388671+0000","last_unstale":"2023-11-28T11:56:43.972495+0000","last_undegraded":"2023-11-28T11:56:43.972495+0000","last_fullsized":"2023-11-28T11:56:43.972495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:32.704729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952429+0000","last_change":"2023-11-28T11:56:28.472008+0000","last_active":"2023-11-28T11:56:43.952429+0000","last_peered":"2023-11-28T11:56:43.952429+0000","last_clean":"2023-11-28T11:56:43.952429+0000","last_became_active":"2023-11-28T11:56:28.469273+0000","last_became_peered":"2023-11-28T11:56:28.469273+0000","last_unstale":"2023-11-28T11:56:43.952429+0000","last_undegraded":"2023-11-28T11:56:43.952429+0000","last_fullsized":"2023-11-28T11:56:43.952429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:27.291192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:27.291192+0000","last_clean_scrub_stamp":"2023-11-28T11:56:27.291192+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:14:48.860420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.571768+0000","last_change":"2023-11-28T11:56:43.982227+0000","last_active":"2023-11-28T11:56:44.571768+0000","last_peered":"2023-11-28T11:56:44.571768+0000","last_clean":"2023-11-28T11:56:44.571768+0000","last_became_active":"2023-11-28T11:56:43.980406+0000","last_became_peered":"2023-11-28T11:56:43.980406+0000","last_unstale":"2023-11-28T11:56:44.571768+0000","last_undegraded":"2023-11-28T11:56:44.571768+0000","last_fullsized":"2023-11-28T11:56:44.571768+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:18:10.194854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.971411+0000","last_change":"2023-11-28T11:56:39.945082+0000","last_active":"2023-11-28T11:56:43.971411+0000","last_peered":"2023-11-28T11:56:43.971411+0000","last_clean":"2023-11-28T11:56:43.971411+0000","last_became_active":"2023-11-28T11:56:39.943905+0000","last_became_peered":"2023-11-28T11:56:39.943905+0000","last_unstale":"2023-11-28T11:56:43.971411+0000","last_undegraded":"2023-11-28T11:56:43.971411+0000","last_fullsized":"2023-11-28T11:56:43.971411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:59:04.313406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952622+0000","last_change":"2023-11-28T11:56:39.465139+0000","last_active":"2023-11-28T11:56:43.952622+0000","last_peered":"2023-11-28T11:56:43.952622+0000","last_clean":"2023-11-28T11:56:43.952622+0000","last_became_active":"2023-11-28T11:56:39.464873+0000","last_became_peered":"2023-11-28T11:56:39.464873+0000","last_unstale":"2023-11-28T11:56:43.952622+0000","last_undegraded":"2023-11-28T11:56:43.952622+0000","last_fullsized":"2023-11-28T11:56:43.952622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:15:59.693915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.453970+0000","last_change":"2023-11-28T11:56:43.985102+0000","last_active":"2023-11-28T11:56:44.453970+0000","last_peered":"2023-11-28T11:56:44.453970+0000","last_clean":"2023-11-28T11:56:44.453970+0000","last_became_active":"2023-11-28T11:56:43.981972+0000","last_became_peered":"2023-11-28T11:56:43.981972+0000","last_unstale":"2023-11-28T11:56:44.453970+0000","last_undegraded":"2023-11-28T11:56:44.453970+0000","last_fullsized":"2023-11-28T11:56:44.453970+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:55:56.798336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.962406+0000","last_change":"2023-11-28T11:56:39.927380+0000","last_active":"2023-11-28T11:56:43.962406+0000","last_peered":"2023-11-28T11:56:43.962406+0000","last_clean":"2023-11-28T11:56:43.962406+0000","last_became_active":"2023-11-28T11:56:39.927049+0000","last_became_peered":"2023-11-28T11:56:39.927049+0000","last_unstale":"2023-11-28T11:56:43.962406+0000","last_undegraded":"2023-11-28T11:56:43.962406+0000","last_fullsized":"2023-11-28T11:56:43.962406+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:53:07.604891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960844+0000","last_change":"2023-11-28T11:56:39.465718+0000","last_active":"2023-11-28T11:56:43.960844+0000","last_peered":"2023-11-28T11:56:43.960844+0000","last_clean":"2023-11-28T11:56:43.960844+0000","last_became_active":"2023-11-28T11:56:39.465452+0000","last_became_peered":"2023-11-28T11:56:39.465452+0000","last_unstale":"2023-11-28T11:56:43.960844+0000","last_undegraded":"2023-11-28T11:56:43.960844+0000","last_fullsized":"2023-11-28T11:56:43.960844+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:52:05.494184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.570452+0000","last_change":"2023-11-28T11:56:43.982616+0000","last_active":"2023-11-28T11:56:44.570452+0000","last_peered":"2023-11-28T11:56:44.570452+0000","last_clean":"2023-11-28T11:56:44.570452+0000","last_became_active":"2023-11-28T11:56:43.982223+0000","last_became_peered":"2023-11-28T11:56:43.982223+0000","last_unstale":"2023-11-28T11:56:44.570452+0000","last_undegraded":"2023-11-28T11:56:44.570452+0000","last_fullsized":"2023-11-28T11:56:44.570452+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:03:46.537759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.963773+0000","last_change":"2023-11-28T11:56:39.941619+0000","last_active":"2023-11-28T11:56:43.963773+0000","last_peered":"2023-11-28T11:56:43.963773+0000","last_clean":"2023-11-28T11:56:43.963773+0000","last_became_active":"2023-11-28T11:56:39.941343+0000","last_became_peered":"2023-11-28T11:56:39.941343+0000","last_unstale":"2023-11-28T11:56:43.963773+0000","last_undegraded":"2023-11-28T11:56:43.963773+0000","last_fullsized":"2023-11-28T11:56:43.963773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:09:05.982770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960394+0000","last_change":"2023-11-28T11:56:39.469027+0000","last_active":"2023-11-28T11:56:43.960394+0000","last_peered":"2023-11-28T11:56:43.960394+0000","last_clean":"2023-11-28T11:56:43.960394+0000","last_became_active":"2023-11-28T11:56:39.468738+0000","last_became_peered":"2023-11-28T11:56:39.468738+0000","last_unstale":"2023-11-28T11:56:43.960394+0000","last_undegraded":"2023-11-28T11:56:43.960394+0000","last_fullsized":"2023-11-28T11:56:43.960394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:55:09.019742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.573769+0000","last_change":"2023-11-28T11:56:44.002367+0000","last_active":"2023-11-28T11:56:44.573769+0000","last_peered":"2023-11-28T11:56:44.573769+0000","last_clean":"2023-11-28T11:56:44.573769+0000","last_became_active":"2023-11-28T11:56:44.002098+0000","last_became_peered":"2023-11-28T11:56:44.002098+0000","last_unstale":"2023-11-28T11:56:44.573769+0000","last_undegraded":"2023-11-28T11:56:44.573769+0000","last_fullsized":"2023-11-28T11:56:44.573769+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:34:06.872250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960453+0000","last_change":"2023-11-28T11:56:39.934523+0000","last_active":"2023-11-28T11:56:43.960453+0000","last_peered":"2023-11-28T11:56:43.960453+0000","last_clean":"2023-11-28T11:56:43.960453+0000","last_became_active":"2023-11-28T11:56:39.926004+0000","last_became_peered":"2023-11-28T11:56:39.926004+0000","last_unstale":"2023-11-28T11:56:43.960453+0000","last_undegraded":"2023-11-28T11:56:43.960453+0000","last_fullsized":"2023-11-28T11:56:43.960453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:39:50.872604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"24'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.954294+0000","last_change":"2023-11-28T11:56:39.464276+0000","last_active":"2023-11-28T11:56:43.954294+0000","last_peered":"2023-11-28T11:56:43.954294+0000","last_clean":"2023-11-28T11:56:43.954294+0000","last_became_active":"2023-11-28T11:56:39.463731+0000","last_became_peered":"2023-11-28T11:56:39.463731+0000","last_unstale":"2023-11-28T11:56:43.954294+0000","last_undegraded":"2023-11-28T11:56:43.954294+0000","last_fullsized":"2023-11-28T11:56:43.954294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:52:48.600084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.570251+0000","last_change":"2023-11-28T11:56:43.988077+0000","last_active":"2023-11-28T11:56:44.570251+0000","last_peered":"2023-11-28T11:56:44.570251+0000","last_clean":"2023-11-28T11:56:44.570251+0000","last_became_active":"2023-11-28T11:56:43.987519+0000","last_became_peered":"2023-11-28T11:56:43.987519+0000","last_unstale":"2023-11-28T11:56:44.570251+0000","last_undegraded":"2023-11-28T11:56:44.570251+0000","last_fullsized":"2023-11-28T11:56:44.570251+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:27:49.851056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960239+0000","last_change":"2023-11-28T11:56:39.943627+0000","last_active":"2023-11-28T11:56:43.960239+0000","last_peered":"2023-11-28T11:56:43.960239+0000","last_clean":"2023-11-28T11:56:43.960239+0000","last_became_active":"2023-11-28T11:56:39.943358+0000","last_became_peered":"2023-11-28T11:56:39.943358+0000","last_unstale":"2023-11-28T11:56:43.960239+0000","last_undegraded":"2023-11-28T11:56:43.960239+0000","last_fullsized":"2023-11-28T11:56:43.960239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:54:54.554070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.963730+0000","last_change":"2023-11-28T11:56:39.459974+0000","last_active":"2023-11-28T11:56:43.963730+0000","last_peered":"2023-11-28T11:56:43.963730+0000","last_clean":"2023-11-28T11:56:43.963730+0000","last_became_active":"2023-11-28T11:56:39.459621+0000","last_became_peered":"2023-11-28T11:56:39.459621+0000","last_unstale":"2023-11-28T11:56:43.963730+0000","last_undegraded":"2023-11-28T11:56:43.963730+0000","last_fullsized":"2023-11-28T11:56:43.963730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:57:44.601498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.569869+0000","last_change":"2023-11-28T11:56:43.987926+0000","last_active":"2023-11-28T11:56:44.569869+0000","last_peered":"2023-11-28T11:56:44.569869+0000","last_clean":"2023-11-28T11:56:44.569869+0000","last_became_active":"2023-11-28T11:56:43.987447+0000","last_became_peered":"2023-11-28T11:56:43.987447+0000","last_unstale":"2023-11-28T11:56:44.569869+0000","last_undegraded":"2023-11-28T11:56:44.569869+0000","last_fullsized":"2023-11-28T11:56:44.569869+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:48:08.970147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960270+0000","last_change":"2023-11-28T11:56:39.944531+0000","last_active":"2023-11-28T11:56:43.960270+0000","last_peered":"2023-11-28T11:56:43.960270+0000","last_clean":"2023-11-28T11:56:43.960270+0000","last_became_active":"2023-11-28T11:56:39.944262+0000","last_became_peered":"2023-11-28T11:56:39.944262+0000","last_unstale":"2023-11-28T11:56:43.960270+0000","last_undegraded":"2023-11-28T11:56:43.960270+0000","last_fullsized":"2023-11-28T11:56:43.960270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:36:30.674628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.953951+0000","last_change":"2023-11-28T11:56:39.468498+0000","last_active":"2023-11-28T11:56:43.953951+0000","last_peered":"2023-11-28T11:56:43.953951+0000","last_clean":"2023-11-28T11:56:43.953951+0000","last_became_active":"2023-11-28T11:56:39.468198+0000","last_became_peered":"2023-11-28T11:56:39.468198+0000","last_unstale":"2023-11-28T11:56:43.953951+0000","last_undegraded":"2023-11-28T11:56:43.953951+0000","last_fullsized":"2023-11-28T11:56:43.953951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:30:31.377988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.569939+0000","last_change":"2023-11-28T11:56:43.996490+0000","last_active":"2023-11-28T11:56:44.569939+0000","last_peered":"2023-11-28T11:56:44.569939+0000","last_clean":"2023-11-28T11:56:44.569939+0000","last_became_active":"2023-11-28T11:56:43.996074+0000","last_became_peered":"2023-11-28T11:56:43.996074+0000","last_unstale":"2023-11-28T11:56:44.569939+0000","last_undegraded":"2023-11-28T11:56:44.569939+0000","last_fullsized":"2023-11-28T11:56:44.569939+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:01:51.310559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960636+0000","last_change":"2023-11-28T11:56:39.946101+0000","last_active":"2023-11-28T11:56:43.960636+0000","last_peered":"2023-11-28T11:56:43.960636+0000","last_clean":"2023-11-28T11:56:43.960636+0000","last_became_active":"2023-11-28T11:56:39.945797+0000","last_became_peered":"2023-11-28T11:56:39.945797+0000","last_unstale":"2023-11-28T11:56:43.960636+0000","last_undegraded":"2023-11-28T11:56:43.960636+0000","last_fullsized":"2023-11-28T11:56:43.960636+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:04:33.061948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.954377+0000","last_change":"2023-11-28T11:56:39.468642+0000","last_active":"2023-11-28T11:56:43.954377+0000","last_peered":"2023-11-28T11:56:43.954377+0000","last_clean":"2023-11-28T11:56:43.954377+0000","last_became_active":"2023-11-28T11:56:39.468261+0000","last_became_peered":"2023-11-28T11:56:39.468261+0000","last_unstale":"2023-11-28T11:56:43.954377+0000","last_undegraded":"2023-11-28T11:56:43.954377+0000","last_fullsized":"2023-11-28T11:56:43.954377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:09:04.506578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.569358+0000","last_change":"2023-11-28T11:56:44.001612+0000","last_active":"2023-11-28T11:56:44.569358+0000","last_peered":"2023-11-28T11:56:44.569358+0000","last_clean":"2023-11-28T11:56:44.569358+0000","last_became_active":"2023-11-28T11:56:44.001218+0000","last_became_peered":"2023-11-28T11:56:44.001218+0000","last_unstale":"2023-11-28T11:56:44.569358+0000","last_undegraded":"2023-11-28T11:56:44.569358+0000","last_fullsized":"2023-11-28T11:56:44.569358+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:47.972845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.962655+0000","last_change":"2023-11-28T11:56:39.937560+0000","last_active":"2023-11-28T11:56:43.962655+0000","last_peered":"2023-11-28T11:56:43.962655+0000","last_clean":"2023-11-28T11:56:43.962655+0000","last_became_active":"2023-11-28T11:56:39.935813+0000","last_became_peered":"2023-11-28T11:56:39.935813+0000","last_unstale":"2023-11-28T11:56:43.962655+0000","last_undegraded":"2023-11-28T11:56:43.962655+0000","last_fullsized":"2023-11-28T11:56:43.962655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:39:50.872604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.954504+0000","last_change":"2023-11-28T11:56:39.460965+0000","last_active":"2023-11-28T11:56:43.954504+0000","last_peered":"2023-11-28T11:56:43.954504+0000","last_clean":"2023-11-28T11:56:43.954504+0000","last_became_active":"2023-11-28T11:56:39.460589+0000","last_became_peered":"2023-11-28T11:56:39.460589+0000","last_unstale":"2023-11-28T11:56:43.954504+0000","last_undegraded":"2023-11-28T11:56:43.954504+0000","last_fullsized":"2023-11-28T11:56:43.954504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:14:49.707818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.571715+0000","last_change":"2023-11-28T11:56:43.975101+0000","last_active":"2023-11-28T11:56:44.571715+0000","last_peered":"2023-11-28T11:56:44.571715+0000","last_clean":"2023-11-28T11:56:44.571715+0000","last_became_active":"2023-11-28T11:56:43.974532+0000","last_became_peered":"2023-11-28T11:56:43.974532+0000","last_unstale":"2023-11-28T11:56:44.571715+0000","last_undegraded":"2023-11-28T11:56:44.571715+0000","last_fullsized":"2023-11-28T11:56:44.571715+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:34:06.872250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.570363+0000","last_change":"2023-11-28T11:56:43.980824+0000","last_active":"2023-11-28T11:56:44.570363+0000","last_peered":"2023-11-28T11:56:44.570363+0000","last_clean":"2023-11-28T11:56:44.570363+0000","last_became_active":"2023-11-28T11:56:43.978868+0000","last_became_peered":"2023-11-28T11:56:43.978868+0000","last_unstale":"2023-11-28T11:56:44.570363+0000","last_undegraded":"2023-11-28T11:56:44.570363+0000","last_fullsized":"2023-11-28T11:56:44.570363+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:03:18.915760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"24'8","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.953542+0000","last_change":"2023-11-28T11:56:39.463107+0000","last_active":"2023-11-28T11:56:43.953542+0000","last_peered":"2023-11-28T11:56:43.953542+0000","last_clean":"2023-11-28T11:56:43.953542+0000","last_became_active":"2023-11-28T11:56:39.462771+0000","last_became_peered":"2023-11-28T11:56:39.462771+0000","last_unstale":"2023-11-28T11:56:43.953542+0000","last_undegraded":"2023-11-28T11:56:43.953542+0000","last_fullsized":"2023-11-28T11:56:43.953542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:26:50.340796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.959057+0000","last_change":"2023-11-28T11:56:39.935086+0000","last_active":"2023-11-28T11:56:43.959057+0000","last_peered":"2023-11-28T11:56:43.959057+0000","last_clean":"2023-11-28T11:56:43.959057+0000","last_became_active":"2023-11-28T11:56:39.934832+0000","last_became_peered":"2023-11-28T11:56:39.934832+0000","last_unstale":"2023-11-28T11:56:43.959057+0000","last_undegraded":"2023-11-28T11:56:43.959057+0000","last_fullsized":"2023-11-28T11:56:43.959057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:10:06.958523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.575548+0000","last_change":"2023-11-28T11:56:43.996688+0000","last_active":"2023-11-28T11:56:44.575548+0000","last_peered":"2023-11-28T11:56:44.575548+0000","last_clean":"2023-11-28T11:56:44.575548+0000","last_became_active":"2023-11-28T11:56:43.996253+0000","last_became_peered":"2023-11-28T11:56:43.996253+0000","last_unstale":"2023-11-28T11:56:44.575548+0000","last_undegraded":"2023-11-28T11:56:44.575548+0000","last_fullsized":"2023-11-28T11:56:44.575548+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:20:35.086687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952840+0000","last_change":"2023-11-28T11:56:39.471710+0000","last_active":"2023-11-28T11:56:43.952840+0000","last_peered":"2023-11-28T11:56:43.952840+0000","last_clean":"2023-11-28T11:56:43.952840+0000","last_became_active":"2023-11-28T11:56:39.471423+0000","last_became_peered":"2023-11-28T11:56:39.471423+0000","last_unstale":"2023-11-28T11:56:43.952840+0000","last_undegraded":"2023-11-28T11:56:43.952840+0000","last_fullsized":"2023-11-28T11:56:43.952840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:41.737631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.974564+0000","last_change":"2023-11-28T11:56:39.932531+0000","last_active":"2023-11-28T11:56:43.974564+0000","last_peered":"2023-11-28T11:56:43.974564+0000","last_clean":"2023-11-28T11:56:43.974564+0000","last_became_active":"2023-11-28T11:56:39.932235+0000","last_became_peered":"2023-11-28T11:56:39.932235+0000","last_unstale":"2023-11-28T11:56:43.974564+0000","last_undegraded":"2023-11-28T11:56:43.974564+0000","last_fullsized":"2023-11-28T11:56:43.974564+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:37:59.805024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960058+0000","last_change":"2023-11-28T11:56:39.459466+0000","last_active":"2023-11-28T11:56:43.960058+0000","last_peered":"2023-11-28T11:56:43.960058+0000","last_clean":"2023-11-28T11:56:43.960058+0000","last_became_active":"2023-11-28T11:56:39.459207+0000","last_became_peered":"2023-11-28T11:56:39.459207+0000","last_unstale":"2023-11-28T11:56:43.960058+0000","last_undegraded":"2023-11-28T11:56:43.960058+0000","last_fullsized":"2023-11-28T11:56:43.960058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:21:06.192836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.966700+0000","last_change":"2023-11-28T11:56:39.947121+0000","last_active":"2023-11-28T11:56:43.966700+0000","last_peered":"2023-11-28T11:56:43.966700+0000","last_clean":"2023-11-28T11:56:43.966700+0000","last_became_active":"2023-11-28T11:56:39.944854+0000","last_became_peered":"2023-11-28T11:56:39.944854+0000","last_unstale":"2023-11-28T11:56:43.966700+0000","last_undegraded":"2023-11-28T11:56:43.966700+0000","last_fullsized":"2023-11-28T11:56:43.966700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:53:07.604891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.572743+0000","last_change":"2023-11-28T11:56:43.976187+0000","last_active":"2023-11-28T11:56:44.572743+0000","last_peered":"2023-11-28T11:56:44.572743+0000","last_clean":"2023-11-28T11:56:44.572743+0000","last_became_active":"2023-11-28T11:56:43.975691+0000","last_became_peered":"2023-11-28T11:56:43.975691+0000","last_unstale":"2023-11-28T11:56:44.572743+0000","last_undegraded":"2023-11-28T11:56:44.572743+0000","last_fullsized":"2023-11-28T11:56:44.572743+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:38:23.071293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"24'2","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952993+0000","last_change":"2023-11-28T11:56:39.473334+0000","last_active":"2023-11-28T11:56:43.952993+0000","last_peered":"2023-11-28T11:56:43.952993+0000","last_clean":"2023-11-28T11:56:43.952993+0000","last_became_active":"2023-11-28T11:56:39.472989+0000","last_became_peered":"2023-11-28T11:56:39.472989+0000","last_unstale":"2023-11-28T11:56:43.952993+0000","last_undegraded":"2023-11-28T11:56:43.952993+0000","last_fullsized":"2023-11-28T11:56:43.952993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.415006+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.415006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:36:29.668082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.953207+0000","last_change":"2023-11-28T11:56:39.942962+0000","last_active":"2023-11-28T11:56:43.953207+0000","last_peered":"2023-11-28T11:56:43.953207+0000","last_clean":"2023-11-28T11:56:43.953207+0000","last_became_active":"2023-11-28T11:56:39.942628+0000","last_became_peered":"2023-11-28T11:56:39.942628+0000","last_unstale":"2023-11-28T11:56:43.953207+0000","last_undegraded":"2023-11-28T11:56:43.953207+0000","last_fullsized":"2023-11-28T11:56:43.953207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:09:53.018437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-28T11:56:44.571109+0000","last_change":"2023-11-28T11:56:43.983804+0000","last_active":"2023-11-28T11:56:44.571109+0000","last_peered":"2023-11-28T11:56:44.571109+0000","last_clean":"2023-11-28T11:56:44.571109+0000","last_became_active":"2023-11-28T11:56:43.983397+0000","last_became_peered":"2023-11-28T11:56:43.983397+0000","last_unstale":"2023-11-28T11:56:44.571109+0000","last_undegraded":"2023-11-28T11:56:44.571109+0000","last_fullsized":"2023-11-28T11:56:44.571109+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:42.922377+0000","last_clean_scrub_stamp":"2023-11-28T11:56:42.922377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:16.749468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.953340+0000","last_change":"2023-11-28T11:56:39.938472+0000","last_active":"2023-11-28T11:56:43.953340+0000","last_peered":"2023-11-28T11:56:43.953340+0000","last_clean":"2023-11-28T11:56:43.953340+0000","last_became_active":"2023-11-28T11:56:39.938186+0000","last_became_peered":"2023-11-28T11:56:39.938186+0000","last_unstale":"2023-11-28T11:56:43.953340+0000","last_undegraded":"2023-11-28T11:56:43.953340+0000","last_fullsized":"2023-11-28T11:56:43.953340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:30:32.384534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952481+0000","last_change":"2023-11-28T11:56:39.947611+0000","last_active":"2023-11-28T11:56:43.952481+0000","last_peered":"2023-11-28T11:56:43.952481+0000","last_clean":"2023-11-28T11:56:43.952481+0000","last_became_active":"2023-11-28T11:56:39.947364+0000","last_became_peered":"2023-11-28T11:56:39.947364+0000","last_unstale":"2023-11-28T11:56:43.952481+0000","last_undegraded":"2023-11-28T11:56:43.952481+0000","last_fullsized":"2023-11-28T11:56:43.952481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:49:14.776024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.959741+0000","last_change":"2023-11-28T11:56:39.928631+0000","last_active":"2023-11-28T11:56:43.959741+0000","last_peered":"2023-11-28T11:56:43.959741+0000","last_clean":"2023-11-28T11:56:43.959741+0000","last_became_active":"2023-11-28T11:56:39.928360+0000","last_became_peered":"2023-11-28T11:56:39.928360+0000","last_unstale":"2023-11-28T11:56:43.959741+0000","last_undegraded":"2023-11-28T11:56:43.959741+0000","last_fullsized":"2023-11-28T11:56:43.959741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:09:53.018437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.954058+0000","last_change":"2023-11-28T11:56:39.935151+0000","last_active":"2023-11-28T11:56:43.954058+0000","last_peered":"2023-11-28T11:56:43.954058+0000","last_clean":"2023-11-28T11:56:43.954058+0000","last_became_active":"2023-11-28T11:56:39.934811+0000","last_became_peered":"2023-11-28T11:56:39.934811+0000","last_unstale":"2023-11-28T11:56:43.954058+0000","last_undegraded":"2023-11-28T11:56:43.954058+0000","last_fullsized":"2023-11-28T11:56:43.954058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:24:26.563114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.968635+0000","last_change":"2023-11-28T11:56:39.940870+0000","last_active":"2023-11-28T11:56:43.968635+0000","last_peered":"2023-11-28T11:56:43.968635+0000","last_clean":"2023-11-28T11:56:43.968635+0000","last_became_active":"2023-11-28T11:56:39.940598+0000","last_became_peered":"2023-11-28T11:56:39.940598+0000","last_unstale":"2023-11-28T11:56:43.968635+0000","last_undegraded":"2023-11-28T11:56:43.968635+0000","last_fullsized":"2023-11-28T11:56:43.968635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:14:50.714365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.966611+0000","last_change":"2023-11-28T11:56:39.953168+0000","last_active":"2023-11-28T11:56:43.966611+0000","last_peered":"2023-11-28T11:56:43.966611+0000","last_clean":"2023-11-28T11:56:43.966611+0000","last_became_active":"2023-11-28T11:56:39.951968+0000","last_became_peered":"2023-11-28T11:56:39.951968+0000","last_unstale":"2023-11-28T11:56:43.966611+0000","last_undegraded":"2023-11-28T11:56:43.966611+0000","last_fullsized":"2023-11-28T11:56:43.966611+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:08:24.197240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.970835+0000","last_change":"2023-11-28T11:56:39.946593+0000","last_active":"2023-11-28T11:56:43.970835+0000","last_peered":"2023-11-28T11:56:43.970835+0000","last_clean":"2023-11-28T11:56:43.970835+0000","last_became_active":"2023-11-28T11:56:39.944862+0000","last_became_peered":"2023-11-28T11:56:39.944862+0000","last_unstale":"2023-11-28T11:56:43.970835+0000","last_undegraded":"2023-11-28T11:56:43.970835+0000","last_fullsized":"2023-11-28T11:56:43.970835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:13:17.325195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.971180+0000","last_change":"2023-11-28T11:56:39.941059+0000","last_active":"2023-11-28T11:56:43.971180+0000","last_peered":"2023-11-28T11:56:43.971180+0000","last_clean":"2023-11-28T11:56:43.971180+0000","last_became_active":"2023-11-28T11:56:39.940781+0000","last_became_peered":"2023-11-28T11:56:39.940781+0000","last_unstale":"2023-11-28T11:56:43.971180+0000","last_undegraded":"2023-11-28T11:56:43.971180+0000","last_fullsized":"2023-11-28T11:56:43.971180+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:50:59.351619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952193+0000","last_change":"2023-11-28T11:56:39.950678+0000","last_active":"2023-11-28T11:56:43.952193+0000","last_peered":"2023-11-28T11:56:43.952193+0000","last_clean":"2023-11-28T11:56:43.952193+0000","last_became_active":"2023-11-28T11:56:39.948033+0000","last_became_peered":"2023-11-28T11:56:39.948033+0000","last_unstale":"2023-11-28T11:56:43.952193+0000","last_undegraded":"2023-11-28T11:56:43.952193+0000","last_fullsized":"2023-11-28T11:56:43.952193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:13:17.325195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952347+0000","last_change":"2023-11-28T11:56:39.926747+0000","last_active":"2023-11-28T11:56:43.952347+0000","last_peered":"2023-11-28T11:56:43.952347+0000","last_clean":"2023-11-28T11:56:43.952347+0000","last_became_active":"2023-11-28T11:56:39.926475+0000","last_became_peered":"2023-11-28T11:56:39.926475+0000","last_unstale":"2023-11-28T11:56:43.952347+0000","last_undegraded":"2023-11-28T11:56:43.952347+0000","last_fullsized":"2023-11-28T11:56:43.952347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:10:35.378054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.957922+0000","last_change":"2023-11-28T11:56:39.952645+0000","last_active":"2023-11-28T11:56:43.957922+0000","last_peered":"2023-11-28T11:56:43.957922+0000","last_clean":"2023-11-28T11:56:43.957922+0000","last_became_active":"2023-11-28T11:56:39.952363+0000","last_became_peered":"2023-11-28T11:56:39.952363+0000","last_unstale":"2023-11-28T11:56:43.957922+0000","last_undegraded":"2023-11-28T11:56:43.957922+0000","last_fullsized":"2023-11-28T11:56:43.957922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:43:39.611494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952872+0000","last_change":"2023-11-28T11:56:39.947249+0000","last_active":"2023-11-28T11:56:43.952872+0000","last_peered":"2023-11-28T11:56:43.952872+0000","last_clean":"2023-11-28T11:56:43.952872+0000","last_became_active":"2023-11-28T11:56:39.946423+0000","last_became_peered":"2023-11-28T11:56:39.946423+0000","last_unstale":"2023-11-28T11:56:43.952872+0000","last_undegraded":"2023-11-28T11:56:43.952872+0000","last_fullsized":"2023-11-28T11:56:43.952872+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:49:14.776024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960364+0000","last_change":"2023-11-28T11:56:39.934479+0000","last_active":"2023-11-28T11:56:43.960364+0000","last_peered":"2023-11-28T11:56:43.960364+0000","last_clean":"2023-11-28T11:56:43.960364+0000","last_became_active":"2023-11-28T11:56:39.928161+0000","last_became_peered":"2023-11-28T11:56:39.928161+0000","last_unstale":"2023-11-28T11:56:43.960364+0000","last_undegraded":"2023-11-28T11:56:43.960364+0000","last_fullsized":"2023-11-28T11:56:43.960364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:54:26.952553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.963038+0000","last_change":"2023-11-28T11:56:39.941392+0000","last_active":"2023-11-28T11:56:43.963038+0000","last_peered":"2023-11-28T11:56:43.963038+0000","last_clean":"2023-11-28T11:56:43.963038+0000","last_became_active":"2023-11-28T11:56:39.940495+0000","last_became_peered":"2023-11-28T11:56:39.940495+0000","last_unstale":"2023-11-28T11:56:43.963038+0000","last_undegraded":"2023-11-28T11:56:43.963038+0000","last_fullsized":"2023-11-28T11:56:43.963038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:20:02.710099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.962307+0000","last_change":"2023-11-28T11:56:39.945287+0000","last_active":"2023-11-28T11:56:43.962307+0000","last_peered":"2023-11-28T11:56:43.962307+0000","last_clean":"2023-11-28T11:56:43.962307+0000","last_became_active":"2023-11-28T11:56:39.942342+0000","last_became_peered":"2023-11-28T11:56:39.942342+0000","last_unstale":"2023-11-28T11:56:43.962307+0000","last_undegraded":"2023-11-28T11:56:43.962307+0000","last_fullsized":"2023-11-28T11:56:43.962307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:10:35.378054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.992453+0000","last_change":"2023-11-28T11:56:39.934499+0000","last_active":"2023-11-28T11:56:43.992453+0000","last_peered":"2023-11-28T11:56:43.992453+0000","last_clean":"2023-11-28T11:56:43.992453+0000","last_became_active":"2023-11-28T11:56:39.934253+0000","last_became_peered":"2023-11-28T11:56:39.934253+0000","last_unstale":"2023-11-28T11:56:43.992453+0000","last_undegraded":"2023-11-28T11:56:43.992453+0000","last_fullsized":"2023-11-28T11:56:43.992453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:45:29.746371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.959288+0000","last_change":"2023-11-28T11:56:39.941319+0000","last_active":"2023-11-28T11:56:43.959288+0000","last_peered":"2023-11-28T11:56:43.959288+0000","last_clean":"2023-11-28T11:56:43.959288+0000","last_became_active":"2023-11-28T11:56:39.941012+0000","last_became_peered":"2023-11-28T11:56:39.941012+0000","last_unstale":"2023-11-28T11:56:43.959288+0000","last_undegraded":"2023-11-28T11:56:43.959288+0000","last_fullsized":"2023-11-28T11:56:43.959288+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:08:24.197240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952737+0000","last_change":"2023-11-28T11:56:39.950163+0000","last_active":"2023-11-28T11:56:43.952737+0000","last_peered":"2023-11-28T11:56:43.952737+0000","last_clean":"2023-11-28T11:56:43.952737+0000","last_became_active":"2023-11-28T11:56:39.949823+0000","last_became_peered":"2023-11-28T11:56:39.949823+0000","last_unstale":"2023-11-28T11:56:43.952737+0000","last_undegraded":"2023-11-28T11:56:43.952737+0000","last_fullsized":"2023-11-28T11:56:43.952737+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:53:07.604891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.965275+0000","last_change":"2023-11-28T11:56:39.945909+0000","last_active":"2023-11-28T11:56:43.965275+0000","last_peered":"2023-11-28T11:56:43.965275+0000","last_clean":"2023-11-28T11:56:43.965275+0000","last_became_active":"2023-11-28T11:56:39.945628+0000","last_became_peered":"2023-11-28T11:56:39.945628+0000","last_unstale":"2023-11-28T11:56:43.965275+0000","last_undegraded":"2023-11-28T11:56:43.965275+0000","last_fullsized":"2023-11-28T11:56:43.965275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:47:39.671110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.967426+0000","last_change":"2023-11-28T11:56:39.949059+0000","last_active":"2023-11-28T11:56:43.967426+0000","last_peered":"2023-11-28T11:56:43.967426+0000","last_clean":"2023-11-28T11:56:43.967426+0000","last_became_active":"2023-11-28T11:56:39.948795+0000","last_became_peered":"2023-11-28T11:56:39.948795+0000","last_unstale":"2023-11-28T11:56:43.967426+0000","last_undegraded":"2023-11-28T11:56:43.967426+0000","last_fullsized":"2023-11-28T11:56:43.967426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:10:59.494745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.964659+0000","last_change":"2023-11-28T11:56:39.955527+0000","last_active":"2023-11-28T11:56:43.964659+0000","last_peered":"2023-11-28T11:56:43.964659+0000","last_clean":"2023-11-28T11:56:43.964659+0000","last_became_active":"2023-11-28T11:56:39.955190+0000","last_became_peered":"2023-11-28T11:56:39.955190+0000","last_unstale":"2023-11-28T11:56:43.964659+0000","last_undegraded":"2023-11-28T11:56:43.964659+0000","last_fullsized":"2023-11-28T11:56:43.964659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:31:52.674778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.963692+0000","last_change":"2023-11-28T11:56:39.950894+0000","last_active":"2023-11-28T11:56:43.963692+0000","last_peered":"2023-11-28T11:56:43.963692+0000","last_clean":"2023-11-28T11:56:43.963692+0000","last_became_active":"2023-11-28T11:56:39.950572+0000","last_became_peered":"2023-11-28T11:56:39.950572+0000","last_unstale":"2023-11-28T11:56:43.963692+0000","last_undegraded":"2023-11-28T11:56:43.963692+0000","last_fullsized":"2023-11-28T11:56:43.963692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:33:44.652949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.961221+0000","last_change":"2023-11-28T11:56:39.943609+0000","last_active":"2023-11-28T11:56:43.961221+0000","last_peered":"2023-11-28T11:56:43.961221+0000","last_clean":"2023-11-28T11:56:43.961221+0000","last_became_active":"2023-11-28T11:56:39.943334+0000","last_became_peered":"2023-11-28T11:56:39.943334+0000","last_unstale":"2023-11-28T11:56:43.961221+0000","last_undegraded":"2023-11-28T11:56:43.961221+0000","last_fullsized":"2023-11-28T11:56:43.961221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:15:38.977863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.991532+0000","last_change":"2023-11-28T11:56:39.937893+0000","last_active":"2023-11-28T11:56:43.991532+0000","last_peered":"2023-11-28T11:56:43.991532+0000","last_clean":"2023-11-28T11:56:43.991532+0000","last_became_active":"2023-11-28T11:56:39.936035+0000","last_became_peered":"2023-11-28T11:56:39.936035+0000","last_unstale":"2023-11-28T11:56:43.991532+0000","last_undegraded":"2023-11-28T11:56:43.991532+0000","last_fullsized":"2023-11-28T11:56:43.991532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:48:05.469323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.962560+0000","last_change":"2023-11-28T11:56:39.948688+0000","last_active":"2023-11-28T11:56:43.962560+0000","last_peered":"2023-11-28T11:56:43.962560+0000","last_clean":"2023-11-28T11:56:43.962560+0000","last_became_active":"2023-11-28T11:56:39.948372+0000","last_became_peered":"2023-11-28T11:56:39.948372+0000","last_unstale":"2023-11-28T11:56:43.962560+0000","last_undegraded":"2023-11-28T11:56:43.962560+0000","last_fullsized":"2023-11-28T11:56:43.962560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:49:14.776024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.952119+0000","last_change":"2023-11-28T11:56:39.950877+0000","last_active":"2023-11-28T11:56:43.952119+0000","last_peered":"2023-11-28T11:56:43.952119+0000","last_clean":"2023-11-28T11:56:43.952119+0000","last_became_active":"2023-11-28T11:56:39.949415+0000","last_became_peered":"2023-11-28T11:56:39.949415+0000","last_unstale":"2023-11-28T11:56:43.952119+0000","last_undegraded":"2023-11-28T11:56:43.952119+0000","last_fullsized":"2023-11-28T11:56:43.952119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:15:38.977863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.959490+0000","last_change":"2023-11-28T11:56:39.940463+0000","last_active":"2023-11-28T11:56:43.959490+0000","last_peered":"2023-11-28T11:56:43.959490+0000","last_clean":"2023-11-28T11:56:43.959490+0000","last_became_active":"2023-11-28T11:56:39.940181+0000","last_became_peered":"2023-11-28T11:56:39.940181+0000","last_unstale":"2023-11-28T11:56:43.959490+0000","last_undegraded":"2023-11-28T11:56:43.959490+0000","last_fullsized":"2023-11-28T11:56:43.959490+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:39:27.124421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.960539+0000","last_change":"2023-11-28T11:56:39.933634+0000","last_active":"2023-11-28T11:56:43.960539+0000","last_peered":"2023-11-28T11:56:43.960539+0000","last_clean":"2023-11-28T11:56:43.960539+0000","last_became_active":"2023-11-28T11:56:39.933388+0000","last_became_peered":"2023-11-28T11:56:39.933388+0000","last_unstale":"2023-11-28T11:56:43.960539+0000","last_undegraded":"2023-11-28T11:56:43.960539+0000","last_fullsized":"2023-11-28T11:56:43.960539+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:35:17.292824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.953846+0000","last_change":"2023-11-28T11:56:39.929640+0000","last_active":"2023-11-28T11:56:43.953846+0000","last_peered":"2023-11-28T11:56:43.953846+0000","last_clean":"2023-11-28T11:56:43.953846+0000","last_became_active":"2023-11-28T11:56:39.926154+0000","last_became_peered":"2023-11-28T11:56:39.926154+0000","last_unstale":"2023-11-28T11:56:43.953846+0000","last_undegraded":"2023-11-28T11:56:43.953846+0000","last_fullsized":"2023-11-28T11:56:43.953846+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:09:05.513124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.963588+0000","last_change":"2023-11-28T11:56:39.927473+0000","last_active":"2023-11-28T11:56:43.963588+0000","last_peered":"2023-11-28T11:56:43.963588+0000","last_clean":"2023-11-28T11:56:43.963588+0000","last_became_active":"2023-11-28T11:56:39.927002+0000","last_became_peered":"2023-11-28T11:56:39.927002+0000","last_unstale":"2023-11-28T11:56:43.963588+0000","last_undegraded":"2023-11-28T11:56:43.963588+0000","last_fullsized":"2023-11-28T11:56:43.963588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:53:05.931879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.961138+0000","last_change":"2023-11-28T11:56:39.956928+0000","last_active":"2023-11-28T11:56:43.961138+0000","last_peered":"2023-11-28T11:56:43.961138+0000","last_clean":"2023-11-28T11:56:43.961138+0000","last_became_active":"2023-11-28T11:56:39.956676+0000","last_became_peered":"2023-11-28T11:56:39.956676+0000","last_unstale":"2023-11-28T11:56:43.961138+0000","last_undegraded":"2023-11-28T11:56:43.961138+0000","last_fullsized":"2023-11-28T11:56:43.961138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:24:26.563114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.959783+0000","last_change":"2023-11-28T11:56:39.948454+0000","last_active":"2023-11-28T11:56:43.959783+0000","last_peered":"2023-11-28T11:56:43.959783+0000","last_clean":"2023-11-28T11:56:43.959783+0000","last_became_active":"2023-11-28T11:56:39.948186+0000","last_became_peered":"2023-11-28T11:56:39.948186+0000","last_unstale":"2023-11-28T11:56:43.959783+0000","last_undegraded":"2023-11-28T11:56:43.959783+0000","last_fullsized":"2023-11-28T11:56:43.959783+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.421553+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.421553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:55:32.097238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4527,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9300,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362540,"statfs":{"total":96636764160,"available":96627240960,"internally_reserved":0,"allocated":929792,"data_stored":719926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3740000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]}]},{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8116,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363724,"statfs":{"total":96636764160,"available":96628453376,"internally_reserved":0,"allocated":307200,"data_stored":125597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5740000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2689999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4370000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4059999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.464}]}]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8188,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363652,"statfs":{"total":96636764160,"available":96628379648,"internally_reserved":0,"allocated":315392,"data_stored":126233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3169999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.403}]}]},{"osd":4,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8264,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363576,"statfs":{"total":96636764160,"available":96628301824,"internally_reserved":0,"allocated":327680,"data_stored":129398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.335}]}]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8184,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363656,"statfs":{"total":96636764160,"available":96628383744,"internally_reserved":0,"allocated":311296,"data_stored":125687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2370000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0980000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]}]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8244,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363596,"statfs":{"total":96636764160,"available":96628322304,"internally_reserved":0,"allocated":307200,"data_stored":125597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2789999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542155,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8116,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363724,"statfs":{"total":96636764160,"available":96628453376,"internally_reserved":0,"allocated":307200,"data_stored":125597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1910000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3169999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542155,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9272,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362568,"statfs":{"total":96636764160,"available":96627269632,"internally_reserved":0,"allocated":901120,"data_stored":715612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.224}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.284}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:57:06.756 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-28T11:57:06.756 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-28T11:57:06.756 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-28T11:57:06.756 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T11:57:06.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.953+0000 7fafb2362700 1 Processor -- start 2023-11-28T11:57:06.960 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.953+0000 7fafb2362700 1 -- start start 2023-11-28T11:57:06.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.957+0000 7fafb2362700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fafac06b240 0x7fafac0b36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:06.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.957+0000 7fafb2362700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafac069bf0 con 0x7fafac0ca8e0 2023-11-28T11:57:06.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.957+0000 7fafb2362700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafac0b3c00 con 0x7fafac0c1d50 2023-11-28T11:57:06.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.957+0000 7fafb2362700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafac069e40 con 0x7fafac06b240 2023-11-28T11:57:06.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.957+0000 7fafb1360700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fafac0ca8e0 0x7fafac0c1640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:38032/0 (socket says 172.21.15.39:38032) 2023-11-28T11:57:06.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.957+0000 7fafb1360700 1 -- 172.21.15.39:0/2503129225 learned_addr learned my addr 172.21.15.39:0/2503129225 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:06.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.957+0000 7fafb1b61700 1 --2- 172.21.15.39:0/2503129225 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fafac06b240 0x7fafac0b36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:06.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.957+0000 7fafa3fff700 1 -- 172.21.15.39:0/2503129225 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3082907080 0 0) 0x7fafac0b3c00 con 0x7fafac0c1d50 2023-11-28T11:57:06.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.957+0000 7fafa3fff700 1 -- 172.21.15.39:0/2503129225 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf980035d0 con 0x7fafac0c1d50 2023-11-28T11:57:06.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.957+0000 7fafa3fff700 1 -- 172.21.15.39:0/2503129225 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1176373960 0 0) 0x7fafac069bf0 con 0x7fafac0ca8e0 2023-11-28T11:57:06.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.957+0000 7fafa3fff700 1 -- 172.21.15.39:0/2503129225 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafac0b3c00 con 0x7fafac0ca8e0 2023-11-28T11:57:06.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.957+0000 7fafb1b61700 1 -- 172.21.15.39:0/2503129225 >> v1:172.21.15.184:6789/0 conn(0x7fafac0c1d50 legacy=0x7fafac0cb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:06.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.957+0000 7fafb1b61700 1 -- 172.21.15.39:0/2503129225 >> v1:172.21.15.39:6789/0 conn(0x7fafac0ca8e0 legacy=0x7fafac0c1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:06.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.957+0000 7fafb1b61700 1 -- 172.21.15.39:0/2503129225 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafac06a120 con 0x7fafac06b240 2023-11-28T11:57:06.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.961+0000 7fafb1b61700 1 --2- 172.21.15.39:0/2503129225 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fafac06b240 0x7fafac0b36c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fafa4009dc0 tx=0x7fafa400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb5579c084061434 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:06.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.961+0000 7fafa3fff700 1 -- 172.21.15.39:0/2503129225 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa400e070 con 0x7fafac06b240 2023-11-28T11:57:06.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.961+0000 7fafa3fff700 1 -- 172.21.15.39:0/2503129225 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa400bb20 con 0x7fafac06b240 2023-11-28T11:57:06.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.961+0000 7fafa3fff700 1 -- 172.21.15.39:0/2503129225 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa4012430 con 0x7fafac06b240 2023-11-28T11:57:06.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.961+0000 7fafb2362700 1 -- 172.21.15.39:0/2503129225 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fafac06b240 msgr2=0x7fafac0b36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:06.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.961+0000 7fafb2362700 1 --2- 172.21.15.39:0/2503129225 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fafac06b240 0x7fafac0b36c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fafa4009dc0 tx=0x7fafa400b330 comp rx=0 tx=0).stop 2023-11-28T11:57:06.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.961+0000 7fafb2362700 1 -- 172.21.15.39:0/2503129225 shutdown_connections 2023-11-28T11:57:06.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.961+0000 7fafb2362700 1 --2- 172.21.15.39:0/2503129225 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fafac06b240 0x7fafac0b36c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:06.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.961+0000 7fafb2362700 1 -- 172.21.15.39:0/2503129225 >> 172.21.15.39:0/2503129225 conn(0x7fafac0ce670 msgr2=0x7fafac0cea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:06.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.961+0000 7fafb2362700 1 -- 172.21.15.39:0/2503129225 shutdown_connections 2023-11-28T11:57:06.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.961+0000 7fafb2362700 1 -- 172.21.15.39:0/2503129225 wait complete. 2023-11-28T11:57:06.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.965+0000 7fafb2362700 1 Processor -- start 2023-11-28T11:57:06.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.965+0000 7fafb2362700 1 -- start start 2023-11-28T11:57:06.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.965+0000 7fafb2362700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fafac06b240 0x7fafac0c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:06.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.965+0000 7fafb2362700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fafac0c1d50 0x7fafac0af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:06.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.969+0000 7fafb2362700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fafac0ca8e0 0x7fafac158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:06.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.969+0000 7fafb2362700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafac0afc00 con 0x7fafac0ca8e0 2023-11-28T11:57:06.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.969+0000 7fafb2362700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafac159250 con 0x7fafac06b240 2023-11-28T11:57:06.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.969+0000 7fafb2362700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafac0afe30 con 0x7fafac0c1d50 2023-11-28T11:57:06.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.969+0000 7fafb1b61700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fafac0ca8e0 0x7fafac158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:06.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.969+0000 7fafb1b61700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fafac0ca8e0 0x7fafac158d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45420/0 (socket says 172.21.15.39:45420) 2023-11-28T11:57:06.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.969+0000 7fafb1b61700 1 -- 172.21.15.39:0/2711609499 learned_addr learned my addr 172.21.15.39:0/2711609499 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:06.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.969+0000 7fafb1360700 1 --2- 172.21.15.39:0/2711609499 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fafac06b240 0x7fafac0c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:06.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.969+0000 7fafb0b5f700 1 --2- 172.21.15.39:0/2711609499 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fafac0c1d50 0x7fafac0af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:06.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.969+0000 7fafb1b61700 1 -- 172.21.15.39:0/2711609499 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fafac0c1d50 msgr2=0x7fafac0af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:06.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.969+0000 7fafb1b61700 1 --2- 172.21.15.39:0/2711609499 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fafac0c1d50 0x7fafac0af6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:06.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.969+0000 7fafb1b61700 1 -- 172.21.15.39:0/2711609499 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fafac06b240 msgr2=0x7fafac0c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:06.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.969+0000 7fafb1b61700 1 --2- 172.21.15.39:0/2711609499 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fafac06b240 0x7fafac0c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:06.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.969+0000 7fafb1b61700 1 -- 172.21.15.39:0/2711609499 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa4009a70 con 0x7fafac0ca8e0 2023-11-28T11:57:06.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.969+0000 7fafb1b61700 1 --2- 172.21.15.39:0/2711609499 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fafac0ca8e0 0x7fafac158d10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fafa400b370 tx=0x7fafa4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:06.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.969+0000 7fafa1ffb700 1 -- 172.21.15.39:0/2711609499 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa4004780 con 0x7fafac0ca8e0 2023-11-28T11:57:06.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.969+0000 7fafb2362700 1 -- 172.21.15.39:0/2711609499 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafac06a6e0 con 0x7fafac0ca8e0 2023-11-28T11:57:06.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.969+0000 7fafa1ffb700 1 -- 172.21.15.39:0/2711609499 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa4020070 con 0x7fafac0ca8e0 2023-11-28T11:57:06.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.969+0000 7fafa1ffb700 1 -- 172.21.15.39:0/2711609499 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa40098f0 con 0x7fafac0ca8e0 2023-11-28T11:57:06.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.969+0000 7fafb2362700 1 -- 172.21.15.39:0/2711609499 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafac06a400 con 0x7fafac0ca8e0 2023-11-28T11:57:06.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.973+0000 7fafb2362700 1 -- 172.21.15.39:0/2711609499 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafac06a9c0 con 0x7fafac0ca8e0 2023-11-28T11:57:06.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.973+0000 7fafa1ffb700 1 -- 172.21.15.39:0/2711609499 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fafa402e070 con 0x7fafac0ca8e0 2023-11-28T11:57:06.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.977+0000 7fafa1ffb700 1 --2- 172.21.15.39:0/2711609499 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7faf90064ee0 0x7faf90067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:06.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.977+0000 7fafa1ffb700 1 -- 172.21.15.39:0/2711609499 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fafa4022070 con 0x7fafac0ca8e0 2023-11-28T11:57:06.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.977+0000 7fafb1360700 1 --2- 172.21.15.39:0/2711609499 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7faf90064ee0 0x7faf90067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:06.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.977+0000 7fafb1360700 1 --2- 172.21.15.39:0/2711609499 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7faf90064ee0 0x7faf90067390 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fafa8007fd0 tx=0x7fafa8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:06.984 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:06.977+0000 7fafa1ffb700 1 -- 172.21.15.39:0/2711609499 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fafa4051b00 con 0x7fafac0ca8e0 2023-11-28T11:57:07.188 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.181+0000 7fafb2362700 1 -- 172.21.15.39:0/2711609499 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fafac073cb0 con 0x7fafac0ca8e0 2023-11-28T11:57:07.189 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.185+0000 7fafa1ffb700 1 -- 172.21.15.39:0/2711609499 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fafa4055120 con 0x7fafac0ca8e0 2023-11-28T11:57:07.189 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:57:07.189 INFO:teuthology.orchestra.run.smithi039.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-28T11:57:07.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.189+0000 7fafb2362700 1 -- 172.21.15.39:0/2711609499 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7faf90064ee0 msgr2=0x7faf90067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:07.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.189+0000 7fafb2362700 1 --2- 172.21.15.39:0/2711609499 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7faf90064ee0 0x7faf90067390 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fafa8007fd0 tx=0x7fafa8009040 comp rx=0 tx=0).stop 2023-11-28T11:57:07.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.189+0000 7fafb2362700 1 -- 172.21.15.39:0/2711609499 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fafac0ca8e0 msgr2=0x7fafac158d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:07.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.189+0000 7fafb2362700 1 --2- 172.21.15.39:0/2711609499 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fafac0ca8e0 0x7fafac158d10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fafa400b370 tx=0x7fafa4004af0 comp rx=0 tx=0).stop 2023-11-28T11:57:07.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.189+0000 7fafb2362700 1 -- 172.21.15.39:0/2711609499 shutdown_connections 2023-11-28T11:57:07.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.189+0000 7fafb2362700 1 --2- 172.21.15.39:0/2711609499 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fafac0ca8e0 0x7fafac158d10 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:07.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.189+0000 7fafb2362700 1 --2- 172.21.15.39:0/2711609499 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fafac0c1d50 0x7fafac0af6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:07.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.189+0000 7fafb2362700 1 --2- 172.21.15.39:0/2711609499 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7faf90064ee0 0x7faf90067390 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:07.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.189+0000 7fafb2362700 1 --2- 172.21.15.39:0/2711609499 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fafac06b240 0x7fafac0c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:07.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.189+0000 7fafb2362700 1 -- 172.21.15.39:0/2711609499 >> 172.21.15.39:0/2711609499 conn(0x7fafac0ce670 msgr2=0x7fafac0cea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:07.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.189+0000 7fafb2362700 1 -- 172.21.15.39:0/2711609499 shutdown_connections 2023-11-28T11:57:07.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.189+0000 7fafb2362700 1 -- 172.21.15.39:0/2711609499 wait complete. 2023-11-28T11:57:07.215 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-28T11:57:07.215 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:57:07.387 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.381+0000 7f6325f58700 1 Processor -- start 2023-11-28T11:57:07.387 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.381+0000 7f6325f58700 1 -- start start 2023-11-28T11:57:07.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.385+0000 7f6325f58700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f63200b43a0 0x7f632015e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:07.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.385+0000 7f6325f58700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f63200b1640 0x7f6320070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:07.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.385+0000 7f6325f58700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f632015a550 con 0x7f63200c9040 2023-11-28T11:57:07.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.385+0000 7f6325f58700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f632006b0a0 con 0x7f63200b1640 2023-11-28T11:57:07.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.385+0000 7f6325f58700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63200caac0 con 0x7f63200b43a0 2023-11-28T11:57:07.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.385+0000 7f6324f56700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f63200b43a0 0x7f632015e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:07.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.385+0000 7f6317fff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f63200b1640 0x7f6320070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:07.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.385+0000 7f6324f56700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f63200b43a0 0x7f632015e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:43158/0 (socket says 172.21.15.39:43158) 2023-11-28T11:57:07.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.385+0000 7f6324f56700 1 -- 172.21.15.39:0/3259006203 learned_addr learned my addr 172.21.15.39:0/3259006203 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:07.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.385+0000 7f6324f56700 1 -- 172.21.15.39:0/3259006203 >> v2:172.21.15.39:3300/0 conn(0x7f63200b1640 msgr2=0x7f6320070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:07.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.385+0000 7f6324f56700 1 --2- 172.21.15.39:0/3259006203 >> v2:172.21.15.39:3300/0 conn(0x7f63200b1640 0x7f6320070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:07.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.385+0000 7f6324f56700 1 -- 172.21.15.39:0/3259006203 >> v1:172.21.15.39:6789/0 conn(0x7f63200c9040 legacy=0x7f6320069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:07.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.385+0000 7f6324f56700 1 -- 172.21.15.39:0/3259006203 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63200cada0 con 0x7f63200b43a0 2023-11-28T11:57:07.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.385+0000 7f6317fff700 1 --2- 172.21.15.39:0/3259006203 >> v2:172.21.15.39:3300/0 conn(0x7f63200b1640 0x7f6320070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:07.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.389+0000 7f6324f56700 1 --2- 172.21.15.39:0/3259006203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63200b43a0 0x7f632015e5d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f632006fe80 tx=0x7f631c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebd6a23c01135d64 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:07.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.389+0000 7f63177fe700 1 -- 172.21.15.39:0/3259006203 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c00e070 con 0x7f63200b43a0 2023-11-28T11:57:07.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.389+0000 7f63177fe700 1 -- 172.21.15.39:0/3259006203 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631c00b910 con 0x7f63200b43a0 2023-11-28T11:57:07.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.389+0000 7f63177fe700 1 -- 172.21.15.39:0/3259006203 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c00bcc0 con 0x7f63200b43a0 2023-11-28T11:57:07.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.389+0000 7f6325f58700 1 -- 172.21.15.39:0/3259006203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63200b43a0 msgr2=0x7f632015e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:07.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.389+0000 7f6325f58700 1 --2- 172.21.15.39:0/3259006203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63200b43a0 0x7f632015e5d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f632006fe80 tx=0x7f631c00b330 comp rx=0 tx=0).stop 2023-11-28T11:57:07.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.389+0000 7f6325f58700 1 -- 172.21.15.39:0/3259006203 shutdown_connections 2023-11-28T11:57:07.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.389+0000 7f6325f58700 1 --2- 172.21.15.39:0/3259006203 >> v2:172.21.15.39:3300/0 conn(0x7f63200b1640 0x7f6320070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:07.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.389+0000 7f6325f58700 1 --2- 172.21.15.39:0/3259006203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63200b43a0 0x7f632015e5d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:07.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.389+0000 7f6325f58700 1 -- 172.21.15.39:0/3259006203 >> 172.21.15.39:0/3259006203 conn(0x7f63200b0f80 msgr2=0x7f63200ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:07.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.389+0000 7f6325f58700 1 -- 172.21.15.39:0/3259006203 shutdown_connections 2023-11-28T11:57:07.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.389+0000 7f6325f58700 1 -- 172.21.15.39:0/3259006203 wait complete. 2023-11-28T11:57:07.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.393+0000 7f6325f58700 1 Processor -- start 2023-11-28T11:57:07.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.393+0000 7f6325f58700 1 -- start start 2023-11-28T11:57:07.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.393+0000 7f6325f58700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63200b1640 0x7f63201535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:07.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.393+0000 7f6325f58700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63200b43a0 0x7f632015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:07.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.393+0000 7f6325f58700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63200c9040 0x7f63200b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:07.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.393+0000 7f6325f58700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63200ce240 con 0x7f63200c9040 2023-11-28T11:57:07.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.393+0000 7f6325f58700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63200ccd80 con 0x7f63200b1640 2023-11-28T11:57:07.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.393+0000 7f6325f58700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63200ad520 con 0x7f63200b43a0 2023-11-28T11:57:07.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.393+0000 7f6325757700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63200c9040 0x7f63200b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:07.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.393+0000 7f6325757700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63200c9040 0x7f63200b2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45448/0 (socket says 172.21.15.39:45448) 2023-11-28T11:57:07.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.393+0000 7f6325757700 1 -- 172.21.15.39:0/3740418997 learned_addr learned my addr 172.21.15.39:0/3740418997 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:07.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.393+0000 7f6317fff700 1 --2- 172.21.15.39:0/3740418997 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63200b43a0 0x7f632015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:07.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.393+0000 7f6324f56700 1 --2- 172.21.15.39:0/3740418997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63200b1640 0x7f63201535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:07.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.393+0000 7f6325757700 1 -- 172.21.15.39:0/3740418997 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63200b43a0 msgr2=0x7f632015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:07.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.393+0000 7f6325757700 1 --2- 172.21.15.39:0/3740418997 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63200b43a0 0x7f632015a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:07.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.393+0000 7f6325757700 1 -- 172.21.15.39:0/3740418997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63200b1640 msgr2=0x7f63201535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:07.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.393+0000 7f6325757700 1 --2- 172.21.15.39:0/3740418997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63200b1640 0x7f63201535c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:07.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.393+0000 7f6325757700 1 -- 172.21.15.39:0/3740418997 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63100094b0 con 0x7f63200c9040 2023-11-28T11:57:07.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.393+0000 7f6325757700 1 --2- 172.21.15.39:0/3740418997 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63200c9040 0x7f63200b2b90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f631800c480 tx=0x7f631800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:07.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.397+0000 7f63157fa700 1 -- 172.21.15.39:0/3740418997 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63180052d0 con 0x7f63200c9040 2023-11-28T11:57:07.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.397+0000 7f63157fa700 1 -- 172.21.15.39:0/3740418997 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6318005430 con 0x7f63200c9040 2023-11-28T11:57:07.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.397+0000 7f6325f58700 1 -- 172.21.15.39:0/3740418997 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f631c009b30 con 0x7f63200c9040 2023-11-28T11:57:07.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.397+0000 7f63157fa700 1 -- 172.21.15.39:0/3740418997 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63180055a0 con 0x7f63200c9040 2023-11-28T11:57:07.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.397+0000 7f6325f58700 1 -- 172.21.15.39:0/3740418997 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f632006b5d0 con 0x7f63200c9040 2023-11-28T11:57:07.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.397+0000 7f6325f58700 1 -- 172.21.15.39:0/3740418997 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f632006b2f0 con 0x7f63200c9040 2023-11-28T11:57:07.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.397+0000 7f63157fa700 1 -- 172.21.15.39:0/3740418997 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6318019030 con 0x7f63200c9040 2023-11-28T11:57:07.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.401+0000 7f63157fa700 1 --2- 172.21.15.39:0/3740418997 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f630c064ee0 0x7f630c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:07.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.401+0000 7f63157fa700 1 -- 172.21.15.39:0/3740418997 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6318081420 con 0x7f63200c9040 2023-11-28T11:57:07.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.401+0000 7f6324f56700 1 --2- 172.21.15.39:0/3740418997 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f630c064ee0 0x7f630c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:07.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.401+0000 7f6324f56700 1 --2- 172.21.15.39:0/3740418997 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f630c064ee0 0x7f630c067390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f631c000f80 tx=0x7f631c009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:07.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.405+0000 7f63157fa700 1 -- 172.21.15.39:0/3740418997 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f631804f2d0 con 0x7f63200c9040 2023-11-28T11:57:07.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.577+0000 7f6325f58700 1 -- 172.21.15.39:0/3740418997 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f632015eb10 con 0x7f63200c9040 2023-11-28T11:57:07.587 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.581+0000 7f63157fa700 1 -- 172.21.15.39:0/3740418997 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+19652 (secure 0 0 0) 0x7f63180528f0 con 0x7f63200c9040 2023-11-28T11:57:07.587 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:57:07.588 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":29,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:56:44.439368+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:56:38.203736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:56:38.946498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:56:41.988334+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:57:07.589 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.585+0000 7f6325f58700 1 -- 172.21.15.39:0/3740418997 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f630c064ee0 msgr2=0x7f630c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:07.590 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.585+0000 7f6325f58700 1 --2- 172.21.15.39:0/3740418997 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f630c064ee0 0x7f630c067390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f631c000f80 tx=0x7f631c009000 comp rx=0 tx=0).stop 2023-11-28T11:57:07.590 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.585+0000 7f6325f58700 1 -- 172.21.15.39:0/3740418997 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63200c9040 msgr2=0x7f63200b2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:07.590 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.585+0000 7f6325f58700 1 --2- 172.21.15.39:0/3740418997 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63200c9040 0x7f63200b2b90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f631800c480 tx=0x7f631800c840 comp rx=0 tx=0).stop 2023-11-28T11:57:07.591 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.585+0000 7f6325f58700 1 -- 172.21.15.39:0/3740418997 shutdown_connections 2023-11-28T11:57:07.591 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.585+0000 7f6325f58700 1 --2- 172.21.15.39:0/3740418997 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63200c9040 0x7f63200b2b90 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:07.591 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.585+0000 7f6325f58700 1 --2- 172.21.15.39:0/3740418997 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63200b43a0 0x7f632015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:07.591 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.585+0000 7f6325f58700 1 --2- 172.21.15.39:0/3740418997 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f630c064ee0 0x7f630c067390 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:07.591 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.585+0000 7f6325f58700 1 --2- 172.21.15.39:0/3740418997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63200b1640 0x7f63201535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:07.591 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.585+0000 7f6325f58700 1 -- 172.21.15.39:0/3740418997 >> 172.21.15.39:0/3740418997 conn(0x7f63200b0f80 msgr2=0x7f632006ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:07.591 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.585+0000 7f6325f58700 1 -- 172.21.15.39:0/3740418997 shutdown_connections 2023-11-28T11:57:07.591 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.585+0000 7f6325f58700 1 -- 172.21.15.39:0/3740418997 wait complete. 2023-11-28T11:57:07.612 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:56:26.631457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:56:33.242202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:56:38.203736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:56:38.946498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T11:56:41.988334+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T11:57:07.613 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:57:07.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.793+0000 7f540cf58700 1 Processor -- start 2023-11-28T11:57:07.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.793+0000 7f540cf58700 1 -- start start 2023-11-28T11:57:07.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.797+0000 7f540cf58700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f54080d35d0 0x7f54080b85f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:07.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.797+0000 7f540cf58700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f540806bbe0 0x7f540806c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:07.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.797+0000 7f540cf58700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54080b65c0 con 0x7f540815c0f0 2023-11-28T11:57:07.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.797+0000 7f540cf58700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54080b8c40 con 0x7f54080d35d0 2023-11-28T11:57:07.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.797+0000 7f540cf58700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54080b7160 con 0x7f540806bbe0 2023-11-28T11:57:07.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.797+0000 7f5406ffd700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f54080d35d0 0x7f54080b85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:07.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.797+0000 7f5406ffd700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f54080d35d0 0x7f54080b85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45454/0 (socket says 172.21.15.39:45454) 2023-11-28T11:57:07.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.797+0000 7f5406ffd700 1 -- 172.21.15.39:0/3870696615 learned_addr learned my addr 172.21.15.39:0/3870696615 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:07.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.797+0000 7f5407fff700 1 --2- 172.21.15.39:0/3870696615 >> v2:172.21.15.184:3300/0 conn(0x7f540806bbe0 0x7f540806c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:07.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.797+0000 7f5407fff700 1 -- 172.21.15.39:0/3870696615 >> v2:172.21.15.39:3300/0 conn(0x7f54080d35d0 msgr2=0x7f54080b85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:07.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.797+0000 7f5407fff700 1 --2- 172.21.15.39:0/3870696615 >> v2:172.21.15.39:3300/0 conn(0x7f54080d35d0 0x7f54080b85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:07.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.797+0000 7f5407fff700 1 -- 172.21.15.39:0/3870696615 >> v1:172.21.15.184:6789/0 conn(0x7f540815c0f0 legacy=0x7f54080b6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:07.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.797+0000 7f5407fff700 1 -- 172.21.15.39:0/3870696615 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540806c560 con 0x7f540806bbe0 2023-11-28T11:57:07.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.797+0000 7f5406ffd700 1 --2- 172.21.15.39:0/3870696615 >> v2:172.21.15.39:3300/0 conn(0x7f54080d35d0 0x7f54080b85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:07.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.797+0000 7f5407fff700 1 --2- 172.21.15.39:0/3870696615 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f540806bbe0 0x7f540806c020 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f54080d3520 tx=0x7f540000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ca1b43805f92c65 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:07.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.801+0000 7f54067fc700 1 -- 172.21.15.39:0/3870696615 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540000e070 con 0x7f540806bbe0 2023-11-28T11:57:07.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.801+0000 7f54067fc700 1 -- 172.21.15.39:0/3870696615 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540000bb20 con 0x7f540806bbe0 2023-11-28T11:57:07.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.801+0000 7f54067fc700 1 -- 172.21.15.39:0/3870696615 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5400012430 con 0x7f540806bbe0 2023-11-28T11:57:07.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.805+0000 7f540cf58700 1 -- 172.21.15.39:0/3870696615 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f540806bbe0 msgr2=0x7f540806c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:07.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.805+0000 7f540cf58700 1 --2- 172.21.15.39:0/3870696615 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f540806bbe0 0x7f540806c020 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f54080d3520 tx=0x7f540000b330 comp rx=0 tx=0).stop 2023-11-28T11:57:07.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.805+0000 7f540cf58700 1 -- 172.21.15.39:0/3870696615 shutdown_connections 2023-11-28T11:57:07.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.805+0000 7f540cf58700 1 --2- 172.21.15.39:0/3870696615 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f540806bbe0 0x7f540806c020 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:07.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.805+0000 7f540cf58700 1 --2- 172.21.15.39:0/3870696615 >> v2:172.21.15.39:3300/0 conn(0x7f54080d35d0 0x7f54080b85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:07.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.805+0000 7f540cf58700 1 -- 172.21.15.39:0/3870696615 >> 172.21.15.39:0/3870696615 conn(0x7f54080d01d0 msgr2=0x7f54080d2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:07.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.805+0000 7f540cf58700 1 -- 172.21.15.39:0/3870696615 shutdown_connections 2023-11-28T11:57:07.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.805+0000 7f540cf58700 1 -- 172.21.15.39:0/3870696615 wait complete. 2023-11-28T11:57:07.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.805+0000 7f540cf58700 1 Processor -- start 2023-11-28T11:57:07.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.805+0000 7f540cf58700 1 -- start start 2023-11-28T11:57:07.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.809+0000 7f540cf58700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f540806bbe0 0x7f54080cd810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:07.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.809+0000 7f540cf58700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54080d35d0 0x7f54080cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:07.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.809+0000 7f540cf58700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f540815c0f0 0x7f54081f4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:07.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.809+0000 7f540cf58700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54081e2010 con 0x7f540806bbe0 2023-11-28T11:57:07.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.809+0000 7f540cf58700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54081e1390 con 0x7f540815c0f0 2023-11-28T11:57:07.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.809+0000 7f540cf58700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54081e1670 con 0x7f54080d35d0 2023-11-28T11:57:07.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.809+0000 7f54077fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f540806bbe0 0x7f54080cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:07.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.809+0000 7f54077fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f540806bbe0 0x7f54080cd810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45470/0 (socket says 172.21.15.39:45470) 2023-11-28T11:57:07.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.809+0000 7f54077fe700 1 -- 172.21.15.39:0/1828489789 learned_addr learned my addr 172.21.15.39:0/1828489789 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:07.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.809+0000 7f5406ffd700 1 --2- 172.21.15.39:0/1828489789 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54080d35d0 0x7f54080cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:07.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.809+0000 7f5407fff700 1 --2- 172.21.15.39:0/1828489789 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f540815c0f0 0x7f54081f4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:07.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.809+0000 7f54077fe700 1 -- 172.21.15.39:0/1828489789 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54080d35d0 msgr2=0x7f54080cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:07.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.809+0000 7f54077fe700 1 --2- 172.21.15.39:0/1828489789 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54080d35d0 0x7f54080cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:07.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.809+0000 7f54077fe700 1 -- 172.21.15.39:0/1828489789 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f540815c0f0 msgr2=0x7f54081f4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:07.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.809+0000 7f54077fe700 1 --2- 172.21.15.39:0/1828489789 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f540815c0f0 0x7f54081f4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:07.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.809+0000 7f54077fe700 1 -- 172.21.15.39:0/1828489789 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53fc009570 con 0x7f540806bbe0 2023-11-28T11:57:07.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.809+0000 7f54077fe700 1 --2- 172.21.15.39:0/1828489789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f540806bbe0 0x7f54080cd810 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f53f800c500 tx=0x7f53f800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:07.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.809+0000 7f53effff700 1 -- 172.21.15.39:0/1828489789 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f80052d0 con 0x7f540806bbe0 2023-11-28T11:57:07.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.809+0000 7f540cf58700 1 -- 172.21.15.39:0/1828489789 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5400009a70 con 0x7f540806bbe0 2023-11-28T11:57:07.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.809+0000 7f53effff700 1 -- 172.21.15.39:0/1828489789 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f8005430 con 0x7f540806bbe0 2023-11-28T11:57:07.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.809+0000 7f53effff700 1 -- 172.21.15.39:0/1828489789 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f80055a0 con 0x7f540806bbe0 2023-11-28T11:57:07.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.809+0000 7f540cf58700 1 -- 172.21.15.39:0/1828489789 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54080b5f70 con 0x7f540806bbe0 2023-11-28T11:57:07.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.813+0000 7f540cf58700 1 -- 172.21.15.39:0/1828489789 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54080b5c90 con 0x7f540806bbe0 2023-11-28T11:57:07.819 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.813+0000 7f53effff700 1 -- 172.21.15.39:0/1828489789 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f53f8019030 con 0x7f540806bbe0 2023-11-28T11:57:07.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.817+0000 7f53effff700 1 --2- 172.21.15.39:0/1828489789 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f53f4064ee0 0x7f53f4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:07.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.817+0000 7f53effff700 1 -- 172.21.15.39:0/1828489789 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f53f80814a0 con 0x7f540806bbe0 2023-11-28T11:57:07.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.817+0000 7f5406ffd700 1 --2- 172.21.15.39:0/1828489789 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f53f4064ee0 0x7f53f4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:07.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.817+0000 7f5406ffd700 1 --2- 172.21.15.39:0/1828489789 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f53f4064ee0 0x7f53f4067390 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f54080cd2e0 tx=0x7f53fc0092e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:07.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:07.821+0000 7f53effff700 1 -- 172.21.15.39:0/1828489789 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f53f804f1e0 con 0x7f540806bbe0 2023-11-28T11:57:08.006 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.001+0000 7f540cf58700 1 -- 172.21.15.39:0/1828489789 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f54080b6250 con 0x7f540806bbe0 2023-11-28T11:57:08.007 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.001+0000 7f53effff700 1 -- 172.21.15.39:0/1828489789 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f53f8052800 con 0x7f540806bbe0 2023-11-28T11:57:08.007 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-11-28T11:57:08.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.005+0000 7f540cf58700 1 -- 172.21.15.39:0/1828489789 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f53f4064ee0 msgr2=0x7f53f4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:08.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.005+0000 7f540cf58700 1 --2- 172.21.15.39:0/1828489789 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f53f4064ee0 0x7f53f4067390 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f54080cd2e0 tx=0x7f53fc0092e0 comp rx=0 tx=0).stop 2023-11-28T11:57:08.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.005+0000 7f540cf58700 1 -- 172.21.15.39:0/1828489789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f540806bbe0 msgr2=0x7f54080cd810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:08.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.005+0000 7f540cf58700 1 --2- 172.21.15.39:0/1828489789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f540806bbe0 0x7f54080cd810 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f53f800c500 tx=0x7f53f800c810 comp rx=0 tx=0).stop 2023-11-28T11:57:08.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.005+0000 7f540cf58700 1 -- 172.21.15.39:0/1828489789 shutdown_connections 2023-11-28T11:57:08.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.005+0000 7f540cf58700 1 --2- 172.21.15.39:0/1828489789 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f53f4064ee0 0x7f53f4067390 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:08.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.005+0000 7f540cf58700 1 --2- 172.21.15.39:0/1828489789 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f540815c0f0 0x7f54081f4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:08.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.005+0000 7f540cf58700 1 --2- 172.21.15.39:0/1828489789 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54080d35d0 0x7f54080cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:08.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.005+0000 7f540cf58700 1 --2- 172.21.15.39:0/1828489789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f540806bbe0 0x7f54080cd810 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:08.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.005+0000 7f540cf58700 1 -- 172.21.15.39:0/1828489789 >> 172.21.15.39:0/1828489789 conn(0x7f54080d01d0 msgr2=0x7f5408069e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:08.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.005+0000 7f540cf58700 1 -- 172.21.15.39:0/1828489789 shutdown_connections 2023-11-28T11:57:08.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.005+0000 7f540cf58700 1 -- 172.21.15.39:0/1828489789 wait complete. 2023-11-28T11:57:08.033 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:57:08.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.209+0000 7ff8623f2700 1 Processor -- start 2023-11-28T11:57:08.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.209+0000 7ff8623f2700 1 -- start start 2023-11-28T11:57:08.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.209+0000 7ff8623f2700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff85c0ca510 0x7ff85c0af600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:08.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.213+0000 7ff8623f2700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff85c15c990 con 0x7ff85c06ca50 2023-11-28T11:57:08.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.213+0000 7ff8623f2700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff85c15cc70 con 0x7ff85c0b0de0 2023-11-28T11:57:08.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.213+0000 7ff8623f2700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff85c15cf50 con 0x7ff85c0ca510 2023-11-28T11:57:08.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.213+0000 7ff85bfff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff85c0ca510 0x7ff85c0af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:08.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.213+0000 7ff853fff700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7ff85c06ca50 0x7ff85c158540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:44894/0 (socket says 172.21.15.39:44894) 2023-11-28T11:57:08.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.213+0000 7ff853fff700 1 -- 172.21.15.39:0/1525121587 learned_addr learned my addr 172.21.15.39:0/1525121587 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:08.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.213+0000 7ff85bfff700 1 -- 172.21.15.39:0/1525121587 >> v1:172.21.15.184:6789/0 conn(0x7ff85c0b0de0 legacy=0x7ff85c069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:08.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.213+0000 7ff85bfff700 1 -- 172.21.15.39:0/1525121587 >> v1:172.21.15.39:6789/0 conn(0x7ff85c06ca50 legacy=0x7ff85c158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:08.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.213+0000 7ff85bfff700 1 -- 172.21.15.39:0/1525121587 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff85c15d230 con 0x7ff85c0ca510 2023-11-28T11:57:08.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.213+0000 7ff85b7fe700 1 -- 172.21.15.39:0/1525121587 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1115891992 0 0) 0x7ff85c15c990 con 0x7ff85c06ca50 2023-11-28T11:57:08.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.213+0000 7ff85bfff700 1 --2- 172.21.15.39:0/1525121587 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff85c0ca510 0x7ff85c0af600 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff84c00a9f0 tx=0x7ff84c00ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5587b47c2a973fd2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:08.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.213+0000 7ff85b7fe700 1 -- 172.21.15.39:0/1525121587 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84c00cb70 con 0x7ff85c0ca510 2023-11-28T11:57:08.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.213+0000 7ff85b7fe700 1 -- 172.21.15.39:0/1525121587 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff84c00ccd0 con 0x7ff85c0ca510 2023-11-28T11:57:08.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.213+0000 7ff85b7fe700 1 -- 172.21.15.39:0/1525121587 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84c018620 con 0x7ff85c0ca510 2023-11-28T11:57:08.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.217+0000 7ff8623f2700 1 -- 172.21.15.39:0/1525121587 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff85c0ca510 msgr2=0x7ff85c0af600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:08.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.217+0000 7ff8623f2700 1 --2- 172.21.15.39:0/1525121587 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff85c0ca510 0x7ff85c0af600 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff84c00a9f0 tx=0x7ff84c00ad00 comp rx=0 tx=0).stop 2023-11-28T11:57:08.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.217+0000 7ff8623f2700 1 -- 172.21.15.39:0/1525121587 shutdown_connections 2023-11-28T11:57:08.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.217+0000 7ff8623f2700 1 --2- 172.21.15.39:0/1525121587 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff85c0ca510 0x7ff85c0af600 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:08.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.217+0000 7ff8623f2700 1 -- 172.21.15.39:0/1525121587 >> 172.21.15.39:0/1525121587 conn(0x7ff85c0cf580 msgr2=0x7ff85c0cb370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:08.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.217+0000 7ff8623f2700 1 -- 172.21.15.39:0/1525121587 shutdown_connections 2023-11-28T11:57:08.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.217+0000 7ff8623f2700 1 -- 172.21.15.39:0/1525121587 wait complete. 2023-11-28T11:57:08.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.221+0000 7ff8623f2700 1 Processor -- start 2023-11-28T11:57:08.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.221+0000 7ff8623f2700 1 -- start start 2023-11-28T11:57:08.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.221+0000 7ff8623f2700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff85c06ca50 0x7ff85c0c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:08.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.221+0000 7ff8623f2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff85c0b0de0 0x7ff85c0c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:08.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.221+0000 7ff8623f2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff85c0ca510 0x7ff85c157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:08.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.221+0000 7ff8623f2700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff85c1565b0 con 0x7ff85c06ca50 2023-11-28T11:57:08.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.221+0000 7ff8623f2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff85c156850 con 0x7ff85c0b0de0 2023-11-28T11:57:08.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.221+0000 7ff8623f2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff85c156b30 con 0x7ff85c0ca510 2023-11-28T11:57:08.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.221+0000 7ff85bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff85c06ca50 0x7ff85c0c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:08.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.221+0000 7ff85bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff85c06ca50 0x7ff85c0c8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53348/0 (socket says 172.21.15.39:53348) 2023-11-28T11:57:08.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.221+0000 7ff85bfff700 1 -- 172.21.15.39:0/1779723131 learned_addr learned my addr 172.21.15.39:0/1779723131 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:08.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.221+0000 7ff853fff700 1 --2- 172.21.15.39:0/1779723131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff85c0b0de0 0x7ff85c0c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:08.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.221+0000 7ff86098f700 1 --2- 172.21.15.39:0/1779723131 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff85c0ca510 0x7ff85c157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:08.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.225+0000 7ff85bfff700 1 -- 172.21.15.39:0/1779723131 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff85c0ca510 msgr2=0x7ff85c157610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:08.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.225+0000 7ff85bfff700 1 --2- 172.21.15.39:0/1779723131 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff85c0ca510 0x7ff85c157610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:08.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.225+0000 7ff85bfff700 1 -- 172.21.15.39:0/1779723131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff85c0b0de0 msgr2=0x7ff85c0c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:08.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.225+0000 7ff85bfff700 1 --2- 172.21.15.39:0/1779723131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff85c0b0de0 0x7ff85c0c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:08.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.225+0000 7ff85bfff700 1 -- 172.21.15.39:0/1779723131 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff84c00a650 con 0x7ff85c06ca50 2023-11-28T11:57:08.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.225+0000 7ff86098f700 1 --2- 172.21.15.39:0/1779723131 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff85c0ca510 0x7ff85c157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:57:08.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.225+0000 7ff85bfff700 1 --2- 172.21.15.39:0/1779723131 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff85c06ca50 0x7ff85c0c8f40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff84c000c00 tx=0x7ff84c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:08.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.225+0000 7ff8597fa700 1 -- 172.21.15.39:0/1779723131 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84c00cb70 con 0x7ff85c06ca50 2023-11-28T11:57:08.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.225+0000 7ff8597fa700 1 -- 172.21.15.39:0/1779723131 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff84c023420 con 0x7ff85c06ca50 2023-11-28T11:57:08.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.225+0000 7ff8623f2700 1 -- 172.21.15.39:0/1779723131 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff85c15c660 con 0x7ff85c06ca50 2023-11-28T11:57:08.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.225+0000 7ff8597fa700 1 -- 172.21.15.39:0/1779723131 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84c0237b0 con 0x7ff85c06ca50 2023-11-28T11:57:08.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.225+0000 7ff8623f2700 1 -- 172.21.15.39:0/1779723131 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff85c15d510 con 0x7ff85c06ca50 2023-11-28T11:57:08.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.225+0000 7ff8623f2700 1 -- 172.21.15.39:0/1779723131 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff85c0ca8e0 con 0x7ff85c06ca50 2023-11-28T11:57:08.234 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.229+0000 7ff8597fa700 1 -- 172.21.15.39:0/1779723131 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff84c02a030 con 0x7ff85c06ca50 2023-11-28T11:57:08.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.229+0000 7ff8597fa700 1 --2- 172.21.15.39:0/1779723131 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff83c064ee0 0x7ff83c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:08.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.229+0000 7ff8597fa700 1 -- 172.21.15.39:0/1779723131 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff84c0838c0 con 0x7ff85c06ca50 2023-11-28T11:57:08.236 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.229+0000 7ff853fff700 1 --2- 172.21.15.39:0/1779723131 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff83c064ee0 0x7ff83c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:08.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.233+0000 7ff853fff700 1 --2- 172.21.15.39:0/1779723131 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff83c064ee0 0x7ff83c067390 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff85c0ae590 tx=0x7ff844007c40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:08.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.237+0000 7ff8597fa700 1 -- 172.21.15.39:0/1779723131 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff84c051680 con 0x7ff85c06ca50 2023-11-28T11:57:08.423 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.417+0000 7ff8623f2700 1 -- 172.21.15.39:0/1779723131 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff85c0726c0 con 0x7ff85c06ca50 2023-11-28T11:57:08.424 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.421+0000 7ff8597fa700 1 -- 172.21.15.39:0/1779723131 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff84c0280a0 con 0x7ff85c06ca50 2023-11-28T11:57:08.424 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-11-28T11:57:08.427 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.421+0000 7ff8623f2700 1 -- 172.21.15.39:0/1779723131 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff83c064ee0 msgr2=0x7ff83c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:08.427 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.421+0000 7ff8623f2700 1 --2- 172.21.15.39:0/1779723131 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff83c064ee0 0x7ff83c067390 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff85c0ae590 tx=0x7ff844007c40 comp rx=0 tx=0).stop 2023-11-28T11:57:08.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.421+0000 7ff8623f2700 1 -- 172.21.15.39:0/1779723131 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff85c06ca50 msgr2=0x7ff85c0c8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:08.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.421+0000 7ff8623f2700 1 --2- 172.21.15.39:0/1779723131 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff85c06ca50 0x7ff85c0c8f40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff84c000c00 tx=0x7ff84c0047e0 comp rx=0 tx=0).stop 2023-11-28T11:57:08.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.421+0000 7ff8623f2700 1 -- 172.21.15.39:0/1779723131 shutdown_connections 2023-11-28T11:57:08.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.421+0000 7ff8623f2700 1 --2- 172.21.15.39:0/1779723131 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff85c0ca510 0x7ff85c157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:08.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.421+0000 7ff8623f2700 1 --2- 172.21.15.39:0/1779723131 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff83c064ee0 0x7ff83c067390 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:08.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.421+0000 7ff8623f2700 1 --2- 172.21.15.39:0/1779723131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff85c0b0de0 0x7ff85c0c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:08.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.421+0000 7ff8623f2700 1 --2- 172.21.15.39:0/1779723131 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff85c06ca50 0x7ff85c0c8f40 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:08.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.421+0000 7ff8623f2700 1 -- 172.21.15.39:0/1779723131 >> 172.21.15.39:0/1779723131 conn(0x7ff85c0cf580 msgr2=0x7ff85c0b3e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:08.429 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.421+0000 7ff8623f2700 1 -- 172.21.15.39:0/1779723131 shutdown_connections 2023-11-28T11:57:08.429 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.421+0000 7ff8623f2700 1 -- 172.21.15.39:0/1779723131 wait complete. 2023-11-28T11:57:08.449 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:57:08.630 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.625+0000 7ff3af24c700 1 Processor -- start 2023-11-28T11:57:08.630 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.625+0000 7ff3af24c700 1 -- start start 2023-11-28T11:57:08.634 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.629+0000 7ff3af24c700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff3a8070620 0x7ff3a80b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:08.634 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.629+0000 7ff3af24c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff3a8069bf0 0x7ff3a8069ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:08.635 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.629+0000 7ff3af24c700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3a815c520 con 0x7ff3a815c150 2023-11-28T11:57:08.635 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.629+0000 7ff3af24c700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3a80b4240 con 0x7ff3a8070620 2023-11-28T11:57:08.635 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.629+0000 7ff3af24c700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3a806cc50 con 0x7ff3a8069bf0 2023-11-28T11:57:08.635 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.629+0000 7ff3ada49700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff3a8070620 0x7ff3a80b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:08.635 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.629+0000 7ff3ae24a700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7ff3a815c150 0x7ff3a806ff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:44908/0 (socket says 172.21.15.39:44908) 2023-11-28T11:57:08.635 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.629+0000 7ff3ada49700 1 --2- 172.21.15.39:0/3821028063 >> v2:172.21.15.39:3300/0 conn(0x7ff3a8070620 0x7ff3a80b3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53352/0 (socket says 172.21.15.39:53352) 2023-11-28T11:57:08.635 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.629+0000 7ff3ae24a700 1 -- 172.21.15.39:0/3821028063 learned_addr learned my addr 172.21.15.39:0/3821028063 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:08.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.629+0000 7ff3aea4b700 1 --2- 172.21.15.39:0/3821028063 >> v2:172.21.15.184:3300/0 conn(0x7ff3a8069bf0 0x7ff3a8069ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:08.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.629+0000 7ff3ada49700 1 -- 172.21.15.39:0/3821028063 >> v2:172.21.15.184:3300/0 conn(0x7ff3a8069bf0 msgr2=0x7ff3a8069ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:08.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.629+0000 7ff3ada49700 1 --2- 172.21.15.39:0/3821028063 >> v2:172.21.15.184:3300/0 conn(0x7ff3a8069bf0 0x7ff3a8069ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:08.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.629+0000 7ff3ada49700 1 -- 172.21.15.39:0/3821028063 >> v1:172.21.15.39:6789/0 conn(0x7ff3a815c150 legacy=0x7ff3a806ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:08.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.629+0000 7ff3ada49700 1 -- 172.21.15.39:0/3821028063 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a80d2450 con 0x7ff3a8070620 2023-11-28T11:57:08.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.629+0000 7ff3ad248700 1 -- 172.21.15.39:0/3821028063 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 175467953 0 0) 0x7ff3a815c520 con 0x7ff3a815c150 2023-11-28T11:57:08.637 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.633+0000 7ff3ada49700 1 --2- 172.21.15.39:0/3821028063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3a8070620 0x7ff3a80b3d00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8071460 tx=0x7ff398009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61b99f09bc0b81bb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:08.637 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.633+0000 7ff3ad248700 1 -- 172.21.15.39:0/3821028063 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff398005e50 con 0x7ff3a8070620 2023-11-28T11:57:08.637 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.633+0000 7ff3ad248700 1 -- 172.21.15.39:0/3821028063 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff398006030 con 0x7ff3a8070620 2023-11-28T11:57:08.637 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.633+0000 7ff3ad248700 1 -- 172.21.15.39:0/3821028063 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3980063c0 con 0x7ff3a8070620 2023-11-28T11:57:08.638 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.633+0000 7ff3af24c700 1 -- 172.21.15.39:0/3821028063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3a8070620 msgr2=0x7ff3a80b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:08.638 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.633+0000 7ff3af24c700 1 --2- 172.21.15.39:0/3821028063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3a8070620 0x7ff3a80b3d00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8071460 tx=0x7ff398009b20 comp rx=0 tx=0).stop 2023-11-28T11:57:08.639 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.633+0000 7ff3af24c700 1 -- 172.21.15.39:0/3821028063 shutdown_connections 2023-11-28T11:57:08.639 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.633+0000 7ff3af24c700 1 --2- 172.21.15.39:0/3821028063 >> v2:172.21.15.184:3300/0 conn(0x7ff3a8069bf0 0x7ff3a8069ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:08.639 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.633+0000 7ff3af24c700 1 --2- 172.21.15.39:0/3821028063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3a8070620 0x7ff3a80b3d00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:08.639 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.633+0000 7ff3af24c700 1 -- 172.21.15.39:0/3821028063 >> 172.21.15.39:0/3821028063 conn(0x7ff3a80d3680 msgr2=0x7ff3a80cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:08.639 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.633+0000 7ff3af24c700 1 -- 172.21.15.39:0/3821028063 shutdown_connections 2023-11-28T11:57:08.639 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.633+0000 7ff3af24c700 1 -- 172.21.15.39:0/3821028063 wait complete. 2023-11-28T11:57:08.641 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.637+0000 7ff3af24c700 1 Processor -- start 2023-11-28T11:57:08.641 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.637+0000 7ff3af24c700 1 -- start start 2023-11-28T11:57:08.642 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.637+0000 7ff3af24c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3a8069bf0 0x7ff3a80cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:08.642 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.637+0000 7ff3af24c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff3a8070620 0x7ff3a80cf300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:08.642 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.637+0000 7ff3af24c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3a815c150 0x7ff3a80cf840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:08.642 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.637+0000 7ff3af24c700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a80cac30 con 0x7ff3a815c150 2023-11-28T11:57:08.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.637+0000 7ff3af24c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a80caeb0 con 0x7ff3a8069bf0 2023-11-28T11:57:08.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.637+0000 7ff3af24c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a80cb190 con 0x7ff3a8070620 2023-11-28T11:57:08.644 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.637+0000 7ff3aea4b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3a815c150 0x7ff3a80cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:08.644 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.637+0000 7ff3ae24a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3a8069bf0 0x7ff3a80cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:08.644 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.637+0000 7ff3aea4b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3a815c150 0x7ff3a80cf840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53360/0 (socket says 172.21.15.39:53360) 2023-11-28T11:57:08.644 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.637+0000 7ff3aea4b700 1 -- 172.21.15.39:0/1223407626 learned_addr learned my addr 172.21.15.39:0/1223407626 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:08.644 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.637+0000 7ff3ada49700 1 --2- 172.21.15.39:0/1223407626 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff3a8070620 0x7ff3a80cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:08.644 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.637+0000 7ff3aea4b700 1 -- 172.21.15.39:0/1223407626 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff3a8070620 msgr2=0x7ff3a80cf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:08.644 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.637+0000 7ff3aea4b700 1 --2- 172.21.15.39:0/1223407626 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff3a8070620 0x7ff3a80cf300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:08.644 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.637+0000 7ff3aea4b700 1 -- 172.21.15.39:0/1223407626 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3a8069bf0 msgr2=0x7ff3a80cc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:08.644 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.637+0000 7ff3aea4b700 1 --2- 172.21.15.39:0/1223407626 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3a8069bf0 0x7ff3a80cc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:08.645 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.637+0000 7ff3aea4b700 1 -- 172.21.15.39:0/1223407626 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff398009450 con 0x7ff3a815c150 2023-11-28T11:57:08.645 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.637+0000 7ff3ada49700 1 --2- 172.21.15.39:0/1223407626 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff3a8070620 0x7ff3a80cf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:57:08.646 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.641+0000 7ff3aea4b700 1 --2- 172.21.15.39:0/1223407626 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3a815c150 0x7ff3a80cf840 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff3a000efc0 tx=0x7ff3a000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:08.646 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.641+0000 7ff39effd700 1 -- 172.21.15.39:0/1223407626 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a0009ea0 con 0x7ff3a815c150 2023-11-28T11:57:08.646 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.641+0000 7ff39effd700 1 -- 172.21.15.39:0/1223407626 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a000f040 con 0x7ff3a815c150 2023-11-28T11:57:08.646 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.641+0000 7ff3af24c700 1 -- 172.21.15.39:0/1223407626 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a80d05e0 con 0x7ff3a815c150 2023-11-28T11:57:08.646 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.641+0000 7ff39effd700 1 -- 172.21.15.39:0/1223407626 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a0014480 con 0x7ff3a815c150 2023-11-28T11:57:08.646 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.641+0000 7ff3af24c700 1 -- 172.21.15.39:0/1223407626 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3a80d2730 con 0x7ff3a815c150 2023-11-28T11:57:08.647 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.641+0000 7ff3af24c700 1 -- 172.21.15.39:0/1223407626 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3a80d2140 con 0x7ff3a815c150 2023-11-28T11:57:08.648 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.645+0000 7ff39effd700 1 -- 172.21.15.39:0/1223407626 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff3a00145e0 con 0x7ff3a815c150 2023-11-28T11:57:08.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.645+0000 7ff39effd700 1 --2- 172.21.15.39:0/1223407626 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff38c064ee0 0x7ff38c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:08.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.645+0000 7ff39effd700 1 -- 172.21.15.39:0/1223407626 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff3a0082be0 con 0x7ff3a815c150 2023-11-28T11:57:08.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.645+0000 7ff3ae24a700 1 --2- 172.21.15.39:0/1223407626 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff38c064ee0 0x7ff38c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:08.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.645+0000 7ff3ae24a700 1 --2- 172.21.15.39:0/1223407626 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff38c064ee0 0x7ff38c067390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff3a4000f60 tx=0x7ff3a4007e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:08.655 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.649+0000 7ff39effd700 1 -- 172.21.15.39:0/1223407626 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff3a0050a90 con 0x7ff3a815c150 2023-11-28T11:57:08.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.825+0000 7ff3af24c700 1 -- 172.21.15.39:0/1223407626 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff3a8073d20 con 0x7ff3a815c150 2023-11-28T11:57:08.829 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.825+0000 7ff39effd700 1 -- 172.21.15.39:0/1223407626 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff3a00540b0 con 0x7ff3a815c150 2023-11-28T11:57:08.829 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-11-28T11:57:08.833 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.825+0000 7ff3af24c700 1 -- 172.21.15.39:0/1223407626 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff38c064ee0 msgr2=0x7ff38c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:08.833 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.825+0000 7ff3af24c700 1 --2- 172.21.15.39:0/1223407626 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff38c064ee0 0x7ff38c067390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff3a4000f60 tx=0x7ff3a4007e90 comp rx=0 tx=0).stop 2023-11-28T11:57:08.833 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.825+0000 7ff3af24c700 1 -- 172.21.15.39:0/1223407626 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3a815c150 msgr2=0x7ff3a80cf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:08.833 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.825+0000 7ff3af24c700 1 --2- 172.21.15.39:0/1223407626 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3a815c150 0x7ff3a80cf840 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff3a000efc0 tx=0x7ff3a000c3a0 comp rx=0 tx=0).stop 2023-11-28T11:57:08.833 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.829+0000 7ff3af24c700 1 -- 172.21.15.39:0/1223407626 shutdown_connections 2023-11-28T11:57:08.833 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.829+0000 7ff3af24c700 1 --2- 172.21.15.39:0/1223407626 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3a815c150 0x7ff3a80cf840 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:08.833 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.829+0000 7ff3af24c700 1 --2- 172.21.15.39:0/1223407626 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff3a8070620 0x7ff3a80cf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:08.833 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.829+0000 7ff3af24c700 1 --2- 172.21.15.39:0/1223407626 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff38c064ee0 0x7ff38c067390 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:08.834 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.829+0000 7ff3af24c700 1 --2- 172.21.15.39:0/1223407626 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3a8069bf0 0x7ff3a80cc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:08.834 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.829+0000 7ff3af24c700 1 -- 172.21.15.39:0/1223407626 >> 172.21.15.39:0/1223407626 conn(0x7ff3a80d3680 msgr2=0x7ff3a8157620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:08.834 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.829+0000 7ff3af24c700 1 -- 172.21.15.39:0/1223407626 shutdown_connections 2023-11-28T11:57:08.834 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:08.829+0000 7ff3af24c700 1 -- 172.21.15.39:0/1223407626 wait complete. 2023-11-28T11:57:08.853 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:57:09.038 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.033+0000 7f9bcf6ee700 1 Processor -- start 2023-11-28T11:57:09.038 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.033+0000 7f9bcf6ee700 1 -- start start 2023-11-28T11:57:09.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.037+0000 7f9bcf6ee700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9bc815c700 0x7f9bc80702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:09.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.037+0000 7f9bcf6ee700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bc806cf00 con 0x7f9bc80b1be0 2023-11-28T11:57:09.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.037+0000 7f9bcf6ee700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bc806ac00 con 0x7f9bc80b2130 2023-11-28T11:57:09.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.037+0000 7f9bcf6ee700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bc80cd360 con 0x7f9bc815c700 2023-11-28T11:57:09.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.037+0000 7f9bcdc8b700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f9bc80b1be0 0x7f9bc806c7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:44916/0 (socket says 172.21.15.39:44916) 2023-11-28T11:57:09.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.037+0000 7f9bcdc8b700 1 -- 172.21.15.39:0/814486394 learned_addr learned my addr 172.21.15.39:0/814486394 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:09.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.037+0000 7f9bcd48a700 1 --2- 172.21.15.39:0/814486394 >> v2:172.21.15.184:3300/0 conn(0x7f9bc815c700 0x7f9bc80702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:09.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.037+0000 7f9bbffff700 1 -- 172.21.15.39:0/814486394 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4247322878 0 0) 0x7f9bc806cf00 con 0x7f9bc80b1be0 2023-11-28T11:57:09.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.037+0000 7f9bbffff700 1 -- 172.21.15.39:0/814486394 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bb40035d0 con 0x7f9bc80b1be0 2023-11-28T11:57:09.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.037+0000 7f9bbffff700 1 -- 172.21.15.39:0/814486394 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1449589727 0 0) 0x7f9bc806ac00 con 0x7f9bc80b2130 2023-11-28T11:57:09.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.037+0000 7f9bbffff700 1 -- 172.21.15.39:0/814486394 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bc806cf00 con 0x7f9bc80b2130 2023-11-28T11:57:09.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.037+0000 7f9bbffff700 1 -- 172.21.15.39:0/814486394 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2565761967 0 0) 0x7f9bb40035d0 con 0x7f9bc80b1be0 2023-11-28T11:57:09.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.037+0000 7f9bbffff700 1 -- 172.21.15.39:0/814486394 >> v2:172.21.15.184:3300/0 conn(0x7f9bc815c700 msgr2=0x7f9bc80702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:09.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.037+0000 7f9bbffff700 1 --2- 172.21.15.39:0/814486394 >> v2:172.21.15.184:3300/0 conn(0x7f9bc815c700 0x7f9bc80702f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:09.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.037+0000 7f9bbffff700 1 -- 172.21.15.39:0/814486394 >> v1:172.21.15.184:6789/0 conn(0x7f9bc80b2130 legacy=0x7f9bc806c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:09.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.037+0000 7f9bbffff700 1 -- 172.21.15.39:0/814486394 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc8160190 con 0x7f9bc80b1be0 2023-11-28T11:57:09.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.037+0000 7f9bbffff700 1 -- 172.21.15.39:0/814486394 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4013383302 0 0) 0x7f9bc00019f0 con 0x7f9bc80b1be0 2023-11-28T11:57:09.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.037+0000 7f9bcd48a700 1 --2- 172.21.15.39:0/814486394 >> v2:172.21.15.184:3300/0 conn(0x7f9bc815c700 0x7f9bc80702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:09.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.037+0000 7f9bbffff700 1 -- 172.21.15.39:0/814486394 >> v1:172.21.15.39:6789/0 conn(0x7f9bc80b1be0 legacy=0x7f9bc806c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:09.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.037+0000 7f9bbffff700 1 --2- 172.21.15.39:0/814486394 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9bb4003bb0 0x7f9bb4003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:09.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.041+0000 7f9bbffff700 1 --2- 172.21.15.39:0/814486394 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9bb4004870 0x7f9bb4004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:09.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.041+0000 7f9bbffff700 1 --2- 172.21.15.39:0/814486394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9bb4005220 0x7f9bb400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:09.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.041+0000 7f9bbffff700 1 -- 172.21.15.39:0/814486394 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc80cd360 con 0x7f9bb4003bb0 2023-11-28T11:57:09.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.041+0000 7f9bbffff700 1 -- 172.21.15.39:0/814486394 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb400c080 con 0x7f9bb4005220 2023-11-28T11:57:09.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.041+0000 7f9bcd48a700 1 --2- 172.21.15.39:0/814486394 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9bb4003bb0 0x7f9bb4003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:09.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.041+0000 7f9bbffff700 1 -- 172.21.15.39:0/814486394 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb400c240 con 0x7f9bb4004870 2023-11-28T11:57:09.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.041+0000 7f9bccc89700 1 --2- 172.21.15.39:0/814486394 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9bb4004870 0x7f9bb4004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:09.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.041+0000 7f9bcd48a700 1 -- 172.21.15.39:0/814486394 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9bb4004870 msgr2=0x7f9bb4004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:09.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.041+0000 7f9bcd48a700 1 --2- 172.21.15.39:0/814486394 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9bb4004870 0x7f9bb4004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:09.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.041+0000 7f9bcdc8b700 1 --2- 172.21.15.39:0/814486394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9bb4005220 0x7f9bb400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:09.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.041+0000 7f9bcd48a700 1 -- 172.21.15.39:0/814486394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9bb4005220 msgr2=0x7f9bb400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:09.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.041+0000 7f9bcd48a700 1 --2- 172.21.15.39:0/814486394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9bb4005220 0x7f9bb400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:09.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.041+0000 7f9bcd48a700 1 -- 172.21.15.39:0/814486394 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb40035d0 con 0x7f9bb4003bb0 2023-11-28T11:57:09.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.041+0000 7f9bcdc8b700 1 --2- 172.21.15.39:0/814486394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9bb4005220 0x7f9bb400ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:57:09.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.041+0000 7f9bccc89700 1 --2- 172.21.15.39:0/814486394 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9bb4004870 0x7f9bb4004ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:57:09.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.041+0000 7f9bcdc8b700 1 -- 172.21.15.39:0/814486394 reap_dead start 2023-11-28T11:57:09.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.041+0000 7f9bcd48a700 1 --2- 172.21.15.39:0/814486394 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9bb4003bb0 0x7f9bb4003fa0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4009d40 tx=0x7f9bb40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d02aa381fe02b2f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:09.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.041+0000 7f9bbffff700 1 -- 172.21.15.39:0/814486394 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc4009e90 con 0x7f9bb4003bb0 2023-11-28T11:57:09.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.041+0000 7f9bbffff700 1 -- 172.21.15.39:0/814486394 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc400e9a0 con 0x7f9bb4003bb0 2023-11-28T11:57:09.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.041+0000 7f9bbffff700 1 -- 172.21.15.39:0/814486394 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc400ed10 con 0x7f9bb4003bb0 2023-11-28T11:57:09.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.041+0000 7f9bcf6ee700 1 -- 172.21.15.39:0/814486394 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9bb4003bb0 msgr2=0x7f9bb4003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:09.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.041+0000 7f9bcf6ee700 1 --2- 172.21.15.39:0/814486394 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9bb4003bb0 0x7f9bb4003fa0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4009d40 tx=0x7f9bb40058a0 comp rx=0 tx=0).stop 2023-11-28T11:57:09.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.041+0000 7f9bcf6ee700 1 -- 172.21.15.39:0/814486394 shutdown_connections 2023-11-28T11:57:09.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.041+0000 7f9bcf6ee700 1 --2- 172.21.15.39:0/814486394 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9bb4003bb0 0x7f9bb4003fa0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:09.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.041+0000 7f9bcf6ee700 1 -- 172.21.15.39:0/814486394 >> 172.21.15.39:0/814486394 conn(0x7f9bc80d2d10 msgr2=0x7f9bc80d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:09.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.041+0000 7f9bcf6ee700 1 -- 172.21.15.39:0/814486394 shutdown_connections 2023-11-28T11:57:09.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.041+0000 7f9bcf6ee700 1 -- 172.21.15.39:0/814486394 wait complete. 2023-11-28T11:57:09.050 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.045+0000 7f9bcf6ee700 1 Processor -- start 2023-11-28T11:57:09.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.045+0000 7f9bcf6ee700 1 -- start start 2023-11-28T11:57:09.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.049+0000 7f9bcf6ee700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9bb4003bb0 0x7f9bc80c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:09.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.049+0000 7f9bcf6ee700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9bc80b7960 0x7f9bc80b7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:09.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.049+0000 7f9bcf6ee700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9bc80d0c70 0x7f9bc80d10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:09.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.049+0000 7f9bcf6ee700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc80d1600 con 0x7f9bb4003bb0 2023-11-28T11:57:09.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.049+0000 7f9bcf6ee700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc80c68e0 con 0x7f9bc80b7960 2023-11-28T11:57:09.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.049+0000 7f9bcf6ee700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc80c6b80 con 0x7f9bc80d0c70 2023-11-28T11:57:09.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.049+0000 7f9bcd48a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9bb4003bb0 0x7f9bc80c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:09.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.049+0000 7f9bcd48a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9bb4003bb0 0x7f9bc80c8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53378/0 (socket says 172.21.15.39:53378) 2023-11-28T11:57:09.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.049+0000 7f9bcd48a700 1 -- 172.21.15.39:0/3400253170 learned_addr learned my addr 172.21.15.39:0/3400253170 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:09.054 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.049+0000 7f9bccc89700 1 --2- 172.21.15.39:0/3400253170 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9bc80b7960 0x7f9bc80b7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:09.055 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.049+0000 7f9bcdc8b700 1 --2- 172.21.15.39:0/3400253170 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9bc80d0c70 0x7f9bc80d10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:09.055 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.049+0000 7f9bcd48a700 1 -- 172.21.15.39:0/3400253170 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9bc80d0c70 msgr2=0x7f9bc80d10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:09.055 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.049+0000 7f9bcd48a700 1 --2- 172.21.15.39:0/3400253170 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9bc80d0c70 0x7f9bc80d10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:09.055 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.049+0000 7f9bcd48a700 1 -- 172.21.15.39:0/3400253170 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9bc80b7960 msgr2=0x7f9bc80b7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:09.055 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.049+0000 7f9bcd48a700 1 --2- 172.21.15.39:0/3400253170 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9bc80b7960 0x7f9bc80b7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:09.055 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.049+0000 7f9bcd48a700 1 -- 172.21.15.39:0/3400253170 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc8160750 con 0x7f9bb4003bb0 2023-11-28T11:57:09.056 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.049+0000 7f9bcd48a700 1 --2- 172.21.15.39:0/3400253170 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9bb4003bb0 0x7f9bc80c8520 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9bc40090b0 tx=0x7f9bc40047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:09.056 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.049+0000 7f9bbdffb700 1 -- 172.21.15.39:0/3400253170 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc4003ad0 con 0x7f9bb4003bb0 2023-11-28T11:57:09.056 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.049+0000 7f9bbdffb700 1 -- 172.21.15.39:0/3400253170 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc4003c30 con 0x7f9bb4003bb0 2023-11-28T11:57:09.056 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.049+0000 7f9bcf6ee700 1 -- 172.21.15.39:0/3400253170 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bc8160470 con 0x7f9bb4003bb0 2023-11-28T11:57:09.056 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.049+0000 7f9bbdffb700 1 -- 172.21.15.39:0/3400253170 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc4009e90 con 0x7f9bb4003bb0 2023-11-28T11:57:09.056 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.049+0000 7f9bcf6ee700 1 -- 172.21.15.39:0/3400253170 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bc8160a30 con 0x7f9bb4003bb0 2023-11-28T11:57:09.057 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.053+0000 7f9bcf6ee700 1 -- 172.21.15.39:0/3400253170 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bc80726c0 con 0x7f9bb4003bb0 2023-11-28T11:57:09.059 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.053+0000 7f9bbdffb700 1 -- 172.21.15.39:0/3400253170 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9bc402c030 con 0x7f9bb4003bb0 2023-11-28T11:57:09.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.057+0000 7f9bbdffb700 1 --2- 172.21.15.39:0/3400253170 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9bac064f10 0x7f9bac0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:09.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.057+0000 7f9bbdffb700 1 -- 172.21.15.39:0/3400253170 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9bc4083730 con 0x7f9bb4003bb0 2023-11-28T11:57:09.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.057+0000 7f9bccc89700 1 --2- 172.21.15.39:0/3400253170 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9bac064f10 0x7f9bac0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:09.063 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.057+0000 7f9bccc89700 1 --2- 172.21.15.39:0/3400253170 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9bac064f10 0x7f9bac0673c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8007fd0 tx=0x7f9bb8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:09.067 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.061+0000 7f9bbdffb700 1 -- 172.21.15.39:0/3400253170 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9bc40515e0 con 0x7f9bb4003bb0 2023-11-28T11:57:09.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.233+0000 7f9bcf6ee700 1 -- 172.21.15.39:0/3400253170 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9bc8072280 con 0x7f9bb4003bb0 2023-11-28T11:57:09.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.233+0000 7f9bbdffb700 1 -- 172.21.15.39:0/3400253170 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9bc4054c00 con 0x7f9bb4003bb0 2023-11-28T11:57:09.240 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2023-11-28T11:57:09.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.237+0000 7f9bcf6ee700 1 -- 172.21.15.39:0/3400253170 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9bac064f10 msgr2=0x7f9bac0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:09.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.237+0000 7f9bcf6ee700 1 --2- 172.21.15.39:0/3400253170 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9bac064f10 0x7f9bac0673c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8007fd0 tx=0x7f9bb8009040 comp rx=0 tx=0).stop 2023-11-28T11:57:09.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.237+0000 7f9bcf6ee700 1 -- 172.21.15.39:0/3400253170 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9bb4003bb0 msgr2=0x7f9bc80c8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:09.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.237+0000 7f9bcf6ee700 1 --2- 172.21.15.39:0/3400253170 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9bb4003bb0 0x7f9bc80c8520 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9bc40090b0 tx=0x7f9bc40047e0 comp rx=0 tx=0).stop 2023-11-28T11:57:09.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.237+0000 7f9bcf6ee700 1 -- 172.21.15.39:0/3400253170 shutdown_connections 2023-11-28T11:57:09.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.237+0000 7f9bcf6ee700 1 --2- 172.21.15.39:0/3400253170 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9bc80d0c70 0x7f9bc80d10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:09.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.237+0000 7f9bcf6ee700 1 --2- 172.21.15.39:0/3400253170 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9bac064f10 0x7f9bac0673c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:09.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.237+0000 7f9bcf6ee700 1 --2- 172.21.15.39:0/3400253170 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9bc80b7960 0x7f9bc80b7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:09.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.237+0000 7f9bcf6ee700 1 --2- 172.21.15.39:0/3400253170 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9bb4003bb0 0x7f9bc80c8520 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:09.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.237+0000 7f9bcf6ee700 1 -- 172.21.15.39:0/3400253170 >> 172.21.15.39:0/3400253170 conn(0x7f9bc80d2d10 msgr2=0x7f9bc8157110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:09.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.237+0000 7f9bcf6ee700 1 -- 172.21.15.39:0/3400253170 shutdown_connections 2023-11-28T11:57:09.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.237+0000 7f9bcf6ee700 1 -- 172.21.15.39:0/3400253170 wait complete. 2023-11-28T11:57:09.264 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T11:57:09.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.445+0000 7fe34dc6f700 1 Processor -- start 2023-11-28T11:57:09.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.445+0000 7fe34dc6f700 1 -- start start 2023-11-28T11:57:09.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.445+0000 7fe34dc6f700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe348070a90 0x7fe3480c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:09.452 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.445+0000 7fe34dc6f700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe34815a9f0 0x7fe34806b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:09.452 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.445+0000 7fe34dc6f700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe348070600 con 0x7fe348159f10 2023-11-28T11:57:09.452 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.445+0000 7fe34dc6f700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe34806b840 con 0x7fe34815a9f0 2023-11-28T11:57:09.452 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.445+0000 7fe34dc6f700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe34815adf0 con 0x7fe348070a90 2023-11-28T11:57:09.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.449+0000 7fe34d46e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe34815a9f0 0x7fe34806b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:09.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.449+0000 7fe34d46e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe34815a9f0 0x7fe34806b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53384/0 (socket says 172.21.15.39:53384) 2023-11-28T11:57:09.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.449+0000 7fe34d46e700 1 -- 172.21.15.39:0/2507134167 learned_addr learned my addr 172.21.15.39:0/2507134167 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:09.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.449+0000 7fe347fff700 1 --2- 172.21.15.39:0/2507134167 >> v2:172.21.15.184:3300/0 conn(0x7fe348070a90 0x7fe3480c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:09.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.449+0000 7fe34d46e700 1 -- 172.21.15.39:0/2507134167 >> v2:172.21.15.184:3300/0 conn(0x7fe348070a90 msgr2=0x7fe3480c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:09.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.449+0000 7fe34d46e700 1 --2- 172.21.15.39:0/2507134167 >> v2:172.21.15.184:3300/0 conn(0x7fe348070a90 0x7fe3480c8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:09.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.449+0000 7fe34d46e700 1 -- 172.21.15.39:0/2507134167 >> v1:172.21.15.184:6789/0 conn(0x7fe348159f10 legacy=0x7fe34815a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:09.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.449+0000 7fe34d46e700 1 -- 172.21.15.39:0/2507134167 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3480afcc0 con 0x7fe34815a9f0 2023-11-28T11:57:09.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.449+0000 7fe347fff700 1 --2- 172.21.15.39:0/2507134167 >> v2:172.21.15.184:3300/0 conn(0x7fe348070a90 0x7fe3480c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:57:09.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.449+0000 7fe34d46e700 1 --2- 172.21.15.39:0/2507134167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe34815a9f0 0x7fe34806b300 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe3480c93e0 tx=0x7fe34000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef8572f9066c6ecd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:09.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.449+0000 7fe3477fe700 1 -- 172.21.15.39:0/2507134167 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34000e070 con 0x7fe34815a9f0 2023-11-28T11:57:09.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.449+0000 7fe3477fe700 1 -- 172.21.15.39:0/2507134167 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe340003a40 con 0x7fe34815a9f0 2023-11-28T11:57:09.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.449+0000 7fe3477fe700 1 -- 172.21.15.39:0/2507134167 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe340003df0 con 0x7fe34815a9f0 2023-11-28T11:57:09.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.449+0000 7fe34dc6f700 1 -- 172.21.15.39:0/2507134167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe34815a9f0 msgr2=0x7fe34806b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:09.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.449+0000 7fe34dc6f700 1 --2- 172.21.15.39:0/2507134167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe34815a9f0 0x7fe34806b300 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe3480c93e0 tx=0x7fe34000b330 comp rx=0 tx=0).stop 2023-11-28T11:57:09.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.449+0000 7fe34dc6f700 1 -- 172.21.15.39:0/2507134167 shutdown_connections 2023-11-28T11:57:09.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.449+0000 7fe34dc6f700 1 --2- 172.21.15.39:0/2507134167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe34815a9f0 0x7fe34806b300 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:09.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.449+0000 7fe34dc6f700 1 --2- 172.21.15.39:0/2507134167 >> v2:172.21.15.184:3300/0 conn(0x7fe348070a90 0x7fe3480c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:09.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.449+0000 7fe34dc6f700 1 -- 172.21.15.39:0/2507134167 >> 172.21.15.39:0/2507134167 conn(0x7fe3480cf280 msgr2=0x7fe3480cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:09.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.449+0000 7fe34dc6f700 1 -- 172.21.15.39:0/2507134167 shutdown_connections 2023-11-28T11:57:09.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.449+0000 7fe34dc6f700 1 -- 172.21.15.39:0/2507134167 wait complete. 2023-11-28T11:57:09.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.453+0000 7fe34dc6f700 1 Processor -- start 2023-11-28T11:57:09.457 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.453+0000 7fe34dc6f700 1 -- start start 2023-11-28T11:57:09.460 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.453+0000 7fe34dc6f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe348070a90 0x7fe348153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:09.460 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.453+0000 7fe34dc6f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe348159f10 0x7fe34815c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:09.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.453+0000 7fe34dc6f700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe34815a9f0 0x7fe34814ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:09.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.453+0000 7fe34dc6f700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe348154120 con 0x7fe34815a9f0 2023-11-28T11:57:09.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.453+0000 7fe34dc6f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3480b2a70 con 0x7fe348070a90 2023-11-28T11:57:09.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.453+0000 7fe34dc6f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3480b19d0 con 0x7fe348159f10 2023-11-28T11:57:09.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.453+0000 7fe34d46e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe34815a9f0 0x7fe34814ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:09.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.453+0000 7fe34d46e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe34815a9f0 0x7fe34814ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53400/0 (socket says 172.21.15.39:53400) 2023-11-28T11:57:09.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.453+0000 7fe34d46e700 1 -- 172.21.15.39:0/2110421421 learned_addr learned my addr 172.21.15.39:0/2110421421 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:09.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.453+0000 7fe34d46e700 1 -- 172.21.15.39:0/2110421421 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe348159f10 msgr2=0x7fe34815c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:09.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.453+0000 7fe34d46e700 1 --2- 172.21.15.39:0/2110421421 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe348159f10 0x7fe34815c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:09.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.453+0000 7fe34d46e700 1 -- 172.21.15.39:0/2110421421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe348070a90 msgr2=0x7fe348153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:09.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.453+0000 7fe34cc6d700 1 --2- 172.21.15.39:0/2110421421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe348070a90 0x7fe348153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:09.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.453+0000 7fe34d46e700 1 --2- 172.21.15.39:0/2110421421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe348070a90 0x7fe348153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:09.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.453+0000 7fe34d46e700 1 -- 172.21.15.39:0/2110421421 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe340009b30 con 0x7fe34815a9f0 2023-11-28T11:57:09.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.453+0000 7fe34cc6d700 1 --2- 172.21.15.39:0/2110421421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe348070a90 0x7fe348153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:57:09.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.453+0000 7fe34d46e700 1 --2- 172.21.15.39:0/2110421421 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe34815a9f0 0x7fe34814ade0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe340015040 tx=0x7fe340004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:09.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.453+0000 7fe3457fa700 1 -- 172.21.15.39:0/2110421421 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe340004440 con 0x7fe34815a9f0 2023-11-28T11:57:09.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.453+0000 7fe3457fa700 1 -- 172.21.15.39:0/2110421421 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3400045a0 con 0x7fe34815a9f0 2023-11-28T11:57:09.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.453+0000 7fe3457fa700 1 -- 172.21.15.39:0/2110421421 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe340004950 con 0x7fe34815a9f0 2023-11-28T11:57:09.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.453+0000 7fe34dc6f700 1 -- 172.21.15.39:0/2110421421 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe348070290 con 0x7fe34815a9f0 2023-11-28T11:57:09.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.457+0000 7fe34dc6f700 1 -- 172.21.15.39:0/2110421421 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe34806ffb0 con 0x7fe34815a9f0 2023-11-28T11:57:09.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.457+0000 7fe34dc6f700 1 -- 172.21.15.39:0/2110421421 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3480affa0 con 0x7fe34815a9f0 2023-11-28T11:57:09.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.457+0000 7fe3457fa700 1 -- 172.21.15.39:0/2110421421 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe340022030 con 0x7fe34815a9f0 2023-11-28T11:57:09.464 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.461+0000 7fe3457fa700 1 --2- 172.21.15.39:0/2110421421 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe32c064ee0 0x7fe32c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:09.464 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.461+0000 7fe3457fa700 1 -- 172.21.15.39:0/2110421421 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe3400835f0 con 0x7fe34815a9f0 2023-11-28T11:57:09.464 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.461+0000 7fe34cc6d700 1 --2- 172.21.15.39:0/2110421421 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe32c064ee0 0x7fe32c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:09.465 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.461+0000 7fe34cc6d700 1 --2- 172.21.15.39:0/2110421421 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe32c064ee0 0x7fe32c067390 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe33c003f90 tx=0x7fe33c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:09.473 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.465+0000 7fe3457fa700 1 -- 172.21.15.39:0/2110421421 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe340051420 con 0x7fe34815a9f0 2023-11-28T11:57:09.646 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.641+0000 7fe34dc6f700 1 -- 172.21.15.39:0/2110421421 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe34806cf30 con 0x7fe34815a9f0 2023-11-28T11:57:09.647 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.641+0000 7fe3457fa700 1 -- 172.21.15.39:0/2110421421 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe340054a40 con 0x7fe34815a9f0 2023-11-28T11:57:09.647 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-11-28T11:57:09.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.645+0000 7fe34dc6f700 1 -- 172.21.15.39:0/2110421421 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe32c064ee0 msgr2=0x7fe32c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:09.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.645+0000 7fe34dc6f700 1 --2- 172.21.15.39:0/2110421421 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe32c064ee0 0x7fe32c067390 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe33c003f90 tx=0x7fe33c009040 comp rx=0 tx=0).stop 2023-11-28T11:57:09.652 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.645+0000 7fe34dc6f700 1 -- 172.21.15.39:0/2110421421 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe34815a9f0 msgr2=0x7fe34814ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:09.652 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.645+0000 7fe34dc6f700 1 --2- 172.21.15.39:0/2110421421 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe34815a9f0 0x7fe34814ade0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe340015040 tx=0x7fe340004af0 comp rx=0 tx=0).stop 2023-11-28T11:57:09.652 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.645+0000 7fe34dc6f700 1 -- 172.21.15.39:0/2110421421 shutdown_connections 2023-11-28T11:57:09.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.645+0000 7fe34dc6f700 1 --2- 172.21.15.39:0/2110421421 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe34815a9f0 0x7fe34814ade0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:09.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.645+0000 7fe34dc6f700 1 --2- 172.21.15.39:0/2110421421 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe348159f10 0x7fe34815c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:09.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.645+0000 7fe34dc6f700 1 --2- 172.21.15.39:0/2110421421 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe32c064ee0 0x7fe32c067390 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:09.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.645+0000 7fe34dc6f700 1 --2- 172.21.15.39:0/2110421421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe348070a90 0x7fe348153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:09.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.645+0000 7fe34dc6f700 1 -- 172.21.15.39:0/2110421421 >> 172.21.15.39:0/2110421421 conn(0x7fe3480cf280 msgr2=0x7fe3480c3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:09.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.649+0000 7fe34dc6f700 1 -- 172.21.15.39:0/2110421421 shutdown_connections 2023-11-28T11:57:09.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.649+0000 7fe34dc6f700 1 -- 172.21.15.39:0/2110421421 wait complete. 2023-11-28T11:57:09.676 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:57:09.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.845+0000 7f520759e700 1 Processor -- start 2023-11-28T11:57:09.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.845+0000 7f520759e700 1 -- start start 2023-11-28T11:57:09.853 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.849+0000 7f520759e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f52080b1640 0x7f5208070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:09.853 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.849+0000 7f520759e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52080c9040 0x7f52080705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:09.853 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.849+0000 7f520759e700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f520815a550 con 0x7f52080b43a0 2023-11-28T11:57:09.853 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.849+0000 7f520759e700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f520806b0a0 con 0x7f52080b1640 2023-11-28T11:57:09.853 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.849+0000 7f520759e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52080caac0 con 0x7f52080c9040 2023-11-28T11:57:09.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.849+0000 7f520659c700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f52080b43a0 0x7f520815e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:44928/0 (socket says 172.21.15.39:44928) 2023-11-28T11:57:09.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.849+0000 7f520659c700 1 -- 172.21.15.39:0/3773862162 learned_addr learned my addr 172.21.15.39:0/3773862162 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:09.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.849+0000 7f51fdd9b700 1 --2- 172.21.15.39:0/3773862162 >> v2:172.21.15.39:3300/0 conn(0x7f52080b1640 0x7f5208070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:09.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.849+0000 7f5206d9d700 1 --2- 172.21.15.39:0/3773862162 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52080c9040 0x7f52080705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:09.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.849+0000 7f5205d9b700 1 -- 172.21.15.39:0/3773862162 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1047946674 0 0) 0x7f51f8001490 con 0x7f52080b43a0 2023-11-28T11:57:09.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.849+0000 7f5205d9b700 1 -- 172.21.15.39:0/3773862162 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51f40035d0 con 0x7f52080b43a0 2023-11-28T11:57:09.855 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.849+0000 7f5205d9b700 1 -- 172.21.15.39:0/3773862162 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1119528608 0 0) 0x7f51f40035d0 con 0x7f52080b43a0 2023-11-28T11:57:09.855 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.849+0000 7f51fdd9b700 1 -- 172.21.15.39:0/3773862162 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52080c9040 msgr2=0x7f52080705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:09.855 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.849+0000 7f51fdd9b700 1 --2- 172.21.15.39:0/3773862162 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52080c9040 0x7f52080705c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:09.855 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.849+0000 7f51fdd9b700 1 -- 172.21.15.39:0/3773862162 >> v1:172.21.15.39:6789/0 conn(0x7f52080b43a0 legacy=0x7f520815e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:09.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.849+0000 7f51fdd9b700 1 -- 172.21.15.39:0/3773862162 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52080cada0 con 0x7f52080b1640 2023-11-28T11:57:09.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.849+0000 7f51fdd9b700 1 --2- 172.21.15.39:0/3773862162 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52080b1640 0x7f5208070080 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f51f0009850 tx=0x7f51f0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cac25e7c128ba2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:09.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.849+0000 7f5205d9b700 1 -- 172.21.15.39:0/3773862162 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f8001b80 con 0x7f52080b1640 2023-11-28T11:57:09.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.849+0000 7f5205d9b700 1 -- 172.21.15.39:0/3773862162 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f0004030 con 0x7f52080b1640 2023-11-28T11:57:09.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.849+0000 7f5205d9b700 1 -- 172.21.15.39:0/3773862162 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f00043e0 con 0x7f52080b1640 2023-11-28T11:57:09.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.853+0000 7f520759e700 1 -- 172.21.15.39:0/3773862162 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52080b1640 msgr2=0x7f5208070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:09.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.853+0000 7f520759e700 1 --2- 172.21.15.39:0/3773862162 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52080b1640 0x7f5208070080 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f51f0009850 tx=0x7f51f0009b60 comp rx=0 tx=0).stop 2023-11-28T11:57:09.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.853+0000 7f520759e700 1 -- 172.21.15.39:0/3773862162 shutdown_connections 2023-11-28T11:57:09.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.853+0000 7f520759e700 1 --2- 172.21.15.39:0/3773862162 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52080c9040 0x7f52080705c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:09.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.853+0000 7f520759e700 1 --2- 172.21.15.39:0/3773862162 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52080b1640 0x7f5208070080 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:09.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.853+0000 7f520759e700 1 -- 172.21.15.39:0/3773862162 >> 172.21.15.39:0/3773862162 conn(0x7f52080b0f80 msgr2=0x7f52080ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:09.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.853+0000 7f520759e700 1 -- 172.21.15.39:0/3773862162 shutdown_connections 2023-11-28T11:57:09.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.853+0000 7f520759e700 1 -- 172.21.15.39:0/3773862162 wait complete. 2023-11-28T11:57:09.861 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.857+0000 7f520759e700 1 Processor -- start 2023-11-28T11:57:09.861 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.857+0000 7f520759e700 1 -- start start 2023-11-28T11:57:09.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.857+0000 7f520759e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52080b1640 0x7f520815b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:09.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.857+0000 7f520759e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52080b43a0 0x7f5208154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:09.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.857+0000 7f520759e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52080c9040 0x7f5208069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:09.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.857+0000 7f520759e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5208155440 con 0x7f52080c9040 2023-11-28T11:57:09.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.857+0000 7f520759e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520815ade0 con 0x7f52080b1640 2023-11-28T11:57:09.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.857+0000 7f520759e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520806a440 con 0x7f52080b43a0 2023-11-28T11:57:09.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.857+0000 7f5206d9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52080c9040 0x7f5208069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:09.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.857+0000 7f51fdd9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52080b43a0 0x7f5208154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:09.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.857+0000 7f520659c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52080b1640 0x7f520815b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:09.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.857+0000 7f5206d9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52080c9040 0x7f5208069bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53410/0 (socket says 172.21.15.39:53410) 2023-11-28T11:57:09.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.857+0000 7f5206d9d700 1 -- 172.21.15.39:0/1208209973 learned_addr learned my addr 172.21.15.39:0/1208209973 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:09.865 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.861+0000 7f5206d9d700 1 -- 172.21.15.39:0/1208209973 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52080b43a0 msgr2=0x7f5208154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:09.865 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.861+0000 7f5206d9d700 1 --2- 172.21.15.39:0/1208209973 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52080b43a0 0x7f5208154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:09.865 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.861+0000 7f5206d9d700 1 -- 172.21.15.39:0/1208209973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52080b1640 msgr2=0x7f520815b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:09.865 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.861+0000 7f5206d9d700 1 --2- 172.21.15.39:0/1208209973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52080b1640 0x7f520815b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:09.865 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.861+0000 7f5206d9d700 1 -- 172.21.15.39:0/1208209973 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f00094b0 con 0x7f52080c9040 2023-11-28T11:57:09.865 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.861+0000 7f5206d9d700 1 --2- 172.21.15.39:0/1208209973 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52080c9040 0x7f5208069bf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f520000eb60 tx=0x7f520000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:09.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.861+0000 7f51ff7fe700 1 -- 172.21.15.39:0/1208209973 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5200009740 con 0x7f52080c9040 2023-11-28T11:57:09.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.861+0000 7f51ff7fe700 1 -- 172.21.15.39:0/1208209973 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5200009e00 con 0x7f52080c9040 2023-11-28T11:57:09.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.861+0000 7f520759e700 1 -- 172.21.15.39:0/1208209973 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f520806b5d0 con 0x7f52080c9040 2023-11-28T11:57:09.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.861+0000 7f51ff7fe700 1 -- 172.21.15.39:0/1208209973 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520000ca70 con 0x7f52080c9040 2023-11-28T11:57:09.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.861+0000 7f520759e700 1 -- 172.21.15.39:0/1208209973 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f520806b2f0 con 0x7f52080c9040 2023-11-28T11:57:09.867 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.861+0000 7f520759e700 1 -- 172.21.15.39:0/1208209973 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52080ca7b0 con 0x7f52080c9040 2023-11-28T11:57:09.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.865+0000 7f51ff7fe700 1 -- 172.21.15.39:0/1208209973 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5200019030 con 0x7f52080c9040 2023-11-28T11:57:09.870 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.865+0000 7f51ff7fe700 1 --2- 172.21.15.39:0/1208209973 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f51e8064ee0 0x7f51e8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:09.870 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.865+0000 7f51ff7fe700 1 -- 172.21.15.39:0/1208209973 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5200082120 con 0x7f52080c9040 2023-11-28T11:57:09.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.865+0000 7f520659c700 1 --2- 172.21.15.39:0/1208209973 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f51e8064ee0 0x7f51e8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:09.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.865+0000 7f520659c700 1 --2- 172.21.15.39:0/1208209973 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f51e8064ee0 0x7f51e8067390 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f51f80012e0 tx=0x7f51f8002170 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:09.878 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:09.873+0000 7f51ff7fe700 1 -- 172.21.15.39:0/1208209973 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f520004fee0 con 0x7f52080c9040 2023-11-28T11:57:10.089 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.085+0000 7f520759e700 1 -- 172.21.15.39:0/1208209973 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5208073200 con 0x7f52080c9040 2023-11-28T11:57:10.090 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.085+0000 7f51ff7fe700 1 -- 172.21.15.39:0/1208209973 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4647 (secure 0 0 0) 0x7f5208073200 con 0x7f52080c9040 2023-11-28T11:57:10.090 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:57:10.090 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4265,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1518942402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":1518942402},{"type":"v1","addr":"172.21.15.184:6837","nonce":1518942402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/1834562481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":1834562481},{"type":"v1","addr":"172.21.15.39:6833","nonce":1834562481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2470756838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2470756838},{"type":"v1","addr":"172.21.15.39:6835","nonce":2470756838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:56:39.894634+0000","modified":"2023-11-28T11:56:59.724929+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6835/516507254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":516507254},{"type":"v1","addr":"172.21.15.184:6835","nonce":516507254}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T11:57:10.095 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.089+0000 7f520759e700 1 -- 172.21.15.39:0/1208209973 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f51e8064ee0 msgr2=0x7f51e8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:10.095 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.089+0000 7f520759e700 1 --2- 172.21.15.39:0/1208209973 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f51e8064ee0 0x7f51e8067390 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f51f80012e0 tx=0x7f51f8002170 comp rx=0 tx=0).stop 2023-11-28T11:57:10.095 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.089+0000 7f520759e700 1 -- 172.21.15.39:0/1208209973 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52080c9040 msgr2=0x7f5208069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:10.095 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.089+0000 7f520759e700 1 --2- 172.21.15.39:0/1208209973 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52080c9040 0x7f5208069bf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f520000eb60 tx=0x7f520000ee70 comp rx=0 tx=0).stop 2023-11-28T11:57:10.095 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.089+0000 7f520759e700 1 -- 172.21.15.39:0/1208209973 shutdown_connections 2023-11-28T11:57:10.095 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.089+0000 7f520759e700 1 --2- 172.21.15.39:0/1208209973 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52080c9040 0x7f5208069bf0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:10.095 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.089+0000 7f520759e700 1 --2- 172.21.15.39:0/1208209973 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f52080b43a0 0x7f5208154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:10.096 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.089+0000 7f520759e700 1 --2- 172.21.15.39:0/1208209973 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f51e8064ee0 0x7f51e8067390 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:10.096 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.089+0000 7f520759e700 1 --2- 172.21.15.39:0/1208209973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52080b1640 0x7f520815b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:10.096 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.089+0000 7f520759e700 1 -- 172.21.15.39:0/1208209973 >> 172.21.15.39:0/1208209973 conn(0x7f52080b0f80 msgr2=0x7f5208159ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:10.096 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.089+0000 7f520759e700 1 -- 172.21.15.39:0/1208209973 shutdown_connections 2023-11-28T11:57:10.096 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.089+0000 7f520759e700 1 -- 172.21.15.39:0/1208209973 wait complete. 2023-11-28T11:57:10.098 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 9 2023-11-28T11:57:10.521 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T11:56:39.894634+0000', 'modified': '2023-11-28T11:56:59.724929+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4288}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4288': {'gid': 4288, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.184:6835/516507254', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6834', 'nonce': 516507254}, {'type': 'v1', 'addr': '172.21.15.184:6835', 'nonce': 516507254}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T11:57:10.521 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T11:57:10.521 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-28T11:57:10.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.709+0000 7fde143a3700 1 Processor -- start 2023-11-28T11:57:10.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.709+0000 7fde143a3700 1 -- start start 2023-11-28T11:57:10.717 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.713+0000 7fde143a3700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fde0c159390 0x7fde0c0b1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:10.717 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.713+0000 7fde143a3700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde0c0720e0 con 0x7fde0c0cd870 2023-11-28T11:57:10.717 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.713+0000 7fde143a3700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde0c0ceb40 con 0x7fde0c06b060 2023-11-28T11:57:10.717 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.713+0000 7fde143a3700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde0c159ae0 con 0x7fde0c159390 2023-11-28T11:57:10.718 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.713+0000 7fde1213f700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fde0c159390 0x7fde0c0b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:10.718 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.713+0000 7fde12940700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fde0c0cd870 0x7fde0c0719d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:44934/0 (socket says 172.21.15.39:44934) 2023-11-28T11:57:10.718 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.713+0000 7fde12940700 1 -- 172.21.15.39:0/1670842670 learned_addr learned my addr 172.21.15.39:0/1670842670 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:10.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.713+0000 7fde1213f700 1 -- 172.21.15.39:0/1670842670 >> v1:172.21.15.184:6789/0 conn(0x7fde0c06b060 legacy=0x7fde0c0712c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:10.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.713+0000 7fde1213f700 1 -- 172.21.15.39:0/1670842670 >> v1:172.21.15.39:6789/0 conn(0x7fde0c0cd870 legacy=0x7fde0c0719d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:10.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.713+0000 7fde1113d700 1 -- 172.21.15.39:0/1670842670 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1279735871 0 0) 0x7fde0c0720e0 con 0x7fde0c0cd870 2023-11-28T11:57:10.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.713+0000 7fde1213f700 1 -- 172.21.15.39:0/1670842670 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0c159dc0 con 0x7fde0c159390 2023-11-28T11:57:10.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.713+0000 7fde1213f700 1 --2- 172.21.15.39:0/1670842670 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde0c159390 0x7fde0c0b1290 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fde08009850 tx=0x7fde08009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb0ee35eb0ab2a1f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:10.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.713+0000 7fde1113d700 1 -- 172.21.15.39:0/1670842670 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde08011830 con 0x7fde0c159390 2023-11-28T11:57:10.720 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.713+0000 7fde1113d700 1 -- 172.21.15.39:0/1670842670 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde08011990 con 0x7fde0c159390 2023-11-28T11:57:10.720 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.713+0000 7fde1113d700 1 -- 172.21.15.39:0/1670842670 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde08011d20 con 0x7fde0c159390 2023-11-28T11:57:10.720 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.717+0000 7fde143a3700 1 -- 172.21.15.39:0/1670842670 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde0c159390 msgr2=0x7fde0c0b1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:10.720 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.717+0000 7fde143a3700 1 --2- 172.21.15.39:0/1670842670 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde0c159390 0x7fde0c0b1290 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fde08009850 tx=0x7fde08009b60 comp rx=0 tx=0).stop 2023-11-28T11:57:10.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.717+0000 7fde143a3700 1 -- 172.21.15.39:0/1670842670 shutdown_connections 2023-11-28T11:57:10.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.717+0000 7fde143a3700 1 --2- 172.21.15.39:0/1670842670 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde0c159390 0x7fde0c0b1290 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:10.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.717+0000 7fde143a3700 1 -- 172.21.15.39:0/1670842670 >> 172.21.15.39:0/1670842670 conn(0x7fde0c0cc290 msgr2=0x7fde0c0cc690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:10.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.717+0000 7fde143a3700 1 -- 172.21.15.39:0/1670842670 shutdown_connections 2023-11-28T11:57:10.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.717+0000 7fde143a3700 1 -- 172.21.15.39:0/1670842670 wait complete. 2023-11-28T11:57:10.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.717+0000 7fde143a3700 1 Processor -- start 2023-11-28T11:57:10.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.717+0000 7fde143a3700 1 -- start start 2023-11-28T11:57:10.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.721+0000 7fde143a3700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde0c06b060 0x7fde0c154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:10.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.721+0000 7fde143a3700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde0c0cd870 0x7fde0c0b3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:10.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.721+0000 7fde143a3700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde0c159390 0x7fde0c1f6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:10.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.721+0000 7fde143a3700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c1f7480 con 0x7fde0c159390 2023-11-28T11:57:10.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.721+0000 7fde143a3700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c1f6240 con 0x7fde0c06b060 2023-11-28T11:57:10.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.721+0000 7fde143a3700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c1f6520 con 0x7fde0c0cd870 2023-11-28T11:57:10.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.721+0000 7fde12940700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde0c159390 0x7fde0c1f6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:10.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.721+0000 7fde12940700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde0c159390 0x7fde0c1f6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53428/0 (socket says 172.21.15.39:53428) 2023-11-28T11:57:10.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.721+0000 7fde12940700 1 -- 172.21.15.39:0/1579997387 learned_addr learned my addr 172.21.15.39:0/1579997387 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:10.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.721+0000 7fde1213f700 1 --2- 172.21.15.39:0/1579997387 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde0c06b060 0x7fde0c154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:10.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.721+0000 7fde1193e700 1 --2- 172.21.15.39:0/1579997387 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde0c0cd870 0x7fde0c0b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:10.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.721+0000 7fde12940700 1 -- 172.21.15.39:0/1579997387 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde0c0cd870 msgr2=0x7fde0c0b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:10.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.721+0000 7fde12940700 1 --2- 172.21.15.39:0/1579997387 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde0c0cd870 0x7fde0c0b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:10.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.721+0000 7fde12940700 1 -- 172.21.15.39:0/1579997387 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde0c06b060 msgr2=0x7fde0c154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:10.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.721+0000 7fde12940700 1 --2- 172.21.15.39:0/1579997387 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde0c06b060 0x7fde0c154680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:10.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.721+0000 7fde12940700 1 -- 172.21.15.39:0/1579997387 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde080094b0 con 0x7fde0c159390 2023-11-28T11:57:10.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.721+0000 7fde12940700 1 --2- 172.21.15.39:0/1579997387 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde0c159390 0x7fde0c1f6f40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fde04002230 tx=0x7fde0400cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:10.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.721+0000 7fde02ffd700 1 -- 172.21.15.39:0/1579997387 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0400aac0 con 0x7fde0c159390 2023-11-28T11:57:10.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.721+0000 7fde02ffd700 1 -- 172.21.15.39:0/1579997387 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde0400ac40 con 0x7fde0c159390 2023-11-28T11:57:10.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.721+0000 7fde143a3700 1 -- 172.21.15.39:0/1579997387 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde0c0ce7d0 con 0x7fde0c159390 2023-11-28T11:57:10.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.721+0000 7fde02ffd700 1 -- 172.21.15.39:0/1579997387 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde040070d0 con 0x7fde0c159390 2023-11-28T11:57:10.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.721+0000 7fde143a3700 1 -- 172.21.15.39:0/1579997387 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde0c15a0a0 con 0x7fde0c159390 2023-11-28T11:57:10.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.725+0000 7fde02ffd700 1 -- 172.21.15.39:0/1579997387 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fde0401a030 con 0x7fde0c159390 2023-11-28T11:57:10.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.729+0000 7fde02ffd700 1 --2- 172.21.15.39:0/1579997387 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fddf0064ee0 0x7fddf0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:10.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.729+0000 7fde02ffd700 1 -- 172.21.15.39:0/1579997387 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fde04081ed0 con 0x7fde0c159390 2023-11-28T11:57:10.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.729+0000 7fde17626740 1 Processor -- start 2023-11-28T11:57:10.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.729+0000 7fde1213f700 1 --2- 172.21.15.39:0/1579997387 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fddf0064ee0 0x7fddf0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:10.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.729+0000 7fde17626740 1 -- start start 2023-11-28T11:57:10.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.729+0000 7fde1213f700 1 --2- 172.21.15.39:0/1579997387 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fddf0064ee0 0x7fddf0067390 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fde080090b0 tx=0x7fde08008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:10.738 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.729+0000 7fde17626740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x19f2ae0 0x1ca2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:10.738 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.729+0000 7fde17626740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x19f2710 0x1ca3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:10.738 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.729+0000 7fde17626740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1a3d790 0x1ca3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:10.738 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.729+0000 7fde17626740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b61ae0 con 0x1a3d790 2023-11-28T11:57:10.738 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.729+0000 7fde17626740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bd1bd0 con 0x19f2ae0 2023-11-28T11:57:10.738 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.729+0000 7fde17626740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x1bcaed0 con 0x19f2710 2023-11-28T11:57:10.738 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.733+0000 7fde12940700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1a3d790 0x1ca3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:10.738 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.733+0000 7fde12940700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1a3d790 0x1ca3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53444/0 (socket says 172.21.15.39:53444) 2023-11-28T11:57:10.738 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.733+0000 7fde12940700 1 -- 172.21.15.39:0/1861530636 learned_addr learned my addr 172.21.15.39:0/1861530636 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:10.738 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.733+0000 7fde1213f700 1 --2- 172.21.15.39:0/1861530636 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x19f2ae0 0x1ca2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:10.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.733+0000 7fde1193e700 1 --2- 172.21.15.39:0/1861530636 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x19f2710 0x1ca3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:10.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.733+0000 7fde12940700 1 -- 172.21.15.39:0/1861530636 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x19f2710 msgr2=0x1ca3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:10.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.733+0000 7fde12940700 1 --2- 172.21.15.39:0/1861530636 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x19f2710 0x1ca3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:10.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.733+0000 7fde12940700 1 -- 172.21.15.39:0/1861530636 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x19f2ae0 msgr2=0x1ca2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:10.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.733+0000 7fde12940700 1 --2- 172.21.15.39:0/1861530636 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x19f2ae0 0x1ca2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:10.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.733+0000 7fde12940700 1 -- 172.21.15.39:0/1861530636 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1bf0cc0 con 0x1a3d790 2023-11-28T11:57:10.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.733+0000 7fde12940700 1 --2- 172.21.15.39:0/1861530636 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1a3d790 0x1ca3880 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fde04053380 tx=0x7fde0405b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb0ea60cb137c5e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:10.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.733+0000 7fddeffff700 1 -- 172.21.15.39:0/1861530636 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0405b750 con 0x1a3d790 2023-11-28T11:57:10.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.733+0000 7fddeffff700 1 -- 172.21.15.39:0/1861530636 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde0404f6e0 con 0x1a3d790 2023-11-28T11:57:10.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.733+0000 7fddeffff700 1 -- 172.21.15.39:0/1861530636 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0404fa50 con 0x1a3d790 2023-11-28T11:57:10.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.733+0000 7fde17626740 1 -- 172.21.15.39:0/1861530636 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1a3d790 msgr2=0x1ca3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:10.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.733+0000 7fde17626740 1 --2- 172.21.15.39:0/1861530636 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1a3d790 0x1ca3880 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fde04053380 tx=0x7fde0405b9e0 comp rx=0 tx=0).stop 2023-11-28T11:57:10.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.733+0000 7fde17626740 1 -- 172.21.15.39:0/1861530636 shutdown_connections 2023-11-28T11:57:10.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.733+0000 7fde17626740 1 --2- 172.21.15.39:0/1861530636 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1a3d790 0x1ca3880 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:10.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.733+0000 7fde17626740 1 --2- 172.21.15.39:0/1861530636 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x19f2710 0x1ca3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:10.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.733+0000 7fde17626740 1 --2- 172.21.15.39:0/1861530636 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x19f2ae0 0x1ca2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:10.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.733+0000 7fde17626740 1 -- 172.21.15.39:0/1861530636 >> 172.21.15.39:0/1861530636 conn(0x19f2eb0 msgr2=0x1c8b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:10.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.733+0000 7fde17626740 1 -- 172.21.15.39:0/1861530636 shutdown_connections 2023-11-28T11:57:10.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.733+0000 7fde17626740 1 -- 172.21.15.39:0/1861530636 wait complete. 2023-11-28T11:57:10.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.733+0000 7fde17626740 1 -- start start 2023-11-28T11:57:10.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.737+0000 7fde17626740 1 Processor -- start 2023-11-28T11:57:10.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.737+0000 7fde17626740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x19f2710 0x1c61050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:10.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.737+0000 7fde17626740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x19f2ae0 0x1c89770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:10.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.737+0000 7fde17626740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1a3d790 0x1c89cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:10.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.737+0000 7fde17626740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a77b20 con 0x1a3d790 2023-11-28T11:57:10.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.737+0000 7fde17626740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c61590 con 0x19f2ae0 2023-11-28T11:57:10.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.737+0000 7fde17626740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c5eae0 con 0x19f2710 2023-11-28T11:57:10.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.737+0000 7fde17626740 10 client.0 _ll_register_callbacks cb 0x1c270d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:57:10.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.737+0000 7fde12940700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1a3d790 0x1c89cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:10.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.737+0000 7fde12940700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1a3d790 0x1c89cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53456/0 (socket says 172.21.15.39:53456) 2023-11-28T11:57:10.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.737+0000 7fde12940700 1 -- 172.21.15.39:0/3129040846 learned_addr learned my addr 172.21.15.39:0/3129040846 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:10.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.737+0000 7fde1193e700 1 --2- 172.21.15.39:0/3129040846 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x19f2ae0 0x1c89770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:10.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.737+0000 7fde1213f700 1 --2- 172.21.15.39:0/3129040846 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x19f2710 0x1c61050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:10.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.737+0000 7fde12940700 1 -- 172.21.15.39:0/3129040846 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x19f2710 msgr2=0x1c61050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:10.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.737+0000 7fde12940700 1 --2- 172.21.15.39:0/3129040846 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x19f2710 0x1c61050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:10.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.737+0000 7fde12940700 1 -- 172.21.15.39:0/3129040846 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x19f2ae0 msgr2=0x1c89770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:10.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.737+0000 7fde12940700 1 --2- 172.21.15.39:0/3129040846 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x19f2ae0 0x1c89770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:10.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.737+0000 7fde12940700 1 -- 172.21.15.39:0/3129040846 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde0c15a0a0 con 0x1a3d790 2023-11-28T11:57:10.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.737+0000 7fde12940700 1 --2- 172.21.15.39:0/3129040846 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1a3d790 0x1c89cb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fde040535a0 tx=0x7fde04056040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9182093c1a52c024 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:10.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.737+0000 7fdded7fa700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-11-28T11:57:10.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.737+0000 7fdded7fa700 1 -- 172.21.15.39:0/3129040846 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0407f070 con 0x1a3d790 2023-11-28T11:57:10.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.737+0000 7fdded7fa700 1 -- 172.21.15.39:0/3129040846 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fde0406a020 con 0x1a3d790 2023-11-28T11:57:10.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.737+0000 7fde17626740 1 -- 172.21.15.39:0/3129040846 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1bc3f50 con 0x1a3d790 2023-11-28T11:57:10.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.737+0000 7fdded7fa700 1 -- 172.21.15.39:0/3129040846 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fde04052a60 con 0x1a3d790 2023-11-28T11:57:10.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.741+0000 7fde17626740 10 client.4791 fetch_fsmap learned FSMap version 9 2023-11-28T11:57:10.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.741+0000 7fde17626740 1 -- 172.21.15.39:0/3129040846 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x1a3e9e0 con 0x1a3d790 2023-11-28T11:57:10.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.741+0000 7fdded7fa700 1 -- 172.21.15.39:0/3129040846 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1bc3f50 con 0x1a3d790 2023-11-28T11:57:10.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.741+0000 7fdded7fa700 1 -- 172.21.15.39:0/3129040846 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 9) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fde04054660 con 0x1a3d790 2023-11-28T11:57:10.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.741+0000 7fde17626740 10 client.4791 fetch_fsmap finished waiting for FSMap version 9 2023-11-28T11:57:10.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.741+0000 7fde17626740 10 client.4791 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-28T11:57:10.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.741+0000 7fde17626740 20 client.4791 populate_metadata read hostname 'smithi039' 2023-11-28T11:57:10.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.741+0000 7fde17626740 1 --2- 172.21.15.39:0/3129040846 >> [v2:172.21.15.184:6834/516507254,v1:172.21.15.184:6835/516507254] conn(0x1c5fce0 0x1c600b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:10.747 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.741+0000 7fde17626740 4 client.4791 mds_command: new command op to 4288 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T11:57:10.747 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.741+0000 7fde17626740 1 -- 172.21.15.39:0/3129040846 --> [v2:172.21.15.184:6834/516507254,v1:172.21.15.184:6835/516507254] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1bc3c70 con 0x1c5fce0 2023-11-28T11:57:10.747 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.741+0000 7fde1213f700 1 --2- 172.21.15.39:0/3129040846 >> [v2:172.21.15.184:6834/516507254,v1:172.21.15.184:6835/516507254] conn(0x1c5fce0 0x1c600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:10.748 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.741+0000 7fde1213f700 1 --2- 172.21.15.39:0/3129040846 >> [v2:172.21.15.184:6834/516507254,v1:172.21.15.184:6835/516507254] conn(0x1c5fce0 0x1c600b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f519e33498c35839 server_cookie=7277299d10bf1c0a in_seq=0 out_seq=0 2023-11-28T11:57:10.748 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.741+0000 7fdded7fa700 10 client.4791 ms_handle_connect on v2:172.21.15.184:6834/516507254 2023-11-28T11:57:10.748 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.745+0000 7fdded7fa700 1 -- 172.21.15.39:0/3129040846 <== mds.0 v2:172.21.15.184:6834/516507254 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x1bc3c70 con 0x1c5fce0 2023-11-28T11:57:10.748 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.745+0000 7fdded7fa700 10 client.4791 handle_command_reply: tid=0 2023-11-28T11:57:10.748 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.745+0000 7fde17626740 1 client.4791 shutdown 2023-11-28T11:57:10.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.745+0000 7fde17626740 1 -- 172.21.15.39:0/3129040846 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1a3d790 msgr2=0x1c89cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:10.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.745+0000 7fde17626740 1 --2- 172.21.15.39:0/3129040846 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1a3d790 0x1c89cb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fde040535a0 tx=0x7fde04056040 comp rx=0 tx=0).stop 2023-11-28T11:57:10.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.745+0000 7fde17626740 1 -- 172.21.15.39:0/3129040846 shutdown_connections 2023-11-28T11:57:10.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.745+0000 7fde17626740 1 --2- 172.21.15.39:0/3129040846 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1a3d790 0x1c89cb0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:10.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.745+0000 7fde17626740 1 --2- 172.21.15.39:0/3129040846 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x19f2ae0 0x1c89770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:10.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.745+0000 7fde17626740 1 --2- 172.21.15.39:0/3129040846 >> [v2:172.21.15.184:6834/516507254,v1:172.21.15.184:6835/516507254] conn(0x1c5fce0 0x1c600b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:10.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.745+0000 7fde17626740 1 --2- 172.21.15.39:0/3129040846 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x19f2710 0x1c61050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:10.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.745+0000 7fde17626740 1 -- 172.21.15.39:0/3129040846 >> 172.21.15.39:0/3129040846 conn(0x19f2eb0 msgr2=0x1c8b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:10.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.745+0000 7fdded7fa700 0 client.4791 ms_handle_reset on v2:172.21.15.184:6834/516507254 2023-11-28T11:57:10.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.745+0000 7fde17626740 1 -- 172.21.15.39:0/3129040846 shutdown_connections 2023-11-28T11:57:10.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.745+0000 7fde17626740 1 -- 172.21.15.39:0/3129040846 wait complete. 2023-11-28T11:57:10.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.745+0000 7fde17626740 20 client.4791 trim_cache size 0 max 16384 2023-11-28T11:57:10.772 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.769+0000 7fde17626740 1 Processor -- start 2023-11-28T11:57:10.772 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.769+0000 7fde17626740 1 -- start start 2023-11-28T11:57:10.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.769+0000 7fde17626740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x19f2710 0x1ca3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:10.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.769+0000 7fde17626740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x19f2ae0 0x1ca4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:10.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.769+0000 7fde17626740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1a3d790 0x1cb1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:10.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.769+0000 7fde17626740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bca6e0 con 0x1a3d790 2023-11-28T11:57:10.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.769+0000 7fde17626740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b71750 con 0x19f2710 2023-11-28T11:57:10.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.769+0000 7fde17626740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b755f0 con 0x19f2ae0 2023-11-28T11:57:10.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.769+0000 7fde1193e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x19f2ae0 0x1ca4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:10.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.769+0000 7fde1213f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x19f2710 0x1ca3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:10.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.769+0000 7fde12940700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1a3d790 0x1cb1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:10.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.769+0000 7fde1193e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x19f2ae0 0x1ca4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:51342/0 (socket says 172.21.15.39:51342) 2023-11-28T11:57:10.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.769+0000 7fde1193e700 1 -- 172.21.15.39:0/149502257 learned_addr learned my addr 172.21.15.39:0/149502257 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:10.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.769+0000 7fde1193e700 1 -- 172.21.15.39:0/149502257 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x19f2710 msgr2=0x1ca3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:10.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.769+0000 7fde1193e700 1 --2- 172.21.15.39:0/149502257 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x19f2710 0x1ca3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:10.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.769+0000 7fde1193e700 1 -- 172.21.15.39:0/149502257 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1a3d790 msgr2=0x1cb1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:10.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.769+0000 7fde1193e700 1 --2- 172.21.15.39:0/149502257 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1a3d790 0x1cb1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:10.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.769+0000 7fde1193e700 1 -- 172.21.15.39:0/149502257 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0c0af260 con 0x19f2ae0 2023-11-28T11:57:10.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.769+0000 7fde1193e700 1 --2- 172.21.15.39:0/149502257 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x19f2ae0 0x1ca4070 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fddfc005480 tx=0x7fddfc007ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c200da2383e29040 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:10.776 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.769+0000 7fde00bff700 1 -- 172.21.15.39:0/149502257 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddfc006880 con 0x19f2ae0 2023-11-28T11:57:10.776 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.769+0000 7fde00bff700 1 -- 172.21.15.39:0/149502257 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddfc0069e0 con 0x19f2ae0 2023-11-28T11:57:10.776 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.769+0000 7fde00bff700 1 -- 172.21.15.39:0/149502257 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddfc006b50 con 0x19f2ae0 2023-11-28T11:57:10.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.773+0000 7fde17626740 1 -- 172.21.15.39:0/149502257 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x19f2ae0 msgr2=0x1ca4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:10.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.773+0000 7fde17626740 1 --2- 172.21.15.39:0/149502257 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x19f2ae0 0x1ca4070 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fddfc005480 tx=0x7fddfc007ee0 comp rx=0 tx=0).stop 2023-11-28T11:57:10.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.773+0000 7fde17626740 1 -- 172.21.15.39:0/149502257 shutdown_connections 2023-11-28T11:57:10.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.773+0000 7fde17626740 1 --2- 172.21.15.39:0/149502257 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1a3d790 0x1cb1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:10.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.773+0000 7fde17626740 1 --2- 172.21.15.39:0/149502257 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x19f2ae0 0x1ca4070 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:10.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.773+0000 7fde17626740 1 --2- 172.21.15.39:0/149502257 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x19f2710 0x1ca3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:10.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.773+0000 7fde17626740 1 -- 172.21.15.39:0/149502257 >> 172.21.15.39:0/149502257 conn(0x19f2eb0 msgr2=0x1c61650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:10.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.773+0000 7fde17626740 1 -- 172.21.15.39:0/149502257 shutdown_connections 2023-11-28T11:57:10.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.773+0000 7fde17626740 1 -- 172.21.15.39:0/149502257 wait complete. 2023-11-28T11:57:10.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.773+0000 7fde17626740 1 -- start start 2023-11-28T11:57:10.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.773+0000 7fde17626740 1 Processor -- start 2023-11-28T11:57:10.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.773+0000 7fde17626740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x19f2710 0x1ca3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:10.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.773+0000 7fde17626740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x19f2ae0 0x1ca4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:10.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.773+0000 7fde17626740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1a3d790 0x1cbc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:10.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.773+0000 7fde17626740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x1caf8b0 con 0x19f2ae0 2023-11-28T11:57:10.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.773+0000 7fde17626740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x1cbd350 con 0x19f2710 2023-11-28T11:57:10.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.773+0000 7fde17626740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x1cbe2a0 con 0x1a3d790 2023-11-28T11:57:10.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.773+0000 7fde17626740 10 client.0 _ll_register_callbacks cb 0x1b772d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:57:10.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.773+0000 7fde1193e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x19f2ae0 0x1ca4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:10.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.773+0000 7fde1193e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x19f2ae0 0x1ca4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53474/0 (socket says 172.21.15.39:53474) 2023-11-28T11:57:10.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.773+0000 7fde1193e700 1 -- 172.21.15.39:0/673803801 learned_addr learned my addr 172.21.15.39:0/673803801 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:10.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.777+0000 7fde12940700 1 --2- 172.21.15.39:0/673803801 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1a3d790 0x1cbc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:10.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.777+0000 7fde1213f700 1 --2- 172.21.15.39:0/673803801 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x19f2710 0x1ca3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:10.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.777+0000 7fde1193e700 1 -- 172.21.15.39:0/673803801 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1a3d790 msgr2=0x1cbc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:10.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.777+0000 7fde1193e700 1 --2- 172.21.15.39:0/673803801 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1a3d790 0x1cbc110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:10.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.777+0000 7fde1193e700 1 -- 172.21.15.39:0/673803801 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x19f2710 msgr2=0x1ca3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:10.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.777+0000 7fde1193e700 1 --2- 172.21.15.39:0/673803801 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x19f2710 0x1ca3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:10.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.777+0000 7fde1193e700 1 -- 172.21.15.39:0/673803801 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde0c0ceb40 con 0x19f2ae0 2023-11-28T11:57:10.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.777+0000 7fde1213f700 1 --2- 172.21.15.39:0/673803801 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x19f2710 0x1ca3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:57:10.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.777+0000 7fde1193e700 1 --2- 172.21.15.39:0/673803801 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x19f2ae0 0x1ca4070 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fddfc000fd0 tx=0x7fddfc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fde7ffe51d0ffe1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:10.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.777+0000 7fdded7fa700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-11-28T11:57:10.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.777+0000 7fdded7fa700 1 -- 172.21.15.39:0/673803801 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddfc016830 con 0x19f2ae0 2023-11-28T11:57:10.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.777+0000 7fdded7fa700 1 -- 172.21.15.39:0/673803801 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fddfc016990 con 0x19f2ae0 2023-11-28T11:57:10.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.777+0000 7fde17626740 1 -- 172.21.15.39:0/673803801 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fde0404f6e0 con 0x19f2ae0 2023-11-28T11:57:10.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.777+0000 7fdded7fa700 1 -- 172.21.15.39:0/673803801 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fddfc005180 con 0x19f2ae0 2023-11-28T11:57:10.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.777+0000 7fde17626740 10 client.4797 fetch_fsmap learned FSMap version 9 2023-11-28T11:57:10.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.777+0000 7fde17626740 1 -- 172.21.15.39:0/673803801 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x1b77a20 con 0x19f2ae0 2023-11-28T11:57:10.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.777+0000 7fdded7fa700 1 -- 172.21.15.39:0/673803801 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde0404f6e0 con 0x19f2ae0 2023-11-28T11:57:10.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.777+0000 7fdded7fa700 1 -- 172.21.15.39:0/673803801 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 9) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fddfc016b50 con 0x19f2ae0 2023-11-28T11:57:10.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.777+0000 7fde17626740 10 client.4797 fetch_fsmap finished waiting for FSMap version 9 2023-11-28T11:57:10.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.777+0000 7fde17626740 10 client.4797 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-28T11:57:10.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.777+0000 7fde17626740 20 client.4797 populate_metadata read hostname 'smithi039' 2023-11-28T11:57:10.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.777+0000 7fde17626740 1 --2- 172.21.15.39:0/673803801 >> [v2:172.21.15.184:6834/516507254,v1:172.21.15.184:6835/516507254] conn(0x1cbcc00 0x1cbff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:10.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.777+0000 7fde17626740 4 client.4797 mds_command: new command op to 4288 tid=0[{"prefix": "status"}] 2023-11-28T11:57:10.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.777+0000 7fde17626740 1 -- 172.21.15.39:0/673803801 --> [v2:172.21.15.184:6834/516507254,v1:172.21.15.184:6835/516507254] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1a6f260 con 0x1cbcc00 2023-11-28T11:57:10.785 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.777+0000 7fde1213f700 1 --2- 172.21.15.39:0/673803801 >> [v2:172.21.15.184:6834/516507254,v1:172.21.15.184:6835/516507254] conn(0x1cbcc00 0x1cbff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:10.785 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.781+0000 7fde1213f700 1 --2- 172.21.15.39:0/673803801 >> [v2:172.21.15.184:6834/516507254,v1:172.21.15.184:6835/516507254] conn(0x1cbcc00 0x1cbff10 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8bfb3256018b3a0 server_cookie=7e7b9257cb9d1f6c in_seq=0 out_seq=0 2023-11-28T11:57:10.785 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.781+0000 7fdded7fa700 10 client.4797 ms_handle_connect on v2:172.21.15.184:6834/516507254 2023-11-28T11:57:10.785 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.781+0000 7fdded7fa700 1 -- 172.21.15.39:0/673803801 <== mds.0 v2:172.21.15.184:6834/516507254 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x1a6f260 con 0x1cbcc00 2023-11-28T11:57:10.785 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.781+0000 7fdded7fa700 10 client.4797 handle_command_reply: tid=0 2023-11-28T11:57:10.785 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.781+0000 7fde17626740 1 client.4797 shutdown 2023-11-28T11:57:10.786 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.781+0000 7fde17626740 1 -- 172.21.15.39:0/673803801 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x19f2ae0 msgr2=0x1ca4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:10.786 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.781+0000 7fde17626740 1 --2- 172.21.15.39:0/673803801 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x19f2ae0 0x1ca4070 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fddfc000fd0 tx=0x7fddfc000ed0 comp rx=0 tx=0).stop 2023-11-28T11:57:10.786 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.781+0000 7fde17626740 1 -- 172.21.15.39:0/673803801 shutdown_connections 2023-11-28T11:57:10.786 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.781+0000 7fde17626740 1 --2- 172.21.15.39:0/673803801 >> [v2:172.21.15.184:6834/516507254,v1:172.21.15.184:6835/516507254] conn(0x1cbcc00 0x1cbff10 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:10.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.781+0000 7fde17626740 1 --2- 172.21.15.39:0/673803801 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1a3d790 0x1cbc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:10.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.781+0000 7fde17626740 1 --2- 172.21.15.39:0/673803801 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x19f2ae0 0x1ca4070 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:10.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.781+0000 7fde17626740 1 --2- 172.21.15.39:0/673803801 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x19f2710 0x1ca3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:10.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.781+0000 7fde17626740 1 -- 172.21.15.39:0/673803801 >> 172.21.15.39:0/673803801 conn(0x19f2eb0 msgr2=0x1cb9620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:10.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.781+0000 7fdded7fa700 0 client.4797 ms_handle_reset on v2:172.21.15.184:6834/516507254 2023-11-28T11:57:10.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.781+0000 7fde17626740 1 -- 172.21.15.39:0/673803801 shutdown_connections 2023-11-28T11:57:10.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.781+0000 7fde17626740 1 -- 172.21.15.39:0/673803801 wait complete. 2023-11-28T11:57:10.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.781+0000 7fde17626740 20 client.4797 trim_cache size 0 max 16384 2023-11-28T11:57:10.787 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2023-11-28T11:57:10.788 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "67ce95b1-cd7e-4478-b863-c714ef275520", 2023-11-28T11:57:10.788 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 0, 2023-11-28T11:57:10.788 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 4288, 2023-11-28T11:57:10.788 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2023-11-28T11:57:10.788 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2023-11-28T11:57:10.788 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2023-11-28T11:57:10.788 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 30.879347018000001, 2023-11-28T11:57:10.788 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 9, 2023-11-28T11:57:10.788 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 29, 2023-11-28T11:57:10.788 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 29, 2023-11-28T11:57:10.788 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 36.216120193000002 2023-11-28T11:57:10.788 INFO:teuthology.orchestra.run.smithi039.stdout:} 2023-11-28T11:57:10.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.781+0000 7fde143a3700 1 -- 172.21.15.39:0/1579997387 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fddf0064ee0 msgr2=0x7fddf0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:10.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.781+0000 7fde143a3700 1 --2- 172.21.15.39:0/1579997387 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fddf0064ee0 0x7fddf0067390 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fde080090b0 tx=0x7fde08008030 comp rx=0 tx=0).stop 2023-11-28T11:57:10.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.781+0000 7fde143a3700 1 -- 172.21.15.39:0/1579997387 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde0c159390 msgr2=0x7fde0c1f6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:10.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.781+0000 7fde143a3700 1 --2- 172.21.15.39:0/1579997387 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde0c159390 0x7fde0c1f6f40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fde04002230 tx=0x7fde0400cf50 comp rx=0 tx=0).stop 2023-11-28T11:57:10.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.781+0000 7fde143a3700 1 -- 172.21.15.39:0/1579997387 shutdown_connections 2023-11-28T11:57:10.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.781+0000 7fde143a3700 1 --2- 172.21.15.39:0/1579997387 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde0c159390 0x7fde0c1f6f40 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:10.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.781+0000 7fde143a3700 1 --2- 172.21.15.39:0/1579997387 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde0c0cd870 0x7fde0c0b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:10.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.781+0000 7fde143a3700 1 --2- 172.21.15.39:0/1579997387 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fddf0064ee0 0x7fddf0067390 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:10.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.781+0000 7fde143a3700 1 --2- 172.21.15.39:0/1579997387 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde0c06b060 0x7fde0c154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:10.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.781+0000 7fde143a3700 1 -- 172.21.15.39:0/1579997387 >> 172.21.15.39:0/1579997387 conn(0x7fde0c0cc290 msgr2=0x7fde0c154d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:10.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.781+0000 7fde143a3700 1 -- 172.21.15.39:0/1579997387 shutdown_connections 2023-11-28T11:57:10.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:10.781+0000 7fde143a3700 1 -- 172.21.15.39:0/1579997387 wait complete. 2023-11-28T11:57:10.810 INFO:teuthology.run_tasks:Running task kclient... 2023-11-28T11:57:10.822 INFO:tasks.kclient:Mounting kernel clients... 2023-11-28T11:57:10.823 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-28T11:57:10.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:10.823 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2023-11-28T11:57:10.842 INFO:teuthology.orchestra.run.smithi039.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-11-28T11:57:10.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:10.844 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-28T11:57:10.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:10.927 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link delete ceph-brx 2023-11-28T11:57:11.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:11.123 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2023-11-28T11:57:11.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:11.143 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link delete ceph-brx 2023-11-28T11:57:11.232 INFO:teuthology.orchestra.run.smithi039.stderr:Cannot find device "ceph-brx" 2023-11-28T11:57:11.236 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:57:11.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:11.238 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-11-28T11:57:11.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:11.261 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link delete ceph-brx 2023-11-28T11:57:11.348 INFO:teuthology.orchestra.run.smithi184.stderr:Cannot find device "ceph-brx" 2023-11-28T11:57:11.352 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:57:11.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:11.352 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-11-28T11:57:11.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:11.416 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link delete ceph-brx 2023-11-28T11:57:11.506 INFO:teuthology.orchestra.run.smithi184.stderr:Cannot find device "ceph-brx" 2023-11-28T11:57:11.510 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:57:11.511 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-11-28T11:57:11.511 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T11:57:11.511 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T11:57:11.511 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T11:57:11.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.689+0000 7f7bae4a7700 1 Processor -- start 2023-11-28T11:57:11.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.689+0000 7f7bae4a7700 1 -- start start 2023-11-28T11:57:11.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.693+0000 7f7bae4a7700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7ba815d510 0x7f7ba80b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:11.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.693+0000 7f7bae4a7700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ba80b6030 0x7f7ba8070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:11.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.693+0000 7f7bae4a7700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ba815d080 con 0x7f7ba81534a0 2023-11-28T11:57:11.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.693+0000 7f7bae4a7700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ba815d970 con 0x7f7ba815d510 2023-11-28T11:57:11.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.693+0000 7f7bae4a7700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba8153870 con 0x7f7ba80b6030 2023-11-28T11:57:11.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.693+0000 7f7ba77fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7ba815d510 0x7f7ba80b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:11.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.693+0000 7f7ba77fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7ba815d510 0x7f7ba80b5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53480/0 (socket says 172.21.15.39:53480) 2023-11-28T11:57:11.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.693+0000 7f7ba7fff700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f7ba81534a0 0x7f7ba8160920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:44946/0 (socket says 172.21.15.39:44946) 2023-11-28T11:57:11.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.693+0000 7f7ba77fe700 1 -- 172.21.15.39:0/2102481754 learned_addr learned my addr 172.21.15.39:0/2102481754 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:11.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.693+0000 7f7baca44700 1 --2- 172.21.15.39:0/2102481754 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ba80b6030 0x7f7ba8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:11.701 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.697+0000 7f7ba77fe700 1 -- 172.21.15.39:0/2102481754 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ba80b6030 msgr2=0x7f7ba8070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:11.701 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.697+0000 7f7ba77fe700 1 --2- 172.21.15.39:0/2102481754 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ba80b6030 0x7f7ba8070630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:11.701 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.697+0000 7f7ba77fe700 1 -- 172.21.15.39:0/2102481754 >> v1:172.21.15.39:6789/0 conn(0x7f7ba81534a0 legacy=0x7f7ba8160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:11.701 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.697+0000 7f7ba77fe700 1 -- 172.21.15.39:0/2102481754 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba80b6430 con 0x7f7ba815d510 2023-11-28T11:57:11.701 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.697+0000 7f7baca44700 1 --2- 172.21.15.39:0/2102481754 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ba80b6030 0x7f7ba8070630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:11.701 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.697+0000 7f7ba77fe700 1 --2- 172.21.15.39:0/2102481754 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ba815d510 0x7f7ba80b5af0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c009910 tx=0x7f7b9c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e62492c93dc956c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:11.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.697+0000 7f7ba6ffd700 1 -- 172.21.15.39:0/2102481754 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c011830 con 0x7f7ba815d510 2023-11-28T11:57:11.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.697+0000 7f7ba6ffd700 1 -- 172.21.15.39:0/2102481754 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b9c011990 con 0x7f7ba815d510 2023-11-28T11:57:11.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.697+0000 7f7ba6ffd700 1 -- 172.21.15.39:0/2102481754 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c011d40 con 0x7f7ba815d510 2023-11-28T11:57:11.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.697+0000 7f7bae4a7700 1 -- 172.21.15.39:0/2102481754 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ba815d510 msgr2=0x7f7ba80b5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:11.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.697+0000 7f7bae4a7700 1 --2- 172.21.15.39:0/2102481754 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ba815d510 0x7f7ba80b5af0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c009910 tx=0x7f7b9c009c20 comp rx=0 tx=0).stop 2023-11-28T11:57:11.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.697+0000 7f7bae4a7700 1 -- 172.21.15.39:0/2102481754 shutdown_connections 2023-11-28T11:57:11.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.697+0000 7f7bae4a7700 1 --2- 172.21.15.39:0/2102481754 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ba80b6030 0x7f7ba8070630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:11.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.697+0000 7f7bae4a7700 1 --2- 172.21.15.39:0/2102481754 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ba815d510 0x7f7ba80b5af0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:11.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.697+0000 7f7bae4a7700 1 -- 172.21.15.39:0/2102481754 >> 172.21.15.39:0/2102481754 conn(0x7f7ba806bfc0 msgr2=0x7f7ba806c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:11.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.697+0000 7f7bae4a7700 1 -- 172.21.15.39:0/2102481754 shutdown_connections 2023-11-28T11:57:11.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.697+0000 7f7bae4a7700 1 -- 172.21.15.39:0/2102481754 wait complete. 2023-11-28T11:57:11.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.701+0000 7f7bae4a7700 1 Processor -- start 2023-11-28T11:57:11.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.701+0000 7f7bae4a7700 1 -- start start 2023-11-28T11:57:11.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.701+0000 7f7bae4a7700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ba80b6030 0x7f7ba80c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:11.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.701+0000 7f7bae4a7700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ba81534a0 0x7f7ba81591b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:11.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.701+0000 7f7bae4a7700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ba815d510 0x7f7ba81596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:11.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.701+0000 7f7bae4a7700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba81f2cb0 con 0x7f7ba80b6030 2023-11-28T11:57:11.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.701+0000 7f7bae4a7700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba81560e0 con 0x7f7ba815d510 2023-11-28T11:57:11.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.701+0000 7f7bae4a7700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba81563c0 con 0x7f7ba81534a0 2023-11-28T11:57:11.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.701+0000 7f7ba7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ba80b6030 0x7f7ba80c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:11.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.701+0000 7f7ba7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ba80b6030 0x7f7ba80c8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53494/0 (socket says 172.21.15.39:53494) 2023-11-28T11:57:11.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.701+0000 7f7ba7fff700 1 -- 172.21.15.39:0/1779598335 learned_addr learned my addr 172.21.15.39:0/1779598335 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:11.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.701+0000 7f7ba77fe700 1 --2- 172.21.15.39:0/1779598335 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ba81534a0 0x7f7ba81591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:11.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.701+0000 7f7baca44700 1 --2- 172.21.15.39:0/1779598335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ba815d510 0x7f7ba81596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:11.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.701+0000 7f7ba7fff700 1 -- 172.21.15.39:0/1779598335 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ba81534a0 msgr2=0x7f7ba81591b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:11.709 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.701+0000 7f7ba7fff700 1 --2- 172.21.15.39:0/1779598335 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ba81534a0 0x7f7ba81591b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:11.709 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.701+0000 7f7ba7fff700 1 -- 172.21.15.39:0/1779598335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ba815d510 msgr2=0x7f7ba81596f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:11.709 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.701+0000 7f7ba7fff700 1 --2- 172.21.15.39:0/1779598335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ba815d510 0x7f7ba81596f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:11.709 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.701+0000 7f7ba7fff700 1 -- 172.21.15.39:0/1779598335 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b980094b0 con 0x7f7ba80b6030 2023-11-28T11:57:11.709 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.701+0000 7f7baca44700 1 --2- 172.21.15.39:0/1779598335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ba815d510 0x7f7ba81596f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:57:11.709 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.701+0000 7f7ba7fff700 1 --2- 172.21.15.39:0/1779598335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ba80b6030 0x7f7ba80c8f80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7ba000cc50 tx=0x7f7ba000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:11.709 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.701+0000 7f7ba4ff9700 1 -- 172.21.15.39:0/1779598335 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba000ade0 con 0x7f7ba80b6030 2023-11-28T11:57:11.709 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.701+0000 7f7ba4ff9700 1 -- 172.21.15.39:0/1779598335 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba000ce50 con 0x7f7ba80b6030 2023-11-28T11:57:11.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.701+0000 7f7bae4a7700 1 -- 172.21.15.39:0/1779598335 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b9c009570 con 0x7f7ba80b6030 2023-11-28T11:57:11.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.701+0000 7f7ba4ff9700 1 -- 172.21.15.39:0/1779598335 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba0007270 con 0x7f7ba80b6030 2023-11-28T11:57:11.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.705+0000 7f7bae4a7700 1 -- 172.21.15.39:0/1779598335 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ba80b56a0 con 0x7f7ba80b6030 2023-11-28T11:57:11.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.705+0000 7f7bae4a7700 1 -- 172.21.15.39:0/1779598335 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ba80b53c0 con 0x7f7ba80b6030 2023-11-28T11:57:11.711 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.705+0000 7f7ba4ff9700 1 -- 172.21.15.39:0/1779598335 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7ba0019030 con 0x7f7ba80b6030 2023-11-28T11:57:11.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.709+0000 7f7ba4ff9700 1 --2- 172.21.15.39:0/1779598335 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7b94064f10 0x7f7b940673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:11.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.709+0000 7f7ba4ff9700 1 -- 172.21.15.39:0/1779598335 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7ba0081f60 con 0x7f7ba80b6030 2023-11-28T11:57:11.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.709+0000 7f7ba77fe700 1 --2- 172.21.15.39:0/1779598335 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7b94064f10 0x7f7b940673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:11.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.709+0000 7f7ba77fe700 1 --2- 172.21.15.39:0/1779598335 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7b94064f10 0x7f7b940673c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8155170 tx=0x7f7b9c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:11.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.713+0000 7f7ba4ff9700 1 -- 172.21.15.39:0/1779598335 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7ba004a400 con 0x7f7ba80b6030 2023-11-28T11:57:11.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.921+0000 7f7bae4a7700 1 -- 172.21.15.39:0/1779598335 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7ba815ca30 con 0x7f7ba80b6030 2023-11-28T11:57:11.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.925+0000 7f7ba4ff9700 1 -- 172.21.15.39:0/1779598335 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f7ba0017020 con 0x7f7ba80b6030 2023-11-28T11:57:11.928 INFO:teuthology.orchestra.run.smithi039.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-28T11:57:11.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.929+0000 7f7bae4a7700 1 -- 172.21.15.39:0/1779598335 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7b94064f10 msgr2=0x7f7b940673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:11.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.929+0000 7f7bae4a7700 1 --2- 172.21.15.39:0/1779598335 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7b94064f10 0x7f7b940673c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8155170 tx=0x7f7b9c008030 comp rx=0 tx=0).stop 2023-11-28T11:57:11.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.929+0000 7f7bae4a7700 1 -- 172.21.15.39:0/1779598335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ba80b6030 msgr2=0x7f7ba80c8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:11.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.929+0000 7f7bae4a7700 1 --2- 172.21.15.39:0/1779598335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ba80b6030 0x7f7ba80c8f80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7ba000cc50 tx=0x7f7ba000a340 comp rx=0 tx=0).stop 2023-11-28T11:57:11.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.929+0000 7f7bae4a7700 1 -- 172.21.15.39:0/1779598335 shutdown_connections 2023-11-28T11:57:11.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.929+0000 7f7bae4a7700 1 --2- 172.21.15.39:0/1779598335 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7b94064f10 0x7f7b940673c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:11.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.929+0000 7f7bae4a7700 1 --2- 172.21.15.39:0/1779598335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ba815d510 0x7f7ba81596f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:11.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.929+0000 7f7bae4a7700 1 --2- 172.21.15.39:0/1779598335 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ba81534a0 0x7f7ba81591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:11.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.929+0000 7f7bae4a7700 1 --2- 172.21.15.39:0/1779598335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ba80b6030 0x7f7ba80c8f80 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:11.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.929+0000 7f7bae4a7700 1 -- 172.21.15.39:0/1779598335 >> 172.21.15.39:0/1779598335 conn(0x7f7ba806bfc0 msgr2=0x7f7ba815b480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:11.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.929+0000 7f7bae4a7700 1 -- 172.21.15.39:0/1779598335 shutdown_connections 2023-11-28T11:57:11.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:11.929+0000 7f7bae4a7700 1 -- 172.21.15.39:0/1779598335 wait complete. 2023-11-28T11:57:11.955 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T11:57:11.955 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T11:57:11.955 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi039.front.sepia.ceph.com 2023-11-28T11:57:11.955 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T11:57:11.955 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T11:57:11.955 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T11:57:11.955 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T11:57:11.956 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T11:57:11.956 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T11:57:11.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:11.956 DEBUG:teuthology.orchestra.run.smithi039:> ip addr 2023-11-28T11:57:11.971 INFO:teuthology.orchestra.run.smithi039.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T11:57:11.971 INFO:teuthology.orchestra.run.smithi039.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T11:57:11.971 INFO:teuthology.orchestra.run.smithi039.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T11:57:11.971 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:57:11.971 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 ::1/128 scope host 2023-11-28T11:57:11.971 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:57:11.972 INFO:teuthology.orchestra.run.smithi039.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:57:11.972 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c6 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:57:11.972 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f0 2023-11-28T11:57:11.972 INFO:teuthology.orchestra.run.smithi039.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T11:57:11.972 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:70 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:57:11.972 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f0 2023-11-28T11:57:11.972 INFO:teuthology.orchestra.run.smithi039.stdout: inet 172.21.15.39/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-28T11:57:11.972 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft 42343sec preferred_lft 42343sec 2023-11-28T11:57:11.972 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::ec4:7aff:febd:1370/64 scope link 2023-11-28T11:57:11.972 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:57:11.972 INFO:teuthology.orchestra.run.smithi039.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:57:11.973 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c7 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:57:11.973 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f1 2023-11-28T11:57:11.973 INFO:teuthology.orchestra.run.smithi039.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:57:11.973 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:71 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:57:11.973 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f1 2023-11-28T11:57:11.973 INFO:teuthology.orchestra.run.smithi039.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T11:57:11.973 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 02:42:df:e8:d2:63 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:57:11.973 INFO:teuthology.orchestra.run.smithi039.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T11:57:11.973 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:57:11.974 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-28T11:57:11.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:11.975 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2023-11-28T11:57:11.975 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2023-11-28T11:57:11.975 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link add name ceph-brx type bridge 2023-11-28T11:57:11.975 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip addr flush dev ceph-brx 2023-11-28T11:57:11.975 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set ceph-brx up 2023-11-28T11:57:11.975 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-28T11:57:11.975 DEBUG:teuthology.orchestra.run.smithi039:> ') 2023-11-28T11:57:12.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:12.125 DEBUG:teuthology.orchestra.run.smithi039:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T11:57:12.160 INFO:teuthology.orchestra.run.smithi039.stdout:1 2023-11-28T11:57:12.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:12.165 DEBUG:teuthology.orchestra.run.smithi039:> route 2023-11-28T11:57:12.233 INFO:teuthology.orchestra.run.smithi039.stdout:Kernel IP routing table 2023-11-28T11:57:12.233 INFO:teuthology.orchestra.run.smithi039.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T11:57:12.233 INFO:teuthology.orchestra.run.smithi039.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-28T11:57:12.233 INFO:teuthology.orchestra.run.smithi039.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T11:57:12.233 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-28T11:57:12.233 INFO:teuthology.orchestra.run.smithi039.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T11:57:12.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:12.234 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2023-11-28T11:57:12.234 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2023-11-28T11:57:12.234 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-28T11:57:12.234 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-28T11:57:12.234 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-28T11:57:12.234 DEBUG:teuthology.orchestra.run.smithi039:> ') 2023-11-28T11:57:12.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:12.370 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2023-11-28T11:57:12.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:12.389 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list-id 2023-11-28T11:57:12.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:12.451 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2023-11-28T11:57:12.451 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2023-11-28T11:57:12.451 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T11:57:12.451 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-28T11:57:12.451 DEBUG:teuthology.orchestra.run.smithi039:> ') 2023-11-28T11:57:12.567 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-28T11:57:12.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:12.567 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2023-11-28T11:57:12.567 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2023-11-28T11:57:12.567 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-28T11:57:12.567 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-28T11:57:12.567 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-28T11:57:12.567 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-28T11:57:12.568 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-28T11:57:12.568 DEBUG:teuthology.orchestra.run.smithi039:> ') 2023-11-28T11:57:12.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:12.721 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2023-11-28T11:57:12.721 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2023-11-28T11:57:12.721 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set brx.0 up 2023-11-28T11:57:12.722 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set dev brx.0 master ceph-brx 2023-11-28T11:57:12.722 DEBUG:teuthology.orchestra.run.smithi039:> ') 2023-11-28T11:57:12.791 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:57:12.791 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T11:57:12.811 INFO:teuthology.orchestra.run.smithi039.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T11:57:12.811 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:57:12.811 DEBUG:teuthology.orchestra.run.smithi039:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T11:57:12.869 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-28T11:57:12.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:12.869 DEBUG:teuthology.orchestra.run.smithi039:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T11:57:13.009 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T11:57:13.009 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-28T11:57:13.010 INFO:teuthology.orchestra.run.smithi039.stdout:invalid new device string format 2023-11-28T11:57:13.138 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T11:57:13.138 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-28T11:57:13.138 INFO:teuthology.orchestra.run.smithi039.stdout:invalid new device string format 2023-11-28T11:57:13.138 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-11-28T11:57:13.138 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-28T11:57:13.164 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T11:57:13.164 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-28T11:57:13.165 INFO:teuthology.orchestra.run.smithi039.stdout:invalid new device string format 2023-11-28T11:57:13.165 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-11-28T11:57:13.165 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-28T11:57:13.165 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.39:6789,172.21.15.184:6789,172.21.15.184:6790" 2023-11-28T11:57:13.165 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.39:6789,172.21.15.184:6789,172.21.15.184:6790:/ 2023-11-28T11:57:13.165 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=67ce95b1-cd7e-4478-b863-c714ef275520" will pass to kernel 2023-11-28T11:57:13.173 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T11:57:13.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:13.174 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T11:57:13.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:13.208 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T11:57:13.275 INFO:teuthology.orchestra.run.smithi039.stdout:client4652 2023-11-28T11:57:13.275 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:57:13.276 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:57:13.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:13.340 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T11:57:13.418 INFO:teuthology.orchestra.run.smithi039.stdout:client4652 2023-11-28T11:57:13.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:13.419 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T11:57:13.488 INFO:teuthology.orchestra.run.smithi039.stdout:client4652 2023-11-28T11:57:13.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:13.489 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/67ce95b1-cd7e-4478-b863-c714ef275520.client4652/status') 2023-11-28T11:57:13.573 INFO:teuthology.orchestra.run.smithi039.stdout:instance: client.4652 (3)172.21.15.39:0/1252285875 2023-11-28T11:57:13.574 INFO:teuthology.orchestra.run.smithi039.stdout:blocklisted: false 2023-11-28T11:57:13.574 INFO:teuthology.orchestra.run.smithi039.stderr:0+1 records in 2023-11-28T11:57:13.574 INFO:teuthology.orchestra.run.smithi039.stderr:0+1 records out 2023-11-28T11:57:13.574 INFO:teuthology.orchestra.run.smithi039.stderr:70 bytes copied, 0.00016073 s, 436 kB/s 2023-11-28T11:57:13.577 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-11-28T11:57:13.577 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T11:57:13.577 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-28T11:57:13.577 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T11:57:13.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.801+0000 7f160b0fb700 1 Processor -- start 2023-11-28T11:57:13.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.801+0000 7f160b0fb700 1 -- start start 2023-11-28T11:57:13.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.801+0000 7f160b0fb700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f160415c640 0x7f16040d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:13.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.801+0000 7f160b0fb700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1604071aa0 0x7f160406d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:13.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.801+0000 7f160b0fb700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1604069e00 0x7f160406a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:13.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.801+0000 7f160b0fb700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f160406cef0 con 0x7f1604069e00 2023-11-28T11:57:13.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.801+0000 7f160b0fb700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f160406a7c0 con 0x7f1604071aa0 2023-11-28T11:57:13.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.801+0000 7f160b0fb700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f160406c600 con 0x7f160415c640 2023-11-28T11:57:13.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.801+0000 7f160a8fa700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1604069e00 0x7f160406a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:13.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.801+0000 7f160a8fa700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1604069e00 0x7f160406a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53498/0 (socket says 172.21.15.39:53498) 2023-11-28T11:57:13.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.801+0000 7f160a8fa700 1 -- 172.21.15.39:0/595607260 learned_addr learned my addr 172.21.15.39:0/595607260 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:13.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.801+0000 7f160a0f9700 1 --2- 172.21.15.39:0/595607260 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f160415c640 0x7f16040d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:13.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.801+0000 7f16098f8700 1 --2- 172.21.15.39:0/595607260 >> v2:172.21.15.184:3300/0 conn(0x7f1604071aa0 0x7f160406d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:13.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.801+0000 7f160a8fa700 1 -- 172.21.15.39:0/595607260 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f160415c640 msgr2=0x7f16040d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:13.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.801+0000 7f160a8fa700 1 --2- 172.21.15.39:0/595607260 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f160415c640 0x7f16040d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:13.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.801+0000 7f160a8fa700 1 -- 172.21.15.39:0/595607260 >> v2:172.21.15.184:3300/0 conn(0x7f1604071aa0 msgr2=0x7f160406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:13.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.801+0000 7f160a8fa700 1 --2- 172.21.15.39:0/595607260 >> v2:172.21.15.184:3300/0 conn(0x7f1604071aa0 0x7f160406d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:13.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.801+0000 7f160a8fa700 1 -- 172.21.15.39:0/595607260 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16040722f0 con 0x7f1604069e00 2023-11-28T11:57:13.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.801+0000 7f16098f8700 1 --2- 172.21.15.39:0/595607260 >> v2:172.21.15.184:3300/0 conn(0x7f1604071aa0 0x7f160406d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:57:13.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.805+0000 7f160a8fa700 1 --2- 172.21.15.39:0/595607260 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1604069e00 0x7f160406a280 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f160406fc90 tx=0x7f15fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e531abe4ab555ac8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:13.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.805+0000 7f16090f7700 1 -- 172.21.15.39:0/595607260 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc00e070 con 0x7f1604069e00 2023-11-28T11:57:13.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.805+0000 7f16090f7700 1 -- 172.21.15.39:0/595607260 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15fc00b9c0 con 0x7f1604069e00 2023-11-28T11:57:13.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.805+0000 7f16090f7700 1 -- 172.21.15.39:0/595607260 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc00bd70 con 0x7f1604069e00 2023-11-28T11:57:13.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.805+0000 7f160b0fb700 1 -- 172.21.15.39:0/595607260 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1604069e00 msgr2=0x7f160406a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:13.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.805+0000 7f160b0fb700 1 --2- 172.21.15.39:0/595607260 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1604069e00 0x7f160406a280 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f160406fc90 tx=0x7f15fc00b330 comp rx=0 tx=0).stop 2023-11-28T11:57:13.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.805+0000 7f160b0fb700 1 -- 172.21.15.39:0/595607260 shutdown_connections 2023-11-28T11:57:13.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.805+0000 7f160b0fb700 1 --2- 172.21.15.39:0/595607260 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1604069e00 0x7f160406a280 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:13.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.805+0000 7f160b0fb700 1 --2- 172.21.15.39:0/595607260 >> v2:172.21.15.184:3300/0 conn(0x7f1604071aa0 0x7f160406d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:13.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.805+0000 7f160b0fb700 1 --2- 172.21.15.39:0/595607260 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f160415c640 0x7f16040d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:13.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.805+0000 7f160b0fb700 1 -- 172.21.15.39:0/595607260 >> 172.21.15.39:0/595607260 conn(0x7f16040b6520 msgr2=0x7f1604071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:13.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.805+0000 7f160b0fb700 1 -- 172.21.15.39:0/595607260 shutdown_connections 2023-11-28T11:57:13.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.805+0000 7f160b0fb700 1 -- 172.21.15.39:0/595607260 wait complete. 2023-11-28T11:57:13.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.809+0000 7f160b0fb700 1 Processor -- start 2023-11-28T11:57:13.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.809+0000 7f160b0fb700 1 -- start start 2023-11-28T11:57:13.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.809+0000 7f160b0fb700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1604069e00 0x7f16040c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:13.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.809+0000 7f160b0fb700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1604071aa0 0x7f16040ca490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:13.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.809+0000 7f160b0fb700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f160415c640 0x7f16041588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:13.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.809+0000 7f160b0fb700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16040cb880 con 0x7f160415c640 2023-11-28T11:57:13.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.809+0000 7f160b0fb700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16040ca9d0 con 0x7f1604069e00 2023-11-28T11:57:13.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.809+0000 7f160b0fb700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16040cac70 con 0x7f1604071aa0 2023-11-28T11:57:13.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.809+0000 7f160a8fa700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f160415c640 0x7f16041588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:13.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.809+0000 7f160a8fa700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f160415c640 0x7f16041588f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53506/0 (socket says 172.21.15.39:53506) 2023-11-28T11:57:13.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.809+0000 7f160a8fa700 1 -- 172.21.15.39:0/2705659955 learned_addr learned my addr 172.21.15.39:0/2705659955 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:13.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.813+0000 7f16098f8700 1 --2- 172.21.15.39:0/2705659955 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1604071aa0 0x7f16040ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:13.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.813+0000 7f160a0f9700 1 --2- 172.21.15.39:0/2705659955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1604069e00 0x7f16040c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:13.819 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.813+0000 7f160a8fa700 1 -- 172.21.15.39:0/2705659955 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1604071aa0 msgr2=0x7f16040ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:13.819 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.813+0000 7f160a8fa700 1 --2- 172.21.15.39:0/2705659955 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1604071aa0 0x7f16040ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:13.819 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.813+0000 7f160a8fa700 1 -- 172.21.15.39:0/2705659955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1604069e00 msgr2=0x7f16040c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:13.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.813+0000 7f160a8fa700 1 --2- 172.21.15.39:0/2705659955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1604069e00 0x7f16040c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:13.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.813+0000 7f160a8fa700 1 -- 172.21.15.39:0/2705659955 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15fc009b30 con 0x7f160415c640 2023-11-28T11:57:13.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.813+0000 7f16098f8700 1 --2- 172.21.15.39:0/2705659955 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1604071aa0 0x7f16040ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:57:13.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.813+0000 7f160a0f9700 1 --2- 172.21.15.39:0/2705659955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1604069e00 0x7f16040c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:57:13.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.813+0000 7f160a8fa700 1 --2- 172.21.15.39:0/2705659955 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f160415c640 0x7f16041588f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f160406f090 tx=0x7f15fc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:13.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.813+0000 7f15faffd700 1 -- 172.21.15.39:0/2705659955 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc004250 con 0x7f160415c640 2023-11-28T11:57:13.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.813+0000 7f15faffd700 1 -- 172.21.15.39:0/2705659955 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15fc0043b0 con 0x7f160415c640 2023-11-28T11:57:13.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.813+0000 7f160b0fb700 1 -- 172.21.15.39:0/2705659955 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1604072010 con 0x7f160415c640 2023-11-28T11:57:13.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.813+0000 7f15faffd700 1 -- 172.21.15.39:0/2705659955 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc004760 con 0x7f160415c640 2023-11-28T11:57:13.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.813+0000 7f160b0fb700 1 -- 172.21.15.39:0/2705659955 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f160415ca10 con 0x7f160415c640 2023-11-28T11:57:13.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.817+0000 7f160b0fb700 1 -- 172.21.15.39:0/2705659955 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f160406c830 con 0x7f160415c640 2023-11-28T11:57:13.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.817+0000 7f15faffd700 1 -- 172.21.15.39:0/2705659955 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f15fc02c070 con 0x7f160415c640 2023-11-28T11:57:13.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.817+0000 7f15faffd700 1 --2- 172.21.15.39:0/2705659955 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f15e8064ee0 0x7f15e8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:13.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.821+0000 7f15faffd700 1 -- 172.21.15.39:0/2705659955 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f15fc083630 con 0x7f160415c640 2023-11-28T11:57:13.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.821+0000 7f160a0f9700 1 --2- 172.21.15.39:0/2705659955 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f15e8064ee0 0x7f15e8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:13.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.821+0000 7f160a0f9700 1 --2- 172.21.15.39:0/2705659955 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f15e8064ee0 0x7f15e8067390 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1600009a10 tx=0x7f1600008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:13.829 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:13.825+0000 7f15faffd700 1 -- 172.21.15.39:0/2705659955 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f15fc051460 con 0x7f160415c640 2023-11-28T11:57:14.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:14.037+0000 7f160b0fb700 1 -- 172.21.15.39:0/2705659955 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1604073cb0 con 0x7f160415c640 2023-11-28T11:57:14.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:14.037+0000 7f15faffd700 1 -- 172.21.15.39:0/2705659955 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f15fc020070 con 0x7f160415c640 2023-11-28T11:57:14.043 INFO:teuthology.orchestra.run.smithi039.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-28T11:57:14.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:14.041+0000 7f160b0fb700 1 -- 172.21.15.39:0/2705659955 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f15e8064ee0 msgr2=0x7f15e8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:14.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:14.041+0000 7f160b0fb700 1 --2- 172.21.15.39:0/2705659955 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f15e8064ee0 0x7f15e8067390 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1600009a10 tx=0x7f1600008040 comp rx=0 tx=0).stop 2023-11-28T11:57:14.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:14.041+0000 7f160b0fb700 1 -- 172.21.15.39:0/2705659955 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f160415c640 msgr2=0x7f16041588f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:14.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:14.041+0000 7f160b0fb700 1 --2- 172.21.15.39:0/2705659955 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f160415c640 0x7f16041588f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f160406f090 tx=0x7f15fc004af0 comp rx=0 tx=0).stop 2023-11-28T11:57:14.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:14.041+0000 7f160b0fb700 1 -- 172.21.15.39:0/2705659955 shutdown_connections 2023-11-28T11:57:14.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:14.041+0000 7f160b0fb700 1 --2- 172.21.15.39:0/2705659955 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f160415c640 0x7f16041588f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:14.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:14.041+0000 7f160b0fb700 1 --2- 172.21.15.39:0/2705659955 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1604071aa0 0x7f16040ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:14.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:14.041+0000 7f160b0fb700 1 --2- 172.21.15.39:0/2705659955 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f15e8064ee0 0x7f15e8067390 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:14.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:14.041+0000 7f160b0fb700 1 --2- 172.21.15.39:0/2705659955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1604069e00 0x7f16040c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:14.050 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:14.041+0000 7f160b0fb700 1 -- 172.21.15.39:0/2705659955 >> 172.21.15.39:0/2705659955 conn(0x7f16040b6520 msgr2=0x7f16040b23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:14.050 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:14.041+0000 7f160b0fb700 1 -- 172.21.15.39:0/2705659955 shutdown_connections 2023-11-28T11:57:14.050 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:14.041+0000 7f160b0fb700 1 -- 172.21.15.39:0/2705659955 wait complete. 2023-11-28T11:57:14.071 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T11:57:14.073 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T11:57:14.073 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi039.front.sepia.ceph.com 2023-11-28T11:57:14.073 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-28T11:57:14.073 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-28T11:57:14.073 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T11:57:14.073 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T11:57:14.074 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T11:57:14.074 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-28T11:57:14.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:14.075 DEBUG:teuthology.orchestra.run.smithi039:> ip addr 2023-11-28T11:57:14.098 INFO:teuthology.orchestra.run.smithi039.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T11:57:14.099 INFO:teuthology.orchestra.run.smithi039.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T11:57:14.099 INFO:teuthology.orchestra.run.smithi039.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T11:57:14.099 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:57:14.099 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 ::1/128 scope host 2023-11-28T11:57:14.099 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:57:14.099 INFO:teuthology.orchestra.run.smithi039.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:57:14.099 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c6 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:57:14.100 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f0 2023-11-28T11:57:14.100 INFO:teuthology.orchestra.run.smithi039.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T11:57:14.100 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:70 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:57:14.100 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f0 2023-11-28T11:57:14.100 INFO:teuthology.orchestra.run.smithi039.stdout: inet 172.21.15.39/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-28T11:57:14.100 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft 42341sec preferred_lft 42341sec 2023-11-28T11:57:14.100 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::ec4:7aff:febd:1370/64 scope link 2023-11-28T11:57:14.101 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:57:14.101 INFO:teuthology.orchestra.run.smithi039.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:57:14.101 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c7 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:57:14.101 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f1 2023-11-28T11:57:14.101 INFO:teuthology.orchestra.run.smithi039.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:57:14.101 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:71 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:57:14.102 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f1 2023-11-28T11:57:14.102 INFO:teuthology.orchestra.run.smithi039.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T11:57:14.102 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 02:42:df:e8:d2:63 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:57:14.102 INFO:teuthology.orchestra.run.smithi039.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T11:57:14.103 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:57:14.103 INFO:teuthology.orchestra.run.smithi039.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T11:57:14.103 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 82:c4:07:ce:89:23 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:57:14.103 INFO:teuthology.orchestra.run.smithi039.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T11:57:14.103 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:57:14.103 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::48e6:ebff:fe99:9ca6/64 scope link tentative 2023-11-28T11:57:14.104 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:57:14.104 INFO:teuthology.orchestra.run.smithi039.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T11:57:14.104 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 82:c4:07:ce:89:23 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T11:57:14.104 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::80c4:7ff:fece:8923/64 scope link tentative 2023-11-28T11:57:14.104 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:57:14.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:14.106 DEBUG:teuthology.orchestra.run.smithi039:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T11:57:14.185 INFO:teuthology.orchestra.run.smithi039.stdout:1 2023-11-28T11:57:14.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:14.189 DEBUG:teuthology.orchestra.run.smithi039:> route 2023-11-28T11:57:14.253 INFO:teuthology.orchestra.run.smithi039.stdout:Kernel IP routing table 2023-11-28T11:57:14.253 INFO:teuthology.orchestra.run.smithi039.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T11:57:14.253 INFO:teuthology.orchestra.run.smithi039.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-28T11:57:14.253 INFO:teuthology.orchestra.run.smithi039.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T11:57:14.253 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-28T11:57:14.253 INFO:teuthology.orchestra.run.smithi039.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T11:57:14.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:14.254 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2023-11-28T11:57:14.254 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2023-11-28T11:57:14.254 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-28T11:57:14.254 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-28T11:57:14.254 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-28T11:57:14.254 DEBUG:teuthology.orchestra.run.smithi039:> ') 2023-11-28T11:57:14.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:14.394 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2023-11-28T11:57:14.408 INFO:teuthology.orchestra.run.smithi039.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T11:57:14.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:14.409 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list-id 2023-11-28T11:57:14.471 INFO:teuthology.orchestra.run.smithi039.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-28T11:57:14.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:14.473 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2023-11-28T11:57:14.473 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2023-11-28T11:57:14.473 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T11:57:14.473 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-28T11:57:14.474 DEBUG:teuthology.orchestra.run.smithi039:> ') 2023-11-28T11:57:14.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:14.598 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-28T11:57:14.633 INFO:teuthology.orchestra.run.smithi039.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T11:57:14.633 INFO:teuthology.orchestra.run.smithi039.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T11:57:14.633 INFO:teuthology.orchestra.run.smithi039.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T11:57:14.634 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:57:14.634 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 ::1/128 scope host 2023-11-28T11:57:14.634 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:57:14.634 INFO:teuthology.orchestra.run.smithi039.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T11:57:14.634 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether c6:be:5b:b3:07:7f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-28T11:57:14.634 INFO:teuthology.orchestra.run.smithi039.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-28T11:57:14.634 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:57:14.634 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::c4be:5bff:feb3:77f/64 scope link 2023-11-28T11:57:14.634 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:57:14.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:14.637 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-28T11:57:14.718 INFO:teuthology.orchestra.run.smithi039.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T11:57:14.718 INFO:teuthology.orchestra.run.smithi039.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T11:57:14.718 INFO:teuthology.orchestra.run.smithi039.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T11:57:14.719 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:57:14.719 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 ::1/128 scope host 2023-11-28T11:57:14.719 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:57:14.719 INFO:teuthology.orchestra.run.smithi039.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T11:57:14.719 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether c6:be:5b:b3:07:7f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-28T11:57:14.719 INFO:teuthology.orchestra.run.smithi039.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-28T11:57:14.720 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:57:14.720 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::c4be:5bff:feb3:77f/64 scope link 2023-11-28T11:57:14.720 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:57:14.723 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-28T11:57:14.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:14.754 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2023-11-28T11:57:14.755 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2023-11-28T11:57:14.755 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-28T11:57:14.755 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-28T11:57:14.755 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-28T11:57:14.755 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-28T11:57:14.755 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-28T11:57:14.755 DEBUG:teuthology.orchestra.run.smithi039:> ') 2023-11-28T11:57:14.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:14.919 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2023-11-28T11:57:14.919 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2023-11-28T11:57:14.919 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set brx.1 up 2023-11-28T11:57:14.919 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set dev brx.1 master ceph-brx 2023-11-28T11:57:14.919 DEBUG:teuthology.orchestra.run.smithi039:> ') 2023-11-28T11:57:14.997 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:57:14.997 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-11-28T11:57:15.012 INFO:teuthology.orchestra.run.smithi039.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-11-28T11:57:15.013 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:57:15.013 DEBUG:teuthology.orchestra.run.smithi039:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-11-28T11:57:15.074 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-28T11:57:15.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:15.075 DEBUG:teuthology.orchestra.run.smithi039:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-11-28T11:57:15.209 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-11-28T11:57:15.209 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-11-28T11:57:15.209 INFO:teuthology.orchestra.run.smithi039.stdout:invalid new device string format 2023-11-28T11:57:15.237 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-11-28T11:57:15.238 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-11-28T11:57:15.238 INFO:teuthology.orchestra.run.smithi039.stdout:invalid new device string format 2023-11-28T11:57:15.238 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-11-28T11:57:15.238 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-28T11:57:15.258 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-11-28T11:57:15.258 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-11-28T11:57:15.258 INFO:teuthology.orchestra.run.smithi039.stdout:invalid new device string format 2023-11-28T11:57:15.258 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-11-28T11:57:15.258 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-28T11:57:15.259 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.39:6789,172.21.15.184:6789,172.21.15.184:6790" 2023-11-28T11:57:15.259 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.39:6789,172.21.15.184:6789,172.21.15.184:6790:/ 2023-11-28T11:57:15.259 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=67ce95b1-cd7e-4478-b863-c714ef275520" will pass to kernel 2023-11-28T11:57:15.268 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T11:57:15.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:15.269 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-28T11:57:15.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:15.302 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T11:57:15.373 INFO:teuthology.orchestra.run.smithi039.stdout:client4815 2023-11-28T11:57:15.373 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:57:15.373 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:57:15.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:15.435 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T11:57:15.508 INFO:teuthology.orchestra.run.smithi039.stdout:client4815 2023-11-28T11:57:15.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:15.509 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T11:57:15.577 INFO:teuthology.orchestra.run.smithi039.stdout:client4815 2023-11-28T11:57:15.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:15.578 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/67ce95b1-cd7e-4478-b863-c714ef275520.client4815/status') 2023-11-28T11:57:15.661 INFO:teuthology.orchestra.run.smithi039.stdout:instance: client.4815 (3)192.168.0.2:0/2073895687 2023-11-28T11:57:15.661 INFO:teuthology.orchestra.run.smithi039.stdout:blocklisted: false 2023-11-28T11:57:15.662 INFO:teuthology.orchestra.run.smithi039.stderr:0+1 records in 2023-11-28T11:57:15.662 INFO:teuthology.orchestra.run.smithi039.stderr:0+1 records out 2023-11-28T11:57:15.662 INFO:teuthology.orchestra.run.smithi039.stderr:69 bytes copied, 0.000140487 s, 491 kB/s 2023-11-28T11:57:15.665 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-11-28T11:57:15.665 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T11:57:15.666 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-28T11:57:15.666 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T11:57:15.886 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.881+0000 7f470ca20700 1 Processor -- start 2023-11-28T11:57:15.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.881+0000 7f470ca20700 1 -- start start 2023-11-28T11:57:15.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.881+0000 7f470ca20700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f470815c640 0x7f47080d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:15.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.885+0000 7f470ca20700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f4708069e00 0x7f470806a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:15.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.885+0000 7f470ca20700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f470806c600 con 0x7f4708071aa0 2023-11-28T11:57:15.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.885+0000 7f470ca20700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f470806cef0 con 0x7f4708069e00 2023-11-28T11:57:15.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.885+0000 7f470ca20700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f470806a7c0 con 0x7f470815c640 2023-11-28T11:57:15.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.885+0000 7f4706ffd700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f4708071aa0 0x7f470806d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:37178/0 (socket says 172.21.15.39:37178) 2023-11-28T11:57:15.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.885+0000 7f47077fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f470815c640 0x7f47080d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:15.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.885+0000 7f4706ffd700 1 -- 172.21.15.39:0/278937726 learned_addr learned my addr 172.21.15.39:0/278937726 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:15.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.885+0000 7f4707fff700 1 --2- 172.21.15.39:0/278937726 >> v2:172.21.15.184:3300/0 conn(0x7f4708069e00 0x7f470806a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:15.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.885+0000 7f47077fe700 1 -- 172.21.15.39:0/278937726 >> v2:172.21.15.184:3300/0 conn(0x7f4708069e00 msgr2=0x7f470806a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:15.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.885+0000 7f47077fe700 1 --2- 172.21.15.39:0/278937726 >> v2:172.21.15.184:3300/0 conn(0x7f4708069e00 0x7f470806a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:15.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.885+0000 7f47077fe700 1 -- 172.21.15.39:0/278937726 >> v1:172.21.15.184:6789/0 conn(0x7f4708071aa0 legacy=0x7f470806d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:15.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.885+0000 7f47077fe700 1 -- 172.21.15.39:0/278937726 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47080722f0 con 0x7f470815c640 2023-11-28T11:57:15.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.885+0000 7f4707fff700 1 --2- 172.21.15.39:0/278937726 >> v2:172.21.15.184:3300/0 conn(0x7f4708069e00 0x7f470806a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:15.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.885+0000 7f47077fe700 1 --2- 172.21.15.39:0/278937726 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f470815c640 0x7f47080d31e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f46f8009850 tx=0x7f46f8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fd54c5639b96b58 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:15.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.885+0000 7f47067fc700 1 -- 172.21.15.39:0/278937726 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f8011830 con 0x7f470815c640 2023-11-28T11:57:15.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.885+0000 7f47067fc700 1 -- 172.21.15.39:0/278937726 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f8011990 con 0x7f470815c640 2023-11-28T11:57:15.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.885+0000 7f47067fc700 1 -- 172.21.15.39:0/278937726 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f8011d40 con 0x7f470815c640 2023-11-28T11:57:15.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.885+0000 7f470ca20700 1 -- 172.21.15.39:0/278937726 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f470815c640 msgr2=0x7f47080d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:15.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.885+0000 7f470ca20700 1 --2- 172.21.15.39:0/278937726 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f470815c640 0x7f47080d31e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f46f8009850 tx=0x7f46f8009b60 comp rx=0 tx=0).stop 2023-11-28T11:57:15.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.889+0000 7f470ca20700 1 -- 172.21.15.39:0/278937726 shutdown_connections 2023-11-28T11:57:15.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.889+0000 7f470ca20700 1 --2- 172.21.15.39:0/278937726 >> v2:172.21.15.184:3300/0 conn(0x7f4708069e00 0x7f470806a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:15.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.889+0000 7f470ca20700 1 --2- 172.21.15.39:0/278937726 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f470815c640 0x7f47080d31e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:15.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.889+0000 7f470ca20700 1 -- 172.21.15.39:0/278937726 >> 172.21.15.39:0/278937726 conn(0x7f47080b6520 msgr2=0x7f4708071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:15.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.889+0000 7f470ca20700 1 -- 172.21.15.39:0/278937726 shutdown_connections 2023-11-28T11:57:15.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.889+0000 7f470ca20700 1 -- 172.21.15.39:0/278937726 wait complete. 2023-11-28T11:57:15.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.893+0000 7f470ca20700 1 Processor -- start 2023-11-28T11:57:15.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.893+0000 7f470ca20700 1 -- start start 2023-11-28T11:57:15.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.893+0000 7f470ca20700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4708069e00 0x7f470809bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:15.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.893+0000 7f470ca20700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4708071aa0 0x7f47080b28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:15.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.893+0000 7f470ca20700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f470815c640 0x7f47080b2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:15.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.893+0000 7f470ca20700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470809c2d0 con 0x7f4708069e00 2023-11-28T11:57:15.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.893+0000 7f470ca20700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47080d1e40 con 0x7f4708071aa0 2023-11-28T11:57:15.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.893+0000 7f470ca20700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47080b3640 con 0x7f470815c640 2023-11-28T11:57:15.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.893+0000 7f47077fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4708069e00 0x7f470809bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:15.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.893+0000 7f47077fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4708069e00 0x7f470809bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53518/0 (socket says 172.21.15.39:53518) 2023-11-28T11:57:15.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.893+0000 7f47077fe700 1 -- 172.21.15.39:0/3850326446 learned_addr learned my addr 172.21.15.39:0/3850326446 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:15.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.893+0000 7f4707fff700 1 --2- 172.21.15.39:0/3850326446 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f470815c640 0x7f47080b2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:15.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.893+0000 7f4706ffd700 1 --2- 172.21.15.39:0/3850326446 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4708071aa0 0x7f47080b28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:15.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.893+0000 7f47077fe700 1 -- 172.21.15.39:0/3850326446 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f470815c640 msgr2=0x7f47080b2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:15.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.893+0000 7f47077fe700 1 --2- 172.21.15.39:0/3850326446 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f470815c640 0x7f47080b2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:15.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.893+0000 7f47077fe700 1 -- 172.21.15.39:0/3850326446 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4708071aa0 msgr2=0x7f47080b28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:15.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.893+0000 7f47077fe700 1 --2- 172.21.15.39:0/3850326446 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4708071aa0 0x7f47080b28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:15.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.893+0000 7f47077fe700 1 -- 172.21.15.39:0/3850326446 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4700009a70 con 0x7f4708069e00 2023-11-28T11:57:15.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.893+0000 7f47077fe700 1 --2- 172.21.15.39:0/3850326446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4708069e00 0x7f470809bd90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f46f8014040 tx=0x7f46f8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:15.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.897+0000 7f46effff700 1 -- 172.21.15.39:0/3850326446 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f80038c0 con 0x7f4708069e00 2023-11-28T11:57:15.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.897+0000 7f470ca20700 1 -- 172.21.15.39:0/3850326446 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46f80094b0 con 0x7f4708069e00 2023-11-28T11:57:15.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.897+0000 7f46effff700 1 -- 172.21.15.39:0/3850326446 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f801e070 con 0x7f4708069e00 2023-11-28T11:57:15.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.897+0000 7f46effff700 1 -- 172.21.15.39:0/3850326446 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f8003c80 con 0x7f4708069e00 2023-11-28T11:57:15.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.897+0000 7f470ca20700 1 -- 172.21.15.39:0/3850326446 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f470815ca10 con 0x7f4708069e00 2023-11-28T11:57:15.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.897+0000 7f470ca20700 1 -- 172.21.15.39:0/3850326446 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f470806da20 con 0x7f4708069e00 2023-11-28T11:57:15.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.901+0000 7f46effff700 1 -- 172.21.15.39:0/3850326446 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f46f800f050 con 0x7f4708069e00 2023-11-28T11:57:15.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.901+0000 7f46effff700 1 --2- 172.21.15.39:0/3850326446 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f46f4064ee0 0x7f46f4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:15.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.905+0000 7f46effff700 1 -- 172.21.15.39:0/3850326446 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f46f8020070 con 0x7f4708069e00 2023-11-28T11:57:15.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.905+0000 7f4706ffd700 1 --2- 172.21.15.39:0/3850326446 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f46f4064ee0 0x7f46f4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:15.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.905+0000 7f4706ffd700 1 --2- 172.21.15.39:0/3850326446 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f46f4064ee0 0x7f46f4067390 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f470815f9e0 tx=0x7f46fc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:15.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:15.905+0000 7f46effff700 1 -- 172.21.15.39:0/3850326446 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f46f8051730 con 0x7f4708069e00 2023-11-28T11:57:16.123 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:16.117+0000 7f470ca20700 1 -- 172.21.15.39:0/3850326446 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4708072010 con 0x7f4708069e00 2023-11-28T11:57:16.123 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:16.117+0000 7f46effff700 1 -- 172.21.15.39:0/3850326446 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f46f802a070 con 0x7f4708069e00 2023-11-28T11:57:16.124 INFO:teuthology.orchestra.run.smithi039.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-28T11:57:16.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:16.121+0000 7f470ca20700 1 -- 172.21.15.39:0/3850326446 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f46f4064ee0 msgr2=0x7f46f4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:16.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:16.121+0000 7f470ca20700 1 --2- 172.21.15.39:0/3850326446 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f46f4064ee0 0x7f46f4067390 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f470815f9e0 tx=0x7f46fc009040 comp rx=0 tx=0).stop 2023-11-28T11:57:16.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:16.121+0000 7f470ca20700 1 -- 172.21.15.39:0/3850326446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4708069e00 msgr2=0x7f470809bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:16.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:16.121+0000 7f470ca20700 1 --2- 172.21.15.39:0/3850326446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4708069e00 0x7f470809bd90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f46f8014040 tx=0x7f46f8004770 comp rx=0 tx=0).stop 2023-11-28T11:57:16.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:16.125+0000 7f470ca20700 1 -- 172.21.15.39:0/3850326446 shutdown_connections 2023-11-28T11:57:16.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:16.125+0000 7f470ca20700 1 --2- 172.21.15.39:0/3850326446 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f470815c640 0x7f47080b2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:16.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:16.125+0000 7f470ca20700 1 --2- 172.21.15.39:0/3850326446 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f46f4064ee0 0x7f46f4067390 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:16.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:16.125+0000 7f470ca20700 1 --2- 172.21.15.39:0/3850326446 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4708071aa0 0x7f47080b28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:16.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:16.125+0000 7f470ca20700 1 --2- 172.21.15.39:0/3850326446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4708069e00 0x7f470809bd90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:16.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:16.125+0000 7f470ca20700 1 -- 172.21.15.39:0/3850326446 >> 172.21.15.39:0/3850326446 conn(0x7f47080b6520 msgr2=0x7f47080cba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:16.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:16.125+0000 7f470ca20700 1 -- 172.21.15.39:0/3850326446 shutdown_connections 2023-11-28T11:57:16.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:16.125+0000 7f470ca20700 1 -- 172.21.15.39:0/3850326446 wait complete. 2023-11-28T11:57:16.151 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T11:57:16.151 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T11:57:16.151 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi184.front.sepia.ceph.com 2023-11-28T11:57:16.151 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-28T11:57:16.151 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-28T11:57:16.151 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T11:57:16.151 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T11:57:16.151 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T11:57:16.151 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-28T11:57:16.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:16.152 DEBUG:teuthology.orchestra.run.smithi184:> ip addr 2023-11-28T11:57:16.174 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T11:57:16.174 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T11:57:16.174 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T11:57:16.174 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:57:16.174 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-11-28T11:57:16.174 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:57:16.175 INFO:teuthology.orchestra.run.smithi184.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:57:16.175 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:16 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:57:16.175 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f0 2023-11-28T11:57:16.175 INFO:teuthology.orchestra.run.smithi184.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:57:16.175 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:17 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:57:16.175 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f1 2023-11-28T11:57:16.175 INFO:teuthology.orchestra.run.smithi184.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:57:16.175 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8e brd ff:ff:ff:ff:ff:ff 2023-11-28T11:57:16.175 INFO:teuthology.orchestra.run.smithi184.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T11:57:16.175 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8f brd ff:ff:ff:ff:ff:ff 2023-11-28T11:57:16.175 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.21.15.184/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T11:57:16.175 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft 42295sec preferred_lft 42295sec 2023-11-28T11:57:16.176 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::ec4:7aff:fe88:7b8f/64 scope link 2023-11-28T11:57:16.176 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:57:16.176 INFO:teuthology.orchestra.run.smithi184.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T11:57:16.176 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 02:42:c8:96:89:92 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:57:16.176 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T11:57:16.176 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:57:16.177 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-28T11:57:16.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:16.177 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-11-28T11:57:16.177 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-11-28T11:57:16.177 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link add name ceph-brx type bridge 2023-11-28T11:57:16.177 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip addr flush dev ceph-brx 2023-11-28T11:57:16.178 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set ceph-brx up 2023-11-28T11:57:16.178 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-28T11:57:16.178 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-11-28T11:57:16.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:16.328 DEBUG:teuthology.orchestra.run.smithi184:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T11:57:16.358 INFO:teuthology.orchestra.run.smithi184.stdout:1 2023-11-28T11:57:16.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:16.360 DEBUG:teuthology.orchestra.run.smithi184:> route 2023-11-28T11:57:16.438 INFO:teuthology.orchestra.run.smithi184.stdout:Kernel IP routing table 2023-11-28T11:57:16.438 INFO:teuthology.orchestra.run.smithi184.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T11:57:16.438 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T11:57:16.438 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T11:57:16.438 INFO:teuthology.orchestra.run.smithi184.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T11:57:16.438 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-28T11:57:16.438 INFO:teuthology.orchestra.run.smithi184.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T11:57:16.438 INFO:teuthology.orchestra.run.smithi184.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T11:57:16.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:16.439 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-11-28T11:57:16.440 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-11-28T11:57:16.440 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T11:57:16.440 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T11:57:16.440 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T11:57:16.440 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-11-28T11:57:16.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:16.566 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-11-28T11:57:16.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:16.583 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list-id 2023-11-28T11:57:16.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:16.646 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-11-28T11:57:16.646 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-11-28T11:57:16.646 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T11:57:16.646 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-28T11:57:16.647 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-11-28T11:57:16.767 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-28T11:57:16.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:16.767 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-11-28T11:57:16.767 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-11-28T11:57:16.767 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-28T11:57:16.767 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-28T11:57:16.767 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-28T11:57:16.767 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-28T11:57:16.767 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-28T11:57:16.767 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-11-28T11:57:16.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:16.956 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-11-28T11:57:16.956 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-11-28T11:57:16.956 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set brx.0 up 2023-11-28T11:57:16.956 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set dev brx.0 master ceph-brx 2023-11-28T11:57:16.956 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-11-28T11:57:17.026 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:57:17.026 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-28T11:57:17.042 INFO:teuthology.orchestra.run.smithi184.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-28T11:57:17.043 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:57:17.043 DEBUG:teuthology.orchestra.run.smithi184:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-28T11:57:17.103 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-28T11:57:17.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:17.103 DEBUG:teuthology.orchestra.run.smithi184:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-28T11:57:17.235 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-28T11:57:17.235 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-28T11:57:17.235 INFO:teuthology.orchestra.run.smithi184.stdout:invalid new device string format 2023-11-28T11:57:17.361 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-28T11:57:17.361 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-28T11:57:17.361 INFO:teuthology.orchestra.run.smithi184.stdout:invalid new device string format 2023-11-28T11:57:17.361 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-11-28T11:57:17.362 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-28T11:57:17.383 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-28T11:57:17.383 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-28T11:57:17.383 INFO:teuthology.orchestra.run.smithi184.stdout:invalid new device string format 2023-11-28T11:57:17.383 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-11-28T11:57:17.383 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-28T11:57:17.383 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.39:6789,172.21.15.184:6789,172.21.15.184:6790" 2023-11-28T11:57:17.383 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.39:6789,172.21.15.184:6789,172.21.15.184:6790:/ 2023-11-28T11:57:17.384 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=67ce95b1-cd7e-4478-b863-c714ef275520" will pass to kernel 2023-11-28T11:57:17.393 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T11:57:17.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:17.393 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-28T11:57:17.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:17.423 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T11:57:17.501 INFO:teuthology.orchestra.run.smithi184.stdout:client4819 2023-11-28T11:57:17.501 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:57:17.501 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:57:17.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:17.561 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T11:57:17.626 INFO:teuthology.orchestra.run.smithi184.stdout:client4819 2023-11-28T11:57:17.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:17.627 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T11:57:17.693 INFO:teuthology.orchestra.run.smithi184.stdout:client4819 2023-11-28T11:57:17.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:17.693 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/67ce95b1-cd7e-4478-b863-c714ef275520.client4819/status') 2023-11-28T11:57:17.777 INFO:teuthology.orchestra.run.smithi184.stdout:instance: client.4819 (3)192.168.0.1:0/2468060839 2023-11-28T11:57:17.777 INFO:teuthology.orchestra.run.smithi184.stdout:blocklisted: false 2023-11-28T11:57:17.778 INFO:teuthology.orchestra.run.smithi184.stderr:0+1 records in 2023-11-28T11:57:17.778 INFO:teuthology.orchestra.run.smithi184.stderr:0+1 records out 2023-11-28T11:57:17.778 INFO:teuthology.orchestra.run.smithi184.stderr:69 bytes copied, 0.000101583 s, 679 kB/s 2023-11-28T11:57:17.780 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-11-28T11:57:17.780 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T11:57:17.780 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-28T11:57:17.781 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T11:57:17.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.965+0000 7fad4ed58700 1 Processor -- start 2023-11-28T11:57:17.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.965+0000 7fad4ed58700 1 -- start start 2023-11-28T11:57:17.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.965+0000 7fad4ed58700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fad4815c640 0x7fad480d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:17.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.965+0000 7fad4ed58700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fad48069e00 0x7fad4806a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:17.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.965+0000 7fad4ed58700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad4806c600 con 0x7fad48071aa0 2023-11-28T11:57:17.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.965+0000 7fad4ed58700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad4806cef0 con 0x7fad48069e00 2023-11-28T11:57:17.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.965+0000 7fad4ed58700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4806a7c0 con 0x7fad4815c640 2023-11-28T11:57:17.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.965+0000 7fad4d555700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fad48071aa0 0x7fad4806d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:44956/0 (socket says 172.21.15.39:44956) 2023-11-28T11:57:17.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.965+0000 7fad4e557700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fad48069e00 0x7fad4806a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:17.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.965+0000 7fad4dd56700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fad4815c640 0x7fad480d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:17.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.965+0000 7fad4d555700 1 -- 172.21.15.39:0/4010398318 learned_addr learned my addr 172.21.15.39:0/4010398318 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:17.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.969+0000 7fad4e557700 1 -- 172.21.15.39:0/4010398318 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fad4815c640 msgr2=0x7fad480d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:17.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.969+0000 7fad4e557700 1 --2- 172.21.15.39:0/4010398318 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fad4815c640 0x7fad480d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:17.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.969+0000 7fad4e557700 1 -- 172.21.15.39:0/4010398318 >> v1:172.21.15.39:6789/0 conn(0x7fad48071aa0 legacy=0x7fad4806d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:17.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.969+0000 7fad4e557700 1 -- 172.21.15.39:0/4010398318 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad480722f0 con 0x7fad48069e00 2023-11-28T11:57:17.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.969+0000 7fad4dd56700 1 --2- 172.21.15.39:0/4010398318 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fad4815c640 0x7fad480d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:17.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.969+0000 7fad4e557700 1 --2- 172.21.15.39:0/4010398318 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad48069e00 0x7fad4806a280 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fad40009d90 tx=0x7fad4000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e58362049339ddb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:17.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.969+0000 7fad4cd54700 1 -- 172.21.15.39:0/4010398318 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4000e070 con 0x7fad48069e00 2023-11-28T11:57:17.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.969+0000 7fad4cd54700 1 -- 172.21.15.39:0/4010398318 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad4000bb20 con 0x7fad48069e00 2023-11-28T11:57:17.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.969+0000 7fad4cd54700 1 -- 172.21.15.39:0/4010398318 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad40012430 con 0x7fad48069e00 2023-11-28T11:57:17.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.969+0000 7fad4ed58700 1 -- 172.21.15.39:0/4010398318 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad48069e00 msgr2=0x7fad4806a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:17.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.969+0000 7fad4ed58700 1 --2- 172.21.15.39:0/4010398318 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad48069e00 0x7fad4806a280 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fad40009d90 tx=0x7fad4000b330 comp rx=0 tx=0).stop 2023-11-28T11:57:17.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.969+0000 7fad4ed58700 1 -- 172.21.15.39:0/4010398318 shutdown_connections 2023-11-28T11:57:17.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.969+0000 7fad4ed58700 1 --2- 172.21.15.39:0/4010398318 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad48069e00 0x7fad4806a280 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:17.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.969+0000 7fad4ed58700 1 --2- 172.21.15.39:0/4010398318 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fad4815c640 0x7fad480d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:17.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.969+0000 7fad4ed58700 1 -- 172.21.15.39:0/4010398318 >> 172.21.15.39:0/4010398318 conn(0x7fad480b6520 msgr2=0x7fad48071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:17.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.969+0000 7fad4ed58700 1 -- 172.21.15.39:0/4010398318 shutdown_connections 2023-11-28T11:57:17.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.969+0000 7fad4ed58700 1 -- 172.21.15.39:0/4010398318 wait complete. 2023-11-28T11:57:17.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.973+0000 7fad4ed58700 1 Processor -- start 2023-11-28T11:57:17.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.973+0000 7fad4ed58700 1 -- start start 2023-11-28T11:57:17.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.977+0000 7fad4ed58700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad48069e00 0x7fad480cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:17.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.977+0000 7fad4ed58700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad48071aa0 0x7fad480caa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:17.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.977+0000 7fad4ed58700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fad4815c640 0x7fad48159b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:17.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.977+0000 7fad4ed58700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad480c8250 con 0x7fad48071aa0 2023-11-28T11:57:17.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.977+0000 7fad4ed58700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad480c7640 con 0x7fad48069e00 2023-11-28T11:57:17.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.977+0000 7fad4ed58700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad480c7920 con 0x7fad4815c640 2023-11-28T11:57:17.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.977+0000 7fad4d555700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad48071aa0 0x7fad480caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:17.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.977+0000 7fad4d555700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad48071aa0 0x7fad480caa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53544/0 (socket says 172.21.15.39:53544) 2023-11-28T11:57:17.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.977+0000 7fad4d555700 1 -- 172.21.15.39:0/1913731726 learned_addr learned my addr 172.21.15.39:0/1913731726 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:17.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.977+0000 7fad4dd56700 1 --2- 172.21.15.39:0/1913731726 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad48069e00 0x7fad480cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:17.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.977+0000 7fad4e557700 1 --2- 172.21.15.39:0/1913731726 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fad4815c640 0x7fad48159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:17.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.977+0000 7fad4d555700 1 -- 172.21.15.39:0/1913731726 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fad4815c640 msgr2=0x7fad48159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:17.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.977+0000 7fad4d555700 1 --2- 172.21.15.39:0/1913731726 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fad4815c640 0x7fad48159b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:17.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.977+0000 7fad4d555700 1 -- 172.21.15.39:0/1913731726 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad48069e00 msgr2=0x7fad480cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:17.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.977+0000 7fad4d555700 1 --2- 172.21.15.39:0/1913731726 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad48069e00 0x7fad480cc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:17.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.977+0000 7fad4d555700 1 -- 172.21.15.39:0/1913731726 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad440094b0 con 0x7fad48071aa0 2023-11-28T11:57:17.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.977+0000 7fad4d555700 1 --2- 172.21.15.39:0/1913731726 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad48071aa0 0x7fad480caa80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fad38001eb0 tx=0x7fad3800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:17.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.977+0000 7fad3e7fc700 1 -- 172.21.15.39:0/1913731726 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad38005d90 con 0x7fad48071aa0 2023-11-28T11:57:17.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.977+0000 7fad3e7fc700 1 -- 172.21.15.39:0/1913731726 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad380070d0 con 0x7fad48071aa0 2023-11-28T11:57:17.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.977+0000 7fad3e7fc700 1 -- 172.21.15.39:0/1913731726 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad38007440 con 0x7fad48071aa0 2023-11-28T11:57:17.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.977+0000 7fad4ed58700 1 -- 172.21.15.39:0/1913731726 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad40009a70 con 0x7fad48071aa0 2023-11-28T11:57:17.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.977+0000 7fad4ed58700 1 -- 172.21.15.39:0/1913731726 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad4815ca10 con 0x7fad48071aa0 2023-11-28T11:57:17.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.981+0000 7fad4ed58700 1 -- 172.21.15.39:0/1913731726 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad4806da20 con 0x7fad48071aa0 2023-11-28T11:57:17.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.981+0000 7fad3e7fc700 1 -- 172.21.15.39:0/1913731726 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fad38019030 con 0x7fad48071aa0 2023-11-28T11:57:17.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.981+0000 7fad3e7fc700 1 --2- 172.21.15.39:0/1913731726 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fad2c064ee0 0x7fad2c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:17.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.981+0000 7fad3e7fc700 1 -- 172.21.15.39:0/1913731726 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fad380812b0 con 0x7fad48071aa0 2023-11-28T11:57:17.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.981+0000 7fad4dd56700 1 --2- 172.21.15.39:0/1913731726 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fad2c064ee0 0x7fad2c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:17.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.985+0000 7fad4dd56700 1 --2- 172.21.15.39:0/1913731726 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fad2c064ee0 0x7fad2c067390 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fad44009d80 tx=0x7fad44009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:17.994 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:17.989+0000 7fad3e7fc700 1 -- 172.21.15.39:0/1913731726 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fad3804a400 con 0x7fad48071aa0 2023-11-28T11:57:18.210 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:18.205+0000 7fad4ed58700 1 -- 172.21.15.39:0/1913731726 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fad48072010 con 0x7fad48071aa0 2023-11-28T11:57:18.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:18.205+0000 7fad3e7fc700 1 -- 172.21.15.39:0/1913731726 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fad3804f120 con 0x7fad48071aa0 2023-11-28T11:57:18.211 INFO:teuthology.orchestra.run.smithi039.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-28T11:57:18.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:18.209+0000 7fad4ed58700 1 -- 172.21.15.39:0/1913731726 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fad2c064ee0 msgr2=0x7fad2c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:18.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:18.209+0000 7fad4ed58700 1 --2- 172.21.15.39:0/1913731726 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fad2c064ee0 0x7fad2c067390 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fad44009d80 tx=0x7fad44009240 comp rx=0 tx=0).stop 2023-11-28T11:57:18.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:18.209+0000 7fad4ed58700 1 -- 172.21.15.39:0/1913731726 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad48071aa0 msgr2=0x7fad480caa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:18.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:18.209+0000 7fad4ed58700 1 --2- 172.21.15.39:0/1913731726 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad48071aa0 0x7fad480caa80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fad38001eb0 tx=0x7fad3800c7b0 comp rx=0 tx=0).stop 2023-11-28T11:57:18.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:18.209+0000 7fad4ed58700 1 -- 172.21.15.39:0/1913731726 shutdown_connections 2023-11-28T11:57:18.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:18.209+0000 7fad4ed58700 1 --2- 172.21.15.39:0/1913731726 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fad4815c640 0x7fad48159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:18.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:18.209+0000 7fad4ed58700 1 --2- 172.21.15.39:0/1913731726 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad48071aa0 0x7fad480caa80 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:18.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:18.209+0000 7fad4ed58700 1 --2- 172.21.15.39:0/1913731726 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fad2c064ee0 0x7fad2c067390 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:18.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:18.209+0000 7fad4ed58700 1 --2- 172.21.15.39:0/1913731726 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad48069e00 0x7fad480cc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:18.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:18.209+0000 7fad4ed58700 1 -- 172.21.15.39:0/1913731726 >> 172.21.15.39:0/1913731726 conn(0x7fad480b6520 msgr2=0x7fad4806d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:18.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:18.209+0000 7fad4ed58700 1 -- 172.21.15.39:0/1913731726 shutdown_connections 2023-11-28T11:57:18.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:18.209+0000 7fad4ed58700 1 -- 172.21.15.39:0/1913731726 wait complete. 2023-11-28T11:57:18.236 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T11:57:18.237 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T11:57:18.237 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi184.front.sepia.ceph.com 2023-11-28T11:57:18.237 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-28T11:57:18.237 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-28T11:57:18.237 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T11:57:18.237 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T11:57:18.237 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T11:57:18.237 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-28T11:57:18.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:18.237 DEBUG:teuthology.orchestra.run.smithi184:> ip addr 2023-11-28T11:57:18.256 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T11:57:18.256 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T11:57:18.256 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T11:57:18.257 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:57:18.257 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-11-28T11:57:18.257 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:57:18.257 INFO:teuthology.orchestra.run.smithi184.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:57:18.257 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:16 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:57:18.257 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f0 2023-11-28T11:57:18.257 INFO:teuthology.orchestra.run.smithi184.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:57:18.257 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:17 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:57:18.257 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f1 2023-11-28T11:57:18.257 INFO:teuthology.orchestra.run.smithi184.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:57:18.257 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8e brd ff:ff:ff:ff:ff:ff 2023-11-28T11:57:18.257 INFO:teuthology.orchestra.run.smithi184.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T11:57:18.257 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8f brd ff:ff:ff:ff:ff:ff 2023-11-28T11:57:18.258 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.21.15.184/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T11:57:18.258 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft 42293sec preferred_lft 42293sec 2023-11-28T11:57:18.258 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::ec4:7aff:fe88:7b8f/64 scope link 2023-11-28T11:57:18.258 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:57:18.258 INFO:teuthology.orchestra.run.smithi184.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T11:57:18.258 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 02:42:c8:96:89:92 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:57:18.258 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T11:57:18.258 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:57:18.258 INFO:teuthology.orchestra.run.smithi184.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T11:57:18.258 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 9a:73:ec:e3:63:1e brd ff:ff:ff:ff:ff:ff 2023-11-28T11:57:18.259 INFO:teuthology.orchestra.run.smithi184.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T11:57:18.259 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:57:18.259 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::a867:fff:fecc:9e9/64 scope link 2023-11-28T11:57:18.259 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:57:18.259 INFO:teuthology.orchestra.run.smithi184.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T11:57:18.259 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 9a:73:ec:e3:63:1e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T11:57:18.259 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::9873:ecff:fee3:631e/64 scope link tentative 2023-11-28T11:57:18.259 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:57:18.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:18.260 DEBUG:teuthology.orchestra.run.smithi184:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T11:57:18.346 INFO:teuthology.orchestra.run.smithi184.stdout:1 2023-11-28T11:57:18.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:18.347 DEBUG:teuthology.orchestra.run.smithi184:> route 2023-11-28T11:57:18.412 INFO:teuthology.orchestra.run.smithi184.stdout:Kernel IP routing table 2023-11-28T11:57:18.412 INFO:teuthology.orchestra.run.smithi184.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T11:57:18.412 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T11:57:18.412 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T11:57:18.412 INFO:teuthology.orchestra.run.smithi184.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T11:57:18.412 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-28T11:57:18.412 INFO:teuthology.orchestra.run.smithi184.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T11:57:18.413 INFO:teuthology.orchestra.run.smithi184.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T11:57:18.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:18.413 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-11-28T11:57:18.413 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-11-28T11:57:18.413 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T11:57:18.413 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T11:57:18.413 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T11:57:18.413 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-11-28T11:57:18.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:18.550 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-11-28T11:57:18.572 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-28T11:57:18.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:18.573 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list-id 2023-11-28T11:57:18.634 INFO:teuthology.orchestra.run.smithi184.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-28T11:57:18.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:18.635 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-11-28T11:57:18.635 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-11-28T11:57:18.636 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-28T11:57:18.636 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-28T11:57:18.636 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-11-28T11:57:18.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:18.746 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-28T11:57:18.782 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T11:57:18.783 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T11:57:18.783 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T11:57:18.783 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:57:18.783 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-11-28T11:57:18.783 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:57:18.783 INFO:teuthology.orchestra.run.smithi184.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T11:57:18.783 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether fe:ee:0f:61:62:32 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-28T11:57:18.783 INFO:teuthology.orchestra.run.smithi184.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-28T11:57:18.783 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:57:18.783 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::fcee:fff:fe61:6232/64 scope link 2023-11-28T11:57:18.783 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:57:18.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:18.786 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-28T11:57:18.866 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T11:57:18.866 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T11:57:18.866 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T11:57:18.866 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:57:18.867 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-11-28T11:57:18.867 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:57:18.867 INFO:teuthology.orchestra.run.smithi184.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T11:57:18.867 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether fe:ee:0f:61:62:32 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-28T11:57:18.867 INFO:teuthology.orchestra.run.smithi184.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-28T11:57:18.867 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:57:18.867 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::fcee:fff:fe61:6232/64 scope link 2023-11-28T11:57:18.867 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:57:18.870 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-28T11:57:18.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:18.871 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-11-28T11:57:18.871 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-11-28T11:57:18.871 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-28T11:57:18.871 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-28T11:57:18.871 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-28T11:57:18.871 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-28T11:57:18.871 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-28T11:57:18.871 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-11-28T11:57:19.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:19.080 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-11-28T11:57:19.080 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-11-28T11:57:19.080 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set brx.1 up 2023-11-28T11:57:19.080 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set dev brx.1 master ceph-brx 2023-11-28T11:57:19.080 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-11-28T11:57:19.146 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:57:19.146 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-11-28T11:57:19.163 INFO:teuthology.orchestra.run.smithi184.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-11-28T11:57:19.164 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:57:19.164 DEBUG:teuthology.orchestra.run.smithi184:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-11-28T11:57:19.224 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-28T11:57:19.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:19.224 DEBUG:teuthology.orchestra.run.smithi184:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-11-28T11:57:19.361 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-11-28T11:57:19.362 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-11-28T11:57:19.362 INFO:teuthology.orchestra.run.smithi184.stdout:invalid new device string format 2023-11-28T11:57:19.394 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-11-28T11:57:19.394 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-11-28T11:57:19.394 INFO:teuthology.orchestra.run.smithi184.stdout:invalid new device string format 2023-11-28T11:57:19.395 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-11-28T11:57:19.395 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-28T11:57:19.410 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-11-28T11:57:19.410 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-11-28T11:57:19.410 INFO:teuthology.orchestra.run.smithi184.stdout:invalid new device string format 2023-11-28T11:57:19.410 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-11-28T11:57:19.411 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-28T11:57:19.411 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.39:6789,172.21.15.184:6789,172.21.15.184:6790" 2023-11-28T11:57:19.411 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.39:6789,172.21.15.184:6789,172.21.15.184:6790:/ 2023-11-28T11:57:19.411 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=67ce95b1-cd7e-4478-b863-c714ef275520" will pass to kernel 2023-11-28T11:57:19.417 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T11:57:19.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:19.417 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-28T11:57:19.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:19.448 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T11:57:19.521 INFO:teuthology.orchestra.run.smithi184.stdout:client4673 2023-11-28T11:57:19.521 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:57:19.522 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:57:19.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:19.583 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T11:57:19.648 INFO:teuthology.orchestra.run.smithi184.stdout:client4673 2023-11-28T11:57:19.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:19.648 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T11:57:19.719 INFO:teuthology.orchestra.run.smithi184.stdout:client4673 2023-11-28T11:57:19.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:19.719 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/67ce95b1-cd7e-4478-b863-c714ef275520.client4673/status') 2023-11-28T11:57:19.801 INFO:teuthology.orchestra.run.smithi184.stdout:instance: client.4673 (3)192.168.0.2:0/1972318388 2023-11-28T11:57:19.801 INFO:teuthology.orchestra.run.smithi184.stdout:blocklisted: false 2023-11-28T11:57:19.801 INFO:teuthology.orchestra.run.smithi184.stderr:0+1 records in 2023-11-28T11:57:19.801 INFO:teuthology.orchestra.run.smithi184.stderr:0+1 records out 2023-11-28T11:57:19.802 INFO:teuthology.orchestra.run.smithi184.stderr:69 bytes copied, 0.000102763 s, 671 kB/s 2023-11-28T11:57:19.804 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-28T11:57:19.823 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:57:20.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.005+0000 7f1b88b29700 1 Processor -- start 2023-11-28T11:57:20.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.005+0000 7f1b88b29700 1 -- start start 2023-11-28T11:57:20.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.009+0000 7f1b88b29700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1b8415c640 0x7f1b840d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:20.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.009+0000 7f1b88b29700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1b84069e00 0x7f1b8406a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:20.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.009+0000 7f1b88b29700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b8406c600 con 0x7f1b84071aa0 2023-11-28T11:57:20.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.009+0000 7f1b88b29700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b8406cef0 con 0x7f1b84069e00 2023-11-28T11:57:20.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.009+0000 7f1b88b29700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8406a7c0 con 0x7f1b8415c640 2023-11-28T11:57:20.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.009+0000 7f1b7affd700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f1b84071aa0 0x7f1b8406d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:46342/0 (socket says 172.21.15.39:46342) 2023-11-28T11:57:20.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.009+0000 7f1b7affd700 1 -- 172.21.15.39:0/2035711928 learned_addr learned my addr 172.21.15.39:0/2035711928 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:20.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.009+0000 7f1b837fe700 1 --2- 172.21.15.39:0/2035711928 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1b8415c640 0x7f1b840d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:20.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.009+0000 7f1b83fff700 1 --2- 172.21.15.39:0/2035711928 >> v2:172.21.15.184:3300/0 conn(0x7f1b84069e00 0x7f1b8406a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:20.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.009+0000 7f1b82ffd700 1 -- 172.21.15.39:0/2035711928 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3524532535 0 0) 0x7f1b8406c600 con 0x7f1b84071aa0 2023-11-28T11:57:20.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.009+0000 7f1b82ffd700 1 -- 172.21.15.39:0/2035711928 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b700035d0 con 0x7f1b84071aa0 2023-11-28T11:57:20.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.009+0000 7f1b837fe700 1 -- 172.21.15.39:0/2035711928 >> v2:172.21.15.184:3300/0 conn(0x7f1b84069e00 msgr2=0x7f1b8406a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:20.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.009+0000 7f1b837fe700 1 --2- 172.21.15.39:0/2035711928 >> v2:172.21.15.184:3300/0 conn(0x7f1b84069e00 0x7f1b8406a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:20.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.009+0000 7f1b837fe700 1 -- 172.21.15.39:0/2035711928 >> v1:172.21.15.39:6789/0 conn(0x7f1b84071aa0 legacy=0x7f1b8406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:20.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.009+0000 7f1b837fe700 1 -- 172.21.15.39:0/2035711928 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b840722f0 con 0x7f1b8415c640 2023-11-28T11:57:20.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.009+0000 7f1b837fe700 1 --2- 172.21.15.39:0/2035711928 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1b8415c640 0x7f1b840d31e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1b74009d90 tx=0x7f1b7400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d82369469938d69 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:20.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.009+0000 7f1b82ffd700 1 -- 172.21.15.39:0/2035711928 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7400e070 con 0x7f1b8415c640 2023-11-28T11:57:20.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.009+0000 7f1b82ffd700 1 -- 172.21.15.39:0/2035711928 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7400bb20 con 0x7f1b8415c640 2023-11-28T11:57:20.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.009+0000 7f1b82ffd700 1 -- 172.21.15.39:0/2035711928 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b74012430 con 0x7f1b8415c640 2023-11-28T11:57:20.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.009+0000 7f1b88b29700 1 -- 172.21.15.39:0/2035711928 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1b8415c640 msgr2=0x7f1b840d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:20.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.009+0000 7f1b88b29700 1 --2- 172.21.15.39:0/2035711928 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1b8415c640 0x7f1b840d31e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1b74009d90 tx=0x7f1b7400b330 comp rx=0 tx=0).stop 2023-11-28T11:57:20.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.009+0000 7f1b88b29700 1 -- 172.21.15.39:0/2035711928 shutdown_connections 2023-11-28T11:57:20.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.009+0000 7f1b88b29700 1 --2- 172.21.15.39:0/2035711928 >> v2:172.21.15.184:3300/0 conn(0x7f1b84069e00 0x7f1b8406a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:20.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.009+0000 7f1b88b29700 1 --2- 172.21.15.39:0/2035711928 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1b8415c640 0x7f1b840d31e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:20.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.009+0000 7f1b88b29700 1 -- 172.21.15.39:0/2035711928 >> 172.21.15.39:0/2035711928 conn(0x7f1b840b6520 msgr2=0x7f1b84071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:20.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.009+0000 7f1b88b29700 1 -- 172.21.15.39:0/2035711928 shutdown_connections 2023-11-28T11:57:20.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.009+0000 7f1b88b29700 1 -- 172.21.15.39:0/2035711928 wait complete. 2023-11-28T11:57:20.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.013+0000 7f1b88b29700 1 Processor -- start 2023-11-28T11:57:20.018 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.013+0000 7f1b88b29700 1 -- start start 2023-11-28T11:57:20.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.013+0000 7f1b88b29700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b84069e00 0x7f1b840cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:20.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.013+0000 7f1b88b29700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1b84071aa0 0x7f1b8409bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:20.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.013+0000 7f1b88b29700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b8415c640 0x7f1b840d1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:20.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.013+0000 7f1b88b29700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b840cb9b0 con 0x7f1b84069e00 2023-11-28T11:57:20.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.013+0000 7f1b88b29700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8409c310 con 0x7f1b8415c640 2023-11-28T11:57:20.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.013+0000 7f1b88b29700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b840cad30 con 0x7f1b84071aa0 2023-11-28T11:57:20.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.013+0000 7f1b837fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b84069e00 0x7f1b840cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:20.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.013+0000 7f1b837fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b84069e00 0x7f1b840cbdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37052/0 (socket says 172.21.15.39:37052) 2023-11-28T11:57:20.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.013+0000 7f1b837fe700 1 -- 172.21.15.39:0/2117196231 learned_addr learned my addr 172.21.15.39:0/2117196231 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:20.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.013+0000 7f1b7affd700 1 --2- 172.21.15.39:0/2117196231 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1b84071aa0 0x7f1b8409bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:20.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.013+0000 7f1b83fff700 1 --2- 172.21.15.39:0/2117196231 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b8415c640 0x7f1b840d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:20.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.017+0000 7f1b837fe700 1 -- 172.21.15.39:0/2117196231 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1b84071aa0 msgr2=0x7f1b8409bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:20.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.017+0000 7f1b837fe700 1 --2- 172.21.15.39:0/2117196231 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1b84071aa0 0x7f1b8409bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:20.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.017+0000 7f1b837fe700 1 -- 172.21.15.39:0/2117196231 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b8415c640 msgr2=0x7f1b840d1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:20.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.017+0000 7f1b837fe700 1 --2- 172.21.15.39:0/2117196231 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b8415c640 0x7f1b840d1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:20.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.017+0000 7f1b837fe700 1 -- 172.21.15.39:0/2117196231 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b74009a70 con 0x7f1b84069e00 2023-11-28T11:57:20.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.017+0000 7f1b83fff700 1 --2- 172.21.15.39:0/2117196231 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b8415c640 0x7f1b840d1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:57:20.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.017+0000 7f1b837fe700 1 --2- 172.21.15.39:0/2117196231 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b84069e00 0x7f1b840cbdd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1b74014040 tx=0x7f1b74004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:20.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.017+0000 7f1b80ff9700 1 -- 172.21.15.39:0/2117196231 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b74012430 con 0x7f1b84069e00 2023-11-28T11:57:20.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.017+0000 7f1b80ff9700 1 -- 172.21.15.39:0/2117196231 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b74020070 con 0x7f1b84069e00 2023-11-28T11:57:20.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.017+0000 7f1b80ff9700 1 -- 172.21.15.39:0/2117196231 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b74004280 con 0x7f1b84069e00 2023-11-28T11:57:20.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.017+0000 7f1b88b29700 1 -- 172.21.15.39:0/2117196231 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b8415ca10 con 0x7f1b84069e00 2023-11-28T11:57:20.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.017+0000 7f1b88b29700 1 -- 172.21.15.39:0/2117196231 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b8406da20 con 0x7f1b84069e00 2023-11-28T11:57:20.023 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.017+0000 7f1b88b29700 1 -- 172.21.15.39:0/2117196231 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b840cc310 con 0x7f1b84069e00 2023-11-28T11:57:20.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.021+0000 7f1b80ff9700 1 -- 172.21.15.39:0/2117196231 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1b7402e070 con 0x7f1b84069e00 2023-11-28T11:57:20.027 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.021+0000 7f1b80ff9700 1 --2- 172.21.15.39:0/2117196231 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1b64064f10 0x7f1b640673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:20.027 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.021+0000 7f1b80ff9700 1 -- 172.21.15.39:0/2117196231 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1b74022070 con 0x7f1b84069e00 2023-11-28T11:57:20.027 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.021+0000 7f1b7affd700 1 --2- 172.21.15.39:0/2117196231 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1b64064f10 0x7f1b640673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:20.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.025+0000 7f1b7affd700 1 --2- 172.21.15.39:0/2117196231 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1b64064f10 0x7f1b640673c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1b841e5620 tx=0x7f1b6c007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:20.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.029+0000 7f1b80ff9700 1 -- 172.21.15.39:0/2117196231 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1b74051c10 con 0x7f1b84069e00 2023-11-28T11:57:20.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.201+0000 7f1b88b29700 1 -- 172.21.15.39:0/2117196231 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b84072010 con 0x7f1b84069e00 2023-11-28T11:57:20.207 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.201+0000 7f1b80ff9700 1 -- 172.21.15.39:0/2117196231 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+19652 (secure 0 0 0) 0x7f1b74055230 con 0x7f1b84069e00 2023-11-28T11:57:20.208 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:57:20.208 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":29,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:56:44.439368+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:56:38.203736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:56:38.946498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:56:41.988334+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:57:20.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.205+0000 7f1b88b29700 1 -- 172.21.15.39:0/2117196231 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1b64064f10 msgr2=0x7f1b640673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:20.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.205+0000 7f1b88b29700 1 --2- 172.21.15.39:0/2117196231 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1b64064f10 0x7f1b640673c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1b841e5620 tx=0x7f1b6c007de0 comp rx=0 tx=0).stop 2023-11-28T11:57:20.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.205+0000 7f1b88b29700 1 -- 172.21.15.39:0/2117196231 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b84069e00 msgr2=0x7f1b840cbdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:20.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.205+0000 7f1b88b29700 1 --2- 172.21.15.39:0/2117196231 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b84069e00 0x7f1b840cbdd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1b74014040 tx=0x7f1b74004af0 comp rx=0 tx=0).stop 2023-11-28T11:57:20.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.205+0000 7f1b88b29700 1 -- 172.21.15.39:0/2117196231 shutdown_connections 2023-11-28T11:57:20.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.205+0000 7f1b88b29700 1 --2- 172.21.15.39:0/2117196231 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1b64064f10 0x7f1b640673c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:20.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.205+0000 7f1b88b29700 1 --2- 172.21.15.39:0/2117196231 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b8415c640 0x7f1b840d1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:20.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.205+0000 7f1b88b29700 1 --2- 172.21.15.39:0/2117196231 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1b84071aa0 0x7f1b8409bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:20.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.205+0000 7f1b88b29700 1 --2- 172.21.15.39:0/2117196231 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b84069e00 0x7f1b840cbdd0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:20.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.205+0000 7f1b88b29700 1 -- 172.21.15.39:0/2117196231 >> 172.21.15.39:0/2117196231 conn(0x7f1b840b6520 msgr2=0x7f1b840b0840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:20.212 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.205+0000 7f1b88b29700 1 -- 172.21.15.39:0/2117196231 shutdown_connections 2023-11-28T11:57:20.212 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.205+0000 7f1b88b29700 1 -- 172.21.15.39:0/2117196231 wait complete. 2023-11-28T11:57:20.233 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:56:26.631457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:56:33.242202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:56:38.203736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:56:38.946498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T11:56:41.988334+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T11:57:20.233 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:57:20.422 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.417+0000 7f1c8dc48700 1 Processor -- start 2023-11-28T11:57:20.422 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.417+0000 7f1c8dc48700 1 -- start start 2023-11-28T11:57:20.425 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.421+0000 7f1c8dc48700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1c8815a110 0x7f1c8806b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:20.425 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.421+0000 7f1c8dc48700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c88071600 con 0x7f1c880b2470 2023-11-28T11:57:20.425 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.421+0000 7f1c8dc48700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c880cc2c0 con 0x7f1c880c9560 2023-11-28T11:57:20.425 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.421+0000 7f1c8dc48700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c8815a4e0 con 0x7f1c8815a110 2023-11-28T11:57:20.426 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.421+0000 7f1c8cc46700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1c8815a110 0x7f1c8806b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:20.426 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.421+0000 7f1c8d447700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f1c880b2470 0x7f1c880caef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:46356/0 (socket says 172.21.15.39:46356) 2023-11-28T11:57:20.426 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.421+0000 7f1c8d447700 1 -- 172.21.15.39:0/2878246755 learned_addr learned my addr 172.21.15.39:0/2878246755 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:20.427 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.421+0000 7f1c877fe700 1 -- 172.21.15.39:0/2878246755 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2425387 0 0) 0x7f1c880cc2c0 con 0x7f1c880c9560 2023-11-28T11:57:20.427 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.421+0000 7f1c877fe700 1 -- 172.21.15.39:0/2878246755 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c780035d0 con 0x7f1c880c9560 2023-11-28T11:57:20.427 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.421+0000 7f1c8cc46700 1 -- 172.21.15.39:0/2878246755 >> v1:172.21.15.184:6789/0 conn(0x7f1c880c9560 legacy=0x7f1c880b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:20.427 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.421+0000 7f1c8cc46700 1 -- 172.21.15.39:0/2878246755 >> v1:172.21.15.39:6789/0 conn(0x7f1c880b2470 legacy=0x7f1c880caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:20.427 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.421+0000 7f1c877fe700 1 -- 172.21.15.39:0/2878246755 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 223380586 0 0) 0x7f1c88071600 con 0x7f1c880b2470 2023-11-28T11:57:20.427 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.421+0000 7f1c8cc46700 1 -- 172.21.15.39:0/2878246755 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c88071850 con 0x7f1c8815a110 2023-11-28T11:57:20.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.425+0000 7f1c8cc46700 1 --2- 172.21.15.39:0/2878246755 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c8815a110 0x7f1c8806b180 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c009850 tx=0x7f1c7c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a5518b2883dcdf1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:20.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.425+0000 7f1c877fe700 1 -- 172.21.15.39:0/2878246755 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c011830 con 0x7f1c8815a110 2023-11-28T11:57:20.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.425+0000 7f1c877fe700 1 -- 172.21.15.39:0/2878246755 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7c011990 con 0x7f1c8815a110 2023-11-28T11:57:20.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.425+0000 7f1c877fe700 1 -- 172.21.15.39:0/2878246755 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c011d00 con 0x7f1c8815a110 2023-11-28T11:57:20.429 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.425+0000 7f1c8dc48700 1 -- 172.21.15.39:0/2878246755 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c8815a110 msgr2=0x7f1c8806b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:20.429 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.425+0000 7f1c8dc48700 1 --2- 172.21.15.39:0/2878246755 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c8815a110 0x7f1c8806b180 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c009850 tx=0x7f1c7c009b60 comp rx=0 tx=0).stop 2023-11-28T11:57:20.430 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.425+0000 7f1c8dc48700 1 -- 172.21.15.39:0/2878246755 shutdown_connections 2023-11-28T11:57:20.430 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.425+0000 7f1c8dc48700 1 --2- 172.21.15.39:0/2878246755 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c8815a110 0x7f1c8806b180 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:20.430 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.425+0000 7f1c8dc48700 1 -- 172.21.15.39:0/2878246755 >> 172.21.15.39:0/2878246755 conn(0x7f1c880b0a20 msgr2=0x7f1c880b0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:20.430 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.425+0000 7f1c8dc48700 1 -- 172.21.15.39:0/2878246755 shutdown_connections 2023-11-28T11:57:20.430 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.425+0000 7f1c8dc48700 1 -- 172.21.15.39:0/2878246755 wait complete. 2023-11-28T11:57:20.432 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.429+0000 7f1c8dc48700 1 Processor -- start 2023-11-28T11:57:20.432 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.429+0000 7f1c8dc48700 1 -- start start 2023-11-28T11:57:20.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.429+0000 7f1c8dc48700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c880b2470 0x7f1c880c5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:20.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.429+0000 7f1c8dc48700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c880c9560 0x7f1c880c5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:20.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.429+0000 7f1c8dc48700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c8815a110 0x7f1c881f1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:20.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.429+0000 7f1c8dc48700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c880c4fd0 con 0x7f1c880b2470 2023-11-28T11:57:20.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.429+0000 7f1c8dc48700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c880c71d0 con 0x7f1c880c9560 2023-11-28T11:57:20.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.429+0000 7f1c8dc48700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c880c5880 con 0x7f1c8815a110 2023-11-28T11:57:20.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.429+0000 7f1c8cc46700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c880b2470 0x7f1c880c5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:20.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.429+0000 7f1c8cc46700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c880b2470 0x7f1c880c5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37076/0 (socket says 172.21.15.39:37076) 2023-11-28T11:57:20.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.429+0000 7f1c8cc46700 1 -- 172.21.15.39:0/337956423 learned_addr learned my addr 172.21.15.39:0/337956423 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:20.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.429+0000 7f1c87fff700 1 --2- 172.21.15.39:0/337956423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c880c9560 0x7f1c880c5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:20.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.429+0000 7f1c8d447700 1 --2- 172.21.15.39:0/337956423 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c8815a110 0x7f1c881f1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:20.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.429+0000 7f1c8cc46700 1 -- 172.21.15.39:0/337956423 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c8815a110 msgr2=0x7f1c881f1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:20.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.429+0000 7f1c8cc46700 1 --2- 172.21.15.39:0/337956423 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c8815a110 0x7f1c881f1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:20.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.429+0000 7f1c8cc46700 1 -- 172.21.15.39:0/337956423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c880c9560 msgr2=0x7f1c880c5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:20.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.429+0000 7f1c8cc46700 1 --2- 172.21.15.39:0/337956423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c880c9560 0x7f1c880c5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:20.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.429+0000 7f1c8cc46700 1 -- 172.21.15.39:0/337956423 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c7c0094b0 con 0x7f1c880b2470 2023-11-28T11:57:20.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.429+0000 7f1c87fff700 1 --2- 172.21.15.39:0/337956423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c880c9560 0x7f1c880c5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:57:20.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.429+0000 7f1c8cc46700 1 --2- 172.21.15.39:0/337956423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c880b2470 0x7f1c880c5fe0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c0090b0 tx=0x7f1c7c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:20.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.429+0000 7f1c857fa700 1 -- 172.21.15.39:0/337956423 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c0038c0 con 0x7f1c880b2470 2023-11-28T11:57:20.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.429+0000 7f1c857fa700 1 -- 172.21.15.39:0/337956423 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7c01e070 con 0x7f1c880b2470 2023-11-28T11:57:20.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.429+0000 7f1c857fa700 1 -- 172.21.15.39:0/337956423 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c003c40 con 0x7f1c880b2470 2023-11-28T11:57:20.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.429+0000 7f1c8dc48700 1 -- 172.21.15.39:0/337956423 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c8806a980 con 0x7f1c880b2470 2023-11-28T11:57:20.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.433+0000 7f1c8dc48700 1 -- 172.21.15.39:0/337956423 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c8806a6a0 con 0x7f1c880b2470 2023-11-28T11:57:20.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.433+0000 7f1c8dc48700 1 -- 172.21.15.39:0/337956423 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c8806ac60 con 0x7f1c880b2470 2023-11-28T11:57:20.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.433+0000 7f1c857fa700 1 -- 172.21.15.39:0/337956423 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1c7c00f050 con 0x7f1c880b2470 2023-11-28T11:57:20.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.437+0000 7f1c857fa700 1 --2- 172.21.15.39:0/337956423 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1c6c064ee0 0x7f1c6c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:20.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.437+0000 7f1c857fa700 1 -- 172.21.15.39:0/337956423 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1c7c083130 con 0x7f1c880b2470 2023-11-28T11:57:20.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.437+0000 7f1c87fff700 1 --2- 172.21.15.39:0/337956423 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1c6c064ee0 0x7f1c6c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:20.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.437+0000 7f1c87fff700 1 --2- 172.21.15.39:0/337956423 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1c6c064ee0 0x7f1c6c067390 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1c880c4b80 tx=0x7f1c74009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:20.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.441+0000 7f1c857fa700 1 -- 172.21.15.39:0/337956423 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1c7c050fe0 con 0x7f1c880b2470 2023-11-28T11:57:20.624 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.617+0000 7f1c8dc48700 1 -- 172.21.15.39:0/337956423 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1c88071b30 con 0x7f1c880b2470 2023-11-28T11:57:20.625 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.621+0000 7f1c857fa700 1 -- 172.21.15.39:0/337956423 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1c7c006ce0 con 0x7f1c880b2470 2023-11-28T11:57:20.625 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-11-28T11:57:20.628 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.621+0000 7f1c8dc48700 1 -- 172.21.15.39:0/337956423 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1c6c064ee0 msgr2=0x7f1c6c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:20.628 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.621+0000 7f1c8dc48700 1 --2- 172.21.15.39:0/337956423 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1c6c064ee0 0x7f1c6c067390 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1c880c4b80 tx=0x7f1c74009040 comp rx=0 tx=0).stop 2023-11-28T11:57:20.628 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.621+0000 7f1c8dc48700 1 -- 172.21.15.39:0/337956423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c880b2470 msgr2=0x7f1c880c5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:20.628 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.621+0000 7f1c8dc48700 1 --2- 172.21.15.39:0/337956423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c880b2470 0x7f1c880c5fe0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c0090b0 tx=0x7f1c7c004770 comp rx=0 tx=0).stop 2023-11-28T11:57:20.628 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.621+0000 7f1c8dc48700 1 -- 172.21.15.39:0/337956423 shutdown_connections 2023-11-28T11:57:20.628 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.621+0000 7f1c8dc48700 1 --2- 172.21.15.39:0/337956423 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c8815a110 0x7f1c881f1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:20.628 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.621+0000 7f1c8dc48700 1 --2- 172.21.15.39:0/337956423 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1c6c064ee0 0x7f1c6c067390 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:20.628 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.621+0000 7f1c8dc48700 1 --2- 172.21.15.39:0/337956423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c880c9560 0x7f1c880c5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:20.629 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.621+0000 7f1c8dc48700 1 --2- 172.21.15.39:0/337956423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c880b2470 0x7f1c880c5fe0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:20.629 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.621+0000 7f1c8dc48700 1 -- 172.21.15.39:0/337956423 >> 172.21.15.39:0/337956423 conn(0x7f1c880b0a20 msgr2=0x7f1c88159380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:20.629 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.625+0000 7f1c8dc48700 1 -- 172.21.15.39:0/337956423 shutdown_connections 2023-11-28T11:57:20.629 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.625+0000 7f1c8dc48700 1 -- 172.21.15.39:0/337956423 wait complete. 2023-11-28T11:57:20.649 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:57:20.839 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.833+0000 7fe025ccf700 1 Processor -- start 2023-11-28T11:57:20.839 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.833+0000 7fe025ccf700 1 -- start start 2023-11-28T11:57:20.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.837+0000 7fe025ccf700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe020160840 0x7fe0200d2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:20.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.837+0000 7fe025ccf700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe0200b1ac0 0x7fe020070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:20.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.837+0000 7fe025ccf700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0201642b0 con 0x7fe020070780 2023-11-28T11:57:20.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.837+0000 7fe025ccf700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe020070c00 con 0x7fe0200b1ac0 2023-11-28T11:57:20.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.837+0000 7fe025ccf700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0200d2b40 con 0x7fe020160840 2023-11-28T11:57:20.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.837+0000 7fe01effd700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe0200b1ac0 0x7fe020070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:20.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.837+0000 7fe01effd700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe0200b1ac0 0x7fe020070240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37084/0 (socket says 172.21.15.39:37084) 2023-11-28T11:57:20.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.837+0000 7fe01effd700 1 -- 172.21.15.39:0/1017881784 learned_addr learned my addr 172.21.15.39:0/1017881784 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:20.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.837+0000 7fe01f7fe700 1 --2- 172.21.15.39:0/1017881784 >> v2:172.21.15.184:3300/0 conn(0x7fe020160840 0x7fe0200d2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:20.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.837+0000 7fe01effd700 1 -- 172.21.15.39:0/1017881784 >> v2:172.21.15.184:3300/0 conn(0x7fe020160840 msgr2=0x7fe0200d2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:20.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.837+0000 7fe01effd700 1 --2- 172.21.15.39:0/1017881784 >> v2:172.21.15.184:3300/0 conn(0x7fe020160840 0x7fe0200d2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:20.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.837+0000 7fe01effd700 1 -- 172.21.15.39:0/1017881784 >> v1:172.21.15.39:6789/0 conn(0x7fe020070780 legacy=0x7fe02006c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:20.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.837+0000 7fe01effd700 1 -- 172.21.15.39:0/1017881784 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0200b23a0 con 0x7fe0200b1ac0 2023-11-28T11:57:20.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.837+0000 7fe01effd700 1 --2- 172.21.15.39:0/1017881784 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0200b1ac0 0x7fe020070240 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe02006fcf0 tx=0x7fe014009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98d5953f791f0b2b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:20.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.837+0000 7fe01e7fc700 1 -- 172.21.15.39:0/1017881784 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe014011830 con 0x7fe0200b1ac0 2023-11-28T11:57:20.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.837+0000 7fe01e7fc700 1 -- 172.21.15.39:0/1017881784 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe014011990 con 0x7fe0200b1ac0 2023-11-28T11:57:20.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.841+0000 7fe01e7fc700 1 -- 172.21.15.39:0/1017881784 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe014011d20 con 0x7fe0200b1ac0 2023-11-28T11:57:20.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.841+0000 7fe025ccf700 1 -- 172.21.15.39:0/1017881784 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0200b1ac0 msgr2=0x7fe020070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:20.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.841+0000 7fe025ccf700 1 --2- 172.21.15.39:0/1017881784 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0200b1ac0 0x7fe020070240 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe02006fcf0 tx=0x7fe014009bf0 comp rx=0 tx=0).stop 2023-11-28T11:57:20.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.841+0000 7fe025ccf700 1 -- 172.21.15.39:0/1017881784 shutdown_connections 2023-11-28T11:57:20.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.841+0000 7fe025ccf700 1 --2- 172.21.15.39:0/1017881784 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0200b1ac0 0x7fe020070240 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:20.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.841+0000 7fe025ccf700 1 --2- 172.21.15.39:0/1017881784 >> v2:172.21.15.184:3300/0 conn(0x7fe020160840 0x7fe0200d2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:20.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.841+0000 7fe025ccf700 1 -- 172.21.15.39:0/1017881784 >> 172.21.15.39:0/1017881784 conn(0x7fe0200b49d0 msgr2=0x7fe0200b4da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:20.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.841+0000 7fe025ccf700 1 -- 172.21.15.39:0/1017881784 shutdown_connections 2023-11-28T11:57:20.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.841+0000 7fe025ccf700 1 -- 172.21.15.39:0/1017881784 wait complete. 2023-11-28T11:57:20.852 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.841+0000 7fe025ccf700 1 Processor -- start 2023-11-28T11:57:20.852 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.845+0000 7fe025ccf700 1 -- start start 2023-11-28T11:57:20.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.845+0000 7fe025ccf700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe020070780 0x7fe020149180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:20.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.845+0000 7fe025ccf700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0200b1ac0 0x7fe02006cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:20.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.845+0000 7fe025ccf700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe020160840 0x7fe020162de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:20.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.845+0000 7fe025ccf700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0201496c0 con 0x7fe020070780 2023-11-28T11:57:20.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.845+0000 7fe025ccf700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02008d790 con 0x7fe0200b1ac0 2023-11-28T11:57:20.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.845+0000 7fe025ccf700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe02008cb80 con 0x7fe020160840 2023-11-28T11:57:20.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.845+0000 7fe01f7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe020070780 0x7fe020149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:20.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.845+0000 7fe01f7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe020070780 0x7fe020149180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37092/0 (socket says 172.21.15.39:37092) 2023-11-28T11:57:20.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.845+0000 7fe01f7fe700 1 -- 172.21.15.39:0/142889187 learned_addr learned my addr 172.21.15.39:0/142889187 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:20.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.845+0000 7fe01effd700 1 --2- 172.21.15.39:0/142889187 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0200b1ac0 0x7fe02006cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:20.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.845+0000 7fe01ffff700 1 --2- 172.21.15.39:0/142889187 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe020160840 0x7fe020162de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:20.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.849+0000 7fe01f7fe700 1 -- 172.21.15.39:0/142889187 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe020160840 msgr2=0x7fe020162de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:20.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.849+0000 7fe01f7fe700 1 --2- 172.21.15.39:0/142889187 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe020160840 0x7fe020162de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:20.855 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.849+0000 7fe01f7fe700 1 -- 172.21.15.39:0/142889187 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0200b1ac0 msgr2=0x7fe02006cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:20.855 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.849+0000 7fe01f7fe700 1 --2- 172.21.15.39:0/142889187 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0200b1ac0 0x7fe02006cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:20.855 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.849+0000 7fe01f7fe700 1 -- 172.21.15.39:0/142889187 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe014009570 con 0x7fe020070780 2023-11-28T11:57:20.855 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.849+0000 7fe01ffff700 1 --2- 172.21.15.39:0/142889187 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe020160840 0x7fe020162de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:57:20.855 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.849+0000 7fe01effd700 1 --2- 172.21.15.39:0/142889187 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0200b1ac0 0x7fe02006cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:57:20.855 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.849+0000 7fe01f7fe700 1 --2- 172.21.15.39:0/142889187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe020070780 0x7fe020149180 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe01000e840 tx=0x7fe01000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:20.855 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.849+0000 7fe007fff700 1 -- 172.21.15.39:0/142889187 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0100095a0 con 0x7fe020070780 2023-11-28T11:57:20.855 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.849+0000 7fe007fff700 1 -- 172.21.15.39:0/142889187 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe01000c690 con 0x7fe020070780 2023-11-28T11:57:20.855 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.849+0000 7fe007fff700 1 -- 172.21.15.39:0/142889187 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01000ca00 con 0x7fe020070780 2023-11-28T11:57:20.855 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.849+0000 7fe025ccf700 1 -- 172.21.15.39:0/142889187 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0201647e0 con 0x7fe020070780 2023-11-28T11:57:20.855 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.849+0000 7fe025ccf700 1 -- 172.21.15.39:0/142889187 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe020164500 con 0x7fe020070780 2023-11-28T11:57:20.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.849+0000 7fe025ccf700 1 -- 172.21.15.39:0/142889187 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe020164ac0 con 0x7fe020070780 2023-11-28T11:57:20.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.853+0000 7fe007fff700 1 -- 172.21.15.39:0/142889187 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe010019030 con 0x7fe020070780 2023-11-28T11:57:20.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.853+0000 7fe007fff700 1 --2- 172.21.15.39:0/142889187 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe00c064ee0 0x7fe00c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:20.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.853+0000 7fe007fff700 1 -- 172.21.15.39:0/142889187 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe010082040 con 0x7fe020070780 2023-11-28T11:57:20.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.853+0000 7fe01effd700 1 --2- 172.21.15.39:0/142889187 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe00c064ee0 0x7fe00c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:20.860 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.857+0000 7fe01effd700 1 --2- 172.21.15.39:0/142889187 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe00c064ee0 0x7fe00c067390 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe014000c00 tx=0x7fe014008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:20.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:20.857+0000 7fe007fff700 1 -- 172.21.15.39:0/142889187 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe01004fe90 con 0x7fe020070780 2023-11-28T11:57:21.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.041+0000 7fe025ccf700 1 -- 172.21.15.39:0/142889187 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe0200726c0 con 0x7fe020070780 2023-11-28T11:57:21.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.045+0000 7fe007fff700 1 -- 172.21.15.39:0/142889187 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe0100534b0 con 0x7fe020070780 2023-11-28T11:57:21.048 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-11-28T11:57:21.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.045+0000 7fe025ccf700 1 -- 172.21.15.39:0/142889187 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe00c064ee0 msgr2=0x7fe00c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:21.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.045+0000 7fe025ccf700 1 --2- 172.21.15.39:0/142889187 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe00c064ee0 0x7fe00c067390 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe014000c00 tx=0x7fe014008030 comp rx=0 tx=0).stop 2023-11-28T11:57:21.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.045+0000 7fe025ccf700 1 -- 172.21.15.39:0/142889187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe020070780 msgr2=0x7fe020149180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:21.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.045+0000 7fe025ccf700 1 --2- 172.21.15.39:0/142889187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe020070780 0x7fe020149180 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe01000e840 tx=0x7fe01000ec00 comp rx=0 tx=0).stop 2023-11-28T11:57:21.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.045+0000 7fe025ccf700 1 -- 172.21.15.39:0/142889187 shutdown_connections 2023-11-28T11:57:21.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.045+0000 7fe025ccf700 1 --2- 172.21.15.39:0/142889187 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe020160840 0x7fe020162de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:21.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.045+0000 7fe025ccf700 1 --2- 172.21.15.39:0/142889187 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe00c064ee0 0x7fe00c067390 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:21.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.045+0000 7fe025ccf700 1 --2- 172.21.15.39:0/142889187 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0200b1ac0 0x7fe02006cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:21.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.045+0000 7fe025ccf700 1 --2- 172.21.15.39:0/142889187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe020070780 0x7fe020149180 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:21.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.045+0000 7fe025ccf700 1 -- 172.21.15.39:0/142889187 >> 172.21.15.39:0/142889187 conn(0x7fe0200b49d0 msgr2=0x7fe0200b8050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:21.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.045+0000 7fe025ccf700 1 -- 172.21.15.39:0/142889187 shutdown_connections 2023-11-28T11:57:21.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.045+0000 7fe025ccf700 1 -- 172.21.15.39:0/142889187 wait complete. 2023-11-28T11:57:21.072 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:57:21.257 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.253+0000 7fb7b977f700 1 Processor -- start 2023-11-28T11:57:21.258 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.253+0000 7fb7b977f700 1 -- start start 2023-11-28T11:57:21.259 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.253+0000 7fb7b977f700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb7b4159f10 0x7fb7b4070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:21.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.253+0000 7fb7b977f700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7b4070600 con 0x7fb7b40c8c90 2023-11-28T11:57:21.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.253+0000 7fb7b977f700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7b415adf0 con 0x7fb7b415a9f0 2023-11-28T11:57:21.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.253+0000 7fb7b977f700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7b40c9130 con 0x7fb7b4159f10 2023-11-28T11:57:21.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.257+0000 7fb7b27fc700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fb7b40c8c90 0x7fb7b415a2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:46376/0 (socket says 172.21.15.39:46376) 2023-11-28T11:57:21.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.257+0000 7fb7b27fc700 1 -- 172.21.15.39:0/3209323794 learned_addr learned my addr 172.21.15.39:0/3209323794 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:21.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.257+0000 7fb7b2ffd700 1 --2- 172.21.15.39:0/3209323794 >> v2:172.21.15.184:3300/0 conn(0x7fb7b4159f10 0x7fb7b4070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:21.262 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.257+0000 7fb7b1ffb700 1 -- 172.21.15.39:0/3209323794 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 954506998 0 0) 0x7fb7b4070600 con 0x7fb7b40c8c90 2023-11-28T11:57:21.262 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.257+0000 7fb7b1ffb700 1 -- 172.21.15.39:0/3209323794 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb79c0035d0 con 0x7fb7b40c8c90 2023-11-28T11:57:21.262 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.257+0000 7fb7b1ffb700 1 -- 172.21.15.39:0/3209323794 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2315179785 0 0) 0x7fb7b415adf0 con 0x7fb7b415a9f0 2023-11-28T11:57:21.262 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.257+0000 7fb7b1ffb700 1 -- 172.21.15.39:0/3209323794 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7b4070600 con 0x7fb7b415a9f0 2023-11-28T11:57:21.262 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.257+0000 7fb7b2ffd700 1 -- 172.21.15.39:0/3209323794 >> v1:172.21.15.184:6789/0 conn(0x7fb7b415a9f0 legacy=0x7fb7b406be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:21.262 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.257+0000 7fb7b1ffb700 1 -- 172.21.15.39:0/3209323794 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 531528602 0 0) 0x7fb79c0035d0 con 0x7fb7b40c8c90 2023-11-28T11:57:21.262 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.257+0000 7fb7b2ffd700 1 -- 172.21.15.39:0/3209323794 >> v1:172.21.15.39:6789/0 conn(0x7fb7b40c8c90 legacy=0x7fb7b415a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:21.262 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.257+0000 7fb7b2ffd700 1 -- 172.21.15.39:0/3209323794 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b40afcc0 con 0x7fb7b4159f10 2023-11-28T11:57:21.263 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.257+0000 7fb7b2ffd700 1 --2- 172.21.15.39:0/3209323794 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7b4159f10 0x7fb7b4070a90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4009850 tx=0x7fb7a4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f878caf5a2ccad0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:21.263 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.257+0000 7fb7b1ffb700 1 -- 172.21.15.39:0/3209323794 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a8001670 con 0x7fb7b4159f10 2023-11-28T11:57:21.263 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.257+0000 7fb7b1ffb700 1 -- 172.21.15.39:0/3209323794 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a4004030 con 0x7fb7b4159f10 2023-11-28T11:57:21.263 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.257+0000 7fb7b1ffb700 1 -- 172.21.15.39:0/3209323794 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a40043c0 con 0x7fb7b4159f10 2023-11-28T11:57:21.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.261+0000 7fb7b977f700 1 -- 172.21.15.39:0/3209323794 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7b4159f10 msgr2=0x7fb7b4070a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:21.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.261+0000 7fb7b977f700 1 --2- 172.21.15.39:0/3209323794 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7b4159f10 0x7fb7b4070a90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4009850 tx=0x7fb7a4009b60 comp rx=0 tx=0).stop 2023-11-28T11:57:21.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.261+0000 7fb7b977f700 1 -- 172.21.15.39:0/3209323794 shutdown_connections 2023-11-28T11:57:21.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.261+0000 7fb7b977f700 1 --2- 172.21.15.39:0/3209323794 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7b4159f10 0x7fb7b4070a90 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:21.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.261+0000 7fb7b977f700 1 -- 172.21.15.39:0/3209323794 >> 172.21.15.39:0/3209323794 conn(0x7fb7b40cf280 msgr2=0x7fb7b40cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:21.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.261+0000 7fb7b977f700 1 -- 172.21.15.39:0/3209323794 shutdown_connections 2023-11-28T11:57:21.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.261+0000 7fb7b977f700 1 -- 172.21.15.39:0/3209323794 wait complete. 2023-11-28T11:57:21.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.265+0000 7fb7b977f700 1 Processor -- start 2023-11-28T11:57:21.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.265+0000 7fb7b977f700 1 -- start start 2023-11-28T11:57:21.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.265+0000 7fb7b977f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7b40c8c90 0x7fb7b40af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:21.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.265+0000 7fb7b977f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7b4159f10 0x7fb7b4153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:21.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.265+0000 7fb7b977f700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7b415a9f0 0x7fb7b4153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:21.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.265+0000 7fb7b977f700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b415ceb0 con 0x7fb7b415a9f0 2023-11-28T11:57:21.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.265+0000 7fb7b977f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b415c330 con 0x7fb7b40c8c90 2023-11-28T11:57:21.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.265+0000 7fb7b977f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b415c610 con 0x7fb7b4159f10 2023-11-28T11:57:21.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.265+0000 7fb7b37fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7b415a9f0 0x7fb7b4153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:21.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.265+0000 7fb7b37fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7b415a9f0 0x7fb7b4153e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37108/0 (socket says 172.21.15.39:37108) 2023-11-28T11:57:21.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.265+0000 7fb7b37fe700 1 -- 172.21.15.39:0/272173114 learned_addr learned my addr 172.21.15.39:0/272173114 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:21.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.265+0000 7fb7b2ffd700 1 --2- 172.21.15.39:0/272173114 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7b40c8c90 0x7fb7b40af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:21.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.265+0000 7fb7b27fc700 1 --2- 172.21.15.39:0/272173114 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7b4159f10 0x7fb7b4153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:21.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.265+0000 7fb7b37fe700 1 -- 172.21.15.39:0/272173114 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7b4159f10 msgr2=0x7fb7b4153940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:21.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.265+0000 7fb7b37fe700 1 --2- 172.21.15.39:0/272173114 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7b4159f10 0x7fb7b4153940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:21.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.269+0000 7fb7b37fe700 1 -- 172.21.15.39:0/272173114 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7b40c8c90 msgr2=0x7fb7b40af0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:21.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.269+0000 7fb7b37fe700 1 --2- 172.21.15.39:0/272173114 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7b40c8c90 0x7fb7b40af0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:21.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.269+0000 7fb7b37fe700 1 -- 172.21.15.39:0/272173114 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a40094b0 con 0x7fb7b415a9f0 2023-11-28T11:57:21.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.269+0000 7fb7b37fe700 1 --2- 172.21.15.39:0/272173114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7b415a9f0 0x7fb7b4153e80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac00cbc0 tx=0x7fb7ac00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:21.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.269+0000 7fb79b7fe700 1 -- 172.21.15.39:0/272173114 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac003c20 con 0x7fb7b415a9f0 2023-11-28T11:57:21.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.269+0000 7fb79b7fe700 1 -- 172.21.15.39:0/272173114 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ac003d80 con 0x7fb7b415a9f0 2023-11-28T11:57:21.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.269+0000 7fb7b977f700 1 -- 172.21.15.39:0/272173114 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7b4070290 con 0x7fb7b415a9f0 2023-11-28T11:57:21.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.269+0000 7fb79b7fe700 1 -- 172.21.15.39:0/272173114 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac00aaa0 con 0x7fb7b415a9f0 2023-11-28T11:57:21.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.269+0000 7fb7b977f700 1 -- 172.21.15.39:0/272173114 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7b406ffb0 con 0x7fb7b415a9f0 2023-11-28T11:57:21.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.269+0000 7fb7b977f700 1 -- 172.21.15.39:0/272173114 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7b40affa0 con 0x7fb7b415a9f0 2023-11-28T11:57:21.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.273+0000 7fb79b7fe700 1 -- 172.21.15.39:0/272173114 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb7ac010050 con 0x7fb7b415a9f0 2023-11-28T11:57:21.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.273+0000 7fb79b7fe700 1 --2- 172.21.15.39:0/272173114 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb7a0064ee0 0x7fb7a0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:21.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.273+0000 7fb79b7fe700 1 -- 172.21.15.39:0/272173114 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb7ac0820b0 con 0x7fb7b415a9f0 2023-11-28T11:57:21.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.273+0000 7fb7b2ffd700 1 --2- 172.21.15.39:0/272173114 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb7a0064ee0 0x7fb7a0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:21.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.277+0000 7fb7b2ffd700 1 --2- 172.21.15.39:0/272173114 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb7a0064ee0 0x7fb7a0067390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb7a40090b0 tx=0x7fb7a4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:21.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.281+0000 7fb79b7fe700 1 -- 172.21.15.39:0/272173114 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb7ac04fe30 con 0x7fb7b415a9f0 2023-11-28T11:57:21.458 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.453+0000 7fb7b977f700 1 -- 172.21.15.39:0/272173114 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb7b406cf30 con 0x7fb7b415a9f0 2023-11-28T11:57:21.459 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.453+0000 7fb79b7fe700 1 -- 172.21.15.39:0/272173114 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb7ac053450 con 0x7fb7b415a9f0 2023-11-28T11:57:21.459 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-11-28T11:57:21.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.457+0000 7fb7b977f700 1 -- 172.21.15.39:0/272173114 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb7a0064ee0 msgr2=0x7fb7a0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:21.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.457+0000 7fb7b977f700 1 --2- 172.21.15.39:0/272173114 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb7a0064ee0 0x7fb7a0067390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb7a40090b0 tx=0x7fb7a4008030 comp rx=0 tx=0).stop 2023-11-28T11:57:21.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.457+0000 7fb7b977f700 1 -- 172.21.15.39:0/272173114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7b415a9f0 msgr2=0x7fb7b4153e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:21.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.457+0000 7fb7b977f700 1 --2- 172.21.15.39:0/272173114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7b415a9f0 0x7fb7b4153e80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac00cbc0 tx=0x7fb7ac00ced0 comp rx=0 tx=0).stop 2023-11-28T11:57:21.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.457+0000 7fb7b977f700 1 -- 172.21.15.39:0/272173114 shutdown_connections 2023-11-28T11:57:21.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.457+0000 7fb7b977f700 1 --2- 172.21.15.39:0/272173114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7b415a9f0 0x7fb7b4153e80 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:21.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.457+0000 7fb7b977f700 1 --2- 172.21.15.39:0/272173114 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7b4159f10 0x7fb7b4153940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:21.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.457+0000 7fb7b977f700 1 --2- 172.21.15.39:0/272173114 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb7a0064ee0 0x7fb7a0067390 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:21.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.457+0000 7fb7b977f700 1 --2- 172.21.15.39:0/272173114 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7b40c8c90 0x7fb7b40af0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:21.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.457+0000 7fb7b977f700 1 -- 172.21.15.39:0/272173114 >> 172.21.15.39:0/272173114 conn(0x7fb7b40cf280 msgr2=0x7fb7b40cb540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:21.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.457+0000 7fb7b977f700 1 -- 172.21.15.39:0/272173114 shutdown_connections 2023-11-28T11:57:21.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.457+0000 7fb7b977f700 1 -- 172.21.15.39:0/272173114 wait complete. 2023-11-28T11:57:21.484 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:57:21.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.665+0000 7f24895aa700 1 Processor -- start 2023-11-28T11:57:21.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.669+0000 7f24895aa700 1 -- start start 2023-11-28T11:57:21.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.669+0000 7f24895aa700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f24840b4280 0x7f24840aef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:21.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.669+0000 7f24895aa700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f248406ae10 0x7f24840af480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:21.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.669+0000 7f24895aa700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f248406c040 con 0x7f24840adb20 2023-11-28T11:57:21.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.669+0000 7f24895aa700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f248415a920 con 0x7f248406ae10 2023-11-28T11:57:21.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.669+0000 7f24895aa700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f248415eac0 con 0x7f24840b4280 2023-11-28T11:57:21.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.669+0000 7f24837fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f248406ae10 0x7f24840af480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:21.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.669+0000 7f24837fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f248406ae10 0x7f24840af480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37116/0 (socket says 172.21.15.39:37116) 2023-11-28T11:57:21.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.669+0000 7f24837fe700 1 -- 172.21.15.39:0/3235543243 learned_addr learned my addr 172.21.15.39:0/3235543243 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:21.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.669+0000 7f2482ffd700 1 --2- 172.21.15.39:0/3235543243 >> v2:172.21.15.184:3300/0 conn(0x7f24840b4280 0x7f24840aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:21.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.669+0000 7f24837fe700 1 -- 172.21.15.39:0/3235543243 >> v2:172.21.15.184:3300/0 conn(0x7f24840b4280 msgr2=0x7f24840aef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:21.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.669+0000 7f24837fe700 1 --2- 172.21.15.39:0/3235543243 >> v2:172.21.15.184:3300/0 conn(0x7f24840b4280 0x7f24840aef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:21.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.669+0000 7f24837fe700 1 -- 172.21.15.39:0/3235543243 >> v1:172.21.15.184:6789/0 conn(0x7f24840adb20 legacy=0x7f2484069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:21.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.669+0000 7f24837fe700 1 -- 172.21.15.39:0/3235543243 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f248406d4e0 con 0x7f248406ae10 2023-11-28T11:57:21.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.669+0000 7f24837fe700 1 --2- 172.21.15.39:0/3235543243 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f248406ae10 0x7f24840af480 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f248406bcb0 tx=0x7f247c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef52420e45984b50 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:21.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.673+0000 7f2481ffb700 1 -- 172.21.15.39:0/3235543243 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247c00e070 con 0x7f248406ae10 2023-11-28T11:57:21.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.673+0000 7f2481ffb700 1 -- 172.21.15.39:0/3235543243 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247c00b9c0 con 0x7f248406ae10 2023-11-28T11:57:21.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.673+0000 7f2481ffb700 1 -- 172.21.15.39:0/3235543243 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247c00bd70 con 0x7f248406ae10 2023-11-28T11:57:21.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.673+0000 7f24895aa700 1 -- 172.21.15.39:0/3235543243 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f248406ae10 msgr2=0x7f24840af480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:21.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.673+0000 7f24895aa700 1 --2- 172.21.15.39:0/3235543243 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f248406ae10 0x7f24840af480 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f248406bcb0 tx=0x7f247c00b330 comp rx=0 tx=0).stop 2023-11-28T11:57:21.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.673+0000 7f24895aa700 1 -- 172.21.15.39:0/3235543243 shutdown_connections 2023-11-28T11:57:21.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.673+0000 7f24895aa700 1 --2- 172.21.15.39:0/3235543243 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f248406ae10 0x7f24840af480 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:21.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.673+0000 7f24895aa700 1 --2- 172.21.15.39:0/3235543243 >> v2:172.21.15.184:3300/0 conn(0x7f24840b4280 0x7f24840aef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:21.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.673+0000 7f24895aa700 1 -- 172.21.15.39:0/3235543243 >> 172.21.15.39:0/3235543243 conn(0x7f24840cf580 msgr2=0x7f24840cb370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:21.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.673+0000 7f24895aa700 1 -- 172.21.15.39:0/3235543243 shutdown_connections 2023-11-28T11:57:21.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.673+0000 7f24895aa700 1 -- 172.21.15.39:0/3235543243 wait complete. 2023-11-28T11:57:21.680 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.677+0000 7f24895aa700 1 Processor -- start 2023-11-28T11:57:21.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.677+0000 7f24895aa700 1 -- start start 2023-11-28T11:57:21.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.677+0000 7f24895aa700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f248406ae10 0x7f24840c30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:21.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.677+0000 7f24895aa700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24840adb20 0x7f248415cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:21.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.677+0000 7f24895aa700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f24840b4280 0x7f248415b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:21.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.677+0000 7f24895aa700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24840c8700 con 0x7f24840b4280 2023-11-28T11:57:21.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.677+0000 7f24895aa700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248415c0e0 con 0x7f24840adb20 2023-11-28T11:57:21.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.677+0000 7f24895aa700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24840c5af0 con 0x7f248406ae10 2023-11-28T11:57:21.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.677+0000 7f24837fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f24840b4280 0x7f248415b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:21.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.677+0000 7f24837fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f24840b4280 0x7f248415b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37118/0 (socket says 172.21.15.39:37118) 2023-11-28T11:57:21.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.677+0000 7f24837fe700 1 -- 172.21.15.39:0/3121763054 learned_addr learned my addr 172.21.15.39:0/3121763054 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:21.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.677+0000 7f2482ffd700 1 --2- 172.21.15.39:0/3121763054 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f248406ae10 0x7f24840c30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:21.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.677+0000 7f24827fc700 1 --2- 172.21.15.39:0/3121763054 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24840adb20 0x7f248415cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:21.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.681+0000 7f24837fe700 1 -- 172.21.15.39:0/3121763054 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f248406ae10 msgr2=0x7f24840c30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:21.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.681+0000 7f24837fe700 1 --2- 172.21.15.39:0/3121763054 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f248406ae10 0x7f24840c30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:21.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.681+0000 7f24837fe700 1 -- 172.21.15.39:0/3121763054 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24840adb20 msgr2=0x7f248415cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:21.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.681+0000 7f24837fe700 1 --2- 172.21.15.39:0/3121763054 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24840adb20 0x7f248415cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:21.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.681+0000 7f24837fe700 1 -- 172.21.15.39:0/3121763054 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f247c009b30 con 0x7f24840b4280 2023-11-28T11:57:21.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.681+0000 7f24837fe700 1 --2- 172.21.15.39:0/3121763054 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f24840b4280 0x7f248415b500 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f248406bce0 tx=0x7f247c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:21.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.681+0000 7f246b7fe700 1 -- 172.21.15.39:0/3121763054 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247c0099b0 con 0x7f24840b4280 2023-11-28T11:57:21.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.681+0000 7f246b7fe700 1 -- 172.21.15.39:0/3121763054 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247c0092e0 con 0x7f24840b4280 2023-11-28T11:57:21.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.681+0000 7f246b7fe700 1 -- 172.21.15.39:0/3121763054 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247c01c640 con 0x7f24840b4280 2023-11-28T11:57:21.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.681+0000 7f24895aa700 1 -- 172.21.15.39:0/3121763054 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f248415ed60 con 0x7f24840b4280 2023-11-28T11:57:21.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.681+0000 7f24895aa700 1 -- 172.21.15.39:0/3121763054 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24840b4650 con 0x7f24840b4280 2023-11-28T11:57:21.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.681+0000 7f24895aa700 1 -- 172.21.15.39:0/3121763054 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24840b1350 con 0x7f24840b4280 2023-11-28T11:57:21.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.681+0000 7f246b7fe700 1 -- 172.21.15.39:0/3121763054 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f247c02c070 con 0x7f24840b4280 2023-11-28T11:57:21.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.685+0000 7f246b7fe700 1 --2- 172.21.15.39:0/3121763054 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2470064ee0 0x7f2470067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:21.689 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.685+0000 7f246b7fe700 1 -- 172.21.15.39:0/3121763054 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f247c083e00 con 0x7f24840b4280 2023-11-28T11:57:21.689 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.685+0000 7f2482ffd700 1 --2- 172.21.15.39:0/3121763054 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2470064ee0 0x7f2470067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:21.690 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.685+0000 7f2482ffd700 1 --2- 172.21.15.39:0/3121763054 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2470064ee0 0x7f2470067390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f248415dcf0 tx=0x7f2474008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:21.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.693+0000 7f246b7fe700 1 -- 172.21.15.39:0/3121763054 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f247c051b80 con 0x7f24840b4280 2023-11-28T11:57:21.874 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.869+0000 7f24895aa700 1 -- 172.21.15.39:0/3121763054 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f24840726c0 con 0x7f24840b4280 2023-11-28T11:57:21.880 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.869+0000 7f246b7fe700 1 -- 172.21.15.39:0/3121763054 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f247c0551a0 con 0x7f24840b4280 2023-11-28T11:57:21.887 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2023-11-28T11:57:21.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.877+0000 7f24895aa700 1 -- 172.21.15.39:0/3121763054 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2470064ee0 msgr2=0x7f2470067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:21.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.877+0000 7f24895aa700 1 --2- 172.21.15.39:0/3121763054 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2470064ee0 0x7f2470067390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f248415dcf0 tx=0x7f2474008040 comp rx=0 tx=0).stop 2023-11-28T11:57:21.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.877+0000 7f24895aa700 1 -- 172.21.15.39:0/3121763054 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f24840b4280 msgr2=0x7f248415b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:21.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.877+0000 7f24895aa700 1 --2- 172.21.15.39:0/3121763054 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f24840b4280 0x7f248415b500 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f248406bce0 tx=0x7f247c004af0 comp rx=0 tx=0).stop 2023-11-28T11:57:21.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.877+0000 7f24895aa700 1 -- 172.21.15.39:0/3121763054 shutdown_connections 2023-11-28T11:57:21.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.877+0000 7f24895aa700 1 --2- 172.21.15.39:0/3121763054 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f24840b4280 0x7f248415b500 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:21.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.877+0000 7f24895aa700 1 --2- 172.21.15.39:0/3121763054 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2470064ee0 0x7f2470067390 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:21.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.877+0000 7f24895aa700 1 --2- 172.21.15.39:0/3121763054 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24840adb20 0x7f248415cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:21.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.877+0000 7f24895aa700 1 --2- 172.21.15.39:0/3121763054 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f248406ae10 0x7f24840c30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:21.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.877+0000 7f24895aa700 1 -- 172.21.15.39:0/3121763054 >> 172.21.15.39:0/3121763054 conn(0x7f24840cf580 msgr2=0x7f24840ae070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:21.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.877+0000 7f24895aa700 1 -- 172.21.15.39:0/3121763054 shutdown_connections 2023-11-28T11:57:21.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:21.877+0000 7f24895aa700 1 -- 172.21.15.39:0/3121763054 wait complete. 2023-11-28T11:57:21.903 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T11:57:22.080 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.077+0000 7f4ae1533700 1 Processor -- start 2023-11-28T11:57:22.081 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.077+0000 7f4ae1533700 1 -- start start 2023-11-28T11:57:22.082 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.077+0000 7f4ae1533700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f4adc15e190 0x7f4adc0cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:22.082 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.077+0000 7f4ae1533700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4adc06ff10 0x7f4adc070390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:22.082 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.077+0000 7f4ae1533700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4adc15e560 con 0x7f4adc161560 2023-11-28T11:57:22.082 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.077+0000 7f4ae1533700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4adc0708d0 con 0x7f4adc15e190 2023-11-28T11:57:22.082 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.077+0000 7f4ae1533700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4adc06be80 con 0x7f4adc06ff10 2023-11-28T11:57:22.083 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.077+0000 7f4ad27fc700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f4adc161560 0x7f4adc069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:46378/0 (socket says 172.21.15.39:46378) 2023-11-28T11:57:22.083 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.077+0000 7f4ad27fc700 1 -- 172.21.15.39:0/2580809187 learned_addr learned my addr 172.21.15.39:0/2580809187 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:22.083 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.077+0000 7f4adb7fe700 1 --2- 172.21.15.39:0/2580809187 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4adc06ff10 0x7f4adc070390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:22.083 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.077+0000 7f4adaffd700 1 --2- 172.21.15.39:0/2580809187 >> v2:172.21.15.184:3300/0 conn(0x7f4adc15e190 0x7f4adc0cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:22.084 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.077+0000 7f4ada7fc700 1 -- 172.21.15.39:0/2580809187 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3438657156 0 0) 0x7f4ac4001110 con 0x7f4adc161560 2023-11-28T11:57:22.084 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.077+0000 7f4ada7fc700 1 -- 172.21.15.39:0/2580809187 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ac80035d0 con 0x7f4adc161560 2023-11-28T11:57:22.084 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.077+0000 7f4adb7fe700 1 -- 172.21.15.39:0/2580809187 >> v2:172.21.15.184:3300/0 conn(0x7f4adc15e190 msgr2=0x7f4adc0cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:22.084 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.077+0000 7f4adb7fe700 1 --2- 172.21.15.39:0/2580809187 >> v2:172.21.15.184:3300/0 conn(0x7f4adc15e190 0x7f4adc0cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:22.084 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.077+0000 7f4adb7fe700 1 -- 172.21.15.39:0/2580809187 >> v1:172.21.15.39:6789/0 conn(0x7f4adc161560 legacy=0x7f4adc069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:22.084 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.081+0000 7f4adb7fe700 1 -- 172.21.15.39:0/2580809187 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4adc0ce330 con 0x7f4adc06ff10 2023-11-28T11:57:22.085 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.081+0000 7f4adb7fe700 1 --2- 172.21.15.39:0/2580809187 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4adc06ff10 0x7f4adc070390 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4009850 tx=0x7f4ad4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4f69e1e0235d57c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:22.086 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.081+0000 7f4ada7fc700 1 -- 172.21.15.39:0/2580809187 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad4011830 con 0x7f4adc06ff10 2023-11-28T11:57:22.086 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.081+0000 7f4ada7fc700 1 -- 172.21.15.39:0/2580809187 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad4011990 con 0x7f4adc06ff10 2023-11-28T11:57:22.086 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.081+0000 7f4ada7fc700 1 -- 172.21.15.39:0/2580809187 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad4011d40 con 0x7f4adc06ff10 2023-11-28T11:57:22.087 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.081+0000 7f4ae1533700 1 -- 172.21.15.39:0/2580809187 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4adc06ff10 msgr2=0x7f4adc070390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:22.087 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.081+0000 7f4ae1533700 1 --2- 172.21.15.39:0/2580809187 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4adc06ff10 0x7f4adc070390 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4009850 tx=0x7f4ad4009b60 comp rx=0 tx=0).stop 2023-11-28T11:57:22.087 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.081+0000 7f4ae1533700 1 -- 172.21.15.39:0/2580809187 shutdown_connections 2023-11-28T11:57:22.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.081+0000 7f4ae1533700 1 --2- 172.21.15.39:0/2580809187 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4adc06ff10 0x7f4adc070390 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:22.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.081+0000 7f4ae1533700 1 --2- 172.21.15.39:0/2580809187 >> v2:172.21.15.184:3300/0 conn(0x7f4adc15e190 0x7f4adc0cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:22.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.081+0000 7f4ae1533700 1 -- 172.21.15.39:0/2580809187 >> 172.21.15.39:0/2580809187 conn(0x7f4adc0cf280 msgr2=0x7f4adc0cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:22.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.081+0000 7f4ae1533700 1 -- 172.21.15.39:0/2580809187 shutdown_connections 2023-11-28T11:57:22.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.081+0000 7f4ae1533700 1 -- 172.21.15.39:0/2580809187 wait complete. 2023-11-28T11:57:22.089 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.085+0000 7f4ae1533700 1 Processor -- start 2023-11-28T11:57:22.089 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.085+0000 7f4ae1533700 1 -- start start 2023-11-28T11:57:22.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.085+0000 7f4ae1533700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4adc06ff10 0x7f4adc1549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:22.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.085+0000 7f4ae1533700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4adc15e190 0x7f4adc155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:22.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.085+0000 7f4ae1533700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4adc161560 0x7f4adc1f9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:22.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.085+0000 7f4ae1533700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4adc1628b0 con 0x7f4adc15e190 2023-11-28T11:57:22.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.085+0000 7f4ae1533700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4adc1622c0 con 0x7f4adc06ff10 2023-11-28T11:57:22.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.085+0000 7f4ae1533700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4adc154f20 con 0x7f4adc161560 2023-11-28T11:57:22.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.085+0000 7f4ad27fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4adc15e190 0x7f4adc155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:22.093 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.085+0000 7f4ad27fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4adc15e190 0x7f4adc155240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37122/0 (socket says 172.21.15.39:37122) 2023-11-28T11:57:22.093 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.085+0000 7f4ad27fc700 1 -- 172.21.15.39:0/429009033 learned_addr learned my addr 172.21.15.39:0/429009033 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:22.093 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.085+0000 7f4adb7fe700 1 --2- 172.21.15.39:0/429009033 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4adc161560 0x7f4adc1f9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:22.093 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.085+0000 7f4adaffd700 1 --2- 172.21.15.39:0/429009033 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4adc06ff10 0x7f4adc1549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:22.093 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.089+0000 7f4ad27fc700 1 -- 172.21.15.39:0/429009033 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4adc161560 msgr2=0x7f4adc1f9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:22.093 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.089+0000 7f4ad27fc700 1 --2- 172.21.15.39:0/429009033 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4adc161560 0x7f4adc1f9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:22.093 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.089+0000 7f4ad27fc700 1 -- 172.21.15.39:0/429009033 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4adc06ff10 msgr2=0x7f4adc1549e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:22.094 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.089+0000 7f4ad27fc700 1 --2- 172.21.15.39:0/429009033 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4adc06ff10 0x7f4adc1549e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:22.094 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.089+0000 7f4ad27fc700 1 -- 172.21.15.39:0/429009033 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad40094b0 con 0x7f4adc15e190 2023-11-28T11:57:22.094 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.089+0000 7f4ad27fc700 1 --2- 172.21.15.39:0/429009033 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4adc15e190 0x7f4adc155240 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4ac400c4f0 tx=0x7f4ac400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:22.094 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.089+0000 7f4ad3fff700 1 -- 172.21.15.39:0/429009033 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac4005d90 con 0x7f4adc15e190 2023-11-28T11:57:22.094 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.089+0000 7f4ad3fff700 1 -- 172.21.15.39:0/429009033 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac40070d0 con 0x7f4adc15e190 2023-11-28T11:57:22.094 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.089+0000 7f4ae1533700 1 -- 172.21.15.39:0/429009033 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4adc0afc70 con 0x7f4adc15e190 2023-11-28T11:57:22.095 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.089+0000 7f4ad3fff700 1 -- 172.21.15.39:0/429009033 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac4007480 con 0x7f4adc15e190 2023-11-28T11:57:22.095 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.089+0000 7f4ae1533700 1 -- 172.21.15.39:0/429009033 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4adc0af990 con 0x7f4adc15e190 2023-11-28T11:57:22.096 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.089+0000 7f4ae1533700 1 -- 172.21.15.39:0/429009033 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4adc0aff50 con 0x7f4adc15e190 2023-11-28T11:57:22.096 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.093+0000 7f4ad3fff700 1 -- 172.21.15.39:0/429009033 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4ac4019030 con 0x7f4adc15e190 2023-11-28T11:57:22.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.093+0000 7f4ad3fff700 1 --2- 172.21.15.39:0/429009033 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4abc064ee0 0x7f4abc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:22.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.093+0000 7f4ad3fff700 1 -- 172.21.15.39:0/429009033 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4ac40813c0 con 0x7f4adc15e190 2023-11-28T11:57:22.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.093+0000 7f4adaffd700 1 --2- 172.21.15.39:0/429009033 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4abc064ee0 0x7f4abc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:22.099 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.093+0000 7f4adaffd700 1 --2- 172.21.15.39:0/429009033 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4abc064ee0 0x7f4abc067390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4adc06b690 tx=0x7f4acc00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:22.103 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.097+0000 7f4ad3fff700 1 -- 172.21.15.39:0/429009033 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4ac404f140 con 0x7f4adc15e190 2023-11-28T11:57:22.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.269+0000 7f4ae1533700 1 -- 172.21.15.39:0/429009033 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4adc15e560 con 0x7f4adc15e190 2023-11-28T11:57:22.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.269+0000 7f4ad3fff700 1 -- 172.21.15.39:0/429009033 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4adc15e560 con 0x7f4adc15e190 2023-11-28T11:57:22.273 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-11-28T11:57:22.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.269+0000 7f4ae1533700 1 -- 172.21.15.39:0/429009033 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4abc064ee0 msgr2=0x7f4abc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:22.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.269+0000 7f4ae1533700 1 --2- 172.21.15.39:0/429009033 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4abc064ee0 0x7f4abc067390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4adc06b690 tx=0x7f4acc00b040 comp rx=0 tx=0).stop 2023-11-28T11:57:22.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.269+0000 7f4ae1533700 1 -- 172.21.15.39:0/429009033 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4adc15e190 msgr2=0x7f4adc155240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:22.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.269+0000 7f4ae1533700 1 --2- 172.21.15.39:0/429009033 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4adc15e190 0x7f4adc155240 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4ac400c4f0 tx=0x7f4ac400c800 comp rx=0 tx=0).stop 2023-11-28T11:57:22.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.269+0000 7f4ae1533700 1 -- 172.21.15.39:0/429009033 shutdown_connections 2023-11-28T11:57:22.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.269+0000 7f4ae1533700 1 --2- 172.21.15.39:0/429009033 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4adc161560 0x7f4adc1f9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:22.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.269+0000 7f4ae1533700 1 --2- 172.21.15.39:0/429009033 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4adc15e190 0x7f4adc155240 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:22.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.269+0000 7f4ae1533700 1 --2- 172.21.15.39:0/429009033 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4abc064ee0 0x7f4abc067390 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:22.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.269+0000 7f4ae1533700 1 --2- 172.21.15.39:0/429009033 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4adc06ff10 0x7f4adc1549e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:22.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.269+0000 7f4ae1533700 1 -- 172.21.15.39:0/429009033 >> 172.21.15.39:0/429009033 conn(0x7f4adc0cf280 msgr2=0x7f4adc06c210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:22.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.273+0000 7f4ae1533700 1 -- 172.21.15.39:0/429009033 shutdown_connections 2023-11-28T11:57:22.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.273+0000 7f4ae1533700 1 -- 172.21.15.39:0/429009033 wait complete. 2023-11-28T11:57:22.305 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:57:22.492 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.489+0000 7f43b6726700 1 Processor -- start 2023-11-28T11:57:22.493 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.489+0000 7f43b6726700 1 -- start start 2023-11-28T11:57:22.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.489+0000 7f43b6726700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f43b0156b60 0x7f43b00cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:22.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.489+0000 7f43b6726700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43b006b0d0 con 0x7f43b0156790 2023-11-28T11:57:22.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.489+0000 7f43b6726700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43b006b560 con 0x7f43b01605b0 2023-11-28T11:57:22.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.489+0000 7f43b6726700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43b00cc990 con 0x7f43b0156b60 2023-11-28T11:57:22.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.489+0000 7f43affff700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f43b0156790 0x7f43b015fea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:46388/0 (socket says 172.21.15.39:46388) 2023-11-28T11:57:22.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.489+0000 7f43affff700 1 -- 172.21.15.39:0/108962736 learned_addr learned my addr 172.21.15.39:0/108962736 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:22.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.489+0000 7f43af7fe700 1 --2- 172.21.15.39:0/108962736 >> v2:172.21.15.184:3300/0 conn(0x7f43b0156b60 0x7f43b00cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:22.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.493+0000 7f43aeffd700 1 -- 172.21.15.39:0/108962736 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2192062995 0 0) 0x7f43b006b0d0 con 0x7f43b0156790 2023-11-28T11:57:22.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.493+0000 7f43aeffd700 1 -- 172.21.15.39:0/108962736 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43980035d0 con 0x7f43b0156790 2023-11-28T11:57:22.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.493+0000 7f43aeffd700 1 -- 172.21.15.39:0/108962736 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 678939279 0 0) 0x7f43b006b560 con 0x7f43b01605b0 2023-11-28T11:57:22.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.493+0000 7f43aeffd700 1 -- 172.21.15.39:0/108962736 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43b006b0d0 con 0x7f43b01605b0 2023-11-28T11:57:22.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.493+0000 7f43af7fe700 1 -- 172.21.15.39:0/108962736 >> v1:172.21.15.184:6789/0 conn(0x7f43b01605b0 legacy=0x7f43b0166230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:22.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.493+0000 7f43af7fe700 1 -- 172.21.15.39:0/108962736 >> v1:172.21.15.39:6789/0 conn(0x7f43b0156790 legacy=0x7f43b015fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:22.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.493+0000 7f43af7fe700 1 -- 172.21.15.39:0/108962736 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b006a7a0 con 0x7f43b0156b60 2023-11-28T11:57:22.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.493+0000 7f43af7fe700 1 --2- 172.21.15.39:0/108962736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43b0156b60 0x7f43b00cc290 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f43a4009850 tx=0x7f43a4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdd7a118d7c8c68 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:22.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.493+0000 7f43aeffd700 1 -- 172.21.15.39:0/108962736 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a4011830 con 0x7f43b0156b60 2023-11-28T11:57:22.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.493+0000 7f43aeffd700 1 -- 172.21.15.39:0/108962736 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a4011990 con 0x7f43b0156b60 2023-11-28T11:57:22.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.493+0000 7f43aeffd700 1 -- 172.21.15.39:0/108962736 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a4011d40 con 0x7f43b0156b60 2023-11-28T11:57:22.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.493+0000 7f43b6726700 1 -- 172.21.15.39:0/108962736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43b0156b60 msgr2=0x7f43b00cc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:22.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.493+0000 7f43b6726700 1 --2- 172.21.15.39:0/108962736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43b0156b60 0x7f43b00cc290 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f43a4009850 tx=0x7f43a4009b60 comp rx=0 tx=0).stop 2023-11-28T11:57:22.500 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.493+0000 7f43b6726700 1 -- 172.21.15.39:0/108962736 shutdown_connections 2023-11-28T11:57:22.500 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.493+0000 7f43b6726700 1 --2- 172.21.15.39:0/108962736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43b0156b60 0x7f43b00cc290 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:22.500 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.493+0000 7f43b6726700 1 -- 172.21.15.39:0/108962736 >> 172.21.15.39:0/108962736 conn(0x7f43b00cf350 msgr2=0x7f43b00b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:22.500 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.493+0000 7f43b6726700 1 -- 172.21.15.39:0/108962736 shutdown_connections 2023-11-28T11:57:22.500 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.493+0000 7f43b6726700 1 -- 172.21.15.39:0/108962736 wait complete. 2023-11-28T11:57:22.501 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.497+0000 7f43b6726700 1 Processor -- start 2023-11-28T11:57:22.502 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.497+0000 7f43b6726700 1 -- start start 2023-11-28T11:57:22.505 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.497+0000 7f43b6726700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43b0156790 0x7f43b014f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:22.505 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.497+0000 7f43b6726700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43b0156b60 0x7f43b00c38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:22.505 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.497+0000 7f43b6726700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43b01605b0 0x7f43b00c1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:22.505 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.497+0000 7f43b6726700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b014f780 con 0x7f43b0156b60 2023-11-28T11:57:22.505 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.497+0000 7f43b6726700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b00c3430 con 0x7f43b01605b0 2023-11-28T11:57:22.505 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.497+0000 7f43b6726700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b00c2820 con 0x7f43b0156790 2023-11-28T11:57:22.505 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.497+0000 7f43af7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43b0156b60 0x7f43b00c38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:22.505 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.497+0000 7f43af7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43b0156b60 0x7f43b00c38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37130/0 (socket says 172.21.15.39:37130) 2023-11-28T11:57:22.505 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.497+0000 7f43af7fe700 1 -- 172.21.15.39:0/3528290067 learned_addr learned my addr 172.21.15.39:0/3528290067 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:22.505 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.497+0000 7f43affff700 1 --2- 172.21.15.39:0/3528290067 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43b0156790 0x7f43b014f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:22.505 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.497+0000 7f43b4cc3700 1 --2- 172.21.15.39:0/3528290067 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43b01605b0 0x7f43b00c1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:22.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.501+0000 7f43af7fe700 1 -- 172.21.15.39:0/3528290067 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43b0156790 msgr2=0x7f43b014f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:22.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.501+0000 7f43af7fe700 1 --2- 172.21.15.39:0/3528290067 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43b0156790 0x7f43b014f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:22.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.501+0000 7f43af7fe700 1 -- 172.21.15.39:0/3528290067 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43b01605b0 msgr2=0x7f43b00c1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:22.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.501+0000 7f43af7fe700 1 --2- 172.21.15.39:0/3528290067 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43b01605b0 0x7f43b00c1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:22.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.501+0000 7f43af7fe700 1 -- 172.21.15.39:0/3528290067 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a40094b0 con 0x7f43b0156b60 2023-11-28T11:57:22.507 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.501+0000 7f43af7fe700 1 --2- 172.21.15.39:0/3528290067 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43b0156b60 0x7f43b00c38c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f43b006f6f0 tx=0x7f43a4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:22.507 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.501+0000 7f43acff9700 1 -- 172.21.15.39:0/3528290067 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a401a990 con 0x7f43b0156b60 2023-11-28T11:57:22.507 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.501+0000 7f43acff9700 1 -- 172.21.15.39:0/3528290067 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a401f070 con 0x7f43b0156b60 2023-11-28T11:57:22.507 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.501+0000 7f43b6726700 1 -- 172.21.15.39:0/3528290067 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43b006ad60 con 0x7f43b0156b60 2023-11-28T11:57:22.507 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.501+0000 7f43acff9700 1 -- 172.21.15.39:0/3528290067 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a401ad30 con 0x7f43b0156b60 2023-11-28T11:57:22.507 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.501+0000 7f43b6726700 1 -- 172.21.15.39:0/3528290067 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43b006aa80 con 0x7f43b0156b60 2023-11-28T11:57:22.508 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.501+0000 7f43b6726700 1 -- 172.21.15.39:0/3528290067 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43b00ce000 con 0x7f43b0156b60 2023-11-28T11:57:22.509 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.505+0000 7f43acff9700 1 -- 172.21.15.39:0/3528290067 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f43a400f050 con 0x7f43b0156b60 2023-11-28T11:57:22.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.505+0000 7f43acff9700 1 --2- 172.21.15.39:0/3528290067 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f439c064ee0 0x7f439c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:22.511 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.505+0000 7f43acff9700 1 -- 172.21.15.39:0/3528290067 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f43a4083110 con 0x7f43b0156b60 2023-11-28T11:57:22.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.505+0000 7f43affff700 1 --2- 172.21.15.39:0/3528290067 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f439c064ee0 0x7f439c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:22.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.509+0000 7f43affff700 1 --2- 172.21.15.39:0/3528290067 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f439c064ee0 0x7f439c067390 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f43a0000f60 tx=0x7f43a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:22.518 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.513+0000 7f43acff9700 1 -- 172.21.15.39:0/3528290067 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f43a4050f80 con 0x7f43b0156b60 2023-11-28T11:57:22.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.701+0000 7f43b6726700 1 -- 172.21.15.39:0/3528290067 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43b00726c0 con 0x7f43b0156b60 2023-11-28T11:57:22.709 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.705+0000 7f43acff9700 1 -- 172.21.15.39:0/3528290067 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+19748 (secure 0 0 0) 0x7f43a4021090 con 0x7f43b0156b60 2023-11-28T11:57:22.709 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:57:22.709 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":31,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:57:21.927556+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:56:38.203736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:56:38.946498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:56:41.988334+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.10","mappings":[{"from":1,"to":5}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:57:22.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.709+0000 7f43b6726700 1 -- 172.21.15.39:0/3528290067 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f439c064ee0 msgr2=0x7f439c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:22.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.709+0000 7f43b6726700 1 --2- 172.21.15.39:0/3528290067 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f439c064ee0 0x7f439c067390 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f43a0000f60 tx=0x7f43a0009040 comp rx=0 tx=0).stop 2023-11-28T11:57:22.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.709+0000 7f43b6726700 1 -- 172.21.15.39:0/3528290067 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43b0156b60 msgr2=0x7f43b00c38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:22.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.709+0000 7f43b6726700 1 --2- 172.21.15.39:0/3528290067 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43b0156b60 0x7f43b00c38c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f43b006f6f0 tx=0x7f43a4004770 comp rx=0 tx=0).stop 2023-11-28T11:57:22.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.709+0000 7f43b6726700 1 -- 172.21.15.39:0/3528290067 shutdown_connections 2023-11-28T11:57:22.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.709+0000 7f43b6726700 1 --2- 172.21.15.39:0/3528290067 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f439c064ee0 0x7f439c067390 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:22.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.709+0000 7f43b6726700 1 --2- 172.21.15.39:0/3528290067 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43b01605b0 0x7f43b00c1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:22.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.709+0000 7f43b6726700 1 --2- 172.21.15.39:0/3528290067 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43b0156b60 0x7f43b00c38c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:22.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.709+0000 7f43b6726700 1 --2- 172.21.15.39:0/3528290067 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43b0156790 0x7f43b014f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:22.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.709+0000 7f43b6726700 1 -- 172.21.15.39:0/3528290067 >> 172.21.15.39:0/3528290067 conn(0x7f43b00cf350 msgr2=0x7f43b015da50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:22.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.709+0000 7f43b6726700 1 -- 172.21.15.39:0/3528290067 shutdown_connections 2023-11-28T11:57:22.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.709+0000 7f43b6726700 1 -- 172.21.15.39:0/3528290067 wait complete. 2023-11-28T11:57:22.738 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:56:26.631457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:56:33.242202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:56:38.203736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:56:38.946498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T11:56:41.988334+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T11:57:22.739 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:57:22.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.917+0000 7fadd359e700 1 Processor -- start 2023-11-28T11:57:22.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.917+0000 7fadd359e700 1 -- start start 2023-11-28T11:57:22.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.921+0000 7fadd359e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fadd4070a90 0x7fadd40c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:22.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.921+0000 7fadd359e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fadd415a9f0 0x7fadd406b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:22.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.921+0000 7fadd359e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd4070600 con 0x7fadd4159f10 2023-11-28T11:57:22.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.921+0000 7fadd359e700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd406b840 con 0x7fadd4070a90 2023-11-28T11:57:22.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.921+0000 7fadd359e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd415ae10 con 0x7fadd415a9f0 2023-11-28T11:57:22.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.921+0000 7fadd1d9b700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fadd4070a90 0x7fadd40c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:22.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.921+0000 7fadd1d9b700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fadd4070a90 0x7fadd40c8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37134/0 (socket says 172.21.15.39:37134) 2023-11-28T11:57:22.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.921+0000 7fadd1d9b700 1 -- 172.21.15.39:0/3736681588 learned_addr learned my addr 172.21.15.39:0/3736681588 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:22.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.921+0000 7fadd2d9d700 1 --2- 172.21.15.39:0/3736681588 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fadd415a9f0 0x7fadd406b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:22.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.921+0000 7fadd1d9b700 1 -- 172.21.15.39:0/3736681588 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fadd415a9f0 msgr2=0x7fadd406b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:22.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.921+0000 7fadd1d9b700 1 --2- 172.21.15.39:0/3736681588 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fadd415a9f0 0x7fadd406b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:22.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.921+0000 7fadd1d9b700 1 -- 172.21.15.39:0/3736681588 >> v1:172.21.15.184:6789/0 conn(0x7fadd4159f10 legacy=0x7fadd415a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:22.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.921+0000 7fadd1d9b700 1 -- 172.21.15.39:0/3736681588 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd40afcc0 con 0x7fadd4070a90 2023-11-28T11:57:22.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.921+0000 7fadd1d9b700 1 --2- 172.21.15.39:0/3736681588 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fadd4070a90 0x7fadd40c8c90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fadc8009910 tx=0x7fadc8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c8846991ba98cb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:22.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.921+0000 7fadd159a700 1 -- 172.21.15.39:0/3736681588 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc8011830 con 0x7fadd4070a90 2023-11-28T11:57:22.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.921+0000 7fadd159a700 1 -- 172.21.15.39:0/3736681588 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc8011990 con 0x7fadd4070a90 2023-11-28T11:57:22.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.921+0000 7fadd159a700 1 -- 172.21.15.39:0/3736681588 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc8011d40 con 0x7fadd4070a90 2023-11-28T11:57:22.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.925+0000 7fadd359e700 1 -- 172.21.15.39:0/3736681588 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fadd4070a90 msgr2=0x7fadd40c8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:22.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.925+0000 7fadd359e700 1 --2- 172.21.15.39:0/3736681588 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fadd4070a90 0x7fadd40c8c90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fadc8009910 tx=0x7fadc8009c20 comp rx=0 tx=0).stop 2023-11-28T11:57:22.929 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.925+0000 7fadd359e700 1 -- 172.21.15.39:0/3736681588 shutdown_connections 2023-11-28T11:57:22.929 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.925+0000 7fadd359e700 1 --2- 172.21.15.39:0/3736681588 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fadd415a9f0 0x7fadd406b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:22.929 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.925+0000 7fadd359e700 1 --2- 172.21.15.39:0/3736681588 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fadd4070a90 0x7fadd40c8c90 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:22.929 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.925+0000 7fadd359e700 1 -- 172.21.15.39:0/3736681588 >> 172.21.15.39:0/3736681588 conn(0x7fadd40cf280 msgr2=0x7fadd40cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:22.929 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.925+0000 7fadd359e700 1 -- 172.21.15.39:0/3736681588 shutdown_connections 2023-11-28T11:57:22.930 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.925+0000 7fadd359e700 1 -- 172.21.15.39:0/3736681588 wait complete. 2023-11-28T11:57:22.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.929+0000 7fadd359e700 1 Processor -- start 2023-11-28T11:57:22.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.929+0000 7fadd359e700 1 -- start start 2023-11-28T11:57:22.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.929+0000 7fadd359e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fadd4070a90 0x7fadd41ef040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:22.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.929+0000 7fadd359e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fadd4159f10 0x7fadd40b3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:22.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.929+0000 7fadd359e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fadd415a9f0 0x7fadd415c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:22.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.929+0000 7fadd359e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd41ef580 con 0x7fadd4159f10 2023-11-28T11:57:22.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.929+0000 7fadd359e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd40b3bc0 con 0x7fadd4070a90 2023-11-28T11:57:22.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.929+0000 7fadd359e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd4153400 con 0x7fadd415a9f0 2023-11-28T11:57:22.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.929+0000 7fadd1d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fadd4159f10 0x7fadd40b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:22.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.929+0000 7fadd1d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fadd4159f10 0x7fadd40b3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37150/0 (socket says 172.21.15.39:37150) 2023-11-28T11:57:22.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.929+0000 7fadd1d9b700 1 -- 172.21.15.39:0/1947571330 learned_addr learned my addr 172.21.15.39:0/1947571330 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:22.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.929+0000 7fadd2d9d700 1 --2- 172.21.15.39:0/1947571330 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fadd415a9f0 0x7fadd415c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:22.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.929+0000 7fadd259c700 1 --2- 172.21.15.39:0/1947571330 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fadd4070a90 0x7fadd41ef040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:22.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.929+0000 7fadd1d9b700 1 -- 172.21.15.39:0/1947571330 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fadd415a9f0 msgr2=0x7fadd415c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:22.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.929+0000 7fadd1d9b700 1 --2- 172.21.15.39:0/1947571330 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fadd415a9f0 0x7fadd415c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:22.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.929+0000 7fadd1d9b700 1 -- 172.21.15.39:0/1947571330 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fadd4070a90 msgr2=0x7fadd41ef040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:22.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.929+0000 7fadd1d9b700 1 --2- 172.21.15.39:0/1947571330 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fadd4070a90 0x7fadd41ef040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:22.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.929+0000 7fadd1d9b700 1 -- 172.21.15.39:0/1947571330 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc8009570 con 0x7fadd4159f10 2023-11-28T11:57:22.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.929+0000 7fadd259c700 1 --2- 172.21.15.39:0/1947571330 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fadd4070a90 0x7fadd41ef040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:57:22.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.929+0000 7fadd2d9d700 1 --2- 172.21.15.39:0/1947571330 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fadd415a9f0 0x7fadd415c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:57:22.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.929+0000 7fadd1d9b700 1 --2- 172.21.15.39:0/1947571330 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fadd4159f10 0x7fadd40b3270 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fadc8000c00 tx=0x7fadc8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:22.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.933+0000 7fadc2ffd700 1 -- 172.21.15.39:0/1947571330 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc8004610 con 0x7fadd4159f10 2023-11-28T11:57:22.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.933+0000 7fadc2ffd700 1 -- 172.21.15.39:0/1947571330 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc80036c0 con 0x7fadd4159f10 2023-11-28T11:57:22.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.933+0000 7fadc2ffd700 1 -- 172.21.15.39:0/1947571330 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc8003a50 con 0x7fadd4159f10 2023-11-28T11:57:22.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.933+0000 7fadd359e700 1 -- 172.21.15.39:0/1947571330 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd4070290 con 0x7fadd4159f10 2023-11-28T11:57:22.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.933+0000 7fadd359e700 1 -- 172.21.15.39:0/1947571330 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd406ffb0 con 0x7fadd4159f10 2023-11-28T11:57:22.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.933+0000 7fadd359e700 1 -- 172.21.15.39:0/1947571330 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd40affa0 con 0x7fadd4159f10 2023-11-28T11:57:22.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.933+0000 7fadc2ffd700 1 -- 172.21.15.39:0/1947571330 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fadc802d070 con 0x7fadd4159f10 2023-11-28T11:57:22.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.937+0000 7fadc2ffd700 1 --2- 172.21.15.39:0/1947571330 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fadb4064f10 0x7fadb40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:22.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.937+0000 7fadc2ffd700 1 -- 172.21.15.39:0/1947571330 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fadc8021030 con 0x7fadd4159f10 2023-11-28T11:57:22.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.937+0000 7fadd259c700 1 --2- 172.21.15.39:0/1947571330 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fadb4064f10 0x7fadb40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:22.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.937+0000 7fadd259c700 1 --2- 172.21.15.39:0/1947571330 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fadb4064f10 0x7fadb40673c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fadc4000f60 tx=0x7fadc4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:22.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:22.941+0000 7fadc2ffd700 1 -- 172.21.15.39:0/1947571330 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fadc8051750 con 0x7fadd4159f10 2023-11-28T11:57:23.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.113+0000 7fadd359e700 1 -- 172.21.15.39:0/1947571330 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fadd406cf30 con 0x7fadd4159f10 2023-11-28T11:57:23.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.113+0000 7fadc2ffd700 1 -- 172.21.15.39:0/1947571330 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7fadc80150a0 con 0x7fadd4159f10 2023-11-28T11:57:23.117 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-11-28T11:57:23.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.117+0000 7fadd359e700 1 -- 172.21.15.39:0/1947571330 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fadb4064f10 msgr2=0x7fadb40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:23.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.117+0000 7fadd359e700 1 --2- 172.21.15.39:0/1947571330 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fadb4064f10 0x7fadb40673c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fadc4000f60 tx=0x7fadc4009040 comp rx=0 tx=0).stop 2023-11-28T11:57:23.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.117+0000 7fadd359e700 1 -- 172.21.15.39:0/1947571330 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fadd4159f10 msgr2=0x7fadd40b3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:23.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.117+0000 7fadd359e700 1 --2- 172.21.15.39:0/1947571330 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fadd4159f10 0x7fadd40b3270 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fadc8000c00 tx=0x7fadc8004770 comp rx=0 tx=0).stop 2023-11-28T11:57:23.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.117+0000 7fadd359e700 1 -- 172.21.15.39:0/1947571330 shutdown_connections 2023-11-28T11:57:23.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.117+0000 7fadd359e700 1 --2- 172.21.15.39:0/1947571330 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fadd415a9f0 0x7fadd415c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.117+0000 7fadd359e700 1 --2- 172.21.15.39:0/1947571330 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fadd4159f10 0x7fadd40b3270 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.117+0000 7fadd359e700 1 --2- 172.21.15.39:0/1947571330 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fadb4064f10 0x7fadb40673c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.117+0000 7fadd359e700 1 --2- 172.21.15.39:0/1947571330 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fadd4070a90 0x7fadd41ef040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.117+0000 7fadd359e700 1 -- 172.21.15.39:0/1947571330 >> 172.21.15.39:0/1947571330 conn(0x7fadd40cf280 msgr2=0x7fadd40cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:23.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.117+0000 7fadd359e700 1 -- 172.21.15.39:0/1947571330 shutdown_connections 2023-11-28T11:57:23.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.117+0000 7fadd359e700 1 -- 172.21.15.39:0/1947571330 wait complete. 2023-11-28T11:57:23.145 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:57:23.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.329+0000 7f464bbcb700 1 Processor -- start 2023-11-28T11:57:23.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.329+0000 7f464bbcb700 1 -- start start 2023-11-28T11:57:23.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.329+0000 7f464bbcb700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f464406c2b0 0x7f4644165080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:23.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.329+0000 7f464bbcb700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f464406c680 0x7f46440adfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:23.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.329+0000 7f464bbcb700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f464406afb0 con 0x7f46440aed60 2023-11-28T11:57:23.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.329+0000 7f464bbcb700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46440ca750 con 0x7f464406c680 2023-11-28T11:57:23.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.329+0000 7f464bbcb700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f464406b290 con 0x7f464406c2b0 2023-11-28T11:57:23.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.333+0000 7f4649967700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f464406c2b0 0x7f4644165080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:23.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.333+0000 7f4649967700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f464406c2b0 0x7f4644165080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:45668/0 (socket says 172.21.15.39:45668) 2023-11-28T11:57:23.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.333+0000 7f4649967700 1 -- 172.21.15.39:0/3973169003 learned_addr learned my addr 172.21.15.39:0/3973169003 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:23.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.333+0000 7f464a168700 1 --2- 172.21.15.39:0/3973169003 >> v2:172.21.15.184:3300/0 conn(0x7f464406c680 0x7f46440adfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:23.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.333+0000 7f4649967700 1 -- 172.21.15.39:0/3973169003 >> v2:172.21.15.184:3300/0 conn(0x7f464406c680 msgr2=0x7f46440adfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:23.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.333+0000 7f4649967700 1 --2- 172.21.15.39:0/3973169003 >> v2:172.21.15.184:3300/0 conn(0x7f464406c680 0x7f46440adfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.333+0000 7f4649967700 1 -- 172.21.15.39:0/3973169003 >> v1:172.21.15.184:6789/0 conn(0x7f46440aed60 legacy=0x7f46441639d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:23.338 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.333+0000 7f4649967700 1 -- 172.21.15.39:0/3973169003 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46440c8f40 con 0x7f464406c2b0 2023-11-28T11:57:23.338 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.333+0000 7f4648965700 1 -- 172.21.15.39:0/3973169003 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 252976973 0 0) 0x7f464406afb0 con 0x7f46440aed60 2023-11-28T11:57:23.338 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.333+0000 7f4649967700 1 --2- 172.21.15.39:0/3973169003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f464406c2b0 0x7f4644165080 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4640009910 tx=0x7f4640009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4847a3e98d997da server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:23.339 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.333+0000 7f4648965700 1 -- 172.21.15.39:0/3973169003 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4640011830 con 0x7f464406c2b0 2023-11-28T11:57:23.339 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.333+0000 7f4648965700 1 -- 172.21.15.39:0/3973169003 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4640011990 con 0x7f464406c2b0 2023-11-28T11:57:23.339 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.333+0000 7f4648965700 1 -- 172.21.15.39:0/3973169003 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4640011d40 con 0x7f464406c2b0 2023-11-28T11:57:23.339 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.333+0000 7f464bbcb700 1 -- 172.21.15.39:0/3973169003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f464406c2b0 msgr2=0x7f4644165080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:23.339 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.333+0000 7f464bbcb700 1 --2- 172.21.15.39:0/3973169003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f464406c2b0 0x7f4644165080 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4640009910 tx=0x7f4640009c20 comp rx=0 tx=0).stop 2023-11-28T11:57:23.340 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.333+0000 7f464bbcb700 1 -- 172.21.15.39:0/3973169003 shutdown_connections 2023-11-28T11:57:23.340 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.333+0000 7f464bbcb700 1 --2- 172.21.15.39:0/3973169003 >> v2:172.21.15.184:3300/0 conn(0x7f464406c680 0x7f46440adfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.340 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.333+0000 7f464bbcb700 1 --2- 172.21.15.39:0/3973169003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f464406c2b0 0x7f4644165080 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.340 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.333+0000 7f464bbcb700 1 -- 172.21.15.39:0/3973169003 >> 172.21.15.39:0/3973169003 conn(0x7f46440cf580 msgr2=0x7f46440cb370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:23.340 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.337+0000 7f464bbcb700 1 -- 172.21.15.39:0/3973169003 shutdown_connections 2023-11-28T11:57:23.340 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.337+0000 7f464bbcb700 1 -- 172.21.15.39:0/3973169003 wait complete. 2023-11-28T11:57:23.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.337+0000 7f464bbcb700 1 Processor -- start 2023-11-28T11:57:23.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.337+0000 7f464bbcb700 1 -- start start 2023-11-28T11:57:23.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.341+0000 7f464bbcb700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f464406c2b0 0x7f464414cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:23.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.341+0000 7f464bbcb700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f464406c680 0x7f46440af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:23.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.341+0000 7f464bbcb700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46440aed60 0x7f46440af720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:23.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.341+0000 7f464bbcb700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464414fda0 con 0x7f46440aed60 2023-11-28T11:57:23.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.341+0000 7f464bbcb700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46441fa020 con 0x7f464406c2b0 2023-11-28T11:57:23.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.341+0000 7f464bbcb700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f464414f400 con 0x7f464406c680 2023-11-28T11:57:23.346 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.341+0000 7f464a168700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46440aed60 0x7f46440af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:23.346 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.341+0000 7f464a168700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46440aed60 0x7f46440af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37166/0 (socket says 172.21.15.39:37166) 2023-11-28T11:57:23.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.341+0000 7f464a168700 1 -- 172.21.15.39:0/672278575 learned_addr learned my addr 172.21.15.39:0/672278575 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:23.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.341+0000 7f4649967700 1 --2- 172.21.15.39:0/672278575 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f464406c2b0 0x7f464414cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:23.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.341+0000 7f4649166700 1 --2- 172.21.15.39:0/672278575 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f464406c680 0x7f46440af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:23.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.341+0000 7f464a168700 1 -- 172.21.15.39:0/672278575 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f464406c680 msgr2=0x7f46440af1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:23.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.341+0000 7f464a168700 1 --2- 172.21.15.39:0/672278575 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f464406c680 0x7f46440af1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.341+0000 7f464a168700 1 -- 172.21.15.39:0/672278575 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f464406c2b0 msgr2=0x7f464414cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:23.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.341+0000 7f464a168700 1 --2- 172.21.15.39:0/672278575 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f464406c2b0 0x7f464414cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.341+0000 7f464a168700 1 -- 172.21.15.39:0/672278575 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4640009570 con 0x7f46440aed60 2023-11-28T11:57:23.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.341+0000 7f4649166700 1 --2- 172.21.15.39:0/672278575 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f464406c680 0x7f46440af1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:57:23.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.341+0000 7f464a168700 1 --2- 172.21.15.39:0/672278575 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46440aed60 0x7f46440af720 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f463c00efc0 tx=0x7f463c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:23.348 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.341+0000 7f463a7fc700 1 -- 172.21.15.39:0/672278575 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463c009ea0 con 0x7f46440aed60 2023-11-28T11:57:23.348 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.341+0000 7f463a7fc700 1 -- 172.21.15.39:0/672278575 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463c00f040 con 0x7f46440aed60 2023-11-28T11:57:23.348 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.341+0000 7f463a7fc700 1 -- 172.21.15.39:0/672278575 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463c014480 con 0x7f46440aed60 2023-11-28T11:57:23.348 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.341+0000 7f464bbcb700 1 -- 172.21.15.39:0/672278575 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46440ad800 con 0x7f46440aed60 2023-11-28T11:57:23.348 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.341+0000 7f464bbcb700 1 -- 172.21.15.39:0/672278575 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46440c9220 con 0x7f46440aed60 2023-11-28T11:57:23.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.345+0000 7f464bbcb700 1 -- 172.21.15.39:0/672278575 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46441640e0 con 0x7f46440aed60 2023-11-28T11:57:23.351 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.345+0000 7f463a7fc700 1 -- 172.21.15.39:0/672278575 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f463c0145e0 con 0x7f46440aed60 2023-11-28T11:57:23.352 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.349+0000 7f463a7fc700 1 --2- 172.21.15.39:0/672278575 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4628064f10 0x7f46280673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:23.352 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.349+0000 7f463a7fc700 1 -- 172.21.15.39:0/672278575 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f463c082b80 con 0x7f46440aed60 2023-11-28T11:57:23.353 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.349+0000 7f4649967700 1 --2- 172.21.15.39:0/672278575 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4628064f10 0x7f46280673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:23.354 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.349+0000 7f4649967700 1 --2- 172.21.15.39:0/672278575 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4628064f10 0x7f46280673c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4640000c00 tx=0x7f4640008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:23.357 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.353+0000 7f463a7fc700 1 -- 172.21.15.39:0/672278575 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f463c0509f0 con 0x7f46440aed60 2023-11-28T11:57:23.535 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.529+0000 7f464bbcb700 1 -- 172.21.15.39:0/672278575 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f46440726c0 con 0x7f46440aed60 2023-11-28T11:57:23.536 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.533+0000 7f463a7fc700 1 -- 172.21.15.39:0/672278575 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f463c054010 con 0x7f46440aed60 2023-11-28T11:57:23.536 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-11-28T11:57:23.539 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.533+0000 7f464bbcb700 1 -- 172.21.15.39:0/672278575 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4628064f10 msgr2=0x7f46280673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:23.539 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.533+0000 7f464bbcb700 1 --2- 172.21.15.39:0/672278575 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4628064f10 0x7f46280673c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4640000c00 tx=0x7f4640008030 comp rx=0 tx=0).stop 2023-11-28T11:57:23.539 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.533+0000 7f464bbcb700 1 -- 172.21.15.39:0/672278575 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46440aed60 msgr2=0x7f46440af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:23.540 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.533+0000 7f464bbcb700 1 --2- 172.21.15.39:0/672278575 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46440aed60 0x7f46440af720 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f463c00efc0 tx=0x7f463c00c3a0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.540 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.533+0000 7f464bbcb700 1 -- 172.21.15.39:0/672278575 shutdown_connections 2023-11-28T11:57:23.540 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.533+0000 7f464bbcb700 1 --2- 172.21.15.39:0/672278575 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46440aed60 0x7f46440af720 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.540 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.533+0000 7f464bbcb700 1 --2- 172.21.15.39:0/672278575 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f464406c680 0x7f46440af1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.540 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.533+0000 7f464bbcb700 1 --2- 172.21.15.39:0/672278575 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4628064f10 0x7f46280673c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.540 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.533+0000 7f464bbcb700 1 --2- 172.21.15.39:0/672278575 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f464406c2b0 0x7f464414cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.540 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.533+0000 7f464bbcb700 1 -- 172.21.15.39:0/672278575 >> 172.21.15.39:0/672278575 conn(0x7f46440cf580 msgr2=0x7f46441623a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:23.541 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.533+0000 7f464bbcb700 1 -- 172.21.15.39:0/672278575 shutdown_connections 2023-11-28T11:57:23.541 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.533+0000 7f464bbcb700 1 -- 172.21.15.39:0/672278575 wait complete. 2023-11-28T11:57:23.563 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:57:23.747 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.741+0000 7fba8ead5700 1 Processor -- start 2023-11-28T11:57:23.747 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.741+0000 7fba8ead5700 1 -- start start 2023-11-28T11:57:23.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.741+0000 7fba8ead5700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba8815c150 0x7fba880b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:23.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.741+0000 7fba8ead5700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fba8806ff10 0x7fba88070360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:23.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.745+0000 7fba8ead5700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba8815c520 con 0x7fba8815fc30 2023-11-28T11:57:23.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.745+0000 7fba8ead5700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba880b4240 con 0x7fba8806ff10 2023-11-28T11:57:23.751 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.745+0000 7fba8ead5700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba880708a0 con 0x7fba8815c150 2023-11-28T11:57:23.751 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.745+0000 7fba8d2d2700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fba8806ff10 0x7fba88070360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:23.751 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.745+0000 7fba8d2d2700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fba8806ff10 0x7fba88070360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:60018/0 (socket says 172.21.15.39:60018) 2023-11-28T11:57:23.751 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.745+0000 7fba8dad3700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba8815c150 0x7fba880b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:23.751 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.745+0000 7fba8d2d2700 1 -- 172.21.15.39:0/234253230 learned_addr learned my addr 172.21.15.39:0/234253230 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:23.755 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.745+0000 7fba8d2d2700 1 -- 172.21.15.39:0/234253230 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba8815c150 msgr2=0x7fba880b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:23.755 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.745+0000 7fba8d2d2700 1 --2- 172.21.15.39:0/234253230 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba8815c150 0x7fba880b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.755 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.745+0000 7fba8d2d2700 1 -- 172.21.15.39:0/234253230 >> v1:172.21.15.184:6789/0 conn(0x7fba8815fc30 legacy=0x7fba881600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:23.755 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.745+0000 7fba8d2d2700 1 -- 172.21.15.39:0/234253230 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba8806ac00 con 0x7fba8806ff10 2023-11-28T11:57:23.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.745+0000 7fba8d2d2700 1 --2- 172.21.15.39:0/234253230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba8806ff10 0x7fba88070360 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fba78009910 tx=0x7fba78009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e861b43d2b7d1122 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:23.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.745+0000 7fba8cad1700 1 -- 172.21.15.39:0/234253230 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba78005e50 con 0x7fba8806ff10 2023-11-28T11:57:23.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.745+0000 7fba8cad1700 1 -- 172.21.15.39:0/234253230 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba78006030 con 0x7fba8806ff10 2023-11-28T11:57:23.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.745+0000 7fba8cad1700 1 -- 172.21.15.39:0/234253230 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba780063e0 con 0x7fba8806ff10 2023-11-28T11:57:23.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.749+0000 7fba8ead5700 1 -- 172.21.15.39:0/234253230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba8806ff10 msgr2=0x7fba88070360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:23.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.749+0000 7fba8ead5700 1 --2- 172.21.15.39:0/234253230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba8806ff10 0x7fba88070360 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fba78009910 tx=0x7fba78009c20 comp rx=0 tx=0).stop 2023-11-28T11:57:23.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.749+0000 7fba8ead5700 1 -- 172.21.15.39:0/234253230 shutdown_connections 2023-11-28T11:57:23.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.749+0000 7fba8ead5700 1 --2- 172.21.15.39:0/234253230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba8806ff10 0x7fba88070360 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.749+0000 7fba8ead5700 1 --2- 172.21.15.39:0/234253230 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba8815c150 0x7fba880b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.749+0000 7fba8ead5700 1 -- 172.21.15.39:0/234253230 >> 172.21.15.39:0/234253230 conn(0x7fba880d3680 msgr2=0x7fba880cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:23.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.749+0000 7fba8ead5700 1 -- 172.21.15.39:0/234253230 shutdown_connections 2023-11-28T11:57:23.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.749+0000 7fba8ead5700 1 -- 172.21.15.39:0/234253230 wait complete. 2023-11-28T11:57:23.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.749+0000 7fba8ead5700 1 Processor -- start 2023-11-28T11:57:23.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.749+0000 7fba8ead5700 1 -- start start 2023-11-28T11:57:23.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.749+0000 7fba8ead5700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba8806ff10 0x7fba8815ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:23.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.749+0000 7fba8ead5700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba8815c150 0x7fba8815a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:23.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.753+0000 7fba8ead5700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba8815fc30 0x7fba8815ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:23.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.753+0000 7fba8ead5700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba880b7120 con 0x7fba8806ff10 2023-11-28T11:57:23.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.753+0000 7fba8ead5700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba880b7400 con 0x7fba8815c150 2023-11-28T11:57:23.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.753+0000 7fba8ead5700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba880b76e0 con 0x7fba8815fc30 2023-11-28T11:57:23.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.753+0000 7fba8dad3700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba8806ff10 0x7fba8815ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:23.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.753+0000 7fba8dad3700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba8806ff10 0x7fba8815ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37174/0 (socket says 172.21.15.39:37174) 2023-11-28T11:57:23.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.753+0000 7fba8dad3700 1 -- 172.21.15.39:0/2740196431 learned_addr learned my addr 172.21.15.39:0/2740196431 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:23.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.753+0000 7fba8d2d2700 1 --2- 172.21.15.39:0/2740196431 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba8815c150 0x7fba8815a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:23.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.753+0000 7fba8e2d4700 1 --2- 172.21.15.39:0/2740196431 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba8815fc30 0x7fba8815ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:23.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.753+0000 7fba8dad3700 1 -- 172.21.15.39:0/2740196431 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba8815fc30 msgr2=0x7fba8815ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:23.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.753+0000 7fba8dad3700 1 --2- 172.21.15.39:0/2740196431 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba8815fc30 0x7fba8815ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.753+0000 7fba8dad3700 1 -- 172.21.15.39:0/2740196431 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba8815c150 msgr2=0x7fba8815a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:23.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.753+0000 7fba8dad3700 1 --2- 172.21.15.39:0/2740196431 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba8815c150 0x7fba8815a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.753+0000 7fba8dad3700 1 -- 172.21.15.39:0/2740196431 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba78009520 con 0x7fba8806ff10 2023-11-28T11:57:23.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.753+0000 7fba8dad3700 1 --2- 172.21.15.39:0/2740196431 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba8806ff10 0x7fba8815ef40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fba8400e9d0 tx=0x7fba8400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:23.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.753+0000 7fba7e7fc700 1 -- 172.21.15.39:0/2740196431 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba84009720 con 0x7fba8806ff10 2023-11-28T11:57:23.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.753+0000 7fba7e7fc700 1 -- 172.21.15.39:0/2740196431 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8400c850 con 0x7fba8806ff10 2023-11-28T11:57:23.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.753+0000 7fba8ead5700 1 -- 172.21.15.39:0/2740196431 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba880d2450 con 0x7fba8806ff10 2023-11-28T11:57:23.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.753+0000 7fba7e7fc700 1 -- 172.21.15.39:0/2740196431 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8400cbc0 con 0x7fba8806ff10 2023-11-28T11:57:23.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.753+0000 7fba8ead5700 1 -- 172.21.15.39:0/2740196431 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba8806cc50 con 0x7fba8806ff10 2023-11-28T11:57:23.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.757+0000 7fba8ead5700 1 -- 172.21.15.39:0/2740196431 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba880d2730 con 0x7fba8806ff10 2023-11-28T11:57:23.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.757+0000 7fba7e7fc700 1 -- 172.21.15.39:0/2740196431 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fba84019030 con 0x7fba8806ff10 2023-11-28T11:57:23.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.761+0000 7fba7e7fc700 1 --2- 172.21.15.39:0/2740196431 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fba6c064ee0 0x7fba6c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:23.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.761+0000 7fba7e7fc700 1 -- 172.21.15.39:0/2740196431 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fba84082210 con 0x7fba8806ff10 2023-11-28T11:57:23.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.761+0000 7fba8d2d2700 1 --2- 172.21.15.39:0/2740196431 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fba6c064ee0 0x7fba6c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:23.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.761+0000 7fba8d2d2700 1 --2- 172.21.15.39:0/2740196431 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fba6c064ee0 0x7fba6c067390 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fba78006000 tx=0x7fba78008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:23.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.765+0000 7fba7e7fc700 1 -- 172.21.15.39:0/2740196431 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fba8404ff90 con 0x7fba8806ff10 2023-11-28T11:57:23.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.937+0000 7fba8ead5700 1 -- 172.21.15.39:0/2740196431 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fba8815f4e0 con 0x7fba8806ff10 2023-11-28T11:57:23.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.937+0000 7fba7e7fc700 1 -- 172.21.15.39:0/2740196431 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7fba840535b0 con 0x7fba8806ff10 2023-11-28T11:57:23.943 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-11-28T11:57:23.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.941+0000 7fba8ead5700 1 -- 172.21.15.39:0/2740196431 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fba6c064ee0 msgr2=0x7fba6c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:23.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.941+0000 7fba8ead5700 1 --2- 172.21.15.39:0/2740196431 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fba6c064ee0 0x7fba6c067390 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fba78006000 tx=0x7fba78008070 comp rx=0 tx=0).stop 2023-11-28T11:57:23.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.941+0000 7fba8ead5700 1 -- 172.21.15.39:0/2740196431 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba8806ff10 msgr2=0x7fba8815ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:23.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.941+0000 7fba8ead5700 1 --2- 172.21.15.39:0/2740196431 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba8806ff10 0x7fba8815ef40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fba8400e9d0 tx=0x7fba8400ece0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.941+0000 7fba8ead5700 1 -- 172.21.15.39:0/2740196431 shutdown_connections 2023-11-28T11:57:23.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.941+0000 7fba8ead5700 1 --2- 172.21.15.39:0/2740196431 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba8815fc30 0x7fba8815ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.941+0000 7fba8ead5700 1 --2- 172.21.15.39:0/2740196431 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fba6c064ee0 0x7fba6c067390 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.941+0000 7fba8ead5700 1 --2- 172.21.15.39:0/2740196431 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba8815c150 0x7fba8815a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.941+0000 7fba8ead5700 1 --2- 172.21.15.39:0/2740196431 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba8806ff10 0x7fba8815ef40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.941+0000 7fba8ead5700 1 -- 172.21.15.39:0/2740196431 >> 172.21.15.39:0/2740196431 conn(0x7fba880d3680 msgr2=0x7fba88158f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:23.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.941+0000 7fba8ead5700 1 -- 172.21.15.39:0/2740196431 shutdown_connections 2023-11-28T11:57:23.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:23.941+0000 7fba8ead5700 1 -- 172.21.15.39:0/2740196431 wait complete. 2023-11-28T11:57:23.972 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:57:24.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.149+0000 7f725f19a700 1 Processor -- start 2023-11-28T11:57:24.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.149+0000 7f725f19a700 1 -- start start 2023-11-28T11:57:24.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.149+0000 7f725f19a700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7258159f10 0x7f7258070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.149+0000 7f725f19a700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f72580c8c90 0x7f725806b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.149+0000 7f725f19a700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7258070600 con 0x7f725815a2e0 2023-11-28T11:57:24.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.149+0000 7f725f19a700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72580c9130 con 0x7f7258159f10 2023-11-28T11:57:24.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.149+0000 7f725f19a700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f725806b840 con 0x7f72580c8c90 2023-11-28T11:57:24.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.149+0000 7f725e198700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7258159f10 0x7f7258070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.149+0000 7f725e198700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7258159f10 0x7f7258070a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37178/0 (socket says 172.21.15.39:37178) 2023-11-28T11:57:24.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.149+0000 7f725e198700 1 -- 172.21.15.39:0/2856137580 learned_addr learned my addr 172.21.15.39:0/2856137580 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:24.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.149+0000 7f725d997700 1 --2- 172.21.15.39:0/2856137580 >> v2:172.21.15.184:3300/0 conn(0x7f72580c8c90 0x7f725806b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.153+0000 7f725e198700 1 -- 172.21.15.39:0/2856137580 >> v2:172.21.15.184:3300/0 conn(0x7f72580c8c90 msgr2=0x7f725806b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:24.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.153+0000 7f725e198700 1 --2- 172.21.15.39:0/2856137580 >> v2:172.21.15.184:3300/0 conn(0x7f72580c8c90 0x7f725806b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.153+0000 7f725e198700 1 -- 172.21.15.39:0/2856137580 >> v1:172.21.15.184:6789/0 conn(0x7f725815a2e0 legacy=0x7f725815a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:24.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.153+0000 7f725d196700 1 -- 172.21.15.39:0/2856137580 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1092971403 0 0) 0x7f7258070600 con 0x7f725815a2e0 2023-11-28T11:57:24.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.153+0000 7f725e198700 1 -- 172.21.15.39:0/2856137580 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f725815adf0 con 0x7f7258159f10 2023-11-28T11:57:24.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.153+0000 7f725e198700 1 --2- 172.21.15.39:0/2856137580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7258159f10 0x7f7258070a90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f72580c93e0 tx=0x7f7254009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1735d3e2c0fcc214 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:24.158 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.153+0000 7f725d196700 1 -- 172.21.15.39:0/2856137580 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7254011830 con 0x7f7258159f10 2023-11-28T11:57:24.158 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.153+0000 7f725d196700 1 -- 172.21.15.39:0/2856137580 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7254011990 con 0x7f7258159f10 2023-11-28T11:57:24.158 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.153+0000 7f725d196700 1 -- 172.21.15.39:0/2856137580 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7254011d20 con 0x7f7258159f10 2023-11-28T11:57:24.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.153+0000 7f725f19a700 1 -- 172.21.15.39:0/2856137580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7258159f10 msgr2=0x7f7258070a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:24.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.153+0000 7f725f19a700 1 --2- 172.21.15.39:0/2856137580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7258159f10 0x7f7258070a90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f72580c93e0 tx=0x7f7254009bf0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.153+0000 7f725f19a700 1 -- 172.21.15.39:0/2856137580 shutdown_connections 2023-11-28T11:57:24.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.153+0000 7f725f19a700 1 --2- 172.21.15.39:0/2856137580 >> v2:172.21.15.184:3300/0 conn(0x7f72580c8c90 0x7f725806b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.153+0000 7f725f19a700 1 --2- 172.21.15.39:0/2856137580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7258159f10 0x7f7258070a90 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.153+0000 7f725f19a700 1 -- 172.21.15.39:0/2856137580 >> 172.21.15.39:0/2856137580 conn(0x7f72580cf280 msgr2=0x7f72580cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:24.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.153+0000 7f725f19a700 1 -- 172.21.15.39:0/2856137580 shutdown_connections 2023-11-28T11:57:24.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.157+0000 7f725f19a700 1 -- 172.21.15.39:0/2856137580 wait complete. 2023-11-28T11:57:24.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.161+0000 7f725f19a700 1 Processor -- start 2023-11-28T11:57:24.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.161+0000 7f725f19a700 1 -- start start 2023-11-28T11:57:24.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.161+0000 7f725f19a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72580c8c90 0x7f72580b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.161+0000 7f725f19a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7258159f10 0x7f72581553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.161+0000 7f725f19a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f725815a2e0 0x7f72580c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.161+0000 7f725f19a700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72580c5c60 con 0x7f7258159f10 2023-11-28T11:57:24.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.161+0000 7f725f19a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72580b4630 con 0x7f72580c8c90 2023-11-28T11:57:24.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.161+0000 7f725f19a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72580b4070 con 0x7f725815a2e0 2023-11-28T11:57:24.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.161+0000 7f725d997700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7258159f10 0x7f72581553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.161+0000 7f725d997700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7258159f10 0x7f72581553a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37186/0 (socket says 172.21.15.39:37186) 2023-11-28T11:57:24.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.161+0000 7f725d997700 1 -- 172.21.15.39:0/2222994884 learned_addr learned my addr 172.21.15.39:0/2222994884 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:24.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.161+0000 7f725e198700 1 --2- 172.21.15.39:0/2222994884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72580c8c90 0x7f72580b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.161+0000 7f725e999700 1 --2- 172.21.15.39:0/2222994884 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f725815a2e0 0x7f72580c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.161+0000 7f725d997700 1 -- 172.21.15.39:0/2222994884 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f725815a2e0 msgr2=0x7f72580c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:24.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.161+0000 7f725d997700 1 --2- 172.21.15.39:0/2222994884 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f725815a2e0 0x7f72580c7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.161+0000 7f725d997700 1 -- 172.21.15.39:0/2222994884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72580c8c90 msgr2=0x7f72580b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:24.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.161+0000 7f725d997700 1 --2- 172.21.15.39:0/2222994884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72580c8c90 0x7f72580b3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.161+0000 7f725d997700 1 -- 172.21.15.39:0/2222994884 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7254009570 con 0x7f7258159f10 2023-11-28T11:57:24.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.161+0000 7f725d997700 1 --2- 172.21.15.39:0/2222994884 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7258159f10 0x7f72581553a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f724800e9d0 tx=0x7f724800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:24.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.165+0000 7f724effd700 1 -- 172.21.15.39:0/2222994884 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7248009720 con 0x7f7258159f10 2023-11-28T11:57:24.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.165+0000 7f724effd700 1 -- 172.21.15.39:0/2222994884 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724800ee70 con 0x7f7258159f10 2023-11-28T11:57:24.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.165+0000 7f725f19a700 1 -- 172.21.15.39:0/2222994884 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f725806ffb0 con 0x7f7258159f10 2023-11-28T11:57:24.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.165+0000 7f724effd700 1 -- 172.21.15.39:0/2222994884 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724800ca50 con 0x7f7258159f10 2023-11-28T11:57:24.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.165+0000 7f725f19a700 1 -- 172.21.15.39:0/2222994884 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72580afcc0 con 0x7f7258159f10 2023-11-28T11:57:24.170 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.165+0000 7f725f19a700 1 -- 172.21.15.39:0/2222994884 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7258070290 con 0x7f7258159f10 2023-11-28T11:57:24.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.169+0000 7f724effd700 1 -- 172.21.15.39:0/2222994884 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7248019030 con 0x7f7258159f10 2023-11-28T11:57:24.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.169+0000 7f724effd700 1 --2- 172.21.15.39:0/2222994884 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f723c064ee0 0x7f723c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.176 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.169+0000 7f724effd700 1 -- 172.21.15.39:0/2222994884 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7248082160 con 0x7f7258159f10 2023-11-28T11:57:24.176 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.169+0000 7f725e198700 1 --2- 172.21.15.39:0/2222994884 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f723c064ee0 0x7f723c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.177 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.173+0000 7f725e198700 1 --2- 172.21.15.39:0/2222994884 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f723c064ee0 0x7f723c067390 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7254000c00 tx=0x7f7254008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:24.181 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.177+0000 7f724effd700 1 -- 172.21.15.39:0/2222994884 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f724804fee0 con 0x7f7258159f10 2023-11-28T11:57:24.353 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.349+0000 7f725f19a700 1 -- 172.21.15.39:0/2222994884 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f725806cf30 con 0x7f7258159f10 2023-11-28T11:57:24.354 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.349+0000 7f724effd700 1 -- 172.21.15.39:0/2222994884 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7248053500 con 0x7f7258159f10 2023-11-28T11:57:24.354 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2023-11-28T11:57:24.357 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.353+0000 7f725f19a700 1 -- 172.21.15.39:0/2222994884 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f723c064ee0 msgr2=0x7f723c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:24.357 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.353+0000 7f725f19a700 1 --2- 172.21.15.39:0/2222994884 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f723c064ee0 0x7f723c067390 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7254000c00 tx=0x7f7254008030 comp rx=0 tx=0).stop 2023-11-28T11:57:24.357 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.353+0000 7f725f19a700 1 -- 172.21.15.39:0/2222994884 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7258159f10 msgr2=0x7f72581553a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:24.357 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.353+0000 7f725f19a700 1 --2- 172.21.15.39:0/2222994884 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7258159f10 0x7f72581553a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f724800e9d0 tx=0x7f724800ece0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.357 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.353+0000 7f725f19a700 1 -- 172.21.15.39:0/2222994884 shutdown_connections 2023-11-28T11:57:24.357 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.353+0000 7f725f19a700 1 --2- 172.21.15.39:0/2222994884 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f725815a2e0 0x7f72580c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.358 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.353+0000 7f725f19a700 1 --2- 172.21.15.39:0/2222994884 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7258159f10 0x7f72581553a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.358 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.353+0000 7f725f19a700 1 --2- 172.21.15.39:0/2222994884 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f723c064ee0 0x7f723c067390 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.358 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.353+0000 7f725f19a700 1 --2- 172.21.15.39:0/2222994884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72580c8c90 0x7f72580b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.358 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.353+0000 7f725f19a700 1 -- 172.21.15.39:0/2222994884 >> 172.21.15.39:0/2222994884 conn(0x7f72580cf280 msgr2=0x7f72580c36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:24.358 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.353+0000 7f725f19a700 1 -- 172.21.15.39:0/2222994884 shutdown_connections 2023-11-28T11:57:24.358 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.353+0000 7f725f19a700 1 -- 172.21.15.39:0/2222994884 wait complete. 2023-11-28T11:57:24.379 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T11:57:24.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.565+0000 7facc9f77700 1 Processor -- start 2023-11-28T11:57:24.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.565+0000 7facc9f77700 1 -- start start 2023-11-28T11:57:24.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.569+0000 7facc9f77700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7facc40b1950 0x7facc40cd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.569+0000 7facc9f77700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7facc40cd8d0 0x7facc406b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.569+0000 7facc9f77700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facc415cde0 con 0x7facc4159320 2023-11-28T11:57:24.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.569+0000 7facc9f77700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facc40af040 con 0x7facc40b1950 2023-11-28T11:57:24.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.569+0000 7facc9f77700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facc40ca7f0 con 0x7facc40cd8d0 2023-11-28T11:57:24.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.569+0000 7facbbfff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7facc40b1950 0x7facc40cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.569+0000 7facbbfff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7facc40b1950 0x7facc40cd390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37202/0 (socket says 172.21.15.39:37202) 2023-11-28T11:57:24.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.569+0000 7facbbfff700 1 -- 172.21.15.39:0/1610843700 learned_addr learned my addr 172.21.15.39:0/1610843700 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:24.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.569+0000 7facc9776700 1 --2- 172.21.15.39:0/1610843700 >> v2:172.21.15.184:3300/0 conn(0x7facc40cd8d0 0x7facc406b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.569+0000 7facbbfff700 1 -- 172.21.15.39:0/1610843700 >> v2:172.21.15.184:3300/0 conn(0x7facc40cd8d0 msgr2=0x7facc406b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:24.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.569+0000 7facbbfff700 1 --2- 172.21.15.39:0/1610843700 >> v2:172.21.15.184:3300/0 conn(0x7facc40cd8d0 0x7facc406b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.569+0000 7facbbfff700 1 -- 172.21.15.39:0/1610843700 >> v1:172.21.15.184:6789/0 conn(0x7facc4159320 legacy=0x7facc40b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:24.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.569+0000 7facbbfff700 1 -- 172.21.15.39:0/1610843700 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc41596f0 con 0x7facc40b1950 2023-11-28T11:57:24.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.569+0000 7facbbfff700 1 --2- 172.21.15.39:0/1610843700 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7facc40b1950 0x7facc40cd390 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7facc40cf770 tx=0x7facb4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9667efcea9ee716 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:24.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.569+0000 7facbb7fe700 1 -- 172.21.15.39:0/1610843700 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb400f8a0 con 0x7facc40b1950 2023-11-28T11:57:24.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.569+0000 7facbb7fe700 1 -- 172.21.15.39:0/1610843700 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb400fa00 con 0x7facc40b1950 2023-11-28T11:57:24.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.569+0000 7facbb7fe700 1 -- 172.21.15.39:0/1610843700 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb400fd90 con 0x7facc40b1950 2023-11-28T11:57:24.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.573+0000 7facc9f77700 1 -- 172.21.15.39:0/1610843700 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7facc40b1950 msgr2=0x7facc40cd390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:24.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.573+0000 7facc9f77700 1 --2- 172.21.15.39:0/1610843700 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7facc40b1950 0x7facc40cd390 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7facc40cf770 tx=0x7facb4009bf0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.573+0000 7facc9f77700 1 -- 172.21.15.39:0/1610843700 shutdown_connections 2023-11-28T11:57:24.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.573+0000 7facc9f77700 1 --2- 172.21.15.39:0/1610843700 >> v2:172.21.15.184:3300/0 conn(0x7facc40cd8d0 0x7facc406b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.573+0000 7facc9f77700 1 --2- 172.21.15.39:0/1610843700 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7facc40b1950 0x7facc40cd390 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.573+0000 7facc9f77700 1 -- 172.21.15.39:0/1610843700 >> 172.21.15.39:0/1610843700 conn(0x7facc40cc240 msgr2=0x7facc40cc610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:24.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.573+0000 7facc9f77700 1 -- 172.21.15.39:0/1610843700 shutdown_connections 2023-11-28T11:57:24.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.573+0000 7facc9f77700 1 -- 172.21.15.39:0/1610843700 wait complete. 2023-11-28T11:57:24.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.577+0000 7facc9f77700 1 Processor -- start 2023-11-28T11:57:24.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.577+0000 7facc9f77700 1 -- start start 2023-11-28T11:57:24.583 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.577+0000 7facc9f77700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7facc40b1950 0x7facc40ac270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.583 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.577+0000 7facc9f77700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7facc40cd8d0 0x7facc40adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.583 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.577+0000 7facc9f77700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7facc4159320 0x7facc4148cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.577+0000 7facc9f77700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc40ac7b0 con 0x7facc40b1950 2023-11-28T11:57:24.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.577+0000 7facc9f77700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc40ae390 con 0x7facc40cd8d0 2023-11-28T11:57:24.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.577+0000 7facc9f77700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc40ae110 con 0x7facc4159320 2023-11-28T11:57:24.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.577+0000 7facc8f75700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7facc40b1950 0x7facc40ac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.577+0000 7facc8f75700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7facc40b1950 0x7facc40ac270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37210/0 (socket says 172.21.15.39:37210) 2023-11-28T11:57:24.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.577+0000 7facc8f75700 1 -- 172.21.15.39:0/3602454250 learned_addr learned my addr 172.21.15.39:0/3602454250 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:24.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.577+0000 7facc9776700 1 --2- 172.21.15.39:0/3602454250 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7facc4159320 0x7facc4148cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.577+0000 7facbbfff700 1 --2- 172.21.15.39:0/3602454250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7facc40cd8d0 0x7facc40adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.585 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.577+0000 7facc8f75700 1 -- 172.21.15.39:0/3602454250 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7facc4159320 msgr2=0x7facc4148cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:24.585 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.577+0000 7facc8f75700 1 --2- 172.21.15.39:0/3602454250 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7facc4159320 0x7facc4148cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.585 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.577+0000 7facc8f75700 1 -- 172.21.15.39:0/3602454250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7facc40cd8d0 msgr2=0x7facc40adbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:24.586 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.577+0000 7facc8f75700 1 --2- 172.21.15.39:0/3602454250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7facc40cd8d0 0x7facc40adbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.586 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.577+0000 7facc8f75700 1 -- 172.21.15.39:0/3602454250 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb4009570 con 0x7facc40b1950 2023-11-28T11:57:24.586 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.577+0000 7facbbfff700 1 --2- 172.21.15.39:0/3602454250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7facc40cd8d0 0x7facc40adbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:57:24.586 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.581+0000 7facc8f75700 1 --2- 172.21.15.39:0/3602454250 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7facc40b1950 0x7facc40ac270 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7facc000c410 tx=0x7facc000c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:24.586 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.581+0000 7facb97fa700 1 -- 172.21.15.39:0/3602454250 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc00052d0 con 0x7facc40b1950 2023-11-28T11:57:24.586 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.581+0000 7facb97fa700 1 -- 172.21.15.39:0/3602454250 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc0005430 con 0x7facc40b1950 2023-11-28T11:57:24.586 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.581+0000 7facc9f77700 1 -- 172.21.15.39:0/3602454250 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facc415d030 con 0x7facc40b1950 2023-11-28T11:57:24.586 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.581+0000 7facb97fa700 1 -- 172.21.15.39:0/3602454250 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc00055a0 con 0x7facc40b1950 2023-11-28T11:57:24.586 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.581+0000 7facc9f77700 1 -- 172.21.15.39:0/3602454250 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facc40cdcd0 con 0x7facc40b1950 2023-11-28T11:57:24.587 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.581+0000 7facc9f77700 1 -- 172.21.15.39:0/3602454250 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facc415d310 con 0x7facc40b1950 2023-11-28T11:57:24.588 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.585+0000 7facb97fa700 1 -- 172.21.15.39:0/3602454250 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7facc0010050 con 0x7facc40b1950 2023-11-28T11:57:24.590 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.585+0000 7facb97fa700 1 --2- 172.21.15.39:0/3602454250 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7facb0064ee0 0x7facb0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.590 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.585+0000 7facb97fa700 1 -- 172.21.15.39:0/3602454250 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7facc0081410 con 0x7facc40b1950 2023-11-28T11:57:24.590 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.585+0000 7facbbfff700 1 --2- 172.21.15.39:0/3602454250 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7facb0064ee0 0x7facb0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.592 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.589+0000 7facbbfff700 1 --2- 172.21.15.39:0/3602454250 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7facb0064ee0 0x7facb0067390 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7facb4000c00 tx=0x7facb4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:24.597 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.593+0000 7facb97fa700 1 -- 172.21.15.39:0/3602454250 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7facc0049400 con 0x7facc40b1950 2023-11-28T11:57:24.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.769+0000 7facc9f77700 1 -- 172.21.15.39:0/3602454250 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7facc4073d20 con 0x7facc40b1950 2023-11-28T11:57:24.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.769+0000 7facb97fa700 1 -- 172.21.15.39:0/3602454250 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7facc004f130 con 0x7facc40b1950 2023-11-28T11:57:24.775 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-11-28T11:57:24.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.773+0000 7facc9f77700 1 -- 172.21.15.39:0/3602454250 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7facb0064ee0 msgr2=0x7facb0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:24.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.773+0000 7facc9f77700 1 --2- 172.21.15.39:0/3602454250 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7facb0064ee0 0x7facb0067390 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7facb4000c00 tx=0x7facb4008030 comp rx=0 tx=0).stop 2023-11-28T11:57:24.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.773+0000 7facc9f77700 1 -- 172.21.15.39:0/3602454250 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7facc40b1950 msgr2=0x7facc40ac270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:24.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.773+0000 7facc9f77700 1 --2- 172.21.15.39:0/3602454250 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7facc40b1950 0x7facc40ac270 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7facc000c410 tx=0x7facc000c7d0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.773+0000 7facc9f77700 1 -- 172.21.15.39:0/3602454250 shutdown_connections 2023-11-28T11:57:24.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.773+0000 7facc9f77700 1 --2- 172.21.15.39:0/3602454250 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7facc4159320 0x7facc4148cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.773+0000 7facc9f77700 1 --2- 172.21.15.39:0/3602454250 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7facb0064ee0 0x7facb0067390 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.773+0000 7facc9f77700 1 --2- 172.21.15.39:0/3602454250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7facc40cd8d0 0x7facc40adbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.773+0000 7facc9f77700 1 --2- 172.21.15.39:0/3602454250 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7facc40b1950 0x7facc40ac270 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.773+0000 7facc9f77700 1 -- 172.21.15.39:0/3602454250 >> 172.21.15.39:0/3602454250 conn(0x7facc40cc240 msgr2=0x7facc406a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:24.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.773+0000 7facc9f77700 1 -- 172.21.15.39:0/3602454250 shutdown_connections 2023-11-28T11:57:24.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.773+0000 7facc9f77700 1 -- 172.21.15.39:0/3602454250 wait complete. 2023-11-28T11:57:24.800 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:57:24.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.977+0000 7f1d2e298700 1 Processor -- start 2023-11-28T11:57:24.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.977+0000 7f1d2e298700 1 -- start start 2023-11-28T11:57:24.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.981+0000 7f1d2e298700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1d28069e00 0x7f1d2806a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.981+0000 7f1d2e298700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d2806c600 con 0x7f1d2815c640 2023-11-28T11:57:24.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.981+0000 7f1d2e298700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d280722f0 con 0x7f1d28071aa0 2023-11-28T11:57:24.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.981+0000 7f1d2e298700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d2806cef0 con 0x7f1d28069e00 2023-11-28T11:57:24.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.981+0000 7f1d2d296700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f1d2815c640 0x7f1d280d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:46404/0 (socket says 172.21.15.39:46404) 2023-11-28T11:57:24.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.981+0000 7f1d2d296700 1 -- 172.21.15.39:0/524613548 learned_addr learned my addr 172.21.15.39:0/524613548 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:24.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.981+0000 7f1d2ca95700 1 --1- 172.21.15.39:0/524613548 >> v1:172.21.15.184:6789/0 conn(0x7f1d28071aa0 0x7f1d2806d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:46068/0 (socket says 172.21.15.39:46068) 2023-11-28T11:57:24.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.981+0000 7f1d2da97700 1 --2- 172.21.15.39:0/524613548 >> v2:172.21.15.184:3300/0 conn(0x7f1d28069e00 0x7f1d2806a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.981+0000 7f1d2da97700 1 -- 172.21.15.39:0/524613548 >> v1:172.21.15.184:6789/0 conn(0x7f1d28071aa0 legacy=0x7f1d2806d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:24.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.981+0000 7f1d2da97700 1 -- 172.21.15.39:0/524613548 >> v1:172.21.15.39:6789/0 conn(0x7f1d2815c640 legacy=0x7f1d280d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:24.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.981+0000 7f1d2da97700 1 -- 172.21.15.39:0/524613548 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d2806da20 con 0x7f1d28069e00 2023-11-28T11:57:24.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.985+0000 7f1d2da97700 1 --2- 172.21.15.39:0/524613548 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d28069e00 0x7f1d2806a280 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1d20009d90 tx=0x7f1d2000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6479d969657b42a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:24.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.985+0000 7f1d1ffff700 1 -- 172.21.15.39:0/524613548 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2000e070 con 0x7f1d28069e00 2023-11-28T11:57:24.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.985+0000 7f1d1ffff700 1 -- 172.21.15.39:0/524613548 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2000bbd0 con 0x7f1d28069e00 2023-11-28T11:57:24.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.985+0000 7f1d1ffff700 1 -- 172.21.15.39:0/524613548 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d20012430 con 0x7f1d28069e00 2023-11-28T11:57:24.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.985+0000 7f1d2e298700 1 -- 172.21.15.39:0/524613548 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d28069e00 msgr2=0x7f1d2806a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:24.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.985+0000 7f1d2e298700 1 --2- 172.21.15.39:0/524613548 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d28069e00 0x7f1d2806a280 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1d20009d90 tx=0x7f1d2000b330 comp rx=0 tx=0).stop 2023-11-28T11:57:24.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.985+0000 7f1d2e298700 1 -- 172.21.15.39:0/524613548 shutdown_connections 2023-11-28T11:57:24.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.985+0000 7f1d2e298700 1 --2- 172.21.15.39:0/524613548 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d28069e00 0x7f1d2806a280 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.985+0000 7f1d2e298700 1 -- 172.21.15.39:0/524613548 >> 172.21.15.39:0/524613548 conn(0x7f1d280b6520 msgr2=0x7f1d28071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:24.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.985+0000 7f1d2e298700 1 -- 172.21.15.39:0/524613548 shutdown_connections 2023-11-28T11:57:24.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.985+0000 7f1d2e298700 1 -- 172.21.15.39:0/524613548 wait complete. 2023-11-28T11:57:24.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.989+0000 7f1d2e298700 1 Processor -- start 2023-11-28T11:57:24.994 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.989+0000 7f1d2e298700 1 -- start start 2023-11-28T11:57:24.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.989+0000 7f1d2e298700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d28069e00 0x7f1d2815f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.989+0000 7f1d2e298700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d28071aa0 0x7f1d2809b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.989+0000 7f1d2e298700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d2815c640 0x7f1d280b26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.989+0000 7f1d2e298700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d280d38f0 con 0x7f1d28069e00 2023-11-28T11:57:24.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.989+0000 7f1d2e298700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d280c9a80 con 0x7f1d2815c640 2023-11-28T11:57:24.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.989+0000 7f1d2e298700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2815fa60 con 0x7f1d28071aa0 2023-11-28T11:57:24.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.989+0000 7f1d2d296700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d28069e00 0x7f1d2815f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.989+0000 7f1d2d296700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d28069e00 0x7f1d2815f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37214/0 (socket says 172.21.15.39:37214) 2023-11-28T11:57:24.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.989+0000 7f1d2d296700 1 -- 172.21.15.39:0/3120742332 learned_addr learned my addr 172.21.15.39:0/3120742332 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:24.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.989+0000 7f1d2ca95700 1 --2- 172.21.15.39:0/3120742332 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d28071aa0 0x7f1d2809b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.989+0000 7f1d2da97700 1 --2- 172.21.15.39:0/3120742332 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d2815c640 0x7f1d280b26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.993+0000 7f1d2d296700 1 -- 172.21.15.39:0/3120742332 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d28071aa0 msgr2=0x7f1d2809b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:24.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.993+0000 7f1d2d296700 1 --2- 172.21.15.39:0/3120742332 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d28071aa0 0x7f1d2809b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.993+0000 7f1d2d296700 1 -- 172.21.15.39:0/3120742332 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d2815c640 msgr2=0x7f1d280b26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:24.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.993+0000 7f1d2d296700 1 --2- 172.21.15.39:0/3120742332 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d2815c640 0x7f1d280b26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.993+0000 7f1d2d296700 1 -- 172.21.15.39:0/3120742332 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d20009a70 con 0x7f1d28069e00 2023-11-28T11:57:24.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.993+0000 7f1d2d296700 1 --2- 172.21.15.39:0/3120742332 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d28069e00 0x7f1d2815f520 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1d2400c700 tx=0x7f1d2400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:24.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.993+0000 7f1d1dffb700 1 -- 172.21.15.39:0/3120742332 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d24005d90 con 0x7f1d28069e00 2023-11-28T11:57:24.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.993+0000 7f1d1dffb700 1 -- 172.21.15.39:0/3120742332 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d240070d0 con 0x7f1d28069e00 2023-11-28T11:57:24.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.993+0000 7f1d1dffb700 1 -- 172.21.15.39:0/3120742332 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d24007440 con 0x7f1d28069e00 2023-11-28T11:57:24.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.993+0000 7f1d2e298700 1 -- 172.21.15.39:0/3120742332 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d28072010 con 0x7f1d28069e00 2023-11-28T11:57:24.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.993+0000 7f1d2e298700 1 -- 172.21.15.39:0/3120742332 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d2815ca10 con 0x7f1d28069e00 2023-11-28T11:57:24.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.993+0000 7f1d2e298700 1 -- 172.21.15.39:0/3120742332 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d2806c830 con 0x7f1d28069e00 2023-11-28T11:57:25.000 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.993+0000 7f1d1dffb700 1 -- 172.21.15.39:0/3120742332 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1d24019030 con 0x7f1d28069e00 2023-11-28T11:57:25.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.997+0000 7f1d1dffb700 1 --2- 172.21.15.39:0/3120742332 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1d0c064ee0 0x7f1d0c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:25.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.997+0000 7f1d1dffb700 1 -- 172.21.15.39:0/3120742332 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1d240812b0 con 0x7f1d28069e00 2023-11-28T11:57:25.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.997+0000 7f1d2ca95700 1 --2- 172.21.15.39:0/3120742332 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1d0c064ee0 0x7f1d0c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:25.003 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:24.997+0000 7f1d2ca95700 1 --2- 172.21.15.39:0/3120742332 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1d0c064ee0 0x7f1d0c067390 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1d280b21b0 tx=0x7f1d18007ef0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:25.007 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.001+0000 7f1d1dffb700 1 -- 172.21.15.39:0/3120742332 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1d2404a400 con 0x7f1d28069e00 2023-11-28T11:57:25.186 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.181+0000 7f1d2e298700 1 -- 172.21.15.39:0/3120742332 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d28073cb0 con 0x7f1d28069e00 2023-11-28T11:57:25.190 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.185+0000 7f1d1dffb700 1 -- 172.21.15.39:0/3120742332 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+19748 (secure 0 0 0) 0x7f1d2404f1d0 con 0x7f1d28069e00 2023-11-28T11:57:25.190 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:57:25.191 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":31,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:57:21.927556+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:56:38.203736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:56:38.946498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:56:41.988334+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.10","mappings":[{"from":1,"to":5}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:57:25.193 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.189+0000 7f1d2e298700 1 -- 172.21.15.39:0/3120742332 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1d0c064ee0 msgr2=0x7f1d0c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:25.193 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.189+0000 7f1d2e298700 1 --2- 172.21.15.39:0/3120742332 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1d0c064ee0 0x7f1d0c067390 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1d280b21b0 tx=0x7f1d18007ef0 comp rx=0 tx=0).stop 2023-11-28T11:57:25.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.189+0000 7f1d2e298700 1 -- 172.21.15.39:0/3120742332 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d28069e00 msgr2=0x7f1d2815f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:25.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.189+0000 7f1d2e298700 1 --2- 172.21.15.39:0/3120742332 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d28069e00 0x7f1d2815f520 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1d2400c700 tx=0x7f1d2400ca10 comp rx=0 tx=0).stop 2023-11-28T11:57:25.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.189+0000 7f1d2e298700 1 -- 172.21.15.39:0/3120742332 shutdown_connections 2023-11-28T11:57:25.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.189+0000 7f1d2e298700 1 --2- 172.21.15.39:0/3120742332 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1d0c064ee0 0x7f1d0c067390 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:25.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.189+0000 7f1d2e298700 1 --2- 172.21.15.39:0/3120742332 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d2815c640 0x7f1d280b26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:25.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.189+0000 7f1d2e298700 1 --2- 172.21.15.39:0/3120742332 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d28071aa0 0x7f1d2809b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:25.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.189+0000 7f1d2e298700 1 --2- 172.21.15.39:0/3120742332 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d28069e00 0x7f1d2815f520 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:25.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.189+0000 7f1d2e298700 1 -- 172.21.15.39:0/3120742332 >> 172.21.15.39:0/3120742332 conn(0x7f1d280b6520 msgr2=0x7f1d280b4460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:25.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.189+0000 7f1d2e298700 1 -- 172.21.15.39:0/3120742332 shutdown_connections 2023-11-28T11:57:25.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.189+0000 7f1d2e298700 1 -- 172.21.15.39:0/3120742332 wait complete. 2023-11-28T11:57:25.216 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:56:26.631457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:56:33.242202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:56:38.203736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:56:38.946498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T11:56:41.988334+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T11:57:25.216 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:57:25.414 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.409+0000 7fb3be9d2700 1 Processor -- start 2023-11-28T11:57:25.414 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.409+0000 7fb3be9d2700 1 -- start start 2023-11-28T11:57:25.417 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.413+0000 7fb3be9d2700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb3b80b4280 0x7fb3b80aef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:25.417 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.413+0000 7fb3be9d2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3b80adb20 0x7fb3b80af480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:25.417 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.413+0000 7fb3be9d2700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3b806c040 con 0x7fb3b806ae10 2023-11-28T11:57:25.417 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.413+0000 7fb3be9d2700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3b815a920 con 0x7fb3b80b4280 2023-11-28T11:57:25.417 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.413+0000 7fb3be9d2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b815eac0 con 0x7fb3b80adb20 2023-11-28T11:57:25.417 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.413+0000 7fb3b7fff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb3b80b4280 0x7fb3b80aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:25.418 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.413+0000 7fb3b77fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3b80adb20 0x7fb3b80af480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:25.418 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.413+0000 7fb3bcf6f700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fb3b806ae10 0x7fb3b8069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:46420/0 (socket says 172.21.15.39:46420) 2023-11-28T11:57:25.418 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.413+0000 7fb3bcf6f700 1 -- 172.21.15.39:0/4118118739 learned_addr learned my addr 172.21.15.39:0/4118118739 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:25.418 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.413+0000 7fb3b7fff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb3b80b4280 0x7fb3b80aef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37230/0 (socket says 172.21.15.39:37230) 2023-11-28T11:57:25.418 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.413+0000 7fb3b7fff700 1 -- 172.21.15.39:0/4118118739 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3b80adb20 msgr2=0x7fb3b80af480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:25.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.413+0000 7fb3b7fff700 1 --2- 172.21.15.39:0/4118118739 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3b80adb20 0x7fb3b80af480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:25.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.413+0000 7fb3b7fff700 1 -- 172.21.15.39:0/4118118739 >> v1:172.21.15.39:6789/0 conn(0x7fb3b806ae10 legacy=0x7fb3b8069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:25.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.413+0000 7fb3b7fff700 1 -- 172.21.15.39:0/4118118739 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b806d4e0 con 0x7fb3b80b4280 2023-11-28T11:57:25.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.413+0000 7fb3b6ffd700 1 -- 172.21.15.39:0/4118118739 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3504113355 0 0) 0x7fb3b806c040 con 0x7fb3b806ae10 2023-11-28T11:57:25.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.413+0000 7fb3b7fff700 1 --2- 172.21.15.39:0/4118118739 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3b80b4280 0x7fb3b80aef40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8009850 tx=0x7fb3a8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9633ea027bc351d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:25.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.413+0000 7fb3b6ffd700 1 -- 172.21.15.39:0/4118118739 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a8011830 con 0x7fb3b80b4280 2023-11-28T11:57:25.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.413+0000 7fb3b6ffd700 1 -- 172.21.15.39:0/4118118739 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3a8011990 con 0x7fb3b80b4280 2023-11-28T11:57:25.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.413+0000 7fb3b6ffd700 1 -- 172.21.15.39:0/4118118739 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a8011d40 con 0x7fb3b80b4280 2023-11-28T11:57:25.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.413+0000 7fb3be9d2700 1 -- 172.21.15.39:0/4118118739 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3b80b4280 msgr2=0x7fb3b80aef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:25.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.413+0000 7fb3be9d2700 1 --2- 172.21.15.39:0/4118118739 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3b80b4280 0x7fb3b80aef40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8009850 tx=0x7fb3a8009b60 comp rx=0 tx=0).stop 2023-11-28T11:57:25.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.417+0000 7fb3be9d2700 1 -- 172.21.15.39:0/4118118739 shutdown_connections 2023-11-28T11:57:25.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.417+0000 7fb3be9d2700 1 --2- 172.21.15.39:0/4118118739 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3b80adb20 0x7fb3b80af480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:25.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.417+0000 7fb3be9d2700 1 --2- 172.21.15.39:0/4118118739 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3b80b4280 0x7fb3b80aef40 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:25.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.417+0000 7fb3be9d2700 1 -- 172.21.15.39:0/4118118739 >> 172.21.15.39:0/4118118739 conn(0x7fb3b80cf580 msgr2=0x7fb3b80cb370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:25.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.417+0000 7fb3be9d2700 1 -- 172.21.15.39:0/4118118739 shutdown_connections 2023-11-28T11:57:25.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.417+0000 7fb3be9d2700 1 -- 172.21.15.39:0/4118118739 wait complete. 2023-11-28T11:57:25.423 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.417+0000 7fb3be9d2700 1 Processor -- start 2023-11-28T11:57:25.424 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.421+0000 7fb3be9d2700 1 -- start start 2023-11-28T11:57:25.426 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.421+0000 7fb3be9d2700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3b806ae10 0x7fb3b80ab860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:25.426 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.421+0000 7fb3be9d2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3b80adb20 0x7fb3b8158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:25.426 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.421+0000 7fb3be9d2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3b80b4280 0x7fb3b80ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:25.426 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.421+0000 7fb3be9d2700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b80aca70 con 0x7fb3b806ae10 2023-11-28T11:57:25.426 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.421+0000 7fb3be9d2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b80c7080 con 0x7fb3b80adb20 2023-11-28T11:57:25.427 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.421+0000 7fb3be9d2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b80caf30 con 0x7fb3b80b4280 2023-11-28T11:57:25.427 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.421+0000 7fb3b7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3b806ae10 0x7fb3b80ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:25.427 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.421+0000 7fb3b7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3b806ae10 0x7fb3b80ab860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37242/0 (socket says 172.21.15.39:37242) 2023-11-28T11:57:25.427 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.421+0000 7fb3b7fff700 1 -- 172.21.15.39:0/3684464572 learned_addr learned my addr 172.21.15.39:0/3684464572 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:25.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.421+0000 7fb3b7fff700 1 -- 172.21.15.39:0/3684464572 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3b80b4280 msgr2=0x7fb3b80ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:25.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.421+0000 7fb3b7fff700 1 --2- 172.21.15.39:0/3684464572 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3b80b4280 0x7fb3b80ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:25.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.421+0000 7fb3b7fff700 1 -- 172.21.15.39:0/3684464572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3b80adb20 msgr2=0x7fb3b8158950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:25.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.421+0000 7fb3b7fff700 1 --2- 172.21.15.39:0/3684464572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3b80adb20 0x7fb3b8158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:25.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.421+0000 7fb3b7fff700 1 -- 172.21.15.39:0/3684464572 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a80094b0 con 0x7fb3b806ae10 2023-11-28T11:57:25.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.421+0000 7fb3b7fff700 1 --2- 172.21.15.39:0/3684464572 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3b806ae10 0x7fb3b80ab860 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8014040 tx=0x7fb3a8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:25.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.421+0000 7fb3b4ff9700 1 -- 172.21.15.39:0/3684464572 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a8019ba0 con 0x7fb3b806ae10 2023-11-28T11:57:25.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.421+0000 7fb3b4ff9700 1 -- 172.21.15.39:0/3684464572 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3a801e070 con 0x7fb3b806ae10 2023-11-28T11:57:25.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.421+0000 7fb3be9d2700 1 -- 172.21.15.39:0/3684464572 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3b815ed60 con 0x7fb3b806ae10 2023-11-28T11:57:25.429 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.421+0000 7fb3b4ff9700 1 -- 172.21.15.39:0/3684464572 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a801a420 con 0x7fb3b806ae10 2023-11-28T11:57:25.429 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.421+0000 7fb3be9d2700 1 -- 172.21.15.39:0/3684464572 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3b80b4650 con 0x7fb3b806ae10 2023-11-28T11:57:25.429 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.425+0000 7fb3be9d2700 1 -- 172.21.15.39:0/3684464572 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3b80b1350 con 0x7fb3b806ae10 2023-11-28T11:57:25.432 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.425+0000 7fb3b4ff9700 1 -- 172.21.15.39:0/3684464572 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb3a800f050 con 0x7fb3b806ae10 2023-11-28T11:57:25.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.429+0000 7fb3b4ff9700 1 --2- 172.21.15.39:0/3684464572 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb3a4064ee0 0x7fb3a4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:25.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.429+0000 7fb3b4ff9700 1 -- 172.21.15.39:0/3684464572 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb3a8083300 con 0x7fb3b806ae10 2023-11-28T11:57:25.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.429+0000 7fb3b77fe700 1 --2- 172.21.15.39:0/3684464572 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb3a4064ee0 0x7fb3a4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:25.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.429+0000 7fb3b77fe700 1 --2- 172.21.15.39:0/3684464572 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb3a4064ee0 0x7fb3a4067390 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac006b40 tx=0x7fb3ac006ad0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:25.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.437+0000 7fb3b4ff9700 1 -- 172.21.15.39:0/3684464572 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb3a8051170 con 0x7fb3b806ae10 2023-11-28T11:57:25.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.605+0000 7fb3be9d2700 1 -- 172.21.15.39:0/3684464572 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb3b80c7290 con 0x7fb3b806ae10 2023-11-28T11:57:25.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.605+0000 7fb3b4ff9700 1 -- 172.21.15.39:0/3684464572 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb3a80200a0 con 0x7fb3b806ae10 2023-11-28T11:57:25.612 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-11-28T11:57:25.616 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.613+0000 7fb3be9d2700 1 -- 172.21.15.39:0/3684464572 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb3a4064ee0 msgr2=0x7fb3a4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:25.617 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.613+0000 7fb3be9d2700 1 --2- 172.21.15.39:0/3684464572 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb3a4064ee0 0x7fb3a4067390 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac006b40 tx=0x7fb3ac006ad0 comp rx=0 tx=0).stop 2023-11-28T11:57:25.617 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.613+0000 7fb3be9d2700 1 -- 172.21.15.39:0/3684464572 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3b806ae10 msgr2=0x7fb3b80ab860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:25.617 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.613+0000 7fb3be9d2700 1 --2- 172.21.15.39:0/3684464572 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3b806ae10 0x7fb3b80ab860 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8014040 tx=0x7fb3a8004770 comp rx=0 tx=0).stop 2023-11-28T11:57:25.617 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.613+0000 7fb3be9d2700 1 -- 172.21.15.39:0/3684464572 shutdown_connections 2023-11-28T11:57:25.617 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.613+0000 7fb3be9d2700 1 --2- 172.21.15.39:0/3684464572 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3b80b4280 0x7fb3b80ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:25.617 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.613+0000 7fb3be9d2700 1 --2- 172.21.15.39:0/3684464572 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb3a4064ee0 0x7fb3a4067390 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:25.617 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.613+0000 7fb3be9d2700 1 --2- 172.21.15.39:0/3684464572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3b80adb20 0x7fb3b8158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:25.617 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.613+0000 7fb3be9d2700 1 --2- 172.21.15.39:0/3684464572 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3b806ae10 0x7fb3b80ab860 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:25.617 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.613+0000 7fb3be9d2700 1 -- 172.21.15.39:0/3684464572 >> 172.21.15.39:0/3684464572 conn(0x7fb3b80cf580 msgr2=0x7fb3b80b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:25.617 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.613+0000 7fb3be9d2700 1 -- 172.21.15.39:0/3684464572 shutdown_connections 2023-11-28T11:57:25.617 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.613+0000 7fb3be9d2700 1 -- 172.21.15.39:0/3684464572 wait complete. 2023-11-28T11:57:25.644 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:57:25.832 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.825+0000 7f65ecced700 1 Processor -- start 2023-11-28T11:57:25.832 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.829+0000 7f65ecced700 1 -- start start 2023-11-28T11:57:25.834 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.829+0000 7f65ecced700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65e815c410 0x7f65e8160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:25.834 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.829+0000 7f65ecced700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65e80ca740 con 0x7f65e80b1240 2023-11-28T11:57:25.834 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.829+0000 7f65ecced700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65e8161020 con 0x7f65e80cf2a0 2023-11-28T11:57:25.835 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.829+0000 7f65ecced700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e80ca9e0 con 0x7f65e815c410 2023-11-28T11:57:25.835 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.829+0000 7f65e7fff700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f65e80b1240 0x7f65e80ce390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:46426/0 (socket says 172.21.15.39:46426) 2023-11-28T11:57:25.835 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.829+0000 7f65e7fff700 1 -- 172.21.15.39:0/1416062635 learned_addr learned my addr 172.21.15.39:0/1416062635 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:25.835 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.829+0000 7f65e77fe700 1 --2- 172.21.15.39:0/1416062635 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65e815c410 0x7f65e8160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:25.837 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.833+0000 7f65e77fe700 1 -- 172.21.15.39:0/1416062635 >> v1:172.21.15.184:6789/0 conn(0x7f65e80cf2a0 legacy=0x7f65e8069c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:25.837 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.833+0000 7f65e77fe700 1 -- 172.21.15.39:0/1416062635 >> v1:172.21.15.39:6789/0 conn(0x7f65e80b1240 legacy=0x7f65e80ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:25.837 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.833+0000 7f65e77fe700 1 -- 172.21.15.39:0/1416062635 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e80cacc0 con 0x7f65e815c410 2023-11-28T11:57:25.837 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.833+0000 7f65e67fc700 1 -- 172.21.15.39:0/1416062635 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2871829106 0 0) 0x7f65e80ca740 con 0x7f65e80b1240 2023-11-28T11:57:25.838 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.833+0000 7f65e77fe700 1 --2- 172.21.15.39:0/1416062635 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65e815c410 0x7f65e8160ae0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f65d8009880 tx=0x7f65d8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccb13f2ede94b30a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:25.838 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.833+0000 7f65e67fc700 1 -- 172.21.15.39:0/1416062635 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d8011830 con 0x7f65e815c410 2023-11-28T11:57:25.838 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.833+0000 7f65e67fc700 1 -- 172.21.15.39:0/1416062635 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d8011990 con 0x7f65e815c410 2023-11-28T11:57:25.838 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.833+0000 7f65e67fc700 1 -- 172.21.15.39:0/1416062635 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d8011d20 con 0x7f65e815c410 2023-11-28T11:57:25.839 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.833+0000 7f65ecced700 1 -- 172.21.15.39:0/1416062635 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65e815c410 msgr2=0x7f65e8160ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:25.839 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.833+0000 7f65ecced700 1 --2- 172.21.15.39:0/1416062635 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65e815c410 0x7f65e8160ae0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f65d8009880 tx=0x7f65d8009b90 comp rx=0 tx=0).stop 2023-11-28T11:57:25.839 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.833+0000 7f65ecced700 1 -- 172.21.15.39:0/1416062635 shutdown_connections 2023-11-28T11:57:25.839 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.833+0000 7f65ecced700 1 --2- 172.21.15.39:0/1416062635 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65e815c410 0x7f65e8160ae0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:25.840 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.833+0000 7f65ecced700 1 -- 172.21.15.39:0/1416062635 >> 172.21.15.39:0/1416062635 conn(0x7f65e80cc240 msgr2=0x7f65e80cc610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:25.840 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.833+0000 7f65ecced700 1 -- 172.21.15.39:0/1416062635 shutdown_connections 2023-11-28T11:57:25.840 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.833+0000 7f65ecced700 1 -- 172.21.15.39:0/1416062635 wait complete. 2023-11-28T11:57:25.843 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.837+0000 7f65ecced700 1 Processor -- start 2023-11-28T11:57:25.844 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.841+0000 7f65ecced700 1 -- start start 2023-11-28T11:57:25.846 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.841+0000 7f65ecced700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65e80b1240 0x7f65e80cfd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:25.846 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.841+0000 7f65ecced700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f65e80cf2a0 0x7f65e80c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:25.846 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.841+0000 7f65ecced700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65e815c410 0x7f65e80c5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:25.846 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.841+0000 7f65ecced700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e80c6510 con 0x7f65e80cf2a0 2023-11-28T11:57:25.846 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.841+0000 7f65ecced700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e81f9310 con 0x7f65e80b1240 2023-11-28T11:57:25.846 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.841+0000 7f65ecced700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e81f95f0 con 0x7f65e815c410 2023-11-28T11:57:25.848 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.841+0000 7f65e6ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f65e80cf2a0 0x7f65e80c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:25.848 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.841+0000 7f65e6ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f65e80cf2a0 0x7f65e80c59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37244/0 (socket says 172.21.15.39:37244) 2023-11-28T11:57:25.848 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.841+0000 7f65e6ffd700 1 -- 172.21.15.39:0/1262009444 learned_addr learned my addr 172.21.15.39:0/1262009444 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:25.848 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.841+0000 7f65e77fe700 1 --2- 172.21.15.39:0/1262009444 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65e80b1240 0x7f65e80cfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:25.848 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.841+0000 7f65e7fff700 1 --2- 172.21.15.39:0/1262009444 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65e815c410 0x7f65e80c5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:25.848 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.841+0000 7f65e6ffd700 1 -- 172.21.15.39:0/1262009444 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65e815c410 msgr2=0x7f65e80c5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:25.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.841+0000 7f65e6ffd700 1 --2- 172.21.15.39:0/1262009444 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65e815c410 0x7f65e80c5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:25.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.841+0000 7f65e6ffd700 1 -- 172.21.15.39:0/1262009444 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65e80b1240 msgr2=0x7f65e80cfd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:25.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.841+0000 7f65e6ffd700 1 --2- 172.21.15.39:0/1262009444 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65e80b1240 0x7f65e80cfd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:25.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.841+0000 7f65e6ffd700 1 -- 172.21.15.39:0/1262009444 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d80094b0 con 0x7f65e80cf2a0 2023-11-28T11:57:25.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.841+0000 7f65e6ffd700 1 --2- 172.21.15.39:0/1262009444 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f65e80cf2a0 0x7f65e80c59c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f65dc00c500 tx=0x7f65dc00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:25.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.845+0000 7f65cffff700 1 -- 172.21.15.39:0/1262009444 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65dc0052d0 con 0x7f65e80cf2a0 2023-11-28T11:57:25.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.845+0000 7f65ecced700 1 -- 172.21.15.39:0/1262009444 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65e80cde70 con 0x7f65e80cf2a0 2023-11-28T11:57:25.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.845+0000 7f65cffff700 1 -- 172.21.15.39:0/1262009444 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65dc005430 con 0x7f65e80cf2a0 2023-11-28T11:57:25.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.845+0000 7f65cffff700 1 -- 172.21.15.39:0/1262009444 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65dc0055a0 con 0x7f65e80cf2a0 2023-11-28T11:57:25.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.845+0000 7f65ecced700 1 -- 172.21.15.39:0/1262009444 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65e80cdb90 con 0x7f65e80cf2a0 2023-11-28T11:57:25.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.845+0000 7f65ecced700 1 -- 172.21.15.39:0/1262009444 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65e806a370 con 0x7f65e80cf2a0 2023-11-28T11:57:25.852 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.849+0000 7f65cffff700 1 -- 172.21.15.39:0/1262009444 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f65dc019030 con 0x7f65e80cf2a0 2023-11-28T11:57:25.853 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.849+0000 7f65cffff700 1 --2- 172.21.15.39:0/1262009444 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f65d4064ee0 0x7f65d4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:25.853 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.849+0000 7f65cffff700 1 -- 172.21.15.39:0/1262009444 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f65dc0814d0 con 0x7f65e80cf2a0 2023-11-28T11:57:25.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.849+0000 7f65e77fe700 1 --2- 172.21.15.39:0/1262009444 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f65d4064ee0 0x7f65d4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:25.855 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.849+0000 7f65e77fe700 1 --2- 172.21.15.39:0/1262009444 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f65d4064ee0 0x7f65d4067390 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f65d80090b0 tx=0x7f65d801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:25.860 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:25.853+0000 7f65cffff700 1 -- 172.21.15.39:0/1262009444 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f65dc04f2c0 con 0x7f65e80cf2a0 2023-11-28T11:57:26.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.033+0000 7f65ecced700 1 -- 172.21.15.39:0/1262009444 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f65e8073d20 con 0x7f65e80cf2a0 2023-11-28T11:57:26.038 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.033+0000 7f65cffff700 1 -- 172.21.15.39:0/1262009444 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f65dc0528e0 con 0x7f65e80cf2a0 2023-11-28T11:57:26.038 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-11-28T11:57:26.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.037+0000 7f65ecced700 1 -- 172.21.15.39:0/1262009444 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f65d4064ee0 msgr2=0x7f65d4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:26.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.037+0000 7f65ecced700 1 --2- 172.21.15.39:0/1262009444 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f65d4064ee0 0x7f65d4067390 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f65d80090b0 tx=0x7f65d801c040 comp rx=0 tx=0).stop 2023-11-28T11:57:26.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.037+0000 7f65ecced700 1 -- 172.21.15.39:0/1262009444 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f65e80cf2a0 msgr2=0x7f65e80c59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:26.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.037+0000 7f65ecced700 1 --2- 172.21.15.39:0/1262009444 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f65e80cf2a0 0x7f65e80c59c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f65dc00c500 tx=0x7f65dc00c810 comp rx=0 tx=0).stop 2023-11-28T11:57:26.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.037+0000 7f65ecced700 1 -- 172.21.15.39:0/1262009444 shutdown_connections 2023-11-28T11:57:26.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.037+0000 7f65ecced700 1 --2- 172.21.15.39:0/1262009444 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65e815c410 0x7f65e80c5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:26.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.037+0000 7f65ecced700 1 --2- 172.21.15.39:0/1262009444 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f65e80cf2a0 0x7f65e80c59c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:26.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.037+0000 7f65ecced700 1 --2- 172.21.15.39:0/1262009444 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f65d4064ee0 0x7f65d4067390 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:26.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.037+0000 7f65ecced700 1 --2- 172.21.15.39:0/1262009444 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65e80b1240 0x7f65e80cfd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:26.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.037+0000 7f65ecced700 1 -- 172.21.15.39:0/1262009444 >> 172.21.15.39:0/1262009444 conn(0x7f65e80cc240 msgr2=0x7f65e80b16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:26.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.041+0000 7f65ecced700 1 -- 172.21.15.39:0/1262009444 shutdown_connections 2023-11-28T11:57:26.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.041+0000 7f65ecced700 1 -- 172.21.15.39:0/1262009444 wait complete. 2023-11-28T11:57:26.066 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:57:26.258 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.253+0000 7f7c56aee700 1 Processor -- start 2023-11-28T11:57:26.258 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.253+0000 7f7c56aee700 1 -- start start 2023-11-28T11:57:26.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.257+0000 7f7c56aee700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c50070a00 0x7f7c50069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:26.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.257+0000 7f7c56aee700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7c500b2130 0x7f7c5006a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:26.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.257+0000 7f7c56aee700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c500cd360 con 0x7f7c5015c700 2023-11-28T11:57:26.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.257+0000 7f7c56aee700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c50160190 con 0x7f7c500b2130 2023-11-28T11:57:26.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.257+0000 7f7c56aee700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c50160470 con 0x7f7c50070a00 2023-11-28T11:57:26.262 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.257+0000 7f7c5508b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7c500b2130 0x7f7c5006a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:26.262 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.257+0000 7f7c5508b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7c500b2130 0x7f7c5006a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:60084/0 (socket says 172.21.15.39:60084) 2023-11-28T11:57:26.262 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.257+0000 7f7c5508b700 1 -- 172.21.15.39:0/3331910492 learned_addr learned my addr 172.21.15.39:0/3331910492 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:26.262 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.257+0000 7f7c4ffff700 1 --2- 172.21.15.39:0/3331910492 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c50070a00 0x7f7c50069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:26.263 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.257+0000 7f7c4ffff700 1 -- 172.21.15.39:0/3331910492 >> v2:172.21.15.184:3300/0 conn(0x7f7c500b2130 msgr2=0x7f7c5006a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:26.263 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.257+0000 7f7c4ffff700 1 --2- 172.21.15.39:0/3331910492 >> v2:172.21.15.184:3300/0 conn(0x7f7c500b2130 0x7f7c5006a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:26.263 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.257+0000 7f7c4ffff700 1 -- 172.21.15.39:0/3331910492 >> v1:172.21.15.184:6789/0 conn(0x7f7c5015c700 legacy=0x7f7c500702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:26.263 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.257+0000 7f7c4ffff700 1 -- 172.21.15.39:0/3331910492 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c50160750 con 0x7f7c50070a00 2023-11-28T11:57:26.263 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.257+0000 7f7c5508b700 1 --2- 172.21.15.39:0/3331910492 >> v2:172.21.15.184:3300/0 conn(0x7f7c500b2130 0x7f7c5006a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:26.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.257+0000 7f7c4ffff700 1 --2- 172.21.15.39:0/3331910492 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c50070a00 0x7f7c50069bf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c009850 tx=0x7f7c3c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f2a9431cc25d4ab server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:26.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.257+0000 7f7c4f7fe700 1 -- 172.21.15.39:0/3331910492 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c011830 con 0x7f7c50070a00 2023-11-28T11:57:26.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.257+0000 7f7c4f7fe700 1 -- 172.21.15.39:0/3331910492 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3c011990 con 0x7f7c50070a00 2023-11-28T11:57:26.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.257+0000 7f7c4f7fe700 1 -- 172.21.15.39:0/3331910492 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c011d40 con 0x7f7c50070a00 2023-11-28T11:57:26.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.261+0000 7f7c56aee700 1 -- 172.21.15.39:0/3331910492 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c50070a00 msgr2=0x7f7c50069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:26.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.261+0000 7f7c56aee700 1 --2- 172.21.15.39:0/3331910492 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c50070a00 0x7f7c50069bf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c009850 tx=0x7f7c3c009b60 comp rx=0 tx=0).stop 2023-11-28T11:57:26.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.261+0000 7f7c56aee700 1 -- 172.21.15.39:0/3331910492 shutdown_connections 2023-11-28T11:57:26.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.261+0000 7f7c56aee700 1 --2- 172.21.15.39:0/3331910492 >> v2:172.21.15.184:3300/0 conn(0x7f7c500b2130 0x7f7c5006a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:26.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.261+0000 7f7c56aee700 1 --2- 172.21.15.39:0/3331910492 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c50070a00 0x7f7c50069bf0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:26.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.261+0000 7f7c56aee700 1 -- 172.21.15.39:0/3331910492 >> 172.21.15.39:0/3331910492 conn(0x7f7c500d2d10 msgr2=0x7f7c500d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:26.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.261+0000 7f7c56aee700 1 -- 172.21.15.39:0/3331910492 shutdown_connections 2023-11-28T11:57:26.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.261+0000 7f7c56aee700 1 -- 172.21.15.39:0/3331910492 wait complete. 2023-11-28T11:57:26.267 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.261+0000 7f7c56aee700 1 Processor -- start 2023-11-28T11:57:26.267 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.261+0000 7f7c56aee700 1 -- start start 2023-11-28T11:57:26.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.265+0000 7f7c56aee700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c50070a00 0x7f7c50156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:26.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.265+0000 7f7c56aee700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7c500b2130 0x7f7c5015a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:26.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.265+0000 7f7c56aee700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c5015c700 0x7f7c500b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:26.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.265+0000 7f7c56aee700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c50158eb0 con 0x7f7c500b2130 2023-11-28T11:57:26.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.265+0000 7f7c56aee700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c50159190 con 0x7f7c50070a00 2023-11-28T11:57:26.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.265+0000 7f7c56aee700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5015d580 con 0x7f7c5015c700 2023-11-28T11:57:26.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.265+0000 7f7c4ffff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7c500b2130 0x7f7c5015a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:26.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.265+0000 7f7c4ffff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7c500b2130 0x7f7c5015a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37250/0 (socket says 172.21.15.39:37250) 2023-11-28T11:57:26.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.265+0000 7f7c4ffff700 1 -- 172.21.15.39:0/1858268410 learned_addr learned my addr 172.21.15.39:0/1858268410 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:26.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.265+0000 7f7c5488a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c50070a00 0x7f7c50156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:26.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.265+0000 7f7c5508b700 1 --2- 172.21.15.39:0/1858268410 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c5015c700 0x7f7c500b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:26.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.265+0000 7f7c5488a700 1 -- 172.21.15.39:0/1858268410 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c5015c700 msgr2=0x7f7c500b4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:26.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.265+0000 7f7c5488a700 1 --2- 172.21.15.39:0/1858268410 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c5015c700 0x7f7c500b4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:26.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.265+0000 7f7c5488a700 1 -- 172.21.15.39:0/1858268410 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7c500b2130 msgr2=0x7f7c5015a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:26.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.265+0000 7f7c5488a700 1 --2- 172.21.15.39:0/1858268410 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7c500b2130 0x7f7c5015a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:26.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.265+0000 7f7c5488a700 1 -- 172.21.15.39:0/1858268410 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c48009b30 con 0x7f7c50070a00 2023-11-28T11:57:26.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.265+0000 7f7c4ffff700 1 --2- 172.21.15.39:0/1858268410 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7c500b2130 0x7f7c5015a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:26.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.265+0000 7f7c5488a700 1 --2- 172.21.15.39:0/1858268410 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c50070a00 0x7f7c50156040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7c4400c410 tx=0x7f7c44001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:26.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.269+0000 7f7c4d7fa700 1 -- 172.21.15.39:0/1858268410 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c440052d0 con 0x7f7c50070a00 2023-11-28T11:57:26.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.269+0000 7f7c4d7fa700 1 -- 172.21.15.39:0/1858268410 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c44005430 con 0x7f7c50070a00 2023-11-28T11:57:26.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.269+0000 7f7c56aee700 1 -- 172.21.15.39:0/1858268410 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c3c0094b0 con 0x7f7c50070a00 2023-11-28T11:57:26.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.269+0000 7f7c4d7fa700 1 -- 172.21.15.39:0/1858268410 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c440055a0 con 0x7f7c50070a00 2023-11-28T11:57:26.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.269+0000 7f7c56aee700 1 -- 172.21.15.39:0/1858268410 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c5006b530 con 0x7f7c50070a00 2023-11-28T11:57:26.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.269+0000 7f7c56aee700 1 -- 172.21.15.39:0/1858268410 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c50160a30 con 0x7f7c50070a00 2023-11-28T11:57:26.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.273+0000 7f7c4d7fa700 1 -- 172.21.15.39:0/1858268410 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7c44019030 con 0x7f7c50070a00 2023-11-28T11:57:26.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.273+0000 7f7c4d7fa700 1 --2- 172.21.15.39:0/1858268410 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7c34064ee0 0x7f7c34067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:26.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.273+0000 7f7c4d7fa700 1 -- 172.21.15.39:0/1858268410 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7c440813f0 con 0x7f7c50070a00 2023-11-28T11:57:26.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.273+0000 7f7c4ffff700 1 --2- 172.21.15.39:0/1858268410 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7c34064ee0 0x7f7c34067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:26.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.277+0000 7f7c4ffff700 1 --2- 172.21.15.39:0/1858268410 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7c34064ee0 0x7f7c34067390 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7c5015f540 tx=0x7f7c3c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:26.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.281+0000 7f7c4d7fa700 1 -- 172.21.15.39:0/1858268410 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7c4404f170 con 0x7f7c50070a00 2023-11-28T11:57:26.464 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.461+0000 7f7c56aee700 1 -- 172.21.15.39:0/1858268410 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7c500b1be0 con 0x7f7c50070a00 2023-11-28T11:57:26.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.461+0000 7f7c4d7fa700 1 -- 172.21.15.39:0/1858268410 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7c44052790 con 0x7f7c50070a00 2023-11-28T11:57:26.466 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-11-28T11:57:26.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.461+0000 7f7c56aee700 1 -- 172.21.15.39:0/1858268410 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7c34064ee0 msgr2=0x7f7c34067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:26.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.461+0000 7f7c56aee700 1 --2- 172.21.15.39:0/1858268410 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7c34064ee0 0x7f7c34067390 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7c5015f540 tx=0x7f7c3c008030 comp rx=0 tx=0).stop 2023-11-28T11:57:26.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.461+0000 7f7c56aee700 1 -- 172.21.15.39:0/1858268410 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c50070a00 msgr2=0x7f7c50156040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:26.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.461+0000 7f7c56aee700 1 --2- 172.21.15.39:0/1858268410 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c50070a00 0x7f7c50156040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7c4400c410 tx=0x7f7c44001e70 comp rx=0 tx=0).stop 2023-11-28T11:57:26.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.465+0000 7f7c56aee700 1 -- 172.21.15.39:0/1858268410 shutdown_connections 2023-11-28T11:57:26.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.465+0000 7f7c56aee700 1 --2- 172.21.15.39:0/1858268410 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c5015c700 0x7f7c500b4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:26.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.465+0000 7f7c56aee700 1 --2- 172.21.15.39:0/1858268410 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7c500b2130 0x7f7c5015a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:26.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.465+0000 7f7c56aee700 1 --2- 172.21.15.39:0/1858268410 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7c34064ee0 0x7f7c34067390 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:26.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.465+0000 7f7c56aee700 1 --2- 172.21.15.39:0/1858268410 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c50070a00 0x7f7c50156040 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:26.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.465+0000 7f7c56aee700 1 -- 172.21.15.39:0/1858268410 >> 172.21.15.39:0/1858268410 conn(0x7f7c500d2d10 msgr2=0x7f7c500b3ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:26.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.465+0000 7f7c56aee700 1 -- 172.21.15.39:0/1858268410 shutdown_connections 2023-11-28T11:57:26.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.465+0000 7f7c56aee700 1 -- 172.21.15.39:0/1858268410 wait complete. 2023-11-28T11:57:26.491 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:57:26.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.665+0000 7fa379745700 1 Processor -- start 2023-11-28T11:57:26.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.665+0000 7fa379745700 1 -- start start 2023-11-28T11:57:26.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.669+0000 7fa379745700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa374070620 0x7fa3740b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:26.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.669+0000 7fa379745700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa37415c520 con 0x7fa374069bf0 2023-11-28T11:57:26.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.669+0000 7fa379745700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa37406cc50 con 0x7fa37415c150 2023-11-28T11:57:26.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.669+0000 7fa379745700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3740b4240 con 0x7fa374070620 2023-11-28T11:57:26.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.669+0000 7fa3737fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa374070620 0x7fa3740b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:26.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.669+0000 7fa3737fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa374070620 0x7fa3740b3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:45788/0 (socket says 172.21.15.39:45788) 2023-11-28T11:57:26.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.669+0000 7fa3737fe700 1 -- 172.21.15.39:0/1206156968 learned_addr learned my addr 172.21.15.39:0/1206156968 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:26.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.669+0000 7fa373fff700 1 --1- 172.21.15.39:0/1206156968 >> v1:172.21.15.184:6789/0 conn(0x7fa37415c150 0x7fa37406ff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:46100/0 (socket says 172.21.15.39:46100) 2023-11-28T11:57:26.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.669+0000 7fa372ffd700 1 -- 172.21.15.39:0/1206156968 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3526603319 0 0) 0x7fa37406cc50 con 0x7fa37415c150 2023-11-28T11:57:26.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.673+0000 7fa3737fe700 1 -- 172.21.15.39:0/1206156968 >> v1:172.21.15.184:6789/0 conn(0x7fa37415c150 legacy=0x7fa37406ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:26.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.673+0000 7fa3737fe700 1 -- 172.21.15.39:0/1206156968 >> v1:172.21.15.39:6789/0 conn(0x7fa374069bf0 legacy=0x7fa37406a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:26.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.673+0000 7fa3737fe700 1 -- 172.21.15.39:0/1206156968 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3740d2450 con 0x7fa374070620 2023-11-28T11:57:26.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.673+0000 7fa3737fe700 1 --2- 172.21.15.39:0/1206156968 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa374070620 0x7fa3740b3d00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa368009940 tx=0x7fa368009c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=779498d11b28e251 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:26.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.673+0000 7fa372ffd700 1 -- 172.21.15.39:0/1206156968 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa368004230 con 0x7fa374070620 2023-11-28T11:57:26.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.673+0000 7fa372ffd700 1 -- 172.21.15.39:0/1206156968 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa368004390 con 0x7fa374070620 2023-11-28T11:57:26.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.673+0000 7fa372ffd700 1 -- 172.21.15.39:0/1206156968 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa368009e30 con 0x7fa374070620 2023-11-28T11:57:26.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.673+0000 7fa379745700 1 -- 172.21.15.39:0/1206156968 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa374070620 msgr2=0x7fa3740b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:26.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.673+0000 7fa379745700 1 --2- 172.21.15.39:0/1206156968 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa374070620 0x7fa3740b3d00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa368009940 tx=0x7fa368009c50 comp rx=0 tx=0).stop 2023-11-28T11:57:26.679 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.673+0000 7fa379745700 1 -- 172.21.15.39:0/1206156968 shutdown_connections 2023-11-28T11:57:26.679 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.673+0000 7fa379745700 1 --2- 172.21.15.39:0/1206156968 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa374070620 0x7fa3740b3d00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:26.679 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.673+0000 7fa379745700 1 -- 172.21.15.39:0/1206156968 >> 172.21.15.39:0/1206156968 conn(0x7fa3740d3680 msgr2=0x7fa3740cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:26.679 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.673+0000 7fa379745700 1 -- 172.21.15.39:0/1206156968 shutdown_connections 2023-11-28T11:57:26.680 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.673+0000 7fa379745700 1 -- 172.21.15.39:0/1206156968 wait complete. 2023-11-28T11:57:26.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.677+0000 7fa379745700 1 Processor -- start 2023-11-28T11:57:26.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.677+0000 7fa379745700 1 -- start start 2023-11-28T11:57:26.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.677+0000 7fa379745700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa374069bf0 0x7fa374150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:26.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.677+0000 7fa379745700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa374070620 0x7fa37414eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:26.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.677+0000 7fa379745700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa37415c150 0x7fa374154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:26.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.677+0000 7fa379745700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3740cfaa0 con 0x7fa374069bf0 2023-11-28T11:57:26.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.677+0000 7fa379745700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37414fe40 con 0x7fa37415c150 2023-11-28T11:57:26.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.677+0000 7fa379745700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa374150120 con 0x7fa374070620 2023-11-28T11:57:26.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.681+0000 7fa373fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa374069bf0 0x7fa374150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:26.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.681+0000 7fa373fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa374069bf0 0x7fa374150ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37264/0 (socket says 172.21.15.39:37264) 2023-11-28T11:57:26.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.681+0000 7fa373fff700 1 -- 172.21.15.39:0/1910814740 learned_addr learned my addr 172.21.15.39:0/1910814740 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:26.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.681+0000 7fa3737fe700 1 --2- 172.21.15.39:0/1910814740 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa374070620 0x7fa37414eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:26.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.681+0000 7fa378f44700 1 --2- 172.21.15.39:0/1910814740 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa37415c150 0x7fa374154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:26.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.681+0000 7fa373fff700 1 -- 172.21.15.39:0/1910814740 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa374070620 msgr2=0x7fa37414eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:26.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.681+0000 7fa373fff700 1 --2- 172.21.15.39:0/1910814740 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa374070620 0x7fa37414eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:26.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.681+0000 7fa373fff700 1 -- 172.21.15.39:0/1910814740 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa37415c150 msgr2=0x7fa374154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:26.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.681+0000 7fa373fff700 1 --2- 172.21.15.39:0/1910814740 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa37415c150 0x7fa374154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:26.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.681+0000 7fa373fff700 1 -- 172.21.15.39:0/1910814740 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa368009520 con 0x7fa374069bf0 2023-11-28T11:57:26.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.681+0000 7fa373fff700 1 --2- 172.21.15.39:0/1910814740 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa374069bf0 0x7fa374150ee0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa36400c4a0 tx=0x7fa36400c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:26.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.681+0000 7fa370ff9700 1 -- 172.21.15.39:0/1910814740 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa364004ca0 con 0x7fa374069bf0 2023-11-28T11:57:26.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.681+0000 7fa379745700 1 -- 172.21.15.39:0/1910814740 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3740d05e0 con 0x7fa374069bf0 2023-11-28T11:57:26.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.681+0000 7fa370ff9700 1 -- 172.21.15.39:0/1910814740 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa364004e00 con 0x7fa374069bf0 2023-11-28T11:57:26.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.681+0000 7fa370ff9700 1 -- 172.21.15.39:0/1910814740 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa364007310 con 0x7fa374069bf0 2023-11-28T11:57:26.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.681+0000 7fa379745700 1 -- 172.21.15.39:0/1910814740 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3740d2730 con 0x7fa374069bf0 2023-11-28T11:57:26.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.685+0000 7fa379745700 1 -- 172.21.15.39:0/1910814740 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3740d2140 con 0x7fa374069bf0 2023-11-28T11:57:26.690 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.685+0000 7fa370ff9700 1 -- 172.21.15.39:0/1910814740 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa36401a020 con 0x7fa374069bf0 2023-11-28T11:57:26.691 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.685+0000 7fa370ff9700 1 --2- 172.21.15.39:0/1910814740 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa360064ee0 0x7fa360067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:26.691 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.685+0000 7fa370ff9700 1 -- 172.21.15.39:0/1910814740 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa364081de0 con 0x7fa374069bf0 2023-11-28T11:57:26.692 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.689+0000 7fa3737fe700 1 --2- 172.21.15.39:0/1910814740 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa360064ee0 0x7fa360067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:26.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.689+0000 7fa3737fe700 1 --2- 172.21.15.39:0/1910814740 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa360064ee0 0x7fa360067390 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa368009940 tx=0x7fa368008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:26.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.693+0000 7fa370ff9700 1 -- 172.21.15.39:0/1910814740 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa36404fae0 con 0x7fa374069bf0 2023-11-28T11:57:26.873 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.869+0000 7fa379745700 1 -- 172.21.15.39:0/1910814740 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa37406adf0 con 0x7fa374069bf0 2023-11-28T11:57:26.874 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.869+0000 7fa370ff9700 1 -- 172.21.15.39:0/1910814740 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa364053100 con 0x7fa374069bf0 2023-11-28T11:57:26.874 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2023-11-28T11:57:26.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.873+0000 7fa379745700 1 -- 172.21.15.39:0/1910814740 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa360064ee0 msgr2=0x7fa360067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:26.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.873+0000 7fa379745700 1 --2- 172.21.15.39:0/1910814740 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa360064ee0 0x7fa360067390 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa368009940 tx=0x7fa368008030 comp rx=0 tx=0).stop 2023-11-28T11:57:26.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.873+0000 7fa379745700 1 -- 172.21.15.39:0/1910814740 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa374069bf0 msgr2=0x7fa374150ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:26.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.873+0000 7fa379745700 1 --2- 172.21.15.39:0/1910814740 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa374069bf0 0x7fa374150ee0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa36400c4a0 tx=0x7fa36400c7b0 comp rx=0 tx=0).stop 2023-11-28T11:57:26.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.873+0000 7fa379745700 1 -- 172.21.15.39:0/1910814740 shutdown_connections 2023-11-28T11:57:26.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.873+0000 7fa379745700 1 --2- 172.21.15.39:0/1910814740 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa360064ee0 0x7fa360067390 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:26.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.873+0000 7fa379745700 1 --2- 172.21.15.39:0/1910814740 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa37415c150 0x7fa374154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:26.878 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.873+0000 7fa379745700 1 --2- 172.21.15.39:0/1910814740 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa374070620 0x7fa37414eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:26.878 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.873+0000 7fa379745700 1 --2- 172.21.15.39:0/1910814740 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa374069bf0 0x7fa374150ee0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:26.878 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.873+0000 7fa379745700 1 -- 172.21.15.39:0/1910814740 >> 172.21.15.39:0/1910814740 conn(0x7fa3740d3680 msgr2=0x7fa3740c8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:26.878 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.873+0000 7fa379745700 1 -- 172.21.15.39:0/1910814740 shutdown_connections 2023-11-28T11:57:26.878 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:26.873+0000 7fa379745700 1 -- 172.21.15.39:0/1910814740 wait complete. 2023-11-28T11:57:26.899 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T11:57:27.086 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.081+0000 7f575db97700 1 Processor -- start 2023-11-28T11:57:27.086 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.081+0000 7f575db97700 1 -- start start 2023-11-28T11:57:27.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.081+0000 7f575db97700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f575815c150 0x7f57580b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:27.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.085+0000 7f575db97700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5758070360 0x7f5758160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:27.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.085+0000 7f575db97700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f575815c520 con 0x7f575806ff10 2023-11-28T11:57:27.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.085+0000 7f575db97700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57580b4240 con 0x7f5758070360 2023-11-28T11:57:27.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.085+0000 7f575db97700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f575806ac00 con 0x7f575815c150 2023-11-28T11:57:27.089 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.085+0000 7f575d396700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5758070360 0x7f5758160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:27.089 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.085+0000 7f575cb95700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f575815c150 0x7f57580b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:27.089 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.085+0000 7f575d396700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5758070360 0x7f5758160340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:60124/0 (socket says 172.21.15.39:60124) 2023-11-28T11:57:27.089 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.085+0000 7f575d396700 1 -- 172.21.15.39:0/1323126991 learned_addr learned my addr 172.21.15.39:0/1323126991 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:27.090 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.085+0000 7f575d396700 1 -- 172.21.15.39:0/1323126991 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f575815c150 msgr2=0x7f57580b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:27.090 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.085+0000 7f575d396700 1 --2- 172.21.15.39:0/1323126991 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f575815c150 0x7f57580b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:27.090 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.085+0000 7f575d396700 1 -- 172.21.15.39:0/1323126991 >> v1:172.21.15.184:6789/0 conn(0x7f575806ff10 legacy=0x7f575815fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:27.090 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.085+0000 7f575d396700 1 -- 172.21.15.39:0/1323126991 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f575806cc50 con 0x7f5758070360 2023-11-28T11:57:27.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.085+0000 7f575d396700 1 --2- 172.21.15.39:0/1323126991 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5758070360 0x7f5758160340 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5750009e50 tx=0x7f575000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=456e793b19f989df server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:27.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.085+0000 7f57577fe700 1 -- 172.21.15.39:0/1323126991 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575000e070 con 0x7f5758070360 2023-11-28T11:57:27.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.085+0000 7f57577fe700 1 -- 172.21.15.39:0/1323126991 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575000b910 con 0x7f5758070360 2023-11-28T11:57:27.092 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.085+0000 7f57577fe700 1 -- 172.21.15.39:0/1323126991 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575000bcc0 con 0x7f5758070360 2023-11-28T11:57:27.092 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.089+0000 7f575db97700 1 -- 172.21.15.39:0/1323126991 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5758070360 msgr2=0x7f5758160340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:27.092 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.089+0000 7f575db97700 1 --2- 172.21.15.39:0/1323126991 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5758070360 0x7f5758160340 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5750009e50 tx=0x7f575000b330 comp rx=0 tx=0).stop 2023-11-28T11:57:27.093 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.089+0000 7f575db97700 1 -- 172.21.15.39:0/1323126991 shutdown_connections 2023-11-28T11:57:27.093 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.089+0000 7f575db97700 1 --2- 172.21.15.39:0/1323126991 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5758070360 0x7f5758160340 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:27.093 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.089+0000 7f575db97700 1 --2- 172.21.15.39:0/1323126991 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f575815c150 0x7f57580b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:27.093 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.089+0000 7f575db97700 1 -- 172.21.15.39:0/1323126991 >> 172.21.15.39:0/1323126991 conn(0x7f57580d3680 msgr2=0x7f57580cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:27.093 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.089+0000 7f575db97700 1 -- 172.21.15.39:0/1323126991 shutdown_connections 2023-11-28T11:57:27.093 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.089+0000 7f575db97700 1 -- 172.21.15.39:0/1323126991 wait complete. 2023-11-28T11:57:27.095 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.089+0000 7f575db97700 1 Processor -- start 2023-11-28T11:57:27.096 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.093+0000 7f575db97700 1 -- start start 2023-11-28T11:57:27.097 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.093+0000 7f575db97700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f575806ff10 0x7f575814b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:27.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.093+0000 7f575db97700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5758070360 0x7f57581f17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:27.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.093+0000 7f575db97700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f575815c150 0x7f57581505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:27.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.093+0000 7f575db97700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57580b6ee0 con 0x7f5758070360 2023-11-28T11:57:27.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.093+0000 7f575db97700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57580b6b20 con 0x7f575806ff10 2023-11-28T11:57:27.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.093+0000 7f575db97700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57581f22a0 con 0x7f575815c150 2023-11-28T11:57:27.099 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.093+0000 7f5757fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5758070360 0x7f57581f17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:27.099 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.093+0000 7f5757fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5758070360 0x7f57581f17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37274/0 (socket says 172.21.15.39:37274) 2023-11-28T11:57:27.099 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.093+0000 7f5757fff700 1 -- 172.21.15.39:0/3829922430 learned_addr learned my addr 172.21.15.39:0/3829922430 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:27.099 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.093+0000 7f575cb95700 1 --2- 172.21.15.39:0/3829922430 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f575806ff10 0x7f575814b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:27.099 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.093+0000 7f575d396700 1 --2- 172.21.15.39:0/3829922430 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f575815c150 0x7f57581505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:27.099 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.093+0000 7f5757fff700 1 -- 172.21.15.39:0/3829922430 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f575815c150 msgr2=0x7f57581505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:27.099 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.093+0000 7f5757fff700 1 --2- 172.21.15.39:0/3829922430 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f575815c150 0x7f57581505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:27.099 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.093+0000 7f5757fff700 1 -- 172.21.15.39:0/3829922430 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f575806ff10 msgr2=0x7f575814b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:27.100 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.093+0000 7f5757fff700 1 --2- 172.21.15.39:0/3829922430 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f575806ff10 0x7f575814b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:27.100 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.093+0000 7f5757fff700 1 -- 172.21.15.39:0/3829922430 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5750009b30 con 0x7f5758070360 2023-11-28T11:57:27.100 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.093+0000 7f575cb95700 1 --2- 172.21.15.39:0/3829922430 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f575806ff10 0x7f575814b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:27.100 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.093+0000 7f5757fff700 1 --2- 172.21.15.39:0/3829922430 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5758070360 0x7f57581f17b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5744001f00 tx=0x7f574400c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:27.101 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.093+0000 7f57557fa700 1 -- 172.21.15.39:0/3829922430 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57440052d0 con 0x7f5758070360 2023-11-28T11:57:27.101 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.097+0000 7f57557fa700 1 -- 172.21.15.39:0/3829922430 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5744005430 con 0x7f5758070360 2023-11-28T11:57:27.101 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.097+0000 7f575db97700 1 -- 172.21.15.39:0/3829922430 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57580d2730 con 0x7f5758070360 2023-11-28T11:57:27.101 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.097+0000 7f57557fa700 1 -- 172.21.15.39:0/3829922430 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5744006af0 con 0x7f5758070360 2023-11-28T11:57:27.101 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.097+0000 7f575db97700 1 -- 172.21.15.39:0/3829922430 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57580d2450 con 0x7f5758070360 2023-11-28T11:57:27.102 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.097+0000 7f575db97700 1 -- 172.21.15.39:0/3829922430 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57580d05e0 con 0x7f5758070360 2023-11-28T11:57:27.104 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.097+0000 7f57557fa700 1 -- 172.21.15.39:0/3829922430 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5744010050 con 0x7f5758070360 2023-11-28T11:57:27.105 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.101+0000 7f57557fa700 1 --2- 172.21.15.39:0/3829922430 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f573c064ee0 0x7f573c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:27.105 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.101+0000 7f57557fa700 1 -- 172.21.15.39:0/3829922430 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f57440812f0 con 0x7f5758070360 2023-11-28T11:57:27.106 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.101+0000 7f575cb95700 1 --2- 172.21.15.39:0/3829922430 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f573c064ee0 0x7f573c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:27.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.101+0000 7f575cb95700 1 --2- 172.21.15.39:0/3829922430 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f573c064ee0 0x7f573c067390 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5758151290 tx=0x7f574c009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:27.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.105+0000 7f57557fa700 1 -- 172.21.15.39:0/3829922430 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5744049400 con 0x7f5758070360 2023-11-28T11:57:27.296 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.289+0000 7f575db97700 1 -- 172.21.15.39:0/3829922430 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f57580b7020 con 0x7f5758070360 2023-11-28T11:57:27.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.289+0000 7f57557fa700 1 -- 172.21.15.39:0/3829922430 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f57580b7020 con 0x7f5758070360 2023-11-28T11:57:27.298 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-11-28T11:57:27.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.293+0000 7f575db97700 1 -- 172.21.15.39:0/3829922430 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f573c064ee0 msgr2=0x7f573c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:27.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.293+0000 7f575db97700 1 --2- 172.21.15.39:0/3829922430 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f573c064ee0 0x7f573c067390 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5758151290 tx=0x7f574c009240 comp rx=0 tx=0).stop 2023-11-28T11:57:27.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.293+0000 7f575db97700 1 -- 172.21.15.39:0/3829922430 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5758070360 msgr2=0x7f57581f17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:27.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.293+0000 7f575db97700 1 --2- 172.21.15.39:0/3829922430 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5758070360 0x7f57581f17b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5744001f00 tx=0x7f574400c7b0 comp rx=0 tx=0).stop 2023-11-28T11:57:27.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.293+0000 7f575db97700 1 -- 172.21.15.39:0/3829922430 shutdown_connections 2023-11-28T11:57:27.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.293+0000 7f575db97700 1 --2- 172.21.15.39:0/3829922430 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f575815c150 0x7f57581505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:27.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.293+0000 7f575db97700 1 --2- 172.21.15.39:0/3829922430 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5758070360 0x7f57581f17b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:27.304 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.293+0000 7f575db97700 1 --2- 172.21.15.39:0/3829922430 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f573c064ee0 0x7f573c067390 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:27.304 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.293+0000 7f575db97700 1 --2- 172.21.15.39:0/3829922430 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f575806ff10 0x7f575814b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:27.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.293+0000 7f575db97700 1 -- 172.21.15.39:0/3829922430 >> 172.21.15.39:0/3829922430 conn(0x7f57580d3680 msgr2=0x7f5758155a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:27.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.293+0000 7f575db97700 1 -- 172.21.15.39:0/3829922430 shutdown_connections 2023-11-28T11:57:27.306 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.293+0000 7f575db97700 1 -- 172.21.15.39:0/3829922430 wait complete. 2023-11-28T11:57:27.323 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:57:27.505 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.501+0000 7fce4359e700 1 Processor -- start 2023-11-28T11:57:27.505 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.501+0000 7fce4359e700 1 -- start start 2023-11-28T11:57:27.507 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.501+0000 7fce4359e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce44160710 0x7fce440cc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:27.507 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.501+0000 7fce4359e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fce440cc860 0x7fce44070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:27.507 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.501+0000 7fce4359e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce440ad6c0 con 0x7fce440705c0 2023-11-28T11:57:27.507 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.501+0000 7fce4359e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce44070a60 con 0x7fce440cc860 2023-11-28T11:57:27.507 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.501+0000 7fce4359e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce4406b1c0 con 0x7fce44160710 2023-11-28T11:57:27.508 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.501+0000 7fce39d9b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fce440cc860 0x7fce44070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:27.508 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.501+0000 7fce42d9d700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fce440705c0 0x7fce44069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:46130/0 (socket says 172.21.15.39:46130) 2023-11-28T11:57:27.508 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.501+0000 7fce42d9d700 1 -- 172.21.15.39:0/2698005845 learned_addr learned my addr 172.21.15.39:0/2698005845 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:27.508 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.501+0000 7fce4259c700 1 --2- 172.21.15.39:0/2698005845 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce44160710 0x7fce440cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:27.509 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.505+0000 7fce41d9b700 1 -- 172.21.15.39:0/2698005845 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1681274491 0 0) 0x7fce440ad6c0 con 0x7fce440705c0 2023-11-28T11:57:27.509 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.505+0000 7fce41d9b700 1 -- 172.21.15.39:0/2698005845 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce300035d0 con 0x7fce440705c0 2023-11-28T11:57:27.509 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.505+0000 7fce4259c700 1 -- 172.21.15.39:0/2698005845 >> v2:172.21.15.184:3300/0 conn(0x7fce440cc860 msgr2=0x7fce44070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:27.509 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.505+0000 7fce4259c700 1 --2- 172.21.15.39:0/2698005845 >> v2:172.21.15.184:3300/0 conn(0x7fce440cc860 0x7fce44070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:27.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.505+0000 7fce4259c700 1 -- 172.21.15.39:0/2698005845 >> v1:172.21.15.184:6789/0 conn(0x7fce440705c0 legacy=0x7fce44069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:27.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.505+0000 7fce4259c700 1 -- 172.21.15.39:0/2698005845 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce440adc60 con 0x7fce44160710 2023-11-28T11:57:27.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.505+0000 7fce39d9b700 1 --2- 172.21.15.39:0/2698005845 >> v2:172.21.15.184:3300/0 conn(0x7fce440cc860 0x7fce44070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:27.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.505+0000 7fce4259c700 1 --2- 172.21.15.39:0/2698005845 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce44160710 0x7fce440cc320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fce34009d90 tx=0x7fce3400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33677aeb4fd0c29a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:27.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.505+0000 7fce41d9b700 1 -- 172.21.15.39:0/2698005845 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3400e070 con 0x7fce44160710 2023-11-28T11:57:27.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.505+0000 7fce41d9b700 1 -- 172.21.15.39:0/2698005845 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3400bb20 con 0x7fce44160710 2023-11-28T11:57:27.511 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.505+0000 7fce41d9b700 1 -- 172.21.15.39:0/2698005845 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce34012430 con 0x7fce44160710 2023-11-28T11:57:27.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.505+0000 7fce4359e700 1 -- 172.21.15.39:0/2698005845 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce44160710 msgr2=0x7fce440cc320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:27.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.505+0000 7fce4359e700 1 --2- 172.21.15.39:0/2698005845 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce44160710 0x7fce440cc320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fce34009d90 tx=0x7fce3400b330 comp rx=0 tx=0).stop 2023-11-28T11:57:27.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.505+0000 7fce4359e700 1 -- 172.21.15.39:0/2698005845 shutdown_connections 2023-11-28T11:57:27.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.505+0000 7fce4359e700 1 --2- 172.21.15.39:0/2698005845 >> v2:172.21.15.184:3300/0 conn(0x7fce440cc860 0x7fce44070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:27.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.505+0000 7fce4359e700 1 --2- 172.21.15.39:0/2698005845 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce44160710 0x7fce440cc320 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:27.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.505+0000 7fce4359e700 1 -- 172.21.15.39:0/2698005845 >> 172.21.15.39:0/2698005845 conn(0x7fce440b0f80 msgr2=0x7fce440ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:27.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.505+0000 7fce4359e700 1 -- 172.21.15.39:0/2698005845 shutdown_connections 2023-11-28T11:57:27.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.509+0000 7fce4359e700 1 -- 172.21.15.39:0/2698005845 wait complete. 2023-11-28T11:57:27.515 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.509+0000 7fce4359e700 1 Processor -- start 2023-11-28T11:57:27.515 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.509+0000 7fce4359e700 1 -- start start 2023-11-28T11:57:27.517 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.513+0000 7fce4359e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fce440705c0 0x7fce4415bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:27.517 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.513+0000 7fce4359e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce440cc860 0x7fce441f6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:27.517 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.513+0000 7fce4359e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce44160710 0x7fce440c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:27.517 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.513+0000 7fce4359e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4415ee60 con 0x7fce440705c0 2023-11-28T11:57:27.517 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.513+0000 7fce4359e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4415f280 con 0x7fce440cc860 2023-11-28T11:57:27.517 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.513+0000 7fce4359e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce4415e220 con 0x7fce44160710 2023-11-28T11:57:27.518 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.513+0000 7fce4259c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fce440705c0 0x7fce4415bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:27.518 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.513+0000 7fce4259c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fce440705c0 0x7fce4415bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37286/0 (socket says 172.21.15.39:37286) 2023-11-28T11:57:27.518 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.513+0000 7fce4259c700 1 -- 172.21.15.39:0/3655222524 learned_addr learned my addr 172.21.15.39:0/3655222524 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:27.518 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.513+0000 7fce39d9b700 1 --2- 172.21.15.39:0/3655222524 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce440cc860 0x7fce441f6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:27.518 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.513+0000 7fce42d9d700 1 --2- 172.21.15.39:0/3655222524 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce44160710 0x7fce440c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:27.519 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.513+0000 7fce4259c700 1 -- 172.21.15.39:0/3655222524 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce44160710 msgr2=0x7fce440c3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:27.519 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.513+0000 7fce4259c700 1 --2- 172.21.15.39:0/3655222524 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce44160710 0x7fce440c3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:27.519 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.513+0000 7fce4259c700 1 -- 172.21.15.39:0/3655222524 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce440cc860 msgr2=0x7fce441f6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:27.519 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.513+0000 7fce4259c700 1 --2- 172.21.15.39:0/3655222524 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce440cc860 0x7fce441f6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:27.519 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.513+0000 7fce4259c700 1 -- 172.21.15.39:0/3655222524 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce2c0094b0 con 0x7fce440705c0 2023-11-28T11:57:27.519 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.513+0000 7fce39d9b700 1 --2- 172.21.15.39:0/3655222524 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce440cc860 0x7fce441f6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:27.519 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.513+0000 7fce4259c700 1 --2- 172.21.15.39:0/3655222524 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fce440705c0 0x7fce4415bb20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fce34014040 tx=0x7fce34004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:27.520 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.513+0000 7fce3b7fe700 1 -- 172.21.15.39:0/3655222524 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce34004880 con 0x7fce440705c0 2023-11-28T11:57:27.520 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.513+0000 7fce3b7fe700 1 -- 172.21.15.39:0/3655222524 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce34020070 con 0x7fce440705c0 2023-11-28T11:57:27.520 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.513+0000 7fce4359e700 1 -- 172.21.15.39:0/3655222524 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce34009a70 con 0x7fce440705c0 2023-11-28T11:57:27.520 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.513+0000 7fce3b7fe700 1 -- 172.21.15.39:0/3655222524 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce340276c0 con 0x7fce440705c0 2023-11-28T11:57:27.520 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.517+0000 7fce4359e700 1 -- 172.21.15.39:0/3655222524 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce4406b6b0 con 0x7fce440705c0 2023-11-28T11:57:27.521 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.517+0000 7fce4359e700 1 -- 172.21.15.39:0/3655222524 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce4406b3d0 con 0x7fce440705c0 2023-11-28T11:57:27.523 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.517+0000 7fce3b7fe700 1 -- 172.21.15.39:0/3655222524 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fce34012430 con 0x7fce440705c0 2023-11-28T11:57:27.525 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.521+0000 7fce3b7fe700 1 --2- 172.21.15.39:0/3655222524 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fce24064ee0 0x7fce24067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:27.525 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.521+0000 7fce3b7fe700 1 -- 172.21.15.39:0/3655222524 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fce34022070 con 0x7fce440705c0 2023-11-28T11:57:27.526 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.521+0000 7fce39d9b700 1 --2- 172.21.15.39:0/3655222524 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fce24064ee0 0x7fce24067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:27.527 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.521+0000 7fce39d9b700 1 --2- 172.21.15.39:0/3655222524 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fce24064ee0 0x7fce24067390 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fce440cbcc0 tx=0x7fce2c009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:27.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.525+0000 7fce3b7fe700 1 -- 172.21.15.39:0/3655222524 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fce34052270 con 0x7fce440705c0 2023-11-28T11:57:27.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.697+0000 7fce4359e700 1 -- 172.21.15.39:0/3655222524 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce440ad8f0 con 0x7fce440705c0 2023-11-28T11:57:27.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.701+0000 7fce3b7fe700 1 -- 172.21.15.39:0/3655222524 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+19748 (secure 0 0 0) 0x7fce34055890 con 0x7fce440705c0 2023-11-28T11:57:27.707 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:57:27.707 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":31,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:57:21.927556+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:56:38.203736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:56:38.946498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:56:41.988334+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.10","mappings":[{"from":1,"to":5}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:57:27.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.705+0000 7fce4359e700 1 -- 172.21.15.39:0/3655222524 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fce24064ee0 msgr2=0x7fce24067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:27.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.705+0000 7fce4359e700 1 --2- 172.21.15.39:0/3655222524 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fce24064ee0 0x7fce24067390 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fce440cbcc0 tx=0x7fce2c009240 comp rx=0 tx=0).stop 2023-11-28T11:57:27.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.705+0000 7fce4359e700 1 -- 172.21.15.39:0/3655222524 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fce440705c0 msgr2=0x7fce4415bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:27.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.705+0000 7fce4359e700 1 --2- 172.21.15.39:0/3655222524 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fce440705c0 0x7fce4415bb20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fce34014040 tx=0x7fce34004af0 comp rx=0 tx=0).stop 2023-11-28T11:57:27.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.705+0000 7fce4359e700 1 -- 172.21.15.39:0/3655222524 shutdown_connections 2023-11-28T11:57:27.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.705+0000 7fce4359e700 1 --2- 172.21.15.39:0/3655222524 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce44160710 0x7fce440c3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:27.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.705+0000 7fce4359e700 1 --2- 172.21.15.39:0/3655222524 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fce24064ee0 0x7fce24067390 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:27.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.709+0000 7fce4359e700 1 --2- 172.21.15.39:0/3655222524 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce440cc860 0x7fce441f6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:27.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.709+0000 7fce4359e700 1 --2- 172.21.15.39:0/3655222524 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fce440705c0 0x7fce4415bb20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:27.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.709+0000 7fce4359e700 1 -- 172.21.15.39:0/3655222524 >> 172.21.15.39:0/3655222524 conn(0x7fce440b0f80 msgr2=0x7fce440af870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:27.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.709+0000 7fce4359e700 1 -- 172.21.15.39:0/3655222524 shutdown_connections 2023-11-28T11:57:27.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.709+0000 7fce4359e700 1 -- 172.21.15.39:0/3655222524 wait complete. 2023-11-28T11:57:27.736 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:56:26.631457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:56:33.242202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:56:38.203736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:56:38.946498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T11:56:41.988334+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T11:57:27.737 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:57:27.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.913+0000 7fcefe066700 1 Processor -- start 2023-11-28T11:57:27.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.913+0000 7fcefe066700 1 -- start start 2023-11-28T11:57:27.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.913+0000 7fcefe066700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fcef8070620 0x7fcef80b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:27.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.913+0000 7fcefe066700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcef8069bf0 0x7fcef806a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:27.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.913+0000 7fcefe066700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcef815c520 con 0x7fcef815c150 2023-11-28T11:57:27.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.913+0000 7fcefe066700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcef80b4240 con 0x7fcef8070620 2023-11-28T11:57:27.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.913+0000 7fcefe066700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef806cc50 con 0x7fcef8069bf0 2023-11-28T11:57:27.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.913+0000 7fcefc863700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fcef8070620 0x7fcef80b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:27.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.913+0000 7fcefd064700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fcef815c150 0x7fcef806ff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:46438/0 (socket says 172.21.15.39:46438) 2023-11-28T11:57:27.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.913+0000 7fcefd064700 1 -- 172.21.15.39:0/530963043 learned_addr learned my addr 172.21.15.39:0/530963043 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:27.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.913+0000 7fcefd865700 1 --2- 172.21.15.39:0/530963043 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcef8069bf0 0x7fcef806a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:27.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.917+0000 7fcefc863700 1 -- 172.21.15.39:0/530963043 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcef8069bf0 msgr2=0x7fcef806a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:27.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.917+0000 7fcefc863700 1 --2- 172.21.15.39:0/530963043 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcef8069bf0 0x7fcef806a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:27.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.917+0000 7fcefc863700 1 -- 172.21.15.39:0/530963043 >> v1:172.21.15.39:6789/0 conn(0x7fcef815c150 legacy=0x7fcef806ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:27.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.917+0000 7fcefc863700 1 -- 172.21.15.39:0/530963043 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef80d2450 con 0x7fcef8070620 2023-11-28T11:57:27.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.917+0000 7fceeffff700 1 -- 172.21.15.39:0/530963043 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2807025265 0 0) 0x7fcef815c520 con 0x7fcef815c150 2023-11-28T11:57:27.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.917+0000 7fcefc863700 1 --2- 172.21.15.39:0/530963043 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcef8070620 0x7fcef80b3d00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcee8009840 tx=0x7fcee8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3828031fb52b0427 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:27.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.917+0000 7fceeffff700 1 -- 172.21.15.39:0/530963043 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee8011830 con 0x7fcef8070620 2023-11-28T11:57:27.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.917+0000 7fceeffff700 1 -- 172.21.15.39:0/530963043 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee8011990 con 0x7fcef8070620 2023-11-28T11:57:27.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.917+0000 7fceeffff700 1 -- 172.21.15.39:0/530963043 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee8011d20 con 0x7fcef8070620 2023-11-28T11:57:27.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.917+0000 7fcefe066700 1 -- 172.21.15.39:0/530963043 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcef8070620 msgr2=0x7fcef80b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:27.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.917+0000 7fcefe066700 1 --2- 172.21.15.39:0/530963043 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcef8070620 0x7fcef80b3d00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcee8009840 tx=0x7fcee8009b50 comp rx=0 tx=0).stop 2023-11-28T11:57:27.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.917+0000 7fcefe066700 1 -- 172.21.15.39:0/530963043 shutdown_connections 2023-11-28T11:57:27.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.917+0000 7fcefe066700 1 --2- 172.21.15.39:0/530963043 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcef8069bf0 0x7fcef806a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:27.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.917+0000 7fcefe066700 1 --2- 172.21.15.39:0/530963043 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcef8070620 0x7fcef80b3d00 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:27.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.917+0000 7fcefe066700 1 -- 172.21.15.39:0/530963043 >> 172.21.15.39:0/530963043 conn(0x7fcef80d3680 msgr2=0x7fcef80cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:27.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.917+0000 7fcefe066700 1 -- 172.21.15.39:0/530963043 shutdown_connections 2023-11-28T11:57:27.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.917+0000 7fcefe066700 1 -- 172.21.15.39:0/530963043 wait complete. 2023-11-28T11:57:27.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.921+0000 7fcefe066700 1 Processor -- start 2023-11-28T11:57:27.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.921+0000 7fcefe066700 1 -- start start 2023-11-28T11:57:27.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.921+0000 7fcefe066700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcef8069bf0 0x7fcef80b7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:27.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.921+0000 7fcefe066700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcef8070620 0x7fcef80cd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:27.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.921+0000 7fcefe066700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcef815c150 0x7fcef8158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:27.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.921+0000 7fcefe066700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef8140290 con 0x7fcef815c150 2023-11-28T11:57:27.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.921+0000 7fcefe066700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef80b7990 con 0x7fcef8070620 2023-11-28T11:57:27.929 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.921+0000 7fcefe066700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef80b7c70 con 0x7fcef8069bf0 2023-11-28T11:57:27.929 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.921+0000 7fcefd865700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcef815c150 0x7fcef8158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:27.929 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.921+0000 7fcefd865700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcef815c150 0x7fcef8158980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37310/0 (socket says 172.21.15.39:37310) 2023-11-28T11:57:27.929 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.921+0000 7fcefd865700 1 -- 172.21.15.39:0/1912190373 learned_addr learned my addr 172.21.15.39:0/1912190373 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:27.929 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.921+0000 7fcefd064700 1 --2- 172.21.15.39:0/1912190373 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcef8069bf0 0x7fcef80b7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:27.930 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.921+0000 7fcefc863700 1 --2- 172.21.15.39:0/1912190373 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcef8070620 0x7fcef80cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:27.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.925+0000 7fcefd865700 1 -- 172.21.15.39:0/1912190373 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcef8069bf0 msgr2=0x7fcef80b7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:27.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.925+0000 7fcefd865700 1 --2- 172.21.15.39:0/1912190373 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcef8069bf0 0x7fcef80b7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:27.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.925+0000 7fcefd865700 1 -- 172.21.15.39:0/1912190373 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcef8070620 msgr2=0x7fcef80cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:27.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.925+0000 7fcefd865700 1 --2- 172.21.15.39:0/1912190373 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcef8070620 0x7fcef80cd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:27.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.925+0000 7fcefd865700 1 -- 172.21.15.39:0/1912190373 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee8009450 con 0x7fcef815c150 2023-11-28T11:57:27.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.925+0000 7fcefc863700 1 --2- 172.21.15.39:0/1912190373 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcef8070620 0x7fcef80cd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:57:27.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.925+0000 7fcefd865700 1 --2- 172.21.15.39:0/1912190373 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcef815c150 0x7fcef8158980 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcef000efc0 tx=0x7fcef000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:27.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.925+0000 7fceedffb700 1 -- 172.21.15.39:0/1912190373 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef0009ea0 con 0x7fcef815c150 2023-11-28T11:57:27.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.925+0000 7fceedffb700 1 -- 172.21.15.39:0/1912190373 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef000f040 con 0x7fcef815c150 2023-11-28T11:57:27.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.925+0000 7fcefe066700 1 -- 172.21.15.39:0/1912190373 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcef80d05e0 con 0x7fcef815c150 2023-11-28T11:57:27.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.925+0000 7fceedffb700 1 -- 172.21.15.39:0/1912190373 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef0014480 con 0x7fcef815c150 2023-11-28T11:57:27.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.925+0000 7fcefe066700 1 -- 172.21.15.39:0/1912190373 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcef80d2730 con 0x7fcef815c150 2023-11-28T11:57:27.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.925+0000 7fcefe066700 1 -- 172.21.15.39:0/1912190373 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcef80d2140 con 0x7fcef815c150 2023-11-28T11:57:27.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.929+0000 7fceedffb700 1 -- 172.21.15.39:0/1912190373 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fcef00145e0 con 0x7fcef815c150 2023-11-28T11:57:27.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.929+0000 7fceedffb700 1 --2- 172.21.15.39:0/1912190373 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcedc064f10 0x7fcedc0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:27.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.929+0000 7fceedffb700 1 -- 172.21.15.39:0/1912190373 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcef0082c70 con 0x7fcef815c150 2023-11-28T11:57:27.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.929+0000 7fcefd064700 1 --2- 172.21.15.39:0/1912190373 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcedc064f10 0x7fcedc0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:27.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.933+0000 7fcefd064700 1 --2- 172.21.15.39:0/1912190373 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcedc064f10 0x7fcedc0673c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcef4000f60 tx=0x7fcef4007e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:27.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:27.937+0000 7fceedffb700 1 -- 172.21.15.39:0/1912190373 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcef00509f0 con 0x7fcef815c150 2023-11-28T11:57:28.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.117+0000 7fcefe066700 1 -- 172.21.15.39:0/1912190373 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcef8155fc0 con 0x7fcef815c150 2023-11-28T11:57:28.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.117+0000 7fceedffb700 1 -- 172.21.15.39:0/1912190373 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcef0054010 con 0x7fcef815c150 2023-11-28T11:57:28.123 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-11-28T11:57:28.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.121+0000 7fcefe066700 1 -- 172.21.15.39:0/1912190373 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcedc064f10 msgr2=0x7fcedc0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:28.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.121+0000 7fcefe066700 1 --2- 172.21.15.39:0/1912190373 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcedc064f10 0x7fcedc0673c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcef4000f60 tx=0x7fcef4007e90 comp rx=0 tx=0).stop 2023-11-28T11:57:28.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.121+0000 7fcefe066700 1 -- 172.21.15.39:0/1912190373 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcef815c150 msgr2=0x7fcef8158980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:28.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.121+0000 7fcefe066700 1 --2- 172.21.15.39:0/1912190373 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcef815c150 0x7fcef8158980 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcef000efc0 tx=0x7fcef000c3a0 comp rx=0 tx=0).stop 2023-11-28T11:57:28.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.121+0000 7fcefe066700 1 -- 172.21.15.39:0/1912190373 shutdown_connections 2023-11-28T11:57:28.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.121+0000 7fcefe066700 1 --2- 172.21.15.39:0/1912190373 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcef815c150 0x7fcef8158980 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:28.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.121+0000 7fcefe066700 1 --2- 172.21.15.39:0/1912190373 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcedc064f10 0x7fcedc0673c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:28.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.121+0000 7fcefe066700 1 --2- 172.21.15.39:0/1912190373 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcef8070620 0x7fcef80cd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:28.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.121+0000 7fcefe066700 1 --2- 172.21.15.39:0/1912190373 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcef8069bf0 0x7fcef80b7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:28.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.121+0000 7fcefe066700 1 -- 172.21.15.39:0/1912190373 >> 172.21.15.39:0/1912190373 conn(0x7fcef80d3680 msgr2=0x7fcef80c8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:28.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.121+0000 7fcefe066700 1 -- 172.21.15.39:0/1912190373 shutdown_connections 2023-11-28T11:57:28.127 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.121+0000 7fcefe066700 1 -- 172.21.15.39:0/1912190373 wait complete. 2023-11-28T11:57:28.150 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:57:28.327 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.321+0000 7fe106e16700 1 Processor -- start 2023-11-28T11:57:28.327 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.321+0000 7fe106e16700 1 -- start start 2023-11-28T11:57:28.330 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.325+0000 7fe106e16700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe100070a00 0x7fe100069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:28.330 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.325+0000 7fe106e16700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1000cd360 con 0x7fe1000b2130 2023-11-28T11:57:28.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.325+0000 7fe106e16700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe100160190 con 0x7fe10015c700 2023-11-28T11:57:28.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.325+0000 7fe106e16700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe100160470 con 0x7fe100070a00 2023-11-28T11:57:28.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.325+0000 7fe0fffff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe100070a00 0x7fe100069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:28.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.325+0000 7fe104bb2700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fe10015c700 0x7fe1000702f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:48288/0 (socket says 172.21.15.39:48288) 2023-11-28T11:57:28.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.325+0000 7fe1053b3700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fe1000b2130 0x7fe10006a130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:51264/0 (socket says 172.21.15.39:51264) 2023-11-28T11:57:28.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.325+0000 7fe104bb2700 1 -- 172.21.15.39:0/3507993332 learned_addr learned my addr 172.21.15.39:0/3507993332 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:28.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.325+0000 7fe0ff7fe700 1 -- 172.21.15.39:0/3507993332 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4052243664 0 0) 0x7fe1000cd360 con 0x7fe1000b2130 2023-11-28T11:57:28.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.329+0000 7fe0ff7fe700 1 -- 172.21.15.39:0/3507993332 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0f00035d0 con 0x7fe1000b2130 2023-11-28T11:57:28.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.329+0000 7fe0fffff700 1 -- 172.21.15.39:0/3507993332 >> v1:172.21.15.184:6789/0 conn(0x7fe10015c700 legacy=0x7fe1000702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:28.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.329+0000 7fe0ff7fe700 1 -- 172.21.15.39:0/3507993332 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2887785346 0 0) 0x7fe100160190 con 0x7fe10015c700 2023-11-28T11:57:28.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.329+0000 7fe0fffff700 1 -- 172.21.15.39:0/3507993332 >> v1:172.21.15.39:6789/0 conn(0x7fe1000b2130 legacy=0x7fe10006a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:28.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.329+0000 7fe0fffff700 1 -- 172.21.15.39:0/3507993332 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe100160750 con 0x7fe100070a00 2023-11-28T11:57:28.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.329+0000 7fe0fffff700 1 --2- 172.21.15.39:0/3507993332 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe100070a00 0x7fe100069bf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec009850 tx=0x7fe0ec009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=751f5e05e830001e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:28.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.329+0000 7fe0ff7fe700 1 -- 172.21.15.39:0/3507993332 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec011830 con 0x7fe100070a00 2023-11-28T11:57:28.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.329+0000 7fe0ff7fe700 1 -- 172.21.15.39:0/3507993332 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ec011990 con 0x7fe100070a00 2023-11-28T11:57:28.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.329+0000 7fe0ff7fe700 1 -- 172.21.15.39:0/3507993332 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec011d40 con 0x7fe100070a00 2023-11-28T11:57:28.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.329+0000 7fe106e16700 1 -- 172.21.15.39:0/3507993332 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe100070a00 msgr2=0x7fe100069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:28.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.329+0000 7fe106e16700 1 --2- 172.21.15.39:0/3507993332 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe100070a00 0x7fe100069bf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec009850 tx=0x7fe0ec009b60 comp rx=0 tx=0).stop 2023-11-28T11:57:28.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.329+0000 7fe106e16700 1 -- 172.21.15.39:0/3507993332 shutdown_connections 2023-11-28T11:57:28.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.329+0000 7fe106e16700 1 --2- 172.21.15.39:0/3507993332 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe100070a00 0x7fe100069bf0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:28.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.329+0000 7fe106e16700 1 -- 172.21.15.39:0/3507993332 >> 172.21.15.39:0/3507993332 conn(0x7fe1000d2d10 msgr2=0x7fe1000d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:28.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.329+0000 7fe106e16700 1 -- 172.21.15.39:0/3507993332 shutdown_connections 2023-11-28T11:57:28.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.329+0000 7fe106e16700 1 -- 172.21.15.39:0/3507993332 wait complete. 2023-11-28T11:57:28.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.333+0000 7fe106e16700 1 Processor -- start 2023-11-28T11:57:28.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.333+0000 7fe106e16700 1 -- start start 2023-11-28T11:57:28.339 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.333+0000 7fe106e16700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe100070a00 0x7fe10015f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:28.339 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.333+0000 7fe106e16700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1000b2130 0x7fe1001f6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:28.339 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.333+0000 7fe106e16700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe10015c700 0x7fe1000b7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:28.339 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.333+0000 7fe106e16700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10015e490 con 0x7fe100070a00 2023-11-28T11:57:28.339 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.333+0000 7fe106e16700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10015d880 con 0x7fe1000b2130 2023-11-28T11:57:28.339 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.333+0000 7fe106e16700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe10015db60 con 0x7fe10015c700 2023-11-28T11:57:28.340 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.333+0000 7fe104bb2700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe100070a00 0x7fe10015f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:28.340 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.333+0000 7fe104bb2700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe100070a00 0x7fe10015f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56342/0 (socket says 172.21.15.39:56342) 2023-11-28T11:57:28.340 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.333+0000 7fe104bb2700 1 -- 172.21.15.39:0/3949320335 learned_addr learned my addr 172.21.15.39:0/3949320335 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:28.340 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.333+0000 7fe0fffff700 1 --2- 172.21.15.39:0/3949320335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1000b2130 0x7fe1001f6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:28.340 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.333+0000 7fe1053b3700 1 --2- 172.21.15.39:0/3949320335 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe10015c700 0x7fe1000b7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:28.340 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.337+0000 7fe104bb2700 1 -- 172.21.15.39:0/3949320335 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe10015c700 msgr2=0x7fe1000b7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:28.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.337+0000 7fe104bb2700 1 --2- 172.21.15.39:0/3949320335 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe10015c700 0x7fe1000b7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:28.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.337+0000 7fe104bb2700 1 -- 172.21.15.39:0/3949320335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1000b2130 msgr2=0x7fe1001f6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:28.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.337+0000 7fe104bb2700 1 --2- 172.21.15.39:0/3949320335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1000b2130 0x7fe1001f6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:28.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.337+0000 7fe104bb2700 1 -- 172.21.15.39:0/3949320335 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ec0094b0 con 0x7fe100070a00 2023-11-28T11:57:28.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.337+0000 7fe1053b3700 1 --2- 172.21.15.39:0/3949320335 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe10015c700 0x7fe1000b7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:57:28.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.337+0000 7fe104bb2700 1 --2- 172.21.15.39:0/3949320335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe100070a00 0x7fe10015f570 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe0f400c4a0 tx=0x7fe0f400c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:28.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.337+0000 7fe0fd7fa700 1 -- 172.21.15.39:0/3949320335 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f4004ca0 con 0x7fe100070a00 2023-11-28T11:57:28.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.337+0000 7fe0fd7fa700 1 -- 172.21.15.39:0/3949320335 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f4004e00 con 0x7fe100070a00 2023-11-28T11:57:28.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.337+0000 7fe106e16700 1 -- 172.21.15.39:0/3949320335 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe10006b530 con 0x7fe100070a00 2023-11-28T11:57:28.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.337+0000 7fe0fd7fa700 1 -- 172.21.15.39:0/3949320335 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f4007310 con 0x7fe100070a00 2023-11-28T11:57:28.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.337+0000 7fe106e16700 1 -- 172.21.15.39:0/3949320335 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe100160a30 con 0x7fe100070a00 2023-11-28T11:57:28.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.337+0000 7fe106e16700 1 -- 172.21.15.39:0/3949320335 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1000b1be0 con 0x7fe100070a00 2023-11-28T11:57:28.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.341+0000 7fe0fd7fa700 1 -- 172.21.15.39:0/3949320335 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe0f401a020 con 0x7fe100070a00 2023-11-28T11:57:28.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.341+0000 7fe0fd7fa700 1 --2- 172.21.15.39:0/3949320335 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe0e4064f10 0x7fe0e40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:28.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.341+0000 7fe0fd7fa700 1 -- 172.21.15.39:0/3949320335 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe0f4081d50 con 0x7fe100070a00 2023-11-28T11:57:28.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.345+0000 7fe0fffff700 1 --2- 172.21.15.39:0/3949320335 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe0e4064f10 0x7fe0e40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:28.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.345+0000 7fe0fffff700 1 --2- 172.21.15.39:0/3949320335 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe0e4064f10 0x7fe0e40673c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe100070df0 tx=0x7fe0ec008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:28.354 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.349+0000 7fe0fd7fa700 1 -- 172.21.15.39:0/3949320335 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe0f404fa70 con 0x7fe100070a00 2023-11-28T11:57:28.526 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.521+0000 7fe106e16700 1 -- 172.21.15.39:0/3949320335 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe1000726c0 con 0x7fe100070a00 2023-11-28T11:57:28.527 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.521+0000 7fe0fd7fa700 1 -- 172.21.15.39:0/3949320335 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe0f4081030 con 0x7fe100070a00 2023-11-28T11:57:28.527 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-11-28T11:57:28.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.525+0000 7fe106e16700 1 -- 172.21.15.39:0/3949320335 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe0e4064f10 msgr2=0x7fe0e40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:28.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.525+0000 7fe106e16700 1 --2- 172.21.15.39:0/3949320335 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe0e4064f10 0x7fe0e40673c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe100070df0 tx=0x7fe0ec008030 comp rx=0 tx=0).stop 2023-11-28T11:57:28.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.525+0000 7fe106e16700 1 -- 172.21.15.39:0/3949320335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe100070a00 msgr2=0x7fe10015f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:28.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.525+0000 7fe106e16700 1 --2- 172.21.15.39:0/3949320335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe100070a00 0x7fe10015f570 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe0f400c4a0 tx=0x7fe0f400c7b0 comp rx=0 tx=0).stop 2023-11-28T11:57:28.531 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.525+0000 7fe106e16700 1 -- 172.21.15.39:0/3949320335 shutdown_connections 2023-11-28T11:57:28.531 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.525+0000 7fe106e16700 1 --2- 172.21.15.39:0/3949320335 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe10015c700 0x7fe1000b7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:28.531 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.525+0000 7fe106e16700 1 --2- 172.21.15.39:0/3949320335 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe0e4064f10 0x7fe0e40673c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:28.531 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.525+0000 7fe106e16700 1 --2- 172.21.15.39:0/3949320335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1000b2130 0x7fe1001f6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:28.531 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.525+0000 7fe106e16700 1 --2- 172.21.15.39:0/3949320335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe100070a00 0x7fe10015f570 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:28.531 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.525+0000 7fe106e16700 1 -- 172.21.15.39:0/3949320335 >> 172.21.15.39:0/3949320335 conn(0x7fe1000d2d10 msgr2=0x7fe1000b26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:28.531 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.525+0000 7fe106e16700 1 -- 172.21.15.39:0/3949320335 shutdown_connections 2023-11-28T11:57:28.531 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.525+0000 7fe106e16700 1 -- 172.21.15.39:0/3949320335 wait complete. 2023-11-28T11:57:28.553 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:57:28.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.737+0000 7fb19aad5700 1 Processor -- start 2023-11-28T11:57:28.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.737+0000 7fb19aad5700 1 -- start start 2023-11-28T11:57:28.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.741+0000 7fb19aad5700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb194159f10 0x7fb194070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:28.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.741+0000 7fb19aad5700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1940c8c90 0x7fb19406b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:28.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.741+0000 7fb19aad5700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb19415a2e0 0x7fb19415a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:28.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.741+0000 7fb19aad5700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1940c9130 con 0x7fb194159f10 2023-11-28T11:57:28.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.741+0000 7fb19aad5700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb19406b840 con 0x7fb1940c8c90 2023-11-28T11:57:28.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.741+0000 7fb19aad5700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb194070600 con 0x7fb19415a2e0 2023-11-28T11:57:28.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.741+0000 7fb199ad3700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb194159f10 0x7fb194070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:28.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.741+0000 7fb199ad3700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb194159f10 0x7fb194070a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56350/0 (socket says 172.21.15.39:56350) 2023-11-28T11:57:28.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.741+0000 7fb199ad3700 1 -- 172.21.15.39:0/1939903933 learned_addr learned my addr 172.21.15.39:0/1939903933 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:28.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.741+0000 7fb19a2d4700 1 --2- 172.21.15.39:0/1939903933 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb19415a2e0 0x7fb19415a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:28.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.741+0000 7fb1992d2700 1 --2- 172.21.15.39:0/1939903933 >> v2:172.21.15.184:3300/0 conn(0x7fb1940c8c90 0x7fb19406b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:28.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.741+0000 7fb199ad3700 1 -- 172.21.15.39:0/1939903933 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb19415a2e0 msgr2=0x7fb19415a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:28.747 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.741+0000 7fb199ad3700 1 --2- 172.21.15.39:0/1939903933 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb19415a2e0 0x7fb19415a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:28.747 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.741+0000 7fb199ad3700 1 -- 172.21.15.39:0/1939903933 >> v2:172.21.15.184:3300/0 conn(0x7fb1940c8c90 msgr2=0x7fb19406b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:28.747 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.741+0000 7fb199ad3700 1 --2- 172.21.15.39:0/1939903933 >> v2:172.21.15.184:3300/0 conn(0x7fb1940c8c90 0x7fb19406b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:28.747 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.741+0000 7fb199ad3700 1 -- 172.21.15.39:0/1939903933 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1940afcc0 con 0x7fb194159f10 2023-11-28T11:57:28.748 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.741+0000 7fb1992d2700 1 --2- 172.21.15.39:0/1939903933 >> v2:172.21.15.184:3300/0 conn(0x7fb1940c8c90 0x7fb19406b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:28.748 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.741+0000 7fb199ad3700 1 --2- 172.21.15.39:0/1939903933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb194159f10 0x7fb194070a90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb1940c93e0 tx=0x7fb190009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d54558e8266400 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:28.748 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.741+0000 7fb198ad1700 1 -- 172.21.15.39:0/1939903933 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb190011830 con 0x7fb194159f10 2023-11-28T11:57:28.748 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.745+0000 7fb198ad1700 1 -- 172.21.15.39:0/1939903933 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb190011990 con 0x7fb194159f10 2023-11-28T11:57:28.748 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.745+0000 7fb198ad1700 1 -- 172.21.15.39:0/1939903933 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb190011d20 con 0x7fb194159f10 2023-11-28T11:57:28.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.745+0000 7fb19aad5700 1 -- 172.21.15.39:0/1939903933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb194159f10 msgr2=0x7fb194070a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:28.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.745+0000 7fb19aad5700 1 --2- 172.21.15.39:0/1939903933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb194159f10 0x7fb194070a90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb1940c93e0 tx=0x7fb190009bf0 comp rx=0 tx=0).stop 2023-11-28T11:57:28.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.745+0000 7fb19aad5700 1 -- 172.21.15.39:0/1939903933 shutdown_connections 2023-11-28T11:57:28.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.745+0000 7fb19aad5700 1 --2- 172.21.15.39:0/1939903933 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb19415a2e0 0x7fb19415a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:28.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.745+0000 7fb19aad5700 1 --2- 172.21.15.39:0/1939903933 >> v2:172.21.15.184:3300/0 conn(0x7fb1940c8c90 0x7fb19406b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:28.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.745+0000 7fb19aad5700 1 --2- 172.21.15.39:0/1939903933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb194159f10 0x7fb194070a90 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:28.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.745+0000 7fb19aad5700 1 -- 172.21.15.39:0/1939903933 >> 172.21.15.39:0/1939903933 conn(0x7fb1940cf280 msgr2=0x7fb1940cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:28.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.745+0000 7fb19aad5700 1 -- 172.21.15.39:0/1939903933 shutdown_connections 2023-11-28T11:57:28.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.745+0000 7fb19aad5700 1 -- 172.21.15.39:0/1939903933 wait complete. 2023-11-28T11:57:28.751 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.745+0000 7fb19aad5700 1 Processor -- start 2023-11-28T11:57:28.751 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.745+0000 7fb19aad5700 1 -- start start 2023-11-28T11:57:28.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.749+0000 7fb19aad5700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1940c8c90 0x7fb19414a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:28.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.749+0000 7fb19aad5700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb194159f10 0x7fb1940c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:28.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.749+0000 7fb19aad5700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb19415a2e0 0x7fb1940c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:28.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.749+0000 7fb19aad5700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1941f2f40 con 0x7fb194159f10 2023-11-28T11:57:28.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.749+0000 7fb19aad5700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1941f31e0 con 0x7fb1940c8c90 2023-11-28T11:57:28.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.749+0000 7fb19aad5700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1941f34c0 con 0x7fb19415a2e0 2023-11-28T11:57:28.754 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.749+0000 7fb1992d2700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb194159f10 0x7fb1940c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:28.754 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.749+0000 7fb1992d2700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb194159f10 0x7fb1940c7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56356/0 (socket says 172.21.15.39:56356) 2023-11-28T11:57:28.754 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.749+0000 7fb1992d2700 1 -- 172.21.15.39:0/3363543146 learned_addr learned my addr 172.21.15.39:0/3363543146 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:28.755 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.749+0000 7fb19a2d4700 1 --2- 172.21.15.39:0/3363543146 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb19415a2e0 0x7fb1940c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:28.755 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.749+0000 7fb199ad3700 1 --2- 172.21.15.39:0/3363543146 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1940c8c90 0x7fb19414a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:28.755 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.749+0000 7fb1992d2700 1 -- 172.21.15.39:0/3363543146 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb19415a2e0 msgr2=0x7fb1940c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:28.755 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.749+0000 7fb1992d2700 1 --2- 172.21.15.39:0/3363543146 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb19415a2e0 0x7fb1940c81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:28.755 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.749+0000 7fb1992d2700 1 -- 172.21.15.39:0/3363543146 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1940c8c90 msgr2=0x7fb19414a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:28.755 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.749+0000 7fb1992d2700 1 --2- 172.21.15.39:0/3363543146 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1940c8c90 0x7fb19414a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:28.755 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.749+0000 7fb1992d2700 1 -- 172.21.15.39:0/3363543146 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1840094b0 con 0x7fb194159f10 2023-11-28T11:57:28.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.749+0000 7fb1992d2700 1 --2- 172.21.15.39:0/3363543146 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb194159f10 0x7fb1940c7c80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb18400ebe0 tx=0x7fb18400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:28.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.749+0000 7fb18a7fc700 1 -- 172.21.15.39:0/3363543146 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18400c850 con 0x7fb194159f10 2023-11-28T11:57:28.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.749+0000 7fb18a7fc700 1 -- 172.21.15.39:0/3363543146 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18400c9b0 con 0x7fb194159f10 2023-11-28T11:57:28.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.749+0000 7fb19aad5700 1 -- 172.21.15.39:0/3363543146 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb190009570 con 0x7fb194159f10 2023-11-28T11:57:28.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.749+0000 7fb18a7fc700 1 -- 172.21.15.39:0/3363543146 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18400cd40 con 0x7fb194159f10 2023-11-28T11:57:28.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.749+0000 7fb19aad5700 1 -- 172.21.15.39:0/3363543146 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb194070290 con 0x7fb194159f10 2023-11-28T11:57:28.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.753+0000 7fb19aad5700 1 -- 172.21.15.39:0/3363543146 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb19406ffb0 con 0x7fb194159f10 2023-11-28T11:57:28.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.753+0000 7fb18a7fc700 1 -- 172.21.15.39:0/3363543146 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb184019030 con 0x7fb194159f10 2023-11-28T11:57:28.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.757+0000 7fb18a7fc700 1 --2- 172.21.15.39:0/3363543146 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb178064ee0 0x7fb178067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:28.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.757+0000 7fb18a7fc700 1 -- 172.21.15.39:0/3363543146 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb184082200 con 0x7fb194159f10 2023-11-28T11:57:28.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.757+0000 7fb199ad3700 1 --2- 172.21.15.39:0/3363543146 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb178064ee0 0x7fb178067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:28.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.757+0000 7fb199ad3700 1 --2- 172.21.15.39:0/3363543146 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb178064ee0 0x7fb178067390 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb190000c00 tx=0x7fb190008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:28.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.761+0000 7fb18a7fc700 1 -- 172.21.15.39:0/3363543146 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb18404ff80 con 0x7fb194159f10 2023-11-28T11:57:28.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.933+0000 7fb19aad5700 1 -- 172.21.15.39:0/3363543146 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb19406cf30 con 0x7fb194159f10 2023-11-28T11:57:28.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.937+0000 7fb18a7fc700 1 -- 172.21.15.39:0/3363543146 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb18400cea0 con 0x7fb194159f10 2023-11-28T11:57:28.941 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-11-28T11:57:28.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.937+0000 7fb19aad5700 1 -- 172.21.15.39:0/3363543146 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb178064ee0 msgr2=0x7fb178067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:28.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.937+0000 7fb19aad5700 1 --2- 172.21.15.39:0/3363543146 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb178064ee0 0x7fb178067390 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb190000c00 tx=0x7fb190008030 comp rx=0 tx=0).stop 2023-11-28T11:57:28.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.937+0000 7fb19aad5700 1 -- 172.21.15.39:0/3363543146 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb194159f10 msgr2=0x7fb1940c7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:28.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.937+0000 7fb19aad5700 1 --2- 172.21.15.39:0/3363543146 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb194159f10 0x7fb1940c7c80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb18400ebe0 tx=0x7fb18400eef0 comp rx=0 tx=0).stop 2023-11-28T11:57:28.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.937+0000 7fb19aad5700 1 -- 172.21.15.39:0/3363543146 shutdown_connections 2023-11-28T11:57:28.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.937+0000 7fb19aad5700 1 --2- 172.21.15.39:0/3363543146 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb19415a2e0 0x7fb1940c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:28.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.937+0000 7fb19aad5700 1 --2- 172.21.15.39:0/3363543146 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb194159f10 0x7fb1940c7c80 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:28.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.937+0000 7fb19aad5700 1 --2- 172.21.15.39:0/3363543146 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb178064ee0 0x7fb178067390 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:28.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.937+0000 7fb19aad5700 1 --2- 172.21.15.39:0/3363543146 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1940c8c90 0x7fb19414a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:28.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.937+0000 7fb19aad5700 1 -- 172.21.15.39:0/3363543146 >> 172.21.15.39:0/3363543146 conn(0x7fb1940cf280 msgr2=0x7fb1940cb210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:28.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.937+0000 7fb19aad5700 1 -- 172.21.15.39:0/3363543146 shutdown_connections 2023-11-28T11:57:28.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:28.937+0000 7fb19aad5700 1 -- 172.21.15.39:0/3363543146 wait complete. 2023-11-28T11:57:28.968 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:57:29.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.145+0000 7f51fcd1d700 1 Processor -- start 2023-11-28T11:57:29.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.145+0000 7f51fcd1d700 1 -- start start 2023-11-28T11:57:29.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.145+0000 7f51fcd1d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51f815c150 0x7f51f80b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:29.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.145+0000 7f51fcd1d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f51f8070360 0x7f51f8160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:29.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.145+0000 7f51fcd1d700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f815c520 con 0x7f51f806ff10 2023-11-28T11:57:29.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.145+0000 7f51fcd1d700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51f80b4240 con 0x7f51f8070360 2023-11-28T11:57:29.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.145+0000 7f51fcd1d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f806ac00 con 0x7f51f815c150 2023-11-28T11:57:29.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.149+0000 7f51f77fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51f815c150 0x7f51f80b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:29.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.149+0000 7f51f7fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f51f8070360 0x7f51f8160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:29.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.149+0000 7f51f77fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51f815c150 0x7f51f80b3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:49946/0 (socket says 172.21.15.39:49946) 2023-11-28T11:57:29.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.149+0000 7f51f77fe700 1 -- 172.21.15.39:0/3723051072 learned_addr learned my addr 172.21.15.39:0/3723051072 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:29.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.149+0000 7f51f7fff700 1 -- 172.21.15.39:0/3723051072 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51f815c150 msgr2=0x7f51f80b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:29.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.149+0000 7f51f7fff700 1 --2- 172.21.15.39:0/3723051072 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51f815c150 0x7f51f80b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:29.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.149+0000 7f51f7fff700 1 -- 172.21.15.39:0/3723051072 >> v1:172.21.15.184:6789/0 conn(0x7f51f806ff10 legacy=0x7f51f815fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:29.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.149+0000 7f51f67fc700 1 -- 172.21.15.39:0/3723051072 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 852861244 0 0) 0x7f51f815c520 con 0x7f51f806ff10 2023-11-28T11:57:29.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.149+0000 7f51f7fff700 1 -- 172.21.15.39:0/3723051072 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f806cc50 con 0x7f51f8070360 2023-11-28T11:57:29.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.149+0000 7f51f77fe700 1 --2- 172.21.15.39:0/3723051072 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51f815c150 0x7f51f80b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:29.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.149+0000 7f51f7fff700 1 --2- 172.21.15.39:0/3723051072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51f8070360 0x7f51f8160340 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f51f0009d90 tx=0x7f51f000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e58874eb2d49ca82 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:29.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.149+0000 7f51f67fc700 1 -- 172.21.15.39:0/3723051072 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f000e070 con 0x7f51f8070360 2023-11-28T11:57:29.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.149+0000 7f51f67fc700 1 -- 172.21.15.39:0/3723051072 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f000bb20 con 0x7f51f8070360 2023-11-28T11:57:29.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.149+0000 7f51f67fc700 1 -- 172.21.15.39:0/3723051072 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f0012430 con 0x7f51f8070360 2023-11-28T11:57:29.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.153+0000 7f51fcd1d700 1 -- 172.21.15.39:0/3723051072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51f8070360 msgr2=0x7f51f8160340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:29.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.153+0000 7f51fcd1d700 1 --2- 172.21.15.39:0/3723051072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51f8070360 0x7f51f8160340 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f51f0009d90 tx=0x7f51f000b330 comp rx=0 tx=0).stop 2023-11-28T11:57:29.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.153+0000 7f51fcd1d700 1 -- 172.21.15.39:0/3723051072 shutdown_connections 2023-11-28T11:57:29.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.153+0000 7f51fcd1d700 1 --2- 172.21.15.39:0/3723051072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51f8070360 0x7f51f8160340 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:29.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.153+0000 7f51fcd1d700 1 --2- 172.21.15.39:0/3723051072 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51f815c150 0x7f51f80b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:29.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.153+0000 7f51fcd1d700 1 -- 172.21.15.39:0/3723051072 >> 172.21.15.39:0/3723051072 conn(0x7f51f80d3680 msgr2=0x7f51f80cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:29.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.153+0000 7f51fcd1d700 1 -- 172.21.15.39:0/3723051072 shutdown_connections 2023-11-28T11:57:29.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.153+0000 7f51fcd1d700 1 -- 172.21.15.39:0/3723051072 wait complete. 2023-11-28T11:57:29.158 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.153+0000 7f51fcd1d700 1 Processor -- start 2023-11-28T11:57:29.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.153+0000 7f51fcd1d700 1 -- start start 2023-11-28T11:57:29.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.157+0000 7f51fcd1d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51f806ff10 0x7f51f80b5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:29.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.157+0000 7f51fcd1d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51f8070360 0x7f51f814e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:29.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.157+0000 7f51fcd1d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51f815c150 0x7f51f815a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:29.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.157+0000 7f51fcd1d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f80b6db0 con 0x7f51f806ff10 2023-11-28T11:57:29.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.157+0000 7f51fcd1d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f80b61a0 con 0x7f51f8070360 2023-11-28T11:57:29.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.157+0000 7f51fcd1d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f80b6480 con 0x7f51f815c150 2023-11-28T11:57:29.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.157+0000 7f51f77fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51f806ff10 0x7f51f80b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:29.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.157+0000 7f51f77fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51f806ff10 0x7f51f80b5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56368/0 (socket says 172.21.15.39:56368) 2023-11-28T11:57:29.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.157+0000 7f51f77fe700 1 -- 172.21.15.39:0/1376521331 learned_addr learned my addr 172.21.15.39:0/1376521331 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:29.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.157+0000 7f51f7fff700 1 --2- 172.21.15.39:0/1376521331 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51f815c150 0x7f51f815a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:29.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.157+0000 7f51f6ffd700 1 --2- 172.21.15.39:0/1376521331 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51f8070360 0x7f51f814e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:29.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.157+0000 7f51f77fe700 1 -- 172.21.15.39:0/1376521331 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51f815c150 msgr2=0x7f51f815a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:29.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.157+0000 7f51f77fe700 1 --2- 172.21.15.39:0/1376521331 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51f815c150 0x7f51f815a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:29.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.157+0000 7f51f77fe700 1 -- 172.21.15.39:0/1376521331 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51f8070360 msgr2=0x7f51f814e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:29.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.157+0000 7f51f77fe700 1 --2- 172.21.15.39:0/1376521331 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51f8070360 0x7f51f814e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:29.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.157+0000 7f51f77fe700 1 -- 172.21.15.39:0/1376521331 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e8009570 con 0x7f51f806ff10 2023-11-28T11:57:29.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.157+0000 7f51f7fff700 1 --2- 172.21.15.39:0/1376521331 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51f815c150 0x7f51f815a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:57:29.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.157+0000 7f51f77fe700 1 --2- 172.21.15.39:0/1376521331 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51f806ff10 0x7f51f80b5950 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f51e800e9d0 tx=0x7f51e800ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:29.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.157+0000 7f51dffff700 1 -- 172.21.15.39:0/1376521331 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e800c850 con 0x7f51f806ff10 2023-11-28T11:57:29.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.157+0000 7f51dffff700 1 -- 172.21.15.39:0/1376521331 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e800c9b0 con 0x7f51f806ff10 2023-11-28T11:57:29.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.157+0000 7f51fcd1d700 1 -- 172.21.15.39:0/1376521331 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51f0009a70 con 0x7f51f806ff10 2023-11-28T11:57:29.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.157+0000 7f51dffff700 1 -- 172.21.15.39:0/1376521331 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e800cd20 con 0x7f51f806ff10 2023-11-28T11:57:29.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.157+0000 7f51fcd1d700 1 -- 172.21.15.39:0/1376521331 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f80d2730 con 0x7f51f806ff10 2023-11-28T11:57:29.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.157+0000 7f51fcd1d700 1 -- 172.21.15.39:0/1376521331 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51f80d2450 con 0x7f51f806ff10 2023-11-28T11:57:29.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.161+0000 7f51dffff700 1 -- 172.21.15.39:0/1376521331 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f51e8019030 con 0x7f51f806ff10 2023-11-28T11:57:29.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.161+0000 7f51dffff700 1 --2- 172.21.15.39:0/1376521331 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f51e4064ee0 0x7f51e4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:29.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.161+0000 7f51dffff700 1 -- 172.21.15.39:0/1376521331 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f51e80822d0 con 0x7f51f806ff10 2023-11-28T11:57:29.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.161+0000 7f51f6ffd700 1 --2- 172.21.15.39:0/1376521331 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f51e4064ee0 0x7f51e4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:29.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.165+0000 7f51f6ffd700 1 --2- 172.21.15.39:0/1376521331 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f51e4064ee0 0x7f51e4067390 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f51f81f4c30 tx=0x7f51ec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:29.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.169+0000 7f51dffff700 1 -- 172.21.15.39:0/1376521331 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f51e8050050 con 0x7f51f806ff10 2023-11-28T11:57:29.350 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.345+0000 7f51fcd1d700 1 -- 172.21.15.39:0/1376521331 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f51f80d05e0 con 0x7f51f806ff10 2023-11-28T11:57:29.351 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.345+0000 7f51dffff700 1 -- 172.21.15.39:0/1376521331 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f51e8053670 con 0x7f51f806ff10 2023-11-28T11:57:29.351 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2023-11-28T11:57:29.356 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.349+0000 7f51fcd1d700 1 -- 172.21.15.39:0/1376521331 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f51e4064ee0 msgr2=0x7f51e4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:29.356 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.349+0000 7f51fcd1d700 1 --2- 172.21.15.39:0/1376521331 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f51e4064ee0 0x7f51e4067390 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f51f81f4c30 tx=0x7f51ec009040 comp rx=0 tx=0).stop 2023-11-28T11:57:29.356 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.349+0000 7f51fcd1d700 1 -- 172.21.15.39:0/1376521331 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51f806ff10 msgr2=0x7f51f80b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:29.356 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.349+0000 7f51fcd1d700 1 --2- 172.21.15.39:0/1376521331 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51f806ff10 0x7f51f80b5950 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f51e800e9d0 tx=0x7f51e800ed90 comp rx=0 tx=0).stop 2023-11-28T11:57:29.356 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.349+0000 7f51fcd1d700 1 -- 172.21.15.39:0/1376521331 shutdown_connections 2023-11-28T11:57:29.356 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.349+0000 7f51fcd1d700 1 --2- 172.21.15.39:0/1376521331 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51f815c150 0x7f51f815a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:29.356 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.349+0000 7f51fcd1d700 1 --2- 172.21.15.39:0/1376521331 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f51e4064ee0 0x7f51e4067390 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:29.356 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.349+0000 7f51fcd1d700 1 --2- 172.21.15.39:0/1376521331 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51f8070360 0x7f51f814e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:29.356 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.349+0000 7f51fcd1d700 1 --2- 172.21.15.39:0/1376521331 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51f806ff10 0x7f51f80b5950 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:29.357 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.349+0000 7f51fcd1d700 1 -- 172.21.15.39:0/1376521331 >> 172.21.15.39:0/1376521331 conn(0x7f51f80d3680 msgr2=0x7f51f8155990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:29.357 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.353+0000 7f51fcd1d700 1 -- 172.21.15.39:0/1376521331 shutdown_connections 2023-11-28T11:57:29.357 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.353+0000 7f51fcd1d700 1 -- 172.21.15.39:0/1376521331 wait complete. 2023-11-28T11:57:29.379 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T11:57:29.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.561+0000 7fa48a04c700 1 Processor -- start 2023-11-28T11:57:29.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.561+0000 7fa48a04c700 1 -- start start 2023-11-28T11:57:29.567 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.561+0000 7fa48a04c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa484070620 0x7fa4840b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:29.567 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.561+0000 7fa48a04c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa484069bf0 0x7fa48406a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:29.567 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.561+0000 7fa48a04c700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa48415c520 con 0x7fa48415c150 2023-11-28T11:57:29.568 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.561+0000 7fa48a04c700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4840b4240 con 0x7fa484070620 2023-11-28T11:57:29.568 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.561+0000 7fa48a04c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa48406cc50 con 0x7fa484069bf0 2023-11-28T11:57:29.568 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.561+0000 7fa48904a700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fa48415c150 0x7fa48406ff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:51278/0 (socket says 172.21.15.39:51278) 2023-11-28T11:57:29.569 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.561+0000 7fa48904a700 1 -- 172.21.15.39:0/2027359210 learned_addr learned my addr 172.21.15.39:0/2027359210 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:29.569 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.565+0000 7fa48984b700 1 --2- 172.21.15.39:0/2027359210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa484069bf0 0x7fa48406a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:29.569 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.565+0000 7fa488849700 1 --2- 172.21.15.39:0/2027359210 >> v2:172.21.15.184:3300/0 conn(0x7fa484070620 0x7fa4840b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:29.569 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.565+0000 7fa47bfff700 1 -- 172.21.15.39:0/2027359210 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4043537244 0 0) 0x7fa48415c520 con 0x7fa48415c150 2023-11-28T11:57:29.569 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.565+0000 7fa47bfff700 1 -- 172.21.15.39:0/2027359210 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4700035d0 con 0x7fa48415c150 2023-11-28T11:57:29.569 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.565+0000 7fa48984b700 1 -- 172.21.15.39:0/2027359210 >> v2:172.21.15.184:3300/0 conn(0x7fa484070620 msgr2=0x7fa4840b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:29.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.565+0000 7fa48984b700 1 --2- 172.21.15.39:0/2027359210 >> v2:172.21.15.184:3300/0 conn(0x7fa484070620 0x7fa4840b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:29.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.565+0000 7fa48984b700 1 -- 172.21.15.39:0/2027359210 >> v1:172.21.15.39:6789/0 conn(0x7fa48415c150 legacy=0x7fa48406ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:29.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.565+0000 7fa48984b700 1 -- 172.21.15.39:0/2027359210 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4840d2450 con 0x7fa484069bf0 2023-11-28T11:57:29.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.565+0000 7fa48984b700 1 --2- 172.21.15.39:0/2027359210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa484069bf0 0x7fa48406a030 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa47c009d90 tx=0x7fa47c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1d7fe736fa87218 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:29.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.565+0000 7fa47bfff700 1 -- 172.21.15.39:0/2027359210 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c00e070 con 0x7fa484069bf0 2023-11-28T11:57:29.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.565+0000 7fa47bfff700 1 -- 172.21.15.39:0/2027359210 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47c00bb20 con 0x7fa484069bf0 2023-11-28T11:57:29.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.565+0000 7fa47bfff700 1 -- 172.21.15.39:0/2027359210 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c012430 con 0x7fa484069bf0 2023-11-28T11:57:29.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.565+0000 7fa48a04c700 1 -- 172.21.15.39:0/2027359210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa484069bf0 msgr2=0x7fa48406a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:29.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.565+0000 7fa48a04c700 1 --2- 172.21.15.39:0/2027359210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa484069bf0 0x7fa48406a030 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa47c009d90 tx=0x7fa47c00b330 comp rx=0 tx=0).stop 2023-11-28T11:57:29.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.565+0000 7fa48a04c700 1 -- 172.21.15.39:0/2027359210 shutdown_connections 2023-11-28T11:57:29.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.565+0000 7fa48a04c700 1 --2- 172.21.15.39:0/2027359210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa484069bf0 0x7fa48406a030 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:29.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.565+0000 7fa48a04c700 1 --2- 172.21.15.39:0/2027359210 >> v2:172.21.15.184:3300/0 conn(0x7fa484070620 0x7fa4840b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:29.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.565+0000 7fa48a04c700 1 -- 172.21.15.39:0/2027359210 >> 172.21.15.39:0/2027359210 conn(0x7fa4840d3680 msgr2=0x7fa4840cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:29.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.565+0000 7fa48a04c700 1 -- 172.21.15.39:0/2027359210 shutdown_connections 2023-11-28T11:57:29.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.565+0000 7fa48a04c700 1 -- 172.21.15.39:0/2027359210 wait complete. 2023-11-28T11:57:29.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.569+0000 7fa48a04c700 1 Processor -- start 2023-11-28T11:57:29.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.569+0000 7fa48a04c700 1 -- start start 2023-11-28T11:57:29.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.573+0000 7fa48a04c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa484069bf0 0x7fa4840cad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:29.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.573+0000 7fa48a04c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa484070620 0x7fa4840cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:29.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.573+0000 7fa48a04c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa48415c150 0x7fa4840cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:29.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.573+0000 7fa48a04c700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4840cb920 con 0x7fa484070620 2023-11-28T11:57:29.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.573+0000 7fa48a04c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4840cbc00 con 0x7fa484069bf0 2023-11-28T11:57:29.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.573+0000 7fa48a04c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4840cbee0 con 0x7fa48415c150 2023-11-28T11:57:29.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.573+0000 7fa488849700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa484070620 0x7fa4840cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:29.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.573+0000 7fa488849700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa484070620 0x7fa4840cb2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56376/0 (socket says 172.21.15.39:56376) 2023-11-28T11:57:29.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.573+0000 7fa488849700 1 -- 172.21.15.39:0/2051955252 learned_addr learned my addr 172.21.15.39:0/2051955252 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:29.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.573+0000 7fa48904a700 1 --2- 172.21.15.39:0/2051955252 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa484069bf0 0x7fa4840cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:29.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.573+0000 7fa48984b700 1 --2- 172.21.15.39:0/2051955252 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa48415c150 0x7fa4840cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:29.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.573+0000 7fa488849700 1 -- 172.21.15.39:0/2051955252 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa48415c150 msgr2=0x7fa4840cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:29.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.573+0000 7fa488849700 1 --2- 172.21.15.39:0/2051955252 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa48415c150 0x7fa4840cdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:29.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.573+0000 7fa488849700 1 -- 172.21.15.39:0/2051955252 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa484069bf0 msgr2=0x7fa4840cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:29.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.573+0000 7fa488849700 1 --2- 172.21.15.39:0/2051955252 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa484069bf0 0x7fa4840cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:29.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.573+0000 7fa488849700 1 -- 172.21.15.39:0/2051955252 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa47c009a70 con 0x7fa484070620 2023-11-28T11:57:29.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.573+0000 7fa488849700 1 --2- 172.21.15.39:0/2051955252 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa484070620 0x7fa4840cb2a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa47400e980 tx=0x7fa47400ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:29.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.573+0000 7fa479ffb700 1 -- 172.21.15.39:0/2051955252 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa474009710 con 0x7fa484070620 2023-11-28T11:57:29.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.573+0000 7fa479ffb700 1 -- 172.21.15.39:0/2051955252 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47400c850 con 0x7fa484070620 2023-11-28T11:57:29.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.573+0000 7fa48a04c700 1 -- 172.21.15.39:0/2051955252 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4840d05e0 con 0x7fa484070620 2023-11-28T11:57:29.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.573+0000 7fa479ffb700 1 -- 172.21.15.39:0/2051955252 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47400cc00 con 0x7fa484070620 2023-11-28T11:57:29.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.573+0000 7fa48a04c700 1 -- 172.21.15.39:0/2051955252 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4840d2730 con 0x7fa484070620 2023-11-28T11:57:29.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.577+0000 7fa48a04c700 1 -- 172.21.15.39:0/2051955252 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4840d2140 con 0x7fa484070620 2023-11-28T11:57:29.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.577+0000 7fa479ffb700 1 -- 172.21.15.39:0/2051955252 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa474023070 con 0x7fa484070620 2023-11-28T11:57:29.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.581+0000 7fa479ffb700 1 --2- 172.21.15.39:0/2051955252 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa468064ee0 0x7fa468067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:29.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.581+0000 7fa479ffb700 1 -- 172.21.15.39:0/2051955252 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa4740825c0 con 0x7fa484070620 2023-11-28T11:57:29.585 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.581+0000 7fa48904a700 1 --2- 172.21.15.39:0/2051955252 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa468064ee0 0x7fa468067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:29.586 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.581+0000 7fa48904a700 1 --2- 172.21.15.39:0/2051955252 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa468064ee0 0x7fa468067390 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa4800011e0 tx=0x7fa480009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:29.589 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.585+0000 7fa479ffb700 1 -- 172.21.15.39:0/2051955252 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa474050400 con 0x7fa484070620 2023-11-28T11:57:29.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.765+0000 7fa48a04c700 1 -- 172.21.15.39:0/2051955252 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa484073d20 con 0x7fa484070620 2023-11-28T11:57:29.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.765+0000 7fa479ffb700 1 -- 172.21.15.39:0/2051955252 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa4740210a0 con 0x7fa484070620 2023-11-28T11:57:29.769 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-11-28T11:57:29.772 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.769+0000 7fa48a04c700 1 -- 172.21.15.39:0/2051955252 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa468064ee0 msgr2=0x7fa468067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:29.772 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.769+0000 7fa48a04c700 1 --2- 172.21.15.39:0/2051955252 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa468064ee0 0x7fa468067390 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa4800011e0 tx=0x7fa480009040 comp rx=0 tx=0).stop 2023-11-28T11:57:29.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.769+0000 7fa48a04c700 1 -- 172.21.15.39:0/2051955252 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa484070620 msgr2=0x7fa4840cb2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:29.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.769+0000 7fa48a04c700 1 --2- 172.21.15.39:0/2051955252 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa484070620 0x7fa4840cb2a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa47400e980 tx=0x7fa47400ed40 comp rx=0 tx=0).stop 2023-11-28T11:57:29.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.769+0000 7fa48a04c700 1 -- 172.21.15.39:0/2051955252 shutdown_connections 2023-11-28T11:57:29.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.769+0000 7fa48a04c700 1 --2- 172.21.15.39:0/2051955252 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa48415c150 0x7fa4840cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:29.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.769+0000 7fa48a04c700 1 --2- 172.21.15.39:0/2051955252 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa484070620 0x7fa4840cb2a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:29.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.769+0000 7fa48a04c700 1 --2- 172.21.15.39:0/2051955252 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa468064ee0 0x7fa468067390 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:29.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.769+0000 7fa48a04c700 1 --2- 172.21.15.39:0/2051955252 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa484069bf0 0x7fa4840cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:29.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.769+0000 7fa48a04c700 1 -- 172.21.15.39:0/2051955252 >> 172.21.15.39:0/2051955252 conn(0x7fa4840d3680 msgr2=0x7fa4841564f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:29.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.769+0000 7fa48a04c700 1 -- 172.21.15.39:0/2051955252 shutdown_connections 2023-11-28T11:57:29.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:29.769+0000 7fa48a04c700 1 -- 172.21.15.39:0/2051955252 wait complete. 2023-11-28T11:57:29.783 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:57:29.787 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:57:29.800 INFO:tasks.cephfs_test_runner:Starting test: test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-28T11:57:29.800 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2023-11-28T11:57:30.009 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.005+0000 7f5ac759e700 1 Processor -- start 2023-11-28T11:57:30.009 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.005+0000 7f5ac759e700 1 -- start start 2023-11-28T11:57:30.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.005+0000 7f5ac759e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5ac815c650 0x7f5ac806b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:30.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.005+0000 7f5ac759e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5ac806bed0 0x7f5ac806c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:30.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.005+0000 7f5ac759e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ac80c9d40 con 0x7f5ac80cd0d0 2023-11-28T11:57:30.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.005+0000 7f5ac759e700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ac806b140 con 0x7f5ac815c650 2023-11-28T11:57:30.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.005+0000 7f5ac759e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ac806c830 con 0x7f5ac806bed0 2023-11-28T11:57:30.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.005+0000 7f5ac659c700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5ac815c650 0x7f5ac806b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:30.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.005+0000 7f5ac659c700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5ac815c650 0x7f5ac806b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56392/0 (socket says 172.21.15.39:56392) 2023-11-28T11:57:30.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.005+0000 7f5ac659c700 1 -- 172.21.15.39:0/3009979570 learned_addr learned my addr 172.21.15.39:0/3009979570 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:30.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.005+0000 7f5ac6d9d700 1 --2- 172.21.15.39:0/3009979570 >> v2:172.21.15.184:3300/0 conn(0x7f5ac806bed0 0x7f5ac806c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:30.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.005+0000 7f5ac659c700 1 -- 172.21.15.39:0/3009979570 >> v2:172.21.15.184:3300/0 conn(0x7f5ac806bed0 msgr2=0x7f5ac806c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:30.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.005+0000 7f5ac659c700 1 --2- 172.21.15.39:0/3009979570 >> v2:172.21.15.184:3300/0 conn(0x7f5ac806bed0 0x7f5ac806c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:30.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.005+0000 7f5ac659c700 1 -- 172.21.15.39:0/3009979570 >> v1:172.21.15.184:6789/0 conn(0x7f5ac80cd0d0 legacy=0x7f5ac80b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:30.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.005+0000 7f5ac659c700 1 -- 172.21.15.39:0/3009979570 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac806b820 con 0x7f5ac815c650 2023-11-28T11:57:30.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.009+0000 7f5ac659c700 1 --2- 172.21.15.39:0/3009979570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ac815c650 0x7f5ac806b2e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5ac806fe30 tx=0x7f5ab800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35995e54f99b7dd9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:30.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.009+0000 7f5ac5d9b700 1 -- 172.21.15.39:0/3009979570 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab800e070 con 0x7f5ac815c650 2023-11-28T11:57:30.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.009+0000 7f5ac5d9b700 1 -- 172.21.15.39:0/3009979570 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab8003a40 con 0x7f5ac815c650 2023-11-28T11:57:30.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.009+0000 7f5ac5d9b700 1 -- 172.21.15.39:0/3009979570 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab8003df0 con 0x7f5ac815c650 2023-11-28T11:57:30.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.009+0000 7f5ac759e700 1 -- 172.21.15.39:0/3009979570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ac815c650 msgr2=0x7f5ac806b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:30.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.009+0000 7f5ac759e700 1 --2- 172.21.15.39:0/3009979570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ac815c650 0x7f5ac806b2e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5ac806fe30 tx=0x7f5ab800b330 comp rx=0 tx=0).stop 2023-11-28T11:57:30.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.009+0000 7f5ac759e700 1 -- 172.21.15.39:0/3009979570 shutdown_connections 2023-11-28T11:57:30.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.009+0000 7f5ac759e700 1 --2- 172.21.15.39:0/3009979570 >> v2:172.21.15.184:3300/0 conn(0x7f5ac806bed0 0x7f5ac806c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:30.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.009+0000 7f5ac759e700 1 --2- 172.21.15.39:0/3009979570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ac815c650 0x7f5ac806b2e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:30.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.009+0000 7f5ac759e700 1 -- 172.21.15.39:0/3009979570 >> 172.21.15.39:0/3009979570 conn(0x7f5ac80b0f80 msgr2=0x7f5ac80ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:30.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.009+0000 7f5ac759e700 1 -- 172.21.15.39:0/3009979570 shutdown_connections 2023-11-28T11:57:30.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.009+0000 7f5ac759e700 1 -- 172.21.15.39:0/3009979570 wait complete. 2023-11-28T11:57:30.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.013+0000 7f5ac759e700 1 Processor -- start 2023-11-28T11:57:30.018 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.013+0000 7f5ac759e700 1 -- start start 2023-11-28T11:57:30.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.017+0000 7f5ac759e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ac806bed0 0x7f5ac8144be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:30.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.017+0000 7f5ac759e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ac80cd0d0 0x7f5ac8145370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:30.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.017+0000 7f5ac759e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ac815c650 0x7f5ac80af710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:30.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.017+0000 7f5ac759e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac8145120 con 0x7f5ac815c650 2023-11-28T11:57:30.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.017+0000 7f5ac759e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac80b3f50 con 0x7f5ac806bed0 2023-11-28T11:57:30.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.017+0000 7f5ac759e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac80b4760 con 0x7f5ac80cd0d0 2023-11-28T11:57:30.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.017+0000 7f5ac6d9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ac815c650 0x7f5ac80af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:30.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.017+0000 7f5ac659c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ac806bed0 0x7f5ac8144be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:30.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.017+0000 7f5ac6d9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ac815c650 0x7f5ac80af710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56402/0 (socket says 172.21.15.39:56402) 2023-11-28T11:57:30.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.017+0000 7f5ac659c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ac806bed0 0x7f5ac8144be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:60350/0 (socket says 172.21.15.39:60350) 2023-11-28T11:57:30.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.017+0000 7f5ac6d9d700 1 -- 172.21.15.39:0/2602413158 learned_addr learned my addr 172.21.15.39:0/2602413158 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:30.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.017+0000 7f5abdd9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ac80cd0d0 0x7f5ac8145370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:30.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.017+0000 7f5ac6d9d700 1 -- 172.21.15.39:0/2602413158 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ac80cd0d0 msgr2=0x7f5ac8145370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:30.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.017+0000 7f5ac6d9d700 1 --2- 172.21.15.39:0/2602413158 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ac80cd0d0 0x7f5ac8145370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:30.023 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.017+0000 7f5ac6d9d700 1 -- 172.21.15.39:0/2602413158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ac806bed0 msgr2=0x7f5ac8144be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:30.023 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.017+0000 7f5ac6d9d700 1 --2- 172.21.15.39:0/2602413158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ac806bed0 0x7f5ac8144be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:30.023 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.017+0000 7f5ac6d9d700 1 -- 172.21.15.39:0/2602413158 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab8009b30 con 0x7f5ac815c650 2023-11-28T11:57:30.023 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.017+0000 7f5ac6d9d700 1 --2- 172.21.15.39:0/2602413158 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ac815c650 0x7f5ac80af710 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5ac000d860 tx=0x7f5ac000db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:30.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.021+0000 7f5abf7fe700 1 -- 172.21.15.39:0/2602413158 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac00125f0 con 0x7f5ac815c650 2023-11-28T11:57:30.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.021+0000 7f5ac759e700 1 -- 172.21.15.39:0/2602413158 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ac80cd5d0 con 0x7f5ac815c650 2023-11-28T11:57:30.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.021+0000 7f5abf7fe700 1 -- 172.21.15.39:0/2602413158 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac0012750 con 0x7f5ac815c650 2023-11-28T11:57:30.026 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.021+0000 7f5abf7fe700 1 -- 172.21.15.39:0/2602413158 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac0012b00 con 0x7f5ac815c650 2023-11-28T11:57:30.026 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.021+0000 7f5ac759e700 1 -- 172.21.15.39:0/2602413158 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ac80b1d50 con 0x7f5ac815c650 2023-11-28T11:57:30.028 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.021+0000 7f5ac759e700 1 -- 172.21.15.39:0/2602413158 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ac80cd8b0 con 0x7f5ac815c650 2023-11-28T11:57:30.029 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.025+0000 7f5abf7fe700 1 -- 172.21.15.39:0/2602413158 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5ac0012c60 con 0x7f5ac815c650 2023-11-28T11:57:30.030 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.025+0000 7f5abf7fe700 1 --2- 172.21.15.39:0/2602413158 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5aa8064ee0 0x7f5aa8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:30.031 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.025+0000 7f5abf7fe700 1 -- 172.21.15.39:0/2602413158 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5ac0082550 con 0x7f5ac815c650 2023-11-28T11:57:30.031 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.025+0000 7f5ac659c700 1 --2- 172.21.15.39:0/2602413158 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5aa8064ee0 0x7f5aa8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:30.032 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.029+0000 7f5ac659c700 1 --2- 172.21.15.39:0/2602413158 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5aa8064ee0 0x7f5aa8067390 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8015040 tx=0x7f5ab801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:30.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.033+0000 7f5abf7fe700 1 -- 172.21.15.39:0/2602413158 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5ac00502e0 con 0x7f5ac815c650 2023-11-28T11:57:30.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:30.265+0000 7f5ac759e700 1 -- 172.21.15.39:0/2602413158 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) v1 -- 0x7f5ac8073cb0 con 0x7f5ac815c650 2023-11-28T11:57:31.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.033+0000 7f5abf7fe700 1 -- 172.21.15.39:0/2602413158 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v74) v1 ==== 145+0+0 (secure 0 0 0) 0x7f5ac0053900 con 0x7f5ac815c650 2023-11-28T11:57:31.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.037+0000 7f5ac759e700 1 -- 172.21.15.39:0/2602413158 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5aa8064ee0 msgr2=0x7f5aa8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:31.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.037+0000 7f5ac759e700 1 --2- 172.21.15.39:0/2602413158 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5aa8064ee0 0x7f5aa8067390 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8015040 tx=0x7f5ab801c040 comp rx=0 tx=0).stop 2023-11-28T11:57:31.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.037+0000 7f5ac759e700 1 -- 172.21.15.39:0/2602413158 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ac815c650 msgr2=0x7f5ac80af710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:31.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.037+0000 7f5ac759e700 1 --2- 172.21.15.39:0/2602413158 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ac815c650 0x7f5ac80af710 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5ac000d860 tx=0x7f5ac000db70 comp rx=0 tx=0).stop 2023-11-28T11:57:31.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.037+0000 7f5ac759e700 1 -- 172.21.15.39:0/2602413158 shutdown_connections 2023-11-28T11:57:31.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.037+0000 7f5ac759e700 1 --2- 172.21.15.39:0/2602413158 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ac815c650 0x7f5ac80af710 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:31.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.037+0000 7f5ac759e700 1 --2- 172.21.15.39:0/2602413158 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ac80cd0d0 0x7f5ac8145370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:31.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.037+0000 7f5ac759e700 1 --2- 172.21.15.39:0/2602413158 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5aa8064ee0 0x7f5aa8067390 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:31.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.037+0000 7f5ac759e700 1 --2- 172.21.15.39:0/2602413158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ac806bed0 0x7f5ac8144be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:31.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.037+0000 7f5ac759e700 1 -- 172.21.15.39:0/2602413158 >> 172.21.15.39:0/2602413158 conn(0x7f5ac80b0f80 msgr2=0x7f5ac80b1640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:31.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.037+0000 7f5ac759e700 1 -- 172.21.15.39:0/2602413158 shutdown_connections 2023-11-28T11:57:31.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.037+0000 7f5ac759e700 1 -- 172.21.15.39:0/2602413158 wait complete. 2023-11-28T11:57:31.068 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-28T11:57:31.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.257+0000 7f2226108700 1 Processor -- start 2023-11-28T11:57:31.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.257+0000 7f2226108700 1 -- start start 2023-11-28T11:57:31.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.257+0000 7f2226108700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f222015e190 0x7f22200cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:31.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.257+0000 7f2226108700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f222006ff10 0x7f2220070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:31.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.257+0000 7f2226108700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22200708b0 con 0x7f2220161560 2023-11-28T11:57:31.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.257+0000 7f2226108700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f222015e560 con 0x7f222015e190 2023-11-28T11:57:31.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.261+0000 7f2226108700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f222006be80 con 0x7f222006ff10 2023-11-28T11:57:31.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.261+0000 7f2225106700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f222015e190 0x7f22200cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:31.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.261+0000 7f2225907700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f222006ff10 0x7f2220070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:31.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.261+0000 7f2225106700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f222015e190 0x7f22200cdc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56404/0 (socket says 172.21.15.39:56404) 2023-11-28T11:57:31.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.261+0000 7f2224905700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f2220161560 0x7f2220069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:51294/0 (socket says 172.21.15.39:51294) 2023-11-28T11:57:31.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.261+0000 7f2225106700 1 -- 172.21.15.39:0/2461551016 learned_addr learned my addr 172.21.15.39:0/2461551016 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:31.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.261+0000 7f2225106700 1 -- 172.21.15.39:0/2461551016 >> v2:172.21.15.184:3300/0 conn(0x7f222006ff10 msgr2=0x7f2220070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:31.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.261+0000 7f2225106700 1 --2- 172.21.15.39:0/2461551016 >> v2:172.21.15.184:3300/0 conn(0x7f222006ff10 0x7f2220070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:31.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.261+0000 7f2225106700 1 -- 172.21.15.39:0/2461551016 >> v1:172.21.15.39:6789/0 conn(0x7f2220161560 legacy=0x7f2220069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:31.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.261+0000 7f2225106700 1 -- 172.21.15.39:0/2461551016 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22200ce330 con 0x7f222015e190 2023-11-28T11:57:31.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.261+0000 7f2225907700 1 --2- 172.21.15.39:0/2461551016 >> v2:172.21.15.184:3300/0 conn(0x7f222006ff10 0x7f2220070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:31.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.261+0000 7f2225106700 1 --2- 172.21.15.39:0/2461551016 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f222015e190 0x7f22200cdc50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f222006bbe0 tx=0x7f221c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d556d2011892a29c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:31.267 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.261+0000 7f2217fff700 1 -- 172.21.15.39:0/2461551016 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221c011830 con 0x7f222015e190 2023-11-28T11:57:31.267 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.261+0000 7f2217fff700 1 -- 172.21.15.39:0/2461551016 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f221c011990 con 0x7f222015e190 2023-11-28T11:57:31.267 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.261+0000 7f2217fff700 1 -- 172.21.15.39:0/2461551016 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221c011d20 con 0x7f222015e190 2023-11-28T11:57:31.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.261+0000 7f2226108700 1 -- 172.21.15.39:0/2461551016 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f222015e190 msgr2=0x7f22200cdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:31.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.261+0000 7f2226108700 1 --2- 172.21.15.39:0/2461551016 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f222015e190 0x7f22200cdc50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f222006bbe0 tx=0x7f221c009bf0 comp rx=0 tx=0).stop 2023-11-28T11:57:31.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.265+0000 7f2226108700 1 -- 172.21.15.39:0/2461551016 shutdown_connections 2023-11-28T11:57:31.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.265+0000 7f2226108700 1 --2- 172.21.15.39:0/2461551016 >> v2:172.21.15.184:3300/0 conn(0x7f222006ff10 0x7f2220070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:31.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.265+0000 7f2226108700 1 --2- 172.21.15.39:0/2461551016 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f222015e190 0x7f22200cdc50 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:31.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.265+0000 7f2226108700 1 -- 172.21.15.39:0/2461551016 >> 172.21.15.39:0/2461551016 conn(0x7f22200cf280 msgr2=0x7f22200cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:31.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.265+0000 7f2226108700 1 -- 172.21.15.39:0/2461551016 shutdown_connections 2023-11-28T11:57:31.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.265+0000 7f2226108700 1 -- 172.21.15.39:0/2461551016 wait complete. 2023-11-28T11:57:31.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.265+0000 7f2226108700 1 Processor -- start 2023-11-28T11:57:31.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.265+0000 7f2226108700 1 -- start start 2023-11-28T11:57:31.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.269+0000 7f2226108700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f222006ff10 0x7f22200c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:31.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.269+0000 7f2226108700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f222015e190 0x7f2220152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:31.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.269+0000 7f2226108700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2220161560 0x7f2220153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:31.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.269+0000 7f2226108700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22200c7ba0 con 0x7f222015e190 2023-11-28T11:57:31.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.269+0000 7f2226108700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22200c7300 con 0x7f222006ff10 2023-11-28T11:57:31.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.269+0000 7f2226108700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22200c75e0 con 0x7f2220161560 2023-11-28T11:57:31.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.269+0000 7f2224905700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f222015e190 0x7f2220152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:31.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.269+0000 7f2224905700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f222015e190 0x7f2220152f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56414/0 (socket says 172.21.15.39:56414) 2023-11-28T11:57:31.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.269+0000 7f2224905700 1 -- 172.21.15.39:0/2743142845 learned_addr learned my addr 172.21.15.39:0/2743142845 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:31.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.269+0000 7f2225106700 1 --2- 172.21.15.39:0/2743142845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f222006ff10 0x7f22200c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:31.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.269+0000 7f2225907700 1 --2- 172.21.15.39:0/2743142845 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2220161560 0x7f2220153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:31.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.269+0000 7f2224905700 1 -- 172.21.15.39:0/2743142845 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2220161560 msgr2=0x7f2220153490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:31.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.269+0000 7f2224905700 1 --2- 172.21.15.39:0/2743142845 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2220161560 0x7f2220153490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:31.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.269+0000 7f2224905700 1 -- 172.21.15.39:0/2743142845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f222006ff10 msgr2=0x7f22200c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:31.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.269+0000 7f2224905700 1 --2- 172.21.15.39:0/2743142845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f222006ff10 0x7f22200c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:31.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.269+0000 7f2224905700 1 -- 172.21.15.39:0/2743142845 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2218009a70 con 0x7f222015e190 2023-11-28T11:57:31.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.269+0000 7f2224905700 1 --2- 172.21.15.39:0/2743142845 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f222015e190 0x7f2220152f50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f221000c700 tx=0x7f221000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:31.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.273+0000 7f2215ffb700 1 -- 172.21.15.39:0/2743142845 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2210005cd0 con 0x7f222015e190 2023-11-28T11:57:31.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.273+0000 7f2215ffb700 1 -- 172.21.15.39:0/2743142845 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2210005e30 con 0x7f222015e190 2023-11-28T11:57:31.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.273+0000 7f2215ffb700 1 -- 172.21.15.39:0/2743142845 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22100072d0 con 0x7f222015e190 2023-11-28T11:57:31.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.273+0000 7f2226108700 1 -- 172.21.15.39:0/2743142845 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f221c009570 con 0x7f222015e190 2023-11-28T11:57:31.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.273+0000 7f2226108700 1 -- 172.21.15.39:0/2743142845 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22200afc70 con 0x7f222015e190 2023-11-28T11:57:31.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.273+0000 7f2226108700 1 -- 172.21.15.39:0/2743142845 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22200af990 con 0x7f222015e190 2023-11-28T11:57:31.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.277+0000 7f2215ffb700 1 -- 172.21.15.39:0/2743142845 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2210019030 con 0x7f222015e190 2023-11-28T11:57:31.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.277+0000 7f2215ffb700 1 --2- 172.21.15.39:0/2743142845 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2204064ee0 0x7f2204067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:31.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.277+0000 7f2215ffb700 1 -- 172.21.15.39:0/2743142845 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2210081400 con 0x7f222015e190 2023-11-28T11:57:31.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.277+0000 7f2225106700 1 --2- 172.21.15.39:0/2743142845 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2204064ee0 0x7f2204067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:31.284 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.277+0000 7f2225106700 1 --2- 172.21.15.39:0/2743142845 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2204064ee0 0x7f2204067390 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f221c000c00 tx=0x7f221c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:31.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.281+0000 7f2215ffb700 1 -- 172.21.15.39:0/2743142845 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f221004a400 con 0x7f222015e190 2023-11-28T11:57:31.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.457+0000 7f2226108700 1 -- 172.21.15.39:0/2743142845 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f22200aff50 con 0x7f222015e190 2023-11-28T11:57:31.474 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.469+0000 7f2215ffb700 1 -- 172.21.15.39:0/2743142845 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f221004f230 con 0x7f222015e190 2023-11-28T11:57:31.478 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.473+0000 7f2226108700 1 -- 172.21.15.39:0/2743142845 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2204064ee0 msgr2=0x7f2204067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:31.478 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.473+0000 7f2226108700 1 --2- 172.21.15.39:0/2743142845 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2204064ee0 0x7f2204067390 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f221c000c00 tx=0x7f221c008030 comp rx=0 tx=0).stop 2023-11-28T11:57:31.478 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.473+0000 7f2226108700 1 -- 172.21.15.39:0/2743142845 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f222015e190 msgr2=0x7f2220152f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:31.478 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.473+0000 7f2226108700 1 --2- 172.21.15.39:0/2743142845 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f222015e190 0x7f2220152f50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f221000c700 tx=0x7f221000ca10 comp rx=0 tx=0).stop 2023-11-28T11:57:31.478 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.473+0000 7f2226108700 1 -- 172.21.15.39:0/2743142845 shutdown_connections 2023-11-28T11:57:31.478 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.473+0000 7f2226108700 1 --2- 172.21.15.39:0/2743142845 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2220161560 0x7f2220153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:31.478 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.473+0000 7f2226108700 1 --2- 172.21.15.39:0/2743142845 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f222015e190 0x7f2220152f50 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:31.478 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.473+0000 7f2226108700 1 --2- 172.21.15.39:0/2743142845 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2204064ee0 0x7f2204067390 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:31.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.473+0000 7f2226108700 1 --2- 172.21.15.39:0/2743142845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f222006ff10 0x7f22200c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:31.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.473+0000 7f2226108700 1 -- 172.21.15.39:0/2743142845 >> 172.21.15.39:0/2743142845 conn(0x7f22200cf280 msgr2=0x7f22200c36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:31.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.473+0000 7f2226108700 1 -- 172.21.15.39:0/2743142845 shutdown_connections 2023-11-28T11:57:31.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.473+0000 7f2226108700 1 -- 172.21.15.39:0/2743142845 wait complete. 2023-11-28T11:57:31.504 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T11:57:31.504 DEBUG:teuthology.orchestra.run.smithi039:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T11:57:31.546 DEBUG:teuthology.orchestra.run.smithi184:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T11:57:31.593 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T11:57:31.593 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:57:31.593 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:57:31.614 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:57:31.615 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:57:31.673 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:57:31.673 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:57:31.735 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:57:31.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.953+0000 7f93c6e2f700 1 Processor -- start 2023-11-28T11:57:31.960 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.953+0000 7f93c6e2f700 1 -- start start 2023-11-28T11:57:31.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.957+0000 7f93c6e2f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93c0160710 0x7f93c00cc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:31.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.957+0000 7f93c6e2f700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f93c00cc860 0x7f93c0070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:31.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.957+0000 7f93c6e2f700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93c00ad6c0 con 0x7f93c00705c0 2023-11-28T11:57:31.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.957+0000 7f93c6e2f700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93c0070a60 con 0x7f93c00cc860 2023-11-28T11:57:31.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.957+0000 7f93c6e2f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c006b1c0 con 0x7f93c0160710 2023-11-28T11:57:31.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.957+0000 7f93c662e700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f93c00705c0 0x7f93c0069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:51296/0 (socket says 172.21.15.39:51296) 2023-11-28T11:57:31.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.957+0000 7f93c662e700 1 -- 172.21.15.39:0/2683059542 learned_addr learned my addr 172.21.15.39:0/2683059542 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:31.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.957+0000 7f93c562c700 1 --2- 172.21.15.39:0/2683059542 >> v2:172.21.15.184:3300/0 conn(0x7f93c00cc860 0x7f93c0070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:31.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.957+0000 7f93c5e2d700 1 --2- 172.21.15.39:0/2683059542 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93c0160710 0x7f93c00cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:31.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.957+0000 7f93c4e2b700 1 -- 172.21.15.39:0/2683059542 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3402389922 0 0) 0x7f93c00ad6c0 con 0x7f93c00705c0 2023-11-28T11:57:31.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.957+0000 7f93c4e2b700 1 -- 172.21.15.39:0/2683059542 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93ac0035d0 con 0x7f93c00705c0 2023-11-28T11:57:31.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.957+0000 7f93c4e2b700 1 -- 172.21.15.39:0/2683059542 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1633450931 0 0) 0x7f93ac0035d0 con 0x7f93c00705c0 2023-11-28T11:57:31.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.957+0000 7f93c4e2b700 1 -- 172.21.15.39:0/2683059542 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93c0160710 msgr2=0x7f93c00cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:31.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.957+0000 7f93c4e2b700 1 --2- 172.21.15.39:0/2683059542 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93c0160710 0x7f93c00cc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:31.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.957+0000 7f93c4e2b700 1 -- 172.21.15.39:0/2683059542 >> v2:172.21.15.184:3300/0 conn(0x7f93c00cc860 msgr2=0x7f93c0070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:31.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.957+0000 7f93c4e2b700 1 --2- 172.21.15.39:0/2683059542 >> v2:172.21.15.184:3300/0 conn(0x7f93c00cc860 0x7f93c0070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:31.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.957+0000 7f93c4e2b700 1 -- 172.21.15.39:0/2683059542 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c00adc60 con 0x7f93c00705c0 2023-11-28T11:57:31.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.957+0000 7f93c4e2b700 1 -- 172.21.15.39:0/2683059542 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4013383302 0 0) 0x7f93b80019f0 con 0x7f93c00705c0 2023-11-28T11:57:31.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.961+0000 7f93c4e2b700 1 -- 172.21.15.39:0/2683059542 >> v1:172.21.15.39:6789/0 conn(0x7f93c00705c0 legacy=0x7f93c0069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:31.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.961+0000 7f93c4e2b700 1 --2- 172.21.15.39:0/2683059542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93ac003a20 0x7f93ac003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:31.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.961+0000 7f93c4e2b700 1 --2- 172.21.15.39:0/2683059542 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93c0160710 0x7f93ac004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:31.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.961+0000 7f93c4e2b700 1 --2- 172.21.15.39:0/2683059542 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93ac004db0 0x7f93ac005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:31.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.961+0000 7f93c4e2b700 1 -- 172.21.15.39:0/2683059542 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c006b1c0 con 0x7f93ac003a20 2023-11-28T11:57:31.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.961+0000 7f93c4e2b700 1 -- 172.21.15.39:0/2683059542 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac00ba30 con 0x7f93ac004db0 2023-11-28T11:57:31.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.961+0000 7f93c4e2b700 1 -- 172.21.15.39:0/2683059542 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac00bb70 con 0x7f93c0160710 2023-11-28T11:57:31.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.961+0000 7f93c5e2d700 1 --2- 172.21.15.39:0/2683059542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93ac003a20 0x7f93ac003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:31.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.961+0000 7f93c562c700 1 --2- 172.21.15.39:0/2683059542 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93c0160710 0x7f93ac004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:31.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.961+0000 7f93c662e700 1 --2- 172.21.15.39:0/2683059542 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93ac004db0 0x7f93ac005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:31.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.961+0000 7f93c5e2d700 1 -- 172.21.15.39:0/2683059542 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93c0160710 msgr2=0x7f93ac004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:31.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.961+0000 7f93c5e2d700 1 --2- 172.21.15.39:0/2683059542 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93c0160710 0x7f93ac004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:31.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.961+0000 7f93c5e2d700 1 -- 172.21.15.39:0/2683059542 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93ac004db0 msgr2=0x7f93ac005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:31.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.961+0000 7f93c5e2d700 1 --2- 172.21.15.39:0/2683059542 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93ac004db0 0x7f93ac005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:31.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.961+0000 7f93c5e2d700 1 -- 172.21.15.39:0/2683059542 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ac0035d0 con 0x7f93ac003a20 2023-11-28T11:57:31.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.961+0000 7f93c662e700 1 --2- 172.21.15.39:0/2683059542 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93ac004db0 0x7f93ac005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:57:31.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.961+0000 7f93c5e2d700 1 --2- 172.21.15.39:0/2683059542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93ac003a20 0x7f93ac003e30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f93bc009b70 tx=0x7f93ac0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e554b956a55893e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:31.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.961+0000 7f93c4e2b700 1 -- 172.21.15.39:0/2683059542 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93bc00e660 con 0x7f93ac003a20 2023-11-28T11:57:31.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.961+0000 7f93c4e2b700 1 -- 172.21.15.39:0/2683059542 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93bc00e7c0 con 0x7f93ac003a20 2023-11-28T11:57:31.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.961+0000 7f93c4e2b700 1 -- 172.21.15.39:0/2683059542 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93bc00eb30 con 0x7f93ac003a20 2023-11-28T11:57:31.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.961+0000 7f93c6e2f700 1 -- 172.21.15.39:0/2683059542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93ac003a20 msgr2=0x7f93ac003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:31.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.961+0000 7f93c6e2f700 1 --2- 172.21.15.39:0/2683059542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93ac003a20 0x7f93ac003e30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f93bc009b70 tx=0x7f93ac0058a0 comp rx=0 tx=0).stop 2023-11-28T11:57:31.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.961+0000 7f93c662e700 1 -- 172.21.15.39:0/2683059542 reap_dead start 2023-11-28T11:57:31.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.961+0000 7f93c6e2f700 1 -- 172.21.15.39:0/2683059542 shutdown_connections 2023-11-28T11:57:31.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.961+0000 7f93c6e2f700 1 -- 172.21.15.39:0/2683059542 >> 172.21.15.39:0/2683059542 conn(0x7f93c00b0f80 msgr2=0x7f93c00ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:31.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.961+0000 7f93c6e2f700 1 -- 172.21.15.39:0/2683059542 shutdown_connections 2023-11-28T11:57:31.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.961+0000 7f93c6e2f700 1 -- 172.21.15.39:0/2683059542 wait complete. 2023-11-28T11:57:31.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.965+0000 7f93c6e2f700 1 Processor -- start 2023-11-28T11:57:31.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.965+0000 7f93c6e2f700 1 -- start start 2023-11-28T11:57:31.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.965+0000 7f93c6e2f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93ac003a20 0x7f93c00b1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:31.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.965+0000 7f93c6e2f700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93c0152340 0x7f93c01632e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:31.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.965+0000 7f93c6e2f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93c00c33c0 0x7f93c00c3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:31.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.965+0000 7f93c6e2f700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c015e270 con 0x7f93c0152340 2023-11-28T11:57:31.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.965+0000 7f93c6e2f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c00c3d70 con 0x7f93ac003a20 2023-11-28T11:57:31.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.965+0000 7f93c6e2f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c0162470 con 0x7f93c00c33c0 2023-11-28T11:57:31.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.965+0000 7f93c562c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93c0152340 0x7f93c01632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:31.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.965+0000 7f93c562c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93c0152340 0x7f93c01632e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56432/0 (socket says 172.21.15.39:56432) 2023-11-28T11:57:31.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.965+0000 7f93c562c700 1 -- 172.21.15.39:0/360211084 learned_addr learned my addr 172.21.15.39:0/360211084 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:31.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.965+0000 7f93c5e2d700 1 --2- 172.21.15.39:0/360211084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93ac003a20 0x7f93c00b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:31.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.965+0000 7f93c662e700 1 --2- 172.21.15.39:0/360211084 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93c00c33c0 0x7f93c00c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:31.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.969+0000 7f93c562c700 1 -- 172.21.15.39:0/360211084 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93c00c33c0 msgr2=0x7f93c00c3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:31.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.969+0000 7f93c562c700 1 --2- 172.21.15.39:0/360211084 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93c00c33c0 0x7f93c00c3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:31.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.969+0000 7f93c562c700 1 -- 172.21.15.39:0/360211084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93ac003a20 msgr2=0x7f93c00b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:31.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.969+0000 7f93c562c700 1 --2- 172.21.15.39:0/360211084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93ac003a20 0x7f93c00b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:31.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.969+0000 7f93c562c700 1 -- 172.21.15.39:0/360211084 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c006b6b0 con 0x7f93c0152340 2023-11-28T11:57:31.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.969+0000 7f93c562c700 1 --2- 172.21.15.39:0/360211084 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93c0152340 0x7f93c01632e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f93b00116f0 tx=0x7f93b0011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:31.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.969+0000 7f93b67fc700 1 -- 172.21.15.39:0/360211084 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b0015870 con 0x7f93c0152340 2023-11-28T11:57:31.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.969+0000 7f93b67fc700 1 -- 172.21.15.39:0/360211084 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b00159d0 con 0x7f93c0152340 2023-11-28T11:57:31.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.969+0000 7f93b67fc700 1 -- 172.21.15.39:0/360211084 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b0015d40 con 0x7f93c0152340 2023-11-28T11:57:31.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.969+0000 7f93c6e2f700 1 -- 172.21.15.39:0/360211084 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93c006b3d0 con 0x7f93c0152340 2023-11-28T11:57:31.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.969+0000 7f93c6e2f700 1 -- 172.21.15.39:0/360211084 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93c00ad8f0 con 0x7f93c0152340 2023-11-28T11:57:31.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.969+0000 7f93c6e2f700 1 -- 172.21.15.39:0/360211084 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93c015da10 con 0x7f93c0152340 2023-11-28T11:57:31.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.973+0000 7f93b67fc700 1 -- 172.21.15.39:0/360211084 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f93b001b030 con 0x7f93c0152340 2023-11-28T11:57:31.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.973+0000 7f93b67fc700 1 --2- 172.21.15.39:0/360211084 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f93a4064f10 0x7f93a40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:31.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.973+0000 7f93b67fc700 1 -- 172.21.15.39:0/360211084 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f93b0082980 con 0x7f93c0152340 2023-11-28T11:57:31.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.977+0000 7f93c5e2d700 1 --2- 172.21.15.39:0/360211084 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f93a4064f10 0x7f93a40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:31.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.977+0000 7f93c5e2d700 1 --2- 172.21.15.39:0/360211084 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f93a4064f10 0x7f93a40673c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f93bc0090b0 tx=0x7f93bc01e040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:31.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:31.981+0000 7f93b67fc700 1 -- 172.21.15.39:0/360211084 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f93b0050790 con 0x7f93c0152340 2023-11-28T11:57:32.170 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.165+0000 7f93c6e2f700 1 -- 172.21.15.39:0/360211084 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93c015da10 con 0x7f93c0152340 2023-11-28T11:57:32.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.169+0000 7f93b67fc700 1 -- 172.21.15.39:0/360211084 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+19748 (secure 0 0 0) 0x7f93c015da10 con 0x7f93c0152340 2023-11-28T11:57:32.174 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:57:32.174 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":31,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:57:21.927556+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:56:38.203736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:56:38.946498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:56:41.988334+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.10","mappings":[{"from":1,"to":5}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:57:32.177 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.173+0000 7f93c6e2f700 1 -- 172.21.15.39:0/360211084 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f93a4064f10 msgr2=0x7f93a40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:32.177 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.173+0000 7f93c6e2f700 1 --2- 172.21.15.39:0/360211084 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f93a4064f10 0x7f93a40673c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f93bc0090b0 tx=0x7f93bc01e040 comp rx=0 tx=0).stop 2023-11-28T11:57:32.177 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.173+0000 7f93c6e2f700 1 -- 172.21.15.39:0/360211084 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93c0152340 msgr2=0x7f93c01632e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:32.177 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.173+0000 7f93c6e2f700 1 --2- 172.21.15.39:0/360211084 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93c0152340 0x7f93c01632e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f93b00116f0 tx=0x7f93b0011a00 comp rx=0 tx=0).stop 2023-11-28T11:57:32.178 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.173+0000 7f93c6e2f700 1 -- 172.21.15.39:0/360211084 shutdown_connections 2023-11-28T11:57:32.178 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.173+0000 7f93c6e2f700 1 --2- 172.21.15.39:0/360211084 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93c00c33c0 0x7f93c00c3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:32.178 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.173+0000 7f93c6e2f700 1 --2- 172.21.15.39:0/360211084 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93c0152340 0x7f93c01632e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:32.178 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.173+0000 7f93c6e2f700 1 --2- 172.21.15.39:0/360211084 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f93a4064f10 0x7f93a40673c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:32.178 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.173+0000 7f93c6e2f700 1 --2- 172.21.15.39:0/360211084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93ac003a20 0x7f93c00b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:32.178 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.173+0000 7f93c6e2f700 1 -- 172.21.15.39:0/360211084 >> 172.21.15.39:0/360211084 conn(0x7f93c00b0f80 msgr2=0x7f93c00afa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:32.179 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.173+0000 7f93c6e2f700 1 -- 172.21.15.39:0/360211084 shutdown_connections 2023-11-28T11:57:32.179 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.173+0000 7f93c6e2f700 1 -- 172.21.15.39:0/360211084 wait complete. 2023-11-28T11:57:32.201 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:56:26.631457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:56:33.242202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:56:38.203736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:56:38.946498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T11:56:41.988334+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T11:57:32.201 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:57:32.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.385+0000 7f9156ec4700 1 Processor -- start 2023-11-28T11:57:32.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.385+0000 7f9156ec4700 1 -- start start 2023-11-28T11:57:32.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.389+0000 7f9156ec4700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9150070620 0x7f91500b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:32.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.389+0000 7f9156ec4700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f915015c520 con 0x7f915015c150 2023-11-28T11:57:32.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.389+0000 7f9156ec4700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f915006cc50 con 0x7f9150069bf0 2023-11-28T11:57:32.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.389+0000 7f9156ec4700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91500b4240 con 0x7f9150070620 2023-11-28T11:57:32.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.389+0000 7f9155ec2700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f915015c150 0x7f915006ff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:51298/0 (socket says 172.21.15.39:51298) 2023-11-28T11:57:32.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.389+0000 7f9155ec2700 1 -- 172.21.15.39:0/2584140906 learned_addr learned my addr 172.21.15.39:0/2584140906 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:32.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.389+0000 7f91556c1700 1 --2- 172.21.15.39:0/2584140906 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9150070620 0x7f91500b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:32.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.389+0000 7f9154ec0700 1 -- 172.21.15.39:0/2584140906 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3874683204 0 0) 0x7f915015c520 con 0x7f915015c150 2023-11-28T11:57:32.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.389+0000 7f9154ec0700 1 -- 172.21.15.39:0/2584140906 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f913c0035d0 con 0x7f915015c150 2023-11-28T11:57:32.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.389+0000 7f91556c1700 1 -- 172.21.15.39:0/2584140906 >> v1:172.21.15.184:6789/0 conn(0x7f9150069bf0 legacy=0x7f915006a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:32.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.389+0000 7f9154ec0700 1 -- 172.21.15.39:0/2584140906 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2837271879 0 0) 0x7f915006cc50 con 0x7f9150069bf0 2023-11-28T11:57:32.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.389+0000 7f91556c1700 1 -- 172.21.15.39:0/2584140906 >> v1:172.21.15.39:6789/0 conn(0x7f915015c150 legacy=0x7f915006ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:32.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.389+0000 7f91556c1700 1 -- 172.21.15.39:0/2584140906 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91500d2450 con 0x7f9150070620 2023-11-28T11:57:32.397 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.393+0000 7f91556c1700 1 --2- 172.21.15.39:0/2584140906 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9150070620 0x7f91500b3d00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9140009870 tx=0x7f9140009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33443620b96b406d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:32.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.393+0000 7f9154ec0700 1 -- 172.21.15.39:0/2584140906 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9140005e50 con 0x7f9150070620 2023-11-28T11:57:32.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.393+0000 7f9154ec0700 1 -- 172.21.15.39:0/2584140906 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9140006030 con 0x7f9150070620 2023-11-28T11:57:32.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.393+0000 7f9154ec0700 1 -- 172.21.15.39:0/2584140906 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91400063c0 con 0x7f9150070620 2023-11-28T11:57:32.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.393+0000 7f9156ec4700 1 -- 172.21.15.39:0/2584140906 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9150070620 msgr2=0x7f91500b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:32.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.393+0000 7f9156ec4700 1 --2- 172.21.15.39:0/2584140906 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9150070620 0x7f91500b3d00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9140009870 tx=0x7f9140009b80 comp rx=0 tx=0).stop 2023-11-28T11:57:32.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.393+0000 7f9156ec4700 1 -- 172.21.15.39:0/2584140906 shutdown_connections 2023-11-28T11:57:32.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.393+0000 7f9156ec4700 1 --2- 172.21.15.39:0/2584140906 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9150070620 0x7f91500b3d00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:32.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.393+0000 7f9156ec4700 1 -- 172.21.15.39:0/2584140906 >> 172.21.15.39:0/2584140906 conn(0x7f91500d3680 msgr2=0x7f91500cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:32.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.393+0000 7f9156ec4700 1 -- 172.21.15.39:0/2584140906 shutdown_connections 2023-11-28T11:57:32.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.393+0000 7f9156ec4700 1 -- 172.21.15.39:0/2584140906 wait complete. 2023-11-28T11:57:32.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.397+0000 7f9156ec4700 1 Processor -- start 2023-11-28T11:57:32.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.397+0000 7f9156ec4700 1 -- start start 2023-11-28T11:57:32.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.397+0000 7f9156ec4700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9150069bf0 0x7f915014e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:32.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.397+0000 7f9156ec4700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9150070620 0x7f915015aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:32.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.397+0000 7f9156ec4700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f915015c150 0x7f915015afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:32.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.397+0000 7f9156ec4700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91500b8010 con 0x7f9150069bf0 2023-11-28T11:57:32.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.397+0000 7f9156ec4700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91500b7400 con 0x7f915015c150 2023-11-28T11:57:32.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.397+0000 7f9156ec4700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91500b76e0 con 0x7f9150070620 2023-11-28T11:57:32.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.401+0000 7f9155ec2700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9150069bf0 0x7f915014e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:32.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.401+0000 7f9155ec2700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9150069bf0 0x7f915014e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56434/0 (socket says 172.21.15.39:56434) 2023-11-28T11:57:32.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.401+0000 7f9155ec2700 1 -- 172.21.15.39:0/2393711426 learned_addr learned my addr 172.21.15.39:0/2393711426 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:32.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.401+0000 7f91566c3700 1 --2- 172.21.15.39:0/2393711426 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f915015c150 0x7f915015afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:32.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.401+0000 7f91556c1700 1 --2- 172.21.15.39:0/2393711426 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9150070620 0x7f915015aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:32.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.401+0000 7f9155ec2700 1 -- 172.21.15.39:0/2393711426 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9150070620 msgr2=0x7f915015aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:32.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.401+0000 7f9155ec2700 1 --2- 172.21.15.39:0/2393711426 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9150070620 0x7f915015aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:32.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.401+0000 7f9155ec2700 1 -- 172.21.15.39:0/2393711426 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f915015c150 msgr2=0x7f915015afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:32.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.401+0000 7f9155ec2700 1 --2- 172.21.15.39:0/2393711426 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f915015c150 0x7f915015afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:32.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.401+0000 7f9155ec2700 1 -- 172.21.15.39:0/2393711426 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9140009450 con 0x7f9150069bf0 2023-11-28T11:57:32.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.401+0000 7f9155ec2700 1 --2- 172.21.15.39:0/2393711426 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9150069bf0 0x7f915014e670 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f914c00c4d0 tx=0x7f914c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:32.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.401+0000 7f91467fc700 1 -- 172.21.15.39:0/2393711426 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914c005d90 con 0x7f9150069bf0 2023-11-28T11:57:32.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.401+0000 7f91467fc700 1 -- 172.21.15.39:0/2393711426 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f914c00ce80 con 0x7f9150069bf0 2023-11-28T11:57:32.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.401+0000 7f91467fc700 1 -- 172.21.15.39:0/2393711426 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914c0072d0 con 0x7f9150069bf0 2023-11-28T11:57:32.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.401+0000 7f9156ec4700 1 -- 172.21.15.39:0/2393711426 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91500d05e0 con 0x7f9150069bf0 2023-11-28T11:57:32.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.401+0000 7f9156ec4700 1 -- 172.21.15.39:0/2393711426 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91500d2730 con 0x7f9150069bf0 2023-11-28T11:57:32.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.405+0000 7f9156ec4700 1 -- 172.21.15.39:0/2393711426 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91500d2140 con 0x7f9150069bf0 2023-11-28T11:57:32.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.405+0000 7f91467fc700 1 -- 172.21.15.39:0/2393711426 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f914c019030 con 0x7f9150069bf0 2023-11-28T11:57:32.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.405+0000 7f91467fc700 1 --2- 172.21.15.39:0/2393711426 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9134064ee0 0x7f9134067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:32.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.409+0000 7f91467fc700 1 -- 172.21.15.39:0/2393711426 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f914c081440 con 0x7f9150069bf0 2023-11-28T11:57:32.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.409+0000 7f91556c1700 1 --2- 172.21.15.39:0/2393711426 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9134064ee0 0x7f9134067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:32.414 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.409+0000 7f91556c1700 1 --2- 172.21.15.39:0/2393711426 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9134064ee0 0x7f9134067390 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9150070a10 tx=0x7f9140008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:32.417 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.413+0000 7f91467fc700 1 -- 172.21.15.39:0/2393711426 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f914c04a400 con 0x7f9150069bf0 2023-11-28T11:57:32.597 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.593+0000 7f9156ec4700 1 -- 172.21.15.39:0/2393711426 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9150073d20 con 0x7f9150069bf0 2023-11-28T11:57:32.597 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.593+0000 7f91467fc700 1 -- 172.21.15.39:0/2393711426 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f914c017020 con 0x7f9150069bf0 2023-11-28T11:57:32.598 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-11-28T11:57:32.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.597+0000 7f9156ec4700 1 -- 172.21.15.39:0/2393711426 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9134064ee0 msgr2=0x7f9134067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:32.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.597+0000 7f9156ec4700 1 --2- 172.21.15.39:0/2393711426 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9134064ee0 0x7f9134067390 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9150070a10 tx=0x7f9140008070 comp rx=0 tx=0).stop 2023-11-28T11:57:32.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.597+0000 7f9156ec4700 1 -- 172.21.15.39:0/2393711426 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9150069bf0 msgr2=0x7f915014e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:32.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.597+0000 7f9156ec4700 1 --2- 172.21.15.39:0/2393711426 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9150069bf0 0x7f915014e670 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f914c00c4d0 tx=0x7f914c00c7e0 comp rx=0 tx=0).stop 2023-11-28T11:57:32.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.597+0000 7f9156ec4700 1 -- 172.21.15.39:0/2393711426 shutdown_connections 2023-11-28T11:57:32.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.597+0000 7f9156ec4700 1 --2- 172.21.15.39:0/2393711426 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9134064ee0 0x7f9134067390 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:32.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.597+0000 7f9156ec4700 1 --2- 172.21.15.39:0/2393711426 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f915015c150 0x7f915015afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:32.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.597+0000 7f9156ec4700 1 --2- 172.21.15.39:0/2393711426 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9150070620 0x7f915015aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:32.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.597+0000 7f9156ec4700 1 --2- 172.21.15.39:0/2393711426 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9150069bf0 0x7f915014e670 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:32.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.597+0000 7f9156ec4700 1 -- 172.21.15.39:0/2393711426 >> 172.21.15.39:0/2393711426 conn(0x7f91500d3680 msgr2=0x7f9150159740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:32.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.597+0000 7f9156ec4700 1 -- 172.21.15.39:0/2393711426 shutdown_connections 2023-11-28T11:57:32.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.597+0000 7f9156ec4700 1 -- 172.21.15.39:0/2393711426 wait complete. 2023-11-28T11:57:32.626 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:57:32.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.809+0000 7fe8f1584700 1 Processor -- start 2023-11-28T11:57:32.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.809+0000 7fe8f1584700 1 -- start start 2023-11-28T11:57:32.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.809+0000 7fe8f1584700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe8ec15c150 0x7fe8ec0b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:32.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.809+0000 7fe8f1584700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8ec06ff10 0x7fe8ec070360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:32.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.809+0000 7fe8f1584700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8ec15c520 con 0x7fe8ec15fc30 2023-11-28T11:57:32.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.809+0000 7fe8f1584700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8ec0b4240 con 0x7fe8ec15c150 2023-11-28T11:57:32.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.813+0000 7fe8f1584700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec0708a0 con 0x7fe8ec06ff10 2023-11-28T11:57:32.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.813+0000 7fe8ebfff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe8ec15c150 0x7fe8ec0b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:32.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.813+0000 7fe8ebfff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe8ec15c150 0x7fe8ec0b3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56444/0 (socket says 172.21.15.39:56444) 2023-11-28T11:57:32.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.813+0000 7fe8ebfff700 1 -- 172.21.15.39:0/1059114748 learned_addr learned my addr 172.21.15.39:0/1059114748 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:32.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.813+0000 7fe8e37fe700 1 --2- 172.21.15.39:0/1059114748 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8ec06ff10 0x7fe8ec070360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:32.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.813+0000 7fe8ebfff700 1 -- 172.21.15.39:0/1059114748 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8ec06ff10 msgr2=0x7fe8ec070360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:32.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.813+0000 7fe8ebfff700 1 --2- 172.21.15.39:0/1059114748 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8ec06ff10 0x7fe8ec070360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:32.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.813+0000 7fe8ebfff700 1 -- 172.21.15.39:0/1059114748 >> v1:172.21.15.184:6789/0 conn(0x7fe8ec15fc30 legacy=0x7fe8ec1600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:32.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.813+0000 7fe8ebfff700 1 -- 172.21.15.39:0/1059114748 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8ec06ac00 con 0x7fe8ec15c150 2023-11-28T11:57:32.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.813+0000 7fe8e37fe700 1 --2- 172.21.15.39:0/1059114748 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8ec06ff10 0x7fe8ec070360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:57:32.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.813+0000 7fe8ebfff700 1 --2- 172.21.15.39:0/1059114748 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8ec15c150 0x7fe8ec0b3d00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc009910 tx=0x7fe8dc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e8abc5df27f4036 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:32.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.813+0000 7fe8eb7fe700 1 -- 172.21.15.39:0/1059114748 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc00ba60 con 0x7fe8ec15c150 2023-11-28T11:57:32.819 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.813+0000 7fe8eb7fe700 1 -- 172.21.15.39:0/1059114748 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8dc00bbc0 con 0x7fe8ec15c150 2023-11-28T11:57:32.819 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.813+0000 7fe8eb7fe700 1 -- 172.21.15.39:0/1059114748 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc009e60 con 0x7fe8ec15c150 2023-11-28T11:57:32.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.813+0000 7fe8f1584700 1 -- 172.21.15.39:0/1059114748 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8ec15c150 msgr2=0x7fe8ec0b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:32.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.813+0000 7fe8f1584700 1 --2- 172.21.15.39:0/1059114748 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8ec15c150 0x7fe8ec0b3d00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc009910 tx=0x7fe8dc009c20 comp rx=0 tx=0).stop 2023-11-28T11:57:32.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.813+0000 7fe8f1584700 1 -- 172.21.15.39:0/1059114748 shutdown_connections 2023-11-28T11:57:32.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.813+0000 7fe8f1584700 1 --2- 172.21.15.39:0/1059114748 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8ec06ff10 0x7fe8ec070360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:32.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.813+0000 7fe8f1584700 1 --2- 172.21.15.39:0/1059114748 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8ec15c150 0x7fe8ec0b3d00 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:32.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.813+0000 7fe8f1584700 1 -- 172.21.15.39:0/1059114748 >> 172.21.15.39:0/1059114748 conn(0x7fe8ec0d3680 msgr2=0x7fe8ec0cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:32.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.813+0000 7fe8f1584700 1 -- 172.21.15.39:0/1059114748 shutdown_connections 2023-11-28T11:57:32.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.813+0000 7fe8f1584700 1 -- 172.21.15.39:0/1059114748 wait complete. 2023-11-28T11:57:32.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.817+0000 7fe8f1584700 1 Processor -- start 2023-11-28T11:57:32.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.817+0000 7fe8f1584700 1 -- start start 2023-11-28T11:57:32.825 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.821+0000 7fe8f1584700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8ec06ff10 0x7fe8ec1f1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:32.825 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.821+0000 7fe8f1584700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8ec15c150 0x7fe8ec1f4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:32.825 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.821+0000 7fe8f1584700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8ec15fc30 0x7fe8ec1f53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:32.825 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.821+0000 7fe8f1584700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec15d830 con 0x7fe8ec15c150 2023-11-28T11:57:32.825 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.821+0000 7fe8f1584700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec0cfed0 con 0x7fe8ec06ff10 2023-11-28T11:57:32.825 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.821+0000 7fe8f1584700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec0cf630 con 0x7fe8ec15fc30 2023-11-28T11:57:32.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.821+0000 7fe8e37fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8ec15c150 0x7fe8ec1f4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:32.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.821+0000 7fe8e37fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8ec15c150 0x7fe8ec1f4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56452/0 (socket says 172.21.15.39:56452) 2023-11-28T11:57:32.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.821+0000 7fe8e37fe700 1 -- 172.21.15.39:0/1821062279 learned_addr learned my addr 172.21.15.39:0/1821062279 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:32.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.821+0000 7fe8ebfff700 1 --2- 172.21.15.39:0/1821062279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8ec06ff10 0x7fe8ec1f1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:32.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.821+0000 7fe8f0d83700 1 --2- 172.21.15.39:0/1821062279 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8ec15fc30 0x7fe8ec1f53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:32.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.821+0000 7fe8e37fe700 1 -- 172.21.15.39:0/1821062279 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8ec15fc30 msgr2=0x7fe8ec1f53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:32.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.821+0000 7fe8e37fe700 1 --2- 172.21.15.39:0/1821062279 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8ec15fc30 0x7fe8ec1f53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:32.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.821+0000 7fe8e37fe700 1 -- 172.21.15.39:0/1821062279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8ec06ff10 msgr2=0x7fe8ec1f1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:32.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.821+0000 7fe8e37fe700 1 --2- 172.21.15.39:0/1821062279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8ec06ff10 0x7fe8ec1f1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:32.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.821+0000 7fe8e37fe700 1 -- 172.21.15.39:0/1821062279 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8dc009570 con 0x7fe8ec15c150 2023-11-28T11:57:32.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.821+0000 7fe8f0d83700 1 --2- 172.21.15.39:0/1821062279 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8ec15fc30 0x7fe8ec1f53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:57:32.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.821+0000 7fe8ebfff700 1 --2- 172.21.15.39:0/1821062279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8ec06ff10 0x7fe8ec1f1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:32.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.821+0000 7fe8e37fe700 1 --2- 172.21.15.39:0/1821062279 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8ec15c150 0x7fe8ec1f4eb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4007fb0 tx=0x7fe8d400a670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:32.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.821+0000 7fe8e97fa700 1 -- 172.21.15.39:0/1821062279 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4014410 con 0x7fe8ec15c150 2023-11-28T11:57:32.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.821+0000 7fe8e97fa700 1 -- 172.21.15.39:0/1821062279 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d4014570 con 0x7fe8ec15c150 2023-11-28T11:57:32.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.821+0000 7fe8e97fa700 1 -- 172.21.15.39:0/1821062279 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d40148e0 con 0x7fe8ec15c150 2023-11-28T11:57:32.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.821+0000 7fe8f1584700 1 -- 172.21.15.39:0/1821062279 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8ec0d2450 con 0x7fe8ec15c150 2023-11-28T11:57:32.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.821+0000 7fe8f1584700 1 -- 172.21.15.39:0/1821062279 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8ec06cc50 con 0x7fe8ec15c150 2023-11-28T11:57:32.829 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.825+0000 7fe8f1584700 1 -- 172.21.15.39:0/1821062279 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8ec0d2730 con 0x7fe8ec15c150 2023-11-28T11:57:32.831 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.825+0000 7fe8e97fa700 1 -- 172.21.15.39:0/1821062279 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe8d401b030 con 0x7fe8ec15c150 2023-11-28T11:57:32.832 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.829+0000 7fe8e97fa700 1 --2- 172.21.15.39:0/1821062279 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe8cc064ee0 0x7fe8cc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:32.833 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.829+0000 7fe8e97fa700 1 -- 172.21.15.39:0/1821062279 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe8d40820c0 con 0x7fe8ec15c150 2023-11-28T11:57:32.833 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.829+0000 7fe8ebfff700 1 --2- 172.21.15.39:0/1821062279 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe8cc064ee0 0x7fe8cc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:32.835 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.829+0000 7fe8ebfff700 1 --2- 172.21.15.39:0/1821062279 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe8cc064ee0 0x7fe8cc067390 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc000c00 tx=0x7fe8dc01d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:32.840 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:32.837+0000 7fe8e97fa700 1 -- 172.21.15.39:0/1821062279 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe8d404c400 con 0x7fe8ec15c150 2023-11-28T11:57:33.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.009+0000 7fe8f1584700 1 -- 172.21.15.39:0/1821062279 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe8ec073d20 con 0x7fe8ec15c150 2023-11-28T11:57:33.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.009+0000 7fe8e97fa700 1 -- 172.21.15.39:0/1821062279 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe8d4019020 con 0x7fe8ec15c150 2023-11-28T11:57:33.013 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-11-28T11:57:33.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.009+0000 7fe8f1584700 1 -- 172.21.15.39:0/1821062279 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe8cc064ee0 msgr2=0x7fe8cc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:33.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.009+0000 7fe8f1584700 1 --2- 172.21.15.39:0/1821062279 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe8cc064ee0 0x7fe8cc067390 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc000c00 tx=0x7fe8dc01d040 comp rx=0 tx=0).stop 2023-11-28T11:57:33.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.009+0000 7fe8f1584700 1 -- 172.21.15.39:0/1821062279 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8ec15c150 msgr2=0x7fe8ec1f4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:33.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.009+0000 7fe8f1584700 1 --2- 172.21.15.39:0/1821062279 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8ec15c150 0x7fe8ec1f4eb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4007fb0 tx=0x7fe8d400a670 comp rx=0 tx=0).stop 2023-11-28T11:57:33.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.013+0000 7fe8f1584700 1 -- 172.21.15.39:0/1821062279 shutdown_connections 2023-11-28T11:57:33.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.013+0000 7fe8f1584700 1 --2- 172.21.15.39:0/1821062279 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8ec15fc30 0x7fe8ec1f53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:33.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.013+0000 7fe8f1584700 1 --2- 172.21.15.39:0/1821062279 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8ec15c150 0x7fe8ec1f4eb0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:33.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.013+0000 7fe8f1584700 1 --2- 172.21.15.39:0/1821062279 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe8cc064ee0 0x7fe8cc067390 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:33.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.013+0000 7fe8f1584700 1 --2- 172.21.15.39:0/1821062279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8ec06ff10 0x7fe8ec1f1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:33.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.013+0000 7fe8f1584700 1 -- 172.21.15.39:0/1821062279 >> 172.21.15.39:0/1821062279 conn(0x7fe8ec0d3680 msgr2=0x7fe8ec0c8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:33.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.013+0000 7fe8f1584700 1 -- 172.21.15.39:0/1821062279 shutdown_connections 2023-11-28T11:57:33.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.013+0000 7fe8f1584700 1 -- 172.21.15.39:0/1821062279 wait complete. 2023-11-28T11:57:33.038 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:57:33.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.225+0000 7f7384a85700 1 Processor -- start 2023-11-28T11:57:33.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.225+0000 7f7384a85700 1 -- start start 2023-11-28T11:57:33.234 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.229+0000 7f7384a85700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f738015c150 0x7f73800b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:33.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.229+0000 7f7384a85700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f738015c520 con 0x7f738006ff10 2023-11-28T11:57:33.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.229+0000 7f7384a85700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f738006ac00 con 0x7f7380070360 2023-11-28T11:57:33.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.229+0000 7f7384a85700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73800b4240 con 0x7f738015c150 2023-11-28T11:57:33.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.229+0000 7f737effd700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f738006ff10 0x7f738015fc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:51312/0 (socket says 172.21.15.39:51312) 2023-11-28T11:57:33.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.229+0000 7f737effd700 1 -- 172.21.15.39:0/2725376831 learned_addr learned my addr 172.21.15.39:0/2725376831 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:33.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.229+0000 7f737f7fe700 1 --2- 172.21.15.39:0/2725376831 >> v2:172.21.15.184:3300/0 conn(0x7f738015c150 0x7f73800b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:33.236 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.233+0000 7f737e7fc700 1 -- 172.21.15.39:0/2725376831 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2958217403 0 0) 0x7f738015c520 con 0x7f738006ff10 2023-11-28T11:57:33.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.233+0000 7f737e7fc700 1 -- 172.21.15.39:0/2725376831 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73680035d0 con 0x7f738006ff10 2023-11-28T11:57:33.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.233+0000 7f737e7fc700 1 -- 172.21.15.39:0/2725376831 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 239907539 0 0) 0x7f738006ac00 con 0x7f7380070360 2023-11-28T11:57:33.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.233+0000 7f737e7fc700 1 -- 172.21.15.39:0/2725376831 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f738015c520 con 0x7f7380070360 2023-11-28T11:57:33.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.233+0000 7f737e7fc700 1 -- 172.21.15.39:0/2725376831 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4187159979 0 0) 0x7f73680035d0 con 0x7f738006ff10 2023-11-28T11:57:33.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.233+0000 7f737f7fe700 1 -- 172.21.15.39:0/2725376831 >> v1:172.21.15.184:6789/0 conn(0x7f7380070360 legacy=0x7f7380160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:33.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.233+0000 7f737f7fe700 1 -- 172.21.15.39:0/2725376831 >> v1:172.21.15.39:6789/0 conn(0x7f738006ff10 legacy=0x7f738015fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:33.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.233+0000 7f737f7fe700 1 -- 172.21.15.39:0/2725376831 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7380160a50 con 0x7f738015c150 2023-11-28T11:57:33.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.233+0000 7f737f7fe700 1 --2- 172.21.15.39:0/2725376831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f738015c150 0x7f73800b3d00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7370009850 tx=0x7f7370009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e12f03a6a678fabf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:33.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.233+0000 7f737e7fc700 1 -- 172.21.15.39:0/2725376831 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73740017f0 con 0x7f738015c150 2023-11-28T11:57:33.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.233+0000 7f737e7fc700 1 -- 172.21.15.39:0/2725376831 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7370004030 con 0x7f738015c150 2023-11-28T11:57:33.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.233+0000 7f737e7fc700 1 -- 172.21.15.39:0/2725376831 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73700043c0 con 0x7f738015c150 2023-11-28T11:57:33.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.233+0000 7f7384a85700 1 -- 172.21.15.39:0/2725376831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f738015c150 msgr2=0x7f73800b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:33.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.233+0000 7f7384a85700 1 --2- 172.21.15.39:0/2725376831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f738015c150 0x7f73800b3d00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7370009850 tx=0x7f7370009b60 comp rx=0 tx=0).stop 2023-11-28T11:57:33.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.233+0000 7f7384a85700 1 -- 172.21.15.39:0/2725376831 shutdown_connections 2023-11-28T11:57:33.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.233+0000 7f7384a85700 1 --2- 172.21.15.39:0/2725376831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f738015c150 0x7f73800b3d00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:33.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.233+0000 7f7384a85700 1 -- 172.21.15.39:0/2725376831 >> 172.21.15.39:0/2725376831 conn(0x7f73800d3680 msgr2=0x7f73800cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:33.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.233+0000 7f7384a85700 1 -- 172.21.15.39:0/2725376831 shutdown_connections 2023-11-28T11:57:33.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.233+0000 7f7384a85700 1 -- 172.21.15.39:0/2725376831 wait complete. 2023-11-28T11:57:33.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.237+0000 7f7384a85700 1 Processor -- start 2023-11-28T11:57:33.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.237+0000 7f7384a85700 1 -- start start 2023-11-28T11:57:33.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.237+0000 7f7384a85700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f738006ff10 0x7f7380145170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:33.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.237+0000 7f7384a85700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7380070360 0x7f7380152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:33.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.237+0000 7f7384a85700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f738015c150 0x7f73801532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:33.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.237+0000 7f7384a85700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7380145b10 con 0x7f738015c150 2023-11-28T11:57:33.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.237+0000 7f7384a85700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73801539b0 con 0x7f738006ff10 2023-11-28T11:57:33.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.237+0000 7f7384a85700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7380153c90 con 0x7f7380070360 2023-11-28T11:57:33.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.241+0000 7f737f7fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f738006ff10 0x7f7380145170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:33.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.241+0000 7f737effd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7380070360 0x7f7380152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:33.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.241+0000 7f737ffff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f738015c150 0x7f73801532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:33.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.241+0000 7f737f7fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f738006ff10 0x7f7380145170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:60432/0 (socket says 172.21.15.39:60432) 2023-11-28T11:57:33.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.241+0000 7f737f7fe700 1 -- 172.21.15.39:0/1926001840 learned_addr learned my addr 172.21.15.39:0/1926001840 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:33.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.241+0000 7f737f7fe700 1 -- 172.21.15.39:0/1926001840 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7380070360 msgr2=0x7f7380152d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:33.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.241+0000 7f737f7fe700 1 --2- 172.21.15.39:0/1926001840 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7380070360 0x7f7380152d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:33.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.241+0000 7f737f7fe700 1 -- 172.21.15.39:0/1926001840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f738015c150 msgr2=0x7f73801532b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:33.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.241+0000 7f737f7fe700 1 --2- 172.21.15.39:0/1926001840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f738015c150 0x7f73801532b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:33.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.241+0000 7f737f7fe700 1 -- 172.21.15.39:0/1926001840 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73700094b0 con 0x7f738006ff10 2023-11-28T11:57:33.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.241+0000 7f737ffff700 1 --2- 172.21.15.39:0/1926001840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f738015c150 0x7f73801532b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:33.247 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.241+0000 7f737f7fe700 1 --2- 172.21.15.39:0/1926001840 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f738006ff10 0x7f7380145170 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7380073200 tx=0x7f7370004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:33.247 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.241+0000 7f7367fff700 1 -- 172.21.15.39:0/1926001840 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7370003c30 con 0x7f738006ff10 2023-11-28T11:57:33.247 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.241+0000 7f7367fff700 1 -- 172.21.15.39:0/1926001840 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f737001f070 con 0x7f738006ff10 2023-11-28T11:57:33.247 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.241+0000 7f7384a85700 1 -- 172.21.15.39:0/1926001840 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73800d2450 con 0x7f738006ff10 2023-11-28T11:57:33.247 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.241+0000 7f7367fff700 1 -- 172.21.15.39:0/1926001840 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7370011630 con 0x7f738006ff10 2023-11-28T11:57:33.247 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.241+0000 7f7384a85700 1 -- 172.21.15.39:0/1926001840 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f738006cc50 con 0x7f738006ff10 2023-11-28T11:57:33.248 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.245+0000 7f7384a85700 1 -- 172.21.15.39:0/1926001840 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73800d2730 con 0x7f738006ff10 2023-11-28T11:57:33.250 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.245+0000 7f7367fff700 1 -- 172.21.15.39:0/1926001840 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f737002a020 con 0x7f738006ff10 2023-11-28T11:57:33.252 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.249+0000 7f7367fff700 1 --2- 172.21.15.39:0/1926001840 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f736c064ee0 0x7f736c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:33.252 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.249+0000 7f7367fff700 1 -- 172.21.15.39:0/1926001840 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7370083630 con 0x7f738006ff10 2023-11-28T11:57:33.252 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.249+0000 7f737effd700 1 --2- 172.21.15.39:0/1926001840 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f736c064ee0 0x7f736c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:33.254 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.249+0000 7f737effd700 1 --2- 172.21.15.39:0/1926001840 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f736c064ee0 0x7f736c067390 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f73800ced70 tx=0x7f7374001c90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:33.259 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.253+0000 7f7367fff700 1 -- 172.21.15.39:0/1926001840 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7370051390 con 0x7f738006ff10 2023-11-28T11:57:33.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.429+0000 7f7384a85700 1 -- 172.21.15.39:0/1926001840 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f73800d0150 con 0x7f738006ff10 2023-11-28T11:57:33.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.433+0000 7f7367fff700 1 -- 172.21.15.39:0/1926001840 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f73700549b0 con 0x7f738006ff10 2023-11-28T11:57:33.436 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-11-28T11:57:33.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.437+0000 7f7384a85700 1 -- 172.21.15.39:0/1926001840 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f736c064ee0 msgr2=0x7f736c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:33.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.437+0000 7f7384a85700 1 --2- 172.21.15.39:0/1926001840 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f736c064ee0 0x7f736c067390 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f73800ced70 tx=0x7f7374001c90 comp rx=0 tx=0).stop 2023-11-28T11:57:33.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.437+0000 7f7384a85700 1 -- 172.21.15.39:0/1926001840 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f738006ff10 msgr2=0x7f7380145170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:33.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.437+0000 7f7384a85700 1 --2- 172.21.15.39:0/1926001840 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f738006ff10 0x7f7380145170 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7380073200 tx=0x7f7370004770 comp rx=0 tx=0).stop 2023-11-28T11:57:33.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.437+0000 7f7384a85700 1 -- 172.21.15.39:0/1926001840 shutdown_connections 2023-11-28T11:57:33.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.437+0000 7f7384a85700 1 --2- 172.21.15.39:0/1926001840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f738015c150 0x7f73801532b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:33.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.437+0000 7f7384a85700 1 --2- 172.21.15.39:0/1926001840 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7380070360 0x7f7380152d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:33.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.437+0000 7f7384a85700 1 --2- 172.21.15.39:0/1926001840 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f736c064ee0 0x7f736c067390 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:33.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.437+0000 7f7384a85700 1 --2- 172.21.15.39:0/1926001840 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f738006ff10 0x7f7380145170 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:33.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.437+0000 7f7384a85700 1 -- 172.21.15.39:0/1926001840 >> 172.21.15.39:0/1926001840 conn(0x7f73800d3680 msgr2=0x7f73800c8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:33.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.437+0000 7f7384a85700 1 -- 172.21.15.39:0/1926001840 shutdown_connections 2023-11-28T11:57:33.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.437+0000 7f7384a85700 1 -- 172.21.15.39:0/1926001840 wait complete. 2023-11-28T11:57:33.465 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:57:33.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.649+0000 7f6a3d7d2700 1 Processor -- start 2023-11-28T11:57:33.655 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.649+0000 7f6a3d7d2700 1 -- start start 2023-11-28T11:57:33.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.653+0000 7f6a3d7d2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a380b11a0 0x7f6a380cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:33.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.653+0000 7f6a3d7d2700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6a3806b2e0 0x7f6a380caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:33.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.653+0000 7f6a3d7d2700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a380cebd0 con 0x7f6a3815cdb0 2023-11-28T11:57:33.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.653+0000 7f6a3d7d2700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a380cd170 con 0x7f6a3806b2e0 2023-11-28T11:57:33.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.653+0000 7f6a3d7d2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a38159710 con 0x7f6a380b11a0 2023-11-28T11:57:33.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.653+0000 7f6a36ffd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a380b11a0 0x7f6a380cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:33.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.653+0000 7f6a377fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6a3806b2e0 0x7f6a380caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:33.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.653+0000 7f6a377fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6a3806b2e0 0x7f6a380caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56470/0 (socket says 172.21.15.39:56470) 2023-11-28T11:57:33.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.653+0000 7f6a377fe700 1 -- 172.21.15.39:0/2949737033 learned_addr learned my addr 172.21.15.39:0/2949737033 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:33.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.653+0000 7f6a377fe700 1 -- 172.21.15.39:0/2949737033 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a380b11a0 msgr2=0x7f6a380cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:33.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.653+0000 7f6a377fe700 1 --2- 172.21.15.39:0/2949737033 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a380b11a0 0x7f6a380cdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:33.660 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.653+0000 7f6a377fe700 1 -- 172.21.15.39:0/2949737033 >> v1:172.21.15.184:6789/0 conn(0x7f6a3815cdb0 legacy=0x7f6a380b1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:33.660 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.653+0000 7f6a377fe700 1 -- 172.21.15.39:0/2949737033 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a380caa80 con 0x7f6a3806b2e0 2023-11-28T11:57:33.660 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.653+0000 7f6a377fe700 1 --2- 172.21.15.39:0/2949737033 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a3806b2e0 0x7f6a380caf10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6a3000d150 tx=0x7f6a3000d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=832ad6b3d6423c79 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:33.660 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.657+0000 7f6a35ffb700 1 -- 172.21.15.39:0/2949737033 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a30010070 con 0x7f6a3806b2e0 2023-11-28T11:57:33.660 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.657+0000 7f6a35ffb700 1 -- 172.21.15.39:0/2949737033 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3000dd10 con 0x7f6a3806b2e0 2023-11-28T11:57:33.660 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.657+0000 7f6a35ffb700 1 -- 172.21.15.39:0/2949737033 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3000b310 con 0x7f6a3806b2e0 2023-11-28T11:57:33.661 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.657+0000 7f6a3d7d2700 1 -- 172.21.15.39:0/2949737033 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a3806b2e0 msgr2=0x7f6a380caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:33.661 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.657+0000 7f6a3d7d2700 1 --2- 172.21.15.39:0/2949737033 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a3806b2e0 0x7f6a380caf10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6a3000d150 tx=0x7f6a3000d460 comp rx=0 tx=0).stop 2023-11-28T11:57:33.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.657+0000 7f6a3d7d2700 1 -- 172.21.15.39:0/2949737033 shutdown_connections 2023-11-28T11:57:33.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.657+0000 7f6a3d7d2700 1 --2- 172.21.15.39:0/2949737033 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a3806b2e0 0x7f6a380caf10 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:33.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.657+0000 7f6a3d7d2700 1 --2- 172.21.15.39:0/2949737033 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a380b11a0 0x7f6a380cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:33.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.657+0000 7f6a3d7d2700 1 -- 172.21.15.39:0/2949737033 >> 172.21.15.39:0/2949737033 conn(0x7f6a380cc1a0 msgr2=0x7f6a380cc570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:33.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.657+0000 7f6a3d7d2700 1 -- 172.21.15.39:0/2949737033 shutdown_connections 2023-11-28T11:57:33.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.657+0000 7f6a3d7d2700 1 -- 172.21.15.39:0/2949737033 wait complete. 2023-11-28T11:57:33.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.661+0000 7f6a3d7d2700 1 Processor -- start 2023-11-28T11:57:33.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.661+0000 7f6a3d7d2700 1 -- start start 2023-11-28T11:57:33.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.661+0000 7f6a3d7d2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a3806b2e0 0x7f6a380c7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:33.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.661+0000 7f6a3d7d2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a380b11a0 0x7f6a380c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:33.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.661+0000 7f6a3d7d2700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a3815cdb0 0x7f6a38156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:33.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.661+0000 7f6a3d7d2700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a380c8960 con 0x7f6a3815cdb0 2023-11-28T11:57:33.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.661+0000 7f6a3d7d2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a380c7ce0 con 0x7f6a380b11a0 2023-11-28T11:57:33.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.661+0000 7f6a3d7d2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a380c7fc0 con 0x7f6a3806b2e0 2023-11-28T11:57:33.668 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.661+0000 7f6a377fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a3815cdb0 0x7f6a38156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:33.668 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.661+0000 7f6a377fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a3815cdb0 0x7f6a38156b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56472/0 (socket says 172.21.15.39:56472) 2023-11-28T11:57:33.668 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.661+0000 7f6a367fc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a380b11a0 0x7f6a380c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:33.668 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.661+0000 7f6a377fe700 1 -- 172.21.15.39:0/2503415718 learned_addr learned my addr 172.21.15.39:0/2503415718 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:33.668 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.661+0000 7f6a36ffd700 1 --2- 172.21.15.39:0/2503415718 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a3806b2e0 0x7f6a380c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:33.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.665+0000 7f6a377fe700 1 -- 172.21.15.39:0/2503415718 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a3806b2e0 msgr2=0x7f6a380c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:33.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.665+0000 7f6a377fe700 1 --2- 172.21.15.39:0/2503415718 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a3806b2e0 0x7f6a380c7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:33.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.665+0000 7f6a377fe700 1 -- 172.21.15.39:0/2503415718 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a380b11a0 msgr2=0x7f6a380c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:33.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.665+0000 7f6a377fe700 1 --2- 172.21.15.39:0/2503415718 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a380b11a0 0x7f6a380c48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:33.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.665+0000 7f6a377fe700 1 -- 172.21.15.39:0/2503415718 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3000bd40 con 0x7f6a3815cdb0 2023-11-28T11:57:33.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.665+0000 7f6a377fe700 1 --2- 172.21.15.39:0/2503415718 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a3815cdb0 0x7f6a38156b70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6a3000d4a0 tx=0x7f6a30004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:33.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.665+0000 7f6a1f7fe700 1 -- 172.21.15.39:0/2503415718 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a30009a10 con 0x7f6a3815cdb0 2023-11-28T11:57:33.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.665+0000 7f6a1f7fe700 1 -- 172.21.15.39:0/2503415718 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a30009b90 con 0x7f6a3815cdb0 2023-11-28T11:57:33.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.665+0000 7f6a3d7d2700 1 -- 172.21.15.39:0/2503415718 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a380ce330 con 0x7f6a3815cdb0 2023-11-28T11:57:33.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.665+0000 7f6a1f7fe700 1 -- 172.21.15.39:0/2503415718 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3000b4c0 con 0x7f6a3815cdb0 2023-11-28T11:57:33.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.665+0000 7f6a3d7d2700 1 -- 172.21.15.39:0/2503415718 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a380ce090 con 0x7f6a3815cdb0 2023-11-28T11:57:33.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.665+0000 7f6a3d7d2700 1 -- 172.21.15.39:0/2503415718 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a380ce610 con 0x7f6a3815cdb0 2023-11-28T11:57:33.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.669+0000 7f6a1f7fe700 1 -- 172.21.15.39:0/2503415718 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6a30004040 con 0x7f6a3815cdb0 2023-11-28T11:57:33.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.673+0000 7f6a1f7fe700 1 --2- 172.21.15.39:0/2503415718 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6a24064ee0 0x7f6a24067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:33.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.673+0000 7f6a1f7fe700 1 -- 172.21.15.39:0/2503415718 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6a30084620 con 0x7f6a3815cdb0 2023-11-28T11:57:33.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.673+0000 7f6a36ffd700 1 --2- 172.21.15.39:0/2503415718 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6a24064ee0 0x7f6a24067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:33.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.673+0000 7f6a36ffd700 1 --2- 172.21.15.39:0/2503415718 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6a24064ee0 0x7f6a24067390 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6a28009bf0 tx=0x7f6a28009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:33.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.677+0000 7f6a1f7fe700 1 -- 172.21.15.39:0/2503415718 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6a300523c0 con 0x7f6a3815cdb0 2023-11-28T11:57:33.860 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.853+0000 7f6a3d7d2700 1 -- 172.21.15.39:0/2503415718 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6a380c86a0 con 0x7f6a3815cdb0 2023-11-28T11:57:33.861 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.857+0000 7f6a1f7fe700 1 -- 172.21.15.39:0/2503415718 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6a300559e0 con 0x7f6a3815cdb0 2023-11-28T11:57:33.861 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2023-11-28T11:57:33.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.857+0000 7f6a3d7d2700 1 -- 172.21.15.39:0/2503415718 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6a24064ee0 msgr2=0x7f6a24067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:33.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.857+0000 7f6a3d7d2700 1 --2- 172.21.15.39:0/2503415718 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6a24064ee0 0x7f6a24067390 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6a28009bf0 tx=0x7f6a28009240 comp rx=0 tx=0).stop 2023-11-28T11:57:33.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.857+0000 7f6a3d7d2700 1 -- 172.21.15.39:0/2503415718 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a3815cdb0 msgr2=0x7f6a38156b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:33.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.857+0000 7f6a3d7d2700 1 --2- 172.21.15.39:0/2503415718 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a3815cdb0 0x7f6a38156b70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6a3000d4a0 tx=0x7f6a30004af0 comp rx=0 tx=0).stop 2023-11-28T11:57:33.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.857+0000 7f6a3d7d2700 1 -- 172.21.15.39:0/2503415718 shutdown_connections 2023-11-28T11:57:33.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.857+0000 7f6a3d7d2700 1 --2- 172.21.15.39:0/2503415718 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a3815cdb0 0x7f6a38156b70 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:33.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.857+0000 7f6a3d7d2700 1 --2- 172.21.15.39:0/2503415718 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6a24064ee0 0x7f6a24067390 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:33.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.857+0000 7f6a3d7d2700 1 --2- 172.21.15.39:0/2503415718 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a380b11a0 0x7f6a380c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:33.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.857+0000 7f6a3d7d2700 1 --2- 172.21.15.39:0/2503415718 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a3806b2e0 0x7f6a380c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:33.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.857+0000 7f6a3d7d2700 1 -- 172.21.15.39:0/2503415718 >> 172.21.15.39:0/2503415718 conn(0x7f6a380cc1a0 msgr2=0x7f6a380cd830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:33.865 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.857+0000 7f6a3d7d2700 1 -- 172.21.15.39:0/2503415718 shutdown_connections 2023-11-28T11:57:33.865 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:33.857+0000 7f6a3d7d2700 1 -- 172.21.15.39:0/2503415718 wait complete. 2023-11-28T11:57:33.884 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T11:57:34.066 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.061+0000 7f639a68c700 1 Processor -- start 2023-11-28T11:57:34.066 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.061+0000 7f639a68c700 1 -- start start 2023-11-28T11:57:34.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.065+0000 7f639a68c700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f639415c410 0x7f6394160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:34.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.065+0000 7f639a68c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f63940cf2a0 0x7f6394069c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:34.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.065+0000 7f639a68c700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63940ca740 con 0x7f639406a1a0 2023-11-28T11:57:34.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.065+0000 7f639a68c700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6394161020 con 0x7f639415c410 2023-11-28T11:57:34.069 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.065+0000 7f639a68c700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63940ca9e0 con 0x7f63940cf2a0 2023-11-28T11:57:34.069 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.065+0000 7f639968a700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f639415c410 0x7f6394160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:34.069 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.065+0000 7f6398e89700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f63940cf2a0 0x7f6394069c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:34.069 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.065+0000 7f6399e8b700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f639406a1a0 0x7f63940b1240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:48334/0 (socket says 172.21.15.39:48334) 2023-11-28T11:57:34.069 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.065+0000 7f6398e89700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f63940cf2a0 0x7f6394069c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:60460/0 (socket says 172.21.15.39:60460) 2023-11-28T11:57:34.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.065+0000 7f6399e8b700 1 -- 172.21.15.39:0/4067848522 learned_addr learned my addr 172.21.15.39:0/4067848522 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:34.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.065+0000 7f639968a700 1 -- 172.21.15.39:0/4067848522 >> v2:172.21.15.184:3300/0 conn(0x7f63940cf2a0 msgr2=0x7f6394069c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:34.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.065+0000 7f639968a700 1 --2- 172.21.15.39:0/4067848522 >> v2:172.21.15.184:3300/0 conn(0x7f63940cf2a0 0x7f6394069c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:34.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.065+0000 7f639968a700 1 -- 172.21.15.39:0/4067848522 >> v1:172.21.15.184:6789/0 conn(0x7f639406a1a0 legacy=0x7f63940b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:34.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.065+0000 7f638bfff700 1 -- 172.21.15.39:0/4067848522 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4171365041 0 0) 0x7f63940ca740 con 0x7f639406a1a0 2023-11-28T11:57:34.071 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.065+0000 7f639968a700 1 -- 172.21.15.39:0/4067848522 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63940cacc0 con 0x7f639415c410 2023-11-28T11:57:34.071 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.065+0000 7f639968a700 1 --2- 172.21.15.39:0/4067848522 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f639415c410 0x7f6394160ae0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6394070050 tx=0x7f6390009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=998a7c833fc1b18d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:34.071 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.065+0000 7f638bfff700 1 -- 172.21.15.39:0/4067848522 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6390011830 con 0x7f639415c410 2023-11-28T11:57:34.071 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.065+0000 7f638bfff700 1 -- 172.21.15.39:0/4067848522 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6390011990 con 0x7f639415c410 2023-11-28T11:57:34.071 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.065+0000 7f638bfff700 1 -- 172.21.15.39:0/4067848522 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6390011d20 con 0x7f639415c410 2023-11-28T11:57:34.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.069+0000 7f639a68c700 1 -- 172.21.15.39:0/4067848522 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f639415c410 msgr2=0x7f6394160ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:34.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.069+0000 7f639a68c700 1 --2- 172.21.15.39:0/4067848522 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f639415c410 0x7f6394160ae0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6394070050 tx=0x7f6390009b30 comp rx=0 tx=0).stop 2023-11-28T11:57:34.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.069+0000 7f639a68c700 1 -- 172.21.15.39:0/4067848522 shutdown_connections 2023-11-28T11:57:34.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.069+0000 7f639a68c700 1 --2- 172.21.15.39:0/4067848522 >> v2:172.21.15.184:3300/0 conn(0x7f63940cf2a0 0x7f6394069c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:34.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.069+0000 7f639a68c700 1 --2- 172.21.15.39:0/4067848522 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f639415c410 0x7f6394160ae0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:34.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.069+0000 7f639a68c700 1 -- 172.21.15.39:0/4067848522 >> 172.21.15.39:0/4067848522 conn(0x7f63940cc240 msgr2=0x7f63940cc610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:34.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.069+0000 7f639a68c700 1 -- 172.21.15.39:0/4067848522 shutdown_connections 2023-11-28T11:57:34.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.069+0000 7f639a68c700 1 -- 172.21.15.39:0/4067848522 wait complete. 2023-11-28T11:57:34.075 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.069+0000 7f639a68c700 1 Processor -- start 2023-11-28T11:57:34.075 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.069+0000 7f639a68c700 1 -- start start 2023-11-28T11:57:34.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.073+0000 7f639a68c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f639406a1a0 0x7f6394155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:34.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.073+0000 7f639a68c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63940cf2a0 0x7f63940b2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:34.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.073+0000 7f639a68c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f639415c410 0x7f6394160420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:34.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.073+0000 7f639a68c700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6394156380 con 0x7f63940cf2a0 2023-11-28T11:57:34.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.073+0000 7f639a68c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63940b3700 con 0x7f639415c410 2023-11-28T11:57:34.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.073+0000 7f639a68c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63940c7920 con 0x7f639406a1a0 2023-11-28T11:57:34.078 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.073+0000 7f6398e89700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63940cf2a0 0x7f63940b2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:34.078 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.073+0000 7f6398e89700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63940cf2a0 0x7f63940b2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56490/0 (socket says 172.21.15.39:56490) 2023-11-28T11:57:34.078 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.073+0000 7f6398e89700 1 -- 172.21.15.39:0/2279676582 learned_addr learned my addr 172.21.15.39:0/2279676582 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:34.078 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.073+0000 7f6399e8b700 1 --2- 172.21.15.39:0/2279676582 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f639415c410 0x7f6394160420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:34.078 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.073+0000 7f639968a700 1 --2- 172.21.15.39:0/2279676582 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f639406a1a0 0x7f6394155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:34.079 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.073+0000 7f6398e89700 1 -- 172.21.15.39:0/2279676582 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f639406a1a0 msgr2=0x7f6394155e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:34.079 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.073+0000 7f6398e89700 1 --2- 172.21.15.39:0/2279676582 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f639406a1a0 0x7f6394155e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:34.079 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.073+0000 7f6398e89700 1 -- 172.21.15.39:0/2279676582 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f639415c410 msgr2=0x7f6394160420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:34.079 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.073+0000 7f6398e89700 1 --2- 172.21.15.39:0/2279676582 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f639415c410 0x7f6394160420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:34.079 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.073+0000 7f6398e89700 1 -- 172.21.15.39:0/2279676582 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63900094b0 con 0x7f63940cf2a0 2023-11-28T11:57:34.079 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.073+0000 7f6398e89700 1 --2- 172.21.15.39:0/2279676582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63940cf2a0 0x7f63940b2e00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f638400e9d0 tx=0x7f638400ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:34.080 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.073+0000 7f6389ffb700 1 -- 172.21.15.39:0/2279676582 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6384009720 con 0x7f63940cf2a0 2023-11-28T11:57:34.080 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.073+0000 7f6389ffb700 1 -- 172.21.15.39:0/2279676582 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638400c850 con 0x7f63940cf2a0 2023-11-28T11:57:34.080 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.073+0000 7f6389ffb700 1 -- 172.21.15.39:0/2279676582 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638400cbc0 con 0x7f63940cf2a0 2023-11-28T11:57:34.080 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.073+0000 7f639a68c700 1 -- 172.21.15.39:0/2279676582 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63940cde70 con 0x7f63940cf2a0 2023-11-28T11:57:34.080 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.073+0000 7f639a68c700 1 -- 172.21.15.39:0/2279676582 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63940cdb90 con 0x7f63940cf2a0 2023-11-28T11:57:34.081 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.077+0000 7f639a68c700 1 -- 172.21.15.39:0/2279676582 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f639415c7e0 con 0x7f63940cf2a0 2023-11-28T11:57:34.082 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.077+0000 7f6389ffb700 1 -- 172.21.15.39:0/2279676582 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6384019030 con 0x7f63940cf2a0 2023-11-28T11:57:34.084 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.081+0000 7f6389ffb700 1 --2- 172.21.15.39:0/2279676582 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6378064ee0 0x7f6378067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:34.084 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.081+0000 7f6389ffb700 1 -- 172.21.15.39:0/2279676582 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6384082330 con 0x7f63940cf2a0 2023-11-28T11:57:34.085 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.081+0000 7f639968a700 1 --2- 172.21.15.39:0/2279676582 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6378064ee0 0x7f6378067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:34.086 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.081+0000 7f639968a700 1 --2- 172.21.15.39:0/2279676582 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6378064ee0 0x7f6378067390 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6390000c00 tx=0x7f6390008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:34.090 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.085+0000 7f6389ffb700 1 -- 172.21.15.39:0/2279676582 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f63840500b0 con 0x7f63940cf2a0 2023-11-28T11:57:34.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.261+0000 7f639a68c700 1 -- 172.21.15.39:0/2279676582 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6394073d20 con 0x7f63940cf2a0 2023-11-28T11:57:34.267 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.261+0000 7f6389ffb700 1 -- 172.21.15.39:0/2279676582 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f63840536d0 con 0x7f63940cf2a0 2023-11-28T11:57:34.267 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-11-28T11:57:34.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.265+0000 7f639a68c700 1 -- 172.21.15.39:0/2279676582 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6378064ee0 msgr2=0x7f6378067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:34.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.265+0000 7f639a68c700 1 --2- 172.21.15.39:0/2279676582 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6378064ee0 0x7f6378067390 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6390000c00 tx=0x7f6390008030 comp rx=0 tx=0).stop 2023-11-28T11:57:34.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.265+0000 7f639a68c700 1 -- 172.21.15.39:0/2279676582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63940cf2a0 msgr2=0x7f63940b2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:34.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.265+0000 7f639a68c700 1 --2- 172.21.15.39:0/2279676582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63940cf2a0 0x7f63940b2e00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f638400e9d0 tx=0x7f638400ed90 comp rx=0 tx=0).stop 2023-11-28T11:57:34.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.265+0000 7f639a68c700 1 -- 172.21.15.39:0/2279676582 shutdown_connections 2023-11-28T11:57:34.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.265+0000 7f639a68c700 1 --2- 172.21.15.39:0/2279676582 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6378064ee0 0x7f6378067390 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:34.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.265+0000 7f639a68c700 1 --2- 172.21.15.39:0/2279676582 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f639415c410 0x7f6394160420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:34.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.265+0000 7f639a68c700 1 --2- 172.21.15.39:0/2279676582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63940cf2a0 0x7f63940b2e00 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:34.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.265+0000 7f639a68c700 1 --2- 172.21.15.39:0/2279676582 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f639406a1a0 0x7f6394155e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:34.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.265+0000 7f639a68c700 1 -- 172.21.15.39:0/2279676582 >> 172.21.15.39:0/2279676582 conn(0x7f63940cc240 msgr2=0x7f63940aeaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:34.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.265+0000 7f639a68c700 1 -- 172.21.15.39:0/2279676582 shutdown_connections 2023-11-28T11:57:34.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.265+0000 7f639a68c700 1 -- 172.21.15.39:0/2279676582 wait complete. 2023-11-28T11:57:34.293 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T11:57:34.483 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.477+0000 7f1158891700 1 Processor -- start 2023-11-28T11:57:34.483 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.477+0000 7f1158891700 1 -- start start 2023-11-28T11:57:34.487 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.481+0000 7f1158891700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f11541534a0 0x7f115415d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:34.487 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.481+0000 7f1158891700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f115415d080 con 0x7f11540b6200 2023-11-28T11:57:34.487 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.481+0000 7f1158891700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1154153870 con 0x7f1154160920 2023-11-28T11:57:34.487 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.481+0000 7f1158891700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11540b53c0 con 0x7f11541534a0 2023-11-28T11:57:34.488 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.481+0000 7f115259c700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f11541534a0 0x7f115415d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:34.488 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.481+0000 7f1151d9b700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f1154160920 0x7f11540b5af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:48336/0 (socket says 172.21.15.39:48336) 2023-11-28T11:57:34.488 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.481+0000 7f1151d9b700 1 -- 172.21.15.39:0/17072294 learned_addr learned my addr 172.21.15.39:0/17072294 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:34.489 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.485+0000 7f115159a700 1 -- 172.21.15.39:0/17072294 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1963568906 0 0) 0x7f1154153870 con 0x7f1154160920 2023-11-28T11:57:34.489 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.485+0000 7f115159a700 1 -- 172.21.15.39:0/17072294 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f113c0035d0 con 0x7f1154160920 2023-11-28T11:57:34.489 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.485+0000 7f115159a700 1 -- 172.21.15.39:0/17072294 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 545723121 0 0) 0x7f115415d080 con 0x7f11540b6200 2023-11-28T11:57:34.489 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.485+0000 7f115159a700 1 -- 172.21.15.39:0/17072294 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1154153870 con 0x7f11540b6200 2023-11-28T11:57:34.489 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.485+0000 7f115259c700 1 -- 172.21.15.39:0/17072294 >> v1:172.21.15.184:6789/0 conn(0x7f1154160920 legacy=0x7f11540b5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:34.489 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.485+0000 7f115259c700 1 -- 172.21.15.39:0/17072294 >> v1:172.21.15.39:6789/0 conn(0x7f11540b6200 legacy=0x7f1154070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:34.489 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.485+0000 7f115259c700 1 -- 172.21.15.39:0/17072294 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11540b56a0 con 0x7f11541534a0 2023-11-28T11:57:34.490 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.485+0000 7f115259c700 1 --2- 172.21.15.39:0/17072294 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11541534a0 0x7f115415d510 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1144009d90 tx=0x7f114400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc4c4149f3768bba server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:34.490 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.485+0000 7f115159a700 1 -- 172.21.15.39:0/17072294 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114400e070 con 0x7f11541534a0 2023-11-28T11:57:34.490 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.485+0000 7f115159a700 1 -- 172.21.15.39:0/17072294 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114400bb20 con 0x7f11541534a0 2023-11-28T11:57:34.490 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.485+0000 7f115159a700 1 -- 172.21.15.39:0/17072294 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114400be90 con 0x7f11541534a0 2023-11-28T11:57:34.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.485+0000 7f1158891700 1 -- 172.21.15.39:0/17072294 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11541534a0 msgr2=0x7f115415d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:34.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.485+0000 7f1158891700 1 --2- 172.21.15.39:0/17072294 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11541534a0 0x7f115415d510 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1144009d90 tx=0x7f114400b330 comp rx=0 tx=0).stop 2023-11-28T11:57:34.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.485+0000 7f1158891700 1 -- 172.21.15.39:0/17072294 shutdown_connections 2023-11-28T11:57:34.492 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.485+0000 7f1158891700 1 --2- 172.21.15.39:0/17072294 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11541534a0 0x7f115415d510 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:34.492 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.485+0000 7f1158891700 1 -- 172.21.15.39:0/17072294 >> 172.21.15.39:0/17072294 conn(0x7f115406bfc0 msgr2=0x7f115406c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:34.492 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.485+0000 7f1158891700 1 -- 172.21.15.39:0/17072294 shutdown_connections 2023-11-28T11:57:34.492 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.485+0000 7f1158891700 1 -- 172.21.15.39:0/17072294 wait complete. 2023-11-28T11:57:34.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.489+0000 7f1158891700 1 Processor -- start 2023-11-28T11:57:34.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.489+0000 7f1158891700 1 -- start start 2023-11-28T11:57:34.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.493+0000 7f1158891700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f11540b6200 0x7f11541f5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:34.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.493+0000 7f1158891700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11541534a0 0x7f11541451a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:34.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.493+0000 7f1158891700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1154160920 0x7f11540d3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:34.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.493+0000 7f1158891700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11541f61d0 con 0x7f1154160920 2023-11-28T11:57:34.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.493+0000 7f1158891700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11540d3a90 con 0x7f11541534a0 2023-11-28T11:57:34.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.493+0000 7f1158891700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11541f1b10 con 0x7f11540b6200 2023-11-28T11:57:34.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.493+0000 7f1152d9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1154160920 0x7f11540d3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:34.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.493+0000 7f1152d9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1154160920 0x7f11540d3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56516/0 (socket says 172.21.15.39:56516) 2023-11-28T11:57:34.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.493+0000 7f1152d9d700 1 -- 172.21.15.39:0/3548555914 learned_addr learned my addr 172.21.15.39:0/3548555914 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:34.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.493+0000 7f115259c700 1 --2- 172.21.15.39:0/3548555914 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f11540b6200 0x7f11541f5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:34.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.493+0000 7f1151d9b700 1 --2- 172.21.15.39:0/3548555914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11541534a0 0x7f11541451a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:34.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.493+0000 7f1152d9d700 1 -- 172.21.15.39:0/3548555914 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f11540b6200 msgr2=0x7f11541f5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:34.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.493+0000 7f1152d9d700 1 --2- 172.21.15.39:0/3548555914 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f11540b6200 0x7f11541f5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:34.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.493+0000 7f1152d9d700 1 -- 172.21.15.39:0/3548555914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11541534a0 msgr2=0x7f11541451a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:34.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.493+0000 7f1152d9d700 1 --2- 172.21.15.39:0/3548555914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11541534a0 0x7f11541451a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:34.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.493+0000 7f1152d9d700 1 -- 172.21.15.39:0/3548555914 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1144009a70 con 0x7f1154160920 2023-11-28T11:57:34.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.493+0000 7f115259c700 1 --2- 172.21.15.39:0/3548555914 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f11540b6200 0x7f11541f5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:57:34.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.493+0000 7f1151d9b700 1 --2- 172.21.15.39:0/3548555914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11541534a0 0x7f11541451a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:57:34.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.493+0000 7f1152d9d700 1 --2- 172.21.15.39:0/3548555914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1154160920 0x7f11540d3550 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f114c00c500 tx=0x7f114c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:34.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.493+0000 7f1142ffd700 1 -- 172.21.15.39:0/3548555914 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c0052d0 con 0x7f1154160920 2023-11-28T11:57:34.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.493+0000 7f1142ffd700 1 -- 172.21.15.39:0/3548555914 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114c005430 con 0x7f1154160920 2023-11-28T11:57:34.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.493+0000 7f1158891700 1 -- 172.21.15.39:0/3548555914 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f115415cd10 con 0x7f1154160920 2023-11-28T11:57:34.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.493+0000 7f1142ffd700 1 -- 172.21.15.39:0/3548555914 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c0055a0 con 0x7f1154160920 2023-11-28T11:57:34.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.493+0000 7f1158891700 1 -- 172.21.15.39:0/3548555914 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f115415ca30 con 0x7f1154160920 2023-11-28T11:57:34.500 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.497+0000 7f1158891700 1 -- 172.21.15.39:0/3548555914 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11540b7f10 con 0x7f1154160920 2023-11-28T11:57:34.500 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.497+0000 7f1142ffd700 1 -- 172.21.15.39:0/3548555914 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f114c019030 con 0x7f1154160920 2023-11-28T11:57:34.502 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.497+0000 7f1142ffd700 1 --2- 172.21.15.39:0/3548555914 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1134064ee0 0x7f1134067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:34.502 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.497+0000 7f1142ffd700 1 -- 172.21.15.39:0/3548555914 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f114c081550 con 0x7f1154160920 2023-11-28T11:57:34.503 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.497+0000 7f115259c700 1 --2- 172.21.15.39:0/3548555914 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1134064ee0 0x7f1134067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:34.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.501+0000 7f115259c700 1 --2- 172.21.15.39:0/3548555914 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1134064ee0 0x7f1134067390 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1144009fd0 tx=0x7f1144011000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:34.509 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.505+0000 7f1142ffd700 1 -- 172.21.15.39:0/3548555914 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f114c04f480 con 0x7f1154160920 2023-11-28T11:57:34.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.693+0000 7f1158891700 1 -- 172.21.15.39:0/3548555914 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f115415db20 con 0x7f1154160920 2023-11-28T11:57:34.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.693+0000 7f1142ffd700 1 -- 172.21.15.39:0/3548555914 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7f114c052aa0 con 0x7f1154160920 2023-11-28T11:57:34.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.697+0000 7f1158891700 1 -- 172.21.15.39:0/3548555914 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1134064ee0 msgr2=0x7f1134067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:34.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.697+0000 7f1158891700 1 --2- 172.21.15.39:0/3548555914 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1134064ee0 0x7f1134067390 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1144009fd0 tx=0x7f1144011000 comp rx=0 tx=0).stop 2023-11-28T11:57:34.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.697+0000 7f1158891700 1 -- 172.21.15.39:0/3548555914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1154160920 msgr2=0x7f11540d3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:34.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.697+0000 7f1158891700 1 --2- 172.21.15.39:0/3548555914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1154160920 0x7f11540d3550 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f114c00c500 tx=0x7f114c00c8c0 comp rx=0 tx=0).stop 2023-11-28T11:57:34.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.697+0000 7f1158891700 1 -- 172.21.15.39:0/3548555914 shutdown_connections 2023-11-28T11:57:34.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.697+0000 7f1158891700 1 --2- 172.21.15.39:0/3548555914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1154160920 0x7f11540d3550 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:34.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.697+0000 7f1158891700 1 --2- 172.21.15.39:0/3548555914 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1134064ee0 0x7f1134067390 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:34.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.697+0000 7f1158891700 1 --2- 172.21.15.39:0/3548555914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11541534a0 0x7f11541451a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:34.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.697+0000 7f1158891700 1 --2- 172.21.15.39:0/3548555914 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f11540b6200 0x7f11541f5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:34.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.697+0000 7f1158891700 1 -- 172.21.15.39:0/3548555914 >> 172.21.15.39:0/3548555914 conn(0x7f115406bfc0 msgr2=0x7f115415d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:34.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.697+0000 7f1158891700 1 -- 172.21.15.39:0/3548555914 shutdown_connections 2023-11-28T11:57:34.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:34.697+0000 7f1158891700 1 -- 172.21.15.39:0/3548555914 wait complete. 2023-11-28T11:57:34.705 INFO:teuthology.orchestra.run.smithi039.stderr:listed 0 entries 2023-11-28T11:57:34.724 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-28T11:57:34.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:34.725 DEBUG:teuthology.orchestra.run.smithi039:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-11-28T11:57:34.776 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi039.front.sepia.ceph.com 2023-11-28T11:57:34.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:34.776 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T11:57:34.840 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:57:34.840 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:57:34.862 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:57:34.862 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:57:34.922 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:57:34.922 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:57:34.981 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:57:35.181 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.177+0000 7f7b4a851700 1 Processor -- start 2023-11-28T11:57:35.181 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.177+0000 7f7b4a851700 1 -- start start 2023-11-28T11:57:35.183 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.177+0000 7f7b4a851700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7b4415a480 0x7f7b440cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:35.183 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.177+0000 7f7b4a851700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b44069d60 0x7f7b4406a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:35.183 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.177+0000 7f7b4a851700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b4415a850 con 0x7f7b440c8d10 2023-11-28T11:57:35.183 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.177+0000 7f7b4a851700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b440ce060 con 0x7f7b4415a480 2023-11-28T11:57:35.183 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.177+0000 7f7b4a851700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b440ce300 con 0x7f7b44069d60 2023-11-28T11:57:35.184 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.177+0000 7f7b43fff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7b4415a480 0x7f7b440cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:35.184 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.177+0000 7f7b43fff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7b4415a480 0x7f7b440cc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56518/0 (socket says 172.21.15.39:56518) 2023-11-28T11:57:35.184 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.181+0000 7f7b43fff700 1 -- 172.21.15.39:0/613572494 learned_addr learned my addr 172.21.15.39:0/613572494 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:35.184 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.181+0000 7f7b48dee700 1 --2- 172.21.15.39:0/613572494 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b44069d60 0x7f7b4406a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:35.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.181+0000 7f7b43fff700 1 -- 172.21.15.39:0/613572494 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b44069d60 msgr2=0x7f7b4406a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:35.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.181+0000 7f7b43fff700 1 --2- 172.21.15.39:0/613572494 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b44069d60 0x7f7b4406a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:35.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.181+0000 7f7b43fff700 1 -- 172.21.15.39:0/613572494 >> v1:172.21.15.39:6789/0 conn(0x7f7b440c8d10 legacy=0x7f7b440cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:35.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.181+0000 7f7b43fff700 1 -- 172.21.15.39:0/613572494 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b440cada0 con 0x7f7b4415a480 2023-11-28T11:57:35.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.181+0000 7f7b42ffd700 1 -- 172.21.15.39:0/613572494 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1373076455 0 0) 0x7f7b4415a850 con 0x7f7b440c8d10 2023-11-28T11:57:35.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.181+0000 7f7b43fff700 1 --2- 172.21.15.39:0/613572494 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b4415a480 0x7f7b440cc290 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7b34009910 tx=0x7f7b34009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51a5298b9e01bf2b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:35.186 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.181+0000 7f7b42ffd700 1 -- 172.21.15.39:0/613572494 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b34011830 con 0x7f7b4415a480 2023-11-28T11:57:35.186 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.181+0000 7f7b42ffd700 1 -- 172.21.15.39:0/613572494 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b34011990 con 0x7f7b4415a480 2023-11-28T11:57:35.186 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.181+0000 7f7b42ffd700 1 -- 172.21.15.39:0/613572494 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b34011d40 con 0x7f7b4415a480 2023-11-28T11:57:35.187 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.181+0000 7f7b4a851700 1 -- 172.21.15.39:0/613572494 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b4415a480 msgr2=0x7f7b440cc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:35.187 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.181+0000 7f7b4a851700 1 --2- 172.21.15.39:0/613572494 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b4415a480 0x7f7b440cc290 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7b34009910 tx=0x7f7b34009c20 comp rx=0 tx=0).stop 2023-11-28T11:57:35.187 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.181+0000 7f7b4a851700 1 -- 172.21.15.39:0/613572494 shutdown_connections 2023-11-28T11:57:35.187 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.181+0000 7f7b4a851700 1 --2- 172.21.15.39:0/613572494 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b44069d60 0x7f7b4406a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:35.187 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.181+0000 7f7b4a851700 1 --2- 172.21.15.39:0/613572494 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b4415a480 0x7f7b440cc290 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:35.187 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.181+0000 7f7b4a851700 1 -- 172.21.15.39:0/613572494 >> 172.21.15.39:0/613572494 conn(0x7f7b440cf350 msgr2=0x7f7b440b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:35.187 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.181+0000 7f7b4a851700 1 -- 172.21.15.39:0/613572494 shutdown_connections 2023-11-28T11:57:35.187 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.181+0000 7f7b4a851700 1 -- 172.21.15.39:0/613572494 wait complete. 2023-11-28T11:57:35.189 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.185+0000 7f7b4a851700 1 Processor -- start 2023-11-28T11:57:35.190 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.185+0000 7f7b4a851700 1 -- start start 2023-11-28T11:57:35.192 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.185+0000 7f7b4a851700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b44069d60 0x7f7b440c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:35.192 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.185+0000 7f7b4a851700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b440c8d10 0x7f7b441f5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:35.192 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.185+0000 7f7b4a851700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b4415a480 0x7f7b4415d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:35.192 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.185+0000 7f7b4a851700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b44146840 con 0x7f7b4415a480 2023-11-28T11:57:35.192 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.185+0000 7f7b4a851700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b441f6070 con 0x7f7b44069d60 2023-11-28T11:57:35.192 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.185+0000 7f7b4a851700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b440c8a20 con 0x7f7b440c8d10 2023-11-28T11:57:35.193 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.189+0000 7f7b48dee700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b4415a480 0x7f7b4415d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:35.193 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.189+0000 7f7b48dee700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b4415a480 0x7f7b4415d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56528/0 (socket says 172.21.15.39:56528) 2023-11-28T11:57:35.193 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.189+0000 7f7b48dee700 1 -- 172.21.15.39:0/565378272 learned_addr learned my addr 172.21.15.39:0/565378272 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:35.193 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.189+0000 7f7b437fe700 1 --2- 172.21.15.39:0/565378272 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b440c8d10 0x7f7b441f5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:35.193 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.189+0000 7f7b43fff700 1 --2- 172.21.15.39:0/565378272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b44069d60 0x7f7b440c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:35.193 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.189+0000 7f7b48dee700 1 -- 172.21.15.39:0/565378272 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b440c8d10 msgr2=0x7f7b441f5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:35.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.189+0000 7f7b48dee700 1 --2- 172.21.15.39:0/565378272 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b440c8d10 0x7f7b441f5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:35.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.189+0000 7f7b48dee700 1 -- 172.21.15.39:0/565378272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b44069d60 msgr2=0x7f7b440c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:35.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.189+0000 7f7b48dee700 1 --2- 172.21.15.39:0/565378272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b44069d60 0x7f7b440c77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:35.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.189+0000 7f7b48dee700 1 -- 172.21.15.39:0/565378272 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b34009570 con 0x7f7b4415a480 2023-11-28T11:57:35.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.189+0000 7f7b48dee700 1 --2- 172.21.15.39:0/565378272 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b4415a480 0x7f7b4415d120 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c009d30 tx=0x7f7b3c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:35.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.189+0000 7f7b40ff9700 1 -- 172.21.15.39:0/565378272 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c00cc90 con 0x7f7b4415a480 2023-11-28T11:57:35.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.189+0000 7f7b40ff9700 1 -- 172.21.15.39:0/565378272 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3c00f040 con 0x7f7b4415a480 2023-11-28T11:57:35.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.189+0000 7f7b4a851700 1 -- 172.21.15.39:0/565378272 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b440add50 con 0x7f7b4415a480 2023-11-28T11:57:35.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.189+0000 7f7b40ff9700 1 -- 172.21.15.39:0/565378272 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c009e80 con 0x7f7b4415a480 2023-11-28T11:57:35.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.189+0000 7f7b4a851700 1 -- 172.21.15.39:0/565378272 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b440caa30 con 0x7f7b4415a480 2023-11-28T11:57:35.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.193+0000 7f7b4a851700 1 -- 172.21.15.39:0/565378272 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b440ca6e0 con 0x7f7b4415a480 2023-11-28T11:57:35.198 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.193+0000 7f7b40ff9700 1 -- 172.21.15.39:0/565378272 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7b3c014480 con 0x7f7b4415a480 2023-11-28T11:57:35.199 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.193+0000 7f7b40ff9700 1 --2- 172.21.15.39:0/565378272 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7b30064ee0 0x7f7b30067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:35.200 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.197+0000 7f7b40ff9700 1 -- 172.21.15.39:0/565378272 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7b3c082a80 con 0x7f7b4415a480 2023-11-28T11:57:35.200 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.197+0000 7f7b43fff700 1 --2- 172.21.15.39:0/565378272 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7b30064ee0 0x7f7b30067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:35.202 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.197+0000 7f7b43fff700 1 --2- 172.21.15.39:0/565378272 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7b30064ee0 0x7f7b30067390 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7b34014040 tx=0x7f7b34008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:35.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.201+0000 7f7b40ff9700 1 -- 172.21.15.39:0/565378272 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7b3c050890 con 0x7f7b4415a480 2023-11-28T11:57:35.385 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.377+0000 7f7b4a851700 1 -- 172.21.15.39:0/565378272 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b440b0920 con 0x7f7b4415a480 2023-11-28T11:57:35.386 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.381+0000 7f7b40ff9700 1 -- 172.21.15.39:0/565378272 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+19748 (secure 0 0 0) 0x7f7b3c053eb0 con 0x7f7b4415a480 2023-11-28T11:57:35.387 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:57:35.387 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":31,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:57:21.927556+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:56:38.203736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:56:38.946498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:56:41.988334+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.10","mappings":[{"from":1,"to":5}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:57:35.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.385+0000 7f7b4a851700 1 -- 172.21.15.39:0/565378272 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7b30064ee0 msgr2=0x7f7b30067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:35.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.385+0000 7f7b4a851700 1 --2- 172.21.15.39:0/565378272 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7b30064ee0 0x7f7b30067390 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7b34014040 tx=0x7f7b34008030 comp rx=0 tx=0).stop 2023-11-28T11:57:35.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.385+0000 7f7b4a851700 1 -- 172.21.15.39:0/565378272 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b4415a480 msgr2=0x7f7b4415d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:35.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.385+0000 7f7b4a851700 1 --2- 172.21.15.39:0/565378272 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b4415a480 0x7f7b4415d120 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c009d30 tx=0x7f7b3c00c3a0 comp rx=0 tx=0).stop 2023-11-28T11:57:35.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.385+0000 7f7b4a851700 1 -- 172.21.15.39:0/565378272 shutdown_connections 2023-11-28T11:57:35.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.385+0000 7f7b4a851700 1 --2- 172.21.15.39:0/565378272 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b4415a480 0x7f7b4415d120 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:35.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.385+0000 7f7b4a851700 1 --2- 172.21.15.39:0/565378272 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b440c8d10 0x7f7b441f5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:35.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.385+0000 7f7b4a851700 1 --2- 172.21.15.39:0/565378272 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7b30064ee0 0x7f7b30067390 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:35.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.385+0000 7f7b4a851700 1 --2- 172.21.15.39:0/565378272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b44069d60 0x7f7b440c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:35.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.385+0000 7f7b4a851700 1 -- 172.21.15.39:0/565378272 >> 172.21.15.39:0/565378272 conn(0x7f7b440cf350 msgr2=0x7f7b440cc290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:35.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.385+0000 7f7b4a851700 1 -- 172.21.15.39:0/565378272 shutdown_connections 2023-11-28T11:57:35.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.385+0000 7f7b4a851700 1 -- 172.21.15.39:0/565378272 wait complete. 2023-11-28T11:57:35.414 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:56:26.631457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:56:33.242202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:56:38.203736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:56:38.946498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T11:56:41.988334+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T11:57:35.414 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:57:35.598 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.593+0000 7efcfb14f700 1 Processor -- start 2023-11-28T11:57:35.598 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.593+0000 7efcfb14f700 1 -- start start 2023-11-28T11:57:35.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.597+0000 7efcfb14f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efcf4159cd0 0x7efcf415d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:35.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.597+0000 7efcfb14f700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7efcf406ff10 0x7efcf40703b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:35.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.597+0000 7efcfb14f700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf415d650 con 0x7efcf40cc1a0 2023-11-28T11:57:35.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.597+0000 7efcfb14f700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf40708f0 con 0x7efcf406ff10 2023-11-28T11:57:35.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.597+0000 7efcfb14f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf406be80 con 0x7efcf4159cd0 2023-11-28T11:57:35.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.597+0000 7efcfa94e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7efcf406ff10 0x7efcf40703b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:35.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.597+0000 7efcfa94e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7efcf406ff10 0x7efcf40703b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56542/0 (socket says 172.21.15.39:56542) 2023-11-28T11:57:35.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.597+0000 7efcfa94e700 1 -- 172.21.15.39:0/2213598531 learned_addr learned my addr 172.21.15.39:0/2213598531 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:35.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.597+0000 7efcf994c700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7efcf40cc1a0 0x7efcf406c890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:51342/0 (socket says 172.21.15.39:51342) 2023-11-28T11:57:35.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.597+0000 7efcfa14d700 1 --2- 172.21.15.39:0/2213598531 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efcf4159cd0 0x7efcf415d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:35.604 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.597+0000 7efcfa94e700 1 -- 172.21.15.39:0/2213598531 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efcf4159cd0 msgr2=0x7efcf415d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:35.604 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.597+0000 7efcfa94e700 1 --2- 172.21.15.39:0/2213598531 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efcf4159cd0 0x7efcf415d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:35.604 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.597+0000 7efcfa94e700 1 -- 172.21.15.39:0/2213598531 >> v1:172.21.15.39:6789/0 conn(0x7efcf40cc1a0 legacy=0x7efcf406c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:35.604 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.597+0000 7efcfa94e700 1 -- 172.21.15.39:0/2213598531 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf415a0a0 con 0x7efcf406ff10 2023-11-28T11:57:35.604 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.597+0000 7efcf914b700 1 -- 172.21.15.39:0/2213598531 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 941121175 0 0) 0x7efcf415d650 con 0x7efcf40cc1a0 2023-11-28T11:57:35.604 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.601+0000 7efcfa94e700 1 --2- 172.21.15.39:0/2213598531 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcf406ff10 0x7efcf40703b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7efcec009e50 tx=0x7efcec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f476951458946252 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:35.605 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.601+0000 7efcf914b700 1 -- 172.21.15.39:0/2213598531 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec00e070 con 0x7efcf406ff10 2023-11-28T11:57:35.605 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.601+0000 7efcf914b700 1 -- 172.21.15.39:0/2213598531 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcec00b910 con 0x7efcf406ff10 2023-11-28T11:57:35.605 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.601+0000 7efcf914b700 1 -- 172.21.15.39:0/2213598531 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec00bcc0 con 0x7efcf406ff10 2023-11-28T11:57:35.606 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.601+0000 7efcfb14f700 1 -- 172.21.15.39:0/2213598531 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcf406ff10 msgr2=0x7efcf40703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:35.606 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.601+0000 7efcfb14f700 1 --2- 172.21.15.39:0/2213598531 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcf406ff10 0x7efcf40703b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7efcec009e50 tx=0x7efcec00b330 comp rx=0 tx=0).stop 2023-11-28T11:57:35.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.601+0000 7efcfb14f700 1 -- 172.21.15.39:0/2213598531 shutdown_connections 2023-11-28T11:57:35.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.601+0000 7efcfb14f700 1 --2- 172.21.15.39:0/2213598531 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcf406ff10 0x7efcf40703b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:35.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.601+0000 7efcfb14f700 1 --2- 172.21.15.39:0/2213598531 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efcf4159cd0 0x7efcf415d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:35.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.601+0000 7efcfb14f700 1 -- 172.21.15.39:0/2213598531 >> 172.21.15.39:0/2213598531 conn(0x7efcf40cf280 msgr2=0x7efcf40cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:35.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.601+0000 7efcfb14f700 1 -- 172.21.15.39:0/2213598531 shutdown_connections 2023-11-28T11:57:35.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.601+0000 7efcfb14f700 1 -- 172.21.15.39:0/2213598531 wait complete. 2023-11-28T11:57:35.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.605+0000 7efcfb14f700 1 Processor -- start 2023-11-28T11:57:35.610 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.605+0000 7efcfb14f700 1 -- start start 2023-11-28T11:57:35.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.605+0000 7efcfb14f700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcf406ff10 0x7efcf40c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:35.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.605+0000 7efcfb14f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efcf40cc1a0 0x7efcf40c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:35.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.605+0000 7efcfb14f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efcf4159cd0 0x7efcf40b1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:35.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.605+0000 7efcfb14f700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf41542b0 con 0x7efcf406ff10 2023-11-28T11:57:35.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.605+0000 7efcfb14f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf4154590 con 0x7efcf40cc1a0 2023-11-28T11:57:35.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.605+0000 7efcfb14f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf4157e50 con 0x7efcf4159cd0 2023-11-28T11:57:35.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.605+0000 7efcfa14d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcf406ff10 0x7efcf40c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:35.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.605+0000 7efcfa14d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcf406ff10 0x7efcf40c7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56554/0 (socket says 172.21.15.39:56554) 2023-11-28T11:57:35.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.605+0000 7efcfa14d700 1 -- 172.21.15.39:0/2279720482 learned_addr learned my addr 172.21.15.39:0/2279720482 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:35.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.609+0000 7efcf994c700 1 --2- 172.21.15.39:0/2279720482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efcf40cc1a0 0x7efcf40c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:35.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.609+0000 7efcfa94e700 1 --2- 172.21.15.39:0/2279720482 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efcf4159cd0 0x7efcf40b1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:35.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.609+0000 7efcfa14d700 1 -- 172.21.15.39:0/2279720482 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efcf4159cd0 msgr2=0x7efcf40b1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:35.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.609+0000 7efcfa14d700 1 --2- 172.21.15.39:0/2279720482 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efcf4159cd0 0x7efcf40b1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:35.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.609+0000 7efcfa14d700 1 -- 172.21.15.39:0/2279720482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efcf40cc1a0 msgr2=0x7efcf40c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:35.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.609+0000 7efcfa14d700 1 --2- 172.21.15.39:0/2279720482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efcf40cc1a0 0x7efcf40c5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:35.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.609+0000 7efcfa14d700 1 -- 172.21.15.39:0/2279720482 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcec009b30 con 0x7efcf406ff10 2023-11-28T11:57:35.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.609+0000 7efcfa94e700 1 --2- 172.21.15.39:0/2279720482 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efcf4159cd0 0x7efcf40b1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:57:35.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.609+0000 7efcfa14d700 1 --2- 172.21.15.39:0/2279720482 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcf406ff10 0x7efcf40c7f80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7efcf000e840 tx=0x7efcf000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:35.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.609+0000 7efceaffd700 1 -- 172.21.15.39:0/2279720482 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf00095a0 con 0x7efcf406ff10 2023-11-28T11:57:35.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.609+0000 7efceaffd700 1 -- 172.21.15.39:0/2279720482 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf000c690 con 0x7efcf406ff10 2023-11-28T11:57:35.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.609+0000 7efcfb14f700 1 -- 172.21.15.39:0/2279720482 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf40ce260 con 0x7efcf406ff10 2023-11-28T11:57:35.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.609+0000 7efceaffd700 1 -- 172.21.15.39:0/2279720482 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf000ca00 con 0x7efcf406ff10 2023-11-28T11:57:35.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.609+0000 7efcfb14f700 1 -- 172.21.15.39:0/2279720482 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf40cdf80 con 0x7efcf406ff10 2023-11-28T11:57:35.616 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.609+0000 7efcfb14f700 1 -- 172.21.15.39:0/2279720482 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf406c090 con 0x7efcf406ff10 2023-11-28T11:57:35.617 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.613+0000 7efceaffd700 1 -- 172.21.15.39:0/2279720482 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7efcf0019030 con 0x7efcf406ff10 2023-11-28T11:57:35.619 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.613+0000 7efceaffd700 1 --2- 172.21.15.39:0/2279720482 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7efcd8064ee0 0x7efcd8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:35.619 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.613+0000 7efceaffd700 1 -- 172.21.15.39:0/2279720482 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7efcf00821c0 con 0x7efcf406ff10 2023-11-28T11:57:35.620 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.617+0000 7efcf994c700 1 --2- 172.21.15.39:0/2279720482 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7efcd8064ee0 0x7efcd8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:35.621 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.617+0000 7efcf994c700 1 --2- 172.21.15.39:0/2279720482 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7efcd8064ee0 0x7efcd8067390 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efcf4070fd0 tx=0x7efce4007c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:35.626 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.621+0000 7efceaffd700 1 -- 172.21.15.39:0/2279720482 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7efcf004feb0 con 0x7efcf406ff10 2023-11-28T11:57:35.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.797+0000 7efcfb14f700 1 -- 172.21.15.39:0/2279720482 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efcf40cca80 con 0x7efcf406ff10 2023-11-28T11:57:35.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.801+0000 7efceaffd700 1 -- 172.21.15.39:0/2279720482 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7efcf00534d0 con 0x7efcf406ff10 2023-11-28T11:57:35.805 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-11-28T11:57:35.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.801+0000 7efcfb14f700 1 -- 172.21.15.39:0/2279720482 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7efcd8064ee0 msgr2=0x7efcd8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:35.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.801+0000 7efcfb14f700 1 --2- 172.21.15.39:0/2279720482 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7efcd8064ee0 0x7efcd8067390 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efcf4070fd0 tx=0x7efce4007c00 comp rx=0 tx=0).stop 2023-11-28T11:57:35.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.801+0000 7efcfb14f700 1 -- 172.21.15.39:0/2279720482 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcf406ff10 msgr2=0x7efcf40c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:35.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.801+0000 7efcfb14f700 1 --2- 172.21.15.39:0/2279720482 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcf406ff10 0x7efcf40c7f80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7efcf000e840 tx=0x7efcf000ec00 comp rx=0 tx=0).stop 2023-11-28T11:57:35.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.801+0000 7efcfb14f700 1 -- 172.21.15.39:0/2279720482 shutdown_connections 2023-11-28T11:57:35.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.801+0000 7efcfb14f700 1 --2- 172.21.15.39:0/2279720482 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efcf4159cd0 0x7efcf40b1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:35.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.801+0000 7efcfb14f700 1 --2- 172.21.15.39:0/2279720482 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7efcd8064ee0 0x7efcd8067390 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:35.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.801+0000 7efcfb14f700 1 --2- 172.21.15.39:0/2279720482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efcf40cc1a0 0x7efcf40c5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:35.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.801+0000 7efcfb14f700 1 --2- 172.21.15.39:0/2279720482 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcf406ff10 0x7efcf40c7f80 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:35.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.801+0000 7efcfb14f700 1 -- 172.21.15.39:0/2279720482 >> 172.21.15.39:0/2279720482 conn(0x7efcf40cf280 msgr2=0x7efcf4069bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:35.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.801+0000 7efcfb14f700 1 -- 172.21.15.39:0/2279720482 shutdown_connections 2023-11-28T11:57:35.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:35.805+0000 7efcfb14f700 1 -- 172.21.15.39:0/2279720482 wait complete. 2023-11-28T11:57:35.830 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:57:36.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.013+0000 7f375759e700 1 Processor -- start 2023-11-28T11:57:36.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.013+0000 7f375759e700 1 -- start start 2023-11-28T11:57:36.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.017+0000 7f375759e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f375815c150 0x7f37580b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:36.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.017+0000 7f375759e700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f375815c520 con 0x7f375806ff10 2023-11-28T11:57:36.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.017+0000 7f375759e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f375806ac00 con 0x7f3758070360 2023-11-28T11:57:36.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.017+0000 7f375759e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37580b4240 con 0x7f375815c150 2023-11-28T11:57:36.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.017+0000 7f375659c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f375815c150 0x7f37580b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:36.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.017+0000 7f3755d9b700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f375806ff10 0x7f375815fc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:51350/0 (socket says 172.21.15.39:51350) 2023-11-28T11:57:36.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.017+0000 7f3755d9b700 1 -- 172.21.15.39:0/1491502196 learned_addr learned my addr 172.21.15.39:0/1491502196 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:36.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.017+0000 7f375659c700 1 -- 172.21.15.39:0/1491502196 >> v1:172.21.15.184:6789/0 conn(0x7f3758070360 legacy=0x7f3758160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:36.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.017+0000 7f375559a700 1 -- 172.21.15.39:0/1491502196 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1835671341 0 0) 0x7f375815c520 con 0x7f375806ff10 2023-11-28T11:57:36.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.017+0000 7f375659c700 1 -- 172.21.15.39:0/1491502196 >> v1:172.21.15.39:6789/0 conn(0x7f375806ff10 legacy=0x7f375815fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:36.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.017+0000 7f375659c700 1 -- 172.21.15.39:0/1491502196 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3758160a50 con 0x7f375815c150 2023-11-28T11:57:36.023 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.017+0000 7f375659c700 1 --2- 172.21.15.39:0/1491502196 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f375815c150 0x7f37580b3d00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3748009850 tx=0x7f3748009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3bc22d69a39913d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:36.023 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.017+0000 7f375559a700 1 -- 172.21.15.39:0/1491502196 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3748011830 con 0x7f375815c150 2023-11-28T11:57:36.024 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.017+0000 7f375559a700 1 -- 172.21.15.39:0/1491502196 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3748011990 con 0x7f375815c150 2023-11-28T11:57:36.024 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.017+0000 7f375559a700 1 -- 172.21.15.39:0/1491502196 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3748011d20 con 0x7f375815c150 2023-11-28T11:57:36.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.021+0000 7f375759e700 1 -- 172.21.15.39:0/1491502196 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f375815c150 msgr2=0x7f37580b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:36.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.021+0000 7f375759e700 1 --2- 172.21.15.39:0/1491502196 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f375815c150 0x7f37580b3d00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3748009850 tx=0x7f3748009b60 comp rx=0 tx=0).stop 2023-11-28T11:57:36.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.021+0000 7f375759e700 1 -- 172.21.15.39:0/1491502196 shutdown_connections 2023-11-28T11:57:36.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.021+0000 7f375759e700 1 --2- 172.21.15.39:0/1491502196 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f375815c150 0x7f37580b3d00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:36.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.021+0000 7f375759e700 1 -- 172.21.15.39:0/1491502196 >> 172.21.15.39:0/1491502196 conn(0x7f37580d3680 msgr2=0x7f37580cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:36.026 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.021+0000 7f375759e700 1 -- 172.21.15.39:0/1491502196 shutdown_connections 2023-11-28T11:57:36.026 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.021+0000 7f375759e700 1 -- 172.21.15.39:0/1491502196 wait complete. 2023-11-28T11:57:36.029 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.025+0000 7f375759e700 1 Processor -- start 2023-11-28T11:57:36.029 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.025+0000 7f375759e700 1 -- start start 2023-11-28T11:57:36.031 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.025+0000 7f375759e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f375806ff10 0x7f375814d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:36.031 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.025+0000 7f375759e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3758070360 0x7f37580cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:36.031 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.025+0000 7f375759e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f375815c150 0x7f37580cbf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:36.031 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.025+0000 7f375759e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375814dfd0 con 0x7f375815c150 2023-11-28T11:57:36.031 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.025+0000 7f375759e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375814fc10 con 0x7f375806ff10 2023-11-28T11:57:36.031 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.025+0000 7f375759e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37580ca450 con 0x7f3758070360 2023-11-28T11:57:36.032 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.025+0000 7f3756d9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f375815c150 0x7f37580cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:36.032 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.025+0000 7f3756d9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f375815c150 0x7f37580cbf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56568/0 (socket says 172.21.15.39:56568) 2023-11-28T11:57:36.032 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.025+0000 7f3756d9d700 1 -- 172.21.15.39:0/62491272 learned_addr learned my addr 172.21.15.39:0/62491272 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:36.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.025+0000 7f3755d9b700 1 --2- 172.21.15.39:0/62491272 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3758070360 0x7f37580cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:36.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.025+0000 7f375659c700 1 --2- 172.21.15.39:0/62491272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f375806ff10 0x7f375814d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:36.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.029+0000 7f3756d9d700 1 -- 172.21.15.39:0/62491272 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3758070360 msgr2=0x7f37580cb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:36.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.029+0000 7f3756d9d700 1 --2- 172.21.15.39:0/62491272 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3758070360 0x7f37580cb9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:36.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.029+0000 7f3756d9d700 1 -- 172.21.15.39:0/62491272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f375806ff10 msgr2=0x7f375814d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:36.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.029+0000 7f3756d9d700 1 --2- 172.21.15.39:0/62491272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f375806ff10 0x7f375814d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:36.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.029+0000 7f3756d9d700 1 -- 172.21.15.39:0/62491272 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37480094b0 con 0x7f375815c150 2023-11-28T11:57:36.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.029+0000 7f375659c700 1 --2- 172.21.15.39:0/62491272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f375806ff10 0x7f375814d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:36.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.029+0000 7f3756d9d700 1 --2- 172.21.15.39:0/62491272 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f375815c150 0x7f37580cbf10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f375000cc50 tx=0x7f375000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:36.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.029+0000 7f3746ffd700 1 -- 172.21.15.39:0/62491272 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3750003c20 con 0x7f375815c150 2023-11-28T11:57:36.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.029+0000 7f3746ffd700 1 -- 172.21.15.39:0/62491272 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3750003d80 con 0x7f375815c150 2023-11-28T11:57:36.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.029+0000 7f3746ffd700 1 -- 172.21.15.39:0/62491272 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375000aab0 con 0x7f375815c150 2023-11-28T11:57:36.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.029+0000 7f375759e700 1 -- 172.21.15.39:0/62491272 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37580d2450 con 0x7f375815c150 2023-11-28T11:57:36.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.029+0000 7f375759e700 1 -- 172.21.15.39:0/62491272 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f375806cc50 con 0x7f375815c150 2023-11-28T11:57:36.035 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.029+0000 7f375759e700 1 -- 172.21.15.39:0/62491272 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37580d2730 con 0x7f375815c150 2023-11-28T11:57:36.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.033+0000 7f3746ffd700 1 -- 172.21.15.39:0/62491272 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3750010050 con 0x7f375815c150 2023-11-28T11:57:36.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.033+0000 7f3746ffd700 1 --2- 172.21.15.39:0/62491272 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3738064ee0 0x7f3738067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:36.040 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.033+0000 7f3746ffd700 1 -- 172.21.15.39:0/62491272 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f37500820c0 con 0x7f375815c150 2023-11-28T11:57:36.040 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.037+0000 7f375659c700 1 --2- 172.21.15.39:0/62491272 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3738064ee0 0x7f3738067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:36.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.037+0000 7f375659c700 1 --2- 172.21.15.39:0/62491272 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3738064ee0 0x7f3738067390 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f37480090b0 tx=0x7f374801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:36.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.041+0000 7f3746ffd700 1 -- 172.21.15.39:0/62491272 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f375004fe40 con 0x7f375815c150 2023-11-28T11:57:36.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.209+0000 7f375759e700 1 -- 172.21.15.39:0/62491272 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3758073d20 con 0x7f375815c150 2023-11-28T11:57:36.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.213+0000 7f3746ffd700 1 -- 172.21.15.39:0/62491272 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3750053460 con 0x7f375815c150 2023-11-28T11:57:36.216 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-11-28T11:57:36.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.217+0000 7f375759e700 1 -- 172.21.15.39:0/62491272 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3738064ee0 msgr2=0x7f3738067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:36.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.217+0000 7f375759e700 1 --2- 172.21.15.39:0/62491272 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3738064ee0 0x7f3738067390 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f37480090b0 tx=0x7f374801c040 comp rx=0 tx=0).stop 2023-11-28T11:57:36.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.217+0000 7f375759e700 1 -- 172.21.15.39:0/62491272 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f375815c150 msgr2=0x7f37580cbf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:36.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.217+0000 7f375759e700 1 --2- 172.21.15.39:0/62491272 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f375815c150 0x7f37580cbf10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f375000cc50 tx=0x7f375000cf60 comp rx=0 tx=0).stop 2023-11-28T11:57:36.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.217+0000 7f375759e700 1 -- 172.21.15.39:0/62491272 shutdown_connections 2023-11-28T11:57:36.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.217+0000 7f375759e700 1 --2- 172.21.15.39:0/62491272 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f375815c150 0x7f37580cbf10 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:36.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.217+0000 7f375759e700 1 --2- 172.21.15.39:0/62491272 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3758070360 0x7f37580cb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:36.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.217+0000 7f375759e700 1 --2- 172.21.15.39:0/62491272 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3738064ee0 0x7f3738067390 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:36.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.217+0000 7f375759e700 1 --2- 172.21.15.39:0/62491272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f375806ff10 0x7f375814d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:36.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.217+0000 7f375759e700 1 -- 172.21.15.39:0/62491272 >> 172.21.15.39:0/62491272 conn(0x7f37580d3680 msgr2=0x7f3758156810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:36.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.217+0000 7f375759e700 1 -- 172.21.15.39:0/62491272 shutdown_connections 2023-11-28T11:57:36.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.217+0000 7f375759e700 1 -- 172.21.15.39:0/62491272 wait complete. 2023-11-28T11:57:36.247 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:57:36.432 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.429+0000 7fe85b518700 1 Processor -- start 2023-11-28T11:57:36.433 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.429+0000 7fe85b518700 1 -- start start 2023-11-28T11:57:36.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.429+0000 7fe85b518700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe854070620 0x7fe8540b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:36.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.429+0000 7fe85b518700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe85415c520 con 0x7fe854069bf0 2023-11-28T11:57:36.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.429+0000 7fe85b518700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe85406cc50 con 0x7fe85415c150 2023-11-28T11:57:36.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.429+0000 7fe85b518700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8540b4240 con 0x7fe854070620 2023-11-28T11:57:36.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.429+0000 7fe85ad17700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fe854069bf0 0x7fe854069ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:51362/0 (socket says 172.21.15.39:51362) 2023-11-28T11:57:36.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.429+0000 7fe85ad17700 1 -- 172.21.15.39:0/401987394 learned_addr learned my addr 172.21.15.39:0/401987394 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:36.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.429+0000 7fe859d15700 1 --2- 172.21.15.39:0/401987394 >> v2:172.21.15.184:3300/0 conn(0x7fe854070620 0x7fe8540b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:36.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.433+0000 7fe859514700 1 -- 172.21.15.39:0/401987394 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 628331335 0 0) 0x7fe85415c520 con 0x7fe854069bf0 2023-11-28T11:57:36.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.433+0000 7fe859514700 1 -- 172.21.15.39:0/401987394 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8400035d0 con 0x7fe854069bf0 2023-11-28T11:57:36.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.433+0000 7fe859d15700 1 -- 172.21.15.39:0/401987394 >> v1:172.21.15.184:6789/0 conn(0x7fe85415c150 legacy=0x7fe85406ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:36.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.433+0000 7fe859d15700 1 -- 172.21.15.39:0/401987394 >> v1:172.21.15.39:6789/0 conn(0x7fe854069bf0 legacy=0x7fe854069ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:36.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.433+0000 7fe859d15700 1 -- 172.21.15.39:0/401987394 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8540d2450 con 0x7fe854070620 2023-11-28T11:57:36.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.433+0000 7fe859d15700 1 --2- 172.21.15.39:0/401987394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe854070620 0x7fe8540b3d00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe844009840 tx=0x7fe844009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e722ebea2ed4aedd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:36.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.433+0000 7fe859514700 1 -- 172.21.15.39:0/401987394 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe844005e50 con 0x7fe854070620 2023-11-28T11:57:36.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.433+0000 7fe859514700 1 -- 172.21.15.39:0/401987394 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe844006030 con 0x7fe854070620 2023-11-28T11:57:36.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.433+0000 7fe859514700 1 -- 172.21.15.39:0/401987394 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8440063c0 con 0x7fe854070620 2023-11-28T11:57:36.439 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.433+0000 7fe85b518700 1 -- 172.21.15.39:0/401987394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe854070620 msgr2=0x7fe8540b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:36.439 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.433+0000 7fe85b518700 1 --2- 172.21.15.39:0/401987394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe854070620 0x7fe8540b3d00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe844009840 tx=0x7fe844009b50 comp rx=0 tx=0).stop 2023-11-28T11:57:36.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.433+0000 7fe85b518700 1 -- 172.21.15.39:0/401987394 shutdown_connections 2023-11-28T11:57:36.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.433+0000 7fe85b518700 1 --2- 172.21.15.39:0/401987394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe854070620 0x7fe8540b3d00 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:36.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.433+0000 7fe85b518700 1 -- 172.21.15.39:0/401987394 >> 172.21.15.39:0/401987394 conn(0x7fe8540d3680 msgr2=0x7fe8540cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:36.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.433+0000 7fe85b518700 1 -- 172.21.15.39:0/401987394 shutdown_connections 2023-11-28T11:57:36.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.433+0000 7fe85b518700 1 -- 172.21.15.39:0/401987394 wait complete. 2023-11-28T11:57:36.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.437+0000 7fe85b518700 1 Processor -- start 2023-11-28T11:57:36.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.437+0000 7fe85b518700 1 -- start start 2023-11-28T11:57:36.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.441+0000 7fe85b518700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe854069bf0 0x7fe854151610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:36.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.441+0000 7fe85b518700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe854070620 0x7fe8540cd440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:36.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.441+0000 7fe85b518700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe85415c150 0x7fe8540cd980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:36.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.441+0000 7fe85b518700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8540cb090 con 0x7fe854069bf0 2023-11-28T11:57:36.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.441+0000 7fe85b518700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8540c93c0 con 0x7fe85415c150 2023-11-28T11:57:36.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.441+0000 7fe85b518700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8540ce000 con 0x7fe854070620 2023-11-28T11:57:36.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.441+0000 7fe85a516700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe854069bf0 0x7fe854151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:36.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.441+0000 7fe85a516700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe854069bf0 0x7fe854151610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56584/0 (socket says 172.21.15.39:56584) 2023-11-28T11:57:36.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.441+0000 7fe85a516700 1 -- 172.21.15.39:0/3400937981 learned_addr learned my addr 172.21.15.39:0/3400937981 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:36.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.441+0000 7fe85ad17700 1 --2- 172.21.15.39:0/3400937981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe85415c150 0x7fe8540cd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:36.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.441+0000 7fe859d15700 1 --2- 172.21.15.39:0/3400937981 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe854070620 0x7fe8540cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:36.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.441+0000 7fe85a516700 1 -- 172.21.15.39:0/3400937981 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe854070620 msgr2=0x7fe8540cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:36.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.441+0000 7fe85a516700 1 --2- 172.21.15.39:0/3400937981 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe854070620 0x7fe8540cd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:36.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.441+0000 7fe85a516700 1 -- 172.21.15.39:0/3400937981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe85415c150 msgr2=0x7fe8540cd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:36.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.441+0000 7fe85a516700 1 --2- 172.21.15.39:0/3400937981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe85415c150 0x7fe8540cd980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:36.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.441+0000 7fe85a516700 1 -- 172.21.15.39:0/3400937981 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe844009450 con 0x7fe854069bf0 2023-11-28T11:57:36.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.441+0000 7fe85a516700 1 --2- 172.21.15.39:0/3400937981 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe854069bf0 0x7fe854151610 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe85000c500 tx=0x7fe85000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:36.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.441+0000 7fe84affd700 1 -- 172.21.15.39:0/3400937981 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8500052d0 con 0x7fe854069bf0 2023-11-28T11:57:36.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.441+0000 7fe84affd700 1 -- 172.21.15.39:0/3400937981 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe850005430 con 0x7fe854069bf0 2023-11-28T11:57:36.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.441+0000 7fe85b518700 1 -- 172.21.15.39:0/3400937981 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8540d05e0 con 0x7fe854069bf0 2023-11-28T11:57:36.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.441+0000 7fe84affd700 1 -- 172.21.15.39:0/3400937981 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8500055a0 con 0x7fe854069bf0 2023-11-28T11:57:36.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.441+0000 7fe85b518700 1 -- 172.21.15.39:0/3400937981 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8540d2730 con 0x7fe854069bf0 2023-11-28T11:57:36.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.445+0000 7fe85b518700 1 -- 172.21.15.39:0/3400937981 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8540d2140 con 0x7fe854069bf0 2023-11-28T11:57:36.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.445+0000 7fe84affd700 1 -- 172.21.15.39:0/3400937981 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe850019030 con 0x7fe854069bf0 2023-11-28T11:57:36.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.445+0000 7fe84affd700 1 --2- 172.21.15.39:0/3400937981 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe838064ee0 0x7fe838067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:36.452 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.445+0000 7fe84affd700 1 -- 172.21.15.39:0/3400937981 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe850081470 con 0x7fe854069bf0 2023-11-28T11:57:36.452 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.449+0000 7fe859d15700 1 --2- 172.21.15.39:0/3400937981 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe838064ee0 0x7fe838067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:36.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.449+0000 7fe859d15700 1 --2- 172.21.15.39:0/3400937981 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe838064ee0 0x7fe838067390 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe854070a10 tx=0x7fe844008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:36.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.453+0000 7fe84affd700 1 -- 172.21.15.39:0/3400937981 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe85004f1f0 con 0x7fe854069bf0 2023-11-28T11:57:36.635 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.629+0000 7fe85b518700 1 -- 172.21.15.39:0/3400937981 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe854073d20 con 0x7fe854069bf0 2023-11-28T11:57:36.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.633+0000 7fe84affd700 1 -- 172.21.15.39:0/3400937981 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe850052810 con 0x7fe854069bf0 2023-11-28T11:57:36.636 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-11-28T11:57:36.641 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.637+0000 7fe85b518700 1 -- 172.21.15.39:0/3400937981 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe838064ee0 msgr2=0x7fe838067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:36.641 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.637+0000 7fe85b518700 1 --2- 172.21.15.39:0/3400937981 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe838064ee0 0x7fe838067390 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe854070a10 tx=0x7fe844008070 comp rx=0 tx=0).stop 2023-11-28T11:57:36.641 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.637+0000 7fe85b518700 1 -- 172.21.15.39:0/3400937981 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe854069bf0 msgr2=0x7fe854151610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:36.641 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.637+0000 7fe85b518700 1 --2- 172.21.15.39:0/3400937981 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe854069bf0 0x7fe854151610 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe85000c500 tx=0x7fe85000c810 comp rx=0 tx=0).stop 2023-11-28T11:57:36.641 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.637+0000 7fe85b518700 1 -- 172.21.15.39:0/3400937981 shutdown_connections 2023-11-28T11:57:36.641 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.637+0000 7fe85b518700 1 --2- 172.21.15.39:0/3400937981 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe838064ee0 0x7fe838067390 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:36.641 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.637+0000 7fe85b518700 1 --2- 172.21.15.39:0/3400937981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe85415c150 0x7fe8540cd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:36.642 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.637+0000 7fe85b518700 1 --2- 172.21.15.39:0/3400937981 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe854070620 0x7fe8540cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:36.642 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.637+0000 7fe85b518700 1 --2- 172.21.15.39:0/3400937981 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe854069bf0 0x7fe854151610 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:36.642 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.637+0000 7fe85b518700 1 -- 172.21.15.39:0/3400937981 >> 172.21.15.39:0/3400937981 conn(0x7fe8540d3680 msgr2=0x7fe854157430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:36.642 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.637+0000 7fe85b518700 1 -- 172.21.15.39:0/3400937981 shutdown_connections 2023-11-28T11:57:36.642 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.637+0000 7fe85b518700 1 -- 172.21.15.39:0/3400937981 wait complete. 2023-11-28T11:57:36.662 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:57:36.844 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.837+0000 7fcc499bc700 1 Processor -- start 2023-11-28T11:57:36.845 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.841+0000 7fcc499bc700 1 -- start start 2023-11-28T11:57:36.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.841+0000 7fcc499bc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcc4415c150 0x7fcc440b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:36.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.841+0000 7fcc499bc700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fcc44070360 0x7fcc44160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:36.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.841+0000 7fcc499bc700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc4415c520 con 0x7fcc4406ff10 2023-11-28T11:57:36.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.841+0000 7fcc499bc700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc440b4240 con 0x7fcc44070360 2023-11-28T11:57:36.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.841+0000 7fcc499bc700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4406ac00 con 0x7fcc4415c150 2023-11-28T11:57:36.848 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.841+0000 7fcc491bb700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fcc44070360 0x7fcc44160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:36.848 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.841+0000 7fcc489ba700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcc4415c150 0x7fcc440b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:36.848 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.841+0000 7fcc43fff700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fcc4406ff10 0x7fcc4415fc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:48364/0 (socket says 172.21.15.39:48364) 2023-11-28T11:57:36.848 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.841+0000 7fcc43fff700 1 -- 172.21.15.39:0/2533155957 learned_addr learned my addr 172.21.15.39:0/2533155957 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:36.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.845+0000 7fcc437fe700 1 -- 172.21.15.39:0/2533155957 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1790686996 0 0) 0x7fcc4415c520 con 0x7fcc4406ff10 2023-11-28T11:57:36.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.845+0000 7fcc437fe700 1 -- 172.21.15.39:0/2533155957 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc340035d0 con 0x7fcc4406ff10 2023-11-28T11:57:36.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.845+0000 7fcc489ba700 1 -- 172.21.15.39:0/2533155957 >> v2:172.21.15.184:3300/0 conn(0x7fcc44070360 msgr2=0x7fcc44160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:36.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.845+0000 7fcc489ba700 1 --2- 172.21.15.39:0/2533155957 >> v2:172.21.15.184:3300/0 conn(0x7fcc44070360 0x7fcc44160340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:36.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.845+0000 7fcc489ba700 1 -- 172.21.15.39:0/2533155957 >> v1:172.21.15.184:6789/0 conn(0x7fcc4406ff10 legacy=0x7fcc4415fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:36.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.845+0000 7fcc489ba700 1 -- 172.21.15.39:0/2533155957 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc4406cc50 con 0x7fcc4415c150 2023-11-28T11:57:36.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.845+0000 7fcc491bb700 1 --2- 172.21.15.39:0/2533155957 >> v2:172.21.15.184:3300/0 conn(0x7fcc44070360 0x7fcc44160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:36.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.845+0000 7fcc489ba700 1 --2- 172.21.15.39:0/2533155957 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcc4415c150 0x7fcc440b3d00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcc38009d90 tx=0x7fcc3800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97bf6b74d1545605 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:36.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.845+0000 7fcc437fe700 1 -- 172.21.15.39:0/2533155957 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3800e070 con 0x7fcc4415c150 2023-11-28T11:57:36.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.845+0000 7fcc437fe700 1 -- 172.21.15.39:0/2533155957 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc3800bb20 con 0x7fcc4415c150 2023-11-28T11:57:36.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.845+0000 7fcc437fe700 1 -- 172.21.15.39:0/2533155957 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3800be90 con 0x7fcc4415c150 2023-11-28T11:57:36.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.845+0000 7fcc499bc700 1 -- 172.21.15.39:0/2533155957 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcc4415c150 msgr2=0x7fcc440b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:36.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.845+0000 7fcc499bc700 1 --2- 172.21.15.39:0/2533155957 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcc4415c150 0x7fcc440b3d00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcc38009d90 tx=0x7fcc3800b330 comp rx=0 tx=0).stop 2023-11-28T11:57:36.852 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.845+0000 7fcc499bc700 1 -- 172.21.15.39:0/2533155957 shutdown_connections 2023-11-28T11:57:36.852 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.845+0000 7fcc499bc700 1 --2- 172.21.15.39:0/2533155957 >> v2:172.21.15.184:3300/0 conn(0x7fcc44070360 0x7fcc44160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:36.852 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.845+0000 7fcc499bc700 1 --2- 172.21.15.39:0/2533155957 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcc4415c150 0x7fcc440b3d00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:36.852 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.845+0000 7fcc499bc700 1 -- 172.21.15.39:0/2533155957 >> 172.21.15.39:0/2533155957 conn(0x7fcc440d3680 msgr2=0x7fcc440cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:36.852 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.845+0000 7fcc499bc700 1 -- 172.21.15.39:0/2533155957 shutdown_connections 2023-11-28T11:57:36.852 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.845+0000 7fcc499bc700 1 -- 172.21.15.39:0/2533155957 wait complete. 2023-11-28T11:57:36.855 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.849+0000 7fcc499bc700 1 Processor -- start 2023-11-28T11:57:36.855 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.849+0000 7fcc499bc700 1 -- start start 2023-11-28T11:57:36.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.853+0000 7fcc499bc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcc4406ff10 0x7fcc441597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:36.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.853+0000 7fcc499bc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc44070360 0x7fcc4415b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:36.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.853+0000 7fcc499bc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc4415c150 0x7fcc440cb790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:36.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.853+0000 7fcc499bc700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc440cb390 con 0x7fcc44070360 2023-11-28T11:57:36.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.853+0000 7fcc499bc700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4414a5e0 con 0x7fcc4415c150 2023-11-28T11:57:36.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.853+0000 7fcc499bc700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc44159cf0 con 0x7fcc4406ff10 2023-11-28T11:57:36.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.853+0000 7fcc43fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc44070360 0x7fcc4415b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:36.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.853+0000 7fcc489ba700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcc4406ff10 0x7fcc441597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:36.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.853+0000 7fcc491bb700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc4415c150 0x7fcc440cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:36.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.853+0000 7fcc43fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc44070360 0x7fcc4415b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56594/0 (socket says 172.21.15.39:56594) 2023-11-28T11:57:36.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.853+0000 7fcc489ba700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcc4406ff10 0x7fcc441597b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:50158/0 (socket says 172.21.15.39:50158) 2023-11-28T11:57:36.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.853+0000 7fcc43fff700 1 -- 172.21.15.39:0/3324395083 learned_addr learned my addr 172.21.15.39:0/3324395083 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:36.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.853+0000 7fcc43fff700 1 -- 172.21.15.39:0/3324395083 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcc4406ff10 msgr2=0x7fcc441597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:36.860 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.853+0000 7fcc43fff700 1 --2- 172.21.15.39:0/3324395083 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcc4406ff10 0x7fcc441597b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:36.860 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.853+0000 7fcc43fff700 1 -- 172.21.15.39:0/3324395083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc4415c150 msgr2=0x7fcc440cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:36.860 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.853+0000 7fcc43fff700 1 --2- 172.21.15.39:0/3324395083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc4415c150 0x7fcc440cb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:36.860 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.853+0000 7fcc43fff700 1 -- 172.21.15.39:0/3324395083 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc3c0094b0 con 0x7fcc44070360 2023-11-28T11:57:36.860 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.853+0000 7fcc491bb700 1 --2- 172.21.15.39:0/3324395083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc4415c150 0x7fcc440cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:36.861 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.853+0000 7fcc43fff700 1 --2- 172.21.15.39:0/3324395083 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc44070360 0x7fcc4415b160 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcc3000c4f0 tx=0x7fcc3000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:36.861 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.857+0000 7fcc417fa700 1 -- 172.21.15.39:0/3324395083 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc30005de0 con 0x7fcc44070360 2023-11-28T11:57:36.861 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.857+0000 7fcc499bc700 1 -- 172.21.15.39:0/3324395083 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc38009a70 con 0x7fcc44070360 2023-11-28T11:57:36.861 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.857+0000 7fcc417fa700 1 -- 172.21.15.39:0/3324395083 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc300070d0 con 0x7fcc44070360 2023-11-28T11:57:36.861 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.857+0000 7fcc417fa700 1 -- 172.21.15.39:0/3324395083 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc30007480 con 0x7fcc44070360 2023-11-28T11:57:36.861 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.857+0000 7fcc499bc700 1 -- 172.21.15.39:0/3324395083 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc440d2730 con 0x7fcc44070360 2023-11-28T11:57:36.862 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.857+0000 7fcc499bc700 1 -- 172.21.15.39:0/3324395083 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc440d2450 con 0x7fcc44070360 2023-11-28T11:57:36.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.861+0000 7fcc417fa700 1 -- 172.21.15.39:0/3324395083 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fcc30019030 con 0x7fcc44070360 2023-11-28T11:57:36.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.861+0000 7fcc417fa700 1 --2- 172.21.15.39:0/3324395083 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcc28064f10 0x7fcc280673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:36.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.861+0000 7fcc417fa700 1 -- 172.21.15.39:0/3324395083 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcc300815d0 con 0x7fcc44070360 2023-11-28T11:57:36.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.861+0000 7fcc489ba700 1 --2- 172.21.15.39:0/3324395083 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcc28064f10 0x7fcc280673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:36.867 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.861+0000 7fcc489ba700 1 --2- 172.21.15.39:0/3324395083 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcc28064f10 0x7fcc280673c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcc38014040 tx=0x7fcc38011000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:36.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:36.865+0000 7fcc417fa700 1 -- 172.21.15.39:0/3324395083 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcc3004f2d0 con 0x7fcc44070360 2023-11-28T11:57:37.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.041+0000 7fcc499bc700 1 -- 172.21.15.39:0/3324395083 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcc440d05e0 con 0x7fcc44070360 2023-11-28T11:57:37.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.045+0000 7fcc417fa700 1 -- 172.21.15.39:0/3324395083 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcc30017020 con 0x7fcc44070360 2023-11-28T11:57:37.049 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2023-11-28T11:57:37.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.045+0000 7fcc499bc700 1 -- 172.21.15.39:0/3324395083 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcc28064f10 msgr2=0x7fcc280673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:37.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.045+0000 7fcc499bc700 1 --2- 172.21.15.39:0/3324395083 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcc28064f10 0x7fcc280673c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcc38014040 tx=0x7fcc38011000 comp rx=0 tx=0).stop 2023-11-28T11:57:37.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.045+0000 7fcc499bc700 1 -- 172.21.15.39:0/3324395083 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc44070360 msgr2=0x7fcc4415b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:37.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.045+0000 7fcc499bc700 1 --2- 172.21.15.39:0/3324395083 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc44070360 0x7fcc4415b160 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcc3000c4f0 tx=0x7fcc3000c800 comp rx=0 tx=0).stop 2023-11-28T11:57:37.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.045+0000 7fcc499bc700 1 -- 172.21.15.39:0/3324395083 shutdown_connections 2023-11-28T11:57:37.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.049+0000 7fcc499bc700 1 --2- 172.21.15.39:0/3324395083 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcc28064f10 0x7fcc280673c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:37.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.049+0000 7fcc499bc700 1 --2- 172.21.15.39:0/3324395083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc4415c150 0x7fcc440cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:37.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.049+0000 7fcc499bc700 1 --2- 172.21.15.39:0/3324395083 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc44070360 0x7fcc4415b160 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:37.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.049+0000 7fcc499bc700 1 --2- 172.21.15.39:0/3324395083 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcc4406ff10 0x7fcc441597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:37.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.049+0000 7fcc499bc700 1 -- 172.21.15.39:0/3324395083 >> 172.21.15.39:0/3324395083 conn(0x7fcc440d3680 msgr2=0x7fcc440b6040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:37.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.049+0000 7fcc499bc700 1 -- 172.21.15.39:0/3324395083 shutdown_connections 2023-11-28T11:57:37.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.049+0000 7fcc499bc700 1 -- 172.21.15.39:0/3324395083 wait complete. 2023-11-28T11:57:37.073 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T11:57:37.250 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.245+0000 7f47c97fc700 1 Processor -- start 2023-11-28T11:57:37.250 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.245+0000 7f47c97fc700 1 -- start start 2023-11-28T11:57:37.252 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.249+0000 7f47c97fc700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f47c415c380 0x7f47c406aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:37.253 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.249+0000 7f47c97fc700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f47c40d1af0 0x7f47c40ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:37.253 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.249+0000 7f47c97fc700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47c406b570 con 0x7f47c4069f50 2023-11-28T11:57:37.253 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.249+0000 7f47c97fc700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47c415c750 con 0x7f47c40d1af0 2023-11-28T11:57:37.253 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.249+0000 7f47c97fc700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47c40b5360 con 0x7f47c415c380 2023-11-28T11:57:37.253 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.249+0000 7f47c37fe700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f47c4069f50 0x7f47c40d13e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:51378/0 (socket says 172.21.15.39:51378) 2023-11-28T11:57:37.254 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.249+0000 7f47c37fe700 1 -- 172.21.15.39:0/3184231885 learned_addr learned my addr 172.21.15.39:0/3184231885 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:37.254 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.249+0000 7f47c3fff700 1 --2- 172.21.15.39:0/3184231885 >> v2:172.21.15.184:3300/0 conn(0x7f47c415c380 0x7f47c406aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:37.254 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.249+0000 7f47c8ffb700 1 --2- 172.21.15.39:0/3184231885 >> v2:172.21.15.39:3300/0 conn(0x7f47c40d1af0 0x7f47c40ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:37.254 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.249+0000 7f47c8ffb700 1 -- 172.21.15.39:0/3184231885 >> v2:172.21.15.184:3300/0 conn(0x7f47c415c380 msgr2=0x7f47c406aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:37.255 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.249+0000 7f47c8ffb700 1 --2- 172.21.15.39:0/3184231885 >> v2:172.21.15.184:3300/0 conn(0x7f47c415c380 0x7f47c406aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:37.255 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.249+0000 7f47c2ffd700 1 -- 172.21.15.39:0/3184231885 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1162627415 0 0) 0x7f47c406b570 con 0x7f47c4069f50 2023-11-28T11:57:37.255 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.249+0000 7f47c8ffb700 1 -- 172.21.15.39:0/3184231885 >> v1:172.21.15.39:6789/0 conn(0x7f47c4069f50 legacy=0x7f47c40d13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:37.255 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.249+0000 7f47c8ffb700 1 -- 172.21.15.39:0/3184231885 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c40d0810 con 0x7f47c40d1af0 2023-11-28T11:57:37.255 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.249+0000 7f47c8ffb700 1 --2- 172.21.15.39:0/3184231885 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47c40d1af0 0x7f47c40ce0d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f47bc009d90 tx=0x7f47bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5362aba599f00c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:37.256 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.249+0000 7f47c2ffd700 1 -- 172.21.15.39:0/3184231885 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc00e070 con 0x7f47c40d1af0 2023-11-28T11:57:37.256 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.249+0000 7f47c2ffd700 1 -- 172.21.15.39:0/3184231885 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47bc00bae0 con 0x7f47c40d1af0 2023-11-28T11:57:37.257 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.249+0000 7f47c2ffd700 1 -- 172.21.15.39:0/3184231885 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc00be90 con 0x7f47c40d1af0 2023-11-28T11:57:37.257 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.249+0000 7f47c97fc700 1 -- 172.21.15.39:0/3184231885 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47c40d1af0 msgr2=0x7f47c40ce0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:37.257 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.249+0000 7f47c97fc700 1 --2- 172.21.15.39:0/3184231885 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47c40d1af0 0x7f47c40ce0d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f47bc009d90 tx=0x7f47bc00b330 comp rx=0 tx=0).stop 2023-11-28T11:57:37.257 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.253+0000 7f47c97fc700 1 -- 172.21.15.39:0/3184231885 shutdown_connections 2023-11-28T11:57:37.257 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.253+0000 7f47c97fc700 1 --2- 172.21.15.39:0/3184231885 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47c40d1af0 0x7f47c40ce0d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:37.257 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.253+0000 7f47c97fc700 1 --2- 172.21.15.39:0/3184231885 >> v2:172.21.15.184:3300/0 conn(0x7f47c415c380 0x7f47c406aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:37.257 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.253+0000 7f47c97fc700 1 -- 172.21.15.39:0/3184231885 >> 172.21.15.39:0/3184231885 conn(0x7f47c406cb80 msgr2=0x7f47c40d2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:37.257 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.253+0000 7f47c97fc700 1 -- 172.21.15.39:0/3184231885 shutdown_connections 2023-11-28T11:57:37.257 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.253+0000 7f47c97fc700 1 -- 172.21.15.39:0/3184231885 wait complete. 2023-11-28T11:57:37.258 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.253+0000 7f47c97fc700 1 Processor -- start 2023-11-28T11:57:37.258 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.253+0000 7f47c97fc700 1 -- start start 2023-11-28T11:57:37.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.253+0000 7f47c97fc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47c4069f50 0x7f47c4152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:37.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.253+0000 7f47c97fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47c40d1af0 0x7f47c40702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:37.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.253+0000 7f47c97fc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47c415c380 0x7f47c414f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:37.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.253+0000 7f47c97fc700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c40b6990 con 0x7f47c40d1af0 2023-11-28T11:57:37.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.253+0000 7f47c97fc700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c4154010 con 0x7f47c415c380 2023-11-28T11:57:37.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.253+0000 7f47c97fc700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47c4153770 con 0x7f47c4069f50 2023-11-28T11:57:37.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.257+0000 7f47c37fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47c40d1af0 0x7f47c40702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:37.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.257+0000 7f47c37fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47c40d1af0 0x7f47c40702f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56610/0 (socket says 172.21.15.39:56610) 2023-11-28T11:57:37.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.257+0000 7f47c37fe700 1 -- 172.21.15.39:0/257452669 learned_addr learned my addr 172.21.15.39:0/257452669 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:37.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.257+0000 7f47c3fff700 1 --2- 172.21.15.39:0/257452669 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47c4069f50 0x7f47c4152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:37.263 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.257+0000 7f47c8ffb700 1 --2- 172.21.15.39:0/257452669 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47c415c380 0x7f47c414f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:37.263 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.257+0000 7f47c37fe700 1 -- 172.21.15.39:0/257452669 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47c4069f50 msgr2=0x7f47c4152e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:37.263 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.257+0000 7f47c37fe700 1 --2- 172.21.15.39:0/257452669 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47c4069f50 0x7f47c4152e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:37.263 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.257+0000 7f47c37fe700 1 -- 172.21.15.39:0/257452669 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47c415c380 msgr2=0x7f47c414f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:37.263 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.257+0000 7f47c37fe700 1 --2- 172.21.15.39:0/257452669 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47c415c380 0x7f47c414f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:37.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.257+0000 7f47c37fe700 1 -- 172.21.15.39:0/257452669 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47bc009a70 con 0x7f47c40d1af0 2023-11-28T11:57:37.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.257+0000 7f47c8ffb700 1 --2- 172.21.15.39:0/257452669 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47c415c380 0x7f47c414f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:57:37.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.257+0000 7f47c37fe700 1 --2- 172.21.15.39:0/257452669 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47c40d1af0 0x7f47c40702f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f47b800c750 tx=0x7f47b800ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:37.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.257+0000 7f47c0ff9700 1 -- 172.21.15.39:0/257452669 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b8004ca0 con 0x7f47c40d1af0 2023-11-28T11:57:37.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.257+0000 7f47c0ff9700 1 -- 172.21.15.39:0/257452669 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b8004e00 con 0x7f47c40d1af0 2023-11-28T11:57:37.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.257+0000 7f47c97fc700 1 -- 172.21.15.39:0/257452669 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47c40d0dd0 con 0x7f47c40d1af0 2023-11-28T11:57:37.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.257+0000 7f47c0ff9700 1 -- 172.21.15.39:0/257452669 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b8007310 con 0x7f47c40d1af0 2023-11-28T11:57:37.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.257+0000 7f47c97fc700 1 -- 172.21.15.39:0/257452669 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47c40d0af0 con 0x7f47c40d1af0 2023-11-28T11:57:37.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.257+0000 7f47c97fc700 1 -- 172.21.15.39:0/257452669 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47c40cdb40 con 0x7f47c40d1af0 2023-11-28T11:57:37.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.261+0000 7f47c0ff9700 1 -- 172.21.15.39:0/257452669 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f47b801a020 con 0x7f47c40d1af0 2023-11-28T11:57:37.267 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.261+0000 7f47c0ff9700 1 --2- 172.21.15.39:0/257452669 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f47b0064f10 0x7f47b00673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:37.267 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.261+0000 7f47c0ff9700 1 -- 172.21.15.39:0/257452669 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f47b8081dc0 con 0x7f47c40d1af0 2023-11-28T11:57:37.267 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.261+0000 7f47c3fff700 1 --2- 172.21.15.39:0/257452669 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f47b0064f10 0x7f47b00673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:37.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.265+0000 7f47c3fff700 1 --2- 172.21.15.39:0/257452669 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f47b0064f10 0x7f47b00673c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f47b4009b50 tx=0x7f47b4009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:37.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.269+0000 7f47c0ff9700 1 -- 172.21.15.39:0/257452669 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f47b804fae0 con 0x7f47c40d1af0 2023-11-28T11:57:37.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.437+0000 7f47c97fc700 1 -- 172.21.15.39:0/257452669 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f47c4073d20 con 0x7f47c40d1af0 2023-11-28T11:57:37.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.441+0000 7f47c0ff9700 1 -- 172.21.15.39:0/257452669 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f47b8053100 con 0x7f47c40d1af0 2023-11-28T11:57:37.444 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-11-28T11:57:37.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.445+0000 7f47c97fc700 1 -- 172.21.15.39:0/257452669 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f47b0064f10 msgr2=0x7f47b00673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:37.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.445+0000 7f47c97fc700 1 --2- 172.21.15.39:0/257452669 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f47b0064f10 0x7f47b00673c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f47b4009b50 tx=0x7f47b4009240 comp rx=0 tx=0).stop 2023-11-28T11:57:37.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.445+0000 7f47c97fc700 1 -- 172.21.15.39:0/257452669 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47c40d1af0 msgr2=0x7f47c40702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:37.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.445+0000 7f47c97fc700 1 --2- 172.21.15.39:0/257452669 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47c40d1af0 0x7f47c40702f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f47b800c750 tx=0x7f47b800ca60 comp rx=0 tx=0).stop 2023-11-28T11:57:37.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.445+0000 7f47c97fc700 1 -- 172.21.15.39:0/257452669 shutdown_connections 2023-11-28T11:57:37.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.445+0000 7f47c97fc700 1 --2- 172.21.15.39:0/257452669 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f47b0064f10 0x7f47b00673c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:37.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.445+0000 7f47c97fc700 1 --2- 172.21.15.39:0/257452669 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47c415c380 0x7f47c414f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:37.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.445+0000 7f47c97fc700 1 --2- 172.21.15.39:0/257452669 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47c40d1af0 0x7f47c40702f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:37.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.445+0000 7f47c97fc700 1 --2- 172.21.15.39:0/257452669 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47c4069f50 0x7f47c4152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:37.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.445+0000 7f47c97fc700 1 -- 172.21.15.39:0/257452669 >> 172.21.15.39:0/257452669 conn(0x7f47c406cb80 msgr2=0x7f47c40710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:37.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.445+0000 7f47c97fc700 1 -- 172.21.15.39:0/257452669 shutdown_connections 2023-11-28T11:57:37.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.445+0000 7f47c97fc700 1 -- 172.21.15.39:0/257452669 wait complete. 2023-11-28T11:57:37.474 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T11:57:37.652 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.645+0000 7faba11a8700 1 Processor -- start 2023-11-28T11:57:37.652 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.649+0000 7faba11a8700 1 -- start start 2023-11-28T11:57:37.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.649+0000 7faba11a8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab9c0cdeb0 0x7fab9c070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:37.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.649+0000 7faba11a8700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fab9c0705c0 0x7fab9c06a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:37.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.649+0000 7faba11a8700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab9c0adf90 con 0x7fab9c15c1a0 2023-11-28T11:57:37.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.649+0000 7faba11a8700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab9c069bf0 con 0x7fab9c0705c0 2023-11-28T11:57:37.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.649+0000 7faba11a8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab9c070a40 con 0x7fab9c0cdeb0 2023-11-28T11:57:37.655 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.649+0000 7faba09a7700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fab9c0705c0 0x7fab9c06a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:37.655 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.649+0000 7fab9bfff700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fab9c15c1a0 0x7fab9c06c8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:51390/0 (socket says 172.21.15.39:51390) 2023-11-28T11:57:37.655 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.649+0000 7fab9b7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab9c0cdeb0 0x7fab9c070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:37.655 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.649+0000 7fab9bfff700 1 -- 172.21.15.39:0/68888240 learned_addr learned my addr 172.21.15.39:0/68888240 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:37.656 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.649+0000 7faba09a7700 1 -- 172.21.15.39:0/68888240 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab9c0cdeb0 msgr2=0x7fab9c070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:37.656 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.649+0000 7faba09a7700 1 --2- 172.21.15.39:0/68888240 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab9c0cdeb0 0x7fab9c070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:37.656 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.649+0000 7faba09a7700 1 -- 172.21.15.39:0/68888240 >> v1:172.21.15.39:6789/0 conn(0x7fab9c15c1a0 legacy=0x7fab9c06c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:37.656 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.649+0000 7faba09a7700 1 -- 172.21.15.39:0/68888240 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab9c0ce370 con 0x7fab9c0705c0 2023-11-28T11:57:37.657 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.653+0000 7faba09a7700 1 --2- 172.21.15.39:0/68888240 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab9c0705c0 0x7fab9c06a010 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fab94009d90 tx=0x7fab9400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62efbeb447e4e9c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:37.657 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.653+0000 7fab9affd700 1 -- 172.21.15.39:0/68888240 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9400e070 con 0x7fab9c0705c0 2023-11-28T11:57:37.657 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.653+0000 7fab9affd700 1 -- 172.21.15.39:0/68888240 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9400bb20 con 0x7fab9c0705c0 2023-11-28T11:57:37.657 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.653+0000 7fab9affd700 1 -- 172.21.15.39:0/68888240 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab94012430 con 0x7fab9c0705c0 2023-11-28T11:57:37.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.653+0000 7faba11a8700 1 -- 172.21.15.39:0/68888240 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab9c0705c0 msgr2=0x7fab9c06a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:37.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.653+0000 7faba11a8700 1 --2- 172.21.15.39:0/68888240 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab9c0705c0 0x7fab9c06a010 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fab94009d90 tx=0x7fab9400b330 comp rx=0 tx=0).stop 2023-11-28T11:57:37.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.653+0000 7faba11a8700 1 -- 172.21.15.39:0/68888240 shutdown_connections 2023-11-28T11:57:37.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.653+0000 7faba11a8700 1 --2- 172.21.15.39:0/68888240 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab9c0705c0 0x7fab9c06a010 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:37.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.653+0000 7faba11a8700 1 --2- 172.21.15.39:0/68888240 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab9c0cdeb0 0x7fab9c070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:37.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.653+0000 7faba11a8700 1 -- 172.21.15.39:0/68888240 >> 172.21.15.39:0/68888240 conn(0x7fab9c0b0f80 msgr2=0x7fab9c0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:37.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.653+0000 7faba11a8700 1 -- 172.21.15.39:0/68888240 shutdown_connections 2023-11-28T11:57:37.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.653+0000 7faba11a8700 1 -- 172.21.15.39:0/68888240 wait complete. 2023-11-28T11:57:37.661 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.657+0000 7faba11a8700 1 Processor -- start 2023-11-28T11:57:37.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.657+0000 7faba11a8700 1 -- start start 2023-11-28T11:57:37.664 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.657+0000 7faba11a8700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab9c0705c0 0x7fab9c0c26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:37.664 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.657+0000 7faba11a8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab9c0cdeb0 0x7fab9c0c3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:37.664 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.657+0000 7faba11a8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab9c15c1a0 0x7fab9c0c3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:37.664 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.657+0000 7faba11a8700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9c0c2c10 con 0x7fab9c0705c0 2023-11-28T11:57:37.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.657+0000 7faba11a8700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9c15e370 con 0x7fab9c0cdeb0 2023-11-28T11:57:37.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.657+0000 7faba11a8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab9c15e650 con 0x7fab9c15c1a0 2023-11-28T11:57:37.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.661+0000 7fab9bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab9c0705c0 0x7fab9c0c26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:37.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.661+0000 7fab9bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab9c0705c0 0x7fab9c0c26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56638/0 (socket says 172.21.15.39:56638) 2023-11-28T11:57:37.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.661+0000 7fab9bfff700 1 -- 172.21.15.39:0/4204299656 learned_addr learned my addr 172.21.15.39:0/4204299656 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:37.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.661+0000 7fab9b7fe700 1 --2- 172.21.15.39:0/4204299656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab9c0cdeb0 0x7fab9c0c3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:37.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.661+0000 7faba09a7700 1 --2- 172.21.15.39:0/4204299656 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab9c15c1a0 0x7fab9c0c3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:37.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.661+0000 7fab9bfff700 1 -- 172.21.15.39:0/4204299656 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab9c15c1a0 msgr2=0x7fab9c0c3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:37.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.661+0000 7fab9bfff700 1 --2- 172.21.15.39:0/4204299656 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab9c15c1a0 0x7fab9c0c3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:37.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.661+0000 7fab9bfff700 1 -- 172.21.15.39:0/4204299656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab9c0cdeb0 msgr2=0x7fab9c0c3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:37.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.661+0000 7fab9bfff700 1 --2- 172.21.15.39:0/4204299656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab9c0cdeb0 0x7fab9c0c3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:37.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.661+0000 7fab9bfff700 1 -- 172.21.15.39:0/4204299656 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab94009a70 con 0x7fab9c0705c0 2023-11-28T11:57:37.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.661+0000 7fab9bfff700 1 --2- 172.21.15.39:0/4204299656 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab9c0705c0 0x7fab9c0c26d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fab8c00c700 tx=0x7fab8c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:37.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.661+0000 7fab98ff9700 1 -- 172.21.15.39:0/4204299656 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8c005d90 con 0x7fab9c0705c0 2023-11-28T11:57:37.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.661+0000 7fab98ff9700 1 -- 172.21.15.39:0/4204299656 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8c0070d0 con 0x7fab9c0705c0 2023-11-28T11:57:37.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.661+0000 7faba11a8700 1 -- 172.21.15.39:0/4204299656 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab9c0cc780 con 0x7fab9c0705c0 2023-11-28T11:57:37.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.661+0000 7fab98ff9700 1 -- 172.21.15.39:0/4204299656 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8c007440 con 0x7fab9c0705c0 2023-11-28T11:57:37.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.661+0000 7faba11a8700 1 -- 172.21.15.39:0/4204299656 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab9c0cc4a0 con 0x7fab9c0705c0 2023-11-28T11:57:37.668 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.665+0000 7faba11a8700 1 -- 172.21.15.39:0/4204299656 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab9c15c570 con 0x7fab9c0705c0 2023-11-28T11:57:37.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.665+0000 7fab98ff9700 1 -- 172.21.15.39:0/4204299656 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fab8c019030 con 0x7fab9c0705c0 2023-11-28T11:57:37.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.669+0000 7fab98ff9700 1 --2- 172.21.15.39:0/4204299656 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fab88064ee0 0x7fab88067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:37.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.669+0000 7fab98ff9700 1 -- 172.21.15.39:0/4204299656 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fab8c081420 con 0x7fab9c0705c0 2023-11-28T11:57:37.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.669+0000 7fab9b7fe700 1 --2- 172.21.15.39:0/4204299656 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fab88064ee0 0x7fab88067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:37.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.669+0000 7fab9b7fe700 1 --2- 172.21.15.39:0/4204299656 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fab88064ee0 0x7fab88067390 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fab9c0adc90 tx=0x7fab90009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:37.680 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.677+0000 7fab98ff9700 1 -- 172.21.15.39:0/4204299656 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fab8c04a400 con 0x7fab9c0705c0 2023-11-28T11:57:37.865 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.860+0000 7faba11a8700 1 -- 172.21.15.39:0/4204299656 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fab9c073cb0 con 0x7fab9c0705c0 2023-11-28T11:57:37.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.860+0000 7fab98ff9700 1 -- 172.21.15.39:0/4204299656 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7fab8c04f1d0 con 0x7fab9c0705c0 2023-11-28T11:57:37.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.864+0000 7faba11a8700 1 -- 172.21.15.39:0/4204299656 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fab88064ee0 msgr2=0x7fab88067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:37.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.864+0000 7faba11a8700 1 --2- 172.21.15.39:0/4204299656 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fab88064ee0 0x7fab88067390 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fab9c0adc90 tx=0x7fab90009240 comp rx=0 tx=0).stop 2023-11-28T11:57:37.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.864+0000 7faba11a8700 1 -- 172.21.15.39:0/4204299656 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab9c0705c0 msgr2=0x7fab9c0c26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:37.870 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.864+0000 7faba11a8700 1 --2- 172.21.15.39:0/4204299656 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab9c0705c0 0x7fab9c0c26d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fab8c00c700 tx=0x7fab8c00ca10 comp rx=0 tx=0).stop 2023-11-28T11:57:37.870 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.864+0000 7faba11a8700 1 -- 172.21.15.39:0/4204299656 shutdown_connections 2023-11-28T11:57:37.870 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.864+0000 7faba11a8700 1 --2- 172.21.15.39:0/4204299656 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab9c15c1a0 0x7fab9c0c3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:37.870 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.864+0000 7faba11a8700 1 --2- 172.21.15.39:0/4204299656 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fab88064ee0 0x7fab88067390 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:37.870 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.864+0000 7faba11a8700 1 --2- 172.21.15.39:0/4204299656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab9c0cdeb0 0x7fab9c0c3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:37.870 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.864+0000 7faba11a8700 1 --2- 172.21.15.39:0/4204299656 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab9c0705c0 0x7fab9c0c26d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:37.870 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.864+0000 7faba11a8700 1 -- 172.21.15.39:0/4204299656 >> 172.21.15.39:0/4204299656 conn(0x7fab9c0b0f80 msgr2=0x7fab9c156770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:37.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.864+0000 7faba11a8700 1 -- 172.21.15.39:0/4204299656 shutdown_connections 2023-11-28T11:57:37.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:37.864+0000 7faba11a8700 1 -- 172.21.15.39:0/4204299656 wait complete. 2023-11-28T11:57:37.873 INFO:teuthology.orchestra.run.smithi039.stderr:listed 0 entries 2023-11-28T11:57:37.892 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-28T11:57:37.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:37.892 DEBUG:teuthology.orchestra.run.smithi184:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-11-28T11:57:37.944 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-11-28T11:57:37.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:37.945 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T11:57:37.966 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:57:37.966 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:57:37.986 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:57:37.986 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:57:38.046 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:57:38.047 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:57:38.108 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:57:38.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.324+0000 7f0b358e7700 1 Processor -- start 2023-11-28T11:57:38.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.324+0000 7f0b358e7700 1 -- start start 2023-11-28T11:57:38.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.328+0000 7f0b358e7700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f0b3015c640 0x7f0b300d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:38.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.328+0000 7f0b358e7700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0b30071aa0 0x7f0b3006d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:38.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.328+0000 7f0b358e7700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b3006c600 con 0x7f0b30069e00 2023-11-28T11:57:38.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.328+0000 7f0b358e7700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b3006cef0 con 0x7f0b3015c640 2023-11-28T11:57:38.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.328+0000 7f0b358e7700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b300722f0 con 0x7f0b30071aa0 2023-11-28T11:57:38.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.328+0000 7f0b2f7fe700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f0b30069e00 0x7f0b300d0580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:55526/0 (socket says 172.21.15.39:55526) 2023-11-28T11:57:38.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.328+0000 7f0b2f7fe700 1 -- 172.21.15.39:0/3134378265 learned_addr learned my addr 172.21.15.39:0/3134378265 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:38.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.328+0000 7f0b2effd700 1 --2- 172.21.15.39:0/3134378265 >> v2:172.21.15.184:3300/0 conn(0x7f0b3015c640 0x7f0b300d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:38.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.328+0000 7f0b267fc700 1 --2- 172.21.15.39:0/3134378265 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0b30071aa0 0x7f0b3006d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:38.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.328+0000 7f0b2e7fc700 1 -- 172.21.15.39:0/3134378265 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3156665849 0 0) 0x7f0b3006c600 con 0x7f0b30069e00 2023-11-28T11:57:38.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.328+0000 7f0b2e7fc700 1 -- 172.21.15.39:0/3134378265 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b1c0035d0 con 0x7f0b30069e00 2023-11-28T11:57:38.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.332+0000 7f0b2e7fc700 1 -- 172.21.15.39:0/3134378265 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1063037487 0 0) 0x7f0b1c0035d0 con 0x7f0b30069e00 2023-11-28T11:57:38.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.332+0000 7f0b2effd700 1 -- 172.21.15.39:0/3134378265 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0b30071aa0 msgr2=0x7f0b3006d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:38.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.332+0000 7f0b2effd700 1 --2- 172.21.15.39:0/3134378265 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0b30071aa0 0x7f0b3006d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:38.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.332+0000 7f0b2effd700 1 -- 172.21.15.39:0/3134378265 >> v1:172.21.15.39:6789/0 conn(0x7f0b30069e00 legacy=0x7f0b300d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:38.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.332+0000 7f0b2effd700 1 -- 172.21.15.39:0/3134378265 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b3015ca10 con 0x7f0b3015c640 2023-11-28T11:57:38.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.332+0000 7f0b267fc700 1 --2- 172.21.15.39:0/3134378265 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0b30071aa0 0x7f0b3006d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:38.338 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.332+0000 7f0b2effd700 1 --2- 172.21.15.39:0/3134378265 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b3015c640 0x7f0b300d31e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0b20009850 tx=0x7f0b20009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba043d3df09339eb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:38.338 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.332+0000 7f0b2e7fc700 1 -- 172.21.15.39:0/3134378265 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b280019f0 con 0x7f0b3015c640 2023-11-28T11:57:38.338 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.332+0000 7f0b2e7fc700 1 -- 172.21.15.39:0/3134378265 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b20004030 con 0x7f0b3015c640 2023-11-28T11:57:38.338 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.332+0000 7f0b2e7fc700 1 -- 172.21.15.39:0/3134378265 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b200043e0 con 0x7f0b3015c640 2023-11-28T11:57:38.340 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.332+0000 7f0b358e7700 1 -- 172.21.15.39:0/3134378265 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b3015c640 msgr2=0x7f0b300d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:38.340 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.332+0000 7f0b358e7700 1 --2- 172.21.15.39:0/3134378265 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b3015c640 0x7f0b300d31e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0b20009850 tx=0x7f0b20009b60 comp rx=0 tx=0).stop 2023-11-28T11:57:38.340 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.332+0000 7f0b358e7700 1 -- 172.21.15.39:0/3134378265 shutdown_connections 2023-11-28T11:57:38.340 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.332+0000 7f0b358e7700 1 --2- 172.21.15.39:0/3134378265 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0b30071aa0 0x7f0b3006d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:38.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.332+0000 7f0b358e7700 1 --2- 172.21.15.39:0/3134378265 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b3015c640 0x7f0b300d31e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:38.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.332+0000 7f0b358e7700 1 -- 172.21.15.39:0/3134378265 >> 172.21.15.39:0/3134378265 conn(0x7f0b300b6520 msgr2=0x7f0b30071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:38.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.332+0000 7f0b358e7700 1 -- 172.21.15.39:0/3134378265 shutdown_connections 2023-11-28T11:57:38.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.332+0000 7f0b358e7700 1 -- 172.21.15.39:0/3134378265 wait complete. 2023-11-28T11:57:38.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.336+0000 7f0b358e7700 1 Processor -- start 2023-11-28T11:57:38.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.336+0000 7f0b358e7700 1 -- start start 2023-11-28T11:57:38.346 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.340+0000 7f0b358e7700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0b30069e00 0x7f0b300cee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:38.346 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.340+0000 7f0b358e7700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0b30071aa0 0x7f0b300c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:38.346 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.340+0000 7f0b358e7700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b3015c640 0x7f0b3006d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:38.346 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.340+0000 7f0b358e7700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b300c7940 con 0x7f0b30071aa0 2023-11-28T11:57:38.346 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.340+0000 7f0b358e7700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b300c6a20 con 0x7f0b3015c640 2023-11-28T11:57:38.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.340+0000 7f0b358e7700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b300c6cc0 con 0x7f0b30069e00 2023-11-28T11:57:38.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.340+0000 7f0b267fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0b30071aa0 0x7f0b300c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:38.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.340+0000 7f0b267fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0b30071aa0 0x7f0b300c64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53646/0 (socket says 172.21.15.39:53646) 2023-11-28T11:57:38.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.340+0000 7f0b267fc700 1 -- 172.21.15.39:0/1635505639 learned_addr learned my addr 172.21.15.39:0/1635505639 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:38.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.340+0000 7f0b2effd700 1 --2- 172.21.15.39:0/1635505639 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0b30069e00 0x7f0b300cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:38.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.340+0000 7f0b2f7fe700 1 --2- 172.21.15.39:0/1635505639 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b3015c640 0x7f0b3006d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:38.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.340+0000 7f0b267fc700 1 -- 172.21.15.39:0/1635505639 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0b30069e00 msgr2=0x7f0b300cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:38.350 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.340+0000 7f0b267fc700 1 --2- 172.21.15.39:0/1635505639 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0b30069e00 0x7f0b300cee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:38.350 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.340+0000 7f0b267fc700 1 -- 172.21.15.39:0/1635505639 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b3015c640 msgr2=0x7f0b3006d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:38.350 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.340+0000 7f0b267fc700 1 --2- 172.21.15.39:0/1635505639 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b3015c640 0x7f0b3006d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:38.350 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.340+0000 7f0b267fc700 1 -- 172.21.15.39:0/1635505639 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b180094b0 con 0x7f0b30071aa0 2023-11-28T11:57:38.350 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.340+0000 7f0b267fc700 1 --2- 172.21.15.39:0/1635505639 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0b30071aa0 0x7f0b300c64e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0b1800ebe0 tx=0x7f0b1800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:38.350 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.340+0000 7f0b2cff9700 1 -- 172.21.15.39:0/1635505639 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b18009770 con 0x7f0b30071aa0 2023-11-28T11:57:38.350 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.340+0000 7f0b2cff9700 1 -- 172.21.15.39:0/1635505639 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b1800c850 con 0x7f0b30071aa0 2023-11-28T11:57:38.351 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.340+0000 7f0b2cff9700 1 -- 172.21.15.39:0/1635505639 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1800cbe0 con 0x7f0b30071aa0 2023-11-28T11:57:38.351 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.340+0000 7f0b358e7700 1 -- 172.21.15.39:0/1635505639 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b200094b0 con 0x7f0b30071aa0 2023-11-28T11:57:38.351 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.340+0000 7f0b358e7700 1 -- 172.21.15.39:0/1635505639 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b3006c830 con 0x7f0b30071aa0 2023-11-28T11:57:38.351 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.344+0000 7f0b358e7700 1 -- 172.21.15.39:0/1635505639 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b30072010 con 0x7f0b30071aa0 2023-11-28T11:57:38.352 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.344+0000 7f0b2cff9700 1 -- 172.21.15.39:0/1635505639 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0b18019030 con 0x7f0b30071aa0 2023-11-28T11:57:38.353 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.348+0000 7f0b2cff9700 1 --2- 172.21.15.39:0/1635505639 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0b10064f60 0x7f0b10067410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:38.353 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.348+0000 7f0b2cff9700 1 -- 172.21.15.39:0/1635505639 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0b18082110 con 0x7f0b30071aa0 2023-11-28T11:57:38.354 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.348+0000 7f0b2effd700 1 --2- 172.21.15.39:0/1635505639 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0b10064f60 0x7f0b10067410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:38.355 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.348+0000 7f0b2effd700 1 --2- 172.21.15.39:0/1635505639 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0b10064f60 0x7f0b10067410 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0b200097a0 tx=0x7f0b20008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:38.357 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.352+0000 7f0b2cff9700 1 -- 172.21.15.39:0/1635505639 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0b1804feb0 con 0x7f0b30071aa0 2023-11-28T11:57:38.532 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.524+0000 7f0b358e7700 1 -- 172.21.15.39:0/1635505639 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b3006cb10 con 0x7f0b30071aa0 2023-11-28T11:57:38.534 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.528+0000 7f0b2cff9700 1 -- 172.21.15.39:0/1635505639 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+19748 (secure 0 0 0) 0x7f0b180534d0 con 0x7f0b30071aa0 2023-11-28T11:57:38.535 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:57:38.535 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":31,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:57:21.927556+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:56:38.203736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:56:38.946498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:56:41.988334+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.10","mappings":[{"from":1,"to":5}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:57:38.538 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.532+0000 7f0b358e7700 1 -- 172.21.15.39:0/1635505639 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0b10064f60 msgr2=0x7f0b10067410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:38.538 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.532+0000 7f0b358e7700 1 --2- 172.21.15.39:0/1635505639 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0b10064f60 0x7f0b10067410 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0b200097a0 tx=0x7f0b20008030 comp rx=0 tx=0).stop 2023-11-28T11:57:38.538 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.532+0000 7f0b358e7700 1 -- 172.21.15.39:0/1635505639 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0b30071aa0 msgr2=0x7f0b300c64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:38.538 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.532+0000 7f0b358e7700 1 --2- 172.21.15.39:0/1635505639 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0b30071aa0 0x7f0b300c64e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0b1800ebe0 tx=0x7f0b1800eef0 comp rx=0 tx=0).stop 2023-11-28T11:57:38.538 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.532+0000 7f0b358e7700 1 -- 172.21.15.39:0/1635505639 shutdown_connections 2023-11-28T11:57:38.538 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.532+0000 7f0b358e7700 1 --2- 172.21.15.39:0/1635505639 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0b10064f60 0x7f0b10067410 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:38.539 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.532+0000 7f0b358e7700 1 --2- 172.21.15.39:0/1635505639 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b3015c640 0x7f0b3006d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:38.539 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.532+0000 7f0b358e7700 1 --2- 172.21.15.39:0/1635505639 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0b30071aa0 0x7f0b300c64e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:38.539 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.532+0000 7f0b358e7700 1 --2- 172.21.15.39:0/1635505639 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0b30069e00 0x7f0b300cee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:38.539 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.532+0000 7f0b358e7700 1 -- 172.21.15.39:0/1635505639 >> 172.21.15.39:0/1635505639 conn(0x7f0b300b6520 msgr2=0x7f0b300b0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:38.539 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.532+0000 7f0b358e7700 1 -- 172.21.15.39:0/1635505639 shutdown_connections 2023-11-28T11:57:38.539 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.532+0000 7f0b358e7700 1 -- 172.21.15.39:0/1635505639 wait complete. 2023-11-28T11:57:38.562 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:56:26.631457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:56:33.242202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:56:38.203736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:56:38.946498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T11:56:41.988334+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T11:57:38.563 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:57:38.752 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.744+0000 7f81ef276700 1 Processor -- start 2023-11-28T11:57:38.752 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.748+0000 7f81ef276700 1 -- start start 2023-11-28T11:57:38.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.748+0000 7f81ef276700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f81e815c150 0x7f81e80b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:38.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.752+0000 7f81ef276700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f81e806ff10 0x7f81e8070360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:38.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.752+0000 7f81ef276700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81e815c520 con 0x7f81e815fc30 2023-11-28T11:57:38.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.752+0000 7f81ef276700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81e80b4240 con 0x7f81e806ff10 2023-11-28T11:57:38.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.752+0000 7f81ef276700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81e80708a0 con 0x7f81e815c150 2023-11-28T11:57:38.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.752+0000 7f81eea75700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f81e815fc30 0x7f81e8160050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:55540/0 (socket says 172.21.15.39:55540) 2023-11-28T11:57:38.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.752+0000 7f81eea75700 1 -- 172.21.15.39:0/3584098263 learned_addr learned my addr 172.21.15.39:0/3584098263 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:38.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.752+0000 7f81ee274700 1 --2- 172.21.15.39:0/3584098263 >> v2:172.21.15.184:3300/0 conn(0x7f81e815c150 0x7f81e80b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:38.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.752+0000 7f81eda73700 1 --2- 172.21.15.39:0/3584098263 >> v2:172.21.15.39:3300/0 conn(0x7f81e806ff10 0x7f81e8070360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:38.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.752+0000 7f81ed272700 1 -- 172.21.15.39:0/3584098263 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4245272741 0 0) 0x7f81e815c520 con 0x7f81e815fc30 2023-11-28T11:57:38.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.752+0000 7f81ed272700 1 -- 172.21.15.39:0/3584098263 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81d40035d0 con 0x7f81e815fc30 2023-11-28T11:57:38.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.752+0000 7f81ed272700 1 -- 172.21.15.39:0/3584098263 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 993442325 0 0) 0x7f81d40035d0 con 0x7f81e815fc30 2023-11-28T11:57:38.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.752+0000 7f81eda73700 1 -- 172.21.15.39:0/3584098263 >> v2:172.21.15.184:3300/0 conn(0x7f81e815c150 msgr2=0x7f81e80b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:38.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.752+0000 7f81eda73700 1 --2- 172.21.15.39:0/3584098263 >> v2:172.21.15.184:3300/0 conn(0x7f81e815c150 0x7f81e80b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:38.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.752+0000 7f81eda73700 1 -- 172.21.15.39:0/3584098263 >> v1:172.21.15.39:6789/0 conn(0x7f81e815fc30 legacy=0x7f81e8160050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:38.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.752+0000 7f81eda73700 1 -- 172.21.15.39:0/3584098263 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e806ac00 con 0x7f81e806ff10 2023-11-28T11:57:38.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.752+0000 7f81ee274700 1 --2- 172.21.15.39:0/3584098263 >> v2:172.21.15.184:3300/0 conn(0x7f81e815c150 0x7f81e80b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:38.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.752+0000 7f81eda73700 1 --2- 172.21.15.39:0/3584098263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81e806ff10 0x7f81e8070360 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f81e8071900 tx=0x7f81d8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4673ca4e1dffb369 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:38.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.752+0000 7f81ed272700 1 -- 172.21.15.39:0/3584098263 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e00019f0 con 0x7f81e806ff10 2023-11-28T11:57:38.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.752+0000 7f81ed272700 1 -- 172.21.15.39:0/3584098263 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d8004030 con 0x7f81e806ff10 2023-11-28T11:57:38.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.752+0000 7f81ed272700 1 -- 172.21.15.39:0/3584098263 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d80043a0 con 0x7f81e806ff10 2023-11-28T11:57:38.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.756+0000 7f81ef276700 1 -- 172.21.15.39:0/3584098263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81e806ff10 msgr2=0x7f81e8070360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:38.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.756+0000 7f81ef276700 1 --2- 172.21.15.39:0/3584098263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81e806ff10 0x7f81e8070360 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f81e8071900 tx=0x7f81d8009b20 comp rx=0 tx=0).stop 2023-11-28T11:57:38.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.756+0000 7f81ef276700 1 -- 172.21.15.39:0/3584098263 shutdown_connections 2023-11-28T11:57:38.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.756+0000 7f81ef276700 1 --2- 172.21.15.39:0/3584098263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81e806ff10 0x7f81e8070360 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:38.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.756+0000 7f81ef276700 1 --2- 172.21.15.39:0/3584098263 >> v2:172.21.15.184:3300/0 conn(0x7f81e815c150 0x7f81e80b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:38.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.756+0000 7f81ef276700 1 -- 172.21.15.39:0/3584098263 >> 172.21.15.39:0/3584098263 conn(0x7f81e80d3680 msgr2=0x7f81e80cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:38.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.756+0000 7f81ef276700 1 -- 172.21.15.39:0/3584098263 shutdown_connections 2023-11-28T11:57:38.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.756+0000 7f81ef276700 1 -- 172.21.15.39:0/3584098263 wait complete. 2023-11-28T11:57:38.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.760+0000 7f81ef276700 1 Processor -- start 2023-11-28T11:57:38.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.760+0000 7f81ef276700 1 -- start start 2023-11-28T11:57:38.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.760+0000 7f81ef276700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f81e806ff10 0x7f81e815abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:38.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.760+0000 7f81ef276700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81e815c150 0x7f81e815edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:38.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.760+0000 7f81ef276700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81e815fc30 0x7f81e8154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:38.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.760+0000 7f81ef276700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e815e400 con 0x7f81e815c150 2023-11-28T11:57:38.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.760+0000 7f81ef276700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e815f330 con 0x7f81e815fc30 2023-11-28T11:57:38.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.760+0000 7f81ef276700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e815e960 con 0x7f81e806ff10 2023-11-28T11:57:38.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.760+0000 7f81eda73700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81e815c150 0x7f81e815edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:38.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.760+0000 7f81eda73700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81e815c150 0x7f81e815edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53658/0 (socket says 172.21.15.39:53658) 2023-11-28T11:57:38.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.760+0000 7f81eda73700 1 -- 172.21.15.39:0/1033187440 learned_addr learned my addr 172.21.15.39:0/1033187440 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:38.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.760+0000 7f81ee274700 1 --2- 172.21.15.39:0/1033187440 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f81e806ff10 0x7f81e815abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:38.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.760+0000 7f81eda73700 1 -- 172.21.15.39:0/1033187440 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f81e806ff10 msgr2=0x7f81e815abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:38.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.760+0000 7f81eda73700 1 --2- 172.21.15.39:0/1033187440 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f81e806ff10 0x7f81e815abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:38.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.760+0000 7f81eda73700 1 -- 172.21.15.39:0/1033187440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81e815fc30 msgr2=0x7f81e8154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:38.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.760+0000 7f81eda73700 1 --2- 172.21.15.39:0/1033187440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81e815fc30 0x7f81e8154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:38.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.760+0000 7f81eda73700 1 -- 172.21.15.39:0/1033187440 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e40094b0 con 0x7f81e815c150 2023-11-28T11:57:38.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.760+0000 7f81ee274700 1 --2- 172.21.15.39:0/1033187440 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f81e806ff10 0x7f81e815abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:57:38.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.760+0000 7f81eda73700 1 --2- 172.21.15.39:0/1033187440 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81e815c150 0x7f81e815edf0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f81d8009e70 tx=0x7f81d8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:38.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.764+0000 7f81deffd700 1 -- 172.21.15.39:0/1033187440 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d8006e80 con 0x7f81e815c150 2023-11-28T11:57:38.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.764+0000 7f81ef276700 1 -- 172.21.15.39:0/1033187440 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d8009450 con 0x7f81e815c150 2023-11-28T11:57:38.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.764+0000 7f81ef276700 1 -- 172.21.15.39:0/1033187440 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e80d2450 con 0x7f81e815c150 2023-11-28T11:57:38.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.764+0000 7f81deffd700 1 -- 172.21.15.39:0/1033187440 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d8004590 con 0x7f81e815c150 2023-11-28T11:57:38.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.764+0000 7f81deffd700 1 -- 172.21.15.39:0/1033187440 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d80109c0 con 0x7f81e815c150 2023-11-28T11:57:38.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.764+0000 7f81ef276700 1 -- 172.21.15.39:0/1033187440 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e806cc50 con 0x7f81e815c150 2023-11-28T11:57:38.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.764+0000 7f81deffd700 1 -- 172.21.15.39:0/1033187440 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f81d800f070 con 0x7f81e815c150 2023-11-28T11:57:38.772 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.768+0000 7f81deffd700 1 --2- 172.21.15.39:0/1033187440 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f81cc064f10 0x7f81cc0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:38.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.768+0000 7f81deffd700 1 -- 172.21.15.39:0/1033187440 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f81d8083610 con 0x7f81e815c150 2023-11-28T11:57:38.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.768+0000 7f81ee274700 1 --2- 172.21.15.39:0/1033187440 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f81cc064f10 0x7f81cc0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:38.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.768+0000 7f81ee274700 1 --2- 172.21.15.39:0/1033187440 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f81cc064f10 0x7f81cc0673c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f81e815fb70 tx=0x7f81e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:38.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.772+0000 7f81deffd700 1 -- 172.21.15.39:0/1033187440 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f81d8051480 con 0x7f81e815c150 2023-11-28T11:57:38.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.948+0000 7f81ef276700 1 -- 172.21.15.39:0/1033187440 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f81e80d2730 con 0x7f81e815c150 2023-11-28T11:57:38.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.948+0000 7f81deffd700 1 -- 172.21.15.39:0/1033187440 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f81d802a020 con 0x7f81e815c150 2023-11-28T11:57:38.954 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-11-28T11:57:38.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.952+0000 7f81ef276700 1 -- 172.21.15.39:0/1033187440 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f81cc064f10 msgr2=0x7f81cc0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:38.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.952+0000 7f81ef276700 1 --2- 172.21.15.39:0/1033187440 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f81cc064f10 0x7f81cc0673c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f81e815fb70 tx=0x7f81e4008040 comp rx=0 tx=0).stop 2023-11-28T11:57:38.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.952+0000 7f81ef276700 1 -- 172.21.15.39:0/1033187440 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81e815c150 msgr2=0x7f81e815edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:38.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.952+0000 7f81ef276700 1 --2- 172.21.15.39:0/1033187440 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81e815c150 0x7f81e815edf0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f81d8009e70 tx=0x7f81d8004770 comp rx=0 tx=0).stop 2023-11-28T11:57:38.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.952+0000 7f81ef276700 1 -- 172.21.15.39:0/1033187440 shutdown_connections 2023-11-28T11:57:38.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.952+0000 7f81ef276700 1 --2- 172.21.15.39:0/1033187440 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f81cc064f10 0x7f81cc0673c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:38.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.952+0000 7f81ef276700 1 --2- 172.21.15.39:0/1033187440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81e815fc30 0x7f81e8154380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:38.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.952+0000 7f81ef276700 1 --2- 172.21.15.39:0/1033187440 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81e815c150 0x7f81e815edf0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:38.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.952+0000 7f81ef276700 1 --2- 172.21.15.39:0/1033187440 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f81e806ff10 0x7f81e815abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:38.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.952+0000 7f81ef276700 1 -- 172.21.15.39:0/1033187440 >> 172.21.15.39:0/1033187440 conn(0x7f81e80d3680 msgr2=0x7f81e8158520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:38.960 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.952+0000 7f81ef276700 1 -- 172.21.15.39:0/1033187440 shutdown_connections 2023-11-28T11:57:38.960 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:38.952+0000 7f81ef276700 1 -- 172.21.15.39:0/1033187440 wait complete. 2023-11-28T11:57:38.982 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:57:39.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.156+0000 7f7bdb59e700 1 Processor -- start 2023-11-28T11:57:39.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.156+0000 7f7bdb59e700 1 -- start start 2023-11-28T11:57:39.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.160+0000 7f7bdb59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7bdc0c9560 0x7f7bdc06b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:39.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.160+0000 7f7bdb59e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7bdc06cb00 0x7f7bdc069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:39.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.160+0000 7f7bdb59e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bdc15b140 con 0x7f7bdc0b4990 2023-11-28T11:57:39.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.160+0000 7f7bdb59e700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bdc15b420 con 0x7f7bdc06cb00 2023-11-28T11:57:39.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.160+0000 7f7bdb59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc0714e0 con 0x7f7bdc0c9560 2023-11-28T11:57:39.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.160+0000 7f7bdad9d700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7bdc06cb00 0x7f7bdc069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:39.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.160+0000 7f7bda59c700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f7bdc0b4990 0x7f7bdc06c3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:35706/0 (socket says 172.21.15.39:35706) 2023-11-28T11:57:39.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.160+0000 7f7bda59c700 1 -- 172.21.15.39:0/479415519 learned_addr learned my addr 172.21.15.39:0/479415519 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:39.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.160+0000 7f7bd3fff700 1 --2- 172.21.15.39:0/479415519 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7bdc0c9560 0x7f7bdc06b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:39.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.160+0000 7f7bdad9d700 1 -- 172.21.15.39:0/479415519 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7bdc0c9560 msgr2=0x7f7bdc06b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:39.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.160+0000 7f7bdad9d700 1 --2- 172.21.15.39:0/479415519 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7bdc0c9560 0x7f7bdc06b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:39.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.160+0000 7f7bdad9d700 1 -- 172.21.15.39:0/479415519 >> v1:172.21.15.184:6789/0 conn(0x7f7bdc0b4990 legacy=0x7f7bdc06c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:39.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.160+0000 7f7bdad9d700 1 -- 172.21.15.39:0/479415519 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bdc0717c0 con 0x7f7bdc06cb00 2023-11-28T11:57:39.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.160+0000 7f7bd9d9b700 1 -- 172.21.15.39:0/479415519 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3242997884 0 0) 0x7f7bdc15b140 con 0x7f7bdc0b4990 2023-11-28T11:57:39.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.160+0000 7f7bdad9d700 1 --2- 172.21.15.39:0/479415519 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bdc06cb00 0x7f7bdc069bf0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4009d90 tx=0x7f7bd400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f2b21d894ced31 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:39.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.160+0000 7f7bd9d9b700 1 -- 172.21.15.39:0/479415519 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd400e070 con 0x7f7bdc06cb00 2023-11-28T11:57:39.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.164+0000 7f7bd9d9b700 1 -- 172.21.15.39:0/479415519 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd400bb20 con 0x7f7bdc06cb00 2023-11-28T11:57:39.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.164+0000 7f7bd9d9b700 1 -- 172.21.15.39:0/479415519 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd4012430 con 0x7f7bdc06cb00 2023-11-28T11:57:39.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.164+0000 7f7bdb59e700 1 -- 172.21.15.39:0/479415519 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bdc06cb00 msgr2=0x7f7bdc069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:39.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.164+0000 7f7bdb59e700 1 --2- 172.21.15.39:0/479415519 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bdc06cb00 0x7f7bdc069bf0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4009d90 tx=0x7f7bd400b330 comp rx=0 tx=0).stop 2023-11-28T11:57:39.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.164+0000 7f7bdb59e700 1 -- 172.21.15.39:0/479415519 shutdown_connections 2023-11-28T11:57:39.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.164+0000 7f7bdb59e700 1 --2- 172.21.15.39:0/479415519 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bdc06cb00 0x7f7bdc069bf0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:39.170 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.164+0000 7f7bdb59e700 1 --2- 172.21.15.39:0/479415519 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7bdc0c9560 0x7f7bdc06b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:39.170 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.164+0000 7f7bdb59e700 1 -- 172.21.15.39:0/479415519 >> 172.21.15.39:0/479415519 conn(0x7f7bdc0b0a20 msgr2=0x7f7bdc0b0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:39.170 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.164+0000 7f7bdb59e700 1 -- 172.21.15.39:0/479415519 shutdown_connections 2023-11-28T11:57:39.170 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.164+0000 7f7bdb59e700 1 -- 172.21.15.39:0/479415519 wait complete. 2023-11-28T11:57:39.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.164+0000 7f7bdb59e700 1 Processor -- start 2023-11-28T11:57:39.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.164+0000 7f7bdb59e700 1 -- start start 2023-11-28T11:57:39.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.168+0000 7f7bdb59e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bdc06cb00 0x7f7bdc152700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:39.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.168+0000 7f7bdb59e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bdc0c9560 0x7f7bdc0cce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:39.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.168+0000 7f7bdb59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7bdc0cd340 0x7f7bdc0af9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:39.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.168+0000 7f7bdb59e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc0c32c0 con 0x7f7bdc0c9560 2023-11-28T11:57:39.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.168+0000 7f7bdb59e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc0ccb00 con 0x7f7bdc06cb00 2023-11-28T11:57:39.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.168+0000 7f7bdb59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc0ab860 con 0x7f7bdc0cd340 2023-11-28T11:57:39.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.168+0000 7f7bd3fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bdc0c9560 0x7f7bdc0cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:39.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.168+0000 7f7bd3fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bdc0c9560 0x7f7bdc0cce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53682/0 (socket says 172.21.15.39:53682) 2023-11-28T11:57:39.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.168+0000 7f7bd3fff700 1 -- 172.21.15.39:0/259458049 learned_addr learned my addr 172.21.15.39:0/259458049 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:39.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.168+0000 7f7bda59c700 1 --2- 172.21.15.39:0/259458049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bdc06cb00 0x7f7bdc152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:39.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.168+0000 7f7bdad9d700 1 --2- 172.21.15.39:0/259458049 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7bdc0cd340 0x7f7bdc0af9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:39.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.168+0000 7f7bd3fff700 1 -- 172.21.15.39:0/259458049 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7bdc0cd340 msgr2=0x7f7bdc0af9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:39.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.168+0000 7f7bd3fff700 1 --2- 172.21.15.39:0/259458049 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7bdc0cd340 0x7f7bdc0af9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:39.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.168+0000 7f7bd3fff700 1 -- 172.21.15.39:0/259458049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bdc06cb00 msgr2=0x7f7bdc152700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:39.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.168+0000 7f7bd3fff700 1 --2- 172.21.15.39:0/259458049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bdc06cb00 0x7f7bdc152700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:39.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.168+0000 7f7bd3fff700 1 -- 172.21.15.39:0/259458049 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd4009a70 con 0x7f7bdc0c9560 2023-11-28T11:57:39.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.168+0000 7f7bd3fff700 1 --2- 172.21.15.39:0/259458049 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bdc0c9560 0x7f7bdc0cce00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7bc400e840 tx=0x7f7bc400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:39.176 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.168+0000 7f7bd2ffd700 1 -- 172.21.15.39:0/259458049 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc40095a0 con 0x7f7bdc0c9560 2023-11-28T11:57:39.176 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.168+0000 7f7bd2ffd700 1 -- 172.21.15.39:0/259458049 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc4013680 con 0x7f7bdc0c9560 2023-11-28T11:57:39.176 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.168+0000 7f7bd2ffd700 1 -- 172.21.15.39:0/259458049 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc40139f0 con 0x7f7bdc0c9560 2023-11-28T11:57:39.176 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.168+0000 7f7bdb59e700 1 -- 172.21.15.39:0/259458049 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bdc06d140 con 0x7f7bdc0c9560 2023-11-28T11:57:39.176 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.168+0000 7f7bdb59e700 1 -- 172.21.15.39:0/259458049 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bdc0c99f0 con 0x7f7bdc0c9560 2023-11-28T11:57:39.177 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.172+0000 7f7bdb59e700 1 -- 172.21.15.39:0/259458049 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bdc06a130 con 0x7f7bdc0c9560 2023-11-28T11:57:39.179 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.172+0000 7f7bd2ffd700 1 -- 172.21.15.39:0/259458049 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7bc4019030 con 0x7f7bdc0c9560 2023-11-28T11:57:39.180 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.176+0000 7f7bd2ffd700 1 --2- 172.21.15.39:0/259458049 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7bbc064ee0 0x7f7bbc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:39.181 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.176+0000 7f7bd2ffd700 1 -- 172.21.15.39:0/259458049 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7bc4081fe0 con 0x7f7bdc0c9560 2023-11-28T11:57:39.181 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.176+0000 7f7bda59c700 1 --2- 172.21.15.39:0/259458049 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7bbc064ee0 0x7f7bbc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:39.182 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.176+0000 7f7bda59c700 1 --2- 172.21.15.39:0/259458049 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7bbc064ee0 0x7f7bbc067390 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc000f60 tx=0x7f7bcc007e00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:39.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.180+0000 7f7bd2ffd700 1 -- 172.21.15.39:0/259458049 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7bc404fd60 con 0x7f7bdc0c9560 2023-11-28T11:57:39.361 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.356+0000 7f7bdb59e700 1 -- 172.21.15.39:0/259458049 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7bdc0b3d60 con 0x7f7bdc0c9560 2023-11-28T11:57:39.361 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.356+0000 7f7bd2ffd700 1 -- 172.21.15.39:0/259458049 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7bc4053380 con 0x7f7bdc0c9560 2023-11-28T11:57:39.362 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-11-28T11:57:39.366 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.360+0000 7f7bdb59e700 1 -- 172.21.15.39:0/259458049 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7bbc064ee0 msgr2=0x7f7bbc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:39.366 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.360+0000 7f7bdb59e700 1 --2- 172.21.15.39:0/259458049 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7bbc064ee0 0x7f7bbc067390 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc000f60 tx=0x7f7bcc007e00 comp rx=0 tx=0).stop 2023-11-28T11:57:39.366 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.360+0000 7f7bdb59e700 1 -- 172.21.15.39:0/259458049 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bdc0c9560 msgr2=0x7f7bdc0cce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:39.366 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.360+0000 7f7bdb59e700 1 --2- 172.21.15.39:0/259458049 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bdc0c9560 0x7f7bdc0cce00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7bc400e840 tx=0x7f7bc400eb50 comp rx=0 tx=0).stop 2023-11-28T11:57:39.366 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.360+0000 7f7bdb59e700 1 -- 172.21.15.39:0/259458049 shutdown_connections 2023-11-28T11:57:39.366 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.360+0000 7f7bdb59e700 1 --2- 172.21.15.39:0/259458049 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7bdc0cd340 0x7f7bdc0af9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:39.366 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.360+0000 7f7bdb59e700 1 --2- 172.21.15.39:0/259458049 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bdc0c9560 0x7f7bdc0cce00 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:39.366 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.360+0000 7f7bdb59e700 1 --2- 172.21.15.39:0/259458049 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7bbc064ee0 0x7f7bbc067390 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:39.366 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.360+0000 7f7bdb59e700 1 --2- 172.21.15.39:0/259458049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bdc06cb00 0x7f7bdc152700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:39.366 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.360+0000 7f7bdb59e700 1 -- 172.21.15.39:0/259458049 >> 172.21.15.39:0/259458049 conn(0x7f7bdc0b0a20 msgr2=0x7f7bdc06a550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:39.367 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.360+0000 7f7bdb59e700 1 -- 172.21.15.39:0/259458049 shutdown_connections 2023-11-28T11:57:39.367 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.360+0000 7f7bdb59e700 1 -- 172.21.15.39:0/259458049 wait complete. 2023-11-28T11:57:39.387 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:57:39.568 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.560+0000 7fe777156700 1 Processor -- start 2023-11-28T11:57:39.568 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.564+0000 7fe777156700 1 -- start start 2023-11-28T11:57:39.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.564+0000 7fe777156700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe770159f10 0x7fe770070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:39.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.564+0000 7fe777156700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7700c8c90 0x7fe77006b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:39.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.564+0000 7fe777156700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe770070600 con 0x7fe77015a2e0 2023-11-28T11:57:39.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.564+0000 7fe777156700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7700c9100 con 0x7fe770159f10 2023-11-28T11:57:39.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.564+0000 7fe777156700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77006b840 con 0x7fe7700c8c90 2023-11-28T11:57:39.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.564+0000 7fe776955700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fe77015a2e0 0x7fe77015a720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:55556/0 (socket says 172.21.15.39:55556) 2023-11-28T11:57:39.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.564+0000 7fe776955700 1 -- 172.21.15.39:0/864424023 learned_addr learned my addr 172.21.15.39:0/864424023 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:39.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.564+0000 7fe776154700 1 --2- 172.21.15.39:0/864424023 >> v2:172.21.15.184:3300/0 conn(0x7fe770159f10 0x7fe770070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:39.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.564+0000 7fe775953700 1 --2- 172.21.15.39:0/864424023 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7700c8c90 0x7fe77006b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:39.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.564+0000 7fe775152700 1 -- 172.21.15.39:0/864424023 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 791276473 0 0) 0x7fe770070600 con 0x7fe77015a2e0 2023-11-28T11:57:39.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.564+0000 7fe775152700 1 -- 172.21.15.39:0/864424023 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe75c0035d0 con 0x7fe77015a2e0 2023-11-28T11:57:39.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.564+0000 7fe775953700 1 -- 172.21.15.39:0/864424023 >> v2:172.21.15.184:3300/0 conn(0x7fe770159f10 msgr2=0x7fe770070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:39.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.564+0000 7fe775953700 1 --2- 172.21.15.39:0/864424023 >> v2:172.21.15.184:3300/0 conn(0x7fe770159f10 0x7fe770070a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:39.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.564+0000 7fe775953700 1 -- 172.21.15.39:0/864424023 >> v1:172.21.15.39:6789/0 conn(0x7fe77015a2e0 legacy=0x7fe77015a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:39.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.564+0000 7fe775953700 1 -- 172.21.15.39:0/864424023 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77015ae30 con 0x7fe7700c8c90 2023-11-28T11:57:39.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.568+0000 7fe775953700 1 --2- 172.21.15.39:0/864424023 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7700c8c90 0x7fe77006b300 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe760009850 tx=0x7fe760009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e74d843d8721305 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:39.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.568+0000 7fe775152700 1 -- 172.21.15.39:0/864424023 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe760011830 con 0x7fe7700c8c90 2023-11-28T11:57:39.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.568+0000 7fe775152700 1 -- 172.21.15.39:0/864424023 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe760011990 con 0x7fe7700c8c90 2023-11-28T11:57:39.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.568+0000 7fe775152700 1 -- 172.21.15.39:0/864424023 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe760011d40 con 0x7fe7700c8c90 2023-11-28T11:57:39.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.568+0000 7fe777156700 1 -- 172.21.15.39:0/864424023 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7700c8c90 msgr2=0x7fe77006b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:39.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.568+0000 7fe777156700 1 --2- 172.21.15.39:0/864424023 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7700c8c90 0x7fe77006b300 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe760009850 tx=0x7fe760009b60 comp rx=0 tx=0).stop 2023-11-28T11:57:39.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.568+0000 7fe777156700 1 -- 172.21.15.39:0/864424023 shutdown_connections 2023-11-28T11:57:39.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.568+0000 7fe777156700 1 --2- 172.21.15.39:0/864424023 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7700c8c90 0x7fe77006b300 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:39.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.568+0000 7fe777156700 1 --2- 172.21.15.39:0/864424023 >> v2:172.21.15.184:3300/0 conn(0x7fe770159f10 0x7fe770070a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:39.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.568+0000 7fe777156700 1 -- 172.21.15.39:0/864424023 >> 172.21.15.39:0/864424023 conn(0x7fe7700cf280 msgr2=0x7fe7700cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:39.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.568+0000 7fe777156700 1 -- 172.21.15.39:0/864424023 shutdown_connections 2023-11-28T11:57:39.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.568+0000 7fe777156700 1 -- 172.21.15.39:0/864424023 wait complete. 2023-11-28T11:57:39.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.572+0000 7fe777156700 1 Processor -- start 2023-11-28T11:57:39.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.572+0000 7fe777156700 1 -- start start 2023-11-28T11:57:39.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.572+0000 7fe777156700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7700c8c90 0x7fe77014eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:39.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.572+0000 7fe777156700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe770159f10 0x7fe7700b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:39.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.572+0000 7fe777156700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe77015a2e0 0x7fe7700b09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:39.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.572+0000 7fe777156700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7700c5630 con 0x7fe77015a2e0 2023-11-28T11:57:39.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.572+0000 7fe777156700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7700b2a80 con 0x7fe7700c8c90 2023-11-28T11:57:39.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.572+0000 7fe777156700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77015d470 con 0x7fe770159f10 2023-11-28T11:57:39.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.572+0000 7fe776955700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe77015a2e0 0x7fe7700b09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:39.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.572+0000 7fe776955700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe77015a2e0 0x7fe7700b09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53698/0 (socket says 172.21.15.39:53698) 2023-11-28T11:57:39.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.572+0000 7fe776955700 1 -- 172.21.15.39:0/3937555800 learned_addr learned my addr 172.21.15.39:0/3937555800 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:39.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.572+0000 7fe775953700 1 --2- 172.21.15.39:0/3937555800 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe770159f10 0x7fe7700b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:39.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.572+0000 7fe776154700 1 --2- 172.21.15.39:0/3937555800 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7700c8c90 0x7fe77014eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:39.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.572+0000 7fe776955700 1 -- 172.21.15.39:0/3937555800 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe770159f10 msgr2=0x7fe7700b04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:39.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.572+0000 7fe776955700 1 --2- 172.21.15.39:0/3937555800 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe770159f10 0x7fe7700b04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:39.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.572+0000 7fe776955700 1 -- 172.21.15.39:0/3937555800 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7700c8c90 msgr2=0x7fe77014eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:39.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.572+0000 7fe776955700 1 --2- 172.21.15.39:0/3937555800 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7700c8c90 0x7fe77014eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:39.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.572+0000 7fe776955700 1 -- 172.21.15.39:0/3937555800 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7600094b0 con 0x7fe77015a2e0 2023-11-28T11:57:39.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.572+0000 7fe776955700 1 --2- 172.21.15.39:0/3937555800 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe77015a2e0 0x7fe7700b09f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe76800caa0 tx=0x7fe76800cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:39.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.576+0000 7fe766ffd700 1 -- 172.21.15.39:0/3937555800 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe768007480 con 0x7fe77015a2e0 2023-11-28T11:57:39.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.576+0000 7fe766ffd700 1 -- 172.21.15.39:0/3937555800 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7680075e0 con 0x7fe77015a2e0 2023-11-28T11:57:39.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.576+0000 7fe777156700 1 -- 172.21.15.39:0/3937555800 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe77006ffb0 con 0x7fe77015a2e0 2023-11-28T11:57:39.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.576+0000 7fe766ffd700 1 -- 172.21.15.39:0/3937555800 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe768007970 con 0x7fe77015a2e0 2023-11-28T11:57:39.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.576+0000 7fe777156700 1 -- 172.21.15.39:0/3937555800 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7700afcc0 con 0x7fe77015a2e0 2023-11-28T11:57:39.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.576+0000 7fe777156700 1 -- 172.21.15.39:0/3937555800 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe770070290 con 0x7fe77015a2e0 2023-11-28T11:57:39.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.580+0000 7fe766ffd700 1 -- 172.21.15.39:0/3937555800 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe768019030 con 0x7fe77015a2e0 2023-11-28T11:57:39.587 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.580+0000 7fe766ffd700 1 --2- 172.21.15.39:0/3937555800 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe754064ee0 0x7fe754067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:39.587 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.580+0000 7fe766ffd700 1 -- 172.21.15.39:0/3937555800 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe768081a90 con 0x7fe77015a2e0 2023-11-28T11:57:39.587 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.580+0000 7fe776154700 1 --2- 172.21.15.39:0/3937555800 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe754064ee0 0x7fe754067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:39.589 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.584+0000 7fe776154700 1 --2- 172.21.15.39:0/3937555800 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe754064ee0 0x7fe754067390 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe76c009bf0 tx=0x7fe76c009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:39.593 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.588+0000 7fe766ffd700 1 -- 172.21.15.39:0/3937555800 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe76804f810 con 0x7fe77015a2e0 2023-11-28T11:57:39.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.756+0000 7fe777156700 1 -- 172.21.15.39:0/3937555800 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe77006cf30 con 0x7fe77015a2e0 2023-11-28T11:57:39.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.756+0000 7fe766ffd700 1 -- 172.21.15.39:0/3937555800 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe768052e30 con 0x7fe77015a2e0 2023-11-28T11:57:39.768 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-11-28T11:57:39.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.760+0000 7fe777156700 1 -- 172.21.15.39:0/3937555800 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe754064ee0 msgr2=0x7fe754067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:39.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.760+0000 7fe777156700 1 --2- 172.21.15.39:0/3937555800 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe754064ee0 0x7fe754067390 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe76c009bf0 tx=0x7fe76c009240 comp rx=0 tx=0).stop 2023-11-28T11:57:39.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.760+0000 7fe777156700 1 -- 172.21.15.39:0/3937555800 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe77015a2e0 msgr2=0x7fe7700b09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:39.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.760+0000 7fe777156700 1 --2- 172.21.15.39:0/3937555800 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe77015a2e0 0x7fe7700b09f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe76800caa0 tx=0x7fe76800cad0 comp rx=0 tx=0).stop 2023-11-28T11:57:39.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.760+0000 7fe777156700 1 -- 172.21.15.39:0/3937555800 shutdown_connections 2023-11-28T11:57:39.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.760+0000 7fe777156700 1 --2- 172.21.15.39:0/3937555800 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe77015a2e0 0x7fe7700b09f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:39.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.760+0000 7fe777156700 1 --2- 172.21.15.39:0/3937555800 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe770159f10 0x7fe7700b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:39.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.760+0000 7fe777156700 1 --2- 172.21.15.39:0/3937555800 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe754064ee0 0x7fe754067390 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:39.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.760+0000 7fe777156700 1 --2- 172.21.15.39:0/3937555800 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7700c8c90 0x7fe77014eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:39.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.760+0000 7fe777156700 1 -- 172.21.15.39:0/3937555800 >> 172.21.15.39:0/3937555800 conn(0x7fe7700cf280 msgr2=0x7fe77006c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:39.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.760+0000 7fe777156700 1 -- 172.21.15.39:0/3937555800 shutdown_connections 2023-11-28T11:57:39.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.760+0000 7fe777156700 1 -- 172.21.15.39:0/3937555800 wait complete. 2023-11-28T11:57:39.789 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:57:39.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.976+0000 7fe788e4a700 1 Processor -- start 2023-11-28T11:57:39.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.976+0000 7fe788e4a700 1 -- start start 2023-11-28T11:57:39.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.980+0000 7fe788e4a700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe78415c700 0x7fe7840702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:39.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.980+0000 7fe788e4a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7840b1be0 0x7fe784070830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:39.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.980+0000 7fe788e4a700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe78406ac00 con 0x7fe7840b2130 2023-11-28T11:57:39.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.980+0000 7fe788e4a700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7840cd360 con 0x7fe78415c700 2023-11-28T11:57:39.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.980+0000 7fe788e4a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe784160190 con 0x7fe7840b1be0 2023-11-28T11:57:39.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.980+0000 7fe78259c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe78415c700 0x7fe7840702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:39.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.980+0000 7fe782d9d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7840b1be0 0x7fe784070830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:39.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.980+0000 7fe78259c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe78415c700 0x7fe7840702f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:55518/0 (socket says 172.21.15.39:55518) 2023-11-28T11:57:39.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.980+0000 7fe78259c700 1 -- 172.21.15.39:0/822238537 learned_addr learned my addr 172.21.15.39:0/822238537 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:39.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.980+0000 7fe782d9d700 1 --2- 172.21.15.39:0/822238537 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7840b1be0 0x7fe784070830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:60356/0 (socket says 172.21.15.39:60356) 2023-11-28T11:57:39.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.980+0000 7fe78259c700 1 -- 172.21.15.39:0/822238537 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7840b1be0 msgr2=0x7fe784070830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:39.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.980+0000 7fe78259c700 1 --2- 172.21.15.39:0/822238537 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7840b1be0 0x7fe784070830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:39.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.980+0000 7fe78259c700 1 -- 172.21.15.39:0/822238537 >> v1:172.21.15.39:6789/0 conn(0x7fe7840b2130 legacy=0x7fe78406c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:39.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.980+0000 7fe78259c700 1 -- 172.21.15.39:0/822238537 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe784160470 con 0x7fe78415c700 2023-11-28T11:57:39.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.980+0000 7fe78259c700 1 --2- 172.21.15.39:0/822238537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe78415c700 0x7fe7840702f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe774009910 tx=0x7fe774009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=927adcc2b67dfb2a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:39.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.984+0000 7fe78159a700 1 -- 172.21.15.39:0/822238537 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe774011830 con 0x7fe78415c700 2023-11-28T11:57:39.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.984+0000 7fe78159a700 1 -- 172.21.15.39:0/822238537 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe774011990 con 0x7fe78415c700 2023-11-28T11:57:39.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.984+0000 7fe78159a700 1 -- 172.21.15.39:0/822238537 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe774011d40 con 0x7fe78415c700 2023-11-28T11:57:39.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.984+0000 7fe788e4a700 1 -- 172.21.15.39:0/822238537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe78415c700 msgr2=0x7fe7840702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:39.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.984+0000 7fe788e4a700 1 --2- 172.21.15.39:0/822238537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe78415c700 0x7fe7840702f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe774009910 tx=0x7fe774009c20 comp rx=0 tx=0).stop 2023-11-28T11:57:39.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.984+0000 7fe788e4a700 1 -- 172.21.15.39:0/822238537 shutdown_connections 2023-11-28T11:57:39.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.984+0000 7fe788e4a700 1 --2- 172.21.15.39:0/822238537 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7840b1be0 0x7fe784070830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:39.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.984+0000 7fe788e4a700 1 --2- 172.21.15.39:0/822238537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe78415c700 0x7fe7840702f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:39.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.984+0000 7fe788e4a700 1 -- 172.21.15.39:0/822238537 >> 172.21.15.39:0/822238537 conn(0x7fe7840d2d10 msgr2=0x7fe7840d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:39.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.984+0000 7fe788e4a700 1 -- 172.21.15.39:0/822238537 shutdown_connections 2023-11-28T11:57:39.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.984+0000 7fe788e4a700 1 -- 172.21.15.39:0/822238537 wait complete. 2023-11-28T11:57:39.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.988+0000 7fe788e4a700 1 Processor -- start 2023-11-28T11:57:39.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.988+0000 7fe788e4a700 1 -- start start 2023-11-28T11:57:39.994 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.988+0000 7fe788e4a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7840b1be0 0x7fe7840b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:39.994 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.988+0000 7fe788e4a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe7840b2130 0x7fe7840b5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:39.994 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.988+0000 7fe788e4a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe78415c700 0x7fe78414bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:39.994 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.988+0000 7fe788e4a700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7840b74c0 con 0x7fe7840b2130 2023-11-28T11:57:39.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.988+0000 7fe788e4a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7840b6ba0 con 0x7fe7840b1be0 2023-11-28T11:57:39.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.988+0000 7fe788e4a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7840b65e0 con 0x7fe78415c700 2023-11-28T11:57:39.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.988+0000 7fe782d9d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe78415c700 0x7fe78414bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:39.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.988+0000 7fe781d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe7840b2130 0x7fe7840b5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:39.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.988+0000 7fe78259c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7840b1be0 0x7fe7840b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:39.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.988+0000 7fe782d9d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe78415c700 0x7fe78414bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:60364/0 (socket says 172.21.15.39:60364) 2023-11-28T11:57:39.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.988+0000 7fe782d9d700 1 -- 172.21.15.39:0/295119698 learned_addr learned my addr 172.21.15.39:0/295119698 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:39.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.988+0000 7fe78259c700 1 -- 172.21.15.39:0/295119698 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe78415c700 msgr2=0x7fe78414bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:39.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.988+0000 7fe78259c700 1 --2- 172.21.15.39:0/295119698 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe78415c700 0x7fe78414bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:39.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.988+0000 7fe78259c700 1 -- 172.21.15.39:0/295119698 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe7840b2130 msgr2=0x7fe7840b5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:39.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.988+0000 7fe78259c700 1 --2- 172.21.15.39:0/295119698 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe7840b2130 0x7fe7840b5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:39.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.988+0000 7fe78259c700 1 -- 172.21.15.39:0/295119698 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe774009570 con 0x7fe7840b1be0 2023-11-28T11:57:39.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.988+0000 7fe782d9d700 1 --2- 172.21.15.39:0/295119698 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe78415c700 0x7fe78414bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:39.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.988+0000 7fe781d9b700 1 --2- 172.21.15.39:0/295119698 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe7840b2130 0x7fe7840b5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:39.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.992+0000 7fe78259c700 1 --2- 172.21.15.39:0/295119698 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7840b1be0 0x7fe7840b3de0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe774016000 tx=0x7fe774004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:39.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.992+0000 7fe772ffd700 1 -- 172.21.15.39:0/295119698 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe774004510 con 0x7fe7840b1be0 2023-11-28T11:57:39.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.992+0000 7fe772ffd700 1 -- 172.21.15.39:0/295119698 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7740036c0 con 0x7fe7840b1be0 2023-11-28T11:57:39.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.992+0000 7fe772ffd700 1 -- 172.21.15.39:0/295119698 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe774003a70 con 0x7fe7840b1be0 2023-11-28T11:57:39.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.992+0000 7fe788e4a700 1 -- 172.21.15.39:0/295119698 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe784160a30 con 0x7fe7840b1be0 2023-11-28T11:57:39.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.992+0000 7fe788e4a700 1 -- 172.21.15.39:0/295119698 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe784160750 con 0x7fe7840b1be0 2023-11-28T11:57:39.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.992+0000 7fe788e4a700 1 -- 172.21.15.39:0/295119698 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe78406b530 con 0x7fe7840b1be0 2023-11-28T11:57:40.000 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.996+0000 7fe772ffd700 1 -- 172.21.15.39:0/295119698 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe77402d070 con 0x7fe7840b1be0 2023-11-28T11:57:40.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.996+0000 7fe772ffd700 1 --2- 172.21.15.39:0/295119698 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe764064ee0 0x7fe764067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:40.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.996+0000 7fe772ffd700 1 -- 172.21.15.39:0/295119698 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe774021030 con 0x7fe7840b1be0 2023-11-28T11:57:40.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.996+0000 7fe781d9b700 1 --2- 172.21.15.39:0/295119698 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe764064ee0 0x7fe764067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:40.003 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:39.996+0000 7fe781d9b700 1 --2- 172.21.15.39:0/295119698 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe764064ee0 0x7fe764067390 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe78415d0d0 tx=0x7fe778009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:40.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.004+0000 7fe772ffd700 1 -- 172.21.15.39:0/295119698 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe7740515a0 con 0x7fe7840b1be0 2023-11-28T11:57:40.180 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.176+0000 7fe788e4a700 1 -- 172.21.15.39:0/295119698 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe7840b7600 con 0x7fe7840b1be0 2023-11-28T11:57:40.182 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.176+0000 7fe772ffd700 1 -- 172.21.15.39:0/295119698 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe7840b7600 con 0x7fe7840b1be0 2023-11-28T11:57:40.182 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2023-11-28T11:57:40.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.180+0000 7fe788e4a700 1 -- 172.21.15.39:0/295119698 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe764064ee0 msgr2=0x7fe764067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:40.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.180+0000 7fe788e4a700 1 --2- 172.21.15.39:0/295119698 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe764064ee0 0x7fe764067390 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe78415d0d0 tx=0x7fe778009040 comp rx=0 tx=0).stop 2023-11-28T11:57:40.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.180+0000 7fe788e4a700 1 -- 172.21.15.39:0/295119698 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7840b1be0 msgr2=0x7fe7840b3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:40.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.180+0000 7fe788e4a700 1 --2- 172.21.15.39:0/295119698 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7840b1be0 0x7fe7840b3de0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe774016000 tx=0x7fe774004770 comp rx=0 tx=0).stop 2023-11-28T11:57:40.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.180+0000 7fe788e4a700 1 -- 172.21.15.39:0/295119698 shutdown_connections 2023-11-28T11:57:40.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.180+0000 7fe788e4a700 1 --2- 172.21.15.39:0/295119698 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe78415c700 0x7fe78414bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:40.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.180+0000 7fe788e4a700 1 --2- 172.21.15.39:0/295119698 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe7840b2130 0x7fe7840b5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:40.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.180+0000 7fe788e4a700 1 --2- 172.21.15.39:0/295119698 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe764064ee0 0x7fe764067390 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:40.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.180+0000 7fe788e4a700 1 --2- 172.21.15.39:0/295119698 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7840b1be0 0x7fe7840b3de0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:40.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.180+0000 7fe788e4a700 1 -- 172.21.15.39:0/295119698 >> 172.21.15.39:0/295119698 conn(0x7fe7840d2d10 msgr2=0x7fe7840702f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:40.186 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.180+0000 7fe788e4a700 1 -- 172.21.15.39:0/295119698 shutdown_connections 2023-11-28T11:57:40.186 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.180+0000 7fe788e4a700 1 -- 172.21.15.39:0/295119698 wait complete. 2023-11-28T11:57:40.206 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T11:57:40.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.388+0000 7f32c3558700 1 Processor -- start 2023-11-28T11:57:40.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.388+0000 7f32c3558700 1 -- start start 2023-11-28T11:57:40.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.392+0000 7f32c3558700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f32bc15e190 0x7f32bc0cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:40.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.392+0000 7f32c3558700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f32bc161560 0x7f32bc069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:40.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.392+0000 7f32c3558700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32bc15e560 con 0x7f32bc06ff10 2023-11-28T11:57:40.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.392+0000 7f32c3558700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32bc06be80 con 0x7f32bc161560 2023-11-28T11:57:40.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.392+0000 7f32c3558700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32bc0ce330 con 0x7f32bc15e190 2023-11-28T11:57:40.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.392+0000 7f32c1d55700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f32bc161560 0x7f32bc069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:40.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.392+0000 7f32c1d55700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f32bc161560 0x7f32bc069bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53716/0 (socket says 172.21.15.39:53716) 2023-11-28T11:57:40.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.392+0000 7f32c1d55700 1 -- 172.21.15.39:0/3538711757 learned_addr learned my addr 172.21.15.39:0/3538711757 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:40.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.392+0000 7f32c2556700 1 --2- 172.21.15.39:0/3538711757 >> v2:172.21.15.184:3300/0 conn(0x7f32bc15e190 0x7f32bc0cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:40.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.396+0000 7f32c1d55700 1 -- 172.21.15.39:0/3538711757 >> v2:172.21.15.184:3300/0 conn(0x7f32bc15e190 msgr2=0x7f32bc0cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:40.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.396+0000 7f32c1d55700 1 --2- 172.21.15.39:0/3538711757 >> v2:172.21.15.184:3300/0 conn(0x7f32bc15e190 0x7f32bc0cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:40.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.396+0000 7f32c1d55700 1 -- 172.21.15.39:0/3538711757 >> v1:172.21.15.39:6789/0 conn(0x7f32bc06ff10 legacy=0x7f32bc06c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:40.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.396+0000 7f32c1d55700 1 -- 172.21.15.39:0/3538711757 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32bc0af990 con 0x7f32bc161560 2023-11-28T11:57:40.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.396+0000 7f32c1d55700 1 --2- 172.21.15.39:0/3538711757 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32bc161560 0x7f32bc069bf0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f32bc0cb9b0 tx=0x7f32ac009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=403c03eb475bab6a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:40.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.396+0000 7f32c1554700 1 -- 172.21.15.39:0/3538711757 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ac00b8a0 con 0x7f32bc161560 2023-11-28T11:57:40.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.396+0000 7f32c1554700 1 -- 172.21.15.39:0/3538711757 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32ac00ba00 con 0x7f32bc161560 2023-11-28T11:57:40.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.396+0000 7f32c1554700 1 -- 172.21.15.39:0/3538711757 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ac00bd90 con 0x7f32bc161560 2023-11-28T11:57:40.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.396+0000 7f32c3558700 1 -- 172.21.15.39:0/3538711757 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32bc161560 msgr2=0x7f32bc069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:40.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.396+0000 7f32c3558700 1 --2- 172.21.15.39:0/3538711757 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32bc161560 0x7f32bc069bf0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f32bc0cb9b0 tx=0x7f32ac009bf0 comp rx=0 tx=0).stop 2023-11-28T11:57:40.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.396+0000 7f32c3558700 1 -- 172.21.15.39:0/3538711757 shutdown_connections 2023-11-28T11:57:40.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.396+0000 7f32c3558700 1 --2- 172.21.15.39:0/3538711757 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32bc161560 0x7f32bc069bf0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:40.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.396+0000 7f32c3558700 1 --2- 172.21.15.39:0/3538711757 >> v2:172.21.15.184:3300/0 conn(0x7f32bc15e190 0x7f32bc0cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:40.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.396+0000 7f32c3558700 1 -- 172.21.15.39:0/3538711757 >> 172.21.15.39:0/3538711757 conn(0x7f32bc0cf280 msgr2=0x7f32bc0cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:40.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.396+0000 7f32c3558700 1 -- 172.21.15.39:0/3538711757 shutdown_connections 2023-11-28T11:57:40.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.396+0000 7f32c3558700 1 -- 172.21.15.39:0/3538711757 wait complete. 2023-11-28T11:57:40.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.400+0000 7f32c3558700 1 Processor -- start 2023-11-28T11:57:40.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.400+0000 7f32c3558700 1 -- start start 2023-11-28T11:57:40.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.404+0000 7f32c3558700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32bc06ff10 0x7f32bc1624e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:40.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.404+0000 7f32c3558700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32bc15e190 0x7f32bc14fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:40.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.404+0000 7f32c3558700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32bc161560 0x7f32bc0c6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:40.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.404+0000 7f32c3558700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32bc0b1b70 con 0x7f32bc161560 2023-11-28T11:57:40.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.404+0000 7f32c3558700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32bc0c7940 con 0x7f32bc15e190 2023-11-28T11:57:40.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.404+0000 7f32c3558700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32bc0c70a0 con 0x7f32bc06ff10 2023-11-28T11:57:40.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.404+0000 7f32c2d57700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32bc161560 0x7f32bc0c6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:40.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.404+0000 7f32c2d57700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32bc161560 0x7f32bc0c6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53724/0 (socket says 172.21.15.39:53724) 2023-11-28T11:57:40.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.404+0000 7f32c1d55700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32bc15e190 0x7f32bc14fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:40.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.404+0000 7f32c2d57700 1 -- 172.21.15.39:0/2606297767 learned_addr learned my addr 172.21.15.39:0/2606297767 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:40.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.404+0000 7f32c2556700 1 --2- 172.21.15.39:0/2606297767 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32bc06ff10 0x7f32bc1624e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:40.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.404+0000 7f32c2d57700 1 -- 172.21.15.39:0/2606297767 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32bc06ff10 msgr2=0x7f32bc1624e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:40.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.404+0000 7f32c2d57700 1 --2- 172.21.15.39:0/2606297767 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32bc06ff10 0x7f32bc1624e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:40.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.404+0000 7f32c2d57700 1 -- 172.21.15.39:0/2606297767 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32bc15e190 msgr2=0x7f32bc14fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:40.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.404+0000 7f32c2d57700 1 --2- 172.21.15.39:0/2606297767 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32bc15e190 0x7f32bc14fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:40.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.404+0000 7f32c2d57700 1 -- 172.21.15.39:0/2606297767 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32ac009570 con 0x7f32bc161560 2023-11-28T11:57:40.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.404+0000 7f32c2d57700 1 --2- 172.21.15.39:0/2606297767 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32bc161560 0x7f32bc0c6850 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f32b400cb50 tx=0x7f32b400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:40.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.404+0000 7f32b2ffd700 1 -- 172.21.15.39:0/2606297767 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b4003c20 con 0x7f32bc161560 2023-11-28T11:57:40.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.404+0000 7f32b2ffd700 1 -- 172.21.15.39:0/2606297767 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b4003d80 con 0x7f32bc161560 2023-11-28T11:57:40.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.404+0000 7f32b2ffd700 1 -- 172.21.15.39:0/2606297767 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b400aa20 con 0x7f32bc161560 2023-11-28T11:57:40.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.408+0000 7f32c3558700 1 -- 172.21.15.39:0/2606297767 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32bc0aff50 con 0x7f32bc161560 2023-11-28T11:57:40.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.408+0000 7f32c3558700 1 -- 172.21.15.39:0/2606297767 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32bc0afc70 con 0x7f32bc161560 2023-11-28T11:57:40.414 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.408+0000 7f32c3558700 1 -- 172.21.15.39:0/2606297767 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32bc06a130 con 0x7f32bc161560 2023-11-28T11:57:40.415 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.408+0000 7f32b2ffd700 1 -- 172.21.15.39:0/2606297767 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f32b4010050 con 0x7f32bc161560 2023-11-28T11:57:40.417 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.412+0000 7f32b2ffd700 1 --2- 172.21.15.39:0/2606297767 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f32a0064ee0 0x7f32a0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:40.418 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.412+0000 7f32b2ffd700 1 -- 172.21.15.39:0/2606297767 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f32b4081ff0 con 0x7f32bc161560 2023-11-28T11:57:40.418 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.412+0000 7f32c2556700 1 --2- 172.21.15.39:0/2606297767 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f32a0064ee0 0x7f32a0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:40.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.412+0000 7f32c2556700 1 --2- 172.21.15.39:0/2606297767 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f32a0064ee0 0x7f32a0067390 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f32bc0cac30 tx=0x7f32b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:40.423 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.416+0000 7f32b2ffd700 1 -- 172.21.15.39:0/2606297767 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f32b404fd90 con 0x7f32bc161560 2023-11-28T11:57:40.594 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.588+0000 7f32c3558700 1 -- 172.21.15.39:0/2606297767 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f32bc15f6e0 con 0x7f32bc161560 2023-11-28T11:57:40.596 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.588+0000 7f32b2ffd700 1 -- 172.21.15.39:0/2606297767 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f32bc15f6e0 con 0x7f32bc161560 2023-11-28T11:57:40.596 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-11-28T11:57:40.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.592+0000 7f32c3558700 1 -- 172.21.15.39:0/2606297767 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f32a0064ee0 msgr2=0x7f32a0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:40.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.592+0000 7f32c3558700 1 --2- 172.21.15.39:0/2606297767 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f32a0064ee0 0x7f32a0067390 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f32bc0cac30 tx=0x7f32b8008040 comp rx=0 tx=0).stop 2023-11-28T11:57:40.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.592+0000 7f32c3558700 1 -- 172.21.15.39:0/2606297767 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32bc161560 msgr2=0x7f32bc0c6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:40.600 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.592+0000 7f32c3558700 1 --2- 172.21.15.39:0/2606297767 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32bc161560 0x7f32bc0c6850 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f32b400cb50 tx=0x7f32b400ce60 comp rx=0 tx=0).stop 2023-11-28T11:57:40.600 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.592+0000 7f32c3558700 1 -- 172.21.15.39:0/2606297767 shutdown_connections 2023-11-28T11:57:40.600 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.592+0000 7f32c3558700 1 --2- 172.21.15.39:0/2606297767 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32bc161560 0x7f32bc0c6850 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:40.600 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.592+0000 7f32c3558700 1 --2- 172.21.15.39:0/2606297767 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f32a0064ee0 0x7f32a0067390 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:40.600 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.592+0000 7f32c3558700 1 --2- 172.21.15.39:0/2606297767 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32bc15e190 0x7f32bc14fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:40.600 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.592+0000 7f32c3558700 1 --2- 172.21.15.39:0/2606297767 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32bc06ff10 0x7f32bc1624e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:40.600 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.592+0000 7f32c3558700 1 -- 172.21.15.39:0/2606297767 >> 172.21.15.39:0/2606297767 conn(0x7f32bc0cf280 msgr2=0x7f32bc160950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:40.600 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.592+0000 7f32c3558700 1 -- 172.21.15.39:0/2606297767 shutdown_connections 2023-11-28T11:57:40.600 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.592+0000 7f32c3558700 1 -- 172.21.15.39:0/2606297767 wait complete. 2023-11-28T11:57:40.621 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T11:57:40.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.776+0000 7f4ab8828700 1 Processor -- start 2023-11-28T11:57:40.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.776+0000 7f4ab8828700 1 -- start start 2023-11-28T11:57:40.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.776+0000 7f4ab8828700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4ab40cfbd0 0x7f4ab40cedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:40.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.780+0000 7f4ab8828700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab415cc60 con 0x7f4ab415c890 2023-11-28T11:57:40.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.780+0000 7f4ab8828700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab40cf480 con 0x7f4ab406b410 2023-11-28T11:57:40.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.780+0000 7f4ab8828700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ab40cfa40 con 0x7f4ab40cfbd0 2023-11-28T11:57:40.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.780+0000 7f4ab37fe700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f4ab415c890 0x7f4ab406ad00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:55588/0 (socket says 172.21.15.39:55588) 2023-11-28T11:57:40.785 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.780+0000 7f4ab37fe700 1 -- 172.21.15.39:0/2184481963 learned_addr learned my addr 172.21.15.39:0/2184481963 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:40.785 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.780+0000 7f4ab3fff700 1 --2- 172.21.15.39:0/2184481963 >> v2:172.21.15.39:3300/0 conn(0x7f4ab40cfbd0 0x7f4ab40cedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:40.786 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.780+0000 7f4ab2ffd700 1 -- 172.21.15.39:0/2184481963 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2028628718 0 0) 0x7f4ab415cc60 con 0x7f4ab415c890 2023-11-28T11:57:40.786 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.780+0000 7f4ab2ffd700 1 -- 172.21.15.39:0/2184481963 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4aa00035d0 con 0x7f4ab415c890 2023-11-28T11:57:40.786 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.780+0000 7f4ab2ffd700 1 -- 172.21.15.39:0/2184481963 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3911542373 0 0) 0x7f4ab40cf480 con 0x7f4ab406b410 2023-11-28T11:57:40.786 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.780+0000 7f4ab2ffd700 1 -- 172.21.15.39:0/2184481963 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ab415cc60 con 0x7f4ab406b410 2023-11-28T11:57:40.786 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.780+0000 7f4ab3fff700 1 -- 172.21.15.39:0/2184481963 >> v1:172.21.15.184:6789/0 conn(0x7f4ab406b410 legacy=0x7f4ab40b3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:40.786 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.780+0000 7f4ab3fff700 1 -- 172.21.15.39:0/2184481963 >> v1:172.21.15.39:6789/0 conn(0x7f4ab415c890 legacy=0x7f4ab406ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:40.786 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.780+0000 7f4ab2ffd700 1 -- 172.21.15.39:0/2184481963 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2243117993 0 0) 0x7f4aa00035d0 con 0x7f4ab415c890 2023-11-28T11:57:40.786 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.780+0000 7f4ab3fff700 1 -- 172.21.15.39:0/2184481963 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab40cf760 con 0x7f4ab40cfbd0 2023-11-28T11:57:40.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.780+0000 7f4ab3fff700 1 --2- 172.21.15.39:0/2184481963 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ab40cfbd0 0x7f4ab40cedf0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4aac009850 tx=0x7f4aac009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8188342f241572ff server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:40.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.780+0000 7f4ab2ffd700 1 -- 172.21.15.39:0/2184481963 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa4001a40 con 0x7f4ab40cfbd0 2023-11-28T11:57:40.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.780+0000 7f4ab2ffd700 1 -- 172.21.15.39:0/2184481963 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aac004030 con 0x7f4ab40cfbd0 2023-11-28T11:57:40.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.780+0000 7f4ab2ffd700 1 -- 172.21.15.39:0/2184481963 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac0043c0 con 0x7f4ab40cfbd0 2023-11-28T11:57:40.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.780+0000 7f4ab8828700 1 -- 172.21.15.39:0/2184481963 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ab40cfbd0 msgr2=0x7f4ab40cedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:40.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.780+0000 7f4ab8828700 1 --2- 172.21.15.39:0/2184481963 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ab40cfbd0 0x7f4ab40cedf0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4aac009850 tx=0x7f4aac009b60 comp rx=0 tx=0).stop 2023-11-28T11:57:40.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.780+0000 7f4ab8828700 1 -- 172.21.15.39:0/2184481963 shutdown_connections 2023-11-28T11:57:40.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.780+0000 7f4ab8828700 1 --2- 172.21.15.39:0/2184481963 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ab40cfbd0 0x7f4ab40cedf0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:40.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.780+0000 7f4ab8828700 1 -- 172.21.15.39:0/2184481963 >> 172.21.15.39:0/2184481963 conn(0x7f4ab4099af0 msgr2=0x7f4ab40d07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:40.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.780+0000 7f4ab8828700 1 -- 172.21.15.39:0/2184481963 shutdown_connections 2023-11-28T11:57:40.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.780+0000 7f4ab8828700 1 -- 172.21.15.39:0/2184481963 wait complete. 2023-11-28T11:57:40.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.784+0000 7f4ab8828700 1 Processor -- start 2023-11-28T11:57:40.791 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.784+0000 7f4ab8828700 1 -- start start 2023-11-28T11:57:40.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.788+0000 7f4ab8828700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ab406b410 0x7f4ab40c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:40.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.788+0000 7f4ab8828700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ab40cfbd0 0x7f4ab40b5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:40.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.788+0000 7f4ab8828700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ab415c890 0x7f4ab40b5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:40.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.788+0000 7f4ab8828700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab415db60 con 0x7f4ab406b410 2023-11-28T11:57:40.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.788+0000 7f4ab8828700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab415d190 con 0x7f4ab40cfbd0 2023-11-28T11:57:40.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.788+0000 7f4ab8828700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab415d470 con 0x7f4ab415c890 2023-11-28T11:57:40.794 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.788+0000 7f4ab37fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ab406b410 0x7f4ab40c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:40.794 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.788+0000 7f4ab37fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ab406b410 0x7f4ab40c9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53748/0 (socket says 172.21.15.39:53748) 2023-11-28T11:57:40.794 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.788+0000 7f4ab37fe700 1 -- 172.21.15.39:0/4231923643 learned_addr learned my addr 172.21.15.39:0/4231923643 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:40.794 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.788+0000 7f4aaaffd700 1 --2- 172.21.15.39:0/4231923643 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ab40cfbd0 0x7f4ab40b5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:40.794 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.788+0000 7f4ab3fff700 1 --2- 172.21.15.39:0/4231923643 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ab415c890 0x7f4ab40b5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:40.795 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.788+0000 7f4ab37fe700 1 -- 172.21.15.39:0/4231923643 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ab415c890 msgr2=0x7f4ab40b5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:40.795 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.788+0000 7f4ab37fe700 1 --2- 172.21.15.39:0/4231923643 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ab415c890 0x7f4ab40b5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:40.795 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.788+0000 7f4ab37fe700 1 -- 172.21.15.39:0/4231923643 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ab40cfbd0 msgr2=0x7f4ab40b5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:40.795 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.788+0000 7f4ab37fe700 1 --2- 172.21.15.39:0/4231923643 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ab40cfbd0 0x7f4ab40b5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:40.795 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.788+0000 7f4ab37fe700 1 -- 172.21.15.39:0/4231923643 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aac0094b0 con 0x7f4ab406b410 2023-11-28T11:57:40.795 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.788+0000 7f4ab37fe700 1 --2- 172.21.15.39:0/4231923643 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ab406b410 0x7f4ab40c9f10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4aa400cc70 tx=0x7f4aa400cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:40.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.788+0000 7f4ab0ff9700 1 -- 172.21.15.39:0/4231923643 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa400aac0 con 0x7f4ab406b410 2023-11-28T11:57:40.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.788+0000 7f4ab0ff9700 1 -- 172.21.15.39:0/4231923643 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa400ac40 con 0x7f4ab406b410 2023-11-28T11:57:40.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.788+0000 7f4ab8828700 1 -- 172.21.15.39:0/4231923643 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ab40b3a70 con 0x7f4ab406b410 2023-11-28T11:57:40.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.788+0000 7f4ab0ff9700 1 -- 172.21.15.39:0/4231923643 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa40070d0 con 0x7f4ab406b410 2023-11-28T11:57:40.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.788+0000 7f4ab8828700 1 -- 172.21.15.39:0/4231923643 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ab40b3790 con 0x7f4ab406b410 2023-11-28T11:57:40.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.792+0000 7f4ab8828700 1 -- 172.21.15.39:0/4231923643 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ab40d03c0 con 0x7f4ab406b410 2023-11-28T11:57:40.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.792+0000 7f4ab0ff9700 1 -- 172.21.15.39:0/4231923643 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4aa401a030 con 0x7f4ab406b410 2023-11-28T11:57:40.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.792+0000 7f4ab0ff9700 1 --2- 172.21.15.39:0/4231923643 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4a94064ee0 0x7f4a94067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:40.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.796+0000 7f4ab0ff9700 1 -- 172.21.15.39:0/4231923643 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4aa4081f60 con 0x7f4ab406b410 2023-11-28T11:57:40.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.796+0000 7f4aaaffd700 1 --2- 172.21.15.39:0/4231923643 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4a94064ee0 0x7f4a94067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:40.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.796+0000 7f4aaaffd700 1 --2- 172.21.15.39:0/4231923643 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4a94064ee0 0x7f4a94067390 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4ab40b6400 tx=0x7f4a9c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:40.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.796+0000 7f4ab0ff9700 1 -- 172.21.15.39:0/4231923643 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4aa404fce0 con 0x7f4ab406b410 2023-11-28T11:57:40.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.976+0000 7f4ab8828700 1 -- 172.21.15.39:0/4231923643 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4ab415d630 con 0x7f4ab406b410 2023-11-28T11:57:40.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.976+0000 7f4ab0ff9700 1 -- 172.21.15.39:0/4231923643 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4ab415d630 con 0x7f4ab406b410 2023-11-28T11:57:40.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.980+0000 7f4ab8828700 1 -- 172.21.15.39:0/4231923643 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4a94064ee0 msgr2=0x7f4a94067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:40.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.980+0000 7f4ab8828700 1 --2- 172.21.15.39:0/4231923643 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4a94064ee0 0x7f4a94067390 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4ab40b6400 tx=0x7f4a9c009040 comp rx=0 tx=0).stop 2023-11-28T11:57:40.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.980+0000 7f4ab8828700 1 -- 172.21.15.39:0/4231923643 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ab406b410 msgr2=0x7f4ab40c9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:40.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.980+0000 7f4ab8828700 1 --2- 172.21.15.39:0/4231923643 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ab406b410 0x7f4ab40c9f10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4aa400cc70 tx=0x7f4aa400cf80 comp rx=0 tx=0).stop 2023-11-28T11:57:40.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.980+0000 7f4ab8828700 1 -- 172.21.15.39:0/4231923643 shutdown_connections 2023-11-28T11:57:40.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.980+0000 7f4ab8828700 1 --2- 172.21.15.39:0/4231923643 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ab415c890 0x7f4ab40b5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:40.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.980+0000 7f4ab8828700 1 --2- 172.21.15.39:0/4231923643 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4a94064ee0 0x7f4a94067390 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:40.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.980+0000 7f4ab8828700 1 --2- 172.21.15.39:0/4231923643 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ab40cfbd0 0x7f4ab40b5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:40.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.980+0000 7f4ab8828700 1 --2- 172.21.15.39:0/4231923643 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ab406b410 0x7f4ab40c9f10 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:40.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.980+0000 7f4ab8828700 1 -- 172.21.15.39:0/4231923643 >> 172.21.15.39:0/4231923643 conn(0x7f4ab4099af0 msgr2=0x7f4ab40b3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:40.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.980+0000 7f4ab8828700 1 -- 172.21.15.39:0/4231923643 shutdown_connections 2023-11-28T11:57:40.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:40.980+0000 7f4ab8828700 1 -- 172.21.15.39:0/4231923643 wait complete. 2023-11-28T11:57:40.990 INFO:teuthology.orchestra.run.smithi039.stderr:listed 0 entries 2023-11-28T11:57:41.010 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-11-28T11:57:41.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:41.011 DEBUG:teuthology.orchestra.run.smithi039:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-11-28T11:57:41.050 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi039.front.sepia.ceph.com 2023-11-28T11:57:41.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:41.050 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-28T11:57:41.118 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:57:41.118 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:57:41.135 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:57:41.135 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:57:41.194 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:57:41.194 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:57:41.252 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:57:41.432 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.428+0000 7fb8cce76700 1 Processor -- start 2023-11-28T11:57:41.432 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.428+0000 7fb8cce76700 1 -- start start 2023-11-28T11:57:41.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.428+0000 7fb8cce76700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8c8070790 0x7fb8c8167110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:41.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.428+0000 7fb8cce76700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8c80adf90 con 0x7fb8c80cdeb0 2023-11-28T11:57:41.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.428+0000 7fb8cce76700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8c80ce370 con 0x7fb8c815c1a0 2023-11-28T11:57:41.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.428+0000 7fb8cce76700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c8069bf0 con 0x7fb8c8070790 2023-11-28T11:57:41.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.428+0000 7fb8beffd700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fb8c80cdeb0 0x7fb8c8070080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:55600/0 (socket says 172.21.15.39:55600) 2023-11-28T11:57:41.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.428+0000 7fb8beffd700 1 -- 172.21.15.39:0/1469091635 learned_addr learned my addr 172.21.15.39:0/1469091635 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:41.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.428+0000 7fb8c7fff700 1 --2- 172.21.15.39:0/1469091635 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8c8070790 0x7fb8c8167110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:41.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.428+0000 7fb8c6ffd700 1 -- 172.21.15.39:0/1469091635 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1271967456 0 0) 0x7fb8c80adf90 con 0x7fb8c80cdeb0 2023-11-28T11:57:41.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.428+0000 7fb8c6ffd700 1 -- 172.21.15.39:0/1469091635 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8b40035d0 con 0x7fb8c80cdeb0 2023-11-28T11:57:41.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.428+0000 7fb8c6ffd700 1 -- 172.21.15.39:0/1469091635 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 913339012 0 0) 0x7fb8c80ce370 con 0x7fb8c815c1a0 2023-11-28T11:57:41.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.428+0000 7fb8c6ffd700 1 -- 172.21.15.39:0/1469091635 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8c80adf90 con 0x7fb8c815c1a0 2023-11-28T11:57:41.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.428+0000 7fb8c6ffd700 1 -- 172.21.15.39:0/1469091635 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2209686999 0 0) 0x7fb8b40035d0 con 0x7fb8c80cdeb0 2023-11-28T11:57:41.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.428+0000 7fb8c7fff700 1 -- 172.21.15.39:0/1469091635 >> v1:172.21.15.184:6789/0 conn(0x7fb8c815c1a0 legacy=0x7fb8c806c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:41.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.428+0000 7fb8c7fff700 1 -- 172.21.15.39:0/1469091635 >> v1:172.21.15.39:6789/0 conn(0x7fb8c80cdeb0 legacy=0x7fb8c8070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:41.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.428+0000 7fb8c7fff700 1 -- 172.21.15.39:0/1469091635 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c80cc4a0 con 0x7fb8c8070790 2023-11-28T11:57:41.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.432+0000 7fb8c7fff700 1 --2- 172.21.15.39:0/1469091635 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8c8070790 0x7fb8c8167110 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0009dc0 tx=0x7fb8c000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe77e7fd6a639eef server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:41.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.432+0000 7fb8c6ffd700 1 -- 172.21.15.39:0/1469091635 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c000e070 con 0x7fb8c8070790 2023-11-28T11:57:41.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.432+0000 7fb8c6ffd700 1 -- 172.21.15.39:0/1469091635 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c0003a40 con 0x7fb8c8070790 2023-11-28T11:57:41.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.432+0000 7fb8c6ffd700 1 -- 172.21.15.39:0/1469091635 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b0001690 con 0x7fb8c8070790 2023-11-28T11:57:41.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.432+0000 7fb8cce76700 1 -- 172.21.15.39:0/1469091635 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8c8070790 msgr2=0x7fb8c8167110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:41.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.432+0000 7fb8cce76700 1 --2- 172.21.15.39:0/1469091635 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8c8070790 0x7fb8c8167110 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0009dc0 tx=0x7fb8c000b330 comp rx=0 tx=0).stop 2023-11-28T11:57:41.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.432+0000 7fb8cce76700 1 -- 172.21.15.39:0/1469091635 shutdown_connections 2023-11-28T11:57:41.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.432+0000 7fb8cce76700 1 --2- 172.21.15.39:0/1469091635 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8c8070790 0x7fb8c8167110 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:41.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.432+0000 7fb8cce76700 1 -- 172.21.15.39:0/1469091635 >> 172.21.15.39:0/1469091635 conn(0x7fb8c80b0f80 msgr2=0x7fb8c80ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:41.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.432+0000 7fb8cce76700 1 -- 172.21.15.39:0/1469091635 shutdown_connections 2023-11-28T11:57:41.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.432+0000 7fb8cce76700 1 -- 172.21.15.39:0/1469091635 wait complete. 2023-11-28T11:57:41.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.436+0000 7fb8cce76700 1 Processor -- start 2023-11-28T11:57:41.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.436+0000 7fb8cce76700 1 -- start start 2023-11-28T11:57:41.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.436+0000 7fb8cce76700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8c8070790 0x7fb8c8154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:41.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.436+0000 7fb8cce76700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8c80cdeb0 0x7fb8c81606d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:41.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.436+0000 7fb8cce76700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8c815c1a0 0x7fb8c80ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:41.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.436+0000 7fb8cce76700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c8155420 con 0x7fb8c815c1a0 2023-11-28T11:57:41.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.436+0000 7fb8cce76700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c8155600 con 0x7fb8c8070790 2023-11-28T11:57:41.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.436+0000 7fb8cce76700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c81558a0 con 0x7fb8c80cdeb0 2023-11-28T11:57:41.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.436+0000 7fb8c7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8c815c1a0 0x7fb8c80ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:41.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.436+0000 7fb8c7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8c815c1a0 0x7fb8c80ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53758/0 (socket says 172.21.15.39:53758) 2023-11-28T11:57:41.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.436+0000 7fb8c7fff700 1 -- 172.21.15.39:0/1379006481 learned_addr learned my addr 172.21.15.39:0/1379006481 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:41.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.436+0000 7fb8beffd700 1 --2- 172.21.15.39:0/1379006481 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8c80cdeb0 0x7fb8c81606d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:41.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.436+0000 7fb8c77fe700 1 --2- 172.21.15.39:0/1379006481 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8c8070790 0x7fb8c8154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:41.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.436+0000 7fb8c7fff700 1 -- 172.21.15.39:0/1379006481 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8c80cdeb0 msgr2=0x7fb8c81606d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:41.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.436+0000 7fb8c7fff700 1 --2- 172.21.15.39:0/1379006481 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8c80cdeb0 0x7fb8c81606d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:41.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.436+0000 7fb8c7fff700 1 -- 172.21.15.39:0/1379006481 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8c8070790 msgr2=0x7fb8c8154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:41.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.436+0000 7fb8c7fff700 1 --2- 172.21.15.39:0/1379006481 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8c8070790 0x7fb8c8154ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:41.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.436+0000 7fb8c7fff700 1 -- 172.21.15.39:0/1379006481 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c0009a70 con 0x7fb8c815c1a0 2023-11-28T11:57:41.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.440+0000 7fb8c7fff700 1 --2- 172.21.15.39:0/1379006481 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8c815c1a0 0x7fb8c80ac8b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0009d90 tx=0x7fb8c0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:41.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.440+0000 7fb8c4ff9700 1 -- 172.21.15.39:0/1379006481 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c00044c0 con 0x7fb8c815c1a0 2023-11-28T11:57:41.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.440+0000 7fb8c4ff9700 1 -- 172.21.15.39:0/1379006481 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c0004620 con 0x7fb8c815c1a0 2023-11-28T11:57:41.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.440+0000 7fb8c4ff9700 1 -- 172.21.15.39:0/1379006481 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c001d470 con 0x7fb8c815c1a0 2023-11-28T11:57:41.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.440+0000 7fb8cce76700 1 -- 172.21.15.39:0/1379006481 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c815c570 con 0x7fb8c815c1a0 2023-11-28T11:57:41.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.440+0000 7fb8cce76700 1 -- 172.21.15.39:0/1379006481 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c80cc780 con 0x7fb8c815c1a0 2023-11-28T11:57:41.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.440+0000 7fb8cce76700 1 -- 172.21.15.39:0/1379006481 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8c806b020 con 0x7fb8c815c1a0 2023-11-28T11:57:41.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.444+0000 7fb8c4ff9700 1 -- 172.21.15.39:0/1379006481 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb8c0018030 con 0x7fb8c815c1a0 2023-11-28T11:57:41.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.444+0000 7fb8c4ff9700 1 --2- 172.21.15.39:0/1379006481 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb8a8064ee0 0x7fb8a8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:41.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.444+0000 7fb8c4ff9700 1 -- 172.21.15.39:0/1379006481 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb8c0083700 con 0x7fb8c815c1a0 2023-11-28T11:57:41.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.444+0000 7fb8c77fe700 1 --2- 172.21.15.39:0/1379006481 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb8a8064ee0 0x7fb8a8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:41.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.444+0000 7fb8c77fe700 1 --2- 172.21.15.39:0/1379006481 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb8a8064ee0 0x7fb8a8067390 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb8b80011e0 tx=0x7fb8b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:41.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.448+0000 7fb8c4ff9700 1 -- 172.21.15.39:0/1379006481 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb8c0051480 con 0x7fb8c815c1a0 2023-11-28T11:57:41.631 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.624+0000 7fb8cce76700 1 -- 172.21.15.39:0/1379006481 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8c8159440 con 0x7fb8c815c1a0 2023-11-28T11:57:41.633 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.628+0000 7fb8c4ff9700 1 -- 172.21.15.39:0/1379006481 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+19748 (secure 0 0 0) 0x7fb8c0054aa0 con 0x7fb8c815c1a0 2023-11-28T11:57:41.634 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:57:41.634 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":31,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:57:21.927556+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:56:38.203736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:56:38.946498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:56:41.988334+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.10","mappings":[{"from":1,"to":5}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:57:41.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.628+0000 7fb8cce76700 1 -- 172.21.15.39:0/1379006481 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb8a8064ee0 msgr2=0x7fb8a8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:41.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.628+0000 7fb8cce76700 1 --2- 172.21.15.39:0/1379006481 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb8a8064ee0 0x7fb8a8067390 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb8b80011e0 tx=0x7fb8b8009040 comp rx=0 tx=0).stop 2023-11-28T11:57:41.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.628+0000 7fb8cce76700 1 -- 172.21.15.39:0/1379006481 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8c815c1a0 msgr2=0x7fb8c80ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:41.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.628+0000 7fb8cce76700 1 --2- 172.21.15.39:0/1379006481 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8c815c1a0 0x7fb8c80ac8b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0009d90 tx=0x7fb8c0004af0 comp rx=0 tx=0).stop 2023-11-28T11:57:41.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.632+0000 7fb8cce76700 1 -- 172.21.15.39:0/1379006481 shutdown_connections 2023-11-28T11:57:41.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.632+0000 7fb8cce76700 1 --2- 172.21.15.39:0/1379006481 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8c815c1a0 0x7fb8c80ac8b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:41.637 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.632+0000 7fb8cce76700 1 --2- 172.21.15.39:0/1379006481 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8c80cdeb0 0x7fb8c81606d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:41.637 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.632+0000 7fb8cce76700 1 --2- 172.21.15.39:0/1379006481 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb8a8064ee0 0x7fb8a8067390 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:41.637 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.632+0000 7fb8cce76700 1 --2- 172.21.15.39:0/1379006481 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8c8070790 0x7fb8c8154ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:41.637 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.632+0000 7fb8cce76700 1 -- 172.21.15.39:0/1379006481 >> 172.21.15.39:0/1379006481 conn(0x7fb8c80b0f80 msgr2=0x7fb8c80c8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:41.637 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.632+0000 7fb8cce76700 1 -- 172.21.15.39:0/1379006481 shutdown_connections 2023-11-28T11:57:41.637 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.632+0000 7fb8cce76700 1 -- 172.21.15.39:0/1379006481 wait complete. 2023-11-28T11:57:41.660 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:56:26.631457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:56:33.242202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:56:38.203736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:56:38.946498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T11:56:41.988334+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T11:57:41.660 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:57:41.839 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.832+0000 7f5ce2f3e700 1 Processor -- start 2023-11-28T11:57:41.839 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.832+0000 7f5ce2f3e700 1 -- start start 2023-11-28T11:57:41.843 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.836+0000 7f5ce2f3e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5cdc0b22e0 0x7f5cdc06ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:41.843 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.836+0000 7f5ce2f3e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5cdc15a2e0 0x7f5cdc0b26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:41.843 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.836+0000 7f5ce2f3e700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cdc0b2bf0 con 0x7f5cdc0705a0 2023-11-28T11:57:41.843 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.836+0000 7f5ce2f3e700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cdc0cff10 con 0x7f5cdc0b22e0 2023-11-28T11:57:41.843 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.836+0000 7f5ce2f3e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cdc0d01f0 con 0x7f5cdc15a2e0 2023-11-28T11:57:41.844 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.836+0000 7f5ce1f3c700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5cdc0b22e0 0x7f5cdc06ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:41.844 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.836+0000 7f5ce273d700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f5cdc0705a0 0x7f5cdc0b36b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:55608/0 (socket says 172.21.15.39:55608) 2023-11-28T11:57:41.844 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.836+0000 7f5ce273d700 1 -- 172.21.15.39:0/3379568710 learned_addr learned my addr 172.21.15.39:0/3379568710 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:41.844 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.836+0000 7f5ce173b700 1 --2- 172.21.15.39:0/3379568710 >> v2:172.21.15.184:3300/0 conn(0x7f5cdc15a2e0 0x7f5cdc0b26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:41.845 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.840+0000 7f5ce173b700 1 -- 172.21.15.39:0/3379568710 >> v2:172.21.15.39:3300/0 conn(0x7f5cdc0b22e0 msgr2=0x7f5cdc06ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:41.845 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.840+0000 7f5ce173b700 1 --2- 172.21.15.39:0/3379568710 >> v2:172.21.15.39:3300/0 conn(0x7f5cdc0b22e0 0x7f5cdc06ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:41.845 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.840+0000 7f5ce173b700 1 -- 172.21.15.39:0/3379568710 >> v1:172.21.15.39:6789/0 conn(0x7f5cdc0705a0 legacy=0x7f5cdc0b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:41.845 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.840+0000 7f5ce0f3a700 1 -- 172.21.15.39:0/3379568710 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1873484507 0 0) 0x7f5cdc0b2bf0 con 0x7f5cdc0705a0 2023-11-28T11:57:41.845 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.840+0000 7f5ce173b700 1 -- 172.21.15.39:0/3379568710 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cdc0d04d0 con 0x7f5cdc15a2e0 2023-11-28T11:57:41.845 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.840+0000 7f5ce173b700 1 --2- 172.21.15.39:0/3379568710 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5cdc15a2e0 0x7f5cdc0b26b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc071fb0 tx=0x7f5ccc009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15c55a6ac8513bea server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:41.846 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.840+0000 7f5ce0f3a700 1 -- 172.21.15.39:0/3379568710 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc011830 con 0x7f5cdc15a2e0 2023-11-28T11:57:41.846 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.840+0000 7f5ce0f3a700 1 -- 172.21.15.39:0/3379568710 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ccc011990 con 0x7f5cdc15a2e0 2023-11-28T11:57:41.846 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.840+0000 7f5ce0f3a700 1 -- 172.21.15.39:0/3379568710 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc011d20 con 0x7f5cdc15a2e0 2023-11-28T11:57:41.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.840+0000 7f5ce2f3e700 1 -- 172.21.15.39:0/3379568710 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5cdc15a2e0 msgr2=0x7f5cdc0b26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:41.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.840+0000 7f5ce2f3e700 1 --2- 172.21.15.39:0/3379568710 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5cdc15a2e0 0x7f5cdc0b26b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc071fb0 tx=0x7f5ccc009b30 comp rx=0 tx=0).stop 2023-11-28T11:57:41.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.840+0000 7f5ce2f3e700 1 -- 172.21.15.39:0/3379568710 shutdown_connections 2023-11-28T11:57:41.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.840+0000 7f5ce2f3e700 1 --2- 172.21.15.39:0/3379568710 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5cdc15a2e0 0x7f5cdc0b26b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:41.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.840+0000 7f5ce2f3e700 1 --2- 172.21.15.39:0/3379568710 >> v2:172.21.15.39:3300/0 conn(0x7f5cdc0b22e0 0x7f5cdc06ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:41.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.840+0000 7f5ce2f3e700 1 -- 172.21.15.39:0/3379568710 >> 172.21.15.39:0/3379568710 conn(0x7f5cdc0cd2e0 msgr2=0x7f5cdc0cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:41.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.840+0000 7f5ce2f3e700 1 -- 172.21.15.39:0/3379568710 shutdown_connections 2023-11-28T11:57:41.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.840+0000 7f5ce2f3e700 1 -- 172.21.15.39:0/3379568710 wait complete. 2023-11-28T11:57:41.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.844+0000 7f5ce2f3e700 1 Processor -- start 2023-11-28T11:57:41.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.844+0000 7f5ce2f3e700 1 -- start start 2023-11-28T11:57:41.853 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.844+0000 7f5ce2f3e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5cdc0705a0 0x7f5cdc1f0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:41.853 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.844+0000 7f5ce2f3e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5cdc0b22e0 0x7f5cdc0c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:41.853 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.844+0000 7f5ce2f3e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5cdc15a2e0 0x7f5cdc0b09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:41.853 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.844+0000 7f5ce2f3e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc14fa20 con 0x7f5cdc0b22e0 2023-11-28T11:57:41.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.844+0000 7f5ce2f3e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc14b810 con 0x7f5cdc0705a0 2023-11-28T11:57:41.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.844+0000 7f5ce2f3e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc14baf0 con 0x7f5cdc15a2e0 2023-11-28T11:57:41.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.844+0000 7f5ce173b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5cdc0b22e0 0x7f5cdc0c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:41.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.844+0000 7f5ce173b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5cdc0b22e0 0x7f5cdc0c9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53766/0 (socket says 172.21.15.39:53766) 2023-11-28T11:57:41.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.844+0000 7f5ce173b700 1 -- 172.21.15.39:0/1429629220 learned_addr learned my addr 172.21.15.39:0/1429629220 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:41.855 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.848+0000 7f5ce1f3c700 1 --2- 172.21.15.39:0/1429629220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5cdc0705a0 0x7f5cdc1f0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:41.855 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.848+0000 7f5ce273d700 1 --2- 172.21.15.39:0/1429629220 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5cdc15a2e0 0x7f5cdc0b09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:41.855 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.848+0000 7f5ce173b700 1 -- 172.21.15.39:0/1429629220 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5cdc15a2e0 msgr2=0x7f5cdc0b09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:41.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.848+0000 7f5ce173b700 1 --2- 172.21.15.39:0/1429629220 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5cdc15a2e0 0x7f5cdc0b09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:41.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.848+0000 7f5ce173b700 1 -- 172.21.15.39:0/1429629220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5cdc0705a0 msgr2=0x7f5cdc1f0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:41.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.848+0000 7f5ce173b700 1 --2- 172.21.15.39:0/1429629220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5cdc0705a0 0x7f5cdc1f0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:41.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.848+0000 7f5ce173b700 1 -- 172.21.15.39:0/1429629220 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ccc0094b0 con 0x7f5cdc0b22e0 2023-11-28T11:57:41.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.848+0000 7f5ce1f3c700 1 --2- 172.21.15.39:0/1429629220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5cdc0705a0 0x7f5cdc1f0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:57:41.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.848+0000 7f5ce173b700 1 --2- 172.21.15.39:0/1429629220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5cdc0b22e0 0x7f5cdc0c9fd0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc0090b0 tx=0x7f5ccc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:41.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.848+0000 7f5cd27fc700 1 -- 172.21.15.39:0/1429629220 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc01aa00 con 0x7f5cdc0b22e0 2023-11-28T11:57:41.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.848+0000 7f5cd27fc700 1 -- 172.21.15.39:0/1429629220 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ccc01f070 con 0x7f5cdc0b22e0 2023-11-28T11:57:41.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.848+0000 7f5ce2f3e700 1 -- 172.21.15.39:0/1429629220 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cdc070080 con 0x7f5cdc0b22e0 2023-11-28T11:57:41.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.848+0000 7f5cd27fc700 1 -- 172.21.15.39:0/1429629220 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc01ad60 con 0x7f5cdc0b22e0 2023-11-28T11:57:41.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.848+0000 7f5ce2f3e700 1 -- 172.21.15.39:0/1429629220 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cdc06fda0 con 0x7f5cdc0b22e0 2023-11-28T11:57:41.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.848+0000 7f5ce2f3e700 1 -- 172.21.15.39:0/1429629220 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cdc070a00 con 0x7f5cdc0b22e0 2023-11-28T11:57:41.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.852+0000 7f5cd27fc700 1 -- 172.21.15.39:0/1429629220 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5ccc00f050 con 0x7f5cdc0b22e0 2023-11-28T11:57:41.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.852+0000 7f5cd27fc700 1 --2- 172.21.15.39:0/1429629220 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5cc0064ee0 0x7f5cc0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:41.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.852+0000 7f5cd27fc700 1 -- 172.21.15.39:0/1429629220 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5ccc083300 con 0x7f5cdc0b22e0 2023-11-28T11:57:41.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.852+0000 7f5ce1f3c700 1 --2- 172.21.15.39:0/1429629220 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5cc0064ee0 0x7f5cc0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:41.860 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.856+0000 7f5ce1f3c700 1 --2- 172.21.15.39:0/1429629220 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5cc0064ee0 0x7f5cc0067390 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8009c40 tx=0x7f5cd8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:41.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:41.856+0000 7f5cd27fc700 1 -- 172.21.15.39:0/1429629220 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5ccc051170 con 0x7f5cdc0b22e0 2023-11-28T11:57:42.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.032+0000 7f5ce2f3e700 1 -- 172.21.15.39:0/1429629220 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5cdc1494a0 con 0x7f5cdc0b22e0 2023-11-28T11:57:42.040 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.036+0000 7f5cd27fc700 1 -- 172.21.15.39:0/1429629220 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5ccc021020 con 0x7f5cdc0b22e0 2023-11-28T11:57:42.041 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-11-28T11:57:42.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.040+0000 7f5ce2f3e700 1 -- 172.21.15.39:0/1429629220 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5cc0064ee0 msgr2=0x7f5cc0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:42.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.040+0000 7f5ce2f3e700 1 --2- 172.21.15.39:0/1429629220 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5cc0064ee0 0x7f5cc0067390 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8009c40 tx=0x7f5cd8008040 comp rx=0 tx=0).stop 2023-11-28T11:57:42.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.040+0000 7f5ce2f3e700 1 -- 172.21.15.39:0/1429629220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5cdc0b22e0 msgr2=0x7f5cdc0c9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:42.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.040+0000 7f5ce2f3e700 1 --2- 172.21.15.39:0/1429629220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5cdc0b22e0 0x7f5cdc0c9fd0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc0090b0 tx=0x7f5ccc004770 comp rx=0 tx=0).stop 2023-11-28T11:57:42.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.040+0000 7f5ce2f3e700 1 -- 172.21.15.39:0/1429629220 shutdown_connections 2023-11-28T11:57:42.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.040+0000 7f5ce2f3e700 1 --2- 172.21.15.39:0/1429629220 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5cdc15a2e0 0x7f5cdc0b09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:42.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.040+0000 7f5ce2f3e700 1 --2- 172.21.15.39:0/1429629220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5cdc0b22e0 0x7f5cdc0c9fd0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:42.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.040+0000 7f5ce2f3e700 1 --2- 172.21.15.39:0/1429629220 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5cc0064ee0 0x7f5cc0067390 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:42.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.040+0000 7f5ce2f3e700 1 --2- 172.21.15.39:0/1429629220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5cdc0705a0 0x7f5cdc1f0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:42.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.040+0000 7f5ce2f3e700 1 -- 172.21.15.39:0/1429629220 >> 172.21.15.39:0/1429629220 conn(0x7f5cdc0cd2e0 msgr2=0x7f5cdc0af8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:42.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.040+0000 7f5ce2f3e700 1 -- 172.21.15.39:0/1429629220 shutdown_connections 2023-11-28T11:57:42.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.040+0000 7f5ce2f3e700 1 -- 172.21.15.39:0/1429629220 wait complete. 2023-11-28T11:57:42.068 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:57:42.253 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.248+0000 7f1570eb1700 1 Processor -- start 2023-11-28T11:57:42.254 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.248+0000 7f1570eb1700 1 -- start start 2023-11-28T11:57:42.257 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.252+0000 7f1570eb1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f156c15c150 0x7f156c0b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:42.257 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.252+0000 7f1570eb1700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f156c06ff10 0x7f156c070360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:42.257 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.252+0000 7f1570eb1700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f156c15c520 con 0x7f156c15fc30 2023-11-28T11:57:42.257 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.252+0000 7f1570eb1700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f156c0b4240 con 0x7f156c06ff10 2023-11-28T11:57:42.258 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.252+0000 7f1570eb1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f156c0708a0 con 0x7f156c15c150 2023-11-28T11:57:42.258 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.252+0000 7f156b7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f156c15c150 0x7f156c0b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:42.258 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.252+0000 7f156b7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f156c15c150 0x7f156c0b3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:60420/0 (socket says 172.21.15.39:60420) 2023-11-28T11:57:42.258 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.252+0000 7f156affd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f156c06ff10 0x7f156c070360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:42.258 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.252+0000 7f156b7fe700 1 -- 172.21.15.39:0/2040122554 learned_addr learned my addr 172.21.15.39:0/2040122554 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:42.259 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.252+0000 7f156b7fe700 1 -- 172.21.15.39:0/2040122554 >> v2:172.21.15.184:3300/0 conn(0x7f156c06ff10 msgr2=0x7f156c070360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:42.259 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.252+0000 7f156b7fe700 1 --2- 172.21.15.39:0/2040122554 >> v2:172.21.15.184:3300/0 conn(0x7f156c06ff10 0x7f156c070360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:42.259 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.252+0000 7f156b7fe700 1 -- 172.21.15.39:0/2040122554 >> v1:172.21.15.184:6789/0 conn(0x7f156c15fc30 legacy=0x7f156c1600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:42.259 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.252+0000 7f156b7fe700 1 -- 172.21.15.39:0/2040122554 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f156c06ac00 con 0x7f156c15c150 2023-11-28T11:57:42.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.252+0000 7f156b7fe700 1 --2- 172.21.15.39:0/2040122554 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f156c15c150 0x7f156c0b3d00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f155c009910 tx=0x7f155c009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4b275fe6dfb13ca server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:42.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.252+0000 7f156a7fc700 1 -- 172.21.15.39:0/2040122554 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c011830 con 0x7f156c15c150 2023-11-28T11:57:42.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.252+0000 7f156a7fc700 1 -- 172.21.15.39:0/2040122554 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155c011990 con 0x7f156c15c150 2023-11-28T11:57:42.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.256+0000 7f156a7fc700 1 -- 172.21.15.39:0/2040122554 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c011d40 con 0x7f156c15c150 2023-11-28T11:57:42.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.256+0000 7f1570eb1700 1 -- 172.21.15.39:0/2040122554 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f156c15c150 msgr2=0x7f156c0b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:42.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.256+0000 7f1570eb1700 1 --2- 172.21.15.39:0/2040122554 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f156c15c150 0x7f156c0b3d00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f155c009910 tx=0x7f155c009c20 comp rx=0 tx=0).stop 2023-11-28T11:57:42.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.256+0000 7f1570eb1700 1 -- 172.21.15.39:0/2040122554 shutdown_connections 2023-11-28T11:57:42.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.256+0000 7f1570eb1700 1 --2- 172.21.15.39:0/2040122554 >> v2:172.21.15.184:3300/0 conn(0x7f156c06ff10 0x7f156c070360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:42.262 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.256+0000 7f1570eb1700 1 --2- 172.21.15.39:0/2040122554 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f156c15c150 0x7f156c0b3d00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:42.262 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.256+0000 7f1570eb1700 1 -- 172.21.15.39:0/2040122554 >> 172.21.15.39:0/2040122554 conn(0x7f156c0d3680 msgr2=0x7f156c0cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:42.262 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.256+0000 7f1570eb1700 1 -- 172.21.15.39:0/2040122554 shutdown_connections 2023-11-28T11:57:42.262 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.256+0000 7f1570eb1700 1 -- 172.21.15.39:0/2040122554 wait complete. 2023-11-28T11:57:42.263 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.256+0000 7f1570eb1700 1 Processor -- start 2023-11-28T11:57:42.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.256+0000 7f1570eb1700 1 -- start start 2023-11-28T11:57:42.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.260+0000 7f1570eb1700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f156c06ff10 0x7f156c1500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:42.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.260+0000 7f1570eb1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f156c15c150 0x7f156c156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:42.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.260+0000 7f1570eb1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f156c15fc30 0x7f156c14f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:42.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.260+0000 7f1570eb1700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c150840 con 0x7f156c06ff10 2023-11-28T11:57:42.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.260+0000 7f1570eb1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c153550 con 0x7f156c15c150 2023-11-28T11:57:42.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.260+0000 7f1570eb1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f156c15cda0 con 0x7f156c15fc30 2023-11-28T11:57:42.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.260+0000 7f156b7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f156c06ff10 0x7f156c1500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:42.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.260+0000 7f156b7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f156c06ff10 0x7f156c1500b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53768/0 (socket says 172.21.15.39:53768) 2023-11-28T11:57:42.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.260+0000 7f156b7fe700 1 -- 172.21.15.39:0/3051285504 learned_addr learned my addr 172.21.15.39:0/3051285504 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:42.267 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.260+0000 7f156affd700 1 --2- 172.21.15.39:0/3051285504 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f156c15c150 0x7f156c156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:42.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.260+0000 7f156bfff700 1 --2- 172.21.15.39:0/3051285504 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f156c15fc30 0x7f156c14f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:42.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.260+0000 7f156b7fe700 1 -- 172.21.15.39:0/3051285504 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f156c15fc30 msgr2=0x7f156c14f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:42.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.260+0000 7f156b7fe700 1 --2- 172.21.15.39:0/3051285504 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f156c15fc30 0x7f156c14f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:42.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.260+0000 7f156b7fe700 1 -- 172.21.15.39:0/3051285504 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f156c15c150 msgr2=0x7f156c156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:42.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.260+0000 7f156b7fe700 1 --2- 172.21.15.39:0/3051285504 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f156c15c150 0x7f156c156cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:42.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.260+0000 7f156b7fe700 1 -- 172.21.15.39:0/3051285504 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155c009570 con 0x7f156c06ff10 2023-11-28T11:57:42.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.260+0000 7f156b7fe700 1 --2- 172.21.15.39:0/3051285504 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f156c06ff10 0x7f156c1500b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f156c0709e0 tx=0x7f155c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:42.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.260+0000 7f1553fff700 1 -- 172.21.15.39:0/3051285504 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c004510 con 0x7f156c06ff10 2023-11-28T11:57:42.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.260+0000 7f1553fff700 1 -- 172.21.15.39:0/3051285504 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155c0036c0 con 0x7f156c06ff10 2023-11-28T11:57:42.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.260+0000 7f1553fff700 1 -- 172.21.15.39:0/3051285504 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c003a70 con 0x7f156c06ff10 2023-11-28T11:57:42.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.260+0000 7f1570eb1700 1 -- 172.21.15.39:0/3051285504 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f156c0d2450 con 0x7f156c06ff10 2023-11-28T11:57:42.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.260+0000 7f1570eb1700 1 -- 172.21.15.39:0/3051285504 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f156c06cc50 con 0x7f156c06ff10 2023-11-28T11:57:42.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.264+0000 7f1570eb1700 1 -- 172.21.15.39:0/3051285504 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f156c0d2730 con 0x7f156c06ff10 2023-11-28T11:57:42.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.264+0000 7f1553fff700 1 -- 172.21.15.39:0/3051285504 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f155c02d070 con 0x7f156c06ff10 2023-11-28T11:57:42.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.264+0000 7f1553fff700 1 --2- 172.21.15.39:0/3051285504 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1558064f10 0x7f15580673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:42.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.268+0000 7f1553fff700 1 -- 172.21.15.39:0/3051285504 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f155c021030 con 0x7f156c06ff10 2023-11-28T11:57:42.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.268+0000 7f156affd700 1 --2- 172.21.15.39:0/3051285504 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1558064f10 0x7f15580673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:42.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.268+0000 7f156affd700 1 --2- 172.21.15.39:0/3051285504 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1558064f10 0x7f15580673c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f156c0ccb40 tx=0x7f15600091c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:42.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.272+0000 7f1553fff700 1 -- 172.21.15.39:0/3051285504 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f155c051670 con 0x7f156c06ff10 2023-11-28T11:57:42.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.444+0000 7f1570eb1700 1 -- 172.21.15.39:0/3051285504 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f156c073d20 con 0x7f156c06ff10 2023-11-28T11:57:42.452 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.448+0000 7f1553fff700 1 -- 172.21.15.39:0/3051285504 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f155c02b0a0 con 0x7f156c06ff10 2023-11-28T11:57:42.453 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-11-28T11:57:42.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.448+0000 7f1570eb1700 1 -- 172.21.15.39:0/3051285504 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1558064f10 msgr2=0x7f15580673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:42.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.448+0000 7f1570eb1700 1 --2- 172.21.15.39:0/3051285504 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1558064f10 0x7f15580673c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f156c0ccb40 tx=0x7f15600091c0 comp rx=0 tx=0).stop 2023-11-28T11:57:42.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.448+0000 7f1570eb1700 1 -- 172.21.15.39:0/3051285504 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f156c06ff10 msgr2=0x7f156c1500b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:42.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.448+0000 7f1570eb1700 1 --2- 172.21.15.39:0/3051285504 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f156c06ff10 0x7f156c1500b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f156c0709e0 tx=0x7f155c004770 comp rx=0 tx=0).stop 2023-11-28T11:57:42.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.448+0000 7f1570eb1700 1 -- 172.21.15.39:0/3051285504 shutdown_connections 2023-11-28T11:57:42.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.448+0000 7f1570eb1700 1 --2- 172.21.15.39:0/3051285504 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f156c15fc30 0x7f156c14f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:42.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.448+0000 7f1570eb1700 1 --2- 172.21.15.39:0/3051285504 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1558064f10 0x7f15580673c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:42.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.448+0000 7f1570eb1700 1 --2- 172.21.15.39:0/3051285504 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f156c15c150 0x7f156c156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:42.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.448+0000 7f1570eb1700 1 --2- 172.21.15.39:0/3051285504 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f156c06ff10 0x7f156c1500b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:42.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.448+0000 7f1570eb1700 1 -- 172.21.15.39:0/3051285504 >> 172.21.15.39:0/3051285504 conn(0x7f156c0d3680 msgr2=0x7f156c0b5950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:42.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.448+0000 7f1570eb1700 1 -- 172.21.15.39:0/3051285504 shutdown_connections 2023-11-28T11:57:42.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.448+0000 7f1570eb1700 1 -- 172.21.15.39:0/3051285504 wait complete. 2023-11-28T11:57:42.477 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:57:42.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.652+0000 7f62aa64c700 1 Processor -- start 2023-11-28T11:57:42.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.652+0000 7f62aa64c700 1 -- start start 2023-11-28T11:57:42.661 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.656+0000 7f62aa64c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f62a40cdc50 0x7f62a4069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:42.661 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.656+0000 7f62aa64c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62a406ff10 0x7f62a4070390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:42.661 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.656+0000 7f62aa64c700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62a415e560 con 0x7f62a415e190 2023-11-28T11:57:42.661 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.656+0000 7f62aa64c700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62a40708d0 con 0x7f62a40cdc50 2023-11-28T11:57:42.661 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.656+0000 7f62aa64c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a406be80 con 0x7f62a406ff10 2023-11-28T11:57:42.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.656+0000 7f62a9e4b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62a406ff10 0x7f62a4070390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:42.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.656+0000 7f62a8e49700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f62a40cdc50 0x7f62a4069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:42.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.656+0000 7f62a9e4b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62a406ff10 0x7f62a4070390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:60442/0 (socket says 172.21.15.39:60442) 2023-11-28T11:57:42.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.656+0000 7f62a9e4b700 1 -- 172.21.15.39:0/3718623754 learned_addr learned my addr 172.21.15.39:0/3718623754 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:42.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.656+0000 7f62a9e4b700 1 -- 172.21.15.39:0/3718623754 >> v2:172.21.15.184:3300/0 conn(0x7f62a40cdc50 msgr2=0x7f62a4069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:42.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.656+0000 7f62a9e4b700 1 --2- 172.21.15.39:0/3718623754 >> v2:172.21.15.184:3300/0 conn(0x7f62a40cdc50 0x7f62a4069bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:42.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.656+0000 7f62a9e4b700 1 -- 172.21.15.39:0/3718623754 >> v1:172.21.15.184:6789/0 conn(0x7f62a415e190 legacy=0x7f62a4161560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:42.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.656+0000 7f62a9e4b700 1 -- 172.21.15.39:0/3718623754 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a40ce0a0 con 0x7f62a406ff10 2023-11-28T11:57:42.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.656+0000 7f62a9e4b700 1 --2- 172.21.15.39:0/3718623754 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62a406ff10 0x7f62a4070390 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f629c009e50 tx=0x7f629c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1da3a715500610e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:42.664 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.656+0000 7f629bfff700 1 -- 172.21.15.39:0/3718623754 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c00e070 con 0x7f62a406ff10 2023-11-28T11:57:42.664 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.656+0000 7f629bfff700 1 -- 172.21.15.39:0/3718623754 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629c00b910 con 0x7f62a406ff10 2023-11-28T11:57:42.664 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.656+0000 7f629bfff700 1 -- 172.21.15.39:0/3718623754 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c00bcc0 con 0x7f62a406ff10 2023-11-28T11:57:42.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.660+0000 7f62aa64c700 1 -- 172.21.15.39:0/3718623754 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62a406ff10 msgr2=0x7f62a4070390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:42.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.660+0000 7f62aa64c700 1 --2- 172.21.15.39:0/3718623754 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62a406ff10 0x7f62a4070390 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f629c009e50 tx=0x7f629c00b330 comp rx=0 tx=0).stop 2023-11-28T11:57:42.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.660+0000 7f62aa64c700 1 -- 172.21.15.39:0/3718623754 shutdown_connections 2023-11-28T11:57:42.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.660+0000 7f62aa64c700 1 --2- 172.21.15.39:0/3718623754 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62a406ff10 0x7f62a4070390 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:42.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.660+0000 7f62aa64c700 1 --2- 172.21.15.39:0/3718623754 >> v2:172.21.15.184:3300/0 conn(0x7f62a40cdc50 0x7f62a4069bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:42.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.660+0000 7f62aa64c700 1 -- 172.21.15.39:0/3718623754 >> 172.21.15.39:0/3718623754 conn(0x7f62a40cf280 msgr2=0x7f62a40cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:42.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.660+0000 7f62aa64c700 1 -- 172.21.15.39:0/3718623754 shutdown_connections 2023-11-28T11:57:42.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.660+0000 7f62aa64c700 1 -- 172.21.15.39:0/3718623754 wait complete. 2023-11-28T11:57:42.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.664+0000 7f62aa64c700 1 Processor -- start 2023-11-28T11:57:42.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.664+0000 7f62aa64c700 1 -- start start 2023-11-28T11:57:42.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.664+0000 7f62aa64c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62a406ff10 0x7f62a41578a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:42.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.664+0000 7f62aa64c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62a40cdc50 0x7f62a40b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:42.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.664+0000 7f62aa64c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62a415e190 0x7f62a4162400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:42.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.664+0000 7f62aa64c700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a4161f70 con 0x7f62a415e190 2023-11-28T11:57:42.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.664+0000 7f62aa64c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a4161360 con 0x7f62a406ff10 2023-11-28T11:57:42.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.664+0000 7f62aa64c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a4161640 con 0x7f62a40cdc50 2023-11-28T11:57:42.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.664+0000 7f62a9e4b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62a415e190 0x7f62a4162400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:42.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.664+0000 7f62a9e4b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62a415e190 0x7f62a4162400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53774/0 (socket says 172.21.15.39:53774) 2023-11-28T11:57:42.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.664+0000 7f62a9e4b700 1 -- 172.21.15.39:0/1017986123 learned_addr learned my addr 172.21.15.39:0/1017986123 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:42.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.664+0000 7f62a8e49700 1 --2- 172.21.15.39:0/1017986123 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62a40cdc50 0x7f62a40b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:42.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.664+0000 7f62a964a700 1 --2- 172.21.15.39:0/1017986123 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62a406ff10 0x7f62a41578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:42.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.664+0000 7f62a9e4b700 1 -- 172.21.15.39:0/1017986123 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62a40cdc50 msgr2=0x7f62a40b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:42.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.664+0000 7f62a9e4b700 1 --2- 172.21.15.39:0/1017986123 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62a40cdc50 0x7f62a40b1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:42.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.668+0000 7f62a9e4b700 1 -- 172.21.15.39:0/1017986123 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62a406ff10 msgr2=0x7f62a41578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:42.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.668+0000 7f62a9e4b700 1 --2- 172.21.15.39:0/1017986123 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62a406ff10 0x7f62a41578a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:42.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.668+0000 7f62a9e4b700 1 -- 172.21.15.39:0/1017986123 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f629c009b30 con 0x7f62a415e190 2023-11-28T11:57:42.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.668+0000 7f62a964a700 1 --2- 172.21.15.39:0/1017986123 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62a406ff10 0x7f62a41578a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:57:42.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.668+0000 7f62a9e4b700 1 --2- 172.21.15.39:0/1017986123 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62a415e190 0x7f62a4162400 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f62a4070a10 tx=0x7f629c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:42.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.668+0000 7f6299ffb700 1 -- 172.21.15.39:0/1017986123 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c0048b0 con 0x7f62a415e190 2023-11-28T11:57:42.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.668+0000 7f6299ffb700 1 -- 172.21.15.39:0/1017986123 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629c0099b0 con 0x7f62a415e190 2023-11-28T11:57:42.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.668+0000 7f62aa64c700 1 -- 172.21.15.39:0/1017986123 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62a40af990 con 0x7f62a415e190 2023-11-28T11:57:42.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.668+0000 7f6299ffb700 1 -- 172.21.15.39:0/1017986123 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c01c680 con 0x7f62a415e190 2023-11-28T11:57:42.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.668+0000 7f62aa64c700 1 -- 172.21.15.39:0/1017986123 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62a40ce330 con 0x7f62a415e190 2023-11-28T11:57:42.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.668+0000 7f62aa64c700 1 -- 172.21.15.39:0/1017986123 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62a40afc70 con 0x7f62a415e190 2023-11-28T11:57:42.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.672+0000 7f6299ffb700 1 -- 172.21.15.39:0/1017986123 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f629c02c070 con 0x7f62a415e190 2023-11-28T11:57:42.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.672+0000 7f6299ffb700 1 --2- 172.21.15.39:0/1017986123 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6288064f10 0x7f62880673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:42.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.672+0000 7f6299ffb700 1 -- 172.21.15.39:0/1017986123 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f629c083d00 con 0x7f62a415e190 2023-11-28T11:57:42.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.672+0000 7f62a964a700 1 --2- 172.21.15.39:0/1017986123 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6288064f10 0x7f62880673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:42.680 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.672+0000 7f62a964a700 1 --2- 172.21.15.39:0/1017986123 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6288064f10 0x7f62880673c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f62a40c9f30 tx=0x7f62a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:42.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.680+0000 7f6299ffb700 1 -- 172.21.15.39:0/1017986123 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f629c087030 con 0x7f62a415e190 2023-11-28T11:57:42.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.848+0000 7f62aa64c700 1 -- 172.21.15.39:0/1017986123 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f62a4073d20 con 0x7f62a415e190 2023-11-28T11:57:42.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.852+0000 7f6299ffb700 1 -- 172.21.15.39:0/1017986123 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f629c051b70 con 0x7f62a415e190 2023-11-28T11:57:42.857 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-11-28T11:57:42.862 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.856+0000 7f62aa64c700 1 -- 172.21.15.39:0/1017986123 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6288064f10 msgr2=0x7f62880673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:42.862 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.856+0000 7f62aa64c700 1 --2- 172.21.15.39:0/1017986123 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6288064f10 0x7f62880673c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f62a40c9f30 tx=0x7f62a0009040 comp rx=0 tx=0).stop 2023-11-28T11:57:42.862 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.856+0000 7f62aa64c700 1 -- 172.21.15.39:0/1017986123 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62a415e190 msgr2=0x7f62a4162400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:42.862 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.856+0000 7f62aa64c700 1 --2- 172.21.15.39:0/1017986123 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62a415e190 0x7f62a4162400 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f62a4070a10 tx=0x7f629c004af0 comp rx=0 tx=0).stop 2023-11-28T11:57:42.862 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.856+0000 7f62aa64c700 1 -- 172.21.15.39:0/1017986123 shutdown_connections 2023-11-28T11:57:42.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.856+0000 7f62aa64c700 1 --2- 172.21.15.39:0/1017986123 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62a415e190 0x7f62a4162400 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:42.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.856+0000 7f62aa64c700 1 --2- 172.21.15.39:0/1017986123 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62a40cdc50 0x7f62a40b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:42.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.856+0000 7f62aa64c700 1 --2- 172.21.15.39:0/1017986123 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6288064f10 0x7f62880673c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:42.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.856+0000 7f62aa64c700 1 --2- 172.21.15.39:0/1017986123 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62a406ff10 0x7f62a41578a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:42.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.856+0000 7f62aa64c700 1 -- 172.21.15.39:0/1017986123 >> 172.21.15.39:0/1017986123 conn(0x7f62a40cf280 msgr2=0x7f62a415f660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:42.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.856+0000 7f62aa64c700 1 -- 172.21.15.39:0/1017986123 shutdown_connections 2023-11-28T11:57:42.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:42.856+0000 7f62aa64c700 1 -- 172.21.15.39:0/1017986123 wait complete. 2023-11-28T11:57:42.884 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:57:43.067 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.060+0000 7f9eebfff700 1 Processor -- start 2023-11-28T11:57:43.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.060+0000 7f9eebfff700 1 -- start start 2023-11-28T11:57:43.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.064+0000 7f9eebfff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9eec06ff10 0x7f9eec0d0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:43.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.064+0000 7f9eebfff700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eec0b3ea0 con 0x7f9eec06be80 2023-11-28T11:57:43.071 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.064+0000 7f9eebfff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eec0d20a0 con 0x7f9eec15d100 2023-11-28T11:57:43.071 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.064+0000 7f9eebfff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eec0d28a0 con 0x7f9eec06ff10 2023-11-28T11:57:43.071 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.064+0000 7f9eeb7fe700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f9eec06be80 0x7f9eec06c2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:55610/0 (socket says 172.21.15.39:55610) 2023-11-28T11:57:43.071 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.064+0000 7f9eeb7fe700 1 -- 172.21.15.39:0/898926122 learned_addr learned my addr 172.21.15.39:0/898926122 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:43.071 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.064+0000 7f9eeaffd700 1 --2- 172.21.15.39:0/898926122 >> v2:172.21.15.184:3300/0 conn(0x7f9eec06ff10 0x7f9eec0d0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:43.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.064+0000 7f9ee9ffb700 1 -- 172.21.15.39:0/898926122 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 828221223 0 0) 0x7f9eec0d20a0 con 0x7f9eec15d100 2023-11-28T11:57:43.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.064+0000 7f9ee9ffb700 1 -- 172.21.15.39:0/898926122 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ed40035d0 con 0x7f9eec15d100 2023-11-28T11:57:43.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.068+0000 7f9ee9ffb700 1 -- 172.21.15.39:0/898926122 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3548339907 0 0) 0x7f9eec0b3ea0 con 0x7f9eec06be80 2023-11-28T11:57:43.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.068+0000 7f9eeaffd700 1 -- 172.21.15.39:0/898926122 >> v1:172.21.15.184:6789/0 conn(0x7f9eec15d100 legacy=0x7f9eec0702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:43.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.068+0000 7f9eeaffd700 1 -- 172.21.15.39:0/898926122 >> v1:172.21.15.39:6789/0 conn(0x7f9eec06be80 legacy=0x7f9eec06c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:43.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.068+0000 7f9eeaffd700 1 -- 172.21.15.39:0/898926122 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eec0d2320 con 0x7f9eec06ff10 2023-11-28T11:57:43.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.068+0000 7f9eeaffd700 1 --2- 172.21.15.39:0/898926122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9eec06ff10 0x7f9eec0d0540 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9edc009850 tx=0x7f9edc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcabbc356af79d47 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:43.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.068+0000 7f9ee9ffb700 1 -- 172.21.15.39:0/898926122 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc011830 con 0x7f9eec06ff10 2023-11-28T11:57:43.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.068+0000 7f9ee9ffb700 1 -- 172.21.15.39:0/898926122 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9edc011990 con 0x7f9eec06ff10 2023-11-28T11:57:43.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.068+0000 7f9ee9ffb700 1 -- 172.21.15.39:0/898926122 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc011d40 con 0x7f9eec06ff10 2023-11-28T11:57:43.075 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.068+0000 7f9eebfff700 1 -- 172.21.15.39:0/898926122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9eec06ff10 msgr2=0x7f9eec0d0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:43.075 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.068+0000 7f9eebfff700 1 --2- 172.21.15.39:0/898926122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9eec06ff10 0x7f9eec0d0540 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9edc009850 tx=0x7f9edc009b60 comp rx=0 tx=0).stop 2023-11-28T11:57:43.076 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.068+0000 7f9eebfff700 1 -- 172.21.15.39:0/898926122 shutdown_connections 2023-11-28T11:57:43.076 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.068+0000 7f9eebfff700 1 --2- 172.21.15.39:0/898926122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9eec06ff10 0x7f9eec0d0540 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:43.076 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.068+0000 7f9eebfff700 1 -- 172.21.15.39:0/898926122 >> 172.21.15.39:0/898926122 conn(0x7f9eec0d3690 msgr2=0x7f9eec0cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:43.076 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.068+0000 7f9eebfff700 1 -- 172.21.15.39:0/898926122 shutdown_connections 2023-11-28T11:57:43.076 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.068+0000 7f9eebfff700 1 -- 172.21.15.39:0/898926122 wait complete. 2023-11-28T11:57:43.082 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.072+0000 7f9eebfff700 1 Processor -- start 2023-11-28T11:57:43.083 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.076+0000 7f9eebfff700 1 -- start start 2023-11-28T11:57:43.083 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.076+0000 7f9eebfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9eec06be80 0x7f9eec148720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:43.083 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.076+0000 7f9eebfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9eec06ff10 0x7f9eec0c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:43.083 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.076+0000 7f9eebfff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9eec15d100 0x7f9eec0c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:43.083 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.076+0000 7f9eebfff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec1f1e80 con 0x7f9eec06be80 2023-11-28T11:57:43.083 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.076+0000 7f9eebfff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec1f2160 con 0x7f9eec15d100 2023-11-28T11:57:43.083 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.076+0000 7f9eebfff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec1f2440 con 0x7f9eec06ff10 2023-11-28T11:57:43.083 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.076+0000 7f9eeaffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9eec06be80 0x7f9eec148720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:43.083 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.076+0000 7f9eeaffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9eec06be80 0x7f9eec148720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53788/0 (socket says 172.21.15.39:53788) 2023-11-28T11:57:43.084 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.076+0000 7f9eeaffd700 1 -- 172.21.15.39:0/4175181036 learned_addr learned my addr 172.21.15.39:0/4175181036 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:43.084 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.076+0000 7f9eea7fc700 1 --2- 172.21.15.39:0/4175181036 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9eec06ff10 0x7f9eec0c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:43.084 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.076+0000 7f9eeb7fe700 1 --2- 172.21.15.39:0/4175181036 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9eec15d100 0x7f9eec0c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:43.085 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.076+0000 7f9eeaffd700 1 -- 172.21.15.39:0/4175181036 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9eec06ff10 msgr2=0x7f9eec0c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:43.085 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.076+0000 7f9eeaffd700 1 --2- 172.21.15.39:0/4175181036 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9eec06ff10 0x7f9eec0c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:43.085 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.076+0000 7f9eeaffd700 1 -- 172.21.15.39:0/4175181036 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9eec15d100 msgr2=0x7f9eec0c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:43.086 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.076+0000 7f9eeaffd700 1 --2- 172.21.15.39:0/4175181036 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9eec15d100 0x7f9eec0c8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:43.086 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.076+0000 7f9eeaffd700 1 -- 172.21.15.39:0/4175181036 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9edc0094b0 con 0x7f9eec06be80 2023-11-28T11:57:43.086 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.076+0000 7f9eeaffd700 1 --2- 172.21.15.39:0/4175181036 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9eec06be80 0x7f9eec148720 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9eec073200 tx=0x7f9edc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:43.086 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.080+0000 7f9ed37fe700 1 -- 172.21.15.39:0/4175181036 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc01a990 con 0x7f9eec06be80 2023-11-28T11:57:43.086 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.080+0000 7f9ed37fe700 1 -- 172.21.15.39:0/4175181036 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9edc01f070 con 0x7f9eec06be80 2023-11-28T11:57:43.086 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.080+0000 7f9ed37fe700 1 -- 172.21.15.39:0/4175181036 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc01ad50 con 0x7f9eec06be80 2023-11-28T11:57:43.086 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.080+0000 7f9eebfff700 1 -- 172.21.15.39:0/4175181036 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eec0d25c0 con 0x7f9eec06be80 2023-11-28T11:57:43.086 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.080+0000 7f9eebfff700 1 -- 172.21.15.39:0/4175181036 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eec0d0c00 con 0x7f9eec06be80 2023-11-28T11:57:43.087 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.080+0000 7f9eebfff700 1 -- 172.21.15.39:0/4175181036 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eec15d570 con 0x7f9eec06be80 2023-11-28T11:57:43.087 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.080+0000 7f9ed37fe700 1 -- 172.21.15.39:0/4175181036 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9edc00f050 con 0x7f9eec06be80 2023-11-28T11:57:43.089 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.084+0000 7f9ed37fe700 1 --2- 172.21.15.39:0/4175181036 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9ed8064ee0 0x7f9ed8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:43.089 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.084+0000 7f9ed37fe700 1 -- 172.21.15.39:0/4175181036 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9edc0831d0 con 0x7f9eec06be80 2023-11-28T11:57:43.089 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.084+0000 7f9eea7fc700 1 --2- 172.21.15.39:0/4175181036 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9ed8064ee0 0x7f9ed8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:43.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.084+0000 7f9eea7fc700 1 --2- 172.21.15.39:0/4175181036 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9ed8064ee0 0x7f9ed8067390 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9ee00011e0 tx=0x7f9ee0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:43.097 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.092+0000 7f9ed37fe700 1 -- 172.21.15.39:0/4175181036 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9edc051040 con 0x7f9eec06be80 2023-11-28T11:57:43.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.264+0000 7f9eebfff700 1 -- 172.21.15.39:0/4175181036 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9eec073d20 con 0x7f9eec06be80 2023-11-28T11:57:43.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.268+0000 7f9ed37fe700 1 -- 172.21.15.39:0/4175181036 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9edc054660 con 0x7f9eec06be80 2023-11-28T11:57:43.272 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2023-11-28T11:57:43.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.268+0000 7f9eebfff700 1 -- 172.21.15.39:0/4175181036 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9ed8064ee0 msgr2=0x7f9ed8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:43.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.268+0000 7f9eebfff700 1 --2- 172.21.15.39:0/4175181036 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9ed8064ee0 0x7f9ed8067390 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9ee00011e0 tx=0x7f9ee0009040 comp rx=0 tx=0).stop 2023-11-28T11:57:43.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.268+0000 7f9eebfff700 1 -- 172.21.15.39:0/4175181036 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9eec06be80 msgr2=0x7f9eec148720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:43.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.268+0000 7f9eebfff700 1 --2- 172.21.15.39:0/4175181036 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9eec06be80 0x7f9eec148720 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9eec073200 tx=0x7f9edc004770 comp rx=0 tx=0).stop 2023-11-28T11:57:43.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.268+0000 7f9eebfff700 1 -- 172.21.15.39:0/4175181036 shutdown_connections 2023-11-28T11:57:43.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.268+0000 7f9eebfff700 1 --2- 172.21.15.39:0/4175181036 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9ed8064ee0 0x7f9ed8067390 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:43.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.268+0000 7f9eebfff700 1 --2- 172.21.15.39:0/4175181036 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9eec15d100 0x7f9eec0c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:43.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.268+0000 7f9eebfff700 1 --2- 172.21.15.39:0/4175181036 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9eec06ff10 0x7f9eec0c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:43.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.268+0000 7f9eebfff700 1 --2- 172.21.15.39:0/4175181036 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9eec06be80 0x7f9eec148720 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:43.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.268+0000 7f9eebfff700 1 -- 172.21.15.39:0/4175181036 >> 172.21.15.39:0/4175181036 conn(0x7f9eec0d3690 msgr2=0x7f9eec15faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:43.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.268+0000 7f9eebfff700 1 -- 172.21.15.39:0/4175181036 shutdown_connections 2023-11-28T11:57:43.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.268+0000 7f9eebfff700 1 -- 172.21.15.39:0/4175181036 wait complete. 2023-11-28T11:57:43.297 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T11:57:43.488 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.480+0000 7f625f59e700 1 Processor -- start 2023-11-28T11:57:43.488 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.484+0000 7f625f59e700 1 -- start start 2023-11-28T11:57:43.490 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.484+0000 7f625f59e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f626006c3e0 0x7f626015d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:43.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.484+0000 7f625f59e700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62600ce620 con 0x7f6260069bf0 2023-11-28T11:57:43.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.484+0000 7f625f59e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f626006b520 con 0x7f6260071660 2023-11-28T11:57:43.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.484+0000 7f625f59e700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62600cd190 con 0x7f626006c3e0 2023-11-28T11:57:43.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.484+0000 7f625e59c700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f626006c3e0 0x7f626015d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:43.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.484+0000 7f625ed9d700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f6260069bf0 0x7f626006a050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:55620/0 (socket says 172.21.15.39:55620) 2023-11-28T11:57:43.492 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.484+0000 7f625ed9d700 1 -- 172.21.15.39:0/3176851680 learned_addr learned my addr 172.21.15.39:0/3176851680 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:43.492 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.484+0000 7f6257fff700 1 --1- 172.21.15.39:0/3176851680 >> v1:172.21.15.184:6789/0 conn(0x7f6260071660 0x7f626006c7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:35760/0 (socket says 172.21.15.39:35760) 2023-11-28T11:57:43.492 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.488+0000 7f625e59c700 1 -- 172.21.15.39:0/3176851680 >> v1:172.21.15.184:6789/0 conn(0x7f6260071660 legacy=0x7f626006c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:43.492 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.488+0000 7f625e59c700 1 -- 172.21.15.39:0/3176851680 >> v1:172.21.15.39:6789/0 conn(0x7f6260069bf0 legacy=0x7f626006a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:43.492 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.488+0000 7f625e59c700 1 -- 172.21.15.39:0/3176851680 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626015d710 con 0x7f626006c3e0 2023-11-28T11:57:43.492 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.488+0000 7f625dd9b700 1 -- 172.21.15.39:0/3176851680 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2413519066 0 0) 0x7f62600ce620 con 0x7f6260069bf0 2023-11-28T11:57:43.493 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.488+0000 7f625e59c700 1 --2- 172.21.15.39:0/3176851680 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f626006c3e0 0x7f626015d1d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6250009850 tx=0x7f6250009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=490e3ce567485c60 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:43.493 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.488+0000 7f625dd9b700 1 -- 172.21.15.39:0/3176851680 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6250011830 con 0x7f626006c3e0 2023-11-28T11:57:43.493 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.488+0000 7f625dd9b700 1 -- 172.21.15.39:0/3176851680 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6250011990 con 0x7f626006c3e0 2023-11-28T11:57:43.493 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.488+0000 7f625dd9b700 1 -- 172.21.15.39:0/3176851680 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6250011d20 con 0x7f626006c3e0 2023-11-28T11:57:43.494 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.488+0000 7f625f59e700 1 -- 172.21.15.39:0/3176851680 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f626006c3e0 msgr2=0x7f626015d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:43.494 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.488+0000 7f625f59e700 1 --2- 172.21.15.39:0/3176851680 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f626006c3e0 0x7f626015d1d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6250009850 tx=0x7f6250009b60 comp rx=0 tx=0).stop 2023-11-28T11:57:43.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.488+0000 7f625f59e700 1 -- 172.21.15.39:0/3176851680 shutdown_connections 2023-11-28T11:57:43.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.488+0000 7f625f59e700 1 --2- 172.21.15.39:0/3176851680 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f626006c3e0 0x7f626015d1d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:43.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.488+0000 7f625f59e700 1 -- 172.21.15.39:0/3176851680 >> 172.21.15.39:0/3176851680 conn(0x7f62600cef60 msgr2=0x7f62600cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:43.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.488+0000 7f625f59e700 1 -- 172.21.15.39:0/3176851680 shutdown_connections 2023-11-28T11:57:43.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.488+0000 7f625f59e700 1 -- 172.21.15.39:0/3176851680 wait complete. 2023-11-28T11:57:43.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.492+0000 7f625f59e700 1 Processor -- start 2023-11-28T11:57:43.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.492+0000 7f625f59e700 1 -- start start 2023-11-28T11:57:43.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.492+0000 7f625f59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6260069bf0 0x7f6260156d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:43.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.492+0000 7f625f59e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f626006c3e0 0x7f62600b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:43.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.492+0000 7f625f59e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6260071660 0x7f62600cad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:43.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.492+0000 7f625f59e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62600c3da0 con 0x7f6260071660 2023-11-28T11:57:43.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.492+0000 7f625f59e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62600c4080 con 0x7f626006c3e0 2023-11-28T11:57:43.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.492+0000 7f625f59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62600c4360 con 0x7f6260069bf0 2023-11-28T11:57:43.500 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.492+0000 7f625ed9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6260071660 0x7f62600cad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:43.500 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.492+0000 7f625ed9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6260071660 0x7f62600cad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53802/0 (socket says 172.21.15.39:53802) 2023-11-28T11:57:43.500 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.492+0000 7f625ed9d700 1 -- 172.21.15.39:0/1638674588 learned_addr learned my addr 172.21.15.39:0/1638674588 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:43.500 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.492+0000 7f6257fff700 1 --2- 172.21.15.39:0/1638674588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f626006c3e0 0x7f62600b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:43.500 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.492+0000 7f625e59c700 1 --2- 172.21.15.39:0/1638674588 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6260069bf0 0x7f6260156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:43.501 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.496+0000 7f625ed9d700 1 -- 172.21.15.39:0/1638674588 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6260069bf0 msgr2=0x7f6260156d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:43.501 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.496+0000 7f625ed9d700 1 --2- 172.21.15.39:0/1638674588 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6260069bf0 0x7f6260156d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:43.501 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.496+0000 7f625ed9d700 1 -- 172.21.15.39:0/1638674588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f626006c3e0 msgr2=0x7f62600b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:43.501 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.496+0000 7f625ed9d700 1 --2- 172.21.15.39:0/1638674588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f626006c3e0 0x7f62600b3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:43.501 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.496+0000 7f625ed9d700 1 -- 172.21.15.39:0/1638674588 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62500094b0 con 0x7f6260071660 2023-11-28T11:57:43.501 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.496+0000 7f625ed9d700 1 --2- 172.21.15.39:0/1638674588 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6260071660 0x7f62600cad30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f625800cba0 tx=0x7f625800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:43.502 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.496+0000 7f6256ffd700 1 -- 172.21.15.39:0/1638674588 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625800aaa0 con 0x7f6260071660 2023-11-28T11:57:43.502 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.496+0000 7f6256ffd700 1 -- 172.21.15.39:0/1638674588 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625800ac20 con 0x7f6260071660 2023-11-28T11:57:43.502 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.496+0000 7f6256ffd700 1 -- 172.21.15.39:0/1638674588 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62580070d0 con 0x7f6260071660 2023-11-28T11:57:43.502 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.496+0000 7f625f59e700 1 -- 172.21.15.39:0/1638674588 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62600ccbd0 con 0x7f6260071660 2023-11-28T11:57:43.502 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.496+0000 7f625f59e700 1 -- 172.21.15.39:0/1638674588 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6260071af0 con 0x7f6260071660 2023-11-28T11:57:43.503 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.496+0000 7f625f59e700 1 -- 172.21.15.39:0/1638674588 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62600cceb0 con 0x7f6260071660 2023-11-28T11:57:43.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.500+0000 7f6256ffd700 1 -- 172.21.15.39:0/1638674588 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6258010070 con 0x7f6260071660 2023-11-28T11:57:43.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.500+0000 7f6256ffd700 1 --2- 172.21.15.39:0/1638674588 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6240064f10 0x7f62400673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:43.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.500+0000 7f6256ffd700 1 -- 172.21.15.39:0/1638674588 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6258081a50 con 0x7f6260071660 2023-11-28T11:57:43.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.500+0000 7f625e59c700 1 --2- 172.21.15.39:0/1638674588 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6240064f10 0x7f62400673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:43.507 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.500+0000 7f625e59c700 1 --2- 172.21.15.39:0/1638674588 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6240064f10 0x7f62400673c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f62500090b0 tx=0x7f6250008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:43.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.504+0000 7f6256ffd700 1 -- 172.21.15.39:0/1638674588 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f625804f8c0 con 0x7f6260071660 2023-11-28T11:57:43.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.680+0000 7f625f59e700 1 -- 172.21.15.39:0/1638674588 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f62600c6c30 con 0x7f6260071660 2023-11-28T11:57:43.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.680+0000 7f6256ffd700 1 -- 172.21.15.39:0/1638674588 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f62600c6c30 con 0x7f6260071660 2023-11-28T11:57:43.688 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-11-28T11:57:43.692 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.684+0000 7f625f59e700 1 -- 172.21.15.39:0/1638674588 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6240064f10 msgr2=0x7f62400673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:43.692 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.684+0000 7f625f59e700 1 --2- 172.21.15.39:0/1638674588 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6240064f10 0x7f62400673c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f62500090b0 tx=0x7f6250008030 comp rx=0 tx=0).stop 2023-11-28T11:57:43.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.684+0000 7f625f59e700 1 -- 172.21.15.39:0/1638674588 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6260071660 msgr2=0x7f62600cad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:43.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.684+0000 7f625f59e700 1 --2- 172.21.15.39:0/1638674588 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6260071660 0x7f62600cad30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f625800cba0 tx=0x7f625800ceb0 comp rx=0 tx=0).stop 2023-11-28T11:57:43.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.688+0000 7f625f59e700 1 -- 172.21.15.39:0/1638674588 shutdown_connections 2023-11-28T11:57:43.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.688+0000 7f625f59e700 1 --2- 172.21.15.39:0/1638674588 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6260071660 0x7f62600cad30 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:43.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.688+0000 7f625f59e700 1 --2- 172.21.15.39:0/1638674588 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6240064f10 0x7f62400673c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:43.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.688+0000 7f625f59e700 1 --2- 172.21.15.39:0/1638674588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f626006c3e0 0x7f62600b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:43.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.688+0000 7f625f59e700 1 --2- 172.21.15.39:0/1638674588 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6260069bf0 0x7f6260156d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:43.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.688+0000 7f625f59e700 1 -- 172.21.15.39:0/1638674588 >> 172.21.15.39:0/1638674588 conn(0x7f62600cef60 msgr2=0x7f626015d920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:43.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.688+0000 7f625f59e700 1 -- 172.21.15.39:0/1638674588 shutdown_connections 2023-11-28T11:57:43.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.688+0000 7f625f59e700 1 -- 172.21.15.39:0/1638674588 wait complete. 2023-11-28T11:57:43.715 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T11:57:43.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.892+0000 7fb174da1700 1 Processor -- start 2023-11-28T11:57:43.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.892+0000 7fb174da1700 1 -- start start 2023-11-28T11:57:43.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.892+0000 7fb174da1700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb1700b43a0 0x7fb17015e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:43.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.892+0000 7fb174da1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb170070790 0x7fb17006bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:43.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.892+0000 7fb174da1700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb17015a550 con 0x7fb1700b1640 2023-11-28T11:57:43.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.892+0000 7fb174da1700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb17006b0a0 con 0x7fb1700b43a0 2023-11-28T11:57:43.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.892+0000 7fb174da1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1700caac0 con 0x7fb170070790 2023-11-28T11:57:43.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.896+0000 7fb16f7fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb1700b43a0 0x7fb17015e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:43.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.896+0000 7fb16effd700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fb1700b1640 0x7fb170070080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:35776/0 (socket says 172.21.15.39:35776) 2023-11-28T11:57:43.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.896+0000 7fb16effd700 1 -- 172.21.15.39:0/3810625605 learned_addr learned my addr 172.21.15.39:0/3810625605 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:43.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.896+0000 7fb16ffff700 1 --2- 172.21.15.39:0/3810625605 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb170070790 0x7fb17006bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:43.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.896+0000 7fb16e7fc700 1 -- 172.21.15.39:0/3810625605 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4048278935 0 0) 0x7fb164001110 con 0x7fb1700b1640 2023-11-28T11:57:43.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.896+0000 7fb16e7fc700 1 -- 172.21.15.39:0/3810625605 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1580035d0 con 0x7fb1700b1640 2023-11-28T11:57:43.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.896+0000 7fb16ffff700 1 -- 172.21.15.39:0/3810625605 >> v2:172.21.15.39:3300/0 conn(0x7fb1700b43a0 msgr2=0x7fb17015e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:43.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.896+0000 7fb16ffff700 1 --2- 172.21.15.39:0/3810625605 >> v2:172.21.15.39:3300/0 conn(0x7fb1700b43a0 0x7fb17015e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:43.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.896+0000 7fb16ffff700 1 -- 172.21.15.39:0/3810625605 >> v1:172.21.15.184:6789/0 conn(0x7fb1700b1640 legacy=0x7fb170070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:43.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.896+0000 7fb16ffff700 1 -- 172.21.15.39:0/3810625605 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1700cada0 con 0x7fb170070790 2023-11-28T11:57:43.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.896+0000 7fb16f7fe700 1 --2- 172.21.15.39:0/3810625605 >> v2:172.21.15.39:3300/0 conn(0x7fb1700b43a0 0x7fb17015e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:43.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.896+0000 7fb16ffff700 1 --2- 172.21.15.39:0/3810625605 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb170070790 0x7fb17006bfd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb168009d90 tx=0x7fb16800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6873fb0d8b3791e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:43.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.896+0000 7fb16e7fc700 1 -- 172.21.15.39:0/3810625605 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16800e070 con 0x7fb170070790 2023-11-28T11:57:43.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.896+0000 7fb16e7fc700 1 -- 172.21.15.39:0/3810625605 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16800bb20 con 0x7fb170070790 2023-11-28T11:57:43.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.896+0000 7fb16e7fc700 1 -- 172.21.15.39:0/3810625605 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb168012430 con 0x7fb170070790 2023-11-28T11:57:43.904 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.900+0000 7fb174da1700 1 -- 172.21.15.39:0/3810625605 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb170070790 msgr2=0x7fb17006bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:43.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.900+0000 7fb174da1700 1 --2- 172.21.15.39:0/3810625605 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb170070790 0x7fb17006bfd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb168009d90 tx=0x7fb16800b330 comp rx=0 tx=0).stop 2023-11-28T11:57:43.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.900+0000 7fb174da1700 1 -- 172.21.15.39:0/3810625605 shutdown_connections 2023-11-28T11:57:43.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.900+0000 7fb174da1700 1 --2- 172.21.15.39:0/3810625605 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb170070790 0x7fb17006bfd0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:43.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.900+0000 7fb174da1700 1 --2- 172.21.15.39:0/3810625605 >> v2:172.21.15.39:3300/0 conn(0x7fb1700b43a0 0x7fb17015e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:43.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.900+0000 7fb174da1700 1 -- 172.21.15.39:0/3810625605 >> 172.21.15.39:0/3810625605 conn(0x7fb1700b0f80 msgr2=0x7fb1700ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:43.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.900+0000 7fb174da1700 1 -- 172.21.15.39:0/3810625605 shutdown_connections 2023-11-28T11:57:43.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.900+0000 7fb174da1700 1 -- 172.21.15.39:0/3810625605 wait complete. 2023-11-28T11:57:43.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.904+0000 7fb174da1700 1 Processor -- start 2023-11-28T11:57:43.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.904+0000 7fb174da1700 1 -- start start 2023-11-28T11:57:43.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.904+0000 7fb174da1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb170070790 0x7fb1701f1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:43.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.904+0000 7fb174da1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1700b1640 0x7fb17015a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:43.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.904+0000 7fb174da1700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb1700b43a0 0x7fb17014c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:43.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.904+0000 7fb174da1700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17015c0c0 con 0x7fb1700b43a0 2023-11-28T11:57:43.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.904+0000 7fb174da1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb170149890 con 0x7fb170070790 2023-11-28T11:57:43.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.904+0000 7fb174da1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb17014cb30 con 0x7fb1700b1640 2023-11-28T11:57:43.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.904+0000 7fb16ffff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb1700b43a0 0x7fb17014c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:43.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.904+0000 7fb16ffff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb1700b43a0 0x7fb17014c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53830/0 (socket says 172.21.15.39:53830) 2023-11-28T11:57:43.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.904+0000 7fb16ffff700 1 -- 172.21.15.39:0/3691545611 learned_addr learned my addr 172.21.15.39:0/3691545611 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:43.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.904+0000 7fb16f7fe700 1 --2- 172.21.15.39:0/3691545611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb170070790 0x7fb1701f1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:43.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.904+0000 7fb16effd700 1 --2- 172.21.15.39:0/3691545611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1700b1640 0x7fb17015a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:43.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.904+0000 7fb16ffff700 1 -- 172.21.15.39:0/3691545611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1700b1640 msgr2=0x7fb17015a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:43.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.904+0000 7fb16ffff700 1 --2- 172.21.15.39:0/3691545611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1700b1640 0x7fb17015a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:43.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.904+0000 7fb16ffff700 1 -- 172.21.15.39:0/3691545611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb170070790 msgr2=0x7fb1701f1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:43.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.904+0000 7fb16ffff700 1 --2- 172.21.15.39:0/3691545611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb170070790 0x7fb1701f1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:43.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.904+0000 7fb16ffff700 1 -- 172.21.15.39:0/3691545611 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1600094b0 con 0x7fb1700b43a0 2023-11-28T11:57:43.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.904+0000 7fb16ffff700 1 --2- 172.21.15.39:0/3691545611 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb1700b43a0 0x7fb17014c5f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb168014040 tx=0x7fb168004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:43.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.908+0000 7fb157fff700 1 -- 172.21.15.39:0/3691545611 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb168012430 con 0x7fb1700b43a0 2023-11-28T11:57:43.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.908+0000 7fb174da1700 1 -- 172.21.15.39:0/3691545611 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb168009a70 con 0x7fb1700b43a0 2023-11-28T11:57:43.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.908+0000 7fb157fff700 1 -- 172.21.15.39:0/3691545611 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb168020070 con 0x7fb1700b43a0 2023-11-28T11:57:43.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.908+0000 7fb157fff700 1 -- 172.21.15.39:0/3691545611 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb168004280 con 0x7fb1700b43a0 2023-11-28T11:57:43.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.908+0000 7fb174da1700 1 -- 172.21.15.39:0/3691545611 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb17006b5d0 con 0x7fb1700b43a0 2023-11-28T11:57:43.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.908+0000 7fb174da1700 1 -- 172.21.15.39:0/3691545611 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb17006b2f0 con 0x7fb1700b43a0 2023-11-28T11:57:43.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.908+0000 7fb157fff700 1 -- 172.21.15.39:0/3691545611 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb16802e070 con 0x7fb1700b43a0 2023-11-28T11:57:43.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.912+0000 7fb157fff700 1 --2- 172.21.15.39:0/3691545611 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb15c064ee0 0x7fb15c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:43.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.912+0000 7fb157fff700 1 -- 172.21.15.39:0/3691545611 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb168022070 con 0x7fb1700b43a0 2023-11-28T11:57:43.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.912+0000 7fb16f7fe700 1 --2- 172.21.15.39:0/3691545611 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb15c064ee0 0x7fb15c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:43.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.912+0000 7fb16f7fe700 1 --2- 172.21.15.39:0/3691545611 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb15c064ee0 0x7fb15c067390 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb160009c70 tx=0x7fb160008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:43.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:43.916+0000 7fb157fff700 1 -- 172.21.15.39:0/3691545611 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb168051cd0 con 0x7fb1700b43a0 2023-11-28T11:57:44.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.108+0000 7fb174da1700 1 -- 172.21.15.39:0/3691545611 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb17015eb10 con 0x7fb1700b43a0 2023-11-28T11:57:44.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.108+0000 7fb157fff700 1 -- 172.21.15.39:0/3691545611 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb1680552f0 con 0x7fb1700b43a0 2023-11-28T11:57:44.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.112+0000 7fb174da1700 1 -- 172.21.15.39:0/3691545611 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb15c064ee0 msgr2=0x7fb15c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:44.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.112+0000 7fb174da1700 1 --2- 172.21.15.39:0/3691545611 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb15c064ee0 0x7fb15c067390 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb160009c70 tx=0x7fb160008040 comp rx=0 tx=0).stop 2023-11-28T11:57:44.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.112+0000 7fb174da1700 1 -- 172.21.15.39:0/3691545611 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb1700b43a0 msgr2=0x7fb17014c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:44.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.112+0000 7fb174da1700 1 --2- 172.21.15.39:0/3691545611 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb1700b43a0 0x7fb17014c5f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb168014040 tx=0x7fb168004af0 comp rx=0 tx=0).stop 2023-11-28T11:57:44.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.112+0000 7fb174da1700 1 -- 172.21.15.39:0/3691545611 shutdown_connections 2023-11-28T11:57:44.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.112+0000 7fb174da1700 1 --2- 172.21.15.39:0/3691545611 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb1700b43a0 0x7fb17014c5f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:44.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.112+0000 7fb174da1700 1 --2- 172.21.15.39:0/3691545611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1700b1640 0x7fb17015a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:44.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.112+0000 7fb174da1700 1 --2- 172.21.15.39:0/3691545611 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb15c064ee0 0x7fb15c067390 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:44.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.112+0000 7fb174da1700 1 --2- 172.21.15.39:0/3691545611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb170070790 0x7fb1701f1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:44.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.112+0000 7fb174da1700 1 -- 172.21.15.39:0/3691545611 >> 172.21.15.39:0/3691545611 conn(0x7fb1700b0f80 msgr2=0x7fb1700c9040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:44.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.112+0000 7fb174da1700 1 -- 172.21.15.39:0/3691545611 shutdown_connections 2023-11-28T11:57:44.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.112+0000 7fb174da1700 1 -- 172.21.15.39:0/3691545611 wait complete. 2023-11-28T11:57:44.119 INFO:teuthology.orchestra.run.smithi039.stderr:listed 0 entries 2023-11-28T11:57:44.140 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-11-28T11:57:44.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:44.140 DEBUG:teuthology.orchestra.run.smithi184:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-11-28T11:57:44.180 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-11-28T11:57:44.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:57:44.180 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-28T11:57:44.245 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-28T11:57:44.245 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:57:44.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.436+0000 7f6d8b59e700 1 Processor -- start 2023-11-28T11:57:44.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.436+0000 7f6d8b59e700 1 -- start start 2023-11-28T11:57:44.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.436+0000 7f6d8b59e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6d8c06bed0 0x7f6d8c06c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:44.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.436+0000 7f6d8b59e700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d8c0c9d40 con 0x7f6d8c15c650 2023-11-28T11:57:44.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.436+0000 7f6d8b59e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d8c06c830 con 0x7f6d8c0cd0d0 2023-11-28T11:57:44.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.436+0000 7f6d8b59e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d8c06b140 con 0x7f6d8c06bed0 2023-11-28T11:57:44.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.436+0000 7f6d8a59c700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f6d8c15c650 0x7f6d8c06b2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:55624/0 (socket says 172.21.15.39:55624) 2023-11-28T11:57:44.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.436+0000 7f6d8a59c700 1 -- 172.21.15.39:0/3602029225 learned_addr learned my addr 172.21.15.39:0/3602029225 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:44.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.440+0000 7f6d8ad9d700 1 --2- 172.21.15.39:0/3602029225 >> v2:172.21.15.184:3300/0 conn(0x7f6d8c06bed0 0x7f6d8c06c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:44.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.440+0000 7f6d8959a700 1 -- 172.21.15.39:0/3602029225 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1826298136 0 0) 0x7f6d8c0c9d40 con 0x7f6d8c15c650 2023-11-28T11:57:44.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.440+0000 7f6d8959a700 1 -- 172.21.15.39:0/3602029225 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d740035d0 con 0x7f6d8c15c650 2023-11-28T11:57:44.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.440+0000 7f6d8959a700 1 -- 172.21.15.39:0/3602029225 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 668478745 0 0) 0x7f6d8c06c830 con 0x7f6d8c0cd0d0 2023-11-28T11:57:44.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.440+0000 7f6d8ad9d700 1 -- 172.21.15.39:0/3602029225 >> v1:172.21.15.184:6789/0 conn(0x7f6d8c0cd0d0 legacy=0x7f6d8c0b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:44.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.440+0000 7f6d8ad9d700 1 -- 172.21.15.39:0/3602029225 >> v1:172.21.15.39:6789/0 conn(0x7f6d8c15c650 legacy=0x7f6d8c06b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:44.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.440+0000 7f6d8ad9d700 1 -- 172.21.15.39:0/3602029225 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8c0b1d50 con 0x7f6d8c06bed0 2023-11-28T11:57:44.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.440+0000 7f6d8ad9d700 1 --2- 172.21.15.39:0/3602029225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d8c06bed0 0x7f6d8c06c2f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6d84009d90 tx=0x7f6d8400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8bf73d53fa13b72 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:44.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.440+0000 7f6d8959a700 1 -- 172.21.15.39:0/3602029225 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8400e070 con 0x7f6d8c06bed0 2023-11-28T11:57:44.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.440+0000 7f6d8959a700 1 -- 172.21.15.39:0/3602029225 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8400bb20 con 0x7f6d8c06bed0 2023-11-28T11:57:44.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.440+0000 7f6d8959a700 1 -- 172.21.15.39:0/3602029225 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8400bed0 con 0x7f6d8c06bed0 2023-11-28T11:57:44.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.440+0000 7f6d8b59e700 1 -- 172.21.15.39:0/3602029225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d8c06bed0 msgr2=0x7f6d8c06c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:44.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.440+0000 7f6d8b59e700 1 --2- 172.21.15.39:0/3602029225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d8c06bed0 0x7f6d8c06c2f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6d84009d90 tx=0x7f6d8400b330 comp rx=0 tx=0).stop 2023-11-28T11:57:44.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.440+0000 7f6d8b59e700 1 -- 172.21.15.39:0/3602029225 shutdown_connections 2023-11-28T11:57:44.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.440+0000 7f6d8b59e700 1 --2- 172.21.15.39:0/3602029225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d8c06bed0 0x7f6d8c06c2f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:44.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.440+0000 7f6d8b59e700 1 -- 172.21.15.39:0/3602029225 >> 172.21.15.39:0/3602029225 conn(0x7f6d8c0b0f80 msgr2=0x7f6d8c0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:44.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.444+0000 7f6d8b59e700 1 -- 172.21.15.39:0/3602029225 shutdown_connections 2023-11-28T11:57:44.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.444+0000 7f6d8b59e700 1 -- 172.21.15.39:0/3602029225 wait complete. 2023-11-28T11:57:44.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.444+0000 7f6d8b59e700 1 Processor -- start 2023-11-28T11:57:44.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.444+0000 7f6d8b59e700 1 -- start start 2023-11-28T11:57:44.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.448+0000 7f6d8b59e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d8c06bed0 0x7f6d8c150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:44.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.448+0000 7f6d8b59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d8c0cd0d0 0x7f6d8c069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:44.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.448+0000 7f6d8b59e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d8c15c650 0x7f6d8c06a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:44.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.448+0000 7f6d8b59e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8c0b39b0 con 0x7f6d8c15c650 2023-11-28T11:57:44.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.448+0000 7f6d8b59e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8c0b2d30 con 0x7f6d8c06bed0 2023-11-28T11:57:44.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.448+0000 7f6d8b59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8c0b3010 con 0x7f6d8c0cd0d0 2023-11-28T11:57:44.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.448+0000 7f6d8ad9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d8c15c650 0x7f6d8c06a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:44.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.448+0000 7f6d8ad9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d8c15c650 0x7f6d8c06a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53840/0 (socket says 172.21.15.39:53840) 2023-11-28T11:57:44.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.448+0000 7f6d8ad9d700 1 -- 172.21.15.39:0/3293330084 learned_addr learned my addr 172.21.15.39:0/3293330084 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:44.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.448+0000 7f6d8a59c700 1 --2- 172.21.15.39:0/3293330084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d8c06bed0 0x7f6d8c150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:44.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.448+0000 7f6d89d9b700 1 --2- 172.21.15.39:0/3293330084 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d8c0cd0d0 0x7f6d8c069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:44.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.448+0000 7f6d8ad9d700 1 -- 172.21.15.39:0/3293330084 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d8c0cd0d0 msgr2=0x7f6d8c069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:44.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.448+0000 7f6d8ad9d700 1 --2- 172.21.15.39:0/3293330084 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d8c0cd0d0 0x7f6d8c069bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:44.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.448+0000 7f6d8ad9d700 1 -- 172.21.15.39:0/3293330084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d8c06bed0 msgr2=0x7f6d8c150b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:44.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.448+0000 7f6d8ad9d700 1 --2- 172.21.15.39:0/3293330084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d8c06bed0 0x7f6d8c150b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:44.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.448+0000 7f6d8ad9d700 1 -- 172.21.15.39:0/3293330084 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d84009a70 con 0x7f6d8c15c650 2023-11-28T11:57:44.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.448+0000 7f6d8a59c700 1 --2- 172.21.15.39:0/3293330084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d8c06bed0 0x7f6d8c150b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:57:44.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.448+0000 7f6d8ad9d700 1 --2- 172.21.15.39:0/3293330084 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d8c15c650 0x7f6d8c06a130 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6d84014040 tx=0x7f6d84004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:44.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.448+0000 7f6d7affd700 1 -- 172.21.15.39:0/3293330084 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8401b810 con 0x7f6d8c15c650 2023-11-28T11:57:44.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.448+0000 7f6d8b59e700 1 -- 172.21.15.39:0/3293330084 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d8c0cd8b0 con 0x7f6d8c15c650 2023-11-28T11:57:44.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.448+0000 7f6d7affd700 1 -- 172.21.15.39:0/3293330084 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d84020070 con 0x7f6d8c15c650 2023-11-28T11:57:44.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.448+0000 7f6d7affd700 1 -- 172.21.15.39:0/3293330084 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8401bbb0 con 0x7f6d8c15c650 2023-11-28T11:57:44.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.448+0000 7f6d8b59e700 1 -- 172.21.15.39:0/3293330084 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d8c0cd5d0 con 0x7f6d8c15c650 2023-11-28T11:57:44.457 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.452+0000 7f6d8b59e700 1 -- 172.21.15.39:0/3293330084 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d8c0c99d0 con 0x7f6d8c15c650 2023-11-28T11:57:44.458 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.452+0000 7f6d7affd700 1 -- 172.21.15.39:0/3293330084 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6d8401bd10 con 0x7f6d8c15c650 2023-11-28T11:57:44.459 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.452+0000 7f6d7affd700 1 --2- 172.21.15.39:0/3293330084 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6d6c064ee0 0x7f6d6c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:44.459 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.452+0000 7f6d7affd700 1 -- 172.21.15.39:0/3293330084 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6d84022070 con 0x7f6d8c15c650 2023-11-28T11:57:44.460 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.456+0000 7f6d8a59c700 1 --2- 172.21.15.39:0/3293330084 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6d6c064ee0 0x7f6d6c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:44.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.456+0000 7f6d8a59c700 1 --2- 172.21.15.39:0/3293330084 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6d6c064ee0 0x7f6d6c067390 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c0011e0 tx=0x7f6d7c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:44.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.460+0000 7f6d7affd700 1 -- 172.21.15.39:0/3293330084 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6d840526b0 con 0x7f6d8c15c650 2023-11-28T11:57:44.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.672+0000 7f6d8b59e700 1 -- 172.21.15.39:0/3293330084 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d8c0b3af0 con 0x7f6d8c15c650 2023-11-28T11:57:44.679 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.672+0000 7f6d7affd700 1 -- 172.21.15.39:0/3293330084 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4647 (secure 0 0 0) 0x7f6d8c0b3af0 con 0x7f6d8c15c650 2023-11-28T11:57:44.679 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:57:44.679 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4265,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1518942402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":1518942402},{"type":"v1","addr":"172.21.15.184:6837","nonce":1518942402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/1834562481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":1834562481},{"type":"v1","addr":"172.21.15.39:6833","nonce":1834562481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2470756838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2470756838},{"type":"v1","addr":"172.21.15.39:6835","nonce":2470756838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:56:39.894634+0000","modified":"2023-11-28T11:56:59.724929+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6835/516507254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":516507254},{"type":"v1","addr":"172.21.15.184:6835","nonce":516507254}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T11:57:44.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.676+0000 7f6d8b59e700 1 -- 172.21.15.39:0/3293330084 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6d6c064ee0 msgr2=0x7f6d6c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:44.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.676+0000 7f6d8b59e700 1 --2- 172.21.15.39:0/3293330084 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6d6c064ee0 0x7f6d6c067390 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c0011e0 tx=0x7f6d7c009040 comp rx=0 tx=0).stop 2023-11-28T11:57:44.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.676+0000 7f6d8b59e700 1 -- 172.21.15.39:0/3293330084 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d8c15c650 msgr2=0x7f6d8c06a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:44.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.676+0000 7f6d8b59e700 1 --2- 172.21.15.39:0/3293330084 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d8c15c650 0x7f6d8c06a130 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6d84014040 tx=0x7f6d84004af0 comp rx=0 tx=0).stop 2023-11-28T11:57:44.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.676+0000 7f6d8b59e700 1 -- 172.21.15.39:0/3293330084 shutdown_connections 2023-11-28T11:57:44.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.676+0000 7f6d8b59e700 1 --2- 172.21.15.39:0/3293330084 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d8c15c650 0x7f6d8c06a130 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:44.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.676+0000 7f6d8b59e700 1 --2- 172.21.15.39:0/3293330084 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d8c0cd0d0 0x7f6d8c069bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:44.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.676+0000 7f6d8b59e700 1 --2- 172.21.15.39:0/3293330084 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6d6c064ee0 0x7f6d6c067390 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:44.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.676+0000 7f6d8b59e700 1 --2- 172.21.15.39:0/3293330084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d8c06bed0 0x7f6d8c150b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:44.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.676+0000 7f6d8b59e700 1 -- 172.21.15.39:0/3293330084 >> 172.21.15.39:0/3293330084 conn(0x7f6d8c0b0f80 msgr2=0x7f6d8c06c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:44.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.680+0000 7f6d8b59e700 1 -- 172.21.15.39:0/3293330084 shutdown_connections 2023-11-28T11:57:44.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.680+0000 7f6d8b59e700 1 -- 172.21.15.39:0/3293330084 wait complete. 2023-11-28T11:57:44.687 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 9 2023-11-28T11:57:44.707 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:57:44.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.880+0000 7fb863e25700 1 Processor -- start 2023-11-28T11:57:44.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.884+0000 7fb863e25700 1 -- start start 2023-11-28T11:57:44.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.884+0000 7fb863e25700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb85c1534a0 0x7fb85c15d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:44.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.884+0000 7fb863e25700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb85c160920 0x7fb85c0b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:44.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.884+0000 7fb863e25700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb85c15d080 con 0x7fb85c0b6030 2023-11-28T11:57:44.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.884+0000 7fb863e25700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb85c153870 con 0x7fb85c1534a0 2023-11-28T11:57:44.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.884+0000 7fb863e25700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c0b6450 con 0x7fb85c160920 2023-11-28T11:57:44.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.884+0000 7fb8623c2700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fb85c0b6030 0x7fb85c070630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:55634/0 (socket says 172.21.15.39:55634) 2023-11-28T11:57:44.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.884+0000 7fb8623c2700 1 -- 172.21.15.39:0/2238013731 learned_addr learned my addr 172.21.15.39:0/2238013731 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:44.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.888+0000 7fb861bc1700 1 --2- 172.21.15.39:0/2238013731 >> v2:172.21.15.184:3300/0 conn(0x7fb85c1534a0 0x7fb85c15d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:44.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.888+0000 7fb8613c0700 1 --2- 172.21.15.39:0/2238013731 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb85c160920 0x7fb85c0b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:44.893 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.888+0000 7fb860bbf700 1 -- 172.21.15.39:0/2238013731 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4029736197 0 0) 0x7fb85c15d080 con 0x7fb85c0b6030 2023-11-28T11:57:44.893 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.888+0000 7fb860bbf700 1 -- 172.21.15.39:0/2238013731 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8480035d0 con 0x7fb85c0b6030 2023-11-28T11:57:44.893 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.888+0000 7fb8613c0700 1 -- 172.21.15.39:0/2238013731 >> v2:172.21.15.184:3300/0 conn(0x7fb85c1534a0 msgr2=0x7fb85c15d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:44.893 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.888+0000 7fb8613c0700 1 --2- 172.21.15.39:0/2238013731 >> v2:172.21.15.184:3300/0 conn(0x7fb85c1534a0 0x7fb85c15d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:44.893 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.888+0000 7fb8613c0700 1 -- 172.21.15.39:0/2238013731 >> v1:172.21.15.39:6789/0 conn(0x7fb85c0b6030 legacy=0x7fb85c070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:44.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.888+0000 7fb8613c0700 1 -- 172.21.15.39:0/2238013731 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85c0b53c0 con 0x7fb85c160920 2023-11-28T11:57:44.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.888+0000 7fb8613c0700 1 --2- 172.21.15.39:0/2238013731 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb85c160920 0x7fb85c0b5af0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb84c009850 tx=0x7fb84c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82aa8c480b17b663 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:44.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.888+0000 7fb860bbf700 1 -- 172.21.15.39:0/2238013731 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c011830 con 0x7fb85c160920 2023-11-28T11:57:44.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.888+0000 7fb860bbf700 1 -- 172.21.15.39:0/2238013731 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84c011990 con 0x7fb85c160920 2023-11-28T11:57:44.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.888+0000 7fb860bbf700 1 -- 172.21.15.39:0/2238013731 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c011d40 con 0x7fb85c160920 2023-11-28T11:57:44.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.888+0000 7fb863e25700 1 -- 172.21.15.39:0/2238013731 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb85c160920 msgr2=0x7fb85c0b5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:44.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.888+0000 7fb863e25700 1 --2- 172.21.15.39:0/2238013731 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb85c160920 0x7fb85c0b5af0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb84c009850 tx=0x7fb84c009b60 comp rx=0 tx=0).stop 2023-11-28T11:57:44.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.888+0000 7fb863e25700 1 -- 172.21.15.39:0/2238013731 shutdown_connections 2023-11-28T11:57:44.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.888+0000 7fb863e25700 1 --2- 172.21.15.39:0/2238013731 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb85c160920 0x7fb85c0b5af0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:44.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.888+0000 7fb863e25700 1 --2- 172.21.15.39:0/2238013731 >> v2:172.21.15.184:3300/0 conn(0x7fb85c1534a0 0x7fb85c15d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:44.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.888+0000 7fb863e25700 1 -- 172.21.15.39:0/2238013731 >> 172.21.15.39:0/2238013731 conn(0x7fb85c06bfc0 msgr2=0x7fb85c06c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:44.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.888+0000 7fb863e25700 1 -- 172.21.15.39:0/2238013731 shutdown_connections 2023-11-28T11:57:44.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.888+0000 7fb863e25700 1 -- 172.21.15.39:0/2238013731 wait complete. 2023-11-28T11:57:44.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.892+0000 7fb863e25700 1 Processor -- start 2023-11-28T11:57:44.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.892+0000 7fb863e25700 1 -- start start 2023-11-28T11:57:44.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.892+0000 7fb863e25700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb85c0b6030 0x7fb85c14dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:44.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.892+0000 7fb863e25700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb85c1534a0 0x7fb85c15f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:44.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.892+0000 7fb863e25700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb85c160920 0x7fb85c150040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:44.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.892+0000 7fb863e25700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c0d1eb0 con 0x7fb85c160920 2023-11-28T11:57:44.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.892+0000 7fb863e25700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c0d2190 con 0x7fb85c1534a0 2023-11-28T11:57:44.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.892+0000 7fb863e25700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c0d2470 con 0x7fb85c0b6030 2023-11-28T11:57:44.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.892+0000 7fb8623c2700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb85c160920 0x7fb85c150040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:44.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.896+0000 7fb8623c2700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb85c160920 0x7fb85c150040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53846/0 (socket says 172.21.15.39:53846) 2023-11-28T11:57:44.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.896+0000 7fb8623c2700 1 -- 172.21.15.39:0/918477156 learned_addr learned my addr 172.21.15.39:0/918477156 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:44.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.896+0000 7fb861bc1700 1 --2- 172.21.15.39:0/918477156 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb85c0b6030 0x7fb85c14dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:44.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.896+0000 7fb8613c0700 1 --2- 172.21.15.39:0/918477156 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb85c1534a0 0x7fb85c15f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:44.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.896+0000 7fb8623c2700 1 -- 172.21.15.39:0/918477156 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb85c0b6030 msgr2=0x7fb85c14dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:44.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.896+0000 7fb8623c2700 1 --2- 172.21.15.39:0/918477156 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb85c0b6030 0x7fb85c14dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:44.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.896+0000 7fb8623c2700 1 -- 172.21.15.39:0/918477156 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb85c1534a0 msgr2=0x7fb85c15f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:44.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.896+0000 7fb8623c2700 1 --2- 172.21.15.39:0/918477156 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb85c1534a0 0x7fb85c15f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:44.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.896+0000 7fb8623c2700 1 -- 172.21.15.39:0/918477156 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb84c0094b0 con 0x7fb85c160920 2023-11-28T11:57:44.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.896+0000 7fb8623c2700 1 --2- 172.21.15.39:0/918477156 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb85c160920 0x7fb85c150040 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb85400caa0 tx=0x7fb85400cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:44.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.896+0000 7fb8527fc700 1 -- 172.21.15.39:0/918477156 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb854007480 con 0x7fb85c160920 2023-11-28T11:57:44.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.896+0000 7fb8527fc700 1 -- 172.21.15.39:0/918477156 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8540075e0 con 0x7fb85c160920 2023-11-28T11:57:44.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.896+0000 7fb863e25700 1 -- 172.21.15.39:0/918477156 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb85c15ca30 con 0x7fb85c160920 2023-11-28T11:57:44.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.896+0000 7fb8527fc700 1 -- 172.21.15.39:0/918477156 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb854007970 con 0x7fb85c160920 2023-11-28T11:57:44.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.896+0000 7fb863e25700 1 -- 172.21.15.39:0/918477156 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb85c0b56a0 con 0x7fb85c160920 2023-11-28T11:57:44.904 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.896+0000 7fb863e25700 1 -- 172.21.15.39:0/918477156 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb85c15cd10 con 0x7fb85c160920 2023-11-28T11:57:44.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.900+0000 7fb8527fc700 1 -- 172.21.15.39:0/918477156 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb854019030 con 0x7fb85c160920 2023-11-28T11:57:44.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.900+0000 7fb8527fc700 1 --2- 172.21.15.39:0/918477156 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb840064ee0 0x7fb840067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:44.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.900+0000 7fb8527fc700 1 -- 172.21.15.39:0/918477156 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb854081a90 con 0x7fb85c160920 2023-11-28T11:57:44.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.900+0000 7fb861bc1700 1 --2- 172.21.15.39:0/918477156 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb840064ee0 0x7fb840067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:44.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.904+0000 7fb861bc1700 1 --2- 172.21.15.39:0/918477156 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb840064ee0 0x7fb840067390 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb85c0d2d20 tx=0x7fb858009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:44.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:44.908+0000 7fb8527fc700 1 -- 172.21.15.39:0/918477156 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb85404f810 con 0x7fb85c160920 2023-11-28T11:57:45.085 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.080+0000 7fb863e25700 1 -- 172.21.15.39:0/918477156 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb85c0d2990 con 0x7fb85c160920 2023-11-28T11:57:45.086 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.080+0000 7fb8527fc700 1 -- 172.21.15.39:0/918477156 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+19748 (secure 0 0 0) 0x7fb854052e30 con 0x7fb85c160920 2023-11-28T11:57:45.087 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:57:45.087 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":31,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:57:21.927556+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:56:38.203736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:56:38.946498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:56:41.988334+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.10","mappings":[{"from":1,"to":5}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:57:45.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.084+0000 7fb863e25700 1 -- 172.21.15.39:0/918477156 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb840064ee0 msgr2=0x7fb840067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:45.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.084+0000 7fb863e25700 1 --2- 172.21.15.39:0/918477156 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb840064ee0 0x7fb840067390 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb85c0d2d20 tx=0x7fb858009240 comp rx=0 tx=0).stop 2023-11-28T11:57:45.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.084+0000 7fb863e25700 1 -- 172.21.15.39:0/918477156 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb85c160920 msgr2=0x7fb85c150040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:45.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.084+0000 7fb863e25700 1 --2- 172.21.15.39:0/918477156 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb85c160920 0x7fb85c150040 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb85400caa0 tx=0x7fb85400cad0 comp rx=0 tx=0).stop 2023-11-28T11:57:45.092 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.084+0000 7fb863e25700 1 -- 172.21.15.39:0/918477156 shutdown_connections 2023-11-28T11:57:45.092 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.084+0000 7fb863e25700 1 --2- 172.21.15.39:0/918477156 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb85c160920 0x7fb85c150040 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:45.092 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.084+0000 7fb863e25700 1 --2- 172.21.15.39:0/918477156 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb840064ee0 0x7fb840067390 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:45.092 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.084+0000 7fb863e25700 1 --2- 172.21.15.39:0/918477156 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb85c1534a0 0x7fb85c15f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:45.092 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.084+0000 7fb863e25700 1 --2- 172.21.15.39:0/918477156 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb85c0b6030 0x7fb85c14dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:45.092 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.084+0000 7fb863e25700 1 -- 172.21.15.39:0/918477156 >> 172.21.15.39:0/918477156 conn(0x7fb85c06bfc0 msgr2=0x7fb85c1600a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:45.092 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.084+0000 7fb863e25700 1 -- 172.21.15.39:0/918477156 shutdown_connections 2023-11-28T11:57:45.092 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.084+0000 7fb863e25700 1 -- 172.21.15.39:0/918477156 wait complete. 2023-11-28T11:57:45.115 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:56:26.631457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:56:33.242202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:56:38.203736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:56:38.946498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T11:56:41.988334+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T11:57:45.115 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:57:45.297 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.292+0000 7f9a512c8700 1 Processor -- start 2023-11-28T11:57:45.297 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.292+0000 7f9a512c8700 1 -- start start 2023-11-28T11:57:45.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.292+0000 7f9a512c8700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9a4c15c700 0x7f9a4c0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:45.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.292+0000 7f9a512c8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a4c0b1be0 0x7f9a4c070830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:45.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.292+0000 7f9a512c8700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a4c06ac00 con 0x7f9a4c0b2130 2023-11-28T11:57:45.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.292+0000 7f9a512c8700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a4c0cd360 con 0x7f9a4c15c700 2023-11-28T11:57:45.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.292+0000 7f9a512c8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c160190 con 0x7f9a4c0b1be0 2023-11-28T11:57:45.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.292+0000 7f9a4affd700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9a4c15c700 0x7f9a4c0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:45.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.292+0000 7f9a4affd700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9a4c15c700 0x7f9a4c0702f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53858/0 (socket says 172.21.15.39:53858) 2023-11-28T11:57:45.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.292+0000 7f9a4affd700 1 -- 172.21.15.39:0/3248222242 learned_addr learned my addr 172.21.15.39:0/3248222242 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:45.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.292+0000 7f9a4b7fe700 1 --2- 172.21.15.39:0/3248222242 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a4c0b1be0 0x7f9a4c070830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:45.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.292+0000 7f9a4affd700 1 -- 172.21.15.39:0/3248222242 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a4c0b1be0 msgr2=0x7f9a4c070830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:45.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.292+0000 7f9a4affd700 1 --2- 172.21.15.39:0/3248222242 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a4c0b1be0 0x7f9a4c070830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:45.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.292+0000 7f9a4affd700 1 -- 172.21.15.39:0/3248222242 >> v1:172.21.15.184:6789/0 conn(0x7f9a4c0b2130 legacy=0x7f9a4c06c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:45.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.292+0000 7f9a4affd700 1 -- 172.21.15.39:0/3248222242 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a4c160470 con 0x7f9a4c15c700 2023-11-28T11:57:45.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.292+0000 7f9a4affd700 1 --2- 172.21.15.39:0/3248222242 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9a4c15c700 0x7f9a4c0702f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c009910 tx=0x7f9a3c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=704ee01353787b95 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:45.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.296+0000 7f9a49ffb700 1 -- 172.21.15.39:0/3248222242 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c00ba60 con 0x7f9a4c15c700 2023-11-28T11:57:45.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.296+0000 7f9a49ffb700 1 -- 172.21.15.39:0/3248222242 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3c00bbc0 con 0x7f9a4c15c700 2023-11-28T11:57:45.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.296+0000 7f9a49ffb700 1 -- 172.21.15.39:0/3248222242 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c009e60 con 0x7f9a4c15c700 2023-11-28T11:57:45.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.296+0000 7f9a512c8700 1 -- 172.21.15.39:0/3248222242 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9a4c15c700 msgr2=0x7f9a4c0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:45.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.296+0000 7f9a512c8700 1 --2- 172.21.15.39:0/3248222242 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9a4c15c700 0x7f9a4c0702f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c009910 tx=0x7f9a3c009c20 comp rx=0 tx=0).stop 2023-11-28T11:57:45.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.296+0000 7f9a512c8700 1 -- 172.21.15.39:0/3248222242 shutdown_connections 2023-11-28T11:57:45.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.296+0000 7f9a512c8700 1 --2- 172.21.15.39:0/3248222242 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a4c0b1be0 0x7f9a4c070830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:45.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.296+0000 7f9a512c8700 1 --2- 172.21.15.39:0/3248222242 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9a4c15c700 0x7f9a4c0702f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:45.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.296+0000 7f9a512c8700 1 -- 172.21.15.39:0/3248222242 >> 172.21.15.39:0/3248222242 conn(0x7f9a4c0d2d10 msgr2=0x7f9a4c0d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:45.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.296+0000 7f9a512c8700 1 -- 172.21.15.39:0/3248222242 shutdown_connections 2023-11-28T11:57:45.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.296+0000 7f9a512c8700 1 -- 172.21.15.39:0/3248222242 wait complete. 2023-11-28T11:57:45.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.300+0000 7f9a512c8700 1 Processor -- start 2023-11-28T11:57:45.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.300+0000 7f9a512c8700 1 -- start start 2023-11-28T11:57:45.306 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.300+0000 7f9a512c8700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9a4c0b1be0 0x7f9a4c154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:45.306 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.300+0000 7f9a512c8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a4c0b2130 0x7f9a4c0b7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:45.306 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.300+0000 7f9a512c8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a4c15c700 0x7f9a4c1f1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:45.306 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.300+0000 7f9a512c8700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c0b8af0 con 0x7f9a4c0b1be0 2023-11-28T11:57:45.306 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.300+0000 7f9a512c8700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c0b8530 con 0x7f9a4c15c700 2023-11-28T11:57:45.307 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.300+0000 7f9a512c8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c0b8810 con 0x7f9a4c0b2130 2023-11-28T11:57:45.308 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.300+0000 7f9a4affd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9a4c0b1be0 0x7f9a4c154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:45.308 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.300+0000 7f9a4affd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9a4c0b1be0 0x7f9a4c154330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53874/0 (socket says 172.21.15.39:53874) 2023-11-28T11:57:45.308 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.300+0000 7f9a4affd700 1 -- 172.21.15.39:0/1369660862 learned_addr learned my addr 172.21.15.39:0/1369660862 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:45.308 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.300+0000 7f9a4b7fe700 1 --2- 172.21.15.39:0/1369660862 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a4c15c700 0x7f9a4c1f1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:45.308 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.300+0000 7f9a4a7fc700 1 --2- 172.21.15.39:0/1369660862 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a4c0b2130 0x7f9a4c0b7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:45.308 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.300+0000 7f9a4affd700 1 -- 172.21.15.39:0/1369660862 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a4c0b2130 msgr2=0x7f9a4c0b7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:45.308 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.300+0000 7f9a4affd700 1 --2- 172.21.15.39:0/1369660862 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a4c0b2130 0x7f9a4c0b7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:45.309 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.300+0000 7f9a4affd700 1 -- 172.21.15.39:0/1369660862 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a4c15c700 msgr2=0x7f9a4c1f1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:45.309 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.300+0000 7f9a4affd700 1 --2- 172.21.15.39:0/1369660862 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a4c15c700 0x7f9a4c1f1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:45.309 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.300+0000 7f9a4affd700 1 -- 172.21.15.39:0/1369660862 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a3c009570 con 0x7f9a4c0b1be0 2023-11-28T11:57:45.309 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.304+0000 7f9a4affd700 1 --2- 172.21.15.39:0/1369660862 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9a4c0b1be0 0x7f9a4c154330 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c0d3a50 tx=0x7f9a3c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:45.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.304+0000 7f9a337fe700 1 -- 172.21.15.39:0/1369660862 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c004510 con 0x7f9a4c0b1be0 2023-11-28T11:57:45.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.304+0000 7f9a337fe700 1 -- 172.21.15.39:0/1369660862 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3c01f070 con 0x7f9a4c0b1be0 2023-11-28T11:57:45.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.304+0000 7f9a512c8700 1 -- 172.21.15.39:0/1369660862 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a4c160a30 con 0x7f9a4c0b1be0 2023-11-28T11:57:45.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.304+0000 7f9a337fe700 1 -- 172.21.15.39:0/1369660862 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c003900 con 0x7f9a4c0b1be0 2023-11-28T11:57:45.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.304+0000 7f9a512c8700 1 -- 172.21.15.39:0/1369660862 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a4c160750 con 0x7f9a4c0b1be0 2023-11-28T11:57:45.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.304+0000 7f9a512c8700 1 -- 172.21.15.39:0/1369660862 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a4c06b530 con 0x7f9a4c0b1be0 2023-11-28T11:57:45.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.308+0000 7f9a337fe700 1 -- 172.21.15.39:0/1369660862 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9a3c00f050 con 0x7f9a4c0b1be0 2023-11-28T11:57:45.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.308+0000 7f9a337fe700 1 --2- 172.21.15.39:0/1369660862 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9a38064ee0 0x7f9a38067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:45.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.308+0000 7f9a337fe700 1 -- 172.21.15.39:0/1369660862 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9a3c021070 con 0x7f9a4c0b1be0 2023-11-28T11:57:45.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.308+0000 7f9a4a7fc700 1 --2- 172.21.15.39:0/1369660862 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9a38064ee0 0x7f9a38067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:45.316 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.308+0000 7f9a4a7fc700 1 --2- 172.21.15.39:0/1369660862 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9a38064ee0 0x7f9a38067390 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c0cba40 tx=0x7f9a40009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:45.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.316+0000 7f9a337fe700 1 -- 172.21.15.39:0/1369660862 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9a3c051770 con 0x7f9a4c0b1be0 2023-11-28T11:57:45.494 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.488+0000 7f9a512c8700 1 -- 172.21.15.39:0/1369660862 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9a4c0c9dc0 con 0x7f9a4c0b1be0 2023-11-28T11:57:45.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.488+0000 7f9a337fe700 1 -- 172.21.15.39:0/1369660862 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9a3c015020 con 0x7f9a4c0b1be0 2023-11-28T11:57:45.612 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-11-28T11:57:45.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.492+0000 7f9a512c8700 1 -- 172.21.15.39:0/1369660862 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9a38064ee0 msgr2=0x7f9a38067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:45.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.492+0000 7f9a512c8700 1 --2- 172.21.15.39:0/1369660862 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9a38064ee0 0x7f9a38067390 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c0cba40 tx=0x7f9a40009040 comp rx=0 tx=0).stop 2023-11-28T11:57:45.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.492+0000 7f9a512c8700 1 -- 172.21.15.39:0/1369660862 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9a4c0b1be0 msgr2=0x7f9a4c154330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:45.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.492+0000 7f9a512c8700 1 --2- 172.21.15.39:0/1369660862 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9a4c0b1be0 0x7f9a4c154330 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c0d3a50 tx=0x7f9a3c004770 comp rx=0 tx=0).stop 2023-11-28T11:57:45.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.492+0000 7f9a512c8700 1 -- 172.21.15.39:0/1369660862 shutdown_connections 2023-11-28T11:57:45.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.492+0000 7f9a512c8700 1 --2- 172.21.15.39:0/1369660862 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9a38064ee0 0x7f9a38067390 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:45.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.492+0000 7f9a512c8700 1 --2- 172.21.15.39:0/1369660862 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a4c15c700 0x7f9a4c1f1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:45.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.492+0000 7f9a512c8700 1 --2- 172.21.15.39:0/1369660862 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a4c0b2130 0x7f9a4c0b7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:45.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.492+0000 7f9a512c8700 1 --2- 172.21.15.39:0/1369660862 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9a4c0b1be0 0x7f9a4c154330 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:45.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.492+0000 7f9a512c8700 1 -- 172.21.15.39:0/1369660862 >> 172.21.15.39:0/1369660862 conn(0x7f9a4c0d2d10 msgr2=0x7f9a4c0b29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:45.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.492+0000 7f9a512c8700 1 -- 172.21.15.39:0/1369660862 shutdown_connections 2023-11-28T11:57:45.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.492+0000 7f9a512c8700 1 -- 172.21.15.39:0/1369660862 wait complete. 2023-11-28T11:57:45.615 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:57:45.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.792+0000 7f1572fef700 1 Processor -- start 2023-11-28T11:57:45.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.792+0000 7f1572fef700 1 -- start start 2023-11-28T11:57:45.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.796+0000 7f1572fef700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f156c0caf20 0x7f156c0b2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:45.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.796+0000 7f1572fef700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f156c0b2890 0x7f156c159510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:45.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.796+0000 7f1572fef700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f156c0b0190 con 0x7f156c0afdc0 2023-11-28T11:57:45.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.796+0000 7f1572fef700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f156c0b2d10 con 0x7f156c0caf20 2023-11-28T11:57:45.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.796+0000 7f1572fef700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f156c0d0750 con 0x7f156c0b2890 2023-11-28T11:57:45.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.796+0000 7f15717ec700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f156c0caf20 0x7f156c0b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:45.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.796+0000 7f1571fed700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f156c0afdc0 0x7f156c0cff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:35816/0 (socket says 172.21.15.39:35816) 2023-11-28T11:57:45.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.796+0000 7f1571fed700 1 -- 172.21.15.39:0/1567282812 learned_addr learned my addr 172.21.15.39:0/1567282812 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:45.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.796+0000 7f15727ee700 1 --2- 172.21.15.39:0/1567282812 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f156c0b2890 0x7f156c159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:45.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.796+0000 7f15717ec700 1 -- 172.21.15.39:0/1567282812 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f156c0b2890 msgr2=0x7f156c159510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:45.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.796+0000 7f15717ec700 1 --2- 172.21.15.39:0/1567282812 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f156c0b2890 0x7f156c159510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:45.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.800+0000 7f15717ec700 1 -- 172.21.15.39:0/1567282812 >> v1:172.21.15.184:6789/0 conn(0x7f156c0afdc0 legacy=0x7f156c0cff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:45.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.800+0000 7f15717ec700 1 -- 172.21.15.39:0/1567282812 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f156c06f4f0 con 0x7f156c0caf20 2023-11-28T11:57:45.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.800+0000 7f15717ec700 1 --2- 172.21.15.39:0/1567282812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f156c0caf20 0x7f156c0b2350 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f155c009850 tx=0x7f155c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95674d650c7972fd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:45.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.800+0000 7f1570feb700 1 -- 172.21.15.39:0/1567282812 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c011830 con 0x7f156c0caf20 2023-11-28T11:57:45.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.800+0000 7f1570feb700 1 -- 172.21.15.39:0/1567282812 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155c011990 con 0x7f156c0caf20 2023-11-28T11:57:45.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.800+0000 7f1570feb700 1 -- 172.21.15.39:0/1567282812 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c011d40 con 0x7f156c0caf20 2023-11-28T11:57:45.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.800+0000 7f1572fef700 1 -- 172.21.15.39:0/1567282812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f156c0caf20 msgr2=0x7f156c0b2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:45.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.800+0000 7f1572fef700 1 --2- 172.21.15.39:0/1567282812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f156c0caf20 0x7f156c0b2350 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f155c009850 tx=0x7f155c009b60 comp rx=0 tx=0).stop 2023-11-28T11:57:45.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.800+0000 7f1572fef700 1 -- 172.21.15.39:0/1567282812 shutdown_connections 2023-11-28T11:57:45.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.800+0000 7f1572fef700 1 --2- 172.21.15.39:0/1567282812 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f156c0b2890 0x7f156c159510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:45.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.800+0000 7f1572fef700 1 --2- 172.21.15.39:0/1567282812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f156c0caf20 0x7f156c0b2350 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:45.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.800+0000 7f1572fef700 1 -- 172.21.15.39:0/1567282812 >> 172.21.15.39:0/1567282812 conn(0x7f156c06a800 msgr2=0x7f156c0cd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:45.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.800+0000 7f1572fef700 1 -- 172.21.15.39:0/1567282812 shutdown_connections 2023-11-28T11:57:45.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.800+0000 7f1572fef700 1 -- 172.21.15.39:0/1567282812 wait complete. 2023-11-28T11:57:45.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.804+0000 7f1572fef700 1 Processor -- start 2023-11-28T11:57:45.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.804+0000 7f1572fef700 1 -- start start 2023-11-28T11:57:45.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.804+0000 7f1572fef700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f156c0afdc0 0x7f156c1f0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:45.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.804+0000 7f1572fef700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f156c0b2890 0x7f156c14e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:45.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.804+0000 7f1572fef700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f156c0caf20 0x7f156c0ca3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:45.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.804+0000 7f1572fef700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c14f120 con 0x7f156c0afdc0 2023-11-28T11:57:45.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.804+0000 7f1572fef700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c14f400 con 0x7f156c0caf20 2023-11-28T11:57:45.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.804+0000 7f1572fef700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f156c0c9bc0 con 0x7f156c0b2890 2023-11-28T11:57:45.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.804+0000 7f1571fed700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f156c0afdc0 0x7f156c1f0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:45.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.804+0000 7f1571fed700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f156c0afdc0 0x7f156c1f0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53890/0 (socket says 172.21.15.39:53890) 2023-11-28T11:57:45.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.804+0000 7f1571fed700 1 -- 172.21.15.39:0/1333130028 learned_addr learned my addr 172.21.15.39:0/1333130028 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:45.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.804+0000 7f15727ee700 1 --2- 172.21.15.39:0/1333130028 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f156c0caf20 0x7f156c0ca3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:45.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.804+0000 7f15717ec700 1 --2- 172.21.15.39:0/1333130028 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f156c0b2890 0x7f156c14e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:45.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.804+0000 7f1571fed700 1 -- 172.21.15.39:0/1333130028 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f156c0b2890 msgr2=0x7f156c14e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:45.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.804+0000 7f1571fed700 1 --2- 172.21.15.39:0/1333130028 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f156c0b2890 0x7f156c14e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:45.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.804+0000 7f1571fed700 1 -- 172.21.15.39:0/1333130028 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f156c0caf20 msgr2=0x7f156c0ca3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:45.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.804+0000 7f1571fed700 1 --2- 172.21.15.39:0/1333130028 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f156c0caf20 0x7f156c0ca3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:45.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.804+0000 7f1571fed700 1 -- 172.21.15.39:0/1333130028 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155c0094b0 con 0x7f156c0afdc0 2023-11-28T11:57:45.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.808+0000 7f1571fed700 1 --2- 172.21.15.39:0/1333130028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f156c0afdc0 0x7f156c1f0e80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f156800c700 tx=0x7f156800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:45.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.808+0000 7f15627fc700 1 -- 172.21.15.39:0/1333130028 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1568005d90 con 0x7f156c0afdc0 2023-11-28T11:57:45.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.808+0000 7f15627fc700 1 -- 172.21.15.39:0/1333130028 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15680070d0 con 0x7f156c0afdc0 2023-11-28T11:57:45.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.808+0000 7f1572fef700 1 -- 172.21.15.39:0/1333130028 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f156c06e770 con 0x7f156c0afdc0 2023-11-28T11:57:45.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.808+0000 7f15627fc700 1 -- 172.21.15.39:0/1333130028 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1568007440 con 0x7f156c0afdc0 2023-11-28T11:57:45.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.808+0000 7f1572fef700 1 -- 172.21.15.39:0/1333130028 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f156c0b3720 con 0x7f156c0afdc0 2023-11-28T11:57:45.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.808+0000 7f1572fef700 1 -- 172.21.15.39:0/1333130028 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f156c06ea10 con 0x7f156c0afdc0 2023-11-28T11:57:45.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.812+0000 7f15627fc700 1 -- 172.21.15.39:0/1333130028 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1568019030 con 0x7f156c0afdc0 2023-11-28T11:57:45.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.812+0000 7f15627fc700 1 --2- 172.21.15.39:0/1333130028 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1550064ee0 0x7f1550067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:45.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.812+0000 7f15627fc700 1 -- 172.21.15.39:0/1333130028 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f15680812d0 con 0x7f156c0afdc0 2023-11-28T11:57:45.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.812+0000 7f15717ec700 1 --2- 172.21.15.39:0/1333130028 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1550064ee0 0x7f1550067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:45.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.812+0000 7f15717ec700 1 --2- 172.21.15.39:0/1333130028 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1550064ee0 0x7f1550067390 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f155c0090b0 tx=0x7f155c01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:45.824 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.820+0000 7f15627fc700 1 -- 172.21.15.39:0/1333130028 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f156804a400 con 0x7f156c0afdc0 2023-11-28T11:57:45.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.992+0000 7f1572fef700 1 -- 172.21.15.39:0/1333130028 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f156c0b0190 con 0x7f156c0afdc0 2023-11-28T11:57:45.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.992+0000 7f15627fc700 1 -- 172.21.15.39:0/1333130028 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f156c0b0190 con 0x7f156c0afdc0 2023-11-28T11:57:45.998 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-11-28T11:57:46.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.996+0000 7f1572fef700 1 -- 172.21.15.39:0/1333130028 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1550064ee0 msgr2=0x7f1550067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:46.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.996+0000 7f1572fef700 1 --2- 172.21.15.39:0/1333130028 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1550064ee0 0x7f1550067390 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f155c0090b0 tx=0x7f155c01c040 comp rx=0 tx=0).stop 2023-11-28T11:57:46.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.996+0000 7f1572fef700 1 -- 172.21.15.39:0/1333130028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f156c0afdc0 msgr2=0x7f156c1f0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:46.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.996+0000 7f1572fef700 1 --2- 172.21.15.39:0/1333130028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f156c0afdc0 0x7f156c1f0e80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f156800c700 tx=0x7f156800ca10 comp rx=0 tx=0).stop 2023-11-28T11:57:46.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.996+0000 7f1572fef700 1 -- 172.21.15.39:0/1333130028 shutdown_connections 2023-11-28T11:57:46.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.996+0000 7f1572fef700 1 --2- 172.21.15.39:0/1333130028 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1550064ee0 0x7f1550067390 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:46.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.996+0000 7f1572fef700 1 --2- 172.21.15.39:0/1333130028 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f156c0caf20 0x7f156c0ca3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:46.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.996+0000 7f1572fef700 1 --2- 172.21.15.39:0/1333130028 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f156c0b2890 0x7f156c14e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:46.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.996+0000 7f1572fef700 1 --2- 172.21.15.39:0/1333130028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f156c0afdc0 0x7f156c1f0e80 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:46.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.996+0000 7f1572fef700 1 -- 172.21.15.39:0/1333130028 >> 172.21.15.39:0/1333130028 conn(0x7f156c06a800 msgr2=0x7f156c0b4940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:46.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.996+0000 7f1572fef700 1 -- 172.21.15.39:0/1333130028 shutdown_connections 2023-11-28T11:57:46.003 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:45.996+0000 7f1572fef700 1 -- 172.21.15.39:0/1333130028 wait complete. 2023-11-28T11:57:46.025 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:57:46.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.208+0000 7f87b58dd700 1 Processor -- start 2023-11-28T11:57:46.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.208+0000 7f87b58dd700 1 -- start start 2023-11-28T11:57:46.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.212+0000 7f87b58dd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87b0070620 0x7f87b00b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:46.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.212+0000 7f87b58dd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f87b0069bf0 0x7f87b006a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:46.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.212+0000 7f87b58dd700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87b015c520 con 0x7f87b015c150 2023-11-28T11:57:46.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.212+0000 7f87b58dd700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87b00b4240 con 0x7f87b0069bf0 2023-11-28T11:57:46.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.212+0000 7f87b58dd700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87b006cc50 con 0x7f87b0070620 2023-11-28T11:57:46.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.212+0000 7f87affff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87b0070620 0x7f87b00b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:46.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.212+0000 7f87b50dc700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f87b0069bf0 0x7f87b006a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:46.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.212+0000 7f87b48db700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f87b015c150 0x7f87b006ff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:35820/0 (socket says 172.21.15.39:35820) 2023-11-28T11:57:46.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.212+0000 7f87affff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87b0070620 0x7f87b00b3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:60560/0 (socket says 172.21.15.39:60560) 2023-11-28T11:57:46.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.212+0000 7f87b48db700 1 -- 172.21.15.39:0/2841691972 learned_addr learned my addr 172.21.15.39:0/2841691972 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:46.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.212+0000 7f87af7fe700 1 -- 172.21.15.39:0/2841691972 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3620558573 0 0) 0x7f87b015c520 con 0x7f87b015c150 2023-11-28T11:57:46.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.212+0000 7f87af7fe700 1 -- 172.21.15.39:0/2841691972 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87a00035d0 con 0x7f87b015c150 2023-11-28T11:57:46.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.212+0000 7f87b50dc700 1 -- 172.21.15.39:0/2841691972 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87b0070620 msgr2=0x7f87b00b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:46.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.212+0000 7f87b50dc700 1 --2- 172.21.15.39:0/2841691972 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87b0070620 0x7f87b00b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:46.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.212+0000 7f87b50dc700 1 -- 172.21.15.39:0/2841691972 >> v1:172.21.15.184:6789/0 conn(0x7f87b015c150 legacy=0x7f87b006ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:46.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.212+0000 7f87b50dc700 1 -- 172.21.15.39:0/2841691972 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b00d2450 con 0x7f87b0069bf0 2023-11-28T11:57:46.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.212+0000 7f87affff700 1 --2- 172.21.15.39:0/2841691972 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87b0070620 0x7f87b00b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:46.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.212+0000 7f87b50dc700 1 --2- 172.21.15.39:0/2841691972 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87b0069bf0 0x7f87b006a050 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f87a8009d90 tx=0x7f87a800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5d4671b202c5cb0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:46.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.216+0000 7f87af7fe700 1 -- 172.21.15.39:0/2841691972 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a800e070 con 0x7f87b0069bf0 2023-11-28T11:57:46.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.216+0000 7f87af7fe700 1 -- 172.21.15.39:0/2841691972 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a800bb20 con 0x7f87b0069bf0 2023-11-28T11:57:46.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.216+0000 7f87af7fe700 1 -- 172.21.15.39:0/2841691972 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a8012430 con 0x7f87b0069bf0 2023-11-28T11:57:46.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.216+0000 7f87b58dd700 1 -- 172.21.15.39:0/2841691972 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87b0069bf0 msgr2=0x7f87b006a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:46.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.216+0000 7f87b58dd700 1 --2- 172.21.15.39:0/2841691972 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87b0069bf0 0x7f87b006a050 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f87a8009d90 tx=0x7f87a800b330 comp rx=0 tx=0).stop 2023-11-28T11:57:46.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.216+0000 7f87b58dd700 1 -- 172.21.15.39:0/2841691972 shutdown_connections 2023-11-28T11:57:46.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.216+0000 7f87b58dd700 1 --2- 172.21.15.39:0/2841691972 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87b0069bf0 0x7f87b006a050 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:46.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.216+0000 7f87b58dd700 1 --2- 172.21.15.39:0/2841691972 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87b0070620 0x7f87b00b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:46.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.216+0000 7f87b58dd700 1 -- 172.21.15.39:0/2841691972 >> 172.21.15.39:0/2841691972 conn(0x7f87b00d3680 msgr2=0x7f87b00cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:46.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.216+0000 7f87b58dd700 1 -- 172.21.15.39:0/2841691972 shutdown_connections 2023-11-28T11:57:46.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.216+0000 7f87b58dd700 1 -- 172.21.15.39:0/2841691972 wait complete. 2023-11-28T11:57:46.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.220+0000 7f87b58dd700 1 Processor -- start 2023-11-28T11:57:46.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.220+0000 7f87b58dd700 1 -- start start 2023-11-28T11:57:46.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.220+0000 7f87b58dd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87b0069bf0 0x7f87b0158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:46.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.220+0000 7f87b58dd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f87b0070620 0x7f87b015a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:46.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.220+0000 7f87b58dd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87b015c150 0x7f87b015a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:46.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.220+0000 7f87b58dd700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b0158680 con 0x7f87b0070620 2023-11-28T11:57:46.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.220+0000 7f87b58dd700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b0158960 con 0x7f87b015c150 2023-11-28T11:57:46.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.220+0000 7f87b58dd700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87b0158c40 con 0x7f87b0069bf0 2023-11-28T11:57:46.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.220+0000 7f87affff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f87b0070620 0x7f87b015a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:46.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.220+0000 7f87affff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f87b0070620 0x7f87b015a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53894/0 (socket says 172.21.15.39:53894) 2023-11-28T11:57:46.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.220+0000 7f87affff700 1 -- 172.21.15.39:0/1606359662 learned_addr learned my addr 172.21.15.39:0/1606359662 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:46.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.220+0000 7f87b50dc700 1 --2- 172.21.15.39:0/1606359662 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87b015c150 0x7f87b015a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:46.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.220+0000 7f87b48db700 1 --2- 172.21.15.39:0/1606359662 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87b0069bf0 0x7f87b0158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:46.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.224+0000 7f87affff700 1 -- 172.21.15.39:0/1606359662 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87b0069bf0 msgr2=0x7f87b0158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:46.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.224+0000 7f87affff700 1 --2- 172.21.15.39:0/1606359662 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87b0069bf0 0x7f87b0158080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:46.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.224+0000 7f87affff700 1 -- 172.21.15.39:0/1606359662 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87b015c150 msgr2=0x7f87b015a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:46.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.224+0000 7f87affff700 1 --2- 172.21.15.39:0/1606359662 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87b015c150 0x7f87b015a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:46.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.224+0000 7f87affff700 1 -- 172.21.15.39:0/1606359662 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f879c009450 con 0x7f87b0070620 2023-11-28T11:57:46.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.224+0000 7f87affff700 1 --2- 172.21.15.39:0/1606359662 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f87b0070620 0x7f87b015a0f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f879c00ebe0 tx=0x7f879c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:46.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.224+0000 7f87ad7fa700 1 -- 172.21.15.39:0/1606359662 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c0097a0 con 0x7f87b0070620 2023-11-28T11:57:46.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.224+0000 7f87ad7fa700 1 -- 172.21.15.39:0/1606359662 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879c005a40 con 0x7f87b0070620 2023-11-28T11:57:46.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.224+0000 7f87ad7fa700 1 -- 172.21.15.39:0/1606359662 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c005dd0 con 0x7f87b0070620 2023-11-28T11:57:46.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.224+0000 7f87b58dd700 1 -- 172.21.15.39:0/1606359662 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87a8009a70 con 0x7f87b0070620 2023-11-28T11:57:46.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.224+0000 7f87b58dd700 1 -- 172.21.15.39:0/1606359662 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87b00d05e0 con 0x7f87b0070620 2023-11-28T11:57:46.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.224+0000 7f87b58dd700 1 -- 172.21.15.39:0/1606359662 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87b00d2730 con 0x7f87b0070620 2023-11-28T11:57:46.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.228+0000 7f87ad7fa700 1 -- 172.21.15.39:0/1606359662 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f879c022070 con 0x7f87b0070620 2023-11-28T11:57:46.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.228+0000 7f87ad7fa700 1 --2- 172.21.15.39:0/1606359662 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8794064ee0 0x7f8794067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:46.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.228+0000 7f87ad7fa700 1 -- 172.21.15.39:0/1606359662 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f879c0822b0 con 0x7f87b0070620 2023-11-28T11:57:46.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.228+0000 7f87b48db700 1 --2- 172.21.15.39:0/1606359662 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8794064ee0 0x7f8794067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:46.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.232+0000 7f87b48db700 1 --2- 172.21.15.39:0/1606359662 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8794064ee0 0x7f8794067390 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f87a4007fd0 tx=0x7f87a4007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:46.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.236+0000 7f87ad7fa700 1 -- 172.21.15.39:0/1606359662 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f879c050120 con 0x7f87b0070620 2023-11-28T11:57:46.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.404+0000 7f87b58dd700 1 -- 172.21.15.39:0/1606359662 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f87b00d2140 con 0x7f87b0070620 2023-11-28T11:57:46.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.408+0000 7f87ad7fa700 1 -- 172.21.15.39:0/1606359662 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f879c053740 con 0x7f87b0070620 2023-11-28T11:57:46.414 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-11-28T11:57:46.415 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.408+0000 7f87b58dd700 1 -- 172.21.15.39:0/1606359662 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8794064ee0 msgr2=0x7f8794067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:46.415 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.408+0000 7f87b58dd700 1 --2- 172.21.15.39:0/1606359662 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8794064ee0 0x7f8794067390 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f87a4007fd0 tx=0x7f87a4007de0 comp rx=0 tx=0).stop 2023-11-28T11:57:46.415 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.408+0000 7f87b58dd700 1 -- 172.21.15.39:0/1606359662 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f87b0070620 msgr2=0x7f87b015a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:46.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.408+0000 7f87b58dd700 1 --2- 172.21.15.39:0/1606359662 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f87b0070620 0x7f87b015a0f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f879c00ebe0 tx=0x7f879c00eef0 comp rx=0 tx=0).stop 2023-11-28T11:57:46.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.408+0000 7f87b58dd700 1 -- 172.21.15.39:0/1606359662 shutdown_connections 2023-11-28T11:57:46.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.408+0000 7f87b58dd700 1 --2- 172.21.15.39:0/1606359662 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8794064ee0 0x7f8794067390 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:46.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.408+0000 7f87b58dd700 1 --2- 172.21.15.39:0/1606359662 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87b015c150 0x7f87b015a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:46.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.408+0000 7f87b58dd700 1 --2- 172.21.15.39:0/1606359662 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f87b0070620 0x7f87b015a0f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:46.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.408+0000 7f87b58dd700 1 --2- 172.21.15.39:0/1606359662 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87b0069bf0 0x7f87b0158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:46.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.408+0000 7f87b58dd700 1 -- 172.21.15.39:0/1606359662 >> 172.21.15.39:0/1606359662 conn(0x7f87b00d3680 msgr2=0x7f87b0156f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:46.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.408+0000 7f87b58dd700 1 -- 172.21.15.39:0/1606359662 shutdown_connections 2023-11-28T11:57:46.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.408+0000 7f87b58dd700 1 -- 172.21.15.39:0/1606359662 wait complete. 2023-11-28T11:57:46.436 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:57:46.624 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.616+0000 7f32fd5a7700 1 Processor -- start 2023-11-28T11:57:46.624 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.620+0000 7f32fd5a7700 1 -- start start 2023-11-28T11:57:46.627 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.620+0000 7f32fd5a7700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f32f815a420 0x7f32f80ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:46.627 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.620+0000 7f32fd5a7700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32f80cb6f0 con 0x7f32f806e500 2023-11-28T11:57:46.628 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.620+0000 7f32fd5a7700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32f80b4030 con 0x7f32f80d15e0 2023-11-28T11:57:46.628 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.620+0000 7f32fd5a7700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32f815a7f0 con 0x7f32f815a420 2023-11-28T11:57:46.628 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.624+0000 7f32f67fc700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f32f80d15e0 0x7f32f80b3920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:35836/0 (socket says 172.21.15.39:35836) 2023-11-28T11:57:46.628 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.624+0000 7f32f67fc700 1 -- 172.21.15.39:0/3070208996 learned_addr learned my addr 172.21.15.39:0/3070208996 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:46.628 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.624+0000 7f32f6ffd700 1 --2- 172.21.15.39:0/3070208996 >> v2:172.21.15.39:3300/0 conn(0x7f32f815a420 0x7f32f80ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:46.629 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.624+0000 7f32f5ffb700 1 -- 172.21.15.39:0/3070208996 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1304189985 0 0) 0x7f32f80b4030 con 0x7f32f80d15e0 2023-11-28T11:57:46.629 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.624+0000 7f32f5ffb700 1 -- 172.21.15.39:0/3070208996 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32e00035d0 con 0x7f32f80d15e0 2023-11-28T11:57:46.629 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.624+0000 7f32f6ffd700 1 -- 172.21.15.39:0/3070208996 >> v1:172.21.15.184:6789/0 conn(0x7f32f80d15e0 legacy=0x7f32f80b3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:46.630 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.624+0000 7f32f6ffd700 1 -- 172.21.15.39:0/3070208996 >> v1:172.21.15.39:6789/0 conn(0x7f32f806e500 legacy=0x7f32f806e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:46.630 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.624+0000 7f32f5ffb700 1 -- 172.21.15.39:0/3070208996 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 227879315 0 0) 0x7f32f80cb6f0 con 0x7f32f806e500 2023-11-28T11:57:46.630 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.624+0000 7f32f6ffd700 1 -- 172.21.15.39:0/3070208996 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f80cb130 con 0x7f32f815a420 2023-11-28T11:57:46.630 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.624+0000 7f32f6ffd700 1 --2- 172.21.15.39:0/3070208996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32f815a420 0x7f32f80ccbf0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f32e8009850 tx=0x7f32e8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81c8827f1ec1d89 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:46.631 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.624+0000 7f32f5ffb700 1 -- 172.21.15.39:0/3070208996 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e8011830 con 0x7f32f815a420 2023-11-28T11:57:46.631 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.624+0000 7f32f5ffb700 1 -- 172.21.15.39:0/3070208996 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e8011990 con 0x7f32f815a420 2023-11-28T11:57:46.631 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.624+0000 7f32f5ffb700 1 -- 172.21.15.39:0/3070208996 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e8011d40 con 0x7f32f815a420 2023-11-28T11:57:46.631 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.624+0000 7f32fd5a7700 1 -- 172.21.15.39:0/3070208996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32f815a420 msgr2=0x7f32f80ccbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:46.631 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.624+0000 7f32fd5a7700 1 --2- 172.21.15.39:0/3070208996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32f815a420 0x7f32f80ccbf0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f32e8009850 tx=0x7f32e8009b60 comp rx=0 tx=0).stop 2023-11-28T11:57:46.632 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.624+0000 7f32fd5a7700 1 -- 172.21.15.39:0/3070208996 shutdown_connections 2023-11-28T11:57:46.632 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.624+0000 7f32fd5a7700 1 --2- 172.21.15.39:0/3070208996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32f815a420 0x7f32f80ccbf0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:46.632 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.624+0000 7f32fd5a7700 1 -- 172.21.15.39:0/3070208996 >> 172.21.15.39:0/3070208996 conn(0x7f32f80d0ad0 msgr2=0x7f32f80d0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:46.632 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.628+0000 7f32fd5a7700 1 -- 172.21.15.39:0/3070208996 shutdown_connections 2023-11-28T11:57:46.632 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.628+0000 7f32fd5a7700 1 -- 172.21.15.39:0/3070208996 wait complete. 2023-11-28T11:57:46.634 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.628+0000 7f32fd5a7700 1 Processor -- start 2023-11-28T11:57:46.634 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.628+0000 7f32fd5a7700 1 -- start start 2023-11-28T11:57:46.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.628+0000 7f32fd5a7700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32f806e500 0x7f32f814fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:46.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.628+0000 7f32fd5a7700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32f80d15e0 0x7f32f806bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:46.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.628+0000 7f32fd5a7700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32f815a420 0x7f32f806c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:46.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.628+0000 7f32fd5a7700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f80b0510 con 0x7f32f80d15e0 2023-11-28T11:57:46.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.628+0000 7f32fd5a7700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f80b1370 con 0x7f32f806e500 2023-11-28T11:57:46.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.628+0000 7f32fd5a7700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32f80b0760 con 0x7f32f815a420 2023-11-28T11:57:46.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.632+0000 7f32f67fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32f80d15e0 0x7f32f806bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:46.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.632+0000 7f32f67fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32f80d15e0 0x7f32f806bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53910/0 (socket says 172.21.15.39:53910) 2023-11-28T11:57:46.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.632+0000 7f32f67fc700 1 -- 172.21.15.39:0/3615724357 learned_addr learned my addr 172.21.15.39:0/3615724357 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:46.637 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.632+0000 7f32f77fe700 1 --2- 172.21.15.39:0/3615724357 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32f815a420 0x7f32f806c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:46.637 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.632+0000 7f32f6ffd700 1 --2- 172.21.15.39:0/3615724357 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32f806e500 0x7f32f814fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:46.637 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.632+0000 7f32f67fc700 1 -- 172.21.15.39:0/3615724357 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32f815a420 msgr2=0x7f32f806c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:46.637 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.632+0000 7f32f67fc700 1 --2- 172.21.15.39:0/3615724357 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32f815a420 0x7f32f806c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:46.638 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.632+0000 7f32f67fc700 1 -- 172.21.15.39:0/3615724357 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32f806e500 msgr2=0x7f32f814fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:46.638 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.632+0000 7f32f67fc700 1 --2- 172.21.15.39:0/3615724357 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32f806e500 0x7f32f814fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:46.638 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.632+0000 7f32f67fc700 1 -- 172.21.15.39:0/3615724357 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e80094b0 con 0x7f32f80d15e0 2023-11-28T11:57:46.638 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.632+0000 7f32f67fc700 1 --2- 172.21.15.39:0/3615724357 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32f80d15e0 0x7f32f806bf50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f32ec00c730 tx=0x7f32ec00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:46.639 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.632+0000 7f32df7fe700 1 -- 172.21.15.39:0/3615724357 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ec005d90 con 0x7f32f80d15e0 2023-11-28T11:57:46.639 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.632+0000 7f32df7fe700 1 -- 172.21.15.39:0/3615724357 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32ec0070d0 con 0x7f32f80d15e0 2023-11-28T11:57:46.639 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.632+0000 7f32df7fe700 1 -- 172.21.15.39:0/3615724357 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ec007460 con 0x7f32f80d15e0 2023-11-28T11:57:46.639 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.632+0000 7f32fd5a7700 1 -- 172.21.15.39:0/3615724357 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32f80cf150 con 0x7f32f80d15e0 2023-11-28T11:57:46.639 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.632+0000 7f32fd5a7700 1 -- 172.21.15.39:0/3615724357 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32f80cb410 con 0x7f32f80d15e0 2023-11-28T11:57:46.640 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.636+0000 7f32fd5a7700 1 -- 172.21.15.39:0/3615724357 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32f80cf3f0 con 0x7f32f80d15e0 2023-11-28T11:57:46.641 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.636+0000 7f32df7fe700 1 -- 172.21.15.39:0/3615724357 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f32ec019030 con 0x7f32f80d15e0 2023-11-28T11:57:46.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.636+0000 7f32df7fe700 1 --2- 172.21.15.39:0/3615724357 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f32e4064f10 0x7f32e40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:46.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.636+0000 7f32df7fe700 1 -- 172.21.15.39:0/3615724357 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f32ec0815d0 con 0x7f32f80d15e0 2023-11-28T11:57:46.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.636+0000 7f32f6ffd700 1 --2- 172.21.15.39:0/3615724357 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f32e4064f10 0x7f32e40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:46.645 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.640+0000 7f32f6ffd700 1 --2- 172.21.15.39:0/3615724357 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f32e4064f10 0x7f32e40673c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f32e80090b0 tx=0x7f32e8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:46.648 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.644+0000 7f32df7fe700 1 -- 172.21.15.39:0/3615724357 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f32ec04f350 con 0x7f32f80d15e0 2023-11-28T11:57:46.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.816+0000 7f32fd5a7700 1 -- 172.21.15.39:0/3615724357 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f32f80cac60 con 0x7f32f80d15e0 2023-11-28T11:57:46.824 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.816+0000 7f32df7fe700 1 -- 172.21.15.39:0/3615724357 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f32ec052970 con 0x7f32f80d15e0 2023-11-28T11:57:46.824 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2023-11-28T11:57:46.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.820+0000 7f32fd5a7700 1 -- 172.21.15.39:0/3615724357 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f32e4064f10 msgr2=0x7f32e40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:46.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.820+0000 7f32fd5a7700 1 --2- 172.21.15.39:0/3615724357 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f32e4064f10 0x7f32e40673c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f32e80090b0 tx=0x7f32e8008030 comp rx=0 tx=0).stop 2023-11-28T11:57:46.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.820+0000 7f32fd5a7700 1 -- 172.21.15.39:0/3615724357 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32f80d15e0 msgr2=0x7f32f806bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:46.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.820+0000 7f32fd5a7700 1 --2- 172.21.15.39:0/3615724357 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32f80d15e0 0x7f32f806bf50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f32ec00c730 tx=0x7f32ec00ca40 comp rx=0 tx=0).stop 2023-11-28T11:57:46.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.820+0000 7f32fd5a7700 1 -- 172.21.15.39:0/3615724357 shutdown_connections 2023-11-28T11:57:46.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.820+0000 7f32fd5a7700 1 --2- 172.21.15.39:0/3615724357 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32f815a420 0x7f32f806c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:46.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.820+0000 7f32fd5a7700 1 --2- 172.21.15.39:0/3615724357 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32f80d15e0 0x7f32f806bf50 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:46.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.820+0000 7f32fd5a7700 1 --2- 172.21.15.39:0/3615724357 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f32e4064f10 0x7f32e40673c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:46.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.820+0000 7f32fd5a7700 1 --2- 172.21.15.39:0/3615724357 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32f806e500 0x7f32f814fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:46.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.820+0000 7f32fd5a7700 1 -- 172.21.15.39:0/3615724357 >> 172.21.15.39:0/3615724357 conn(0x7f32f80d0ad0 msgr2=0x7f32f81596d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:46.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.820+0000 7f32fd5a7700 1 -- 172.21.15.39:0/3615724357 shutdown_connections 2023-11-28T11:57:46.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:46.820+0000 7f32fd5a7700 1 -- 172.21.15.39:0/3615724357 wait complete. 2023-11-28T11:57:46.847 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T11:57:47.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.032+0000 7fd0e740f700 1 Processor -- start 2023-11-28T11:57:47.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.032+0000 7fd0e740f700 1 -- start start 2023-11-28T11:57:47.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.036+0000 7fd0e740f700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd0e015a060 0x7fd0e00d0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:47.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.036+0000 7fd0e740f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0e00caf60 0x7fd0e00b2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:47.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.036+0000 7fd0e740f700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0e015e9d0 con 0x7fd0e00b27d0 2023-11-28T11:57:47.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.036+0000 7fd0e740f700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0e015dbb0 con 0x7fd0e015a060 2023-11-28T11:57:47.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.036+0000 7fd0e740f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e00b2c50 con 0x7fd0e00caf60 2023-11-28T11:57:47.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.036+0000 7fd0e6c0e700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fd0e00b27d0 0x7fd0e006fcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:55644/0 (socket says 172.21.15.39:55644) 2023-11-28T11:57:47.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.036+0000 7fd0e6c0e700 1 -- 172.21.15.39:0/4040074857 learned_addr learned my addr 172.21.15.39:0/4040074857 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:47.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.036+0000 7fd0e640d700 1 --2- 172.21.15.39:0/4040074857 >> v2:172.21.15.184:3300/0 conn(0x7fd0e015a060 0x7fd0e00d0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:47.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.036+0000 7fd0e5c0c700 1 --2- 172.21.15.39:0/4040074857 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0e00caf60 0x7fd0e00b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:47.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.036+0000 7fd0e540b700 1 -- 172.21.15.39:0/4040074857 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4145711059 0 0) 0x7fd0e015e9d0 con 0x7fd0e00b27d0 2023-11-28T11:57:47.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.036+0000 7fd0e540b700 1 -- 172.21.15.39:0/4040074857 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0cc0035d0 con 0x7fd0e00b27d0 2023-11-28T11:57:47.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.036+0000 7fd0e640d700 1 -- 172.21.15.39:0/4040074857 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0e00caf60 msgr2=0x7fd0e00b2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:47.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.040+0000 7fd0e640d700 1 --2- 172.21.15.39:0/4040074857 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0e00caf60 0x7fd0e00b2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:47.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.040+0000 7fd0e640d700 1 -- 172.21.15.39:0/4040074857 >> v1:172.21.15.39:6789/0 conn(0x7fd0e00b27d0 legacy=0x7fd0e006fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:47.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.040+0000 7fd0e640d700 1 -- 172.21.15.39:0/4040074857 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e015ddc0 con 0x7fd0e015a060 2023-11-28T11:57:47.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.040+0000 7fd0e5c0c700 1 --2- 172.21.15.39:0/4040074857 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0e00caf60 0x7fd0e00b2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:47.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.040+0000 7fd0e640d700 1 --2- 172.21.15.39:0/4040074857 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0e015a060 0x7fd0e00d0040 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc009850 tx=0x7fd0dc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffb38a67c9bd127c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:47.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.040+0000 7fd0e540b700 1 -- 172.21.15.39:0/4040074857 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc011830 con 0x7fd0e015a060 2023-11-28T11:57:47.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.040+0000 7fd0e540b700 1 -- 172.21.15.39:0/4040074857 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0dc011990 con 0x7fd0e015a060 2023-11-28T11:57:47.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.040+0000 7fd0e540b700 1 -- 172.21.15.39:0/4040074857 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc011d40 con 0x7fd0e015a060 2023-11-28T11:57:47.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.040+0000 7fd0e740f700 1 -- 172.21.15.39:0/4040074857 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0e015a060 msgr2=0x7fd0e00d0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:47.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.040+0000 7fd0e740f700 1 --2- 172.21.15.39:0/4040074857 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0e015a060 0x7fd0e00d0040 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc009850 tx=0x7fd0dc009b60 comp rx=0 tx=0).stop 2023-11-28T11:57:47.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.040+0000 7fd0e740f700 1 -- 172.21.15.39:0/4040074857 shutdown_connections 2023-11-28T11:57:47.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.040+0000 7fd0e740f700 1 --2- 172.21.15.39:0/4040074857 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0e00caf60 0x7fd0e00b2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:47.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.040+0000 7fd0e740f700 1 --2- 172.21.15.39:0/4040074857 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0e015a060 0x7fd0e00d0040 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:47.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.040+0000 7fd0e740f700 1 -- 172.21.15.39:0/4040074857 >> 172.21.15.39:0/4040074857 conn(0x7fd0e00cd290 msgr2=0x7fd0e00cd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:47.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.040+0000 7fd0e740f700 1 -- 172.21.15.39:0/4040074857 shutdown_connections 2023-11-28T11:57:47.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.040+0000 7fd0e740f700 1 -- 172.21.15.39:0/4040074857 wait complete. 2023-11-28T11:57:47.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.044+0000 7fd0e740f700 1 Processor -- start 2023-11-28T11:57:47.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.044+0000 7fd0e740f700 1 -- start start 2023-11-28T11:57:47.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.044+0000 7fd0e740f700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0e00b27d0 0x7fd0e014cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:47.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.044+0000 7fd0e740f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0e015a060 0x7fd0e00c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:47.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.044+0000 7fd0e740f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0e00c9320 0x7fd0e00c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:47.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.044+0000 7fd0e740f700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e00c8280 con 0x7fd0e00b27d0 2023-11-28T11:57:47.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.044+0000 7fd0e740f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e00c8560 con 0x7fd0e015a060 2023-11-28T11:57:47.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.044+0000 7fd0e740f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e00c8840 con 0x7fd0e00c9320 2023-11-28T11:57:47.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.044+0000 7fd0e640d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0e00b27d0 0x7fd0e014cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:47.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.044+0000 7fd0e640d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0e00b27d0 0x7fd0e014cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53922/0 (socket says 172.21.15.39:53922) 2023-11-28T11:57:47.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.044+0000 7fd0e640d700 1 -- 172.21.15.39:0/1559718530 learned_addr learned my addr 172.21.15.39:0/1559718530 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:47.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.044+0000 7fd0e5c0c700 1 --2- 172.21.15.39:0/1559718530 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0e015a060 0x7fd0e00c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:47.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.044+0000 7fd0e6c0e700 1 --2- 172.21.15.39:0/1559718530 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0e00c9320 0x7fd0e00c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:47.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.044+0000 7fd0e640d700 1 -- 172.21.15.39:0/1559718530 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0e00c9320 msgr2=0x7fd0e00c9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:47.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.044+0000 7fd0e640d700 1 --2- 172.21.15.39:0/1559718530 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0e00c9320 0x7fd0e00c9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:47.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.044+0000 7fd0e640d700 1 -- 172.21.15.39:0/1559718530 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0e015a060 msgr2=0x7fd0e00c78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:47.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.044+0000 7fd0e640d700 1 --2- 172.21.15.39:0/1559718530 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0e015a060 0x7fd0e00c78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:47.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.044+0000 7fd0e640d700 1 -- 172.21.15.39:0/1559718530 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d00094b0 con 0x7fd0e00b27d0 2023-11-28T11:57:47.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.044+0000 7fd0e5c0c700 1 --2- 172.21.15.39:0/1559718530 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0e015a060 0x7fd0e00c78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:57:47.054 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.048+0000 7fd0e640d700 1 --2- 172.21.15.39:0/1559718530 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0e00b27d0 0x7fd0e014cce0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc014040 tx=0x7fd0dc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:47.054 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.048+0000 7fd0d6ffd700 1 -- 172.21.15.39:0/1559718530 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc0036c0 con 0x7fd0e00b27d0 2023-11-28T11:57:47.054 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.048+0000 7fd0d6ffd700 1 -- 172.21.15.39:0/1559718530 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0dc01e070 con 0x7fd0e00b27d0 2023-11-28T11:57:47.054 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.048+0000 7fd0e740f700 1 -- 172.21.15.39:0/1559718530 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0dc0094b0 con 0x7fd0e00b27d0 2023-11-28T11:57:47.054 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.048+0000 7fd0d6ffd700 1 -- 172.21.15.39:0/1559718530 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc003a80 con 0x7fd0e00b27d0 2023-11-28T11:57:47.054 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.048+0000 7fd0e740f700 1 -- 172.21.15.39:0/1559718530 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0e015e380 con 0x7fd0e00b27d0 2023-11-28T11:57:47.054 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.048+0000 7fd0e740f700 1 -- 172.21.15.39:0/1559718530 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0e015e0a0 con 0x7fd0e00b27d0 2023-11-28T11:57:47.056 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.052+0000 7fd0d6ffd700 1 -- 172.21.15.39:0/1559718530 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd0dc00f050 con 0x7fd0e00b27d0 2023-11-28T11:57:47.058 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.052+0000 7fd0d6ffd700 1 --2- 172.21.15.39:0/1559718530 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd0c4064f10 0x7fd0c40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:47.058 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.052+0000 7fd0d6ffd700 1 -- 172.21.15.39:0/1559718530 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd0dc020070 con 0x7fd0e00b27d0 2023-11-28T11:57:47.059 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.052+0000 7fd0e5c0c700 1 --2- 172.21.15.39:0/1559718530 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd0c4064f10 0x7fd0c40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:47.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.056+0000 7fd0e5c0c700 1 --2- 172.21.15.39:0/1559718530 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd0c4064f10 0x7fd0c40673c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd0e00c42f0 tx=0x7fd0d0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:47.065 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.060+0000 7fd0d6ffd700 1 -- 172.21.15.39:0/1559718530 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd0dc051490 con 0x7fd0e00b27d0 2023-11-28T11:57:47.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.236+0000 7fd0e740f700 1 -- 172.21.15.39:0/1559718530 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd0e015e660 con 0x7fd0e00b27d0 2023-11-28T11:57:47.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.236+0000 7fd0d6ffd700 1 -- 172.21.15.39:0/1559718530 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd0dc0150a0 con 0x7fd0e00b27d0 2023-11-28T11:57:47.244 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-11-28T11:57:47.248 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.240+0000 7fd0e740f700 1 -- 172.21.15.39:0/1559718530 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd0c4064f10 msgr2=0x7fd0c40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:47.248 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.240+0000 7fd0e740f700 1 --2- 172.21.15.39:0/1559718530 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd0c4064f10 0x7fd0c40673c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd0e00c42f0 tx=0x7fd0d0008040 comp rx=0 tx=0).stop 2023-11-28T11:57:47.248 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.240+0000 7fd0e740f700 1 -- 172.21.15.39:0/1559718530 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0e00b27d0 msgr2=0x7fd0e014cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:47.248 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.240+0000 7fd0e740f700 1 --2- 172.21.15.39:0/1559718530 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0e00b27d0 0x7fd0e014cce0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc014040 tx=0x7fd0dc004770 comp rx=0 tx=0).stop 2023-11-28T11:57:47.249 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.244+0000 7fd0e740f700 1 -- 172.21.15.39:0/1559718530 shutdown_connections 2023-11-28T11:57:47.249 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.244+0000 7fd0e740f700 1 --2- 172.21.15.39:0/1559718530 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0e00c9320 0x7fd0e00c9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:47.249 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.244+0000 7fd0e740f700 1 --2- 172.21.15.39:0/1559718530 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd0c4064f10 0x7fd0c40673c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:47.249 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.244+0000 7fd0e740f700 1 --2- 172.21.15.39:0/1559718530 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0e015a060 0x7fd0e00c78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:47.249 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.244+0000 7fd0e740f700 1 --2- 172.21.15.39:0/1559718530 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0e00b27d0 0x7fd0e014cce0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:47.249 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.244+0000 7fd0e740f700 1 -- 172.21.15.39:0/1559718530 >> 172.21.15.39:0/1559718530 conn(0x7fd0e00cd290 msgr2=0x7fd0e00b3640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:47.249 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.244+0000 7fd0e740f700 1 -- 172.21.15.39:0/1559718530 shutdown_connections 2023-11-28T11:57:47.249 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.244+0000 7fd0e740f700 1 -- 172.21.15.39:0/1559718530 wait complete. 2023-11-28T11:57:47.274 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:57:47.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.440+0000 7f8a570ed700 1 Processor -- start 2023-11-28T11:57:47.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.444+0000 7f8a570ed700 1 -- start start 2023-11-28T11:57:47.452 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.444+0000 7f8a570ed700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f8a500cdeb0 0x7f8a50070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:47.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.448+0000 7f8a570ed700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a500709d0 con 0x7f8a5015c1a0 2023-11-28T11:57:47.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.448+0000 7f8a570ed700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a500adf90 con 0x7f8a500705c0 2023-11-28T11:57:47.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.448+0000 7f8a570ed700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a50069bf0 con 0x7f8a500cdeb0 2023-11-28T11:57:47.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.448+0000 7f8a558ea700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f8a500cdeb0 0x7f8a50070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:47.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.448+0000 7f8a558ea700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f8a500cdeb0 0x7f8a50070080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53936/0 (socket says 172.21.15.39:53936) 2023-11-28T11:57:47.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.448+0000 7f8a558ea700 1 -- 172.21.15.39:0/1888168400 learned_addr learned my addr 172.21.15.39:0/1888168400 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:47.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.448+0000 7f8a558ea700 1 -- 172.21.15.39:0/1888168400 >> v1:172.21.15.184:6789/0 conn(0x7f8a500705c0 legacy=0x7f8a5006a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:47.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.448+0000 7f8a558ea700 1 -- 172.21.15.39:0/1888168400 >> v1:172.21.15.39:6789/0 conn(0x7f8a5015c1a0 legacy=0x7f8a5006c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:47.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.448+0000 7f8a558ea700 1 -- 172.21.15.39:0/1888168400 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a500ce370 con 0x7f8a500cdeb0 2023-11-28T11:57:47.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.448+0000 7f8a550e9700 1 -- 172.21.15.39:0/1888168400 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2107711582 0 0) 0x7f8a500709d0 con 0x7f8a5015c1a0 2023-11-28T11:57:47.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.448+0000 7f8a558ea700 1 --2- 172.21.15.39:0/1888168400 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a500cdeb0 0x7f8a50070080 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8a40009910 tx=0x7f8a40009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ded5ba87c850ebd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:47.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.448+0000 7f8a550e9700 1 -- 172.21.15.39:0/1888168400 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4000ba60 con 0x7f8a500cdeb0 2023-11-28T11:57:47.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.448+0000 7f8a550e9700 1 -- 172.21.15.39:0/1888168400 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a4000bbc0 con 0x7f8a500cdeb0 2023-11-28T11:57:47.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.448+0000 7f8a550e9700 1 -- 172.21.15.39:0/1888168400 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a40009e60 con 0x7f8a500cdeb0 2023-11-28T11:57:47.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.448+0000 7f8a570ed700 1 -- 172.21.15.39:0/1888168400 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a500cdeb0 msgr2=0x7f8a50070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:47.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.448+0000 7f8a570ed700 1 --2- 172.21.15.39:0/1888168400 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a500cdeb0 0x7f8a50070080 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8a40009910 tx=0x7f8a40009c20 comp rx=0 tx=0).stop 2023-11-28T11:57:47.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.448+0000 7f8a570ed700 1 -- 172.21.15.39:0/1888168400 shutdown_connections 2023-11-28T11:57:47.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.448+0000 7f8a570ed700 1 --2- 172.21.15.39:0/1888168400 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a500cdeb0 0x7f8a50070080 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:47.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.448+0000 7f8a570ed700 1 -- 172.21.15.39:0/1888168400 >> 172.21.15.39:0/1888168400 conn(0x7f8a500b0f80 msgr2=0x7f8a500ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:47.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.448+0000 7f8a570ed700 1 -- 172.21.15.39:0/1888168400 shutdown_connections 2023-11-28T11:57:47.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.452+0000 7f8a570ed700 1 -- 172.21.15.39:0/1888168400 wait complete. 2023-11-28T11:57:47.458 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.452+0000 7f8a570ed700 1 Processor -- start 2023-11-28T11:57:47.458 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.452+0000 7f8a570ed700 1 -- start start 2023-11-28T11:57:47.460 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.452+0000 7f8a570ed700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a500705c0 0x7f8a5014ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:47.460 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.452+0000 7f8a570ed700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a500cdeb0 0x7f8a500c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:47.460 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.452+0000 7f8a570ed700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a5015c1a0 0x7f8a500b3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:47.460 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.452+0000 7f8a570ed700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5014b0d0 con 0x7f8a500705c0 2023-11-28T11:57:47.460 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.452+0000 7f8a570ed700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500b25e0 con 0x7f8a500cdeb0 2023-11-28T11:57:47.460 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.452+0000 7f8a570ed700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500b27f0 con 0x7f8a5015c1a0 2023-11-28T11:57:47.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.456+0000 7f8a560eb700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a500705c0 0x7f8a5014ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:47.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.456+0000 7f8a560eb700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a500705c0 0x7f8a5014ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53950/0 (socket says 172.21.15.39:53950) 2023-11-28T11:57:47.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.456+0000 7f8a560eb700 1 -- 172.21.15.39:0/527093726 learned_addr learned my addr 172.21.15.39:0/527093726 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:47.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.456+0000 7f8a558ea700 1 --2- 172.21.15.39:0/527093726 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a500cdeb0 0x7f8a500c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:47.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.456+0000 7f8a568ec700 1 --2- 172.21.15.39:0/527093726 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a5015c1a0 0x7f8a500b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:47.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.456+0000 7f8a560eb700 1 -- 172.21.15.39:0/527093726 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a5015c1a0 msgr2=0x7f8a500b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:47.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.456+0000 7f8a560eb700 1 --2- 172.21.15.39:0/527093726 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a5015c1a0 0x7f8a500b3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:47.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.456+0000 7f8a560eb700 1 -- 172.21.15.39:0/527093726 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a500cdeb0 msgr2=0x7f8a500c8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:47.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.456+0000 7f8a560eb700 1 --2- 172.21.15.39:0/527093726 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a500cdeb0 0x7f8a500c8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:47.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.456+0000 7f8a560eb700 1 -- 172.21.15.39:0/527093726 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a40009570 con 0x7f8a500705c0 2023-11-28T11:57:47.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.456+0000 7f8a560eb700 1 --2- 172.21.15.39:0/527093726 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a500705c0 0x7f8a5014ab90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c00c450 tx=0x7f8a4c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:47.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.456+0000 7f8a46ffd700 1 -- 172.21.15.39:0/527093726 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c0054e0 con 0x7f8a500705c0 2023-11-28T11:57:47.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.456+0000 7f8a46ffd700 1 -- 172.21.15.39:0/527093726 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a4c0036a0 con 0x7f8a500705c0 2023-11-28T11:57:47.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.456+0000 7f8a46ffd700 1 -- 172.21.15.39:0/527093726 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c003a50 con 0x7f8a500705c0 2023-11-28T11:57:47.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.456+0000 7f8a570ed700 1 -- 172.21.15.39:0/527093726 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a500cc780 con 0x7f8a500705c0 2023-11-28T11:57:47.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.456+0000 7f8a570ed700 1 -- 172.21.15.39:0/527093726 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a500cc4a0 con 0x7f8a500705c0 2023-11-28T11:57:47.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.456+0000 7f8a570ed700 1 -- 172.21.15.39:0/527093726 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a5015c570 con 0x7f8a500705c0 2023-11-28T11:57:47.464 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.460+0000 7f8a46ffd700 1 -- 172.21.15.39:0/527093726 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8a4c019030 con 0x7f8a500705c0 2023-11-28T11:57:47.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.460+0000 7f8a46ffd700 1 --2- 172.21.15.39:0/527093726 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8a34064ee0 0x7f8a34067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:47.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.460+0000 7f8a46ffd700 1 -- 172.21.15.39:0/527093726 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8a4c081530 con 0x7f8a500705c0 2023-11-28T11:57:47.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.460+0000 7f8a558ea700 1 --2- 172.21.15.39:0/527093726 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8a34064ee0 0x7f8a34067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:47.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.464+0000 7f8a558ea700 1 --2- 172.21.15.39:0/527093726 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8a34064ee0 0x7f8a34067390 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8a500ce2a0 tx=0x7f8a40008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:47.473 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.468+0000 7f8a46ffd700 1 -- 172.21.15.39:0/527093726 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8a4c04f3a0 con 0x7f8a500705c0 2023-11-28T11:57:47.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.676+0000 7f8a570ed700 1 -- 172.21.15.39:0/527093726 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a50073cb0 con 0x7f8a500705c0 2023-11-28T11:57:47.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.676+0000 7f8a46ffd700 1 -- 172.21.15.39:0/527093726 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4647 (secure 0 0 0) 0x7f8a4c001160 con 0x7f8a500705c0 2023-11-28T11:57:47.685 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:57:47.686 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4265,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1518942402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":1518942402},{"type":"v1","addr":"172.21.15.184:6837","nonce":1518942402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/1834562481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":1834562481},{"type":"v1","addr":"172.21.15.39:6833","nonce":1834562481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2470756838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2470756838},{"type":"v1","addr":"172.21.15.39:6835","nonce":2470756838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:56:39.894634+0000","modified":"2023-11-28T11:56:59.724929+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6835/516507254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":516507254},{"type":"v1","addr":"172.21.15.184:6835","nonce":516507254}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T11:57:47.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.680+0000 7f8a570ed700 1 -- 172.21.15.39:0/527093726 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8a34064ee0 msgr2=0x7f8a34067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:47.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.680+0000 7f8a570ed700 1 --2- 172.21.15.39:0/527093726 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8a34064ee0 0x7f8a34067390 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8a500ce2a0 tx=0x7f8a40008030 comp rx=0 tx=0).stop 2023-11-28T11:57:47.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.680+0000 7f8a570ed700 1 -- 172.21.15.39:0/527093726 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a500705c0 msgr2=0x7f8a5014ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:47.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.680+0000 7f8a570ed700 1 --2- 172.21.15.39:0/527093726 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a500705c0 0x7f8a5014ab90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c00c450 tx=0x7f8a4c00c810 comp rx=0 tx=0).stop 2023-11-28T11:57:47.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.680+0000 7f8a570ed700 1 -- 172.21.15.39:0/527093726 shutdown_connections 2023-11-28T11:57:47.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.680+0000 7f8a570ed700 1 --2- 172.21.15.39:0/527093726 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a5015c1a0 0x7f8a500b3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:47.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.680+0000 7f8a570ed700 1 --2- 172.21.15.39:0/527093726 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8a34064ee0 0x7f8a34067390 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:47.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.680+0000 7f8a570ed700 1 --2- 172.21.15.39:0/527093726 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a500cdeb0 0x7f8a500c8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:47.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.680+0000 7f8a570ed700 1 --2- 172.21.15.39:0/527093726 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a500705c0 0x7f8a5014ab90 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:47.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.680+0000 7f8a570ed700 1 -- 172.21.15.39:0/527093726 >> 172.21.15.39:0/527093726 conn(0x7f8a500b0f80 msgr2=0x7f8a500c9cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:47.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.680+0000 7f8a570ed700 1 -- 172.21.15.39:0/527093726 shutdown_connections 2023-11-28T11:57:47.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.680+0000 7f8a570ed700 1 -- 172.21.15.39:0/527093726 wait complete. 2023-11-28T11:57:47.689 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 9 2023-11-28T11:57:47.713 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:57:47.893 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.888+0000 7f746e156700 1 Processor -- start 2023-11-28T11:57:47.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.888+0000 7f746e156700 1 -- start start 2023-11-28T11:57:47.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.888+0000 7f746e156700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7468070080 0x7f74680704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:47.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.888+0000 7f746e156700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7468164250 0x7f74681646b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:47.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.888+0000 7f746e156700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74680ad6c0 con 0x7f7468160710 2023-11-28T11:57:47.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.888+0000 7f746e156700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f746806b1c0 con 0x7f7468070080 2023-11-28T11:57:47.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.888+0000 7f746e156700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74680adc60 con 0x7f7468164250 2023-11-28T11:57:47.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.888+0000 7f746c953700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7468070080 0x7f74680704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:47.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.888+0000 7f746c953700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7468070080 0x7f74680704b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53956/0 (socket says 172.21.15.39:53956) 2023-11-28T11:57:47.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.888+0000 7f746c953700 1 -- 172.21.15.39:0/3850399773 learned_addr learned my addr 172.21.15.39:0/3850399773 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:47.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.888+0000 7f746d955700 1 --2- 172.21.15.39:0/3850399773 >> v2:172.21.15.184:3300/0 conn(0x7f7468164250 0x7f74681646b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:47.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.892+0000 7f746c953700 1 -- 172.21.15.39:0/3850399773 >> v2:172.21.15.184:3300/0 conn(0x7f7468164250 msgr2=0x7f74681646b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:47.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.892+0000 7f746c953700 1 --2- 172.21.15.39:0/3850399773 >> v2:172.21.15.184:3300/0 conn(0x7f7468164250 0x7f74681646b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:47.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.892+0000 7f746c953700 1 -- 172.21.15.39:0/3850399773 >> v1:172.21.15.184:6789/0 conn(0x7f7468160710 legacy=0x7f74680cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:47.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.892+0000 7f746c953700 1 -- 172.21.15.39:0/3850399773 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74680709f0 con 0x7f7468070080 2023-11-28T11:57:47.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.892+0000 7f746c953700 1 --2- 172.21.15.39:0/3850399773 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7468070080 0x7f74680704b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7468072e80 tx=0x7f7458009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=162c6a52233f0a19 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:47.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.892+0000 7f745ffff700 1 -- 172.21.15.39:0/3850399773 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7458011830 con 0x7f7468070080 2023-11-28T11:57:47.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.892+0000 7f745ffff700 1 -- 172.21.15.39:0/3850399773 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7458011990 con 0x7f7468070080 2023-11-28T11:57:47.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.892+0000 7f745ffff700 1 -- 172.21.15.39:0/3850399773 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7458011d20 con 0x7f7468070080 2023-11-28T11:57:47.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.892+0000 7f746e156700 1 -- 172.21.15.39:0/3850399773 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7468070080 msgr2=0x7f74680704b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:47.904 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.892+0000 7f746e156700 1 --2- 172.21.15.39:0/3850399773 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7468070080 0x7f74680704b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7468072e80 tx=0x7f7458009bf0 comp rx=0 tx=0).stop 2023-11-28T11:57:47.904 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.892+0000 7f746e156700 1 -- 172.21.15.39:0/3850399773 shutdown_connections 2023-11-28T11:57:47.904 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.892+0000 7f746e156700 1 --2- 172.21.15.39:0/3850399773 >> v2:172.21.15.184:3300/0 conn(0x7f7468164250 0x7f74681646b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:47.904 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.892+0000 7f746e156700 1 --2- 172.21.15.39:0/3850399773 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7468070080 0x7f74680704b0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:47.904 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.892+0000 7f746e156700 1 -- 172.21.15.39:0/3850399773 >> 172.21.15.39:0/3850399773 conn(0x7f74680b0f80 msgr2=0x7f74680ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:47.904 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.892+0000 7f746e156700 1 -- 172.21.15.39:0/3850399773 shutdown_connections 2023-11-28T11:57:47.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.892+0000 7f746e156700 1 -- 172.21.15.39:0/3850399773 wait complete. 2023-11-28T11:57:47.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.896+0000 7f746e156700 1 Processor -- start 2023-11-28T11:57:47.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.896+0000 7f746e156700 1 -- start start 2023-11-28T11:57:47.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.896+0000 7f746e156700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7468070080 0x7f74680b2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:47.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.896+0000 7f746e156700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7468160710 0x7f746815de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:47.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.896+0000 7f746e156700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7468164250 0x7f746815e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:47.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.896+0000 7f746e156700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7468158a60 con 0x7f7468164250 2023-11-28T11:57:47.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.896+0000 7f746e156700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74680b3020 con 0x7f7468070080 2023-11-28T11:57:47.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.900+0000 7f746e156700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74680b2a60 con 0x7f7468160710 2023-11-28T11:57:47.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.900+0000 7f746d955700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7468164250 0x7f746815e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:47.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.900+0000 7f746d955700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7468164250 0x7f746815e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53968/0 (socket says 172.21.15.39:53968) 2023-11-28T11:57:47.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.900+0000 7f746d955700 1 -- 172.21.15.39:0/4273672706 learned_addr learned my addr 172.21.15.39:0/4273672706 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:47.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.900+0000 7f746c953700 1 --2- 172.21.15.39:0/4273672706 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7468160710 0x7f746815de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:47.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.900+0000 7f746d154700 1 --2- 172.21.15.39:0/4273672706 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7468070080 0x7f74680b2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:47.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.900+0000 7f746d955700 1 -- 172.21.15.39:0/4273672706 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7468160710 msgr2=0x7f746815de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:47.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.900+0000 7f746d955700 1 --2- 172.21.15.39:0/4273672706 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7468160710 0x7f746815de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:47.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.900+0000 7f746d955700 1 -- 172.21.15.39:0/4273672706 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7468070080 msgr2=0x7f74680b2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:47.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.900+0000 7f746d955700 1 --2- 172.21.15.39:0/4273672706 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7468070080 0x7f74680b2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:47.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.900+0000 7f746d955700 1 -- 172.21.15.39:0/4273672706 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7458009570 con 0x7f7468164250 2023-11-28T11:57:47.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.900+0000 7f746d955700 1 --2- 172.21.15.39:0/4273672706 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7468164250 0x7f746815e370 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f746000efc0 tx=0x7f746000c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:47.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.900+0000 7f745dffb700 1 -- 172.21.15.39:0/4273672706 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746000cad0 con 0x7f7468164250 2023-11-28T11:57:47.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.900+0000 7f745dffb700 1 -- 172.21.15.39:0/4273672706 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746000f040 con 0x7f7468164250 2023-11-28T11:57:47.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.900+0000 7f746e156700 1 -- 172.21.15.39:0/4273672706 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f746806b3d0 con 0x7f7468164250 2023-11-28T11:57:47.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.900+0000 7f745dffb700 1 -- 172.21.15.39:0/4273672706 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746000ce70 con 0x7f7468164250 2023-11-28T11:57:47.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.900+0000 7f746e156700 1 -- 172.21.15.39:0/4273672706 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74680cca30 con 0x7f7468164250 2023-11-28T11:57:47.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.904+0000 7f746e156700 1 -- 172.21.15.39:0/4273672706 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f746806b6b0 con 0x7f7468164250 2023-11-28T11:57:47.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.904+0000 7f745dffb700 1 -- 172.21.15.39:0/4273672706 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7460014480 con 0x7f7468164250 2023-11-28T11:57:47.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.908+0000 7f745dffb700 1 --2- 172.21.15.39:0/4273672706 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f744c064ee0 0x7f744c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:47.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.908+0000 7f745dffb700 1 -- 172.21.15.39:0/4273672706 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7460082b70 con 0x7f7468164250 2023-11-28T11:57:47.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.908+0000 7f746d154700 1 --2- 172.21.15.39:0/4273672706 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f744c064ee0 0x7f744c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:47.916 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.908+0000 7f746d154700 1 --2- 172.21.15.39:0/4273672706 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f744c064ee0 0x7f744c067390 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f74680b3470 tx=0x7f7464009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:47.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:47.912+0000 7f745dffb700 1 -- 172.21.15.39:0/4273672706 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7460050890 con 0x7f7468164250 2023-11-28T11:57:48.101 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.096+0000 7f746e156700 1 -- 172.21.15.39:0/4273672706 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7468073200 con 0x7f7468164250 2023-11-28T11:57:48.104 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.096+0000 7f745dffb700 1 -- 172.21.15.39:0/4273672706 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+19748 (secure 0 0 0) 0x7f7468073200 con 0x7f7468164250 2023-11-28T11:57:48.104 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:57:48.105 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":31,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:57:21.927556+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:56:38.203736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:56:38.946498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:56:41.988334+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.10","mappings":[{"from":1,"to":5}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:57:48.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.104+0000 7f746e156700 1 -- 172.21.15.39:0/4273672706 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f744c064ee0 msgr2=0x7f744c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:48.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.104+0000 7f746e156700 1 --2- 172.21.15.39:0/4273672706 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f744c064ee0 0x7f744c067390 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f74680b3470 tx=0x7f7464009040 comp rx=0 tx=0).stop 2023-11-28T11:57:48.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.104+0000 7f746e156700 1 -- 172.21.15.39:0/4273672706 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7468164250 msgr2=0x7f746815e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:48.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.104+0000 7f746e156700 1 --2- 172.21.15.39:0/4273672706 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7468164250 0x7f746815e370 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f746000efc0 tx=0x7f746000c0c0 comp rx=0 tx=0).stop 2023-11-28T11:57:48.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.104+0000 7f746e156700 1 -- 172.21.15.39:0/4273672706 shutdown_connections 2023-11-28T11:57:48.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.104+0000 7f746e156700 1 --2- 172.21.15.39:0/4273672706 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7468164250 0x7f746815e370 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:48.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.104+0000 7f746e156700 1 --2- 172.21.15.39:0/4273672706 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7468160710 0x7f746815de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:48.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.104+0000 7f746e156700 1 --2- 172.21.15.39:0/4273672706 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f744c064ee0 0x7f744c067390 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:48.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.104+0000 7f746e156700 1 --2- 172.21.15.39:0/4273672706 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7468070080 0x7f74680b2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:48.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.104+0000 7f746e156700 1 -- 172.21.15.39:0/4273672706 >> 172.21.15.39:0/4273672706 conn(0x7f74680b0f80 msgr2=0x7f7468158cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:48.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.104+0000 7f746e156700 1 -- 172.21.15.39:0/4273672706 shutdown_connections 2023-11-28T11:57:48.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.104+0000 7f746e156700 1 -- 172.21.15.39:0/4273672706 wait complete. 2023-11-28T11:57:48.133 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T11:57:48.133 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:57:48.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.300+0000 7f5d9ae6f700 1 Processor -- start 2023-11-28T11:57:48.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.300+0000 7f5d9ae6f700 1 -- start start 2023-11-28T11:57:48.307 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.300+0000 7f5d9ae6f700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5d9415c650 0x7f5d9406b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:48.307 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.300+0000 7f5d9ae6f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d940cd0d0 0x7f5d940b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:48.308 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.300+0000 7f5d9ae6f700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d940c9d40 con 0x7f5d940b1b80 2023-11-28T11:57:48.308 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.300+0000 7f5d9ae6f700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d9406b140 con 0x7f5d9415c650 2023-11-28T11:57:48.308 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.300+0000 7f5d9ae6f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9406b820 con 0x7f5d940cd0d0 2023-11-28T11:57:48.308 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.304+0000 7f5d99e6d700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5d9415c650 0x7f5d9406b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:48.308 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.304+0000 7f5d9a66e700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f5d940b1b80 0x7f5d9406bed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60378/0 (socket says 172.21.15.39:60378) 2023-11-28T11:57:48.309 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.304+0000 7f5d9a66e700 1 -- 172.21.15.39:0/1701290069 learned_addr learned my addr 172.21.15.39:0/1701290069 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:48.309 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.304+0000 7f5d9966c700 1 --2- 172.21.15.39:0/1701290069 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d940cd0d0 0x7f5d940b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:48.309 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.304+0000 7f5d99e6d700 1 -- 172.21.15.39:0/1701290069 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d940cd0d0 msgr2=0x7f5d940b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:48.309 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.304+0000 7f5d99e6d700 1 --2- 172.21.15.39:0/1701290069 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d940cd0d0 0x7f5d940b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:48.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.304+0000 7f5d99e6d700 1 -- 172.21.15.39:0/1701290069 >> v1:172.21.15.39:6789/0 conn(0x7f5d940b1b80 legacy=0x7f5d9406bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:48.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.304+0000 7f5d99e6d700 1 -- 172.21.15.39:0/1701290069 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d940cd5d0 con 0x7f5d9415c650 2023-11-28T11:57:48.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.304+0000 7f5d98e6b700 1 -- 172.21.15.39:0/1701290069 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 172781249 0 0) 0x7f5d940c9d40 con 0x7f5d940b1b80 2023-11-28T11:57:48.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.304+0000 7f5d99e6d700 1 --2- 172.21.15.39:0/1701290069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d9415c650 0x7f5d9406b2e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5d90009850 tx=0x7f5d90009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60ac8bc43d68231 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:48.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.304+0000 7f5d98e6b700 1 -- 172.21.15.39:0/1701290069 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d90011830 con 0x7f5d9415c650 2023-11-28T11:57:48.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.304+0000 7f5d98e6b700 1 -- 172.21.15.39:0/1701290069 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d90011990 con 0x7f5d9415c650 2023-11-28T11:57:48.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.304+0000 7f5d98e6b700 1 -- 172.21.15.39:0/1701290069 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d90011d40 con 0x7f5d9415c650 2023-11-28T11:57:48.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.304+0000 7f5d9ae6f700 1 -- 172.21.15.39:0/1701290069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d9415c650 msgr2=0x7f5d9406b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:48.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.304+0000 7f5d9ae6f700 1 --2- 172.21.15.39:0/1701290069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d9415c650 0x7f5d9406b2e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5d90009850 tx=0x7f5d90009b60 comp rx=0 tx=0).stop 2023-11-28T11:57:48.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.304+0000 7f5d9ae6f700 1 -- 172.21.15.39:0/1701290069 shutdown_connections 2023-11-28T11:57:48.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.304+0000 7f5d9ae6f700 1 --2- 172.21.15.39:0/1701290069 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d940cd0d0 0x7f5d940b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:48.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.304+0000 7f5d9ae6f700 1 --2- 172.21.15.39:0/1701290069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d9415c650 0x7f5d9406b2e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:48.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.304+0000 7f5d9ae6f700 1 -- 172.21.15.39:0/1701290069 >> 172.21.15.39:0/1701290069 conn(0x7f5d940b0f80 msgr2=0x7f5d940ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:48.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.304+0000 7f5d9ae6f700 1 -- 172.21.15.39:0/1701290069 shutdown_connections 2023-11-28T11:57:48.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.308+0000 7f5d9ae6f700 1 -- 172.21.15.39:0/1701290069 wait complete. 2023-11-28T11:57:48.315 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.308+0000 7f5d9ae6f700 1 Processor -- start 2023-11-28T11:57:48.316 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.308+0000 7f5d9ae6f700 1 -- start start 2023-11-28T11:57:48.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.312+0000 7f5d9ae6f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d940b1b80 0x7f5d94159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:48.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.312+0000 7f5d9ae6f700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d940cd0d0 0x7f5d940c5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:48.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.312+0000 7f5d9ae6f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d9415c650 0x7f5d941e3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:48.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.312+0000 7f5d9ae6f700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d940c6510 con 0x7f5d940cd0d0 2023-11-28T11:57:48.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.312+0000 7f5d9ae6f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9415a000 con 0x7f5d940b1b80 2023-11-28T11:57:48.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.312+0000 7f5d9ae6f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d940c80e0 con 0x7f5d9415c650 2023-11-28T11:57:48.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.312+0000 7f5d9966c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d940cd0d0 0x7f5d940c5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:48.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.312+0000 7f5d9966c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d940cd0d0 0x7f5d940c5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34164/0 (socket says 172.21.15.39:34164) 2023-11-28T11:57:48.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.312+0000 7f5d9966c700 1 -- 172.21.15.39:0/2375933376 learned_addr learned my addr 172.21.15.39:0/2375933376 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:48.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.312+0000 7f5d99e6d700 1 --2- 172.21.15.39:0/2375933376 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d940b1b80 0x7f5d94159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:48.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.312+0000 7f5d9a66e700 1 --2- 172.21.15.39:0/2375933376 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d9415c650 0x7f5d941e3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:48.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.312+0000 7f5d9966c700 1 -- 172.21.15.39:0/2375933376 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d9415c650 msgr2=0x7f5d941e3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:48.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.312+0000 7f5d9966c700 1 --2- 172.21.15.39:0/2375933376 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d9415c650 0x7f5d941e3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:48.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.312+0000 7f5d9966c700 1 -- 172.21.15.39:0/2375933376 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d940b1b80 msgr2=0x7f5d94159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:48.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.312+0000 7f5d9966c700 1 --2- 172.21.15.39:0/2375933376 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d940b1b80 0x7f5d94159ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:48.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.312+0000 7f5d9966c700 1 -- 172.21.15.39:0/2375933376 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d900094b0 con 0x7f5d940cd0d0 2023-11-28T11:57:48.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.312+0000 7f5d9966c700 1 --2- 172.21.15.39:0/2375933376 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d940cd0d0 0x7f5d940c5820 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5d8400e9a0 tx=0x7f5d8400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:48.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.312+0000 7f5d8a7fc700 1 -- 172.21.15.39:0/2375933376 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d84009720 con 0x7f5d940cd0d0 2023-11-28T11:57:48.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.312+0000 7f5d8a7fc700 1 -- 172.21.15.39:0/2375933376 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d8400c690 con 0x7f5d940cd0d0 2023-11-28T11:57:48.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.312+0000 7f5d9ae6f700 1 -- 172.21.15.39:0/2375933376 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d940c99d0 con 0x7f5d940cd0d0 2023-11-28T11:57:48.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.312+0000 7f5d8a7fc700 1 -- 172.21.15.39:0/2375933376 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8400ca40 con 0x7f5d940cd0d0 2023-11-28T11:57:48.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.312+0000 7f5d9ae6f700 1 -- 172.21.15.39:0/2375933376 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d940cd8b0 con 0x7f5d940cd0d0 2023-11-28T11:57:48.322 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.316+0000 7f5d9ae6f700 1 -- 172.21.15.39:0/2375933376 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d940c9680 con 0x7f5d940cd0d0 2023-11-28T11:57:48.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.316+0000 7f5d8a7fc700 1 -- 172.21.15.39:0/2375933376 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5d84019030 con 0x7f5d940cd0d0 2023-11-28T11:57:48.325 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.320+0000 7f5d8a7fc700 1 --2- 172.21.15.39:0/2375933376 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5d78064ee0 0x7f5d78067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:48.325 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.320+0000 7f5d8a7fc700 1 -- 172.21.15.39:0/2375933376 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5d84082120 con 0x7f5d940cd0d0 2023-11-28T11:57:48.325 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.320+0000 7f5d99e6d700 1 --2- 172.21.15.39:0/2375933376 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5d78064ee0 0x7f5d78067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:48.326 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.320+0000 7f5d99e6d700 1 --2- 172.21.15.39:0/2375933376 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5d78064ee0 0x7f5d78067390 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5d900090b0 tx=0x7f5d90008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:48.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.324+0000 7f5d8a7fc700 1 -- 172.21.15.39:0/2375933376 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5d8404fea0 con 0x7f5d940cd0d0 2023-11-28T11:57:48.546 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.540+0000 7f5d9ae6f700 1 -- 172.21.15.39:0/2375933376 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5d94073cb0 con 0x7f5d940cd0d0 2023-11-28T11:57:48.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.540+0000 7f5d8a7fc700 1 -- 172.21.15.39:0/2375933376 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4647 (secure 0 0 0) 0x7f5d840534c0 con 0x7f5d940cd0d0 2023-11-28T11:57:48.548 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:57:48.548 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4265,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1518942402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":1518942402},{"type":"v1","addr":"172.21.15.184:6837","nonce":1518942402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/1834562481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":1834562481},{"type":"v1","addr":"172.21.15.39:6833","nonce":1834562481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2470756838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2470756838},{"type":"v1","addr":"172.21.15.39:6835","nonce":2470756838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:56:39.894634+0000","modified":"2023-11-28T11:56:59.724929+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6835/516507254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":516507254},{"type":"v1","addr":"172.21.15.184:6835","nonce":516507254}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T11:57:48.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.548+0000 7f5d9ae6f700 1 -- 172.21.15.39:0/2375933376 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5d78064ee0 msgr2=0x7f5d78067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:48.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.548+0000 7f5d9ae6f700 1 --2- 172.21.15.39:0/2375933376 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5d78064ee0 0x7f5d78067390 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5d900090b0 tx=0x7f5d90008030 comp rx=0 tx=0).stop 2023-11-28T11:57:48.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.548+0000 7f5d9ae6f700 1 -- 172.21.15.39:0/2375933376 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d940cd0d0 msgr2=0x7f5d940c5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:48.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.548+0000 7f5d9ae6f700 1 --2- 172.21.15.39:0/2375933376 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d940cd0d0 0x7f5d940c5820 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5d8400e9a0 tx=0x7f5d8400ecb0 comp rx=0 tx=0).stop 2023-11-28T11:57:48.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.548+0000 7f5d9ae6f700 1 -- 172.21.15.39:0/2375933376 shutdown_connections 2023-11-28T11:57:48.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.548+0000 7f5d9ae6f700 1 --2- 172.21.15.39:0/2375933376 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d9415c650 0x7f5d941e3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:48.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.548+0000 7f5d9ae6f700 1 --2- 172.21.15.39:0/2375933376 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d940cd0d0 0x7f5d940c5820 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:48.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.548+0000 7f5d9ae6f700 1 --2- 172.21.15.39:0/2375933376 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5d78064ee0 0x7f5d78067390 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:48.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.548+0000 7f5d9ae6f700 1 --2- 172.21.15.39:0/2375933376 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d940b1b80 0x7f5d94159ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:48.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.548+0000 7f5d9ae6f700 1 -- 172.21.15.39:0/2375933376 >> 172.21.15.39:0/2375933376 conn(0x7f5d940b0f80 msgr2=0x7f5d9406bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:48.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.548+0000 7f5d9ae6f700 1 -- 172.21.15.39:0/2375933376 shutdown_connections 2023-11-28T11:57:48.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.548+0000 7f5d9ae6f700 1 -- 172.21.15.39:0/2375933376 wait complete. 2023-11-28T11:57:48.555 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 9 2023-11-28T11:57:48.576 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:57:48.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.752+0000 7f4adf59e700 1 Processor -- start 2023-11-28T11:57:48.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.752+0000 7f4adf59e700 1 -- start start 2023-11-28T11:57:48.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.752+0000 7f4adf59e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f4ae00b43a0 0x7f4ae015e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:48.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.752+0000 7f4adf59e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4ae00b1640 0x7f4ae0070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:48.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.752+0000 7f4adf59e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ae015a550 con 0x7f4ae00c9040 2023-11-28T11:57:48.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.752+0000 7f4adf59e700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ae006b0a0 con 0x7f4ae00b1640 2023-11-28T11:57:48.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.752+0000 7f4adf59e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ae00caac0 con 0x7f4ae00b43a0 2023-11-28T11:57:48.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.756+0000 7f4ad7fff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4ae00b1640 0x7f4ae0070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:48.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.756+0000 7f4ad7fff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4ae00b1640 0x7f4ae0070080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34174/0 (socket says 172.21.15.39:34174) 2023-11-28T11:57:48.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.756+0000 7f4ad7fff700 1 -- 172.21.15.39:0/1750494777 learned_addr learned my addr 172.21.15.39:0/1750494777 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:48.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.756+0000 7f4ade59c700 1 --2- 172.21.15.39:0/1750494777 >> v2:172.21.15.184:3300/0 conn(0x7f4ae00b43a0 0x7f4ae015e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:48.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.756+0000 7f4ad7fff700 1 -- 172.21.15.39:0/1750494777 >> v2:172.21.15.184:3300/0 conn(0x7f4ae00b43a0 msgr2=0x7f4ae015e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:48.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.756+0000 7f4ad7fff700 1 --2- 172.21.15.39:0/1750494777 >> v2:172.21.15.184:3300/0 conn(0x7f4ae00b43a0 0x7f4ae015e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:48.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.756+0000 7f4ad7fff700 1 -- 172.21.15.39:0/1750494777 >> v1:172.21.15.184:6789/0 conn(0x7f4ae00c9040 legacy=0x7f4ae0069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:48.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.756+0000 7f4ad7fff700 1 -- 172.21.15.39:0/1750494777 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae00cada0 con 0x7f4ae00b1640 2023-11-28T11:57:48.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.756+0000 7f4ad7fff700 1 --2- 172.21.15.39:0/1750494777 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ae00b1640 0x7f4ae0070080 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4ae006fe80 tx=0x7f4ac8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f65da36621b23c54 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:48.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.756+0000 7f4addd9b700 1 -- 172.21.15.39:0/1750494777 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac800b8a0 con 0x7f4ae00b1640 2023-11-28T11:57:48.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.756+0000 7f4addd9b700 1 -- 172.21.15.39:0/1750494777 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac800ba00 con 0x7f4ae00b1640 2023-11-28T11:57:48.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.756+0000 7f4addd9b700 1 -- 172.21.15.39:0/1750494777 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac800bd90 con 0x7f4ae00b1640 2023-11-28T11:57:48.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.756+0000 7f4adf59e700 1 -- 172.21.15.39:0/1750494777 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ae00b1640 msgr2=0x7f4ae0070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:48.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.756+0000 7f4adf59e700 1 --2- 172.21.15.39:0/1750494777 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ae00b1640 0x7f4ae0070080 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4ae006fe80 tx=0x7f4ac8009bf0 comp rx=0 tx=0).stop 2023-11-28T11:57:48.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.756+0000 7f4adf59e700 1 -- 172.21.15.39:0/1750494777 shutdown_connections 2023-11-28T11:57:48.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.756+0000 7f4adf59e700 1 --2- 172.21.15.39:0/1750494777 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ae00b1640 0x7f4ae0070080 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:48.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.756+0000 7f4adf59e700 1 --2- 172.21.15.39:0/1750494777 >> v2:172.21.15.184:3300/0 conn(0x7f4ae00b43a0 0x7f4ae015e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:48.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.756+0000 7f4adf59e700 1 -- 172.21.15.39:0/1750494777 >> 172.21.15.39:0/1750494777 conn(0x7f4ae00b0f80 msgr2=0x7f4ae00ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:48.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.756+0000 7f4adf59e700 1 -- 172.21.15.39:0/1750494777 shutdown_connections 2023-11-28T11:57:48.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.756+0000 7f4adf59e700 1 -- 172.21.15.39:0/1750494777 wait complete. 2023-11-28T11:57:48.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.760+0000 7f4adf59e700 1 Processor -- start 2023-11-28T11:57:48.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.760+0000 7f4adf59e700 1 -- start start 2023-11-28T11:57:48.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.760+0000 7f4adf59e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ae00b1640 0x7f4ae015ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:48.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.760+0000 7f4adf59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ae00b43a0 0x7f4ae015bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:48.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.760+0000 7f4adf59e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ae00c9040 0x7f4ae015c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:48.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.760+0000 7f4adf59e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae00b28d0 con 0x7f4ae00b1640 2023-11-28T11:57:48.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.760+0000 7f4adf59e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae00b2bb0 con 0x7f4ae00c9040 2023-11-28T11:57:48.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.760+0000 7f4adf59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae00b2e90 con 0x7f4ae00b43a0 2023-11-28T11:57:48.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.760+0000 7f4ade59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ae00b1640 0x7f4ae015ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:48.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.760+0000 7f4ade59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ae00b1640 0x7f4ae015ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34178/0 (socket says 172.21.15.39:34178) 2023-11-28T11:57:48.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.760+0000 7f4ade59c700 1 -- 172.21.15.39:0/4251161783 learned_addr learned my addr 172.21.15.39:0/4251161783 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:48.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.760+0000 7f4ad7fff700 1 --2- 172.21.15.39:0/4251161783 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ae00b43a0 0x7f4ae015bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:48.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.760+0000 7f4aded9d700 1 --2- 172.21.15.39:0/4251161783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ae00c9040 0x7f4ae015c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:48.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.764+0000 7f4ade59c700 1 -- 172.21.15.39:0/4251161783 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ae00b43a0 msgr2=0x7f4ae015bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:48.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.764+0000 7f4ade59c700 1 --2- 172.21.15.39:0/4251161783 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ae00b43a0 0x7f4ae015bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:48.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.764+0000 7f4ade59c700 1 -- 172.21.15.39:0/4251161783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ae00c9040 msgr2=0x7f4ae015c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:48.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.764+0000 7f4ade59c700 1 --2- 172.21.15.39:0/4251161783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ae00c9040 0x7f4ae015c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:48.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.764+0000 7f4ade59c700 1 -- 172.21.15.39:0/4251161783 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac8009570 con 0x7f4ae00b1640 2023-11-28T11:57:48.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.764+0000 7f4ade59c700 1 --2- 172.21.15.39:0/4251161783 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ae00b1640 0x7f4ae015ce20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4ad000e810 tx=0x7f4ad000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:48.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.764+0000 7f4ad6ffd700 1 -- 172.21.15.39:0/4251161783 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad000c070 con 0x7f4ae00b1640 2023-11-28T11:57:48.771 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.764+0000 7f4ad6ffd700 1 -- 172.21.15.39:0/4251161783 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad0013610 con 0x7f4ae00b1640 2023-11-28T11:57:48.771 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.764+0000 7f4adf59e700 1 -- 172.21.15.39:0/4251161783 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ae006b5d0 con 0x7f4ae00b1640 2023-11-28T11:57:48.771 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.764+0000 7f4ad6ffd700 1 -- 172.21.15.39:0/4251161783 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad00139c0 con 0x7f4ae00b1640 2023-11-28T11:57:48.771 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.764+0000 7f4adf59e700 1 -- 172.21.15.39:0/4251161783 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ae006b2f0 con 0x7f4ae00b1640 2023-11-28T11:57:48.771 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.764+0000 7f4adf59e700 1 -- 172.21.15.39:0/4251161783 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ae015eb10 con 0x7f4ae00b1640 2023-11-28T11:57:48.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.768+0000 7f4ad6ffd700 1 -- 172.21.15.39:0/4251161783 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4ad0023070 con 0x7f4ae00b1640 2023-11-28T11:57:48.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.768+0000 7f4ad6ffd700 1 --2- 172.21.15.39:0/4251161783 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4ac0064ee0 0x7f4ac0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:48.776 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.768+0000 7f4ad6ffd700 1 -- 172.21.15.39:0/4251161783 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4ad0081ff0 con 0x7f4ae00b1640 2023-11-28T11:57:48.776 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.772+0000 7f4ad7fff700 1 --2- 172.21.15.39:0/4251161783 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4ac0064ee0 0x7f4ac0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:48.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.772+0000 7f4ad7fff700 1 --2- 172.21.15.39:0/4251161783 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4ac0064ee0 0x7f4ac0067390 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8000c00 tx=0x7f4ac8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:48.782 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.776+0000 7f4ad6ffd700 1 -- 172.21.15.39:0/4251161783 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4ad004fdc0 con 0x7f4ae00b1640 2023-11-28T11:57:48.994 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.988+0000 7f4adf59e700 1 -- 172.21.15.39:0/4251161783 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ae00b3280 con 0x7f4ae00b1640 2023-11-28T11:57:48.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.988+0000 7f4ad6ffd700 1 -- 172.21.15.39:0/4251161783 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4647 (secure 0 0 0) 0x7f4ad000f040 con 0x7f4ae00b1640 2023-11-28T11:57:48.995 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:57:48.995 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4265,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1518942402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":1518942402},{"type":"v1","addr":"172.21.15.184:6837","nonce":1518942402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/1834562481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":1834562481},{"type":"v1","addr":"172.21.15.39:6833","nonce":1834562481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2470756838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2470756838},{"type":"v1","addr":"172.21.15.39:6835","nonce":2470756838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:56:39.894634+0000","modified":"2023-11-28T11:56:59.724929+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6835/516507254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":516507254},{"type":"v1","addr":"172.21.15.184:6835","nonce":516507254}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T11:57:48.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.992+0000 7f4adf59e700 1 -- 172.21.15.39:0/4251161783 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4ac0064ee0 msgr2=0x7f4ac0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:48.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.992+0000 7f4adf59e700 1 --2- 172.21.15.39:0/4251161783 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4ac0064ee0 0x7f4ac0067390 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8000c00 tx=0x7f4ac8008030 comp rx=0 tx=0).stop 2023-11-28T11:57:48.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.992+0000 7f4adf59e700 1 -- 172.21.15.39:0/4251161783 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ae00b1640 msgr2=0x7f4ae015ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:48.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.992+0000 7f4adf59e700 1 --2- 172.21.15.39:0/4251161783 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ae00b1640 0x7f4ae015ce20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4ad000e810 tx=0x7f4ad000eb20 comp rx=0 tx=0).stop 2023-11-28T11:57:48.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.992+0000 7f4adf59e700 1 -- 172.21.15.39:0/4251161783 shutdown_connections 2023-11-28T11:57:48.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.992+0000 7f4adf59e700 1 --2- 172.21.15.39:0/4251161783 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4ac0064ee0 0x7f4ac0067390 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:48.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.992+0000 7f4adf59e700 1 --2- 172.21.15.39:0/4251161783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ae00c9040 0x7f4ae015c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:48.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.992+0000 7f4adf59e700 1 --2- 172.21.15.39:0/4251161783 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ae00b43a0 0x7f4ae015bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:48.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.992+0000 7f4adf59e700 1 --2- 172.21.15.39:0/4251161783 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ae00b1640 0x7f4ae015ce20 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:48.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.992+0000 7f4adf59e700 1 -- 172.21.15.39:0/4251161783 >> 172.21.15.39:0/4251161783 conn(0x7f4ae00b0f80 msgr2=0x7f4ae006a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:48.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.992+0000 7f4adf59e700 1 -- 172.21.15.39:0/4251161783 shutdown_connections 2023-11-28T11:57:48.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:48.992+0000 7f4adf59e700 1 -- 172.21.15.39:0/4251161783 wait complete. 2023-11-28T11:57:49.000 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 9 2023-11-28T11:57:49.022 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:57:49.192 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.184+0000 7fe279f41700 1 Processor -- start 2023-11-28T11:57:49.192 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.188+0000 7fe279f41700 1 -- start start 2023-11-28T11:57:49.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.188+0000 7fe279f41700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe2740cf9c0 0x7fe274160600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:49.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.188+0000 7fe279f41700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2740c8110 0x7fe2740c8590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:49.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.188+0000 7fe279f41700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe27406d290 con 0x7fe274145a00 2023-11-28T11:57:49.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.188+0000 7fe279f41700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2740c8ad0 con 0x7fe2740cf9c0 2023-11-28T11:57:49.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.188+0000 7fe279f41700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe27406ccd0 con 0x7fe2740c8110 2023-11-28T11:57:49.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.188+0000 7fe26bfff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe2740cf9c0 0x7fe274160600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:49.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.188+0000 7fe26bfff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe2740cf9c0 0x7fe274160600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34194/0 (socket says 172.21.15.39:34194) 2023-11-28T11:57:49.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.188+0000 7fe26bfff700 1 -- 172.21.15.39:0/1063256485 learned_addr learned my addr 172.21.15.39:0/1063256485 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:49.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.188+0000 7fe279740700 1 --2- 172.21.15.39:0/1063256485 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2740c8110 0x7fe2740c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:49.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.188+0000 7fe26bfff700 1 -- 172.21.15.39:0/1063256485 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2740c8110 msgr2=0x7fe2740c8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:49.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.188+0000 7fe26bfff700 1 --2- 172.21.15.39:0/1063256485 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2740c8110 0x7fe2740c8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:49.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.188+0000 7fe26bfff700 1 -- 172.21.15.39:0/1063256485 >> v1:172.21.15.39:6789/0 conn(0x7fe274145a00 legacy=0x7fe27406c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:49.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.188+0000 7fe26bfff700 1 -- 172.21.15.39:0/1063256485 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe27406cfb0 con 0x7fe2740cf9c0 2023-11-28T11:57:49.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.188+0000 7fe279740700 1 --2- 172.21.15.39:0/1063256485 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2740c8110 0x7fe2740c8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:57:49.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.188+0000 7fe26bfff700 1 --2- 172.21.15.39:0/1063256485 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2740cf9c0 0x7fe274160600 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe264009910 tx=0x7fe264009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6188e403be415fcd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:49.197 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.188+0000 7fe26b7fe700 1 -- 172.21.15.39:0/1063256485 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26400ba60 con 0x7fe2740cf9c0 2023-11-28T11:57:49.197 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.192+0000 7fe26b7fe700 1 -- 172.21.15.39:0/1063256485 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe26400bbc0 con 0x7fe2740cf9c0 2023-11-28T11:57:49.197 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.192+0000 7fe26b7fe700 1 -- 172.21.15.39:0/1063256485 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe264009e60 con 0x7fe2740cf9c0 2023-11-28T11:57:49.197 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.192+0000 7fe279f41700 1 -- 172.21.15.39:0/1063256485 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2740cf9c0 msgr2=0x7fe274160600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:49.197 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.192+0000 7fe279f41700 1 --2- 172.21.15.39:0/1063256485 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2740cf9c0 0x7fe274160600 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe264009910 tx=0x7fe264009c20 comp rx=0 tx=0).stop 2023-11-28T11:57:49.197 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.192+0000 7fe279f41700 1 -- 172.21.15.39:0/1063256485 shutdown_connections 2023-11-28T11:57:49.198 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.192+0000 7fe279f41700 1 --2- 172.21.15.39:0/1063256485 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2740c8110 0x7fe2740c8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:49.198 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.192+0000 7fe279f41700 1 --2- 172.21.15.39:0/1063256485 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2740cf9c0 0x7fe274160600 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:49.198 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.192+0000 7fe279f41700 1 -- 172.21.15.39:0/1063256485 >> 172.21.15.39:0/1063256485 conn(0x7fe2740b1720 msgr2=0x7fe2740cede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:49.198 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.192+0000 7fe279f41700 1 -- 172.21.15.39:0/1063256485 shutdown_connections 2023-11-28T11:57:49.198 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.192+0000 7fe279f41700 1 -- 172.21.15.39:0/1063256485 wait complete. 2023-11-28T11:57:49.199 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.192+0000 7fe279f41700 1 Processor -- start 2023-11-28T11:57:49.199 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.192+0000 7fe279f41700 1 -- start start 2023-11-28T11:57:49.202 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.196+0000 7fe279f41700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2740c8110 0x7fe27413e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:49.202 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.196+0000 7fe279f41700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2740cf9c0 0x7fe2740c9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:49.202 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.196+0000 7fe279f41700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe274145a00 0x7fe2740c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:49.202 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.196+0000 7fe279f41700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2741f1db0 con 0x7fe2740c8110 2023-11-28T11:57:49.202 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.196+0000 7fe279f41700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2741f28d0 con 0x7fe2740cf9c0 2023-11-28T11:57:49.202 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.196+0000 7fe279f41700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2741f2d60 con 0x7fe274145a00 2023-11-28T11:57:49.202 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.196+0000 7fe278f3f700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2740c8110 0x7fe27413e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:49.203 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.196+0000 7fe278f3f700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2740c8110 0x7fe27413e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34206/0 (socket says 172.21.15.39:34206) 2023-11-28T11:57:49.203 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.196+0000 7fe278f3f700 1 -- 172.21.15.39:0/362448415 learned_addr learned my addr 172.21.15.39:0/362448415 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:49.203 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.196+0000 7fe279740700 1 --2- 172.21.15.39:0/362448415 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe274145a00 0x7fe2740c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:49.203 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.196+0000 7fe26bfff700 1 --2- 172.21.15.39:0/362448415 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2740cf9c0 0x7fe2740c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:49.203 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.196+0000 7fe278f3f700 1 -- 172.21.15.39:0/362448415 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe274145a00 msgr2=0x7fe2740c9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:49.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.196+0000 7fe278f3f700 1 --2- 172.21.15.39:0/362448415 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe274145a00 0x7fe2740c9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:49.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.196+0000 7fe278f3f700 1 -- 172.21.15.39:0/362448415 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2740cf9c0 msgr2=0x7fe2740c9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:49.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.196+0000 7fe278f3f700 1 --2- 172.21.15.39:0/362448415 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2740cf9c0 0x7fe2740c9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:49.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.196+0000 7fe278f3f700 1 -- 172.21.15.39:0/362448415 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe264009570 con 0x7fe2740c8110 2023-11-28T11:57:49.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.196+0000 7fe278f3f700 1 --2- 172.21.15.39:0/362448415 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2740c8110 0x7fe27413e790 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe27000c500 tx=0x7fe27000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:49.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.196+0000 7fe2697fa700 1 -- 172.21.15.39:0/362448415 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2700052d0 con 0x7fe2740c8110 2023-11-28T11:57:49.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.196+0000 7fe2697fa700 1 -- 172.21.15.39:0/362448415 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe270005430 con 0x7fe2740c8110 2023-11-28T11:57:49.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.196+0000 7fe2697fa700 1 -- 172.21.15.39:0/362448415 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2700055a0 con 0x7fe2740c8110 2023-11-28T11:57:49.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.196+0000 7fe279f41700 1 -- 172.21.15.39:0/362448415 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2741600e0 con 0x7fe2740c8110 2023-11-28T11:57:49.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.200+0000 7fe279f41700 1 -- 172.21.15.39:0/362448415 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe27415fe00 con 0x7fe2740c8110 2023-11-28T11:57:49.206 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.200+0000 7fe279f41700 1 -- 172.21.15.39:0/362448415 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe274073cb0 con 0x7fe2740c8110 2023-11-28T11:57:49.207 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.200+0000 7fe2697fa700 1 -- 172.21.15.39:0/362448415 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe270019030 con 0x7fe2740c8110 2023-11-28T11:57:49.209 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.204+0000 7fe2697fa700 1 --2- 172.21.15.39:0/362448415 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe260064ee0 0x7fe260067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:49.209 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.204+0000 7fe2697fa700 1 -- 172.21.15.39:0/362448415 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe2700814b0 con 0x7fe2740c8110 2023-11-28T11:57:49.209 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.204+0000 7fe26bfff700 1 --2- 172.21.15.39:0/362448415 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe260064ee0 0x7fe260067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:49.210 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.204+0000 7fe26bfff700 1 --2- 172.21.15.39:0/362448415 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe260064ee0 0x7fe260067390 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe264000c00 tx=0x7fe264008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:49.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.208+0000 7fe2697fa700 1 -- 172.21.15.39:0/362448415 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe27004f320 con 0x7fe2740c8110 2023-11-28T11:57:49.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.384+0000 7fe279f41700 1 -- 172.21.15.39:0/362448415 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe274160ac0 con 0x7fe2740c8110 2023-11-28T11:57:49.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.388+0000 7fe2697fa700 1 -- 172.21.15.39:0/362448415 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+19748 (secure 0 0 0) 0x7fe270052940 con 0x7fe2740c8110 2023-11-28T11:57:49.394 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:57:49.394 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":31,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:57:21.927556+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:56:38.203736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:56:38.946498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:56:41.988334+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.10","mappings":[{"from":1,"to":5}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:57:49.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.392+0000 7fe279f41700 1 -- 172.21.15.39:0/362448415 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe260064ee0 msgr2=0x7fe260067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:49.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.392+0000 7fe279f41700 1 --2- 172.21.15.39:0/362448415 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe260064ee0 0x7fe260067390 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe264000c00 tx=0x7fe264008030 comp rx=0 tx=0).stop 2023-11-28T11:57:49.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.392+0000 7fe279f41700 1 -- 172.21.15.39:0/362448415 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2740c8110 msgr2=0x7fe27413e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:49.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.392+0000 7fe279f41700 1 --2- 172.21.15.39:0/362448415 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2740c8110 0x7fe27413e790 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe27000c500 tx=0x7fe27000c810 comp rx=0 tx=0).stop 2023-11-28T11:57:49.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.392+0000 7fe279f41700 1 -- 172.21.15.39:0/362448415 shutdown_connections 2023-11-28T11:57:49.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.392+0000 7fe279f41700 1 --2- 172.21.15.39:0/362448415 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe274145a00 0x7fe2740c9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:49.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.392+0000 7fe279f41700 1 --2- 172.21.15.39:0/362448415 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe260064ee0 0x7fe260067390 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:49.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.392+0000 7fe279f41700 1 --2- 172.21.15.39:0/362448415 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2740cf9c0 0x7fe2740c9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:49.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.392+0000 7fe279f41700 1 --2- 172.21.15.39:0/362448415 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2740c8110 0x7fe27413e790 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:49.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.392+0000 7fe279f41700 1 -- 172.21.15.39:0/362448415 >> 172.21.15.39:0/362448415 conn(0x7fe2740b1720 msgr2=0x7fe274060660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:49.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.392+0000 7fe279f41700 1 -- 172.21.15.39:0/362448415 shutdown_connections 2023-11-28T11:57:49.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.392+0000 7fe279f41700 1 -- 172.21.15.39:0/362448415 wait complete. 2023-11-28T11:57:49.421 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T11:57:49.600 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.592+0000 7f59030d8700 1 Processor -- start 2023-11-28T11:57:49.600 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.592+0000 7f59030d8700 1 -- start start 2023-11-28T11:57:49.601 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.596+0000 7f59030d8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f58fc0b1640 0x7f58fc070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:49.601 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.596+0000 7f59030d8700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f58fc0c9040 0x7f58fc0705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:49.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.596+0000 7f59030d8700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58fc15a550 con 0x7f58fc0b43a0 2023-11-28T11:57:49.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.596+0000 7f59030d8700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58fc06b0a0 con 0x7f58fc0c9040 2023-11-28T11:57:49.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.596+0000 7f59030d8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc0caac0 con 0x7f58fc0b1640 2023-11-28T11:57:49.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.596+0000 7f59028d7700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f58fc0c9040 0x7f58fc0705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:49.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.596+0000 7f59028d7700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f58fc0c9040 0x7f58fc0705c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34216/0 (socket says 172.21.15.39:34216) 2023-11-28T11:57:49.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.596+0000 7f59028d7700 1 -- 172.21.15.39:0/3434605189 learned_addr learned my addr 172.21.15.39:0/3434605189 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:49.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.596+0000 7f59020d6700 1 --1- 172.21.15.39:0/3434605189 >> v1:172.21.15.184:6789/0 conn(0x7f58fc0b43a0 0x7f58fc15e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:36902/0 (socket says 172.21.15.39:36902) 2023-11-28T11:57:49.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.596+0000 7f59018d5700 1 --2- 172.21.15.39:0/3434605189 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f58fc0b1640 0x7f58fc070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:49.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.596+0000 7f59028d7700 1 -- 172.21.15.39:0/3434605189 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f58fc0b1640 msgr2=0x7f58fc070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:49.604 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.596+0000 7f59028d7700 1 --2- 172.21.15.39:0/3434605189 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f58fc0b1640 0x7f58fc070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:49.604 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.596+0000 7f59028d7700 1 -- 172.21.15.39:0/3434605189 >> v1:172.21.15.184:6789/0 conn(0x7f58fc0b43a0 legacy=0x7f58fc15e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:49.604 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.596+0000 7f59010d4700 1 -- 172.21.15.39:0/3434605189 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4109636652 0 0) 0x7f58f8001110 con 0x7f58fc0b43a0 2023-11-28T11:57:49.604 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.596+0000 7f59028d7700 1 -- 172.21.15.39:0/3434605189 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58fc0cada0 con 0x7f58fc0c9040 2023-11-28T11:57:49.604 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.596+0000 7f59028d7700 1 --2- 172.21.15.39:0/3434605189 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58fc0c9040 0x7f58fc0705c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f58f4009e50 tx=0x7f58f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8821e9a8b4611b63 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:49.605 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.600+0000 7f59010d4700 1 -- 172.21.15.39:0/3434605189 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f400e070 con 0x7f58fc0c9040 2023-11-28T11:57:49.605 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.600+0000 7f59010d4700 1 -- 172.21.15.39:0/3434605189 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f400b910 con 0x7f58fc0c9040 2023-11-28T11:57:49.605 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.600+0000 7f59010d4700 1 -- 172.21.15.39:0/3434605189 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f400bcc0 con 0x7f58fc0c9040 2023-11-28T11:57:49.605 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.600+0000 7f59030d8700 1 -- 172.21.15.39:0/3434605189 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58fc0c9040 msgr2=0x7f58fc0705c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:49.605 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.600+0000 7f59030d8700 1 --2- 172.21.15.39:0/3434605189 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58fc0c9040 0x7f58fc0705c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f58f4009e50 tx=0x7f58f400b330 comp rx=0 tx=0).stop 2023-11-28T11:57:49.606 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.600+0000 7f59030d8700 1 -- 172.21.15.39:0/3434605189 shutdown_connections 2023-11-28T11:57:49.606 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.600+0000 7f59030d8700 1 --2- 172.21.15.39:0/3434605189 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58fc0c9040 0x7f58fc0705c0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:49.606 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.600+0000 7f59030d8700 1 --2- 172.21.15.39:0/3434605189 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f58fc0b1640 0x7f58fc070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:49.606 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.600+0000 7f59030d8700 1 -- 172.21.15.39:0/3434605189 >> 172.21.15.39:0/3434605189 conn(0x7f58fc0b0f80 msgr2=0x7f58fc0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:49.606 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.600+0000 7f59030d8700 1 -- 172.21.15.39:0/3434605189 shutdown_connections 2023-11-28T11:57:49.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.600+0000 7f59030d8700 1 -- 172.21.15.39:0/3434605189 wait complete. 2023-11-28T11:57:49.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.604+0000 7f59030d8700 1 Processor -- start 2023-11-28T11:57:49.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.604+0000 7f59030d8700 1 -- start start 2023-11-28T11:57:49.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.604+0000 7f59030d8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58fc0b1640 0x7f58fc14d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:49.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.604+0000 7f59030d8700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58fc0b43a0 0x7f58fc15b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:49.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.604+0000 7f59030d8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f58fc0c9040 0x7f58fc15b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:49.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.604+0000 7f59030d8700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc0aca60 con 0x7f58fc0b43a0 2023-11-28T11:57:49.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.604+0000 7f59030d8700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc0ce330 con 0x7f58fc0b1640 2023-11-28T11:57:49.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.604+0000 7f59030d8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc0ce050 con 0x7f58fc0c9040 2023-11-28T11:57:49.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.604+0000 7f59018d5700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58fc0b43a0 0x7f58fc15b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:49.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.604+0000 7f59018d5700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58fc0b43a0 0x7f58fc15b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34226/0 (socket says 172.21.15.39:34226) 2023-11-28T11:57:49.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.604+0000 7f59018d5700 1 -- 172.21.15.39:0/3059426981 learned_addr learned my addr 172.21.15.39:0/3059426981 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:49.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.608+0000 7f59028d7700 1 --2- 172.21.15.39:0/3059426981 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f58fc0c9040 0x7f58fc15b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:49.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.608+0000 7f59020d6700 1 --2- 172.21.15.39:0/3059426981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58fc0b1640 0x7f58fc14d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:49.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.608+0000 7f59018d5700 1 -- 172.21.15.39:0/3059426981 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f58fc0c9040 msgr2=0x7f58fc15b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:49.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.608+0000 7f59018d5700 1 --2- 172.21.15.39:0/3059426981 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f58fc0c9040 0x7f58fc15b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:49.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.608+0000 7f59018d5700 1 -- 172.21.15.39:0/3059426981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58fc0b1640 msgr2=0x7f58fc14d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:49.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.608+0000 7f59018d5700 1 --2- 172.21.15.39:0/3059426981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58fc0b1640 0x7f58fc14d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:49.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.608+0000 7f59018d5700 1 -- 172.21.15.39:0/3059426981 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f4009b30 con 0x7f58fc0b43a0 2023-11-28T11:57:49.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.608+0000 7f59020d6700 1 --2- 172.21.15.39:0/3059426981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58fc0b1640 0x7f58fc14d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:57:49.615 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.608+0000 7f59018d5700 1 --2- 172.21.15.39:0/3059426981 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58fc0b43a0 0x7f58fc15b2a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f58ec00e840 tx=0x7f58ec00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:49.615 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.608+0000 7f58f2ffd700 1 -- 172.21.15.39:0/3059426981 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ec0095a0 con 0x7f58fc0b43a0 2023-11-28T11:57:49.615 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.608+0000 7f58f2ffd700 1 -- 172.21.15.39:0/3059426981 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58ec00c690 con 0x7f58fc0b43a0 2023-11-28T11:57:49.615 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.608+0000 7f59030d8700 1 -- 172.21.15.39:0/3059426981 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58fc06b5d0 con 0x7f58fc0b43a0 2023-11-28T11:57:49.615 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.608+0000 7f58f2ffd700 1 -- 172.21.15.39:0/3059426981 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ec00ca00 con 0x7f58fc0b43a0 2023-11-28T11:57:49.615 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.608+0000 7f59030d8700 1 -- 172.21.15.39:0/3059426981 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58fc06b2f0 con 0x7f58fc0b43a0 2023-11-28T11:57:49.615 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.608+0000 7f59030d8700 1 -- 172.21.15.39:0/3059426981 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58fc0ca7b0 con 0x7f58fc0b43a0 2023-11-28T11:57:49.616 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.608+0000 7f58f2ffd700 1 -- 172.21.15.39:0/3059426981 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f58ec019030 con 0x7f58fc0b43a0 2023-11-28T11:57:49.617 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.612+0000 7f58f2ffd700 1 --2- 172.21.15.39:0/3059426981 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f58e0064ee0 0x7f58e0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:49.617 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.612+0000 7f58f2ffd700 1 -- 172.21.15.39:0/3059426981 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f58ec082080 con 0x7f58fc0b43a0 2023-11-28T11:57:49.618 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.612+0000 7f59020d6700 1 --2- 172.21.15.39:0/3059426981 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f58e0064ee0 0x7f58e0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:49.619 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.612+0000 7f59020d6700 1 --2- 172.21.15.39:0/3059426981 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f58e0064ee0 0x7f58e0067390 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f58f8000f60 tx=0x7f58f8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:49.623 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.616+0000 7f58f2ffd700 1 -- 172.21.15.39:0/3059426981 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f58ec04fe90 con 0x7f58fc0b43a0 2023-11-28T11:57:49.835 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:49.828+0000 7f59030d8700 1 -- 172.21.15.39:0/3059426981 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f58fc073cb0 con 0x7f58fc0b43a0 2023-11-28T11:57:50.186 INFO:tasks.ceph.mon.a.smithi039.stderr:2023-11-28T11:57:50.180+0000 7ff4e35f9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T11:57:50.206 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.200+0000 7f58f2ffd700 1 -- 172.21.15.39:0/3059426981 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f58ec0534b0 con 0x7f58fc0b43a0 2023-11-28T11:57:50.210 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.204+0000 7f59030d8700 1 -- 172.21.15.39:0/3059426981 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f58e0064ee0 msgr2=0x7f58e0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:50.210 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.204+0000 7f59030d8700 1 --2- 172.21.15.39:0/3059426981 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f58e0064ee0 0x7f58e0067390 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f58f8000f60 tx=0x7f58f8009040 comp rx=0 tx=0).stop 2023-11-28T11:57:50.210 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.204+0000 7f59030d8700 1 -- 172.21.15.39:0/3059426981 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58fc0b43a0 msgr2=0x7f58fc15b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:50.210 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.204+0000 7f59030d8700 1 --2- 172.21.15.39:0/3059426981 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58fc0b43a0 0x7f58fc15b2a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f58ec00e840 tx=0x7f58ec00ec00 comp rx=0 tx=0).stop 2023-11-28T11:57:50.210 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.204+0000 7f59030d8700 1 -- 172.21.15.39:0/3059426981 shutdown_connections 2023-11-28T11:57:50.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.204+0000 7f59030d8700 1 --2- 172.21.15.39:0/3059426981 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f58fc0c9040 0x7f58fc15b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:50.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.204+0000 7f59030d8700 1 --2- 172.21.15.39:0/3059426981 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58fc0b43a0 0x7f58fc15b2a0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:50.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.204+0000 7f59030d8700 1 --2- 172.21.15.39:0/3059426981 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f58e0064ee0 0x7f58e0067390 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:50.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.204+0000 7f59030d8700 1 --2- 172.21.15.39:0/3059426981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58fc0b1640 0x7f58fc14d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:50.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.204+0000 7f59030d8700 1 -- 172.21.15.39:0/3059426981 >> 172.21.15.39:0/3059426981 conn(0x7f58fc0b0f80 msgr2=0x7f58fc0ae720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:50.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.204+0000 7f59030d8700 1 -- 172.21.15.39:0/3059426981 shutdown_connections 2023-11-28T11:57:50.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.204+0000 7f59030d8700 1 -- 172.21.15.39:0/3059426981 wait complete. 2023-11-28T11:57:50.212 INFO:teuthology.orchestra.run.smithi039.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T11:57:50.220 INFO:tasks.ceph.mds.b.smithi184.stderr: -4989> 2023-11-28T11:56:45.570+0000 7f93306bf700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T11:57:50.235 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-28T11:57:50.285 INFO:tasks.ceph.mds.b.smithi184.stdout:starting mds.b at 2023-11-28T11:57:50.417 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.412+0000 7f7b68701700 1 Processor -- start 2023-11-28T11:57:50.417 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.412+0000 7f7b68701700 1 -- start start 2023-11-28T11:57:50.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.412+0000 7f7b68701700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7b600cc920 0x7f7b6015e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:50.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.412+0000 7f7b68701700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b600cafe0 0x7f7b600cb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:50.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.412+0000 7f7b68701700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b600b27d0 con 0x7f7b6006a6e0 2023-11-28T11:57:50.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.412+0000 7f7b68701700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b600cab50 con 0x7f7b600cc920 2023-11-28T11:57:50.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.412+0000 7f7b68701700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b600ca570 con 0x7f7b600cafe0 2023-11-28T11:57:50.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.412+0000 7f7b6649d700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7b600cc920 0x7f7b6015e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:50.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.412+0000 7f7b6649d700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7b600cc920 0x7f7b6015e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34240/0 (socket says 172.21.15.39:34240) 2023-11-28T11:57:50.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.412+0000 7f7b6649d700 1 -- 172.21.15.39:0/3135617489 learned_addr learned my addr 172.21.15.39:0/3135617489 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:50.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.416+0000 7f7b66c9e700 1 --2- 172.21.15.39:0/3135617489 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b600cafe0 0x7f7b600cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:50.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.416+0000 7f7b6649d700 1 -- 172.21.15.39:0/3135617489 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b600cafe0 msgr2=0x7f7b600cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:50.422 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.416+0000 7f7b6649d700 1 --2- 172.21.15.39:0/3135617489 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b600cafe0 0x7f7b600cb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:50.422 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.416+0000 7f7b6649d700 1 -- 172.21.15.39:0/3135617489 >> v1:172.21.15.184:6789/0 conn(0x7f7b6006a6e0 legacy=0x7f7b600cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:50.422 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.416+0000 7f7b6649d700 1 -- 172.21.15.39:0/3135617489 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b6015ec30 con 0x7f7b600cc920 2023-11-28T11:57:50.422 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.416+0000 7f7b66c9e700 1 --2- 172.21.15.39:0/3135617489 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b600cafe0 0x7f7b600cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:50.422 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.416+0000 7f7b6549b700 1 -- 172.21.15.39:0/3135617489 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1473195607 0 0) 0x7f7b600b27d0 con 0x7f7b6006a6e0 2023-11-28T11:57:50.422 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.416+0000 7f7b6649d700 1 --2- 172.21.15.39:0/3135617489 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b600cc920 0x7f7b6015e6f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c009910 tx=0x7f7b5c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8fd60b6e1bf08f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:50.423 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.416+0000 7f7b6549b700 1 -- 172.21.15.39:0/3135617489 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c011830 con 0x7f7b600cc920 2023-11-28T11:57:50.423 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.416+0000 7f7b6549b700 1 -- 172.21.15.39:0/3135617489 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5c011990 con 0x7f7b600cc920 2023-11-28T11:57:50.423 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.416+0000 7f7b6549b700 1 -- 172.21.15.39:0/3135617489 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c011d40 con 0x7f7b600cc920 2023-11-28T11:57:50.423 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.416+0000 7f7b68701700 1 -- 172.21.15.39:0/3135617489 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b600cc920 msgr2=0x7f7b6015e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:50.423 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.416+0000 7f7b68701700 1 --2- 172.21.15.39:0/3135617489 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b600cc920 0x7f7b6015e6f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c009910 tx=0x7f7b5c009c20 comp rx=0 tx=0).stop 2023-11-28T11:57:50.424 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.416+0000 7f7b68701700 1 -- 172.21.15.39:0/3135617489 shutdown_connections 2023-11-28T11:57:50.424 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.416+0000 7f7b68701700 1 --2- 172.21.15.39:0/3135617489 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b600cafe0 0x7f7b600cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:50.424 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.416+0000 7f7b68701700 1 --2- 172.21.15.39:0/3135617489 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b600cc920 0x7f7b6015e6f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:50.424 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.416+0000 7f7b68701700 1 -- 172.21.15.39:0/3135617489 >> 172.21.15.39:0/3135617489 conn(0x7f7b6006e2e0 msgr2=0x7f7b6006e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:50.424 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.420+0000 7f7b68701700 1 -- 172.21.15.39:0/3135617489 shutdown_connections 2023-11-28T11:57:50.424 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.420+0000 7f7b68701700 1 -- 172.21.15.39:0/3135617489 wait complete. 2023-11-28T11:57:50.426 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.420+0000 7f7b68701700 1 Processor -- start 2023-11-28T11:57:50.427 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.420+0000 7f7b68701700 1 -- start start 2023-11-28T11:57:50.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.424+0000 7f7b68701700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b6006a6e0 0x7f7b600ce720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:50.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.424+0000 7f7b68701700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b600cafe0 0x7f7b600b4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:50.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.424+0000 7f7b68701700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b600cc920 0x7f7b600b4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:50.429 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.424+0000 7f7b68701700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b600ce300 con 0x7f7b600cafe0 2023-11-28T11:57:50.429 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.424+0000 7f7b68701700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b600cd680 con 0x7f7b6006a6e0 2023-11-28T11:57:50.429 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.424+0000 7f7b68701700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b600cd960 con 0x7f7b600cc920 2023-11-28T11:57:50.430 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.424+0000 7f7b65c9c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b600cafe0 0x7f7b600b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:50.430 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.424+0000 7f7b65c9c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b600cafe0 0x7f7b600b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34246/0 (socket says 172.21.15.39:34246) 2023-11-28T11:57:50.430 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.424+0000 7f7b65c9c700 1 -- 172.21.15.39:0/1170411694 learned_addr learned my addr 172.21.15.39:0/1170411694 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:50.430 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.424+0000 7f7b66c9e700 1 --2- 172.21.15.39:0/1170411694 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b600cc920 0x7f7b600b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:50.430 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.424+0000 7f7b6649d700 1 --2- 172.21.15.39:0/1170411694 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b6006a6e0 0x7f7b600ce720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:50.430 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.424+0000 7f7b65c9c700 1 -- 172.21.15.39:0/1170411694 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b600cc920 msgr2=0x7f7b600b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:50.430 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.424+0000 7f7b65c9c700 1 --2- 172.21.15.39:0/1170411694 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b600cc920 0x7f7b600b4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:50.430 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.424+0000 7f7b65c9c700 1 -- 172.21.15.39:0/1170411694 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b6006a6e0 msgr2=0x7f7b600ce720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:50.431 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.424+0000 7f7b65c9c700 1 --2- 172.21.15.39:0/1170411694 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b6006a6e0 0x7f7b600ce720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:50.431 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.424+0000 7f7b65c9c700 1 -- 172.21.15.39:0/1170411694 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b58009a70 con 0x7f7b600cafe0 2023-11-28T11:57:50.431 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.424+0000 7f7b65c9c700 1 --2- 172.21.15.39:0/1170411694 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b600cafe0 0x7f7b600b4250 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7b5000c540 tx=0x7f7b5000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:50.431 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.424+0000 7f7b56ffd700 1 -- 172.21.15.39:0/1170411694 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b500054e0 con 0x7f7b600cafe0 2023-11-28T11:57:50.431 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.424+0000 7f7b56ffd700 1 -- 172.21.15.39:0/1170411694 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b500036a0 con 0x7f7b600cafe0 2023-11-28T11:57:50.432 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.424+0000 7f7b68701700 1 -- 172.21.15.39:0/1170411694 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b5c009570 con 0x7f7b600cafe0 2023-11-28T11:57:50.432 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.424+0000 7f7b56ffd700 1 -- 172.21.15.39:0/1170411694 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b50003a50 con 0x7f7b600cafe0 2023-11-28T11:57:50.432 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.424+0000 7f7b68701700 1 -- 172.21.15.39:0/1170411694 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b600ca7e0 con 0x7f7b600cafe0 2023-11-28T11:57:50.432 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.428+0000 7f7b68701700 1 -- 172.21.15.39:0/1170411694 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b6006c320 con 0x7f7b600cafe0 2023-11-28T11:57:50.433 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.428+0000 7f7b56ffd700 1 -- 172.21.15.39:0/1170411694 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7b50019030 con 0x7f7b600cafe0 2023-11-28T11:57:50.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.428+0000 7f7b56ffd700 1 --2- 172.21.15.39:0/1170411694 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7b44064ee0 0x7f7b44067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:50.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.428+0000 7f7b56ffd700 1 -- 172.21.15.39:0/1170411694 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6957+0+0 (secure 0 0 0) 0x7f7b50081530 con 0x7f7b600cafe0 2023-11-28T11:57:50.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.432+0000 7f7b6649d700 1 --2- 172.21.15.39:0/1170411694 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7b44064ee0 0x7f7b44067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:50.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.432+0000 7f7b6649d700 1 --2- 172.21.15.39:0/1170411694 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7b44064ee0 0x7f7b44067390 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c014040 tx=0x7f7b5c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:50.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.436+0000 7f7b56ffd700 1 -- 172.21.15.39:0/1170411694 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7b5004f410 con 0x7f7b600cafe0 2023-11-28T11:57:50.652 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:50.644+0000 7f7b68701700 1 -- 172.21.15.39:0/1170411694 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7b6006c010 con 0x7f7b600cafe0 2023-11-28T11:57:51.208 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.204+0000 7f7b56ffd700 1 -- 172.21.15.39:0/1170411694 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7b50052a30 con 0x7f7b600cafe0 2023-11-28T11:57:51.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.208+0000 7f7b68701700 1 -- 172.21.15.39:0/1170411694 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7b44064ee0 msgr2=0x7f7b44067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:51.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.208+0000 7f7b68701700 1 --2- 172.21.15.39:0/1170411694 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7b44064ee0 0x7f7b44067390 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c014040 tx=0x7f7b5c008030 comp rx=0 tx=0).stop 2023-11-28T11:57:51.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.208+0000 7f7b68701700 1 -- 172.21.15.39:0/1170411694 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b600cafe0 msgr2=0x7f7b600b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:51.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.208+0000 7f7b68701700 1 --2- 172.21.15.39:0/1170411694 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b600cafe0 0x7f7b600b4250 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7b5000c540 tx=0x7f7b5000c850 comp rx=0 tx=0).stop 2023-11-28T11:57:51.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.208+0000 7f7b68701700 1 -- 172.21.15.39:0/1170411694 shutdown_connections 2023-11-28T11:57:51.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.208+0000 7f7b68701700 1 --2- 172.21.15.39:0/1170411694 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b600cc920 0x7f7b600b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:51.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.208+0000 7f7b68701700 1 --2- 172.21.15.39:0/1170411694 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b600cafe0 0x7f7b600b4250 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:51.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.208+0000 7f7b68701700 1 --2- 172.21.15.39:0/1170411694 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7b44064ee0 0x7f7b44067390 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:51.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.208+0000 7f7b68701700 1 --2- 172.21.15.39:0/1170411694 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b6006a6e0 0x7f7b600ce720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:51.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.208+0000 7f7b68701700 1 -- 172.21.15.39:0/1170411694 >> 172.21.15.39:0/1170411694 conn(0x7f7b6006e2e0 msgr2=0x7f7b600b2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:51.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.208+0000 7f7b68701700 1 -- 172.21.15.39:0/1170411694 shutdown_connections 2023-11-28T11:57:51.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.208+0000 7f7b68701700 1 -- 172.21.15.39:0/1170411694 wait complete. 2023-11-28T11:57:51.239 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-28T11:57:51.426 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.420+0000 7ff0f10c3700 1 Processor -- start 2023-11-28T11:57:51.427 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.420+0000 7ff0f10c3700 1 -- start start 2023-11-28T11:57:51.430 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.424+0000 7ff0f10c3700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff0ec142650 0x7ff0ec142fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:51.430 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.424+0000 7ff0f10c3700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff0ec0b5a00 0x7ff0ec0b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:51.430 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.424+0000 7ff0f10c3700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0ec0b6370 con 0x7ff0ec06aab0 2023-11-28T11:57:51.430 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.424+0000 7ff0f10c3700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0ec06b8d0 con 0x7ff0ec142650 2023-11-28T11:57:51.430 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.424+0000 7ff0f10c3700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec06bb70 con 0x7ff0ec0b5a00 2023-11-28T11:57:51.431 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.424+0000 7ff0eb59e700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7ff0ec06aab0 0x7ff0ec06af10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60396/0 (socket says 172.21.15.39:60396) 2023-11-28T11:57:51.431 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.424+0000 7ff0eb59e700 1 -- 172.21.15.39:0/1413538452 learned_addr learned my addr 172.21.15.39:0/1413538452 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:51.431 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.424+0000 7ff0ea59c700 1 --2- 172.21.15.39:0/1413538452 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff0ec0b5a00 0x7ff0ec0b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:51.431 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.424+0000 7ff0ead9d700 1 --2- 172.21.15.39:0/1413538452 >> v2:172.21.15.184:3300/0 conn(0x7ff0ec142650 0x7ff0ec142fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:51.432 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.424+0000 7ff0e9d9b700 1 -- 172.21.15.39:0/1413538452 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1203725602 0 0) 0x7ff0ec0b6370 con 0x7ff0ec06aab0 2023-11-28T11:57:51.432 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.424+0000 7ff0e9d9b700 1 -- 172.21.15.39:0/1413538452 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0d40035d0 con 0x7ff0ec06aab0 2023-11-28T11:57:51.432 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.424+0000 7ff0ead9d700 1 -- 172.21.15.39:0/1413538452 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff0ec0b5a00 msgr2=0x7ff0ec0b5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:51.432 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.424+0000 7ff0ead9d700 1 --2- 172.21.15.39:0/1413538452 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff0ec0b5a00 0x7ff0ec0b5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:51.432 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.424+0000 7ff0ead9d700 1 -- 172.21.15.39:0/1413538452 >> v1:172.21.15.39:6789/0 conn(0x7ff0ec06aab0 legacy=0x7ff0ec06af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:51.432 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.424+0000 7ff0ead9d700 1 -- 172.21.15.39:0/1413538452 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ec06be50 con 0x7ff0ec142650 2023-11-28T11:57:51.433 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.428+0000 7ff0ead9d700 1 --2- 172.21.15.39:0/1413538452 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0ec142650 0x7ff0ec142fa0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc009850 tx=0x7ff0dc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c99f4f93cdc8da70 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:51.433 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.428+0000 7ff0e9d9b700 1 -- 172.21.15.39:0/1413538452 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc011830 con 0x7ff0ec142650 2023-11-28T11:57:51.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.428+0000 7ff0e9d9b700 1 -- 172.21.15.39:0/1413538452 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0dc011990 con 0x7ff0ec142650 2023-11-28T11:57:51.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.428+0000 7ff0e9d9b700 1 -- 172.21.15.39:0/1413538452 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc011d40 con 0x7ff0ec142650 2023-11-28T11:57:51.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.428+0000 7ff0f10c3700 1 -- 172.21.15.39:0/1413538452 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0ec142650 msgr2=0x7ff0ec142fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:51.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.428+0000 7ff0f10c3700 1 --2- 172.21.15.39:0/1413538452 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0ec142650 0x7ff0ec142fa0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc009850 tx=0x7ff0dc009b60 comp rx=0 tx=0).stop 2023-11-28T11:57:51.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.428+0000 7ff0f10c3700 1 -- 172.21.15.39:0/1413538452 shutdown_connections 2023-11-28T11:57:51.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.428+0000 7ff0f10c3700 1 --2- 172.21.15.39:0/1413538452 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff0ec0b5a00 0x7ff0ec0b5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:51.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.428+0000 7ff0f10c3700 1 --2- 172.21.15.39:0/1413538452 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0ec142650 0x7ff0ec142fa0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:51.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.428+0000 7ff0f10c3700 1 -- 172.21.15.39:0/1413538452 >> 172.21.15.39:0/1413538452 conn(0x7ff0ec0b5390 msgr2=0x7ff0ec0d2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:51.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.428+0000 7ff0f10c3700 1 -- 172.21.15.39:0/1413538452 shutdown_connections 2023-11-28T11:57:51.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.428+0000 7ff0f10c3700 1 -- 172.21.15.39:0/1413538452 wait complete. 2023-11-28T11:57:51.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.432+0000 7ff0f10c3700 1 Processor -- start 2023-11-28T11:57:51.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.432+0000 7ff0f10c3700 1 -- start start 2023-11-28T11:57:51.439 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.432+0000 7ff0f10c3700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff0ec06aab0 0x7ff0ec1433b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:51.439 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.432+0000 7ff0f10c3700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0ec0b5a00 0x7ff0ec140fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:51.439 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.432+0000 7ff0f10c3700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0ec142650 0x7ff0ec141500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:51.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.432+0000 7ff0f10c3700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec141a40 con 0x7ff0ec142650 2023-11-28T11:57:51.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.432+0000 7ff0f10c3700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec1f5f30 con 0x7ff0ec0b5a00 2023-11-28T11:57:51.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.432+0000 7ff0f10c3700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec1f5170 con 0x7ff0ec06aab0 2023-11-28T11:57:51.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.432+0000 7ff0eb59e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0ec142650 0x7ff0ec141500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:51.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.432+0000 7ff0eb59e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0ec142650 0x7ff0ec141500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34254/0 (socket says 172.21.15.39:34254) 2023-11-28T11:57:51.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.432+0000 7ff0eb59e700 1 -- 172.21.15.39:0/4037385234 learned_addr learned my addr 172.21.15.39:0/4037385234 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:51.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.432+0000 7ff0ea59c700 1 --2- 172.21.15.39:0/4037385234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0ec0b5a00 0x7ff0ec140fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:51.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.432+0000 7ff0ead9d700 1 --2- 172.21.15.39:0/4037385234 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff0ec06aab0 0x7ff0ec1433b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:51.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.436+0000 7ff0eb59e700 1 -- 172.21.15.39:0/4037385234 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff0ec06aab0 msgr2=0x7ff0ec1433b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:51.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.436+0000 7ff0eb59e700 1 --2- 172.21.15.39:0/4037385234 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff0ec06aab0 0x7ff0ec1433b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:51.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.436+0000 7ff0eb59e700 1 -- 172.21.15.39:0/4037385234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0ec0b5a00 msgr2=0x7ff0ec140fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:51.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.436+0000 7ff0eb59e700 1 --2- 172.21.15.39:0/4037385234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0ec0b5a00 0x7ff0ec140fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:51.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.436+0000 7ff0eb59e700 1 -- 172.21.15.39:0/4037385234 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0dc0094b0 con 0x7ff0ec142650 2023-11-28T11:57:51.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.436+0000 7ff0eb59e700 1 --2- 172.21.15.39:0/4037385234 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0ec142650 0x7ff0ec141500 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff0e400cae0 tx=0x7ff0e400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:51.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.436+0000 7ff0d37fe700 1 -- 172.21.15.39:0/4037385234 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4007480 con 0x7ff0ec142650 2023-11-28T11:57:51.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.436+0000 7ff0d37fe700 1 -- 172.21.15.39:0/4037385234 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e40075e0 con 0x7ff0ec142650 2023-11-28T11:57:51.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.436+0000 7ff0d37fe700 1 -- 172.21.15.39:0/4037385234 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4007950 con 0x7ff0ec142650 2023-11-28T11:57:51.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.436+0000 7ff0f10c3700 1 -- 172.21.15.39:0/4037385234 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0ec06c410 con 0x7ff0ec142650 2023-11-28T11:57:51.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.436+0000 7ff0f10c3700 1 -- 172.21.15.39:0/4037385234 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0ec06c130 con 0x7ff0ec142650 2023-11-28T11:57:51.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.436+0000 7ff0f10c3700 1 -- 172.21.15.39:0/4037385234 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0ec142a20 con 0x7ff0ec142650 2023-11-28T11:57:51.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.440+0000 7ff0d37fe700 1 -- 172.21.15.39:0/4037385234 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff0e4019030 con 0x7ff0ec142650 2023-11-28T11:57:51.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.440+0000 7ff0d37fe700 1 --2- 172.21.15.39:0/4037385234 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff0d8064ee0 0x7ff0d8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:51.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.440+0000 7ff0d37fe700 1 -- 172.21.15.39:0/4037385234 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6957+0+0 (secure 0 0 0) 0x7ff0e40819d0 con 0x7ff0ec142650 2023-11-28T11:57:51.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.440+0000 7ff0ead9d700 1 --2- 172.21.15.39:0/4037385234 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff0d8064ee0 0x7ff0d8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:51.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.444+0000 7ff0ead9d700 1 --2- 172.21.15.39:0/4037385234 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff0d8064ee0 0x7ff0d8067390 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc0090b0 tx=0x7ff0dc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:51.452 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.448+0000 7ff0d37fe700 1 -- 172.21.15.39:0/4037385234 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff0e404a400 con 0x7ff0ec142650 2023-11-28T11:57:51.628 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:51.624+0000 7ff0f10c3700 1 -- 172.21.15.39:0/4037385234 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff0ec1f5c50 con 0x7ff0ec142650 2023-11-28T11:57:52.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.308+0000 7ff0d37fe700 1 -- 172.21.15.39:0/4037385234 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v33) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff0ec1f5c50 con 0x7ff0ec142650 2023-11-28T11:57:52.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.312+0000 7ff0f10c3700 1 -- 172.21.15.39:0/4037385234 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff0d8064ee0 msgr2=0x7ff0d8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:52.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.312+0000 7ff0f10c3700 1 --2- 172.21.15.39:0/4037385234 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff0d8064ee0 0x7ff0d8067390 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc0090b0 tx=0x7ff0dc008030 comp rx=0 tx=0).stop 2023-11-28T11:57:52.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.316+0000 7ff0f10c3700 1 -- 172.21.15.39:0/4037385234 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0ec142650 msgr2=0x7ff0ec141500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:52.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.316+0000 7ff0f10c3700 1 --2- 172.21.15.39:0/4037385234 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0ec142650 0x7ff0ec141500 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff0e400cae0 tx=0x7ff0e400cb10 comp rx=0 tx=0).stop 2023-11-28T11:57:52.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.316+0000 7ff0f10c3700 1 -- 172.21.15.39:0/4037385234 shutdown_connections 2023-11-28T11:57:52.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.316+0000 7ff0f10c3700 1 --2- 172.21.15.39:0/4037385234 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0ec142650 0x7ff0ec141500 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:52.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.316+0000 7ff0f10c3700 1 --2- 172.21.15.39:0/4037385234 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff0d8064ee0 0x7ff0d8067390 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:52.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.316+0000 7ff0f10c3700 1 --2- 172.21.15.39:0/4037385234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0ec0b5a00 0x7ff0ec140fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:52.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.316+0000 7ff0f10c3700 1 --2- 172.21.15.39:0/4037385234 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff0ec06aab0 0x7ff0ec1433b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:52.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.316+0000 7ff0f10c3700 1 -- 172.21.15.39:0/4037385234 >> 172.21.15.39:0/4037385234 conn(0x7ff0ec0b5390 msgr2=0x7ff0ec144010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:52.322 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.316+0000 7ff0f10c3700 1 -- 172.21.15.39:0/4037385234 shutdown_connections 2023-11-28T11:57:52.322 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.316+0000 7ff0f10c3700 1 -- 172.21.15.39:0/4037385234 wait complete. 2023-11-28T11:57:52.323 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_metadata' removed 2023-11-28T11:57:52.346 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-28T11:57:52.534 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.528+0000 7fecb759e700 1 Processor -- start 2023-11-28T11:57:52.534 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.528+0000 7fecb759e700 1 -- start start 2023-11-28T11:57:52.535 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.528+0000 7fecb759e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fecb815c6e0 0x7fecb8071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:52.536 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.528+0000 7fecb759e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecb806a510 0x7fecb806c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:52.536 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.528+0000 7fecb759e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb815cab0 con 0x7fecb8071fe0 2023-11-28T11:57:52.536 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.528+0000 7fecb759e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb80d2800 con 0x7fecb815c6e0 2023-11-28T11:57:52.536 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.528+0000 7fecb759e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb80702d0 con 0x7fecb806a510 2023-11-28T11:57:52.536 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.532+0000 7fecb659c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fecb815c6e0 0x7fecb8071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:52.537 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.532+0000 7fecb5d9b700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fecb8071fe0 0x7fecb8069e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:36914/0 (socket says 172.21.15.39:36914) 2023-11-28T11:57:52.537 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.532+0000 7fecb5d9b700 1 -- 172.21.15.39:0/1464624125 learned_addr learned my addr 172.21.15.39:0/1464624125 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:52.537 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.532+0000 7fecb6d9d700 1 --2- 172.21.15.39:0/1464624125 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecb806a510 0x7fecb806c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:52.538 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.532+0000 7fecb659c700 1 -- 172.21.15.39:0/1464624125 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecb806a510 msgr2=0x7fecb806c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:52.538 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.532+0000 7fecb659c700 1 --2- 172.21.15.39:0/1464624125 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecb806a510 0x7fecb806c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:52.538 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.532+0000 7fecb659c700 1 -- 172.21.15.39:0/1464624125 >> v1:172.21.15.184:6789/0 conn(0x7fecb8071fe0 legacy=0x7fecb8069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:52.538 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.532+0000 7fecb659c700 1 -- 172.21.15.39:0/1464624125 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb80d2a10 con 0x7fecb815c6e0 2023-11-28T11:57:52.538 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.532+0000 7fecb659c700 1 --2- 172.21.15.39:0/1464624125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fecb815c6e0 0x7fecb8071aa0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7feca8009850 tx=0x7feca8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23a44a995faa8315 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:52.539 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.532+0000 7fecb559a700 1 -- 172.21.15.39:0/1464624125 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca8011830 con 0x7fecb815c6e0 2023-11-28T11:57:52.539 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.532+0000 7fecb559a700 1 -- 172.21.15.39:0/1464624125 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca8011990 con 0x7fecb815c6e0 2023-11-28T11:57:52.539 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.532+0000 7fecb559a700 1 -- 172.21.15.39:0/1464624125 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca8011d40 con 0x7fecb815c6e0 2023-11-28T11:57:52.539 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.532+0000 7fecb759e700 1 -- 172.21.15.39:0/1464624125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fecb815c6e0 msgr2=0x7fecb8071aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:52.540 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.532+0000 7fecb759e700 1 --2- 172.21.15.39:0/1464624125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fecb815c6e0 0x7fecb8071aa0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7feca8009850 tx=0x7feca8009b60 comp rx=0 tx=0).stop 2023-11-28T11:57:52.540 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.536+0000 7fecb759e700 1 -- 172.21.15.39:0/1464624125 shutdown_connections 2023-11-28T11:57:52.540 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.536+0000 7fecb759e700 1 --2- 172.21.15.39:0/1464624125 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecb806a510 0x7fecb806c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:52.541 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.536+0000 7fecb759e700 1 --2- 172.21.15.39:0/1464624125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fecb815c6e0 0x7fecb8071aa0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:52.541 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.536+0000 7fecb759e700 1 -- 172.21.15.39:0/1464624125 >> 172.21.15.39:0/1464624125 conn(0x7fecb80b65b0 msgr2=0x7fecb8071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:52.541 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.536+0000 7fecb759e700 1 -- 172.21.15.39:0/1464624125 shutdown_connections 2023-11-28T11:57:52.541 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.536+0000 7fecb759e700 1 -- 172.21.15.39:0/1464624125 wait complete. 2023-11-28T11:57:52.544 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.540+0000 7fecb759e700 1 Processor -- start 2023-11-28T11:57:52.544 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.540+0000 7fecb759e700 1 -- start start 2023-11-28T11:57:52.546 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.540+0000 7fecb759e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fecb806a510 0x7fecb809be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:52.546 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.540+0000 7fecb759e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fecb8071fe0 0x7fecb80b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:52.547 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.540+0000 7fecb759e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecb815c6e0 0x7fecb80cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:52.547 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.540+0000 7fecb759e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb80b47f0 con 0x7fecb806a510 2023-11-28T11:57:52.547 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.540+0000 7fecb759e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb80c6260 con 0x7fecb8071fe0 2023-11-28T11:57:52.547 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.540+0000 7fecb759e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb80b2830 con 0x7fecb815c6e0 2023-11-28T11:57:52.547 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.540+0000 7fecb659c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fecb806a510 0x7fecb809be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:52.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.540+0000 7fecb659c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fecb806a510 0x7fecb809be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34256/0 (socket says 172.21.15.39:34256) 2023-11-28T11:57:52.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.540+0000 7fecb659c700 1 -- 172.21.15.39:0/1188814899 learned_addr learned my addr 172.21.15.39:0/1188814899 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:52.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.540+0000 7fecb5d9b700 1 --2- 172.21.15.39:0/1188814899 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fecb8071fe0 0x7fecb80b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:52.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.540+0000 7fecb6d9d700 1 --2- 172.21.15.39:0/1188814899 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecb815c6e0 0x7fecb80cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:52.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.544+0000 7fecb659c700 1 -- 172.21.15.39:0/1188814899 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecb815c6e0 msgr2=0x7fecb80cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:52.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.544+0000 7fecb659c700 1 --2- 172.21.15.39:0/1188814899 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecb815c6e0 0x7fecb80cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:52.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.544+0000 7fecb659c700 1 -- 172.21.15.39:0/1188814899 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fecb8071fe0 msgr2=0x7fecb80b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:52.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.544+0000 7fecb659c700 1 --2- 172.21.15.39:0/1188814899 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fecb8071fe0 0x7fecb80b22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:52.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.544+0000 7fecb659c700 1 -- 172.21.15.39:0/1188814899 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca80094b0 con 0x7fecb806a510 2023-11-28T11:57:52.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.544+0000 7fecb5d9b700 1 --2- 172.21.15.39:0/1188814899 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fecb8071fe0 0x7fecb80b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:52.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.544+0000 7fecb659c700 1 --2- 172.21.15.39:0/1188814899 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fecb806a510 0x7fecb809be40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7feca80090b0 tx=0x7feca8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:52.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.544+0000 7feca6ffd700 1 -- 172.21.15.39:0/1188814899 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca8004480 con 0x7fecb806a510 2023-11-28T11:57:52.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.544+0000 7feca6ffd700 1 -- 172.21.15.39:0/1188814899 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca801f070 con 0x7fecb806a510 2023-11-28T11:57:52.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.544+0000 7feca6ffd700 1 -- 172.21.15.39:0/1188814899 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca8003900 con 0x7fecb806a510 2023-11-28T11:57:52.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.544+0000 7fecb759e700 1 -- 172.21.15.39:0/1188814899 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb80d2fd0 con 0x7fecb806a510 2023-11-28T11:57:52.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.544+0000 7fecb759e700 1 -- 172.21.15.39:0/1188814899 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb80d2cf0 con 0x7fecb806a510 2023-11-28T11:57:52.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.544+0000 7fecb759e700 1 -- 172.21.15.39:0/1188814899 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb80d32b0 con 0x7fecb806a510 2023-11-28T11:57:52.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.548+0000 7feca6ffd700 1 -- 172.21.15.39:0/1188814899 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7feca802a020 con 0x7fecb806a510 2023-11-28T11:57:52.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.548+0000 7feca6ffd700 1 --2- 172.21.15.39:0/1188814899 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fec98064f10 0x7fec980673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:52.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.548+0000 7feca6ffd700 1 -- 172.21.15.39:0/1188814899 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6519+0+0 (secure 0 0 0) 0x7feca8083550 con 0x7fecb806a510 2023-11-28T11:57:52.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.548+0000 7fecb5d9b700 1 --2- 172.21.15.39:0/1188814899 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fec98064f10 0x7fec980673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:52.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.552+0000 7fecb5d9b700 1 --2- 172.21.15.39:0/1188814899 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fec98064f10 0x7fec980673c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fecb80a0940 tx=0x7fecac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:52.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.556+0000 7feca6ffd700 1 -- 172.21.15.39:0/1188814899 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7feca8051430 con 0x7fecb806a510 2023-11-28T11:57:52.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:52.728+0000 7fecb759e700 1 -- 172.21.15.39:0/1188814899 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fecb8073cb0 con 0x7fecb806a510 2023-11-28T11:57:53.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.328+0000 7feca6ffd700 1 -- 172.21.15.39:0/1188814899 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v34) v1 ==== 169+0+0 (secure 0 0 0) 0x7feca8054a50 con 0x7fecb806a510 2023-11-28T11:57:53.338 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.332+0000 7fecb759e700 1 -- 172.21.15.39:0/1188814899 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fec98064f10 msgr2=0x7fec980673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:53.338 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.332+0000 7fecb759e700 1 --2- 172.21.15.39:0/1188814899 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fec98064f10 0x7fec980673c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fecb80a0940 tx=0x7fecac009040 comp rx=0 tx=0).stop 2023-11-28T11:57:53.338 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.332+0000 7fecb759e700 1 -- 172.21.15.39:0/1188814899 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fecb806a510 msgr2=0x7fecb809be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:53.338 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.332+0000 7fecb759e700 1 --2- 172.21.15.39:0/1188814899 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fecb806a510 0x7fecb809be40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7feca80090b0 tx=0x7feca8004770 comp rx=0 tx=0).stop 2023-11-28T11:57:53.339 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.332+0000 7fecb759e700 1 -- 172.21.15.39:0/1188814899 shutdown_connections 2023-11-28T11:57:53.339 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.332+0000 7fecb759e700 1 --2- 172.21.15.39:0/1188814899 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecb815c6e0 0x7fecb80cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:53.340 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.332+0000 7fecb759e700 1 --2- 172.21.15.39:0/1188814899 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fec98064f10 0x7fec980673c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:53.340 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.332+0000 7fecb759e700 1 --2- 172.21.15.39:0/1188814899 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fecb8071fe0 0x7fecb80b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:53.340 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.332+0000 7fecb759e700 1 --2- 172.21.15.39:0/1188814899 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fecb806a510 0x7fecb809be40 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:53.340 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.332+0000 7fecb759e700 1 -- 172.21.15.39:0/1188814899 >> 172.21.15.39:0/1188814899 conn(0x7fecb80b65b0 msgr2=0x7fecb81e2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:53.340 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.332+0000 7fecb759e700 1 -- 172.21.15.39:0/1188814899 shutdown_connections 2023-11-28T11:57:53.340 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.336+0000 7fecb759e700 1 -- 172.21.15.39:0/1188814899 wait complete. 2023-11-28T11:57:53.348 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_data' removed 2023-11-28T11:57:53.364 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-11-28T11:57:53.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.544+0000 7f153584c700 1 Processor -- start 2023-11-28T11:57:53.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.544+0000 7f153584c700 1 -- start start 2023-11-28T11:57:53.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.548+0000 7f153584c700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f153015c6e0 0x7f1530071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:53.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.548+0000 7f153584c700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f153015cab0 con 0x7f1530071fe0 2023-11-28T11:57:53.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.548+0000 7f153584c700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15300702d0 con 0x7f153006a510 2023-11-28T11:57:53.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.548+0000 7f153584c700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15300d2800 con 0x7f153015c6e0 2023-11-28T11:57:53.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.548+0000 7f153484a700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f153015c6e0 0x7f1530071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:53.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.548+0000 7f152ffff700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f1530071fe0 0x7f1530069e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60402/0 (socket says 172.21.15.39:60402) 2023-11-28T11:57:53.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.548+0000 7f152ffff700 1 -- 172.21.15.39:0/3979000474 learned_addr learned my addr 172.21.15.39:0/3979000474 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:53.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.548+0000 7f153484a700 1 -- 172.21.15.39:0/3979000474 >> v1:172.21.15.184:6789/0 conn(0x7f153006a510 legacy=0x7f153006c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:53.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.548+0000 7f153484a700 1 -- 172.21.15.39:0/3979000474 >> v1:172.21.15.39:6789/0 conn(0x7f1530071fe0 legacy=0x7f1530069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:53.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.548+0000 7f153484a700 1 -- 172.21.15.39:0/3979000474 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15300d2a10 con 0x7f153015c6e0 2023-11-28T11:57:53.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.548+0000 7f153484a700 1 --2- 172.21.15.39:0/3979000474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f153015c6e0 0x7f1530071aa0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1524009850 tx=0x7f1524009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32f1be51ee45b142 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:53.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.548+0000 7f152f7fe700 1 -- 172.21.15.39:0/3979000474 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1524011830 con 0x7f153015c6e0 2023-11-28T11:57:53.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.548+0000 7f152f7fe700 1 -- 172.21.15.39:0/3979000474 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1524011990 con 0x7f153015c6e0 2023-11-28T11:57:53.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.548+0000 7f152f7fe700 1 -- 172.21.15.39:0/3979000474 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1524011d20 con 0x7f153015c6e0 2023-11-28T11:57:53.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.548+0000 7f153584c700 1 -- 172.21.15.39:0/3979000474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f153015c6e0 msgr2=0x7f1530071aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:53.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.548+0000 7f153584c700 1 --2- 172.21.15.39:0/3979000474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f153015c6e0 0x7f1530071aa0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1524009850 tx=0x7f1524009b60 comp rx=0 tx=0).stop 2023-11-28T11:57:53.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.552+0000 7f153584c700 1 -- 172.21.15.39:0/3979000474 shutdown_connections 2023-11-28T11:57:53.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.552+0000 7f153584c700 1 --2- 172.21.15.39:0/3979000474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f153015c6e0 0x7f1530071aa0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:53.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.552+0000 7f153584c700 1 -- 172.21.15.39:0/3979000474 >> 172.21.15.39:0/3979000474 conn(0x7f15300b65b0 msgr2=0x7f1530071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:53.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.552+0000 7f153584c700 1 -- 172.21.15.39:0/3979000474 shutdown_connections 2023-11-28T11:57:53.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.552+0000 7f153584c700 1 -- 172.21.15.39:0/3979000474 wait complete. 2023-11-28T11:57:53.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.552+0000 7f153584c700 1 Processor -- start 2023-11-28T11:57:53.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.552+0000 7f153584c700 1 -- start start 2023-11-28T11:57:53.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.552+0000 7f153584c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f153006a510 0x7f15301f5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:53.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.556+0000 7f153584c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1530071fe0 0x7f15300b3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:53.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.556+0000 7f153584c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f153015c6e0 0x7f15301f1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:53.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.556+0000 7f153584c700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15301e3ff0 con 0x7f153006a510 2023-11-28T11:57:53.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.556+0000 7f153584c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15301f2ab0 con 0x7f153015c6e0 2023-11-28T11:57:53.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.556+0000 7f153584c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15301f5520 con 0x7f1530071fe0 2023-11-28T11:57:53.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.556+0000 7f153484a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f153006a510 0x7f15301f5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:53.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.556+0000 7f153484a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f153006a510 0x7f15301f5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34274/0 (socket says 172.21.15.39:34274) 2023-11-28T11:57:53.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.556+0000 7f153484a700 1 -- 172.21.15.39:0/2410548571 learned_addr learned my addr 172.21.15.39:0/2410548571 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:53.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.556+0000 7f152ffff700 1 --2- 172.21.15.39:0/2410548571 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1530071fe0 0x7f15300b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:53.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.556+0000 7f153504b700 1 --2- 172.21.15.39:0/2410548571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f153015c6e0 0x7f15301f1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:53.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.556+0000 7f153484a700 1 -- 172.21.15.39:0/2410548571 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1530071fe0 msgr2=0x7f15300b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:53.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.556+0000 7f153484a700 1 --2- 172.21.15.39:0/2410548571 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1530071fe0 0x7f15300b3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:53.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.556+0000 7f153484a700 1 -- 172.21.15.39:0/2410548571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f153015c6e0 msgr2=0x7f15301f1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:53.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.556+0000 7f153484a700 1 --2- 172.21.15.39:0/2410548571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f153015c6e0 0x7f15301f1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:53.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.556+0000 7f153484a700 1 -- 172.21.15.39:0/2410548571 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15240094b0 con 0x7f153006a510 2023-11-28T11:57:53.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.556+0000 7f152ffff700 1 --2- 172.21.15.39:0/2410548571 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1530071fe0 0x7f15300b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:57:53.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.556+0000 7f153484a700 1 --2- 172.21.15.39:0/2410548571 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f153006a510 0x7f15301f5fe0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1524009fd0 tx=0x7f1524004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:53.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.556+0000 7f152d7fa700 1 -- 172.21.15.39:0/2410548571 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15240038c0 con 0x7f153006a510 2023-11-28T11:57:53.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.556+0000 7f153584c700 1 -- 172.21.15.39:0/2410548571 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15300d2fd0 con 0x7f153006a510 2023-11-28T11:57:53.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.556+0000 7f152d7fa700 1 -- 172.21.15.39:0/2410548571 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f152401e070 con 0x7f153006a510 2023-11-28T11:57:53.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.556+0000 7f152d7fa700 1 -- 172.21.15.39:0/2410548571 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1524003c80 con 0x7f153006a510 2023-11-28T11:57:53.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.556+0000 7f153584c700 1 -- 172.21.15.39:0/2410548571 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15300d2cf0 con 0x7f153006a510 2023-11-28T11:57:53.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.560+0000 7f153584c700 1 -- 172.21.15.39:0/2410548571 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15300d32b0 con 0x7f153006a510 2023-11-28T11:57:53.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.560+0000 7f152d7fa700 1 -- 172.21.15.39:0/2410548571 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f152400f050 con 0x7f153006a510 2023-11-28T11:57:53.567 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.560+0000 7f152d7fa700 1 --2- 172.21.15.39:0/2410548571 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1514064ee0 0x7f1514067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:53.567 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.560+0000 7f152d7fa700 1 -- 172.21.15.39:0/2410548571 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f1524020070 con 0x7f153006a510 2023-11-28T11:57:53.568 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.560+0000 7f152ffff700 1 --2- 172.21.15.39:0/2410548571 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1514064ee0 0x7f1514067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:53.569 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.564+0000 7f152ffff700 1 --2- 172.21.15.39:0/2410548571 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1514064ee0 0x7f1514067390 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f151c007fd0 tx=0x7f151c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:53.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.568+0000 7f152d7fa700 1 -- 172.21.15.39:0/2410548571 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1524051770 con 0x7f153006a510 2023-11-28T11:57:53.755 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:53.748+0000 7f153584c700 1 -- 172.21.15.39:0/2410548571 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1530066b80 con 0x7f153006a510 2023-11-28T11:57:54.694 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.688+0000 7f152d7fa700 1 -- 172.21.15.39:0/2410548571 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v35) v1 ==== 178+0+0 (secure 0 0 0) 0x7f152402a0d0 con 0x7f153006a510 2023-11-28T11:57:54.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.692+0000 7f153584c700 1 -- 172.21.15.39:0/2410548571 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1514064ee0 msgr2=0x7f1514067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:54.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.692+0000 7f153584c700 1 --2- 172.21.15.39:0/2410548571 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1514064ee0 0x7f1514067390 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f151c007fd0 tx=0x7f151c009040 comp rx=0 tx=0).stop 2023-11-28T11:57:54.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.692+0000 7f153584c700 1 -- 172.21.15.39:0/2410548571 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f153006a510 msgr2=0x7f15301f5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:54.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.692+0000 7f153584c700 1 --2- 172.21.15.39:0/2410548571 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f153006a510 0x7f15301f5fe0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1524009fd0 tx=0x7f1524004770 comp rx=0 tx=0).stop 2023-11-28T11:57:54.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.692+0000 7f153584c700 1 -- 172.21.15.39:0/2410548571 shutdown_connections 2023-11-28T11:57:54.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.692+0000 7f153584c700 1 --2- 172.21.15.39:0/2410548571 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1514064ee0 0x7f1514067390 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:54.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.692+0000 7f153584c700 1 --2- 172.21.15.39:0/2410548571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f153015c6e0 0x7f15301f1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:54.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.692+0000 7f153584c700 1 --2- 172.21.15.39:0/2410548571 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1530071fe0 0x7f15300b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:54.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.692+0000 7f153584c700 1 --2- 172.21.15.39:0/2410548571 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f153006a510 0x7f15301f5fe0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:54.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.692+0000 7f153584c700 1 -- 172.21.15.39:0/2410548571 >> 172.21.15.39:0/2410548571 conn(0x7f15300b65b0 msgr2=0x7f153015b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:54.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.692+0000 7f153584c700 1 -- 172.21.15.39:0/2410548571 shutdown_connections 2023-11-28T11:57:54.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.692+0000 7f153584c700 1 -- 172.21.15.39:0/2410548571 wait complete. 2023-11-28T11:57:54.700 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_data_ec' removed 2023-11-28T11:57:54.720 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T11:57:54.720 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-28T11:57:54.720 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-28T11:57:54.720 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:57:54.720 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T11:57:54.720 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-28T11:57:54.721 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-28T11:57:54.721 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:57:54.721 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T11:57:54.721 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-28T11:57:54.721 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-28T11:57:54.721 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:57:54.721 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-28T11:57:54.722 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-28T11:57:54.722 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-28T11:57:54.722 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:57:54.742 INFO:tasks.ceph.mds.a:Stopped 2023-11-28T11:57:54.742 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T11:57:54.743 INFO:tasks.ceph.mds.c:Stopped 2023-11-28T11:57:54.743 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T11:57:54.746 INFO:tasks.ceph.mds.d:Stopped 2023-11-28T11:57:54.747 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-28T11:57:54.748 INFO:tasks.ceph.mds.b:Stopped 2023-11-28T11:57:54.748 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T11:57:54.793 INFO:tasks.ceph.mds.a:Started 2023-11-28T11:57:54.794 DEBUG:teuthology.parallel:result is None 2023-11-28T11:57:54.794 INFO:tasks.ceph.mds.d:Started 2023-11-28T11:57:54.795 DEBUG:teuthology.parallel:result is None 2023-11-28T11:57:54.800 INFO:tasks.ceph.mds.c:Started 2023-11-28T11:57:54.801 DEBUG:teuthology.parallel:result is None 2023-11-28T11:57:54.802 INFO:tasks.ceph.mds.b:Started 2023-11-28T11:57:54.802 DEBUG:teuthology.parallel:result is None 2023-11-28T11:57:54.803 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-28T11:57:54.921 INFO:tasks.ceph.mds.c.smithi039.stdout:starting mds.c at 2023-11-28T11:57:54.921 INFO:tasks.ceph.mds.b.smithi184.stdout:starting mds.b at 2023-11-28T11:57:54.922 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2023-11-28T11:57:54.924 INFO:tasks.ceph.mds.a.smithi039.stdout:starting mds.a at 2023-11-28T11:57:54.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.980+0000 7fe74b53e700 1 Processor -- start 2023-11-28T11:57:54.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.980+0000 7fe74b53e700 1 -- start start 2023-11-28T11:57:54.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.984+0000 7fe74b53e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe744069e00 0x7fe74406a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:54.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.984+0000 7fe74b53e700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe74406c600 con 0x7fe744071aa0 2023-11-28T11:57:54.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.984+0000 7fe74b53e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7440722f0 con 0x7fe74415c640 2023-11-28T11:57:54.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.984+0000 7fe74b53e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe74406cef0 con 0x7fe744069e00 2023-11-28T11:57:54.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.984+0000 7fe749d3b700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fe744071aa0 0x7fe74406d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60424/0 (socket says 172.21.15.39:60424) 2023-11-28T11:57:54.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.984+0000 7fe749d3b700 1 -- 172.21.15.39:0/525696852 learned_addr learned my addr 172.21.15.39:0/525696852 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:54.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.984+0000 7fe74a53c700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fe74415c640 0x7fe7440d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:36972/0 (socket says 172.21.15.39:36972) 2023-11-28T11:57:54.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.984+0000 7fe74ad3d700 1 --2- 172.21.15.39:0/525696852 >> v2:172.21.15.184:3300/0 conn(0x7fe744069e00 0x7fe74406a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:54.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.984+0000 7fe74953a700 1 -- 172.21.15.39:0/525696852 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3483134126 0 0) 0x7fe74406c600 con 0x7fe744071aa0 2023-11-28T11:57:54.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.984+0000 7fe74953a700 1 -- 172.21.15.39:0/525696852 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7300035d0 con 0x7fe744071aa0 2023-11-28T11:57:54.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.984+0000 7fe74953a700 1 -- 172.21.15.39:0/525696852 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1309809137 0 0) 0x7fe7440722f0 con 0x7fe74415c640 2023-11-28T11:57:54.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.984+0000 7fe74953a700 1 -- 172.21.15.39:0/525696852 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe74406c600 con 0x7fe74415c640 2023-11-28T11:57:54.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.984+0000 7fe74ad3d700 1 -- 172.21.15.39:0/525696852 >> v1:172.21.15.184:6789/0 conn(0x7fe74415c640 legacy=0x7fe7440d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:54.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.984+0000 7fe74ad3d700 1 -- 172.21.15.39:0/525696852 >> v1:172.21.15.39:6789/0 conn(0x7fe744071aa0 legacy=0x7fe74406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:54.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.984+0000 7fe74ad3d700 1 -- 172.21.15.39:0/525696852 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74406da20 con 0x7fe744069e00 2023-11-28T11:57:54.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.984+0000 7fe74ad3d700 1 --2- 172.21.15.39:0/525696852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe744069e00 0x7fe74406a280 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe73c009d90 tx=0x7fe73c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b7fbfb9920b60b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:54.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.984+0000 7fe74953a700 1 -- 172.21.15.39:0/525696852 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c00e070 con 0x7fe744069e00 2023-11-28T11:57:54.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.984+0000 7fe74953a700 1 -- 172.21.15.39:0/525696852 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73c00bb20 con 0x7fe744069e00 2023-11-28T11:57:54.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.984+0000 7fe74953a700 1 -- 172.21.15.39:0/525696852 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c012430 con 0x7fe744069e00 2023-11-28T11:57:54.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.988+0000 7fe74b53e700 1 -- 172.21.15.39:0/525696852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe744069e00 msgr2=0x7fe74406a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:54.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.988+0000 7fe74b53e700 1 --2- 172.21.15.39:0/525696852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe744069e00 0x7fe74406a280 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe73c009d90 tx=0x7fe73c00b330 comp rx=0 tx=0).stop 2023-11-28T11:57:54.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.988+0000 7fe74b53e700 1 -- 172.21.15.39:0/525696852 shutdown_connections 2023-11-28T11:57:54.994 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.988+0000 7fe74b53e700 1 --2- 172.21.15.39:0/525696852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe744069e00 0x7fe74406a280 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:54.994 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.988+0000 7fe74b53e700 1 -- 172.21.15.39:0/525696852 >> 172.21.15.39:0/525696852 conn(0x7fe7440b6520 msgr2=0x7fe744071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:54.994 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.988+0000 7fe74b53e700 1 -- 172.21.15.39:0/525696852 shutdown_connections 2023-11-28T11:57:54.994 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.988+0000 7fe74b53e700 1 -- 172.21.15.39:0/525696852 wait complete. 2023-11-28T11:57:54.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.988+0000 7fe74b53e700 1 Processor -- start 2023-11-28T11:57:54.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.988+0000 7fe74b53e700 1 -- start start 2023-11-28T11:57:54.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.992+0000 7fe74b53e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe744069e00 0x7fe7440cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:54.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.992+0000 7fe74b53e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe744071aa0 0x7fe7441f12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:54.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.992+0000 7fe74b53e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe74415c640 0x7fe7441f1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:54.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.992+0000 7fe74b53e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7440d38f0 con 0x7fe744069e00 2023-11-28T11:57:54.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.992+0000 7fe74b53e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7441f1d50 con 0x7fe74415c640 2023-11-28T11:57:54.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.992+0000 7fe74b53e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7440c92b0 con 0x7fe744071aa0 2023-11-28T11:57:54.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.992+0000 7fe74a53c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe744069e00 0x7fe7440cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:54.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.992+0000 7fe74a53c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe744069e00 0x7fe7440cb9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34290/0 (socket says 172.21.15.39:34290) 2023-11-28T11:57:54.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.992+0000 7fe74a53c700 1 -- 172.21.15.39:0/3551723615 learned_addr learned my addr 172.21.15.39:0/3551723615 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:54.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.992+0000 7fe749d3b700 1 --2- 172.21.15.39:0/3551723615 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe744071aa0 0x7fe7441f12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:54.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.992+0000 7fe74ad3d700 1 --2- 172.21.15.39:0/3551723615 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe74415c640 0x7fe7441f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:54.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.992+0000 7fe74a53c700 1 -- 172.21.15.39:0/3551723615 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe744071aa0 msgr2=0x7fe7441f12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:54.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.992+0000 7fe74a53c700 1 --2- 172.21.15.39:0/3551723615 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe744071aa0 0x7fe7441f12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:54.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.992+0000 7fe74a53c700 1 -- 172.21.15.39:0/3551723615 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe74415c640 msgr2=0x7fe7441f1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:54.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.992+0000 7fe74a53c700 1 --2- 172.21.15.39:0/3551723615 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe74415c640 0x7fe7441f1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:54.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.992+0000 7fe74a53c700 1 -- 172.21.15.39:0/3551723615 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe73c009a70 con 0x7fe744069e00 2023-11-28T11:57:54.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.992+0000 7fe74a53c700 1 --2- 172.21.15.39:0/3551723615 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe744069e00 0x7fe7440cb9d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe74000c4d0 tx=0x7fe74000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:54.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.992+0000 7fe73affd700 1 -- 172.21.15.39:0/3551723615 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe740005cd0 con 0x7fe744069e00 2023-11-28T11:57:54.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.992+0000 7fe73affd700 1 -- 172.21.15.39:0/3551723615 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe740005e30 con 0x7fe744069e00 2023-11-28T11:57:55.000 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.992+0000 7fe74b53e700 1 -- 172.21.15.39:0/3551723615 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe744072010 con 0x7fe744069e00 2023-11-28T11:57:55.000 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.992+0000 7fe73affd700 1 -- 172.21.15.39:0/3551723615 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe740007310 con 0x7fe744069e00 2023-11-28T11:57:55.000 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.992+0000 7fe74b53e700 1 -- 172.21.15.39:0/3551723615 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe74415ca10 con 0x7fe744069e00 2023-11-28T11:57:55.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.996+0000 7fe74b53e700 1 -- 172.21.15.39:0/3551723615 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe74406c830 con 0x7fe744069e00 2023-11-28T11:57:55.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:54.996+0000 7fe73affd700 1 -- 172.21.15.39:0/3551723615 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe740019030 con 0x7fe744069e00 2023-11-28T11:57:55.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:55.000+0000 7fe73affd700 1 --2- 172.21.15.39:0/3551723615 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe728064ee0 0x7fe728067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:55.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:55.000+0000 7fe73affd700 1 -- 172.21.15.39:0/3551723615 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fe740081060 con 0x7fe744069e00 2023-11-28T11:57:55.005 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:55.000+0000 7fe749d3b700 1 --2- 172.21.15.39:0/3551723615 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe728064ee0 0x7fe728067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:55.006 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:55.000+0000 7fe749d3b700 1 --2- 172.21.15.39:0/3551723615 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe728064ee0 0x7fe728067390 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe7440cb170 tx=0x7fe734007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:55.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:55.004+0000 7fe73affd700 1 -- 172.21.15.39:0/3551723615 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe74004f2f0 con 0x7fe744069e00 2023-11-28T11:57:55.201 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:55.196+0000 7fe74b53e700 1 -- 172.21.15.39:0/3551723615 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe744066bb0 con 0x7fe744069e00 2023-11-28T11:57:55.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:55.988+0000 7fe73affd700 1 -- 172.21.15.39:0/3551723615 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v40) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe740017080 con 0x7fe744069e00 2023-11-28T11:57:55.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:55.988+0000 7fe74b53e700 1 -- 172.21.15.39:0/3551723615 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe728064ee0 msgr2=0x7fe728067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:55.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:55.988+0000 7fe74b53e700 1 --2- 172.21.15.39:0/3551723615 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe728064ee0 0x7fe728067390 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe7440cb170 tx=0x7fe734007de0 comp rx=0 tx=0).stop 2023-11-28T11:57:55.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:55.988+0000 7fe74b53e700 1 -- 172.21.15.39:0/3551723615 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe744069e00 msgr2=0x7fe7440cb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:55.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:55.988+0000 7fe74b53e700 1 --2- 172.21.15.39:0/3551723615 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe744069e00 0x7fe7440cb9d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe74000c4d0 tx=0x7fe74000c7e0 comp rx=0 tx=0).stop 2023-11-28T11:57:55.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:55.992+0000 7fe74b53e700 1 -- 172.21.15.39:0/3551723615 shutdown_connections 2023-11-28T11:57:55.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:55.992+0000 7fe74b53e700 1 --2- 172.21.15.39:0/3551723615 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe728064ee0 0x7fe728067390 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:55.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:55.992+0000 7fe74b53e700 1 --2- 172.21.15.39:0/3551723615 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe74415c640 0x7fe7441f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:55.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:55.992+0000 7fe74b53e700 1 --2- 172.21.15.39:0/3551723615 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe744071aa0 0x7fe7441f12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:55.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:55.992+0000 7fe74b53e700 1 --2- 172.21.15.39:0/3551723615 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe744069e00 0x7fe7440cb9d0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:55.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:55.992+0000 7fe74b53e700 1 -- 172.21.15.39:0/3551723615 >> 172.21.15.39:0/3551723615 conn(0x7fe7440b6520 msgr2=0x7fe7440b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:55.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:55.992+0000 7fe74b53e700 1 -- 172.21.15.39:0/3551723615 shutdown_connections 2023-11-28T11:57:55.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:55.992+0000 7fe74b53e700 1 -- 172.21.15.39:0/3551723615 wait complete. 2023-11-28T11:57:55.998 INFO:teuthology.orchestra.run.smithi039.stderr: removed all blocklist entries 2023-11-28T11:57:56.021 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-28T11:57:56.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.212+0000 7fc522d90700 1 Processor -- start 2023-11-28T11:57:56.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.212+0000 7fc522d90700 1 -- start start 2023-11-28T11:57:56.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.216+0000 7fc522d90700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc51c15c1a0 0x7fc51c06c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:56.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.216+0000 7fc522d90700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc51c070790 0x7fc51c06a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:56.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.216+0000 7fc522d90700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc51c0adf90 con 0x7fc51c0cdeb0 2023-11-28T11:57:56.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.216+0000 7fc522d90700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc51c069bf0 con 0x7fc51c15c1a0 2023-11-28T11:57:56.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.216+0000 7fc522d90700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc51c0ce370 con 0x7fc51c070790 2023-11-28T11:57:56.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.216+0000 7fc521d8e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc51c15c1a0 0x7fc51c06c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:56.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.216+0000 7fc52158d700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fc51c0cdeb0 0x7fc51c070080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60440/0 (socket says 172.21.15.39:60440) 2023-11-28T11:57:56.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.216+0000 7fc52158d700 1 -- 172.21.15.39:0/4076661419 learned_addr learned my addr 172.21.15.39:0/4076661419 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:56.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.216+0000 7fc52258f700 1 --2- 172.21.15.39:0/4076661419 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc51c070790 0x7fc51c06a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:56.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.216+0000 7fc521d8e700 1 -- 172.21.15.39:0/4076661419 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc51c070790 msgr2=0x7fc51c06a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:56.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.216+0000 7fc521d8e700 1 --2- 172.21.15.39:0/4076661419 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc51c070790 0x7fc51c06a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:56.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.216+0000 7fc521d8e700 1 -- 172.21.15.39:0/4076661419 >> v1:172.21.15.39:6789/0 conn(0x7fc51c0cdeb0 legacy=0x7fc51c070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:56.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.216+0000 7fc521d8e700 1 -- 172.21.15.39:0/4076661419 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc51c0cc4a0 con 0x7fc51c15c1a0 2023-11-28T11:57:56.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.216+0000 7fc520d8c700 1 -- 172.21.15.39:0/4076661419 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 717313410 0 0) 0x7fc51c0adf90 con 0x7fc51c0cdeb0 2023-11-28T11:57:56.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.216+0000 7fc521d8e700 1 --2- 172.21.15.39:0/4076661419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc51c15c1a0 0x7fc51c06c8b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc518009850 tx=0x7fc518009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d5f023cfb9e3930 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:56.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.216+0000 7fc520d8c700 1 -- 172.21.15.39:0/4076661419 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc518011830 con 0x7fc51c15c1a0 2023-11-28T11:57:56.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.216+0000 7fc520d8c700 1 -- 172.21.15.39:0/4076661419 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc518011990 con 0x7fc51c15c1a0 2023-11-28T11:57:56.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.220+0000 7fc520d8c700 1 -- 172.21.15.39:0/4076661419 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc518011d20 con 0x7fc51c15c1a0 2023-11-28T11:57:56.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.220+0000 7fc522d90700 1 -- 172.21.15.39:0/4076661419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc51c15c1a0 msgr2=0x7fc51c06c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:56.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.220+0000 7fc522d90700 1 --2- 172.21.15.39:0/4076661419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc51c15c1a0 0x7fc51c06c8b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc518009850 tx=0x7fc518009b60 comp rx=0 tx=0).stop 2023-11-28T11:57:56.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.220+0000 7fc522d90700 1 -- 172.21.15.39:0/4076661419 shutdown_connections 2023-11-28T11:57:56.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.220+0000 7fc522d90700 1 --2- 172.21.15.39:0/4076661419 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc51c070790 0x7fc51c06a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:56.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.220+0000 7fc522d90700 1 --2- 172.21.15.39:0/4076661419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc51c15c1a0 0x7fc51c06c8b0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:56.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.220+0000 7fc522d90700 1 -- 172.21.15.39:0/4076661419 >> 172.21.15.39:0/4076661419 conn(0x7fc51c0b0f80 msgr2=0x7fc51c0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:56.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.220+0000 7fc522d90700 1 -- 172.21.15.39:0/4076661419 shutdown_connections 2023-11-28T11:57:56.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.220+0000 7fc522d90700 1 -- 172.21.15.39:0/4076661419 wait complete. 2023-11-28T11:57:56.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.224+0000 7fc522d90700 1 Processor -- start 2023-11-28T11:57:56.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.224+0000 7fc522d90700 1 -- start start 2023-11-28T11:57:56.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.224+0000 7fc522d90700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc51c070790 0x7fc51c15a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:56.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.224+0000 7fc522d90700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc51c0cdeb0 0x7fc51c14b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:56.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.224+0000 7fc522d90700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc51c15c1a0 0x7fc51c1f20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:56.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.224+0000 7fc522d90700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51c0b38a0 con 0x7fc51c0cdeb0 2023-11-28T11:57:56.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.224+0000 7fc522d90700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51c0b2c90 con 0x7fc51c070790 2023-11-28T11:57:56.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.224+0000 7fc522d90700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc51c0b2f70 con 0x7fc51c15c1a0 2023-11-28T11:57:56.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.224+0000 7fc52158d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc51c0cdeb0 0x7fc51c14b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:56.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.224+0000 7fc52158d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc51c0cdeb0 0x7fc51c14b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34312/0 (socket says 172.21.15.39:34312) 2023-11-28T11:57:56.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.224+0000 7fc52158d700 1 -- 172.21.15.39:0/3872483750 learned_addr learned my addr 172.21.15.39:0/3872483750 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:56.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.224+0000 7fc521d8e700 1 --2- 172.21.15.39:0/3872483750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc51c070790 0x7fc51c15a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:56.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.224+0000 7fc52258f700 1 --2- 172.21.15.39:0/3872483750 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc51c15c1a0 0x7fc51c1f20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:56.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.224+0000 7fc52158d700 1 -- 172.21.15.39:0/3872483750 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc51c15c1a0 msgr2=0x7fc51c1f20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:56.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.224+0000 7fc52158d700 1 --2- 172.21.15.39:0/3872483750 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc51c15c1a0 0x7fc51c1f20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:56.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.224+0000 7fc52158d700 1 -- 172.21.15.39:0/3872483750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc51c070790 msgr2=0x7fc51c15a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:56.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.224+0000 7fc52158d700 1 --2- 172.21.15.39:0/3872483750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc51c070790 0x7fc51c15a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:56.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.224+0000 7fc52158d700 1 -- 172.21.15.39:0/3872483750 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5180094b0 con 0x7fc51c0cdeb0 2023-11-28T11:57:56.234 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.228+0000 7fc52158d700 1 --2- 172.21.15.39:0/3872483750 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc51c0cdeb0 0x7fc51c14b900 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc50c0011e0 tx=0x7fc50c00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:56.234 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.228+0000 7fc5127fc700 1 -- 172.21.15.39:0/3872483750 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50c005d90 con 0x7fc51c0cdeb0 2023-11-28T11:57:56.234 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.228+0000 7fc5127fc700 1 -- 172.21.15.39:0/3872483750 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc50c0070d0 con 0x7fc51c0cdeb0 2023-11-28T11:57:56.234 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.228+0000 7fc522d90700 1 -- 172.21.15.39:0/3872483750 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc51c06cdf0 con 0x7fc51c0cdeb0 2023-11-28T11:57:56.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.228+0000 7fc5127fc700 1 -- 172.21.15.39:0/3872483750 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50c007460 con 0x7fc51c0cdeb0 2023-11-28T11:57:56.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.228+0000 7fc522d90700 1 -- 172.21.15.39:0/3872483750 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc51c0cc780 con 0x7fc51c0cdeb0 2023-11-28T11:57:56.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.228+0000 7fc522d90700 1 -- 172.21.15.39:0/3872483750 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc51c15c570 con 0x7fc51c0cdeb0 2023-11-28T11:57:56.236 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.232+0000 7fc5127fc700 1 -- 172.21.15.39:0/3872483750 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc50c019030 con 0x7fc51c0cdeb0 2023-11-28T11:57:56.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.232+0000 7fc5127fc700 1 --2- 172.21.15.39:0/3872483750 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc500064ee0 0x7fc500067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:56.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.232+0000 7fc5127fc700 1 -- 172.21.15.39:0/3872483750 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fc50c080f40 con 0x7fc51c0cdeb0 2023-11-28T11:57:56.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.232+0000 7fc521d8e700 1 --2- 172.21.15.39:0/3872483750 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc500064ee0 0x7fc500067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:56.241 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.236+0000 7fc521d8e700 1 --2- 172.21.15.39:0/3872483750 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc500064ee0 0x7fc500067390 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc518014040 tx=0x7fc518008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:56.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.240+0000 7fc5127fc700 1 -- 172.21.15.39:0/3872483750 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc50c04f2f0 con 0x7fc51c0cdeb0 2023-11-28T11:57:56.475 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.468+0000 7fc522d90700 1 -- 172.21.15.39:0/3872483750 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc51c073cb0 con 0x7fc51c0cdeb0 2023-11-28T11:57:56.476 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.468+0000 7fc5127fc700 1 -- 172.21.15.39:0/3872483750 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fc50c052910 con 0x7fc51c0cdeb0 2023-11-28T11:57:56.476 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:57:56.476 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2023-11-28T11:57:56.476 INFO:teuthology.orchestra.run.smithi039.stdout: "auth_dump": [ 2023-11-28T11:57:56.476 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:57:56.476 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mds.a", 2023-11-28T11:57:56.476 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQA01WVlQyBbKxAAY5bRNsaX8hfv1p9qFxGk7A==", 2023-11-28T11:57:56.476 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:57:56.476 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2023-11-28T11:57:56.477 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow *", 2023-11-28T11:57:56.477 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow *", 2023-11-28T11:57:56.477 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:57:56.477 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:57:56.477 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:57:56.477 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:57:56.477 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mds.b", 2023-11-28T11:57:56.477 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQA11WVlZB1uAxAAzd+69PaNzatkv+qGZhwEng==", 2023-11-28T11:57:56.477 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:57:56.477 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2023-11-28T11:57:56.478 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow *", 2023-11-28T11:57:56.478 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow *", 2023-11-28T11:57:56.478 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:57:56.478 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:57:56.478 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:57:56.478 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:57:56.478 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mds.c", 2023-11-28T11:57:56.478 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQA01WVltd/PNhAARPTeQ/ls/8rykZx5Nqpdaw==", 2023-11-28T11:57:56.478 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:57:56.478 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2023-11-28T11:57:56.478 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow *", 2023-11-28T11:57:56.479 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow *", 2023-11-28T11:57:56.479 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:57:56.479 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:57:56.479 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:57:56.479 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:57:56.479 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mds.d", 2023-11-28T11:57:56.479 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQA11WVl3BKfDhAABJE0cb9fBNb7Sy9gC8wS7w==", 2023-11-28T11:57:56.479 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:57:56.479 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2023-11-28T11:57:56.479 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow *", 2023-11-28T11:57:56.479 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow *", 2023-11-28T11:57:56.479 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:57:56.480 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:57:56.480 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:57:56.480 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:57:56.480 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.0", 2023-11-28T11:57:56.480 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQA81WVlStbVERAAQPnXIt45pPKg99io3w4nHA==", 2023-11-28T11:57:56.480 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:57:56.480 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2023-11-28T11:57:56.480 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2023-11-28T11:57:56.480 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:57:56.480 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:57:56.480 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:57:56.481 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:57:56.481 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.1", 2023-11-28T11:57:56.481 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQA/1WVlrdM7IxAA2g0ZCNubjLlQMt1fSQxrFQ==", 2023-11-28T11:57:56.481 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:57:56.481 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2023-11-28T11:57:56.481 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2023-11-28T11:57:56.481 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:57:56.481 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:57:56.481 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:57:56.481 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:57:56.481 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.2", 2023-11-28T11:57:56.481 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQBC1WVlg3ITMhAAm9eJaDLqZDJ0cZGrMdcAdQ==", 2023-11-28T11:57:56.482 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:57:56.482 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2023-11-28T11:57:56.482 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2023-11-28T11:57:56.482 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:57:56.482 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:57:56.482 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:57:56.482 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:57:56.482 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.3", 2023-11-28T11:57:56.482 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQBG1WVliM+vBhAAGP25Wh7MAPte/DgAH0t2sg==", 2023-11-28T11:57:56.482 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:57:56.482 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2023-11-28T11:57:56.482 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2023-11-28T11:57:56.483 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:57:56.483 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:57:56.483 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:57:56.483 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:57:56.483 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.4", 2023-11-28T11:57:56.483 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQBM1WVlFgQ0HxAAoisaw/l1WjPkX6ndrRC9zw==", 2023-11-28T11:57:56.483 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:57:56.483 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2023-11-28T11:57:56.483 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2023-11-28T11:57:56.483 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:57:56.483 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:57:56.484 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:57:56.484 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:57:56.484 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.5", 2023-11-28T11:57:56.484 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQBQ1WVlIGsdARAAFGnkOWG4A4wMr68uP8c73A==", 2023-11-28T11:57:56.484 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:57:56.484 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2023-11-28T11:57:56.484 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2023-11-28T11:57:56.484 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:57:56.484 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:57:56.484 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:57:56.484 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:57:56.484 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.6", 2023-11-28T11:57:56.485 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQBT1WVl7WokEBAAARrh+05BXBzm8tJPplREMg==", 2023-11-28T11:57:56.485 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:57:56.485 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2023-11-28T11:57:56.485 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2023-11-28T11:57:56.485 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:57:56.485 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:57:56.485 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:57:56.485 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:57:56.485 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.7", 2023-11-28T11:57:56.485 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQBW1WVl/yFiHhAAzxVK7EGFHEK0oEyqjaJ8uQ==", 2023-11-28T11:57:56.485 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:57:56.486 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2023-11-28T11:57:56.486 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2023-11-28T11:57:56.486 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:57:56.486 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:57:56.486 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:57:56.486 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:57:56.486 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.0", 2023-11-28T11:57:56.486 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQA11WVlc1G2FRAAQ7OTgUCsPgSquiptDBs73Q==", 2023-11-28T11:57:56.486 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:57:56.486 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2023-11-28T11:57:56.486 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow r", 2023-11-28T11:57:56.487 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow rw", 2023-11-28T11:57:56.487 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow rwx" 2023-11-28T11:57:56.487 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:57:56.487 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:57:56.487 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:57:56.487 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.1", 2023-11-28T11:57:56.488 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQA11WVlrvFzIhAAgF6N85WgJkyxjS5R19vj2A==", 2023-11-28T11:57:56.488 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:57:56.488 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2023-11-28T11:57:56.489 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow r", 2023-11-28T11:57:56.489 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow rw", 2023-11-28T11:57:56.489 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow rwx" 2023-11-28T11:57:56.489 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:57:56.489 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:57:56.489 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:57:56.489 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.2", 2023-11-28T11:57:56.489 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQA11WVlWm/8GxAAXdoSzGMMGGRpddGUgipXaw==", 2023-11-28T11:57:56.489 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:57:56.489 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2023-11-28T11:57:56.489 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow r", 2023-11-28T11:57:56.489 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow rw", 2023-11-28T11:57:56.490 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow rwx" 2023-11-28T11:57:56.490 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:57:56.490 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:57:56.490 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:57:56.490 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.3", 2023-11-28T11:57:56.490 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQA11WVlhyZcKBAARWiULAwCFB1cHeFUgPlYKQ==", 2023-11-28T11:57:56.490 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:57:56.490 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2023-11-28T11:57:56.490 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow r", 2023-11-28T11:57:56.491 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow rw", 2023-11-28T11:57:56.491 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow rwx" 2023-11-28T11:57:56.491 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:57:56.491 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:57:56.491 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:57:56.491 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.admin", 2023-11-28T11:57:56.491 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQA01WVl0bEeARAAf2Z53D+fRxlgR+ySp2GojQ==", 2023-11-28T11:57:56.491 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:57:56.491 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow *", 2023-11-28T11:57:56.491 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow *", 2023-11-28T11:57:56.491 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow *", 2023-11-28T11:57:56.491 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:57:56.491 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:57:56.492 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:57:56.492 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:57:56.492 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.bootstrap-mds", 2023-11-28T11:57:56.492 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQBd1WVlLrzbMxAAssx8SPBFNVfGr+53SjrKhQ==", 2023-11-28T11:57:56.492 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:57:56.492 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile bootstrap-mds" 2023-11-28T11:57:56.492 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:57:56.492 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:57:56.492 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:57:56.492 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.bootstrap-mgr", 2023-11-28T11:57:56.492 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQBd1WVln8vbMxAAwl2it5o1oGdg7A/cUywYcQ==", 2023-11-28T11:57:56.492 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:57:56.493 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-28T11:57:56.493 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:57:56.493 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:57:56.493 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:57:56.493 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.bootstrap-osd", 2023-11-28T11:57:56.493 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQBd1WVlG9fbMxAAYb8Ejz+8ec1wp+yetT7Kcw==", 2023-11-28T11:57:56.493 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:57:56.493 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile bootstrap-osd" 2023-11-28T11:57:56.493 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:57:56.493 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:57:56.493 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:57:56.493 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.bootstrap-rbd", 2023-11-28T11:57:56.493 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQBd1WVl9+HbMxAAuJeo0Ulo7R+mKtNyvCXZog==", 2023-11-28T11:57:56.494 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:57:56.494 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-28T11:57:56.494 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:57:56.494 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:57:56.494 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:57:56.494 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-28T11:57:56.494 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQBd1WVlc+3bMxAAIc1CD032r+8BN2X6n5xHyQ==", 2023-11-28T11:57:56.494 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:57:56.494 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-28T11:57:56.494 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:57:56.494 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:57:56.495 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:57:56.495 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.bootstrap-rgw", 2023-11-28T11:57:56.495 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQBd1WVlUPnbMxAAOmtOEoZfMiMyxiNTTqyJ1g==", 2023-11-28T11:57:56.495 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:57:56.495 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-28T11:57:56.495 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:57:56.495 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:57:56.495 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:57:56.495 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mgr.x", 2023-11-28T11:57:56.495 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQA01WVlZ2c8JBAAZIy0cQXW2ZvyFXfMMhU66g==", 2023-11-28T11:57:56.495 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:57:56.495 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow *", 2023-11-28T11:57:56.495 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile mgr", 2023-11-28T11:57:56.496 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:57:56.496 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:57:56.496 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:57:56.496 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:57:56.496 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mgr.y", 2023-11-28T11:57:56.496 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQA01WVl2MuIHRAAJcRCzINF6RaIyQSyE4VLgQ==", 2023-11-28T11:57:56.496 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:57:56.496 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow *", 2023-11-28T11:57:56.496 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile mgr", 2023-11-28T11:57:56.496 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:57:56.496 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:57:56.496 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:57:56.497 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2023-11-28T11:57:56.497 INFO:teuthology.orchestra.run.smithi039.stdout:} 2023-11-28T11:57:56.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.472+0000 7fc522d90700 1 -- 172.21.15.39:0/3872483750 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc500064ee0 msgr2=0x7fc500067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:56.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.472+0000 7fc522d90700 1 --2- 172.21.15.39:0/3872483750 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc500064ee0 0x7fc500067390 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc518014040 tx=0x7fc518008030 comp rx=0 tx=0).stop 2023-11-28T11:57:56.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.472+0000 7fc522d90700 1 -- 172.21.15.39:0/3872483750 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc51c0cdeb0 msgr2=0x7fc51c14b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:56.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.472+0000 7fc522d90700 1 --2- 172.21.15.39:0/3872483750 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc51c0cdeb0 0x7fc51c14b900 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc50c0011e0 tx=0x7fc50c00ca30 comp rx=0 tx=0).stop 2023-11-28T11:57:56.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.476+0000 7fc522d90700 1 -- 172.21.15.39:0/3872483750 shutdown_connections 2023-11-28T11:57:56.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.476+0000 7fc522d90700 1 --2- 172.21.15.39:0/3872483750 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc51c15c1a0 0x7fc51c1f20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:56.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.476+0000 7fc522d90700 1 --2- 172.21.15.39:0/3872483750 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc51c0cdeb0 0x7fc51c14b900 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:56.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.476+0000 7fc522d90700 1 --2- 172.21.15.39:0/3872483750 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc500064ee0 0x7fc500067390 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:56.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.476+0000 7fc522d90700 1 --2- 172.21.15.39:0/3872483750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc51c070790 0x7fc51c15a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:56.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.476+0000 7fc522d90700 1 -- 172.21.15.39:0/3872483750 >> 172.21.15.39:0/3872483750 conn(0x7fc51c0b0f80 msgr2=0x7fc51c15b110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:56.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.476+0000 7fc522d90700 1 -- 172.21.15.39:0/3872483750 shutdown_connections 2023-11-28T11:57:56.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.476+0000 7fc522d90700 1 -- 172.21.15.39:0/3872483750 wait complete. 2023-11-28T11:57:56.501 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-28T11:57:56.691 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.684+0000 7f921604c700 1 Processor -- start 2023-11-28T11:57:56.692 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.684+0000 7f921604c700 1 -- start start 2023-11-28T11:57:56.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.688+0000 7f921604c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9210160710 0x7f92100cc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:56.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.688+0000 7f921604c700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9210070790 0x7f9210164250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:56.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.688+0000 7f921604c700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92100ad6c0 con 0x7f92100cc860 2023-11-28T11:57:56.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.688+0000 7f921604c700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f921006b1c0 con 0x7f9210070790 2023-11-28T11:57:56.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.688+0000 7f921604c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92100adc60 con 0x7f9210160710 2023-11-28T11:57:56.694 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.688+0000 7f921584b700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9210070790 0x7f9210164250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:56.694 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.688+0000 7f921584b700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9210070790 0x7f9210164250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34318/0 (socket says 172.21.15.39:34318) 2023-11-28T11:57:56.694 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.688+0000 7f921584b700 1 -- 172.21.15.39:0/4081790539 learned_addr learned my addr 172.21.15.39:0/4081790539 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:56.694 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.688+0000 7f921504a700 1 --2- 172.21.15.39:0/4081790539 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9210160710 0x7f92100cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:56.695 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.688+0000 7f921584b700 1 -- 172.21.15.39:0/4081790539 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9210160710 msgr2=0x7f92100cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:56.695 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.688+0000 7f921584b700 1 --2- 172.21.15.39:0/4081790539 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9210160710 0x7f92100cc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:56.695 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.688+0000 7f921584b700 1 -- 172.21.15.39:0/4081790539 >> v1:172.21.15.184:6789/0 conn(0x7f92100cc860 legacy=0x7f9210070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:56.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.688+0000 7f921584b700 1 -- 172.21.15.39:0/4081790539 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f921006b3d0 con 0x7f9210070790 2023-11-28T11:57:56.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.688+0000 7f9207fff700 1 -- 172.21.15.39:0/4081790539 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1661604853 0 0) 0x7f92100ad6c0 con 0x7f92100cc860 2023-11-28T11:57:56.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.688+0000 7f921584b700 1 --2- 172.21.15.39:0/4081790539 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9210070790 0x7f9210164250 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9208009e50 tx=0x7f920800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62ae42b3b282cfda server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:56.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.688+0000 7f9207fff700 1 -- 172.21.15.39:0/4081790539 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920800e070 con 0x7f9210070790 2023-11-28T11:57:56.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.688+0000 7f9207fff700 1 -- 172.21.15.39:0/4081790539 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f920800b910 con 0x7f9210070790 2023-11-28T11:57:56.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.688+0000 7f9207fff700 1 -- 172.21.15.39:0/4081790539 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920800bcc0 con 0x7f9210070790 2023-11-28T11:57:56.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.692+0000 7f921604c700 1 -- 172.21.15.39:0/4081790539 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9210070790 msgr2=0x7f9210164250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:56.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.692+0000 7f921604c700 1 --2- 172.21.15.39:0/4081790539 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9210070790 0x7f9210164250 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9208009e50 tx=0x7f920800b330 comp rx=0 tx=0).stop 2023-11-28T11:57:56.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.692+0000 7f921604c700 1 -- 172.21.15.39:0/4081790539 shutdown_connections 2023-11-28T11:57:56.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.692+0000 7f921604c700 1 --2- 172.21.15.39:0/4081790539 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9210070790 0x7f9210164250 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:56.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.692+0000 7f921604c700 1 --2- 172.21.15.39:0/4081790539 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9210160710 0x7f92100cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:56.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.692+0000 7f921604c700 1 -- 172.21.15.39:0/4081790539 >> 172.21.15.39:0/4081790539 conn(0x7f92100b0f80 msgr2=0x7f92100ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:56.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.692+0000 7f921604c700 1 -- 172.21.15.39:0/4081790539 shutdown_connections 2023-11-28T11:57:56.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.692+0000 7f921604c700 1 -- 172.21.15.39:0/4081790539 wait complete. 2023-11-28T11:57:56.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.692+0000 7f921604c700 1 Processor -- start 2023-11-28T11:57:56.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.692+0000 7f921604c700 1 -- start start 2023-11-28T11:57:56.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.696+0000 7f921604c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9210070790 0x7f92100c0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:56.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.696+0000 7f921604c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92100cc860 0x7f921015d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:56.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.696+0000 7f921604c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9210160710 0x7f92101f6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:56.701 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.696+0000 7f921604c700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921015f1b0 con 0x7f92100cc860 2023-11-28T11:57:56.701 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.696+0000 7f921604c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92101f8dd0 con 0x7f9210070790 2023-11-28T11:57:56.701 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.696+0000 7f921604c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92100c1260 con 0x7f9210160710 2023-11-28T11:57:56.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.696+0000 7f9214849700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92100cc860 0x7f921015d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:56.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.696+0000 7f9214849700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92100cc860 0x7f921015d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34322/0 (socket says 172.21.15.39:34322) 2023-11-28T11:57:56.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.696+0000 7f9214849700 1 -- 172.21.15.39:0/920816311 learned_addr learned my addr 172.21.15.39:0/920816311 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:56.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.696+0000 7f921504a700 1 --2- 172.21.15.39:0/920816311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9210070790 0x7f92100c0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:56.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.696+0000 7f921584b700 1 --2- 172.21.15.39:0/920816311 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9210160710 0x7f92101f6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:56.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.696+0000 7f9214849700 1 -- 172.21.15.39:0/920816311 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9210160710 msgr2=0x7f92101f6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:56.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.696+0000 7f9214849700 1 --2- 172.21.15.39:0/920816311 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9210160710 0x7f92101f6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:56.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.696+0000 7f9214849700 1 -- 172.21.15.39:0/920816311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9210070790 msgr2=0x7f92100c0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:56.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.696+0000 7f9214849700 1 --2- 172.21.15.39:0/920816311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9210070790 0x7f92100c0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:56.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.696+0000 7f9214849700 1 -- 172.21.15.39:0/920816311 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9208009b30 con 0x7f92100cc860 2023-11-28T11:57:56.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.696+0000 7f9214849700 1 --2- 172.21.15.39:0/920816311 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92100cc860 0x7f921015d4a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f92000011e0 tx=0x7f920000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:56.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.696+0000 7f9205ffb700 1 -- 172.21.15.39:0/920816311 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92000054e0 con 0x7f92100cc860 2023-11-28T11:57:56.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.696+0000 7f9205ffb700 1 -- 172.21.15.39:0/920816311 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92000036a0 con 0x7f92100cc860 2023-11-28T11:57:56.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.696+0000 7f921604c700 1 -- 172.21.15.39:0/920816311 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92100ad8f0 con 0x7f92100cc860 2023-11-28T11:57:56.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.696+0000 7f9205ffb700 1 -- 172.21.15.39:0/920816311 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9200003a50 con 0x7f92100cc860 2023-11-28T11:57:56.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.696+0000 7f921604c700 1 -- 172.21.15.39:0/920816311 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f921006b6b0 con 0x7f92100cc860 2023-11-28T11:57:56.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.700+0000 7f921604c700 1 -- 172.21.15.39:0/920816311 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9210160ae0 con 0x7f92100cc860 2023-11-28T11:57:56.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.700+0000 7f9205ffb700 1 -- 172.21.15.39:0/920816311 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9200019030 con 0x7f92100cc860 2023-11-28T11:57:56.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.700+0000 7f9205ffb700 1 --2- 172.21.15.39:0/920816311 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f91f4064ee0 0x7f91f4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:56.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.700+0000 7f9205ffb700 1 -- 172.21.15.39:0/920816311 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f9200081100 con 0x7f92100cc860 2023-11-28T11:57:56.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.704+0000 7f921504a700 1 --2- 172.21.15.39:0/920816311 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f91f4064ee0 0x7f91f4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:56.709 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.704+0000 7f921504a700 1 --2- 172.21.15.39:0/920816311 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f91f4064ee0 0x7f91f4067390 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f92100c3b40 tx=0x7f920c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:56.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.704+0000 7f9205ffb700 1 -- 172.21.15.39:0/920816311 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f920004f430 con 0x7f92100cc860 2023-11-28T11:57:56.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.936+0000 7f921604c700 1 -- 172.21.15.39:0/920816311 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f9210073cb0 con 0x7f92100cc860 2023-11-28T11:57:56.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.948+0000 7f9205ffb700 1 -- 172.21.15.39:0/920816311 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f9200017020 con 0x7f92100cc860 2023-11-28T11:57:56.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.952+0000 7f921604c700 1 -- 172.21.15.39:0/920816311 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f91f4064ee0 msgr2=0x7f91f4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:56.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.952+0000 7f921604c700 1 --2- 172.21.15.39:0/920816311 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f91f4064ee0 0x7f91f4067390 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f92100c3b40 tx=0x7f920c008040 comp rx=0 tx=0).stop 2023-11-28T11:57:56.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.952+0000 7f921604c700 1 -- 172.21.15.39:0/920816311 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92100cc860 msgr2=0x7f921015d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:56.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.952+0000 7f921604c700 1 --2- 172.21.15.39:0/920816311 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92100cc860 0x7f921015d4a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f92000011e0 tx=0x7f920000cae0 comp rx=0 tx=0).stop 2023-11-28T11:57:56.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.952+0000 7f921604c700 1 -- 172.21.15.39:0/920816311 shutdown_connections 2023-11-28T11:57:56.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.952+0000 7f921604c700 1 --2- 172.21.15.39:0/920816311 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9210160710 0x7f92101f6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:56.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.952+0000 7f921604c700 1 --2- 172.21.15.39:0/920816311 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92100cc860 0x7f921015d4a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:56.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.952+0000 7f921604c700 1 --2- 172.21.15.39:0/920816311 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f91f4064ee0 0x7f91f4067390 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:56.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.952+0000 7f921604c700 1 --2- 172.21.15.39:0/920816311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9210070790 0x7f92100c0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:56.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.952+0000 7f921604c700 1 -- 172.21.15.39:0/920816311 >> 172.21.15.39:0/920816311 conn(0x7f92100b0f80 msgr2=0x7f92100606f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:56.958 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.952+0000 7f921604c700 1 -- 172.21.15.39:0/920816311 shutdown_connections 2023-11-28T11:57:56.958 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:56.952+0000 7f921604c700 1 -- 172.21.15.39:0/920816311 wait complete. 2023-11-28T11:57:56.979 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-28T11:57:57.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.156+0000 7f9577276700 1 Processor -- start 2023-11-28T11:57:57.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.156+0000 7f9577276700 1 -- start start 2023-11-28T11:57:57.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.156+0000 7f9577276700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f95700b43a0 0x7f957015e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:57.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.156+0000 7f9577276700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f95700b1640 0x7f9570070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:57.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.156+0000 7f9577276700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95700c9040 0x7f95700705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:57.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.156+0000 7f9577276700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f957015a550 con 0x7f95700b43a0 2023-11-28T11:57:57.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.156+0000 7f9577276700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f957006b0a0 con 0x7f95700b1640 2023-11-28T11:57:57.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.156+0000 7f9577276700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95700caac0 con 0x7f95700c9040 2023-11-28T11:57:57.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.156+0000 7f9576274700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f95700b43a0 0x7f957015e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:57.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.156+0000 7f9576274700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f95700b43a0 0x7f957015e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34332/0 (socket says 172.21.15.39:34332) 2023-11-28T11:57:57.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.156+0000 7f9576274700 1 -- 172.21.15.39:0/3986184162 learned_addr learned my addr 172.21.15.39:0/3986184162 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:57.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.156+0000 7f9576a75700 1 --2- 172.21.15.39:0/3986184162 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95700c9040 0x7f95700705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:57.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.156+0000 7f9575a73700 1 --2- 172.21.15.39:0/3986184162 >> v2:172.21.15.184:3300/0 conn(0x7f95700b1640 0x7f9570070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:57.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.156+0000 7f9576274700 1 -- 172.21.15.39:0/3986184162 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95700c9040 msgr2=0x7f95700705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:57.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.156+0000 7f9576274700 1 --2- 172.21.15.39:0/3986184162 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95700c9040 0x7f95700705c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:57.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.156+0000 7f9576274700 1 -- 172.21.15.39:0/3986184162 >> v2:172.21.15.184:3300/0 conn(0x7f95700b1640 msgr2=0x7f9570070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:57.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.156+0000 7f9576274700 1 --2- 172.21.15.39:0/3986184162 >> v2:172.21.15.184:3300/0 conn(0x7f95700b1640 0x7f9570070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:57.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.156+0000 7f9576274700 1 -- 172.21.15.39:0/3986184162 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95700cada0 con 0x7f95700b43a0 2023-11-28T11:57:57.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.160+0000 7f9576274700 1 --2- 172.21.15.39:0/3986184162 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95700b43a0 0x7f957015e5d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9570072d40 tx=0x7f956c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61601471503d67ca server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:57.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.160+0000 7f9575272700 1 -- 172.21.15.39:0/3986184162 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956c00e070 con 0x7f95700b43a0 2023-11-28T11:57:57.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.160+0000 7f9575272700 1 -- 172.21.15.39:0/3986184162 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f956c00b9c0 con 0x7f95700b43a0 2023-11-28T11:57:57.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.160+0000 7f9575272700 1 -- 172.21.15.39:0/3986184162 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956c00bd70 con 0x7f95700b43a0 2023-11-28T11:57:57.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.160+0000 7f9577276700 1 -- 172.21.15.39:0/3986184162 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95700b43a0 msgr2=0x7f957015e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:57.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.160+0000 7f9577276700 1 --2- 172.21.15.39:0/3986184162 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95700b43a0 0x7f957015e5d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9570072d40 tx=0x7f956c00b330 comp rx=0 tx=0).stop 2023-11-28T11:57:57.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.160+0000 7f9577276700 1 -- 172.21.15.39:0/3986184162 shutdown_connections 2023-11-28T11:57:57.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.160+0000 7f9577276700 1 --2- 172.21.15.39:0/3986184162 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95700c9040 0x7f95700705c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:57.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.160+0000 7f9577276700 1 --2- 172.21.15.39:0/3986184162 >> v2:172.21.15.184:3300/0 conn(0x7f95700b1640 0x7f9570070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:57.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.160+0000 7f9577276700 1 --2- 172.21.15.39:0/3986184162 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95700b43a0 0x7f957015e5d0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:57.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.160+0000 7f9577276700 1 -- 172.21.15.39:0/3986184162 >> 172.21.15.39:0/3986184162 conn(0x7f95700b0f80 msgr2=0x7f95700ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:57.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.160+0000 7f9577276700 1 -- 172.21.15.39:0/3986184162 shutdown_connections 2023-11-28T11:57:57.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.160+0000 7f9577276700 1 -- 172.21.15.39:0/3986184162 wait complete. 2023-11-28T11:57:57.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.164+0000 7f9577276700 1 Processor -- start 2023-11-28T11:57:57.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.164+0000 7f9577276700 1 -- start start 2023-11-28T11:57:57.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.164+0000 7f9577276700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95700b1640 0x7f95700cded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:57.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.164+0000 7f9577276700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95700b43a0 0x7f95701f1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:57.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.164+0000 7f9577276700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95700c9040 0x7f9570154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:57.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.164+0000 7f9577276700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95701f2b70 con 0x7f95700b1640 2023-11-28T11:57:57.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.164+0000 7f9577276700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95701f20a0 con 0x7f95700c9040 2023-11-28T11:57:57.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.164+0000 7f9577276700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95701f5380 con 0x7f95700b43a0 2023-11-28T11:57:57.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.164+0000 7f9576274700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95700b1640 0x7f95700cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:57.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.164+0000 7f9576274700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95700b1640 0x7f95700cded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34344/0 (socket says 172.21.15.39:34344) 2023-11-28T11:57:57.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.164+0000 7f9576274700 1 -- 172.21.15.39:0/1551919210 learned_addr learned my addr 172.21.15.39:0/1551919210 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:57.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.164+0000 7f9575a73700 1 --2- 172.21.15.39:0/1551919210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95700b43a0 0x7f95701f1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:57.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.164+0000 7f9576a75700 1 --2- 172.21.15.39:0/1551919210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95700c9040 0x7f9570154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:57.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.164+0000 7f9576274700 1 -- 172.21.15.39:0/1551919210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95700b43a0 msgr2=0x7f95701f1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:57.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.164+0000 7f9576274700 1 --2- 172.21.15.39:0/1551919210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95700b43a0 0x7f95701f1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:57.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.164+0000 7f9576274700 1 -- 172.21.15.39:0/1551919210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95700c9040 msgr2=0x7f9570154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:57.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.164+0000 7f9576274700 1 --2- 172.21.15.39:0/1551919210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95700c9040 0x7f9570154ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:57.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.164+0000 7f9576274700 1 -- 172.21.15.39:0/1551919210 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f956c009b30 con 0x7f95700b1640 2023-11-28T11:57:57.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.164+0000 7f9576274700 1 --2- 172.21.15.39:0/1551919210 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95700b1640 0x7f95700cded0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f956c00b370 tx=0x7f956c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:57.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.168+0000 7f9566ffd700 1 -- 172.21.15.39:0/1551919210 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956c004250 con 0x7f95700b1640 2023-11-28T11:57:57.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.168+0000 7f9566ffd700 1 -- 172.21.15.39:0/1551919210 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f956c0043d0 con 0x7f95700b1640 2023-11-28T11:57:57.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.168+0000 7f9577276700 1 -- 172.21.15.39:0/1551919210 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f957006b5d0 con 0x7f95700b1640 2023-11-28T11:57:57.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.168+0000 7f9566ffd700 1 -- 172.21.15.39:0/1551919210 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956c004780 con 0x7f95700b1640 2023-11-28T11:57:57.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.168+0000 7f9577276700 1 -- 172.21.15.39:0/1551919210 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f957006b2f0 con 0x7f95700b1640 2023-11-28T11:57:57.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.168+0000 7f9577276700 1 -- 172.21.15.39:0/1551919210 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f957015eb10 con 0x7f95700b1640 2023-11-28T11:57:57.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.168+0000 7f9566ffd700 1 -- 172.21.15.39:0/1551919210 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f956c01c440 con 0x7f95700b1640 2023-11-28T11:57:57.177 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.172+0000 7f9566ffd700 1 --2- 172.21.15.39:0/1551919210 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9554064f10 0x7f95540673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:57.177 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.172+0000 7f9566ffd700 1 -- 172.21.15.39:0/1551919210 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f956c083390 con 0x7f95700b1640 2023-11-28T11:57:57.178 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.172+0000 7f9575a73700 1 --2- 172.21.15.39:0/1551919210 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9554064f10 0x7f95540673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:57.179 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.172+0000 7f9575a73700 1 --2- 172.21.15.39:0/1551919210 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9554064f10 0x7f95540673c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f957006a3d0 tx=0x7f9560008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:57.184 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.180+0000 7f9566ffd700 1 -- 172.21.15.39:0/1551919210 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f956c0516e0 con 0x7f95700b1640 2023-11-28T11:57:57.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.416+0000 7f9577276700 1 -- 172.21.15.39:0/1551919210 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f95701f5150 con 0x7f95700b1640 2023-11-28T11:57:57.432 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.424+0000 7f9566ffd700 1 -- 172.21.15.39:0/1551919210 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f956c054d00 con 0x7f95700b1640 2023-11-28T11:57:57.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.428+0000 7f9577276700 1 -- 172.21.15.39:0/1551919210 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9554064f10 msgr2=0x7f95540673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:57.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.428+0000 7f9577276700 1 --2- 172.21.15.39:0/1551919210 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9554064f10 0x7f95540673c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f957006a3d0 tx=0x7f9560008040 comp rx=0 tx=0).stop 2023-11-28T11:57:57.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.428+0000 7f9577276700 1 -- 172.21.15.39:0/1551919210 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95700b1640 msgr2=0x7f95700cded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:57.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.428+0000 7f9577276700 1 --2- 172.21.15.39:0/1551919210 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95700b1640 0x7f95700cded0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f956c00b370 tx=0x7f956c004af0 comp rx=0 tx=0).stop 2023-11-28T11:57:57.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.428+0000 7f9577276700 1 -- 172.21.15.39:0/1551919210 shutdown_connections 2023-11-28T11:57:57.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.428+0000 7f9577276700 1 --2- 172.21.15.39:0/1551919210 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9554064f10 0x7f95540673c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:57.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.428+0000 7f9577276700 1 --2- 172.21.15.39:0/1551919210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95700c9040 0x7f9570154ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:57.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.428+0000 7f9577276700 1 --2- 172.21.15.39:0/1551919210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95700b43a0 0x7f95701f1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:57.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.428+0000 7f9577276700 1 --2- 172.21.15.39:0/1551919210 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95700b1640 0x7f95700cded0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:57.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.428+0000 7f9577276700 1 -- 172.21.15.39:0/1551919210 >> 172.21.15.39:0/1551919210 conn(0x7f95700b0f80 msgr2=0x7f957006a920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:57.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.428+0000 7f9577276700 1 -- 172.21.15.39:0/1551919210 shutdown_connections 2023-11-28T11:57:57.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.428+0000 7f9577276700 1 -- 172.21.15.39:0/1551919210 wait complete. 2023-11-28T11:57:57.461 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-28T11:57:57.639 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.632+0000 7f780ea74700 1 Processor -- start 2023-11-28T11:57:57.639 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.632+0000 7f780ea74700 1 -- start start 2023-11-28T11:57:57.642 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.636+0000 7f780ea74700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78080ce9e0 0x7f78080cb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:57.642 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.636+0000 7f780ea74700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f780806ca00 0x7f78080b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:57.642 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.636+0000 7f780ea74700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f780806b250 con 0x7f780806ad00 2023-11-28T11:57:57.642 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.636+0000 7f780ea74700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f780806b530 con 0x7f780806ca00 2023-11-28T11:57:57.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.636+0000 7f780ea74700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780806b810 con 0x7f78080ce9e0 2023-11-28T11:57:57.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.636+0000 7f7807fff700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f780806ad00 0x7f780806c2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60452/0 (socket says 172.21.15.39:60452) 2023-11-28T11:57:57.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.636+0000 7f7807fff700 1 -- 172.21.15.39:0/268880149 learned_addr learned my addr 172.21.15.39:0/268880149 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:57.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.636+0000 7f780c810700 1 --2- 172.21.15.39:0/268880149 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78080ce9e0 0x7f78080cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:57.644 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.636+0000 7f780d011700 1 --2- 172.21.15.39:0/268880149 >> v2:172.21.15.184:3300/0 conn(0x7f780806ca00 0x7f78080b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:57.645 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.636+0000 7f78077fe700 1 -- 172.21.15.39:0/268880149 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2161672631 0 0) 0x7f780806b250 con 0x7f780806ad00 2023-11-28T11:57:57.645 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.636+0000 7f78077fe700 1 -- 172.21.15.39:0/268880149 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77f80035d0 con 0x7f780806ad00 2023-11-28T11:57:57.646 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.636+0000 7f780c810700 1 -- 172.21.15.39:0/268880149 >> v2:172.21.15.184:3300/0 conn(0x7f780806ca00 msgr2=0x7f78080b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:57.646 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.636+0000 7f780c810700 1 --2- 172.21.15.39:0/268880149 >> v2:172.21.15.184:3300/0 conn(0x7f780806ca00 0x7f78080b2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:57.646 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.636+0000 7f780c810700 1 -- 172.21.15.39:0/268880149 >> v1:172.21.15.39:6789/0 conn(0x7f780806ad00 legacy=0x7f780806c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:57.646 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.636+0000 7f780c810700 1 -- 172.21.15.39:0/268880149 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780806baf0 con 0x7f78080ce9e0 2023-11-28T11:57:57.646 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.640+0000 7f780c810700 1 --2- 172.21.15.39:0/268880149 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78080ce9e0 0x7f78080cb060 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f77fc009850 tx=0x7f77fc009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d4322122fd8650d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:57.647 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.640+0000 7f78077fe700 1 -- 172.21.15.39:0/268880149 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc011830 con 0x7f78080ce9e0 2023-11-28T11:57:57.647 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.640+0000 7f78077fe700 1 -- 172.21.15.39:0/268880149 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77fc011990 con 0x7f78080ce9e0 2023-11-28T11:57:57.647 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.640+0000 7f78077fe700 1 -- 172.21.15.39:0/268880149 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc011d40 con 0x7f78080ce9e0 2023-11-28T11:57:57.648 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.640+0000 7f780ea74700 1 -- 172.21.15.39:0/268880149 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78080ce9e0 msgr2=0x7f78080cb060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:57.648 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.640+0000 7f780ea74700 1 --2- 172.21.15.39:0/268880149 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78080ce9e0 0x7f78080cb060 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f77fc009850 tx=0x7f77fc009b60 comp rx=0 tx=0).stop 2023-11-28T11:57:57.648 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.640+0000 7f780ea74700 1 -- 172.21.15.39:0/268880149 shutdown_connections 2023-11-28T11:57:57.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.640+0000 7f780ea74700 1 --2- 172.21.15.39:0/268880149 >> v2:172.21.15.184:3300/0 conn(0x7f780806ca00 0x7f78080b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:57.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.640+0000 7f780ea74700 1 --2- 172.21.15.39:0/268880149 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78080ce9e0 0x7f78080cb060 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:57.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.640+0000 7f780ea74700 1 -- 172.21.15.39:0/268880149 >> 172.21.15.39:0/268880149 conn(0x7f780806e5d0 msgr2=0x7f780806e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:57.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.640+0000 7f780ea74700 1 -- 172.21.15.39:0/268880149 shutdown_connections 2023-11-28T11:57:57.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.640+0000 7f780ea74700 1 -- 172.21.15.39:0/268880149 wait complete. 2023-11-28T11:57:57.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.644+0000 7f780ea74700 1 Processor -- start 2023-11-28T11:57:57.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.644+0000 7f780ea74700 1 -- start start 2023-11-28T11:57:57.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.644+0000 7f780ea74700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f780806ad00 0x7f7808157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:57.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.644+0000 7f780ea74700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f780806ca00 0x7f7808144ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:57.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.644+0000 7f780ea74700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78080ce9e0 0x7f78081f5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:57.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.644+0000 7f780ea74700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7808159200 con 0x7f78080ce9e0 2023-11-28T11:57:57.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.644+0000 7f780ea74700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7808145430 con 0x7f780806ca00 2023-11-28T11:57:57.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.644+0000 7f780ea74700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78081f6040 con 0x7f780806ad00 2023-11-28T11:57:57.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.644+0000 7f780d011700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78080ce9e0 0x7f78081f5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:57.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.644+0000 7f780d011700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78080ce9e0 0x7f78081f5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34346/0 (socket says 172.21.15.39:34346) 2023-11-28T11:57:57.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.644+0000 7f780d011700 1 -- 172.21.15.39:0/3997300776 learned_addr learned my addr 172.21.15.39:0/3997300776 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:57.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.644+0000 7f780c810700 1 --2- 172.21.15.39:0/3997300776 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f780806ad00 0x7f7808157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:57.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.648+0000 7f7807fff700 1 --2- 172.21.15.39:0/3997300776 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f780806ca00 0x7f7808144ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:57.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.648+0000 7f780d011700 1 -- 172.21.15.39:0/3997300776 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f780806ad00 msgr2=0x7f7808157fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:57.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.648+0000 7f780d011700 1 --2- 172.21.15.39:0/3997300776 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f780806ad00 0x7f7808157fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:57.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.648+0000 7f780d011700 1 -- 172.21.15.39:0/3997300776 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f780806ca00 msgr2=0x7f7808144ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:57.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.648+0000 7f780d011700 1 --2- 172.21.15.39:0/3997300776 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f780806ca00 0x7f7808144ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:57.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.648+0000 7f780d011700 1 -- 172.21.15.39:0/3997300776 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77fc0094b0 con 0x7f78080ce9e0 2023-11-28T11:57:57.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.648+0000 7f780d011700 1 --2- 172.21.15.39:0/3997300776 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78080ce9e0 0x7f78081f5b00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f780000efc0 tx=0x7f780000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:57.655 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.648+0000 7f78057fa700 1 -- 172.21.15.39:0/3997300776 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7800009ea0 con 0x7f78080ce9e0 2023-11-28T11:57:57.655 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.648+0000 7f780ea74700 1 -- 172.21.15.39:0/3997300776 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78080d06e0 con 0x7f78080ce9e0 2023-11-28T11:57:57.655 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.648+0000 7f78057fa700 1 -- 172.21.15.39:0/3997300776 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780000f040 con 0x7f78080ce9e0 2023-11-28T11:57:57.655 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.648+0000 7f78057fa700 1 -- 172.21.15.39:0/3997300776 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7800014480 con 0x7f78080ce9e0 2023-11-28T11:57:57.655 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.648+0000 7f780ea74700 1 -- 172.21.15.39:0/3997300776 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f780806bdd0 con 0x7f78080ce9e0 2023-11-28T11:57:57.655 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.648+0000 7f780ea74700 1 -- 172.21.15.39:0/3997300776 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78080cedb0 con 0x7f78080ce9e0 2023-11-28T11:57:57.656 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.648+0000 7f78057fa700 1 -- 172.21.15.39:0/3997300776 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f78000145e0 con 0x7f78080ce9e0 2023-11-28T11:57:57.657 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.652+0000 7f78057fa700 1 --2- 172.21.15.39:0/3997300776 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f77ec064ee0 0x7f77ec067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:57.657 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.652+0000 7f78057fa700 1 -- 172.21.15.39:0/3997300776 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f78000827b0 con 0x7f78080ce9e0 2023-11-28T11:57:57.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.652+0000 7f780c810700 1 --2- 172.21.15.39:0/3997300776 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f77ec064ee0 0x7f77ec067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:57.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.652+0000 7f780c810700 1 --2- 172.21.15.39:0/3997300776 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f77ec064ee0 0x7f77ec067390 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0090b0 tx=0x7f77fc01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:57.664 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.656+0000 7f78057fa700 1 -- 172.21.15.39:0/3997300776 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f78000509f0 con 0x7f78080ce9e0 2023-11-28T11:57:57.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.884+0000 7f780ea74700 1 -- 172.21.15.39:0/3997300776 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f78081586e0 con 0x7f78080ce9e0 2023-11-28T11:57:57.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.896+0000 7f78057fa700 1 -- 172.21.15.39:0/3997300776 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7800054010 con 0x7f78080ce9e0 2023-11-28T11:57:57.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.900+0000 7f780ea74700 1 -- 172.21.15.39:0/3997300776 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f77ec064ee0 msgr2=0x7f77ec067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:57.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.900+0000 7f780ea74700 1 --2- 172.21.15.39:0/3997300776 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f77ec064ee0 0x7f77ec067390 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0090b0 tx=0x7f77fc01c040 comp rx=0 tx=0).stop 2023-11-28T11:57:57.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.900+0000 7f780ea74700 1 -- 172.21.15.39:0/3997300776 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78080ce9e0 msgr2=0x7f78081f5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:57.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.900+0000 7f780ea74700 1 --2- 172.21.15.39:0/3997300776 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78080ce9e0 0x7f78081f5b00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f780000efc0 tx=0x7f780000c3a0 comp rx=0 tx=0).stop 2023-11-28T11:57:57.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.900+0000 7f780ea74700 1 -- 172.21.15.39:0/3997300776 shutdown_connections 2023-11-28T11:57:57.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.900+0000 7f780ea74700 1 --2- 172.21.15.39:0/3997300776 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78080ce9e0 0x7f78081f5b00 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:57.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.900+0000 7f780ea74700 1 --2- 172.21.15.39:0/3997300776 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f77ec064ee0 0x7f77ec067390 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:57.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.900+0000 7f780ea74700 1 --2- 172.21.15.39:0/3997300776 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f780806ca00 0x7f7808144ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:57.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.900+0000 7f780ea74700 1 --2- 172.21.15.39:0/3997300776 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f780806ad00 0x7f7808157fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:57.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.900+0000 7f780ea74700 1 -- 172.21.15.39:0/3997300776 >> 172.21.15.39:0/3997300776 conn(0x7f780806e5d0 msgr2=0x7f78080b44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:57.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.900+0000 7f780ea74700 1 -- 172.21.15.39:0/3997300776 shutdown_connections 2023-11-28T11:57:57.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:57.900+0000 7f780ea74700 1 -- 172.21.15.39:0/3997300776 wait complete. 2023-11-28T11:57:57.931 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-28T11:57:58.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.108+0000 7fc72cce0700 1 Processor -- start 2023-11-28T11:57:58.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.108+0000 7fc72cce0700 1 -- start start 2023-11-28T11:57:58.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.108+0000 7fc72cce0700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7280b43a0 0x7fc72815e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:58.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.108+0000 7fc72cce0700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc7280b1640 0x7fc728070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:58.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.108+0000 7fc72cce0700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc72815a550 con 0x7fc7280c9040 2023-11-28T11:57:58.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.108+0000 7fc72cce0700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc72806b0a0 con 0x7fc7280b1640 2023-11-28T11:57:58.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.108+0000 7fc72cce0700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7280caac0 con 0x7fc7280b43a0 2023-11-28T11:57:58.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.108+0000 7fc7277fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7280b43a0 0x7fc72815e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:58.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.108+0000 7fc71effd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc7280b1640 0x7fc728070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:58.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.108+0000 7fc71effd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc7280b1640 0x7fc728070080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:37862/0 (socket says 172.21.15.39:37862) 2023-11-28T11:57:58.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.108+0000 7fc727fff700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fc7280c9040 0x7fc728069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:35320/0 (socket says 172.21.15.39:35320) 2023-11-28T11:57:58.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.108+0000 7fc71effd700 1 -- 172.21.15.39:0/1810710891 learned_addr learned my addr 172.21.15.39:0/1810710891 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:58.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.108+0000 7fc71effd700 1 -- 172.21.15.39:0/1810710891 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7280b43a0 msgr2=0x7fc72815e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:58.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.108+0000 7fc71effd700 1 --2- 172.21.15.39:0/1810710891 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7280b43a0 0x7fc72815e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:58.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.108+0000 7fc71effd700 1 -- 172.21.15.39:0/1810710891 >> v1:172.21.15.184:6789/0 conn(0x7fc7280c9040 legacy=0x7fc728069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:58.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.108+0000 7fc71effd700 1 -- 172.21.15.39:0/1810710891 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7280cada0 con 0x7fc7280b1640 2023-11-28T11:57:58.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.112+0000 7fc7277fe700 1 --2- 172.21.15.39:0/1810710891 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7280b43a0 0x7fc72815e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:58.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.112+0000 7fc71effd700 1 --2- 172.21.15.39:0/1810710891 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7280b1640 0x7fc728070080 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc710009910 tx=0x7fc710009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9014ec6a5b46c14 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:58.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.112+0000 7fc726ffd700 1 -- 172.21.15.39:0/1810710891 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc710011830 con 0x7fc7280b1640 2023-11-28T11:57:58.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.112+0000 7fc726ffd700 1 -- 172.21.15.39:0/1810710891 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc710011990 con 0x7fc7280b1640 2023-11-28T11:57:58.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.112+0000 7fc726ffd700 1 -- 172.21.15.39:0/1810710891 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc710011d40 con 0x7fc7280b1640 2023-11-28T11:57:58.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.112+0000 7fc72cce0700 1 -- 172.21.15.39:0/1810710891 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7280b1640 msgr2=0x7fc728070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:58.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.112+0000 7fc72cce0700 1 --2- 172.21.15.39:0/1810710891 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7280b1640 0x7fc728070080 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc710009910 tx=0x7fc710009c20 comp rx=0 tx=0).stop 2023-11-28T11:57:58.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.112+0000 7fc72cce0700 1 -- 172.21.15.39:0/1810710891 shutdown_connections 2023-11-28T11:57:58.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.112+0000 7fc72cce0700 1 --2- 172.21.15.39:0/1810710891 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7280b1640 0x7fc728070080 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:58.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.112+0000 7fc72cce0700 1 --2- 172.21.15.39:0/1810710891 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7280b43a0 0x7fc72815e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:58.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.112+0000 7fc72cce0700 1 -- 172.21.15.39:0/1810710891 >> 172.21.15.39:0/1810710891 conn(0x7fc7280b0f80 msgr2=0x7fc7280ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:58.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.112+0000 7fc72cce0700 1 -- 172.21.15.39:0/1810710891 shutdown_connections 2023-11-28T11:57:58.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.112+0000 7fc72cce0700 1 -- 172.21.15.39:0/1810710891 wait complete. 2023-11-28T11:57:58.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.116+0000 7fc72cce0700 1 Processor -- start 2023-11-28T11:57:58.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.116+0000 7fc72cce0700 1 -- start start 2023-11-28T11:57:58.123 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.116+0000 7fc72cce0700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7280b1640 0x7fc72814f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:58.123 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.116+0000 7fc72cce0700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7280b43a0 0x7fc7280c6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:58.123 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.116+0000 7fc72cce0700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7280c9040 0x7fc7280c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:58.123 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.116+0000 7fc72cce0700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72815a910 con 0x7fc7280c9040 2023-11-28T11:57:58.124 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.116+0000 7fc72cce0700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7280c5ed0 con 0x7fc7280b43a0 2023-11-28T11:57:58.124 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.116+0000 7fc72cce0700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc728150060 con 0x7fc7280b1640 2023-11-28T11:57:58.124 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.116+0000 7fc727fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7280c9040 0x7fc7280c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:58.124 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.116+0000 7fc727fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7280c9040 0x7fc7280c68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53690/0 (socket says 172.21.15.39:53690) 2023-11-28T11:57:58.124 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.116+0000 7fc727fff700 1 -- 172.21.15.39:0/849679375 learned_addr learned my addr 172.21.15.39:0/849679375 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:58.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.116+0000 7fc7277fe700 1 --2- 172.21.15.39:0/849679375 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7280b1640 0x7fc72814f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:58.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.116+0000 7fc71effd700 1 --2- 172.21.15.39:0/849679375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7280b43a0 0x7fc7280c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:58.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.120+0000 7fc71effd700 1 -- 172.21.15.39:0/849679375 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7280b1640 msgr2=0x7fc72814f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:58.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.120+0000 7fc71effd700 1 --2- 172.21.15.39:0/849679375 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7280b1640 0x7fc72814f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:58.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.120+0000 7fc71effd700 1 -- 172.21.15.39:0/849679375 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7280c9040 msgr2=0x7fc7280c68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:58.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.120+0000 7fc71effd700 1 --2- 172.21.15.39:0/849679375 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7280c9040 0x7fc7280c68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:58.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.120+0000 7fc71effd700 1 -- 172.21.15.39:0/849679375 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7180094b0 con 0x7fc7280b43a0 2023-11-28T11:57:58.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.120+0000 7fc727fff700 1 --2- 172.21.15.39:0/849679375 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7280c9040 0x7fc7280c68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:58.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.120+0000 7fc71effd700 1 --2- 172.21.15.39:0/849679375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7280b43a0 0x7fc7280c6360 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc710016000 tx=0x7fc710004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:58.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.120+0000 7fc724ff9700 1 -- 172.21.15.39:0/849679375 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc710004510 con 0x7fc7280b43a0 2023-11-28T11:57:58.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.120+0000 7fc724ff9700 1 -- 172.21.15.39:0/849679375 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc71001e070 con 0x7fc7280b43a0 2023-11-28T11:57:58.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.120+0000 7fc72cce0700 1 -- 172.21.15.39:0/849679375 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc710009570 con 0x7fc7280b43a0 2023-11-28T11:57:58.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.120+0000 7fc724ff9700 1 -- 172.21.15.39:0/849679375 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc710003900 con 0x7fc7280b43a0 2023-11-28T11:57:58.127 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.120+0000 7fc72cce0700 1 -- 172.21.15.39:0/849679375 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc72806b5d0 con 0x7fc7280b43a0 2023-11-28T11:57:58.127 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.120+0000 7fc72cce0700 1 -- 172.21.15.39:0/849679375 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc72806b2f0 con 0x7fc7280b43a0 2023-11-28T11:57:58.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.124+0000 7fc724ff9700 1 -- 172.21.15.39:0/849679375 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc71000f050 con 0x7fc7280b43a0 2023-11-28T11:57:58.132 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.124+0000 7fc724ff9700 1 --2- 172.21.15.39:0/849679375 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc708064f30 0x7fc7080673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:58.132 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.124+0000 7fc724ff9700 1 -- 172.21.15.39:0/849679375 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fc710082ad0 con 0x7fc7280b43a0 2023-11-28T11:57:58.132 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.124+0000 7fc7277fe700 1 --2- 172.21.15.39:0/849679375 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc708064f30 0x7fc7080673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:58.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.128+0000 7fc7277fe700 1 --2- 172.21.15.39:0/849679375 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc708064f30 0x7fc7080673e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc718009d80 tx=0x7fc718009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:58.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.132+0000 7fc724ff9700 1 -- 172.21.15.39:0/849679375 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc710050e10 con 0x7fc7280b43a0 2023-11-28T11:57:58.372 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.368+0000 7fc72cce0700 1 -- 172.21.15.39:0/849679375 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fc72815eb10 con 0x7fc7280b43a0 2023-11-28T11:57:58.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.376+0000 7fc724ff9700 1 -- 172.21.15.39:0/849679375 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc710054430 con 0x7fc7280b43a0 2023-11-28T11:57:58.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.384+0000 7fc72cce0700 1 -- 172.21.15.39:0/849679375 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc708064f30 msgr2=0x7fc7080673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:58.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.384+0000 7fc72cce0700 1 --2- 172.21.15.39:0/849679375 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc708064f30 0x7fc7080673e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc718009d80 tx=0x7fc718009240 comp rx=0 tx=0).stop 2023-11-28T11:57:58.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.384+0000 7fc72cce0700 1 -- 172.21.15.39:0/849679375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7280b43a0 msgr2=0x7fc7280c6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:58.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.384+0000 7fc72cce0700 1 --2- 172.21.15.39:0/849679375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7280b43a0 0x7fc7280c6360 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc710016000 tx=0x7fc710004770 comp rx=0 tx=0).stop 2023-11-28T11:57:58.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.384+0000 7fc72cce0700 1 -- 172.21.15.39:0/849679375 shutdown_connections 2023-11-28T11:57:58.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.384+0000 7fc72cce0700 1 --2- 172.21.15.39:0/849679375 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7280c9040 0x7fc7280c68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:58.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.384+0000 7fc72cce0700 1 --2- 172.21.15.39:0/849679375 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc708064f30 0x7fc7080673e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:58.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.384+0000 7fc72cce0700 1 --2- 172.21.15.39:0/849679375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7280b43a0 0x7fc7280c6360 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:58.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.384+0000 7fc72cce0700 1 --2- 172.21.15.39:0/849679375 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7280b1640 0x7fc72814f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:58.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.384+0000 7fc72cce0700 1 -- 172.21.15.39:0/849679375 >> 172.21.15.39:0/849679375 conn(0x7fc7280b0f80 msgr2=0x7fc7280acc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:58.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.384+0000 7fc72cce0700 1 -- 172.21.15.39:0/849679375 shutdown_connections 2023-11-28T11:57:58.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.384+0000 7fc72cce0700 1 -- 172.21.15.39:0/849679375 wait complete. 2023-11-28T11:57:58.412 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-28T11:57:58.596 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.588+0000 7f32d2584700 1 Processor -- start 2023-11-28T11:57:58.596 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.592+0000 7f32d2584700 1 -- start start 2023-11-28T11:57:58.598 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.592+0000 7f32d2584700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f32cc0ced50 0x7f32cc06afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:58.598 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.592+0000 7f32d2584700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32cc070790 0x7f32cc069cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:58.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.592+0000 7f32d2584700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32cc0d24d0 con 0x7f32cc160770 2023-11-28T11:57:58.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.592+0000 7f32d2584700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32cc0d27b0 con 0x7f32cc0ced50 2023-11-28T11:57:58.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.592+0000 7f32d2584700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32cc0d08d0 con 0x7f32cc070790 2023-11-28T11:57:58.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.592+0000 7f32d0d81700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f32cc160770 0x7f32cc070080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:49378/0 (socket says 172.21.15.39:49378) 2023-11-28T11:57:58.600 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.592+0000 7f32d0d81700 1 -- 172.21.15.39:0/1152861195 learned_addr learned my addr 172.21.15.39:0/1152861195 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:58.600 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.592+0000 7f32d1582700 1 --2- 172.21.15.39:0/1152861195 >> v2:172.21.15.184:3300/0 conn(0x7f32cc0ced50 0x7f32cc06afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:58.600 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.592+0000 7f32d1d83700 1 --2- 172.21.15.39:0/1152861195 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32cc070790 0x7f32cc069cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:58.600 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.592+0000 7f32c3fff700 1 -- 172.21.15.39:0/1152861195 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2509010948 0 0) 0x7f32cc0d24d0 con 0x7f32cc160770 2023-11-28T11:57:58.600 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.592+0000 7f32c3fff700 1 -- 172.21.15.39:0/1152861195 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32b80035d0 con 0x7f32cc160770 2023-11-28T11:57:58.601 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.596+0000 7f32d1582700 1 -- 172.21.15.39:0/1152861195 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32cc070790 msgr2=0x7f32cc069cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:58.601 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.596+0000 7f32d1582700 1 --2- 172.21.15.39:0/1152861195 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32cc070790 0x7f32cc069cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:58.601 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.596+0000 7f32d1582700 1 -- 172.21.15.39:0/1152861195 >> v1:172.21.15.39:6789/0 conn(0x7f32cc160770 legacy=0x7f32cc070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:58.601 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.596+0000 7f32c3fff700 1 -- 172.21.15.39:0/1152861195 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2113904404 0 0) 0x7f32b80035d0 con 0x7f32cc160770 2023-11-28T11:57:58.601 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.596+0000 7f32d1582700 1 -- 172.21.15.39:0/1152861195 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32cc0d0bb0 con 0x7f32cc0ced50 2023-11-28T11:57:58.601 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.596+0000 7f32d1d83700 1 --2- 172.21.15.39:0/1152861195 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32cc070790 0x7f32cc069cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:58.601 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.596+0000 7f32d1582700 1 --2- 172.21.15.39:0/1152861195 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32cc0ced50 0x7f32cc06afc0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f32c8009d90 tx=0x7f32c800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f05eab946d2e5f1f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:58.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.596+0000 7f32c3fff700 1 -- 172.21.15.39:0/1152861195 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c800e070 con 0x7f32cc0ced50 2023-11-28T11:57:58.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.596+0000 7f32c3fff700 1 -- 172.21.15.39:0/1152861195 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c8003a40 con 0x7f32cc0ced50 2023-11-28T11:57:58.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.596+0000 7f32c3fff700 1 -- 172.21.15.39:0/1152861195 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32bc001670 con 0x7f32cc0ced50 2023-11-28T11:57:58.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.596+0000 7f32d2584700 1 -- 172.21.15.39:0/1152861195 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32cc0ced50 msgr2=0x7f32cc06afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:58.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.596+0000 7f32d2584700 1 --2- 172.21.15.39:0/1152861195 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32cc0ced50 0x7f32cc06afc0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f32c8009d90 tx=0x7f32c800b330 comp rx=0 tx=0).stop 2023-11-28T11:57:58.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.596+0000 7f32d2584700 1 -- 172.21.15.39:0/1152861195 shutdown_connections 2023-11-28T11:57:58.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.596+0000 7f32d2584700 1 --2- 172.21.15.39:0/1152861195 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32cc070790 0x7f32cc069cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:58.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.596+0000 7f32d2584700 1 --2- 172.21.15.39:0/1152861195 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32cc0ced50 0x7f32cc06afc0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:58.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.596+0000 7f32d2584700 1 -- 172.21.15.39:0/1152861195 >> 172.21.15.39:0/1152861195 conn(0x7f32cc0b53a0 msgr2=0x7f32cc0d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:58.604 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.596+0000 7f32d2584700 1 -- 172.21.15.39:0/1152861195 shutdown_connections 2023-11-28T11:57:58.604 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.596+0000 7f32d2584700 1 -- 172.21.15.39:0/1152861195 wait complete. 2023-11-28T11:57:58.608 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.600+0000 7f32d2584700 1 Processor -- start 2023-11-28T11:57:58.608 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.600+0000 7f32d2584700 1 -- start start 2023-11-28T11:57:58.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.604+0000 7f32d2584700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32cc070790 0x7f32cc0c9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:58.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.604+0000 7f32d2584700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32cc0ced50 0x7f32cc0b5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:58.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.604+0000 7f32d2584700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32cc160770 0x7f32cc15ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:58.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.604+0000 7f32d2584700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32cc0b69d0 con 0x7f32cc0ced50 2023-11-28T11:57:58.610 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.604+0000 7f32d2584700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32cc0b6130 con 0x7f32cc070790 2023-11-28T11:57:58.610 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.604+0000 7f32d2584700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32cc0b6410 con 0x7f32cc160770 2023-11-28T11:57:58.610 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.604+0000 7f32d0d81700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32cc0ced50 0x7f32cc0b5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:58.610 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.604+0000 7f32d0d81700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32cc0ced50 0x7f32cc0b5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53694/0 (socket says 172.21.15.39:53694) 2023-11-28T11:57:58.610 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.604+0000 7f32d0d81700 1 -- 172.21.15.39:0/2443992753 learned_addr learned my addr 172.21.15.39:0/2443992753 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:58.610 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.604+0000 7f32d1582700 1 --2- 172.21.15.39:0/2443992753 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32cc070790 0x7f32cc0c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:58.610 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.604+0000 7f32d1d83700 1 --2- 172.21.15.39:0/2443992753 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32cc160770 0x7f32cc15ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:58.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.604+0000 7f32d0d81700 1 -- 172.21.15.39:0/2443992753 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32cc160770 msgr2=0x7f32cc15ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:58.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.604+0000 7f32d0d81700 1 --2- 172.21.15.39:0/2443992753 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32cc160770 0x7f32cc15ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:58.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.604+0000 7f32d0d81700 1 -- 172.21.15.39:0/2443992753 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32cc070790 msgr2=0x7f32cc0c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:58.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.604+0000 7f32d0d81700 1 --2- 172.21.15.39:0/2443992753 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32cc070790 0x7f32cc0c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:58.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.604+0000 7f32d0d81700 1 -- 172.21.15.39:0/2443992753 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c40094b0 con 0x7f32cc0ced50 2023-11-28T11:57:58.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.604+0000 7f32d0d81700 1 --2- 172.21.15.39:0/2443992753 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32cc0ced50 0x7f32cc0b5a50 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f32bc00c750 tx=0x7f32bc00ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:58.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.604+0000 7f32c1ffb700 1 -- 172.21.15.39:0/2443992753 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32bc004ca0 con 0x7f32cc0ced50 2023-11-28T11:57:58.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.604+0000 7f32c1ffb700 1 -- 172.21.15.39:0/2443992753 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32bc004e00 con 0x7f32cc0ced50 2023-11-28T11:57:58.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.604+0000 7f32c1ffb700 1 -- 172.21.15.39:0/2443992753 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32bc0072d0 con 0x7f32cc0ced50 2023-11-28T11:57:58.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.604+0000 7f32d2584700 1 -- 172.21.15.39:0/2443992753 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c8009a70 con 0x7f32cc0ced50 2023-11-28T11:57:58.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.604+0000 7f32d2584700 1 -- 172.21.15.39:0/2443992753 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32cc160bf0 con 0x7f32cc0ced50 2023-11-28T11:57:58.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.608+0000 7f32d2584700 1 -- 172.21.15.39:0/2443992753 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32cc0cf120 con 0x7f32cc0ced50 2023-11-28T11:57:58.615 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.608+0000 7f32c1ffb700 1 -- 172.21.15.39:0/2443992753 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f32bc01a020 con 0x7f32cc0ced50 2023-11-28T11:57:58.617 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.612+0000 7f32c1ffb700 1 --2- 172.21.15.39:0/2443992753 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f32b0064ee0 0x7f32b0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:58.617 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.612+0000 7f32c1ffb700 1 -- 172.21.15.39:0/2443992753 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f32bc0817f0 con 0x7f32cc0ced50 2023-11-28T11:57:58.617 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.612+0000 7f32d1582700 1 --2- 172.21.15.39:0/2443992753 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f32b0064ee0 0x7f32b0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:58.618 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.612+0000 7f32d1582700 1 --2- 172.21.15.39:0/2443992753 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f32b0064ee0 0x7f32b0067390 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f32c800b370 tx=0x7f32c8011000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:58.624 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.616+0000 7f32c1ffb700 1 -- 172.21.15.39:0/2443992753 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f32bc04fc50 con 0x7f32cc0ced50 2023-11-28T11:57:58.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.848+0000 7f32d2584700 1 -- 172.21.15.39:0/2443992753 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f32cc0cd1b0 con 0x7f32cc0ced50 2023-11-28T11:57:58.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.860+0000 7f32c1ffb700 1 -- 172.21.15.39:0/2443992753 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f32bc053270 con 0x7f32cc0ced50 2023-11-28T11:57:58.875 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.868+0000 7f32d2584700 1 -- 172.21.15.39:0/2443992753 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f32b0064ee0 msgr2=0x7f32b0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:58.876 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.868+0000 7f32d2584700 1 --2- 172.21.15.39:0/2443992753 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f32b0064ee0 0x7f32b0067390 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f32c800b370 tx=0x7f32c8011000 comp rx=0 tx=0).stop 2023-11-28T11:57:58.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.868+0000 7f32d2584700 1 -- 172.21.15.39:0/2443992753 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32cc0ced50 msgr2=0x7f32cc0b5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:58.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.868+0000 7f32d2584700 1 --2- 172.21.15.39:0/2443992753 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32cc0ced50 0x7f32cc0b5a50 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f32bc00c750 tx=0x7f32bc00ca60 comp rx=0 tx=0).stop 2023-11-28T11:57:58.878 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.868+0000 7f32d2584700 1 -- 172.21.15.39:0/2443992753 shutdown_connections 2023-11-28T11:57:58.878 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.868+0000 7f32d2584700 1 --2- 172.21.15.39:0/2443992753 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32cc160770 0x7f32cc15ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:58.879 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.868+0000 7f32d2584700 1 --2- 172.21.15.39:0/2443992753 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32cc0ced50 0x7f32cc0b5a50 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:58.879 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.868+0000 7f32d2584700 1 --2- 172.21.15.39:0/2443992753 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f32b0064ee0 0x7f32b0067390 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:58.880 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.868+0000 7f32d2584700 1 --2- 172.21.15.39:0/2443992753 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32cc070790 0x7f32cc0c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:58.880 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.868+0000 7f32d2584700 1 -- 172.21.15.39:0/2443992753 >> 172.21.15.39:0/2443992753 conn(0x7f32cc0b53a0 msgr2=0x7f32cc0b26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:58.880 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.868+0000 7f32d2584700 1 -- 172.21.15.39:0/2443992753 shutdown_connections 2023-11-28T11:57:58.881 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:58.868+0000 7f32d2584700 1 -- 172.21.15.39:0/2443992753 wait complete. 2023-11-28T11:57:58.897 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-28T11:57:59.076 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.068+0000 7f73edf77700 1 Processor -- start 2023-11-28T11:57:59.076 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.072+0000 7f73edf77700 1 -- start start 2023-11-28T11:57:59.078 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.072+0000 7f73edf77700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73e815c640 0x7f73e80d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:59.079 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.072+0000 7f73edf77700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f73e8071aa0 0x7f73e806d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:59.079 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.072+0000 7f73edf77700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e806c600 con 0x7f73e8069e00 2023-11-28T11:57:59.079 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.072+0000 7f73edf77700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73e806cef0 con 0x7f73e8071aa0 2023-11-28T11:57:59.079 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.072+0000 7f73edf77700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e80722f0 con 0x7f73e815c640 2023-11-28T11:57:59.079 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.072+0000 7f73ecf75700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73e815c640 0x7f73e80d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:59.079 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.072+0000 7f73ecf75700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73e815c640 0x7f73e80d31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:43336/0 (socket says 172.21.15.39:43336) 2023-11-28T11:57:59.079 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.072+0000 7f73ecf75700 1 -- 172.21.15.39:0/366500682 learned_addr learned my addr 172.21.15.39:0/366500682 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:59.080 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.072+0000 7f73dffff700 1 --2- 172.21.15.39:0/366500682 >> v2:172.21.15.184:3300/0 conn(0x7f73e8071aa0 0x7f73e806d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:59.080 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.072+0000 7f73ecf75700 1 -- 172.21.15.39:0/366500682 >> v2:172.21.15.184:3300/0 conn(0x7f73e8071aa0 msgr2=0x7f73e806d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:59.080 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.072+0000 7f73ecf75700 1 --2- 172.21.15.39:0/366500682 >> v2:172.21.15.184:3300/0 conn(0x7f73e8071aa0 0x7f73e806d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:59.080 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.072+0000 7f73ecf75700 1 -- 172.21.15.39:0/366500682 >> v1:172.21.15.184:6789/0 conn(0x7f73e8069e00 legacy=0x7f73e80d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:59.081 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.072+0000 7f73ecf75700 1 -- 172.21.15.39:0/366500682 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e815ca10 con 0x7f73e815c640 2023-11-28T11:57:59.081 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.072+0000 7f73ecf75700 1 --2- 172.21.15.39:0/366500682 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73e815c640 0x7f73e80d31e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f73e4009e50 tx=0x7f73e400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=537cec308efa73c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:59.081 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.076+0000 7f73df7fe700 1 -- 172.21.15.39:0/366500682 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e400e070 con 0x7f73e815c640 2023-11-28T11:57:59.081 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.076+0000 7f73df7fe700 1 -- 172.21.15.39:0/366500682 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e400b9c0 con 0x7f73e815c640 2023-11-28T11:57:59.081 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.076+0000 7f73df7fe700 1 -- 172.21.15.39:0/366500682 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e400bd70 con 0x7f73e815c640 2023-11-28T11:57:59.081 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.076+0000 7f73edf77700 1 -- 172.21.15.39:0/366500682 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73e815c640 msgr2=0x7f73e80d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:59.081 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.076+0000 7f73edf77700 1 --2- 172.21.15.39:0/366500682 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73e815c640 0x7f73e80d31e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f73e4009e50 tx=0x7f73e400b330 comp rx=0 tx=0).stop 2023-11-28T11:57:59.082 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.076+0000 7f73edf77700 1 -- 172.21.15.39:0/366500682 shutdown_connections 2023-11-28T11:57:59.082 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.076+0000 7f73edf77700 1 --2- 172.21.15.39:0/366500682 >> v2:172.21.15.184:3300/0 conn(0x7f73e8071aa0 0x7f73e806d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:59.082 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.076+0000 7f73edf77700 1 --2- 172.21.15.39:0/366500682 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73e815c640 0x7f73e80d31e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:59.082 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.076+0000 7f73edf77700 1 -- 172.21.15.39:0/366500682 >> 172.21.15.39:0/366500682 conn(0x7f73e80b6520 msgr2=0x7f73e8071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:59.082 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.076+0000 7f73edf77700 1 -- 172.21.15.39:0/366500682 shutdown_connections 2023-11-28T11:57:59.082 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.076+0000 7f73edf77700 1 -- 172.21.15.39:0/366500682 wait complete. 2023-11-28T11:57:59.086 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.080+0000 7f73edf77700 1 Processor -- start 2023-11-28T11:57:59.086 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.080+0000 7f73edf77700 1 -- start start 2023-11-28T11:57:59.089 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.084+0000 7f73edf77700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73e8069e00 0x7f73e815a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:59.089 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.084+0000 7f73edf77700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73e8071aa0 0x7f73e815a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:59.089 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.084+0000 7f73edf77700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73e815c640 0x7f73e80cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:59.089 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.084+0000 7f73edf77700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e80b1280 con 0x7f73e8071aa0 2023-11-28T11:57:59.089 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.084+0000 7f73edf77700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e815f940 con 0x7f73e815c640 2023-11-28T11:57:59.089 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.084+0000 7f73edf77700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e815fc00 con 0x7f73e8069e00 2023-11-28T11:57:59.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.084+0000 7f73dffff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73e8071aa0 0x7f73e815a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:59.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.084+0000 7f73dffff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73e8071aa0 0x7f73e815a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53702/0 (socket says 172.21.15.39:53702) 2023-11-28T11:57:59.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.084+0000 7f73dffff700 1 -- 172.21.15.39:0/229483357 learned_addr learned my addr 172.21.15.39:0/229483357 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:59.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.084+0000 7f73ed776700 1 --2- 172.21.15.39:0/229483357 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73e815c640 0x7f73e80cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:59.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.084+0000 7f73ecf75700 1 --2- 172.21.15.39:0/229483357 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73e8069e00 0x7f73e815a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:59.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.084+0000 7f73dffff700 1 -- 172.21.15.39:0/229483357 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73e8069e00 msgr2=0x7f73e815a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:59.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.084+0000 7f73dffff700 1 --2- 172.21.15.39:0/229483357 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73e8069e00 0x7f73e815a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:59.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.084+0000 7f73dffff700 1 -- 172.21.15.39:0/229483357 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73e815c640 msgr2=0x7f73e80cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:59.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.084+0000 7f73dffff700 1 --2- 172.21.15.39:0/229483357 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73e815c640 0x7f73e80cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:59.092 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.084+0000 7f73dffff700 1 -- 172.21.15.39:0/229483357 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e4009b30 con 0x7f73e8071aa0 2023-11-28T11:57:59.092 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.084+0000 7f73dffff700 1 --2- 172.21.15.39:0/229483357 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73e8071aa0 0x7f73e815a580 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f73d800d800 tx=0x7f73d800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:59.092 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.084+0000 7f73dd7fa700 1 -- 172.21.15.39:0/229483357 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d80125f0 con 0x7f73e8071aa0 2023-11-28T11:57:59.092 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.084+0000 7f73dd7fa700 1 -- 172.21.15.39:0/229483357 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d8012750 con 0x7f73e8071aa0 2023-11-28T11:57:59.092 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.084+0000 7f73edf77700 1 -- 172.21.15.39:0/229483357 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e806c830 con 0x7f73e8071aa0 2023-11-28T11:57:59.092 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.084+0000 7f73dd7fa700 1 -- 172.21.15.39:0/229483357 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d8012b00 con 0x7f73e8071aa0 2023-11-28T11:57:59.092 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.084+0000 7f73edf77700 1 -- 172.21.15.39:0/229483357 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e8072010 con 0x7f73e8071aa0 2023-11-28T11:57:59.093 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.088+0000 7f73edf77700 1 -- 172.21.15.39:0/229483357 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e806cb10 con 0x7f73e8071aa0 2023-11-28T11:57:59.095 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.088+0000 7f73dd7fa700 1 -- 172.21.15.39:0/229483357 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f73d8012c60 con 0x7f73e8071aa0 2023-11-28T11:57:59.097 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.092+0000 7f73dd7fa700 1 --2- 172.21.15.39:0/229483357 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f73d4064ee0 0x7f73d4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:59.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.092+0000 7f73dd7fa700 1 -- 172.21.15.39:0/229483357 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f73d8081f80 con 0x7f73e8071aa0 2023-11-28T11:57:59.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.092+0000 7f73ecf75700 1 --2- 172.21.15.39:0/229483357 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f73d4064ee0 0x7f73d4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:59.099 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.092+0000 7f73ecf75700 1 --2- 172.21.15.39:0/229483357 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f73d4064ee0 0x7f73d4067390 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f73e4000f80 tx=0x7f73e4009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:59.103 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.096+0000 7f73dd7fa700 1 -- 172.21.15.39:0/229483357 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f73d8050240 con 0x7f73e8071aa0 2023-11-28T11:57:59.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.332+0000 7f73edf77700 1 -- 172.21.15.39:0/229483357 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f73e8073cb0 con 0x7f73e8071aa0 2023-11-28T11:57:59.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.344+0000 7f73dd7fa700 1 -- 172.21.15.39:0/229483357 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f73d8057e60 con 0x7f73e8071aa0 2023-11-28T11:57:59.354 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.348+0000 7f73edf77700 1 -- 172.21.15.39:0/229483357 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f73d4064ee0 msgr2=0x7f73d4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:59.354 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.348+0000 7f73edf77700 1 --2- 172.21.15.39:0/229483357 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f73d4064ee0 0x7f73d4067390 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f73e4000f80 tx=0x7f73e4009000 comp rx=0 tx=0).stop 2023-11-28T11:57:59.354 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.348+0000 7f73edf77700 1 -- 172.21.15.39:0/229483357 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73e8071aa0 msgr2=0x7f73e815a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:59.354 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.348+0000 7f73edf77700 1 --2- 172.21.15.39:0/229483357 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73e8071aa0 0x7f73e815a580 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f73d800d800 tx=0x7f73d800db10 comp rx=0 tx=0).stop 2023-11-28T11:57:59.355 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.348+0000 7f73edf77700 1 -- 172.21.15.39:0/229483357 shutdown_connections 2023-11-28T11:57:59.355 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.348+0000 7f73edf77700 1 --2- 172.21.15.39:0/229483357 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f73d4064ee0 0x7f73d4067390 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:59.355 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.348+0000 7f73edf77700 1 --2- 172.21.15.39:0/229483357 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73e815c640 0x7f73e80cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:59.355 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.348+0000 7f73edf77700 1 --2- 172.21.15.39:0/229483357 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73e8071aa0 0x7f73e815a580 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:59.355 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.348+0000 7f73edf77700 1 --2- 172.21.15.39:0/229483357 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73e8069e00 0x7f73e815a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:59.355 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.348+0000 7f73edf77700 1 -- 172.21.15.39:0/229483357 >> 172.21.15.39:0/229483357 conn(0x7f73e80b6520 msgr2=0x7f73e80b0530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:59.355 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.348+0000 7f73edf77700 1 -- 172.21.15.39:0/229483357 shutdown_connections 2023-11-28T11:57:59.355 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.348+0000 7f73edf77700 1 -- 172.21.15.39:0/229483357 wait complete. 2023-11-28T11:57:59.377 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:57:59.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.544+0000 7ff2c8a98700 1 Processor -- start 2023-11-28T11:57:59.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.544+0000 7ff2c8a98700 1 -- start start 2023-11-28T11:57:59.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.544+0000 7ff2c8a98700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff2c415c640 0x7ff2c40d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:59.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.544+0000 7ff2c8a98700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2c4071aa0 0x7ff2c406d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:59.552 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.544+0000 7ff2c8a98700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2c406c600 con 0x7ff2c4069e00 2023-11-28T11:57:59.552 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.544+0000 7ff2c8a98700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2c406cef0 con 0x7ff2c415c640 2023-11-28T11:57:59.552 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.544+0000 7ff2c8a98700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c40722f0 con 0x7ff2c4071aa0 2023-11-28T11:57:59.552 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.548+0000 7ff2c3fff700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7ff2c4069e00 0x7ff2c40d0580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:49392/0 (socket says 172.21.15.39:49392) 2023-11-28T11:57:59.552 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.548+0000 7ff2c3fff700 1 -- 172.21.15.39:0/3440432997 learned_addr learned my addr 172.21.15.39:0/3440432997 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:59.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.548+0000 7ff2c37fe700 1 --2- 172.21.15.39:0/3440432997 >> v2:172.21.15.184:3300/0 conn(0x7ff2c415c640 0x7ff2c40d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:59.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.548+0000 7ff2c2ffd700 1 --2- 172.21.15.39:0/3440432997 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2c4071aa0 0x7ff2c406d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:59.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.548+0000 7ff2c27fc700 1 -- 172.21.15.39:0/3440432997 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1571907920 0 0) 0x7ff2c406c600 con 0x7ff2c4069e00 2023-11-28T11:57:59.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.548+0000 7ff2c27fc700 1 -- 172.21.15.39:0/3440432997 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2ac0035d0 con 0x7ff2c4069e00 2023-11-28T11:57:59.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.548+0000 7ff2c2ffd700 1 -- 172.21.15.39:0/3440432997 >> v2:172.21.15.184:3300/0 conn(0x7ff2c415c640 msgr2=0x7ff2c40d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:59.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.548+0000 7ff2c2ffd700 1 --2- 172.21.15.39:0/3440432997 >> v2:172.21.15.184:3300/0 conn(0x7ff2c415c640 0x7ff2c40d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:59.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.548+0000 7ff2c2ffd700 1 -- 172.21.15.39:0/3440432997 >> v1:172.21.15.39:6789/0 conn(0x7ff2c4069e00 legacy=0x7ff2c40d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:59.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.548+0000 7ff2c2ffd700 1 -- 172.21.15.39:0/3440432997 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c415ca10 con 0x7ff2c4071aa0 2023-11-28T11:57:59.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.548+0000 7ff2c37fe700 1 --2- 172.21.15.39:0/3440432997 >> v2:172.21.15.184:3300/0 conn(0x7ff2c415c640 0x7ff2c40d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:59.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.548+0000 7ff2c2ffd700 1 --2- 172.21.15.39:0/3440432997 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2c4071aa0 0x7ff2c406d310 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8009850 tx=0x7ff2b8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f795d5e33dcbac1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:59.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.548+0000 7ff2c27fc700 1 -- 172.21.15.39:0/3440432997 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b8011830 con 0x7ff2c4071aa0 2023-11-28T11:57:59.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.548+0000 7ff2c27fc700 1 -- 172.21.15.39:0/3440432997 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b8011990 con 0x7ff2c4071aa0 2023-11-28T11:57:59.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.548+0000 7ff2c27fc700 1 -- 172.21.15.39:0/3440432997 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b8011d40 con 0x7ff2c4071aa0 2023-11-28T11:57:59.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.548+0000 7ff2c8a98700 1 -- 172.21.15.39:0/3440432997 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2c4071aa0 msgr2=0x7ff2c406d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:59.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.548+0000 7ff2c8a98700 1 --2- 172.21.15.39:0/3440432997 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2c4071aa0 0x7ff2c406d310 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8009850 tx=0x7ff2b8009b60 comp rx=0 tx=0).stop 2023-11-28T11:57:59.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.548+0000 7ff2c8a98700 1 -- 172.21.15.39:0/3440432997 shutdown_connections 2023-11-28T11:57:59.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.548+0000 7ff2c8a98700 1 --2- 172.21.15.39:0/3440432997 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2c4071aa0 0x7ff2c406d310 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:59.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.548+0000 7ff2c8a98700 1 --2- 172.21.15.39:0/3440432997 >> v2:172.21.15.184:3300/0 conn(0x7ff2c415c640 0x7ff2c40d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:59.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.548+0000 7ff2c8a98700 1 -- 172.21.15.39:0/3440432997 >> 172.21.15.39:0/3440432997 conn(0x7ff2c40b6520 msgr2=0x7ff2c4071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:59.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.552+0000 7ff2c8a98700 1 -- 172.21.15.39:0/3440432997 shutdown_connections 2023-11-28T11:57:59.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.552+0000 7ff2c8a98700 1 -- 172.21.15.39:0/3440432997 wait complete. 2023-11-28T11:57:59.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.552+0000 7ff2c8a98700 1 Processor -- start 2023-11-28T11:57:59.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.552+0000 7ff2c8a98700 1 -- start start 2023-11-28T11:57:59.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.556+0000 7ff2c8a98700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2c4069e00 0x7ff2c41f5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:59.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.556+0000 7ff2c8a98700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2c4071aa0 0x7ff2c40c6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:59.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.556+0000 7ff2c8a98700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2c415c640 0x7ff2c4159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:59.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.556+0000 7ff2c8a98700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c41f5fe0 con 0x7ff2c415c640 2023-11-28T11:57:59.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.556+0000 7ff2c8a98700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c40b2490 con 0x7ff2c4071aa0 2023-11-28T11:57:59.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.556+0000 7ff2c8a98700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c415f420 con 0x7ff2c4069e00 2023-11-28T11:57:59.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.556+0000 7ff2c3fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2c415c640 0x7ff2c4159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:59.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.556+0000 7ff2c3fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2c415c640 0x7ff2c4159ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53710/0 (socket says 172.21.15.39:53710) 2023-11-28T11:57:59.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.556+0000 7ff2c3fff700 1 -- 172.21.15.39:0/4030719950 learned_addr learned my addr 172.21.15.39:0/4030719950 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:59.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.556+0000 7ff2c2ffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2c4071aa0 0x7ff2c40c6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:59.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.556+0000 7ff2c37fe700 1 --2- 172.21.15.39:0/4030719950 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2c4069e00 0x7ff2c41f5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:59.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.556+0000 7ff2c3fff700 1 -- 172.21.15.39:0/4030719950 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2c4069e00 msgr2=0x7ff2c41f5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:59.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.556+0000 7ff2c3fff700 1 --2- 172.21.15.39:0/4030719950 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2c4069e00 0x7ff2c41f5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:59.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.556+0000 7ff2c3fff700 1 -- 172.21.15.39:0/4030719950 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2c4071aa0 msgr2=0x7ff2c40c6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:59.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.556+0000 7ff2c3fff700 1 --2- 172.21.15.39:0/4030719950 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2c4071aa0 0x7ff2c40c6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:59.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.556+0000 7ff2c3fff700 1 -- 172.21.15.39:0/4030719950 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b40094b0 con 0x7ff2c415c640 2023-11-28T11:57:59.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.556+0000 7ff2c3fff700 1 --2- 172.21.15.39:0/4030719950 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2c415c640 0x7ff2c4159ab0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc00caa0 tx=0x7ff2bc00cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:59.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.556+0000 7ff2abfff700 1 -- 172.21.15.39:0/4030719950 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc007480 con 0x7ff2c415c640 2023-11-28T11:57:59.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.556+0000 7ff2abfff700 1 -- 172.21.15.39:0/4030719950 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2bc0075e0 con 0x7ff2c415c640 2023-11-28T11:57:59.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.556+0000 7ff2c8a98700 1 -- 172.21.15.39:0/4030719950 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2b80094b0 con 0x7ff2c415c640 2023-11-28T11:57:59.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.556+0000 7ff2abfff700 1 -- 172.21.15.39:0/4030719950 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc007970 con 0x7ff2c415c640 2023-11-28T11:57:59.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.556+0000 7ff2c8a98700 1 -- 172.21.15.39:0/4030719950 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2c406c830 con 0x7ff2c415c640 2023-11-28T11:57:59.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.560+0000 7ff2c8a98700 1 -- 172.21.15.39:0/4030719950 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2c4072010 con 0x7ff2c415c640 2023-11-28T11:57:59.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.560+0000 7ff2abfff700 1 -- 172.21.15.39:0/4030719950 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff2bc019030 con 0x7ff2c415c640 2023-11-28T11:57:59.568 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.560+0000 7ff2abfff700 1 --2- 172.21.15.39:0/4030719950 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff2b0064ee0 0x7ff2b0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:59.568 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.560+0000 7ff2abfff700 1 -- 172.21.15.39:0/4030719950 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7ff2bc081490 con 0x7ff2c415c640 2023-11-28T11:57:59.569 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.564+0000 7ff2c37fe700 1 --2- 172.21.15.39:0/4030719950 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff2b0064ee0 0x7ff2b0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:59.569 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.564+0000 7ff2c37fe700 1 --2- 172.21.15.39:0/4030719950 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff2b0064ee0 0x7ff2b0067390 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff2c40716c0 tx=0x7ff2b4009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:59.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.568+0000 7ff2abfff700 1 -- 172.21.15.39:0/4030719950 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff2bc04f840 con 0x7ff2c415c640 2023-11-28T11:57:59.752 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.744+0000 7ff2c8a98700 1 -- 172.21.15.39:0/4030719950 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2c406cb10 con 0x7ff2c415c640 2023-11-28T11:57:59.754 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.748+0000 7ff2abfff700 1 -- 172.21.15.39:0/4030719950 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+14376 (secure 0 0 0) 0x7ff2bc052e60 con 0x7ff2c415c640 2023-11-28T11:57:59.755 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:57:59.755 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":40,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:57:55.982987+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:57:59.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.752+0000 7ff2c8a98700 1 -- 172.21.15.39:0/4030719950 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff2b0064ee0 msgr2=0x7ff2b0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:59.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.752+0000 7ff2c8a98700 1 --2- 172.21.15.39:0/4030719950 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff2b0064ee0 0x7ff2b0067390 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff2c40716c0 tx=0x7ff2b4009240 comp rx=0 tx=0).stop 2023-11-28T11:57:59.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.752+0000 7ff2c8a98700 1 -- 172.21.15.39:0/4030719950 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2c415c640 msgr2=0x7ff2c4159ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:59.758 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.752+0000 7ff2c8a98700 1 --2- 172.21.15.39:0/4030719950 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2c415c640 0x7ff2c4159ab0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc00caa0 tx=0x7ff2bc00cad0 comp rx=0 tx=0).stop 2023-11-28T11:57:59.758 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.752+0000 7ff2c8a98700 1 -- 172.21.15.39:0/4030719950 shutdown_connections 2023-11-28T11:57:59.758 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.752+0000 7ff2c8a98700 1 --2- 172.21.15.39:0/4030719950 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2c415c640 0x7ff2c4159ab0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:59.758 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.752+0000 7ff2c8a98700 1 --2- 172.21.15.39:0/4030719950 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff2b0064ee0 0x7ff2b0067390 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:59.758 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.752+0000 7ff2c8a98700 1 --2- 172.21.15.39:0/4030719950 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2c4071aa0 0x7ff2c40c6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:59.758 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.752+0000 7ff2c8a98700 1 --2- 172.21.15.39:0/4030719950 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2c4069e00 0x7ff2c41f5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:59.758 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.752+0000 7ff2c8a98700 1 -- 172.21.15.39:0/4030719950 >> 172.21.15.39:0/4030719950 conn(0x7ff2c40b6520 msgr2=0x7ff2c40cbfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:59.758 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.752+0000 7ff2c8a98700 1 -- 172.21.15.39:0/4030719950 shutdown_connections 2023-11-28T11:57:59.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.752+0000 7ff2c8a98700 1 -- 172.21.15.39:0/4030719950 wait complete. 2023-11-28T11:57:59.782 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:56:26.631457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:56:33.242202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:57:59.782 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:57:59.890 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:57:59.897 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:57:59.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.952+0000 7ff056af4700 1 Processor -- start 2023-11-28T11:57:59.960 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.956+0000 7ff056af4700 1 -- start start 2023-11-28T11:57:59.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.956+0000 7ff056af4700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff05015e190 0x7ff0500cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:59.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.956+0000 7ff056af4700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff05015e560 con 0x7ff05006ff10 2023-11-28T11:57:59.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.956+0000 7ff056af4700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff05006be80 con 0x7ff050161560 2023-11-28T11:57:59.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.956+0000 7ff056af4700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0500ce330 con 0x7ff05015e190 2023-11-28T11:57:59.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.956+0000 7ff0562f3700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7ff05006ff10 0x7ff05006c310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:49394/0 (socket says 172.21.15.39:49394) 2023-11-28T11:57:59.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.956+0000 7ff0562f3700 1 -- 172.21.15.39:0/4293742395 learned_addr learned my addr 172.21.15.39:0/4293742395 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:57:59.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.956+0000 7ff055af2700 1 --2- 172.21.15.39:0/4293742395 >> v2:172.21.15.184:3300/0 conn(0x7ff05015e190 0x7ff0500cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:59.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.956+0000 7ff054af0700 1 -- 172.21.15.39:0/4293742395 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1544710600 0 0) 0x7ff048001490 con 0x7ff05006ff10 2023-11-28T11:57:59.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.956+0000 7ff054af0700 1 -- 172.21.15.39:0/4293742395 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff03c0035d0 con 0x7ff05006ff10 2023-11-28T11:57:59.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.956+0000 7ff055af2700 1 -- 172.21.15.39:0/4293742395 >> v1:172.21.15.184:6789/0 conn(0x7ff050161560 legacy=0x7ff050069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:59.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.956+0000 7ff055af2700 1 -- 172.21.15.39:0/4293742395 >> v1:172.21.15.39:6789/0 conn(0x7ff05006ff10 legacy=0x7ff05006c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:59.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.956+0000 7ff055af2700 1 -- 172.21.15.39:0/4293742395 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0500af990 con 0x7ff05015e190 2023-11-28T11:57:59.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.956+0000 7ff055af2700 1 --2- 172.21.15.39:0/4293742395 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff05015e190 0x7ff0500cdc50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff04c009850 tx=0x7ff04c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7efedb6e9ff70599 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:59.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.956+0000 7ff054af0700 1 -- 172.21.15.39:0/4293742395 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04c011830 con 0x7ff05015e190 2023-11-28T11:57:59.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.960+0000 7ff054af0700 1 -- 172.21.15.39:0/4293742395 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04c011990 con 0x7ff05015e190 2023-11-28T11:57:59.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.960+0000 7ff054af0700 1 -- 172.21.15.39:0/4293742395 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04c011d40 con 0x7ff05015e190 2023-11-28T11:57:59.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.960+0000 7ff056af4700 1 -- 172.21.15.39:0/4293742395 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff05015e190 msgr2=0x7ff0500cdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:59.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.960+0000 7ff056af4700 1 --2- 172.21.15.39:0/4293742395 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff05015e190 0x7ff0500cdc50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff04c009850 tx=0x7ff04c009b60 comp rx=0 tx=0).stop 2023-11-28T11:57:59.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.960+0000 7ff056af4700 1 -- 172.21.15.39:0/4293742395 shutdown_connections 2023-11-28T11:57:59.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.960+0000 7ff056af4700 1 --2- 172.21.15.39:0/4293742395 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff05015e190 0x7ff0500cdc50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:59.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.960+0000 7ff056af4700 1 -- 172.21.15.39:0/4293742395 >> 172.21.15.39:0/4293742395 conn(0x7ff0500cf280 msgr2=0x7ff0500cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:59.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.960+0000 7ff056af4700 1 -- 172.21.15.39:0/4293742395 shutdown_connections 2023-11-28T11:57:59.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.960+0000 7ff056af4700 1 -- 172.21.15.39:0/4293742395 wait complete. 2023-11-28T11:57:59.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.964+0000 7ff056af4700 1 Processor -- start 2023-11-28T11:57:59.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.964+0000 7ff056af4700 1 -- start start 2023-11-28T11:57:59.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.964+0000 7ff056af4700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff05006ff10 0x7ff0500c5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:59.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.964+0000 7ff056af4700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff05015e190 0x7ff0500b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:59.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.964+0000 7ff056af4700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff050161560 0x7ff050163760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:59.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.964+0000 7ff056af4700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0500c6560 con 0x7ff050161560 2023-11-28T11:57:59.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.964+0000 7ff056af4700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0500c5cc0 con 0x7ff05015e190 2023-11-28T11:57:59.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.964+0000 7ff056af4700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0500c5fa0 con 0x7ff05006ff10 2023-11-28T11:57:59.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.964+0000 7ff0562f3700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff050161560 0x7ff050163760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:59.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.964+0000 7ff0562f3700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff050161560 0x7ff050163760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53718/0 (socket says 172.21.15.39:53718) 2023-11-28T11:57:59.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.964+0000 7ff0562f3700 1 -- 172.21.15.39:0/3665246654 learned_addr learned my addr 172.21.15.39:0/3665246654 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:57:59.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.964+0000 7ff0552f1700 1 --2- 172.21.15.39:0/3665246654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff05015e190 0x7ff0500b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:59.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.964+0000 7ff055af2700 1 --2- 172.21.15.39:0/3665246654 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff05006ff10 0x7ff0500c5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:59.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.968+0000 7ff0562f3700 1 -- 172.21.15.39:0/3665246654 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff05006ff10 msgr2=0x7ff0500c5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:59.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.968+0000 7ff0562f3700 1 --2- 172.21.15.39:0/3665246654 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff05006ff10 0x7ff0500c5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:59.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.968+0000 7ff0562f3700 1 -- 172.21.15.39:0/3665246654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff05015e190 msgr2=0x7ff0500b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:59.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.968+0000 7ff0562f3700 1 --2- 172.21.15.39:0/3665246654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff05015e190 0x7ff0500b3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:59.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.968+0000 7ff0562f3700 1 -- 172.21.15.39:0/3665246654 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff04c0094b0 con 0x7ff050161560 2023-11-28T11:57:59.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.968+0000 7ff0552f1700 1 --2- 172.21.15.39:0/3665246654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff05015e190 0x7ff0500b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:59.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.968+0000 7ff0562f3700 1 --2- 172.21.15.39:0/3665246654 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff050161560 0x7ff050163760 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff04800cae0 tx=0x7ff04800cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:59.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.968+0000 7ff0467fc700 1 -- 172.21.15.39:0/3665246654 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff048007480 con 0x7ff050161560 2023-11-28T11:57:59.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.968+0000 7ff0467fc700 1 -- 172.21.15.39:0/3665246654 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0480075e0 con 0x7ff050161560 2023-11-28T11:57:59.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.968+0000 7ff0467fc700 1 -- 172.21.15.39:0/3665246654 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff048007970 con 0x7ff050161560 2023-11-28T11:57:59.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.968+0000 7ff056af4700 1 -- 172.21.15.39:0/3665246654 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0500aff50 con 0x7ff050161560 2023-11-28T11:57:59.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.968+0000 7ff056af4700 1 -- 172.21.15.39:0/3665246654 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0500afc70 con 0x7ff050161560 2023-11-28T11:57:59.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.968+0000 7ff056af4700 1 -- 172.21.15.39:0/3665246654 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0501619b0 con 0x7ff050161560 2023-11-28T11:57:59.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.972+0000 7ff0467fc700 1 -- 172.21.15.39:0/3665246654 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff048019030 con 0x7ff050161560 2023-11-28T11:57:59.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.972+0000 7ff0467fc700 1 --2- 172.21.15.39:0/3665246654 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff034064f10 0x7ff0340673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:59.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.972+0000 7ff0467fc700 1 -- 172.21.15.39:0/3665246654 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7ff048081260 con 0x7ff050161560 2023-11-28T11:57:59.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.972+0000 7ff055af2700 1 --2- 172.21.15.39:0/3665246654 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff034064f10 0x7ff0340673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:59.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.976+0000 7ff055af2700 1 --2- 172.21.15.39:0/3665246654 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff034064f10 0x7ff0340673c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff04c0090b0 tx=0x7ff04c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:59.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:57:59.980+0000 7ff0467fc700 1 -- 172.21.15.39:0/3665246654 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff04804f610 con 0x7ff050161560 2023-11-28T11:58:00.158 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.152+0000 7ff056af4700 1 -- 172.21.15.39:0/3665246654 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff05015e560 con 0x7ff050161560 2023-11-28T11:58:00.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.152+0000 7ff0467fc700 1 -- 172.21.15.39:0/3665246654 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff05015e560 con 0x7ff050161560 2023-11-28T11:58:00.160 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-11-28T11:58:00.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.156+0000 7ff056af4700 1 -- 172.21.15.39:0/3665246654 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff034064f10 msgr2=0x7ff0340673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:00.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.156+0000 7ff056af4700 1 --2- 172.21.15.39:0/3665246654 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff034064f10 0x7ff0340673c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff04c0090b0 tx=0x7ff04c008030 comp rx=0 tx=0).stop 2023-11-28T11:58:00.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.156+0000 7ff056af4700 1 -- 172.21.15.39:0/3665246654 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff050161560 msgr2=0x7ff050163760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:00.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.156+0000 7ff056af4700 1 --2- 172.21.15.39:0/3665246654 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff050161560 0x7ff050163760 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff04800cae0 tx=0x7ff04800cb10 comp rx=0 tx=0).stop 2023-11-28T11:58:00.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.156+0000 7ff056af4700 1 -- 172.21.15.39:0/3665246654 shutdown_connections 2023-11-28T11:58:00.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.156+0000 7ff056af4700 1 --2- 172.21.15.39:0/3665246654 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff050161560 0x7ff050163760 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:00.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.156+0000 7ff056af4700 1 --2- 172.21.15.39:0/3665246654 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff034064f10 0x7ff0340673c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:00.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.156+0000 7ff056af4700 1 --2- 172.21.15.39:0/3665246654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff05015e190 0x7ff0500b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:00.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.156+0000 7ff056af4700 1 --2- 172.21.15.39:0/3665246654 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff05006ff10 0x7ff0500c5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:00.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.156+0000 7ff056af4700 1 -- 172.21.15.39:0/3665246654 >> 172.21.15.39:0/3665246654 conn(0x7ff0500cf280 msgr2=0x7ff0500c3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:00.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.156+0000 7ff056af4700 1 -- 172.21.15.39:0/3665246654 shutdown_connections 2023-11-28T11:58:00.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.156+0000 7ff056af4700 1 -- 172.21.15.39:0/3665246654 wait complete. 2023-11-28T11:58:00.190 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:58:00.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.416+0000 7f8211b1a700 1 Processor -- start 2023-11-28T11:58:00.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.416+0000 7f8211b1a700 1 -- start start 2023-11-28T11:58:00.423 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.416+0000 7f8211b1a700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f820c0b4280 0x7f820c0aef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:00.423 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.416+0000 7f8211b1a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f820c06ae10 0x7f820c0af480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:00.423 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.416+0000 7f8211b1a700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f820c06c040 con 0x7f820c0adb20 2023-11-28T11:58:00.424 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.416+0000 7f8211b1a700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f820c15a920 con 0x7f820c0b4280 2023-11-28T11:58:00.424 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.416+0000 7f8211b1a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f820c15eac0 con 0x7f820c06ae10 2023-11-28T11:58:00.424 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.416+0000 7f820affd700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f820c0adb20 0x7f820c069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:49406/0 (socket says 172.21.15.39:49406) 2023-11-28T11:58:00.424 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.420+0000 7f820affd700 1 -- 172.21.15.39:0/155651129 learned_addr learned my addr 172.21.15.39:0/155651129 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:58:00.424 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.420+0000 7f820bfff700 1 --2- 172.21.15.39:0/155651129 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f820c06ae10 0x7f820c0af480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:00.425 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.420+0000 7f820b7fe700 1 --2- 172.21.15.39:0/155651129 >> v2:172.21.15.184:3300/0 conn(0x7f820c0b4280 0x7f820c0aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:00.425 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.420+0000 7f820bfff700 1 -- 172.21.15.39:0/155651129 >> v2:172.21.15.184:3300/0 conn(0x7f820c0b4280 msgr2=0x7f820c0aef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:00.425 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.420+0000 7f820bfff700 1 --2- 172.21.15.39:0/155651129 >> v2:172.21.15.184:3300/0 conn(0x7f820c0b4280 0x7f820c0aef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:00.425 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.420+0000 7f820a7fc700 1 -- 172.21.15.39:0/155651129 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3581602934 0 0) 0x7f820c06c040 con 0x7f820c0adb20 2023-11-28T11:58:00.425 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.420+0000 7f820bfff700 1 -- 172.21.15.39:0/155651129 >> v1:172.21.15.39:6789/0 conn(0x7f820c0adb20 legacy=0x7f820c069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:00.426 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.420+0000 7f820bfff700 1 -- 172.21.15.39:0/155651129 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f820c06d4e0 con 0x7f820c06ae10 2023-11-28T11:58:00.426 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.420+0000 7f820bfff700 1 --2- 172.21.15.39:0/155651129 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f820c06ae10 0x7f820c0af480 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8204009d90 tx=0x7f820400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da1e9748344544af server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:00.426 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.420+0000 7f820a7fc700 1 -- 172.21.15.39:0/155651129 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820400e070 con 0x7f820c06ae10 2023-11-28T11:58:00.426 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.420+0000 7f820a7fc700 1 -- 172.21.15.39:0/155651129 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820400bb20 con 0x7f820c06ae10 2023-11-28T11:58:00.426 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.420+0000 7f820a7fc700 1 -- 172.21.15.39:0/155651129 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8204012430 con 0x7f820c06ae10 2023-11-28T11:58:00.427 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.420+0000 7f8211b1a700 1 -- 172.21.15.39:0/155651129 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f820c06ae10 msgr2=0x7f820c0af480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:00.427 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.420+0000 7f8211b1a700 1 --2- 172.21.15.39:0/155651129 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f820c06ae10 0x7f820c0af480 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8204009d90 tx=0x7f820400b330 comp rx=0 tx=0).stop 2023-11-28T11:58:00.427 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.420+0000 7f8211b1a700 1 -- 172.21.15.39:0/155651129 shutdown_connections 2023-11-28T11:58:00.427 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.420+0000 7f8211b1a700 1 --2- 172.21.15.39:0/155651129 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f820c06ae10 0x7f820c0af480 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:00.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.420+0000 7f8211b1a700 1 --2- 172.21.15.39:0/155651129 >> v2:172.21.15.184:3300/0 conn(0x7f820c0b4280 0x7f820c0aef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:00.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.420+0000 7f8211b1a700 1 -- 172.21.15.39:0/155651129 >> 172.21.15.39:0/155651129 conn(0x7f820c0cf580 msgr2=0x7f820c0cb370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:00.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.420+0000 7f8211b1a700 1 -- 172.21.15.39:0/155651129 shutdown_connections 2023-11-28T11:58:00.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.420+0000 7f8211b1a700 1 -- 172.21.15.39:0/155651129 wait complete. 2023-11-28T11:58:00.430 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.424+0000 7f8211b1a700 1 Processor -- start 2023-11-28T11:58:00.433 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.424+0000 7f8211b1a700 1 -- start start 2023-11-28T11:58:00.433 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.428+0000 7f8211b1a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f820c06ae10 0x7f820c15d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:00.433 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.428+0000 7f8211b1a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f820c0adb20 0x7f820c156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:00.433 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.428+0000 7f8211b1a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f820c0b4280 0x7f820c0c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:00.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.428+0000 7f8211b1a700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820c0c9790 con 0x7f820c0adb20 2023-11-28T11:58:00.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.428+0000 7f8211b1a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820c0c9a70 con 0x7f820c0b4280 2023-11-28T11:58:00.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.428+0000 7f8211b1a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f820c0c9d50 con 0x7f820c06ae10 2023-11-28T11:58:00.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.428+0000 7f820affd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f820c0adb20 0x7f820c156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:00.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.428+0000 7f820b7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f820c06ae10 0x7f820c15d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:00.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.428+0000 7f820affd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f820c0adb20 0x7f820c156250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53720/0 (socket says 172.21.15.39:53720) 2023-11-28T11:58:00.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.428+0000 7f820affd700 1 -- 172.21.15.39:0/3698955454 learned_addr learned my addr 172.21.15.39:0/3698955454 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:00.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.428+0000 7f820bfff700 1 --2- 172.21.15.39:0/3698955454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f820c0b4280 0x7f820c0c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:00.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.428+0000 7f820b7fe700 1 -- 172.21.15.39:0/3698955454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f820c0b4280 msgr2=0x7f820c0c8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:00.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.428+0000 7f820b7fe700 1 --2- 172.21.15.39:0/3698955454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f820c0b4280 0x7f820c0c8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:00.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.428+0000 7f820b7fe700 1 -- 172.21.15.39:0/3698955454 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f820c0adb20 msgr2=0x7f820c156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:00.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.428+0000 7f820b7fe700 1 --2- 172.21.15.39:0/3698955454 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f820c0adb20 0x7f820c156250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:00.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.428+0000 7f820b7fe700 1 -- 172.21.15.39:0/3698955454 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8204009a70 con 0x7f820c06ae10 2023-11-28T11:58:00.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.428+0000 7f820b7fe700 1 --2- 172.21.15.39:0/3698955454 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f820c06ae10 0x7f820c15d3d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f81fc00e870 tx=0x7f81fc00eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:00.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.428+0000 7f81f3fff700 1 -- 172.21.15.39:0/3698955454 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81fc013680 con 0x7f820c06ae10 2023-11-28T11:58:00.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.432+0000 7f8211b1a700 1 -- 172.21.15.39:0/3698955454 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f820c15ed60 con 0x7f820c06ae10 2023-11-28T11:58:00.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.432+0000 7f81f3fff700 1 -- 172.21.15.39:0/3698955454 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81fc0137e0 con 0x7f820c06ae10 2023-11-28T11:58:00.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.432+0000 7f81f3fff700 1 -- 172.21.15.39:0/3698955454 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81fc013b70 con 0x7f820c06ae10 2023-11-28T11:58:00.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.432+0000 7f8211b1a700 1 -- 172.21.15.39:0/3698955454 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f820c0b4650 con 0x7f820c06ae10 2023-11-28T11:58:00.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.432+0000 7f8211b1a700 1 -- 172.21.15.39:0/3698955454 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f820c0b1350 con 0x7f820c06ae10 2023-11-28T11:58:00.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.436+0000 7f81f3fff700 1 -- 172.21.15.39:0/3698955454 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f81fc019030 con 0x7f820c06ae10 2023-11-28T11:58:00.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.436+0000 7f81f3fff700 1 --2- 172.21.15.39:0/3698955454 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f81f8064ee0 0x7f81f8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:00.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.436+0000 7f81f3fff700 1 -- 172.21.15.39:0/3698955454 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f81fc0819a0 con 0x7f820c06ae10 2023-11-28T11:58:00.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.436+0000 7f820affd700 1 --2- 172.21.15.39:0/3698955454 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f81f8064ee0 0x7f81f8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:00.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.436+0000 7f820affd700 1 --2- 172.21.15.39:0/3698955454 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f81f8064ee0 0x7f81f8067390 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f820c15d160 tx=0x7f8200007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:00.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.444+0000 7f81f3fff700 1 -- 172.21.15.39:0/3698955454 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f81fc04fd50 con 0x7f820c06ae10 2023-11-28T11:58:00.619 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.612+0000 7f8211b1a700 1 -- 172.21.15.39:0/3698955454 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f820c0726c0 con 0x7f820c06ae10 2023-11-28T11:58:00.621 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.616+0000 7f81f3fff700 1 -- 172.21.15.39:0/3698955454 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v40) v1 ==== 92+0+10 (secure 0 0 0) 0x7f81fc0170a0 con 0x7f820c06ae10 2023-11-28T11:58:00.621 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-11-28T11:58:00.624 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.616+0000 7f8211b1a700 1 -- 172.21.15.39:0/3698955454 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f81f8064ee0 msgr2=0x7f81f8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:00.624 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.616+0000 7f8211b1a700 1 --2- 172.21.15.39:0/3698955454 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f81f8064ee0 0x7f81f8067390 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f820c15d160 tx=0x7f8200007ec0 comp rx=0 tx=0).stop 2023-11-28T11:58:00.624 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.616+0000 7f8211b1a700 1 -- 172.21.15.39:0/3698955454 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f820c06ae10 msgr2=0x7f820c15d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:00.624 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.616+0000 7f8211b1a700 1 --2- 172.21.15.39:0/3698955454 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f820c06ae10 0x7f820c15d3d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f81fc00e870 tx=0x7f81fc00eb80 comp rx=0 tx=0).stop 2023-11-28T11:58:00.624 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.620+0000 7f8211b1a700 1 -- 172.21.15.39:0/3698955454 shutdown_connections 2023-11-28T11:58:00.625 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.620+0000 7f8211b1a700 1 --2- 172.21.15.39:0/3698955454 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f81f8064ee0 0x7f81f8067390 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:00.625 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.620+0000 7f8211b1a700 1 --2- 172.21.15.39:0/3698955454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f820c0b4280 0x7f820c0c8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:00.625 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.620+0000 7f8211b1a700 1 --2- 172.21.15.39:0/3698955454 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f820c0adb20 0x7f820c156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:00.625 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.620+0000 7f8211b1a700 1 --2- 172.21.15.39:0/3698955454 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f820c06ae10 0x7f820c15d3d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:00.625 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.620+0000 7f8211b1a700 1 -- 172.21.15.39:0/3698955454 >> 172.21.15.39:0/3698955454 conn(0x7f820c0cf580 msgr2=0x7f820c0b3340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:00.625 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.620+0000 7f8211b1a700 1 -- 172.21.15.39:0/3698955454 shutdown_connections 2023-11-28T11:58:00.625 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.620+0000 7f8211b1a700 1 -- 172.21.15.39:0/3698955454 wait complete. 2023-11-28T11:58:00.649 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T11:58:00.832 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.824+0000 7efd2f59e700 1 Processor -- start 2023-11-28T11:58:00.832 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.828+0000 7efd2f59e700 1 -- start start 2023-11-28T11:58:00.834 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.828+0000 7efd2f59e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7efd30160710 0x7efd300cc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:00.834 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.828+0000 7efd2f59e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7efd300cc860 0x7efd30070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:00.834 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.828+0000 7efd2f59e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd300ad6c0 con 0x7efd300705c0 2023-11-28T11:58:00.835 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.828+0000 7efd2f59e700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd3006b1c0 con 0x7efd30160710 2023-11-28T11:58:00.835 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.828+0000 7efd2f59e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd300adc60 con 0x7efd300cc860 2023-11-28T11:58:00.835 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.828+0000 7efd2e59c700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7efd30160710 0x7efd300cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:00.835 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.828+0000 7efd2e59c700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7efd30160710 0x7efd300cc320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53730/0 (socket says 172.21.15.39:53730) 2023-11-28T11:58:00.835 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.828+0000 7efd2e59c700 1 -- 172.21.15.39:0/3937381564 learned_addr learned my addr 172.21.15.39:0/3937381564 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:00.836 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.828+0000 7efd2dd9b700 1 --2- 172.21.15.39:0/3937381564 >> v2:172.21.15.184:3300/0 conn(0x7efd300cc860 0x7efd30070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:00.836 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.828+0000 7efd2e59c700 1 -- 172.21.15.39:0/3937381564 >> v2:172.21.15.184:3300/0 conn(0x7efd300cc860 msgr2=0x7efd30070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:00.836 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.828+0000 7efd2e59c700 1 --2- 172.21.15.39:0/3937381564 >> v2:172.21.15.184:3300/0 conn(0x7efd300cc860 0x7efd30070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:00.836 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.828+0000 7efd2e59c700 1 -- 172.21.15.39:0/3937381564 >> v1:172.21.15.184:6789/0 conn(0x7efd300705c0 legacy=0x7efd30069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:00.836 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.828+0000 7efd2e59c700 1 -- 172.21.15.39:0/3937381564 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd30070a20 con 0x7efd30160710 2023-11-28T11:58:00.837 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.832+0000 7efd2e59c700 1 --2- 172.21.15.39:0/3937381564 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd30160710 0x7efd300cc320 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7efd301641b0 tx=0x7efd2000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6687c8dd1f0b1a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:00.837 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.832+0000 7efd2d59a700 1 -- 172.21.15.39:0/3937381564 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2000e070 con 0x7efd30160710 2023-11-28T11:58:00.837 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.832+0000 7efd2d59a700 1 -- 172.21.15.39:0/3937381564 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd2000b910 con 0x7efd30160710 2023-11-28T11:58:00.837 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.832+0000 7efd2d59a700 1 -- 172.21.15.39:0/3937381564 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2000bcc0 con 0x7efd30160710 2023-11-28T11:58:00.838 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.832+0000 7efd2f59e700 1 -- 172.21.15.39:0/3937381564 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd30160710 msgr2=0x7efd300cc320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:00.838 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.832+0000 7efd2f59e700 1 --2- 172.21.15.39:0/3937381564 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd30160710 0x7efd300cc320 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7efd301641b0 tx=0x7efd2000b330 comp rx=0 tx=0).stop 2023-11-28T11:58:00.838 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.832+0000 7efd2f59e700 1 -- 172.21.15.39:0/3937381564 shutdown_connections 2023-11-28T11:58:00.838 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.832+0000 7efd2f59e700 1 --2- 172.21.15.39:0/3937381564 >> v2:172.21.15.184:3300/0 conn(0x7efd300cc860 0x7efd30070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:00.838 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.832+0000 7efd2f59e700 1 --2- 172.21.15.39:0/3937381564 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd30160710 0x7efd300cc320 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:00.839 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.832+0000 7efd2f59e700 1 -- 172.21.15.39:0/3937381564 >> 172.21.15.39:0/3937381564 conn(0x7efd300b0f80 msgr2=0x7efd300ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:00.839 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.832+0000 7efd2f59e700 1 -- 172.21.15.39:0/3937381564 shutdown_connections 2023-11-28T11:58:00.839 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.832+0000 7efd2f59e700 1 -- 172.21.15.39:0/3937381564 wait complete. 2023-11-28T11:58:00.841 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.836+0000 7efd2f59e700 1 Processor -- start 2023-11-28T11:58:00.841 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.836+0000 7efd2f59e700 1 -- start start 2023-11-28T11:58:00.842 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.836+0000 7efd2f59e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd300705c0 0x7efd3015f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:00.842 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.836+0000 7efd2f59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd300cc860 0x7efd300c0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:00.842 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.836+0000 7efd2f59e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd30160710 0x7efd30069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:00.843 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.836+0000 7efd2f59e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd300c1d40 con 0x7efd30160710 2023-11-28T11:58:00.843 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.836+0000 7efd2f59e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd3015f550 con 0x7efd300705c0 2023-11-28T11:58:00.843 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.836+0000 7efd2f59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd300c11f0 con 0x7efd300cc860 2023-11-28T11:58:00.843 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.836+0000 7efd2ed9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd30160710 0x7efd30069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:00.844 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.836+0000 7efd2dd9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd300cc860 0x7efd300c0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:00.844 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.836+0000 7efd2dd9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd300cc860 0x7efd300c0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:43388/0 (socket says 172.21.15.39:43388) 2023-11-28T11:58:00.844 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.836+0000 7efd2dd9b700 1 -- 172.21.15.39:0/2681310616 learned_addr learned my addr 172.21.15.39:0/2681310616 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:00.844 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.836+0000 7efd2ed9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd30160710 0x7efd30069bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53740/0 (socket says 172.21.15.39:53740) 2023-11-28T11:58:00.844 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.836+0000 7efd2e59c700 1 --2- 172.21.15.39:0/2681310616 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd300705c0 0x7efd3015f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:00.844 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.836+0000 7efd2ed9d700 1 -- 172.21.15.39:0/2681310616 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd300cc860 msgr2=0x7efd300c0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:00.845 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.840+0000 7efd2ed9d700 1 --2- 172.21.15.39:0/2681310616 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd300cc860 0x7efd300c0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:00.845 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.840+0000 7efd2ed9d700 1 -- 172.21.15.39:0/2681310616 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd300705c0 msgr2=0x7efd3015f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:00.845 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.840+0000 7efd2ed9d700 1 --2- 172.21.15.39:0/2681310616 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd300705c0 0x7efd3015f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:00.845 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.840+0000 7efd2ed9d700 1 -- 172.21.15.39:0/2681310616 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd20009b30 con 0x7efd30160710 2023-11-28T11:58:00.845 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.840+0000 7efd2dd9b700 1 --2- 172.21.15.39:0/2681310616 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd300cc860 0x7efd300c0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:58:00.845 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.840+0000 7efd2ed9d700 1 --2- 172.21.15.39:0/2681310616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd30160710 0x7efd30069bf0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7efd2800c400 tx=0x7efd2800c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:00.846 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.840+0000 7efd1effd700 1 -- 172.21.15.39:0/2681310616 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd280052d0 con 0x7efd30160710 2023-11-28T11:58:00.846 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.840+0000 7efd1effd700 1 -- 172.21.15.39:0/2681310616 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd28005430 con 0x7efd30160710 2023-11-28T11:58:00.846 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.840+0000 7efd2f59e700 1 -- 172.21.15.39:0/2681310616 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd3006b6b0 con 0x7efd30160710 2023-11-28T11:58:00.846 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.840+0000 7efd1effd700 1 -- 172.21.15.39:0/2681310616 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd280055a0 con 0x7efd30160710 2023-11-28T11:58:00.846 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.840+0000 7efd2f59e700 1 -- 172.21.15.39:0/2681310616 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd3006b3d0 con 0x7efd30160710 2023-11-28T11:58:00.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.840+0000 7efd2f59e700 1 -- 172.21.15.39:0/2681310616 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd300ad8f0 con 0x7efd30160710 2023-11-28T11:58:00.848 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.840+0000 7efd1effd700 1 -- 172.21.15.39:0/2681310616 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7efd28019030 con 0x7efd30160710 2023-11-28T11:58:00.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.844+0000 7efd1effd700 1 --2- 172.21.15.39:0/2681310616 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7efd10064ee0 0x7efd10067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:00.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.844+0000 7efd1effd700 1 -- 172.21.15.39:0/2681310616 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7efd28080d60 con 0x7efd30160710 2023-11-28T11:58:00.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.844+0000 7efd2e59c700 1 --2- 172.21.15.39:0/2681310616 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7efd10064ee0 0x7efd10067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:00.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.844+0000 7efd2e59c700 1 --2- 172.21.15.39:0/2681310616 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7efd10064ee0 0x7efd10067390 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7efd20009e20 tx=0x7efd20009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:00.855 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:00.848+0000 7efd1effd700 1 -- 172.21.15.39:0/2681310616 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7efd2804f0b0 con 0x7efd30160710 2023-11-28T11:58:01.032 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.028+0000 7efd2f59e700 1 -- 172.21.15.39:0/2681310616 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7efd300c1e80 con 0x7efd30160710 2023-11-28T11:58:01.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.028+0000 7efd1effd700 1 -- 172.21.15.39:0/2681310616 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v40) v1 ==== 84+0+126 (secure 0 0 0) 0x7efd28017090 con 0x7efd30160710 2023-11-28T11:58:01.033 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:58:01.033 INFO:teuthology.orchestra.run.smithi039.stdout:[ 2023-11-28T11:58:01.033 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:58:01.034 INFO:teuthology.orchestra.run.smithi039.stdout: "poolnum": 1, 2023-11-28T11:58:01.034 INFO:teuthology.orchestra.run.smithi039.stdout: "poolname": ".mgr" 2023-11-28T11:58:01.034 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:58:01.034 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:58:01.034 INFO:teuthology.orchestra.run.smithi039.stdout: "poolnum": 2, 2023-11-28T11:58:01.034 INFO:teuthology.orchestra.run.smithi039.stdout: "poolname": "rbd" 2023-11-28T11:58:01.034 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:58:01.034 INFO:teuthology.orchestra.run.smithi039.stdout:] 2023-11-28T11:58:01.036 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.028+0000 7efd2f59e700 1 -- 172.21.15.39:0/2681310616 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7efd10064ee0 msgr2=0x7efd10067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:01.036 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.028+0000 7efd2f59e700 1 --2- 172.21.15.39:0/2681310616 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7efd10064ee0 0x7efd10067390 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7efd20009e20 tx=0x7efd20009000 comp rx=0 tx=0).stop 2023-11-28T11:58:01.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.028+0000 7efd2f59e700 1 -- 172.21.15.39:0/2681310616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd30160710 msgr2=0x7efd30069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:01.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.028+0000 7efd2f59e700 1 --2- 172.21.15.39:0/2681310616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd30160710 0x7efd30069bf0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7efd2800c400 tx=0x7efd2800c710 comp rx=0 tx=0).stop 2023-11-28T11:58:01.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.032+0000 7efd2f59e700 1 -- 172.21.15.39:0/2681310616 shutdown_connections 2023-11-28T11:58:01.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.032+0000 7efd2f59e700 1 --2- 172.21.15.39:0/2681310616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd30160710 0x7efd30069bf0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:01.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.032+0000 7efd2f59e700 1 --2- 172.21.15.39:0/2681310616 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd300cc860 0x7efd300c0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:01.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.032+0000 7efd2f59e700 1 --2- 172.21.15.39:0/2681310616 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7efd10064ee0 0x7efd10067390 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:01.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.032+0000 7efd2f59e700 1 --2- 172.21.15.39:0/2681310616 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd300705c0 0x7efd3015f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:01.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.032+0000 7efd2f59e700 1 -- 172.21.15.39:0/2681310616 >> 172.21.15.39:0/2681310616 conn(0x7efd300b0f80 msgr2=0x7efd300afb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:01.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.032+0000 7efd2f59e700 1 -- 172.21.15.39:0/2681310616 shutdown_connections 2023-11-28T11:58:01.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.032+0000 7efd2f59e700 1 -- 172.21.15.39:0/2681310616 wait complete. 2023-11-28T11:58:01.059 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T11:58:01.059 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T11:58:01.251 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.244+0000 7fb50bfd9700 1 Processor -- start 2023-11-28T11:58:01.251 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.244+0000 7fb50bfd9700 1 -- start start 2023-11-28T11:58:01.255 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.248+0000 7fb50bfd9700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb50406b1c0 0x7fb504142fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:01.255 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.248+0000 7fb50bfd9700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb50406b8d0 con 0x7fb504142650 2023-11-28T11:58:01.255 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.248+0000 7fb50bfd9700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb50406bb70 con 0x7fb5040b6110 2023-11-28T11:58:01.255 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.248+0000 7fb50bfd9700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb50406b5f0 con 0x7fb50406b1c0 2023-11-28T11:58:01.256 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.248+0000 7fb509d75700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fb504142650 0x7fb5040b5a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:49416/0 (socket says 172.21.15.39:49416) 2023-11-28T11:58:01.256 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.248+0000 7fb509d75700 1 -- 172.21.15.39:0/3802281501 learned_addr learned my addr 172.21.15.39:0/3802281501 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:58:01.256 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.248+0000 7fb50a576700 1 --2- 172.21.15.39:0/3802281501 >> v2:172.21.15.39:3300/0 conn(0x7fb50406b1c0 0x7fb504142fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:01.257 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.252+0000 7fb50a576700 1 -- 172.21.15.39:0/3802281501 >> v1:172.21.15.184:6789/0 conn(0x7fb5040b6110 legacy=0x7fb50406aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:01.257 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.252+0000 7fb508d73700 1 -- 172.21.15.39:0/3802281501 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2630040124 0 0) 0x7fb50406bb70 con 0x7fb5040b6110 2023-11-28T11:58:01.257 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.252+0000 7fb50a576700 1 -- 172.21.15.39:0/3802281501 >> v1:172.21.15.39:6789/0 conn(0x7fb504142650 legacy=0x7fb5040b5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:01.257 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.252+0000 7fb50a576700 1 -- 172.21.15.39:0/3802281501 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb50406be50 con 0x7fb50406b1c0 2023-11-28T11:58:01.257 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.252+0000 7fb50a576700 1 --2- 172.21.15.39:0/3802281501 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb50406b1c0 0x7fb504142fa0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc009d90 tx=0x7fb4fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16029a66b1c3af01 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:01.258 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.252+0000 7fb508d73700 1 -- 172.21.15.39:0/3802281501 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc00e070 con 0x7fb50406b1c0 2023-11-28T11:58:01.258 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.252+0000 7fb508d73700 1 -- 172.21.15.39:0/3802281501 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4fc00bbd0 con 0x7fb50406b1c0 2023-11-28T11:58:01.258 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.252+0000 7fb508d73700 1 -- 172.21.15.39:0/3802281501 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc012430 con 0x7fb50406b1c0 2023-11-28T11:58:01.259 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.252+0000 7fb50bfd9700 1 -- 172.21.15.39:0/3802281501 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb50406b1c0 msgr2=0x7fb504142fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:01.259 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.252+0000 7fb50bfd9700 1 --2- 172.21.15.39:0/3802281501 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb50406b1c0 0x7fb504142fa0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc009d90 tx=0x7fb4fc00b330 comp rx=0 tx=0).stop 2023-11-28T11:58:01.259 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.252+0000 7fb50bfd9700 1 -- 172.21.15.39:0/3802281501 shutdown_connections 2023-11-28T11:58:01.259 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.252+0000 7fb50bfd9700 1 --2- 172.21.15.39:0/3802281501 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb50406b1c0 0x7fb504142fa0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:01.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.252+0000 7fb50bfd9700 1 -- 172.21.15.39:0/3802281501 >> 172.21.15.39:0/3802281501 conn(0x7fb5040b5390 msgr2=0x7fb5040d2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:01.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.252+0000 7fb50bfd9700 1 -- 172.21.15.39:0/3802281501 shutdown_connections 2023-11-28T11:58:01.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.252+0000 7fb50bfd9700 1 -- 172.21.15.39:0/3802281501 wait complete. 2023-11-28T11:58:01.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.256+0000 7fb50bfd9700 1 Processor -- start 2023-11-28T11:58:01.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.256+0000 7fb50bfd9700 1 -- start start 2023-11-28T11:58:01.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.260+0000 7fb50bfd9700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb50406b1c0 0x7fb5040abf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:01.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.260+0000 7fb50bfd9700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5040b6110 0x7fb5041f1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:01.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.260+0000 7fb50bfd9700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb504142650 0x7fb504157930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:01.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.260+0000 7fb50bfd9700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5040abc00 con 0x7fb504142650 2023-11-28T11:58:01.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.260+0000 7fb50bfd9700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5041f2e40 con 0x7fb50406b1c0 2023-11-28T11:58:01.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.260+0000 7fb50bfd9700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5041f2370 con 0x7fb5040b6110 2023-11-28T11:58:01.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.260+0000 7fb50a576700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb504142650 0x7fb504157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:01.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.260+0000 7fb50a576700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb504142650 0x7fb504157930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53764/0 (socket says 172.21.15.39:53764) 2023-11-28T11:58:01.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.260+0000 7fb50a576700 1 -- 172.21.15.39:0/1228480240 learned_addr learned my addr 172.21.15.39:0/1228480240 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:01.267 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.260+0000 7fb509d75700 1 --2- 172.21.15.39:0/1228480240 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb50406b1c0 0x7fb5040abf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:01.267 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.260+0000 7fb509574700 1 --2- 172.21.15.39:0/1228480240 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5040b6110 0x7fb5041f1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:01.267 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.260+0000 7fb50a576700 1 -- 172.21.15.39:0/1228480240 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5040b6110 msgr2=0x7fb5041f1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:01.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.260+0000 7fb50a576700 1 --2- 172.21.15.39:0/1228480240 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5040b6110 0x7fb5041f1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:01.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.260+0000 7fb50a576700 1 -- 172.21.15.39:0/1228480240 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb50406b1c0 msgr2=0x7fb5040abf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:01.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.260+0000 7fb50a576700 1 --2- 172.21.15.39:0/1228480240 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb50406b1c0 0x7fb5040abf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:01.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.260+0000 7fb50a576700 1 -- 172.21.15.39:0/1228480240 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4fc009a70 con 0x7fb504142650 2023-11-28T11:58:01.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.260+0000 7fb509d75700 1 --2- 172.21.15.39:0/1228480240 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb50406b1c0 0x7fb5040abf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:58:01.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.260+0000 7fb509574700 1 --2- 172.21.15.39:0/1228480240 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5040b6110 0x7fb5041f1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:58:01.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.260+0000 7fb50a576700 1 --2- 172.21.15.39:0/1228480240 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb504142650 0x7fb504157930 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc014040 tx=0x7fb4fc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:01.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.260+0000 7fb4fa7fc700 1 -- 172.21.15.39:0/1228480240 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc012430 con 0x7fb504142650 2023-11-28T11:58:01.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.260+0000 7fb4fa7fc700 1 -- 172.21.15.39:0/1228480240 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4fc020070 con 0x7fb504142650 2023-11-28T11:58:01.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.260+0000 7fb4fa7fc700 1 -- 172.21.15.39:0/1228480240 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc007000 con 0x7fb504142650 2023-11-28T11:58:01.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.260+0000 7fb50bfd9700 1 -- 172.21.15.39:0/1228480240 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb50406c410 con 0x7fb504142650 2023-11-28T11:58:01.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.260+0000 7fb50bfd9700 1 -- 172.21.15.39:0/1228480240 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb50406c130 con 0x7fb504142650 2023-11-28T11:58:01.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.264+0000 7fb50bfd9700 1 -- 172.21.15.39:0/1228480240 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb504142a20 con 0x7fb504142650 2023-11-28T11:58:01.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.264+0000 7fb4fa7fc700 1 -- 172.21.15.39:0/1228480240 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb4fc02e070 con 0x7fb504142650 2023-11-28T11:58:01.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.264+0000 7fb4fa7fc700 1 --2- 172.21.15.39:0/1228480240 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb4e8064ee0 0x7fb4e8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:01.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.264+0000 7fb4fa7fc700 1 -- 172.21.15.39:0/1228480240 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fb4fc022070 con 0x7fb504142650 2023-11-28T11:58:01.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.268+0000 7fb509d75700 1 --2- 172.21.15.39:0/1228480240 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb4e8064ee0 0x7fb4e8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:01.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.268+0000 7fb509d75700 1 --2- 172.21.15.39:0/1228480240 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb4e8064ee0 0x7fb4e8067390 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb5040b2790 tx=0x7fb500009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:01.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.272+0000 7fb4fa7fc700 1 -- 172.21.15.39:0/1228480240 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb4fc051f20 con 0x7fb504142650 2023-11-28T11:58:01.452 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.444+0000 7fb50bfd9700 1 -- 172.21.15.39:0/1228480240 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb50415fde0 con 0x7fb504142650 2023-11-28T11:58:01.755 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.748+0000 7fb4fa7fc700 1 -- 172.21.15.39:0/1228480240 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v41) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb4fc055540 con 0x7fb504142650 2023-11-28T11:58:01.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.756+0000 7fb50bfd9700 1 -- 172.21.15.39:0/1228480240 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb4e8064ee0 msgr2=0x7fb4e8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:01.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.756+0000 7fb50bfd9700 1 --2- 172.21.15.39:0/1228480240 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb4e8064ee0 0x7fb4e8067390 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb5040b2790 tx=0x7fb500009040 comp rx=0 tx=0).stop 2023-11-28T11:58:01.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.756+0000 7fb50bfd9700 1 -- 172.21.15.39:0/1228480240 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb504142650 msgr2=0x7fb504157930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:01.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.756+0000 7fb50bfd9700 1 --2- 172.21.15.39:0/1228480240 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb504142650 0x7fb504157930 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc014040 tx=0x7fb4fc004af0 comp rx=0 tx=0).stop 2023-11-28T11:58:01.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.760+0000 7fb50bfd9700 1 -- 172.21.15.39:0/1228480240 shutdown_connections 2023-11-28T11:58:01.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.760+0000 7fb50bfd9700 1 --2- 172.21.15.39:0/1228480240 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb504142650 0x7fb504157930 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:01.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.760+0000 7fb50bfd9700 1 --2- 172.21.15.39:0/1228480240 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5040b6110 0x7fb5041f1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:01.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.760+0000 7fb50bfd9700 1 --2- 172.21.15.39:0/1228480240 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb4e8064ee0 0x7fb4e8067390 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:01.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.760+0000 7fb50bfd9700 1 --2- 172.21.15.39:0/1228480240 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb50406b1c0 0x7fb5040abf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:01.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.760+0000 7fb50bfd9700 1 -- 172.21.15.39:0/1228480240 >> 172.21.15.39:0/1228480240 conn(0x7fb5040b5390 msgr2=0x7fb50415bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:01.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.764+0000 7fb50bfd9700 1 -- 172.21.15.39:0/1228480240 shutdown_connections 2023-11-28T11:58:01.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.764+0000 7fb50bfd9700 1 -- 172.21.15.39:0/1228480240 wait complete. 2023-11-28T11:58:01.770 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_metadata' created 2023-11-28T11:58:01.790 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T11:58:01.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.988+0000 7fe91f59e700 1 Processor -- start 2023-11-28T11:58:01.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.988+0000 7fe91f59e700 1 -- start start 2023-11-28T11:58:01.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.992+0000 7fe91f59e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe92015c7c0 0x7fe92006cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:01.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.992+0000 7fe91f59e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe920161030 0x7fe9200cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:01.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.992+0000 7fe91f59e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9200cdba0 con 0x7fe9200cd700 2023-11-28T11:58:01.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.992+0000 7fe91f59e700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe92006c010 con 0x7fe92015c7c0 2023-11-28T11:58:01.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.992+0000 7fe91f59e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe92006c2f0 con 0x7fe920161030 2023-11-28T11:58:02.000 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.992+0000 7fe91e59c700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe92015c7c0 0x7fe92006cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:02.000 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.996+0000 7fe917fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe920161030 0x7fe9200cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:02.000 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.996+0000 7fe91ed9d700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fe9200cd700 0x7fe9200cddf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:35358/0 (socket says 172.21.15.39:35358) 2023-11-28T11:58:02.000 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.996+0000 7fe91ed9d700 1 -- 172.21.15.39:0/934551696 learned_addr learned my addr 172.21.15.39:0/934551696 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:58:02.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.996+0000 7fe91dd9b700 1 -- 172.21.15.39:0/934551696 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3185293805 0 0) 0x7fe9200cdba0 con 0x7fe9200cd700 2023-11-28T11:58:02.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.996+0000 7fe917fff700 1 -- 172.21.15.39:0/934551696 >> v2:172.21.15.39:3300/0 conn(0x7fe92015c7c0 msgr2=0x7fe92006cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:02.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.996+0000 7fe917fff700 1 --2- 172.21.15.39:0/934551696 >> v2:172.21.15.39:3300/0 conn(0x7fe92015c7c0 0x7fe92006cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:02.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.996+0000 7fe917fff700 1 -- 172.21.15.39:0/934551696 >> v1:172.21.15.184:6789/0 conn(0x7fe9200cd700 legacy=0x7fe9200cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:02.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.996+0000 7fe917fff700 1 -- 172.21.15.39:0/934551696 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92006c5d0 con 0x7fe920161030 2023-11-28T11:58:02.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.996+0000 7fe91e59c700 1 --2- 172.21.15.39:0/934551696 >> v2:172.21.15.39:3300/0 conn(0x7fe92015c7c0 0x7fe92006cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:58:02.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.996+0000 7fe917fff700 1 --2- 172.21.15.39:0/934551696 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe920161030 0x7fe9200cd1c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe920071590 tx=0x7fe908009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f69e6f7e5ce5f9f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:02.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.996+0000 7fe91dd9b700 1 -- 172.21.15.39:0/934551696 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe908011830 con 0x7fe920161030 2023-11-28T11:58:02.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.996+0000 7fe91dd9b700 1 -- 172.21.15.39:0/934551696 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe908011990 con 0x7fe920161030 2023-11-28T11:58:02.003 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.996+0000 7fe91dd9b700 1 -- 172.21.15.39:0/934551696 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe908011d20 con 0x7fe920161030 2023-11-28T11:58:02.003 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.996+0000 7fe91f59e700 1 -- 172.21.15.39:0/934551696 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe920161030 msgr2=0x7fe9200cd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:02.003 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.996+0000 7fe91f59e700 1 --2- 172.21.15.39:0/934551696 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe920161030 0x7fe9200cd1c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe920071590 tx=0x7fe908009b30 comp rx=0 tx=0).stop 2023-11-28T11:58:02.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:01.996+0000 7fe91f59e700 1 -- 172.21.15.39:0/934551696 shutdown_connections 2023-11-28T11:58:02.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.000+0000 7fe91f59e700 1 --2- 172.21.15.39:0/934551696 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe920161030 0x7fe9200cd1c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:02.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.000+0000 7fe91f59e700 1 --2- 172.21.15.39:0/934551696 >> v2:172.21.15.39:3300/0 conn(0x7fe92015c7c0 0x7fe92006cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:02.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.000+0000 7fe91f59e700 1 -- 172.21.15.39:0/934551696 >> 172.21.15.39:0/934551696 conn(0x7fe9200d3800 msgr2=0x7fe9200cf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:02.005 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.000+0000 7fe91f59e700 1 -- 172.21.15.39:0/934551696 shutdown_connections 2023-11-28T11:58:02.005 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.000+0000 7fe91f59e700 1 -- 172.21.15.39:0/934551696 wait complete. 2023-11-28T11:58:02.008 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.004+0000 7fe91f59e700 1 Processor -- start 2023-11-28T11:58:02.009 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.004+0000 7fe91f59e700 1 -- start start 2023-11-28T11:58:02.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.004+0000 7fe91f59e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9200cd700 0x7fe9200b59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:02.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.004+0000 7fe91f59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe92015c7c0 0x7fe920158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:02.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.004+0000 7fe91f59e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9200b8550 0x7fe920159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:02.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.004+0000 7fe91f59e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9200b62c0 con 0x7fe9200cd700 2023-11-28T11:58:02.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.004+0000 7fe91f59e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9200b65a0 con 0x7fe9200b8550 2023-11-28T11:58:02.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.004+0000 7fe91f59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9200b6880 con 0x7fe92015c7c0 2023-11-28T11:58:02.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.004+0000 7fe91e59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9200cd700 0x7fe9200b59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:02.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.004+0000 7fe91e59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9200cd700 0x7fe9200b59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53776/0 (socket says 172.21.15.39:53776) 2023-11-28T11:58:02.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.004+0000 7fe91e59c700 1 -- 172.21.15.39:0/1162058299 learned_addr learned my addr 172.21.15.39:0/1162058299 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:02.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.004+0000 7fe917fff700 1 --2- 172.21.15.39:0/1162058299 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe92015c7c0 0x7fe920158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:02.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.004+0000 7fe91ed9d700 1 --2- 172.21.15.39:0/1162058299 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9200b8550 0x7fe920159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:02.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.008+0000 7fe91e59c700 1 -- 172.21.15.39:0/1162058299 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe92015c7c0 msgr2=0x7fe920158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:02.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.008+0000 7fe91e59c700 1 --2- 172.21.15.39:0/1162058299 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe92015c7c0 0x7fe920158ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:02.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.008+0000 7fe91e59c700 1 -- 172.21.15.39:0/1162058299 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9200b8550 msgr2=0x7fe920159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:02.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.008+0000 7fe91e59c700 1 --2- 172.21.15.39:0/1162058299 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9200b8550 0x7fe920159430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:02.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.008+0000 7fe91e59c700 1 -- 172.21.15.39:0/1162058299 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9100094b0 con 0x7fe9200cd700 2023-11-28T11:58:02.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.008+0000 7fe91e59c700 1 --2- 172.21.15.39:0/1162058299 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9200cd700 0x7fe9200b59e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe91000ebe0 tx=0x7fe91000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:02.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.008+0000 7fe916ffd700 1 -- 172.21.15.39:0/1162058299 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91000c850 con 0x7fe9200cd700 2023-11-28T11:58:02.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.008+0000 7fe916ffd700 1 -- 172.21.15.39:0/1162058299 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91000c9b0 con 0x7fe9200cd700 2023-11-28T11:58:02.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.008+0000 7fe91f59e700 1 -- 172.21.15.39:0/1162058299 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9080094b0 con 0x7fe9200cd700 2023-11-28T11:58:02.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.008+0000 7fe916ffd700 1 -- 172.21.15.39:0/1162058299 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91000cd40 con 0x7fe9200cd700 2023-11-28T11:58:02.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.008+0000 7fe91f59e700 1 -- 172.21.15.39:0/1162058299 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe92015cb90 con 0x7fe9200cd700 2023-11-28T11:58:02.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.008+0000 7fe91f59e700 1 -- 172.21.15.39:0/1162058299 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe92006c8b0 con 0x7fe9200cd700 2023-11-28T11:58:02.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.012+0000 7fe916ffd700 1 -- 172.21.15.39:0/1162058299 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe910019030 con 0x7fe9200cd700 2023-11-28T11:58:02.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.012+0000 7fe916ffd700 1 --2- 172.21.15.39:0/1162058299 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe900064f10 0x7fe9000673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:02.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.012+0000 7fe916ffd700 1 -- 172.21.15.39:0/1162058299 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5900+0+0 (secure 0 0 0) 0x7fe9100825a0 con 0x7fe9200cd700 2023-11-28T11:58:02.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.016+0000 7fe917fff700 1 --2- 172.21.15.39:0/1162058299 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe900064f10 0x7fe9000673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:02.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.016+0000 7fe916ffd700 1 -- 172.21.15.39:0/1162058299 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe910050770 con 0x7fe9200cd700 2023-11-28T11:58:02.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.016+0000 7fe917fff700 1 --2- 172.21.15.39:0/1162058299 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe900064f10 0x7fe9000673c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe9080090b0 tx=0x7fe908008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:02.192 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.188+0000 7fe91f59e700 1 -- 172.21.15.39:0/1162058299 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe9200ce500 con 0x7fe9200cd700 2023-11-28T11:58:02.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.752+0000 7fe916ffd700 1 -- 172.21.15.39:0/1162058299 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v42) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe9100170d0 con 0x7fe9200cd700 2023-11-28T11:58:02.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.764+0000 7fe91f59e700 1 -- 172.21.15.39:0/1162058299 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe900064f10 msgr2=0x7fe9000673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:02.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.764+0000 7fe91f59e700 1 --2- 172.21.15.39:0/1162058299 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe900064f10 0x7fe9000673c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe9080090b0 tx=0x7fe908008030 comp rx=0 tx=0).stop 2023-11-28T11:58:02.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.764+0000 7fe91f59e700 1 -- 172.21.15.39:0/1162058299 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9200cd700 msgr2=0x7fe9200b59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:02.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.764+0000 7fe91f59e700 1 --2- 172.21.15.39:0/1162058299 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9200cd700 0x7fe9200b59e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe91000ebe0 tx=0x7fe91000eef0 comp rx=0 tx=0).stop 2023-11-28T11:58:02.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.768+0000 7fe91f59e700 1 -- 172.21.15.39:0/1162058299 shutdown_connections 2023-11-28T11:58:02.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.768+0000 7fe91f59e700 1 --2- 172.21.15.39:0/1162058299 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe900064f10 0x7fe9000673c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:02.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.768+0000 7fe91f59e700 1 --2- 172.21.15.39:0/1162058299 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9200b8550 0x7fe920159430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:02.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.768+0000 7fe91f59e700 1 --2- 172.21.15.39:0/1162058299 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe92015c7c0 0x7fe920158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:02.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.768+0000 7fe91f59e700 1 --2- 172.21.15.39:0/1162058299 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9200cd700 0x7fe9200b59e0 secure :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe91000ebe0 tx=0x7fe91000eef0 comp rx=0 tx=0).stop 2023-11-28T11:58:02.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.768+0000 7fe91f59e700 1 -- 172.21.15.39:0/1162058299 >> 172.21.15.39:0/1162058299 conn(0x7fe9200d3800 msgr2=0x7fe9200cdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:02.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.768+0000 7fe91f59e700 1 -- 172.21.15.39:0/1162058299 shutdown_connections 2023-11-28T11:58:02.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.768+0000 7fe91f59e700 1 -- 172.21.15.39:0/1162058299 wait complete. 2023-11-28T11:58:02.787 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_data' created 2023-11-28T11:58:02.809 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T11:58:02.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.984+0000 7fac31356700 1 Processor -- start 2023-11-28T11:58:02.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.984+0000 7fac31356700 1 -- start start 2023-11-28T11:58:02.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.988+0000 7fac31356700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fac2c06ff10 0x7fac2c070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:02.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.988+0000 7fac31356700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac2c0708b0 con 0x7fac2c15e190 2023-11-28T11:58:02.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.988+0000 7fac31356700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac2c15e560 con 0x7fac2c0cdc50 2023-11-28T11:58:02.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.988+0000 7fac31356700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac2c06be80 con 0x7fac2c06ff10 2023-11-28T11:58:02.994 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.988+0000 7fac2affd700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fac2c15e190 0x7fac2c161560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:49418/0 (socket says 172.21.15.39:49418) 2023-11-28T11:58:02.994 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.988+0000 7fac2affd700 1 -- 172.21.15.39:0/1377865381 learned_addr learned my addr 172.21.15.39:0/1377865381 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:58:02.994 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.988+0000 7fac2b7fe700 1 --2- 172.21.15.39:0/1377865381 >> v2:172.21.15.184:3300/0 conn(0x7fac2c06ff10 0x7fac2c070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:02.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.988+0000 7fac2a7fc700 1 -- 172.21.15.39:0/1377865381 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2766107734 0 0) 0x7fac14001110 con 0x7fac2c0cdc50 2023-11-28T11:58:02.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.988+0000 7fac2a7fc700 1 -- 172.21.15.39:0/1377865381 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac180035d0 con 0x7fac2c0cdc50 2023-11-28T11:58:02.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.988+0000 7fac2a7fc700 1 -- 172.21.15.39:0/1377865381 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4043886607 0 0) 0x7fac2c0708b0 con 0x7fac2c15e190 2023-11-28T11:58:02.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.988+0000 7fac2a7fc700 1 -- 172.21.15.39:0/1377865381 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac14001110 con 0x7fac2c15e190 2023-11-28T11:58:02.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.988+0000 7fac2b7fe700 1 -- 172.21.15.39:0/1377865381 >> v1:172.21.15.184:6789/0 conn(0x7fac2c0cdc50 legacy=0x7fac2c069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:02.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.988+0000 7fac2b7fe700 1 -- 172.21.15.39:0/1377865381 >> v1:172.21.15.39:6789/0 conn(0x7fac2c15e190 legacy=0x7fac2c161560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:02.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.988+0000 7fac2b7fe700 1 -- 172.21.15.39:0/1377865381 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac2c0ce0a0 con 0x7fac2c06ff10 2023-11-28T11:58:02.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.988+0000 7fac2b7fe700 1 --2- 172.21.15.39:0/1377865381 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac2c06ff10 0x7fac2c070370 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fac24009d90 tx=0x7fac2400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f224b05844dc0d99 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:02.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.992+0000 7fac2a7fc700 1 -- 172.21.15.39:0/1377865381 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2400e070 con 0x7fac2c06ff10 2023-11-28T11:58:02.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.992+0000 7fac2a7fc700 1 -- 172.21.15.39:0/1377865381 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2400bb20 con 0x7fac2c06ff10 2023-11-28T11:58:02.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.992+0000 7fac2a7fc700 1 -- 172.21.15.39:0/1377865381 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac24012430 con 0x7fac2c06ff10 2023-11-28T11:58:02.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.992+0000 7fac31356700 1 -- 172.21.15.39:0/1377865381 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac2c06ff10 msgr2=0x7fac2c070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:02.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.992+0000 7fac31356700 1 --2- 172.21.15.39:0/1377865381 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac2c06ff10 0x7fac2c070370 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fac24009d90 tx=0x7fac2400b330 comp rx=0 tx=0).stop 2023-11-28T11:58:02.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.992+0000 7fac31356700 1 -- 172.21.15.39:0/1377865381 shutdown_connections 2023-11-28T11:58:02.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.992+0000 7fac31356700 1 --2- 172.21.15.39:0/1377865381 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac2c06ff10 0x7fac2c070370 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:02.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.992+0000 7fac31356700 1 -- 172.21.15.39:0/1377865381 >> 172.21.15.39:0/1377865381 conn(0x7fac2c0cf280 msgr2=0x7fac2c0cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:02.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.992+0000 7fac31356700 1 -- 172.21.15.39:0/1377865381 shutdown_connections 2023-11-28T11:58:02.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.992+0000 7fac31356700 1 -- 172.21.15.39:0/1377865381 wait complete. 2023-11-28T11:58:02.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.992+0000 7fac31356700 1 Processor -- start 2023-11-28T11:58:03.000 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.992+0000 7fac31356700 1 -- start start 2023-11-28T11:58:03.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.996+0000 7fac31356700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac2c06ff10 0x7fac2c156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:03.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.996+0000 7fac31356700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac2c0cdc50 0x7fac2c15f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:03.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.996+0000 7fac31356700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac2c15e190 0x7fac2c15f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:03.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.996+0000 7fac31356700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c15b250 con 0x7fac2c15e190 2023-11-28T11:58:03.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.996+0000 7fac31356700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c157020 con 0x7fac2c06ff10 2023-11-28T11:58:03.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.996+0000 7fac31356700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c158f60 con 0x7fac2c0cdc50 2023-11-28T11:58:03.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.996+0000 7fac2b7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac2c15e190 0x7fac2c15f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:03.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.996+0000 7fac2b7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac2c15e190 0x7fac2c15f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53780/0 (socket says 172.21.15.39:53780) 2023-11-28T11:58:03.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.996+0000 7fac2b7fe700 1 -- 172.21.15.39:0/3475176759 learned_addr learned my addr 172.21.15.39:0/3475176759 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:03.003 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.996+0000 7fac2affd700 1 --2- 172.21.15.39:0/3475176759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac2c06ff10 0x7fac2c156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:03.003 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.996+0000 7fac23fff700 1 --2- 172.21.15.39:0/3475176759 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac2c0cdc50 0x7fac2c15f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:03.003 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.996+0000 7fac2b7fe700 1 -- 172.21.15.39:0/3475176759 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac2c0cdc50 msgr2=0x7fac2c15f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:03.003 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.996+0000 7fac2b7fe700 1 --2- 172.21.15.39:0/3475176759 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac2c0cdc50 0x7fac2c15f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:03.003 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.996+0000 7fac2b7fe700 1 -- 172.21.15.39:0/3475176759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac2c06ff10 msgr2=0x7fac2c156790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:03.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.996+0000 7fac2b7fe700 1 --2- 172.21.15.39:0/3475176759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac2c06ff10 0x7fac2c156790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:03.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.996+0000 7fac2b7fe700 1 -- 172.21.15.39:0/3475176759 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac24009a70 con 0x7fac2c15e190 2023-11-28T11:58:03.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.996+0000 7fac2affd700 1 --2- 172.21.15.39:0/3475176759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac2c06ff10 0x7fac2c156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:58:03.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.996+0000 7fac2b7fe700 1 --2- 172.21.15.39:0/3475176759 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac2c15e190 0x7fac2c15f780 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0caec0 tx=0x7fac24004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:03.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.996+0000 7fac237fe700 1 -- 172.21.15.39:0/3475176759 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2401b810 con 0x7fac2c15e190 2023-11-28T11:58:03.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.996+0000 7fac237fe700 1 -- 172.21.15.39:0/3475176759 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac24020070 con 0x7fac2c15e190 2023-11-28T11:58:03.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.996+0000 7fac31356700 1 -- 172.21.15.39:0/3475176759 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac2c0af990 con 0x7fac2c15e190 2023-11-28T11:58:03.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.996+0000 7fac237fe700 1 -- 172.21.15.39:0/3475176759 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2401bbb0 con 0x7fac2c15e190 2023-11-28T11:58:03.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:02.996+0000 7fac31356700 1 -- 172.21.15.39:0/3475176759 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac2c0ce330 con 0x7fac2c15e190 2023-11-28T11:58:03.005 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.000+0000 7fac31356700 1 -- 172.21.15.39:0/3475176759 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac2c0afc70 con 0x7fac2c15e190 2023-11-28T11:58:03.006 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.000+0000 7fac237fe700 1 -- 172.21.15.39:0/3475176759 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fac2401bd10 con 0x7fac2c15e190 2023-11-28T11:58:03.009 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.000+0000 7fac237fe700 1 --2- 172.21.15.39:0/3475176759 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fac0c064ee0 0x7fac0c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:03.009 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.004+0000 7fac237fe700 1 -- 172.21.15.39:0/3475176759 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6282+0+0 (secure 0 0 0) 0x7fac24022070 con 0x7fac2c15e190 2023-11-28T11:58:03.009 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.004+0000 7fac2affd700 1 --2- 172.21.15.39:0/3475176759 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fac0c064ee0 0x7fac0c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:03.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.004+0000 7fac2affd700 1 --2- 172.21.15.39:0/3475176759 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fac0c064ee0 0x7fac0c067390 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fac1c000f60 tx=0x7fac1c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:03.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.008+0000 7fac237fe700 1 -- 172.21.15.39:0/3475176759 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fac240528b0 con 0x7fac2c15e190 2023-11-28T11:58:03.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.220+0000 7fac31356700 1 -- 172.21.15.39:0/3475176759 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fac2c073d20 con 0x7fac2c15e190 2023-11-28T11:58:03.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.232+0000 7fac237fe700 1 -- 172.21.15.39:0/3475176759 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7fac24055ed0 con 0x7fac2c15e190 2023-11-28T11:58:03.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.240+0000 7fac31356700 1 -- 172.21.15.39:0/3475176759 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fac0c064ee0 msgr2=0x7fac0c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:03.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.240+0000 7fac31356700 1 --2- 172.21.15.39:0/3475176759 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fac0c064ee0 0x7fac0c067390 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fac1c000f60 tx=0x7fac1c009040 comp rx=0 tx=0).stop 2023-11-28T11:58:03.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.240+0000 7fac31356700 1 -- 172.21.15.39:0/3475176759 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac2c15e190 msgr2=0x7fac2c15f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:03.247 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.240+0000 7fac31356700 1 --2- 172.21.15.39:0/3475176759 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac2c15e190 0x7fac2c15f780 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0caec0 tx=0x7fac24004af0 comp rx=0 tx=0).stop 2023-11-28T11:58:03.248 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.240+0000 7fac31356700 1 -- 172.21.15.39:0/3475176759 shutdown_connections 2023-11-28T11:58:03.249 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.240+0000 7fac31356700 1 --2- 172.21.15.39:0/3475176759 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac2c15e190 0x7fac2c15f780 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:03.250 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.240+0000 7fac31356700 1 --2- 172.21.15.39:0/3475176759 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac2c0cdc50 0x7fac2c15f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:03.250 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.240+0000 7fac31356700 1 --2- 172.21.15.39:0/3475176759 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fac0c064ee0 0x7fac0c067390 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:03.251 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.240+0000 7fac31356700 1 --2- 172.21.15.39:0/3475176759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac2c06ff10 0x7fac2c156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:03.251 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.240+0000 7fac31356700 1 -- 172.21.15.39:0/3475176759 >> 172.21.15.39:0/3475176759 conn(0x7fac2c0cf280 msgr2=0x7fac2c06ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:03.251 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.244+0000 7fac31356700 1 -- 172.21.15.39:0/3475176759 shutdown_connections 2023-11-28T11:58:03.251 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.244+0000 7fac31356700 1 -- 172.21.15.39:0/3475176759 wait complete. 2023-11-28T11:58:03.272 INFO:teuthology.orchestra.run.smithi039.stderr:new fs with metadata pool 6 and data pool 7 2023-11-28T11:58:03.293 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:58:03.480 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.476+0000 7fa965ab1700 1 Processor -- start 2023-11-28T11:58:03.480 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.476+0000 7fa965ab1700 1 -- start start 2023-11-28T11:58:03.483 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.476+0000 7fa965ab1700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa96015c650 0x7fa96006b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:03.484 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.476+0000 7fa965ab1700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa96006bed0 0x7fa96006c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:03.484 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.476+0000 7fa965ab1700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9600c9d40 con 0x7fa9600cd0d0 2023-11-28T11:58:03.484 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.476+0000 7fa965ab1700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa96006b140 con 0x7fa96006bed0 2023-11-28T11:58:03.484 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.476+0000 7fa965ab1700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa96006c830 con 0x7fa96015c650 2023-11-28T11:58:03.484 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.480+0000 7fa9652b0700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa96006bed0 0x7fa96006c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:03.485 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.480+0000 7fa9652b0700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa96006bed0 0x7fa96006c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53782/0 (socket says 172.21.15.39:53782) 2023-11-28T11:58:03.485 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.480+0000 7fa9652b0700 1 -- 172.21.15.39:0/2242314239 learned_addr learned my addr 172.21.15.39:0/2242314239 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:03.485 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.480+0000 7fa964aaf700 1 --2- 172.21.15.39:0/2242314239 >> v2:172.21.15.184:3300/0 conn(0x7fa96015c650 0x7fa96006b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:03.485 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.480+0000 7fa9652b0700 1 -- 172.21.15.39:0/2242314239 >> v2:172.21.15.184:3300/0 conn(0x7fa96015c650 msgr2=0x7fa96006b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:03.486 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.480+0000 7fa9652b0700 1 --2- 172.21.15.39:0/2242314239 >> v2:172.21.15.184:3300/0 conn(0x7fa96015c650 0x7fa96006b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:03.486 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.480+0000 7fa9652b0700 1 -- 172.21.15.39:0/2242314239 >> v1:172.21.15.39:6789/0 conn(0x7fa9600cd0d0 legacy=0x7fa9600b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:03.486 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.480+0000 7fa9652b0700 1 -- 172.21.15.39:0/2242314239 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa96006b820 con 0x7fa96006bed0 2023-11-28T11:58:03.486 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.480+0000 7fa964aaf700 1 --2- 172.21.15.39:0/2242314239 >> v2:172.21.15.184:3300/0 conn(0x7fa96015c650 0x7fa96006b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:58:03.486 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.480+0000 7fa9652b0700 1 --2- 172.21.15.39:0/2242314239 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa96006bed0 0x7fa96006c2f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa9600cc1e0 tx=0x7fa95800d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47c09d764e7893d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:03.486 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.480+0000 7fa95f7fe700 1 -- 172.21.15.39:0/2242314239 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa958010070 con 0x7fa96006bed0 2023-11-28T11:58:03.487 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.480+0000 7fa95f7fe700 1 -- 172.21.15.39:0/2242314239 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa95800dce0 con 0x7fa96006bed0 2023-11-28T11:58:03.487 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.480+0000 7fa95f7fe700 1 -- 172.21.15.39:0/2242314239 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95800b310 con 0x7fa96006bed0 2023-11-28T11:58:03.487 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.480+0000 7fa965ab1700 1 -- 172.21.15.39:0/2242314239 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa96006bed0 msgr2=0x7fa96006c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:03.488 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.480+0000 7fa965ab1700 1 --2- 172.21.15.39:0/2242314239 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa96006bed0 0x7fa96006c2f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa9600cc1e0 tx=0x7fa95800d430 comp rx=0 tx=0).stop 2023-11-28T11:58:03.488 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.480+0000 7fa965ab1700 1 -- 172.21.15.39:0/2242314239 shutdown_connections 2023-11-28T11:58:03.488 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.480+0000 7fa965ab1700 1 --2- 172.21.15.39:0/2242314239 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa96006bed0 0x7fa96006c2f0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:03.488 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.480+0000 7fa965ab1700 1 --2- 172.21.15.39:0/2242314239 >> v2:172.21.15.184:3300/0 conn(0x7fa96015c650 0x7fa96006b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:03.488 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.480+0000 7fa965ab1700 1 -- 172.21.15.39:0/2242314239 >> 172.21.15.39:0/2242314239 conn(0x7fa9600b0f80 msgr2=0x7fa9600ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:03.488 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.480+0000 7fa965ab1700 1 -- 172.21.15.39:0/2242314239 shutdown_connections 2023-11-28T11:58:03.488 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.480+0000 7fa965ab1700 1 -- 172.21.15.39:0/2242314239 wait complete. 2023-11-28T11:58:03.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.484+0000 7fa965ab1700 1 Processor -- start 2023-11-28T11:58:03.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.484+0000 7fa965ab1700 1 -- start start 2023-11-28T11:58:03.494 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.488+0000 7fa965ab1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa96006bed0 0x7fa960158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:03.494 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.488+0000 7fa965ab1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9600cd0d0 0x7fa9600c7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:03.494 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.488+0000 7fa965ab1700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa96015c650 0x7fa9600ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:03.494 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.488+0000 7fa965ab1700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9601594f0 con 0x7fa96015c650 2023-11-28T11:58:03.494 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.488+0000 7fa965ab1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9600abf50 con 0x7fa96006bed0 2023-11-28T11:58:03.494 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.488+0000 7fa965ab1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9600c8250 con 0x7fa9600cd0d0 2023-11-28T11:58:03.494 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.488+0000 7fa9652b0700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa96015c650 0x7fa9600ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:03.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.488+0000 7fa9652b0700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa96015c650 0x7fa9600ca1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53792/0 (socket says 172.21.15.39:53792) 2023-11-28T11:58:03.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.488+0000 7fa9652b0700 1 -- 172.21.15.39:0/3100174466 learned_addr learned my addr 172.21.15.39:0/3100174466 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:03.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.488+0000 7fa964aaf700 1 --2- 172.21.15.39:0/3100174466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa96006bed0 0x7fa960158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:03.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.488+0000 7fa95ffff700 1 --2- 172.21.15.39:0/3100174466 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9600cd0d0 0x7fa9600c7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:03.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.488+0000 7fa9652b0700 1 -- 172.21.15.39:0/3100174466 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9600cd0d0 msgr2=0x7fa9600c7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:03.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.488+0000 7fa9652b0700 1 --2- 172.21.15.39:0/3100174466 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9600cd0d0 0x7fa9600c7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:03.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.488+0000 7fa9652b0700 1 -- 172.21.15.39:0/3100174466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa96006bed0 msgr2=0x7fa960158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:03.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.488+0000 7fa9652b0700 1 --2- 172.21.15.39:0/3100174466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa96006bed0 0x7fa960158fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:03.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.488+0000 7fa9652b0700 1 -- 172.21.15.39:0/3100174466 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9540094b0 con 0x7fa96015c650 2023-11-28T11:58:03.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.488+0000 7fa9652b0700 1 --2- 172.21.15.39:0/3100174466 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa96015c650 0x7fa9600ca1d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa96006bc30 tx=0x7fa958004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:03.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.492+0000 7fa95d7fa700 1 -- 172.21.15.39:0/3100174466 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa958009a10 con 0x7fa96015c650 2023-11-28T11:58:03.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.492+0000 7fa95d7fa700 1 -- 172.21.15.39:0/3100174466 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa958009b70 con 0x7fa96015c650 2023-11-28T11:58:03.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.492+0000 7fa965ab1700 1 -- 172.21.15.39:0/3100174466 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa95800bd40 con 0x7fa96015c650 2023-11-28T11:58:03.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.492+0000 7fa95d7fa700 1 -- 172.21.15.39:0/3100174466 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95800b4c0 con 0x7fa96015c650 2023-11-28T11:58:03.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.492+0000 7fa965ab1700 1 -- 172.21.15.39:0/3100174466 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9600cd5d0 con 0x7fa96015c650 2023-11-28T11:58:03.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.492+0000 7fa965ab1700 1 -- 172.21.15.39:0/3100174466 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9600b1d50 con 0x7fa96015c650 2023-11-28T11:58:03.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.492+0000 7fa95d7fa700 1 -- 172.21.15.39:0/3100174466 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa958004040 con 0x7fa96015c650 2023-11-28T11:58:03.501 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.496+0000 7fa95d7fa700 1 --2- 172.21.15.39:0/3100174466 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa944064f10 0x7fa9440673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:03.501 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.496+0000 7fa95d7fa700 1 -- 172.21.15.39:0/3100174466 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa9580838c0 con 0x7fa96015c650 2023-11-28T11:58:03.502 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.496+0000 7fa964aaf700 1 --2- 172.21.15.39:0/3100174466 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa944064f10 0x7fa9440673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:03.503 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.496+0000 7fa964aaf700 1 --2- 172.21.15.39:0/3100174466 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa944064f10 0x7fa9440673c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa954009d80 tx=0x7fa954009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:03.509 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.504+0000 7fa95d7fa700 1 -- 172.21.15.39:0/3100174466 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa9580517d0 con 0x7fa96015c650 2023-11-28T11:58:03.695 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.688+0000 7fa965ab1700 1 -- 172.21.15.39:0/3100174466 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9600cd8b0 con 0x7fa96015c650 2023-11-28T11:58:03.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.692+0000 7fa95d7fa700 1 -- 172.21.15.39:0/3100174466 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18045 (secure 0 0 0) 0x7fa958054df0 con 0x7fa96015c650 2023-11-28T11:58:03.699 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:58:03.699 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":43,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:58:03.227208+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:58:01.523189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-28T11:58:02.259575+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:58:03.701 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.696+0000 7fa965ab1700 1 -- 172.21.15.39:0/3100174466 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa944064f10 msgr2=0x7fa9440673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:03.701 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.696+0000 7fa965ab1700 1 --2- 172.21.15.39:0/3100174466 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa944064f10 0x7fa9440673c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa954009d80 tx=0x7fa954009240 comp rx=0 tx=0).stop 2023-11-28T11:58:03.701 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.696+0000 7fa965ab1700 1 -- 172.21.15.39:0/3100174466 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa96015c650 msgr2=0x7fa9600ca1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:03.701 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.696+0000 7fa965ab1700 1 --2- 172.21.15.39:0/3100174466 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa96015c650 0x7fa9600ca1d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa96006bc30 tx=0x7fa958004af0 comp rx=0 tx=0).stop 2023-11-28T11:58:03.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.696+0000 7fa965ab1700 1 -- 172.21.15.39:0/3100174466 shutdown_connections 2023-11-28T11:58:03.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.696+0000 7fa965ab1700 1 --2- 172.21.15.39:0/3100174466 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa96015c650 0x7fa9600ca1d0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:03.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.696+0000 7fa965ab1700 1 --2- 172.21.15.39:0/3100174466 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9600cd0d0 0x7fa9600c7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:03.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.696+0000 7fa965ab1700 1 --2- 172.21.15.39:0/3100174466 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa944064f10 0x7fa9440673c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:03.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.696+0000 7fa965ab1700 1 --2- 172.21.15.39:0/3100174466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa96006bed0 0x7fa960158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:03.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.696+0000 7fa965ab1700 1 -- 172.21.15.39:0/3100174466 >> 172.21.15.39:0/3100174466 conn(0x7fa9600b0f80 msgr2=0x7fa9600b1640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:03.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.696+0000 7fa965ab1700 1 -- 172.21.15.39:0/3100174466 shutdown_connections 2023-11-28T11:58:03.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.696+0000 7fa965ab1700 1 -- 172.21.15.39:0/3100174466 wait complete. 2023-11-28T11:58:03.726 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:58:03.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.900+0000 7f6c8550e700 1 Processor -- start 2023-11-28T11:58:03.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.900+0000 7f6c8550e700 1 -- start start 2023-11-28T11:58:03.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.904+0000 7f6c8550e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6c80070790 0x7f6c80167110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:03.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.904+0000 7f6c8550e700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c800adf90 con 0x7f6c8015c1a0 2023-11-28T11:58:03.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.904+0000 7f6c8550e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c800ce370 con 0x7f6c800cdeb0 2023-11-28T11:58:03.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.904+0000 7f6c8550e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c80069bf0 con 0x7f6c80070790 2023-11-28T11:58:03.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.904+0000 7f6c7ffff700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f6c8015c1a0 0x7f6c8006c8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:49432/0 (socket says 172.21.15.39:49432) 2023-11-28T11:58:03.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.904+0000 7f6c7ffff700 1 -- 172.21.15.39:0/840712697 learned_addr learned my addr 172.21.15.39:0/840712697 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:58:03.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.904+0000 7f6c84d0d700 1 --2- 172.21.15.39:0/840712697 >> v2:172.21.15.184:3300/0 conn(0x7f6c80070790 0x7f6c80167110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:03.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.904+0000 7f6c7effd700 1 -- 172.21.15.39:0/840712697 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2555132013 0 0) 0x7f6c800adf90 con 0x7f6c8015c1a0 2023-11-28T11:58:03.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.904+0000 7f6c7effd700 1 -- 172.21.15.39:0/840712697 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c680035d0 con 0x7f6c8015c1a0 2023-11-28T11:58:03.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.904+0000 7f6c7effd700 1 -- 172.21.15.39:0/840712697 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1450383101 0 0) 0x7f6c800ce370 con 0x7f6c800cdeb0 2023-11-28T11:58:03.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.904+0000 7f6c7effd700 1 -- 172.21.15.39:0/840712697 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c800adf90 con 0x7f6c800cdeb0 2023-11-28T11:58:03.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.904+0000 7f6c7effd700 1 -- 172.21.15.39:0/840712697 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2872366376 0 0) 0x7f6c680035d0 con 0x7f6c8015c1a0 2023-11-28T11:58:03.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.904+0000 7f6c7effd700 1 -- 172.21.15.39:0/840712697 >> v2:172.21.15.184:3300/0 conn(0x7f6c80070790 msgr2=0x7f6c80167110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:03.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.904+0000 7f6c7effd700 1 --2- 172.21.15.39:0/840712697 >> v2:172.21.15.184:3300/0 conn(0x7f6c80070790 0x7f6c80167110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:03.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.904+0000 7f6c7effd700 1 -- 172.21.15.39:0/840712697 >> v1:172.21.15.184:6789/0 conn(0x7f6c800cdeb0 legacy=0x7f6c80070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:03.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.904+0000 7f6c7effd700 1 -- 172.21.15.39:0/840712697 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c800cc4a0 con 0x7f6c8015c1a0 2023-11-28T11:58:03.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.904+0000 7f6c7effd700 1 -- 172.21.15.39:0/840712697 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4013383302 0 0) 0x7f6c70001670 con 0x7f6c8015c1a0 2023-11-28T11:58:03.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.904+0000 7f6c7effd700 1 -- 172.21.15.39:0/840712697 >> v1:172.21.15.39:6789/0 conn(0x7f6c8015c1a0 legacy=0x7f6c8006c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:03.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.904+0000 7f6c7effd700 1 --2- 172.21.15.39:0/840712697 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c68003c00 0x7f6c68004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:03.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.904+0000 7f6c7effd700 1 --2- 172.21.15.39:0/840712697 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6c68004870 0x7f6c68004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:03.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.904+0000 7f6c7effd700 1 --2- 172.21.15.39:0/840712697 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c68005270 0x7f6c6800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:03.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.904+0000 7f6c7effd700 1 -- 172.21.15.39:0/840712697 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c80069bf0 con 0x7f6c68004870 2023-11-28T11:58:03.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.904+0000 7f6c7effd700 1 -- 172.21.15.39:0/840712697 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6800c180 con 0x7f6c68005270 2023-11-28T11:58:03.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.904+0000 7f6c7effd700 1 -- 172.21.15.39:0/840712697 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6800c340 con 0x7f6c68003c00 2023-11-28T11:58:03.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.904+0000 7f6c7f7fe700 1 --2- 172.21.15.39:0/840712697 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6c68004870 0x7f6c68004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:03.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.904+0000 7f6c84d0d700 1 --2- 172.21.15.39:0/840712697 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c68005270 0x7f6c6800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:03.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.904+0000 7f6c7ffff700 1 --2- 172.21.15.39:0/840712697 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c68003c00 0x7f6c68004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:03.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.904+0000 7f6c7f7fe700 1 -- 172.21.15.39:0/840712697 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c68003c00 msgr2=0x7f6c68004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:03.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.904+0000 7f6c7f7fe700 1 --2- 172.21.15.39:0/840712697 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c68003c00 0x7f6c68004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:03.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.904+0000 7f6c7f7fe700 1 -- 172.21.15.39:0/840712697 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c68005270 msgr2=0x7f6c6800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:03.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.904+0000 7f6c7f7fe700 1 --2- 172.21.15.39:0/840712697 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c68005270 0x7f6c6800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:03.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.904+0000 7f6c7f7fe700 1 -- 172.21.15.39:0/840712697 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c680035d0 con 0x7f6c68004870 2023-11-28T11:58:03.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.904+0000 7f6c7ffff700 1 --2- 172.21.15.39:0/840712697 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c68003c00 0x7f6c68004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:58:03.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.904+0000 7f6c84d0d700 1 --2- 172.21.15.39:0/840712697 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c68005270 0x7f6c6800ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:58:03.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.908+0000 7f6c84d0d700 1 -- 172.21.15.39:0/840712697 reap_dead start 2023-11-28T11:58:03.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.908+0000 7f6c7f7fe700 1 --2- 172.21.15.39:0/840712697 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6c68004870 0x7f6c68004ce0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6c800ce2a0 tx=0x7f6c680058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a5fb406b8ca0c24 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:03.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.908+0000 7f6c7effd700 1 -- 172.21.15.39:0/840712697 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c74001450 con 0x7f6c68004870 2023-11-28T11:58:03.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.908+0000 7f6c7effd700 1 -- 172.21.15.39:0/840712697 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c74006aa0 con 0x7f6c68004870 2023-11-28T11:58:03.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.908+0000 7f6c7effd700 1 -- 172.21.15.39:0/840712697 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c74006e50 con 0x7f6c68004870 2023-11-28T11:58:03.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.908+0000 7f6c8550e700 1 -- 172.21.15.39:0/840712697 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6c68004870 msgr2=0x7f6c68004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:03.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.908+0000 7f6c8550e700 1 --2- 172.21.15.39:0/840712697 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6c68004870 0x7f6c68004ce0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6c800ce2a0 tx=0x7f6c680058a0 comp rx=0 tx=0).stop 2023-11-28T11:58:03.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.908+0000 7f6c8550e700 1 -- 172.21.15.39:0/840712697 shutdown_connections 2023-11-28T11:58:03.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.908+0000 7f6c8550e700 1 --2- 172.21.15.39:0/840712697 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6c68004870 0x7f6c68004ce0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:03.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.908+0000 7f6c8550e700 1 -- 172.21.15.39:0/840712697 >> 172.21.15.39:0/840712697 conn(0x7f6c800b0f80 msgr2=0x7f6c800ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:03.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.908+0000 7f6c8550e700 1 -- 172.21.15.39:0/840712697 shutdown_connections 2023-11-28T11:58:03.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.908+0000 7f6c8550e700 1 -- 172.21.15.39:0/840712697 wait complete. 2023-11-28T11:58:03.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.912+0000 7f6c8550e700 1 Processor -- start 2023-11-28T11:58:03.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.912+0000 7f6c8550e700 1 -- start start 2023-11-28T11:58:03.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.912+0000 7f6c8550e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c68004870 0x7f6c800b2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:03.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.912+0000 7f6c8550e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6c8015b6f0 0x7f6c80154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:03.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.912+0000 7f6c8550e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c8015ad90 0x7f6c8015e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:03.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.912+0000 7f6c8550e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c800ad570 con 0x7f6c8015b6f0 2023-11-28T11:58:03.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.912+0000 7f6c8550e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c801f4f60 con 0x7f6c68004870 2023-11-28T11:58:03.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.912+0000 7f6c8550e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c801f5dc0 con 0x7f6c8015ad90 2023-11-28T11:58:03.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.916+0000 7f6c7f7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6c8015b6f0 0x7f6c80154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:03.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.916+0000 7f6c7f7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6c8015b6f0 0x7f6c80154de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53812/0 (socket says 172.21.15.39:53812) 2023-11-28T11:58:03.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.916+0000 7f6c7f7fe700 1 -- 172.21.15.39:0/3723923749 learned_addr learned my addr 172.21.15.39:0/3723923749 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:03.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.916+0000 7f6c7ffff700 1 --2- 172.21.15.39:0/3723923749 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c68004870 0x7f6c800b2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:03.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.916+0000 7f6c84d0d700 1 --2- 172.21.15.39:0/3723923749 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c8015ad90 0x7f6c8015e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:03.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.916+0000 7f6c7f7fe700 1 -- 172.21.15.39:0/3723923749 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c8015ad90 msgr2=0x7f6c8015e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:03.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.916+0000 7f6c7f7fe700 1 --2- 172.21.15.39:0/3723923749 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c8015ad90 0x7f6c8015e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:03.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.916+0000 7f6c7f7fe700 1 -- 172.21.15.39:0/3723923749 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c68004870 msgr2=0x7f6c800b2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:03.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.916+0000 7f6c7f7fe700 1 --2- 172.21.15.39:0/3723923749 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c68004870 0x7f6c800b2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:03.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.916+0000 7f6c7f7fe700 1 -- 172.21.15.39:0/3723923749 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8015c570 con 0x7f6c8015b6f0 2023-11-28T11:58:03.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.916+0000 7f6c7ffff700 1 --2- 172.21.15.39:0/3723923749 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c68004870 0x7f6c800b2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:58:03.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.916+0000 7f6c84d0d700 1 --2- 172.21.15.39:0/3723923749 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c8015ad90 0x7f6c8015e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:58:03.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.916+0000 7f6c7f7fe700 1 --2- 172.21.15.39:0/3723923749 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6c8015b6f0 0x7f6c80154de0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6c7400c3c0 tx=0x7f6c740012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:03.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.916+0000 7f6c7cff9700 1 -- 172.21.15.39:0/3723923749 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c740054d0 con 0x7f6c8015b6f0 2023-11-28T11:58:03.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.916+0000 7f6c7cff9700 1 -- 172.21.15.39:0/3723923749 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c74007030 con 0x7f6c8015b6f0 2023-11-28T11:58:03.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.916+0000 7f6c8550e700 1 -- 172.21.15.39:0/3723923749 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c800cc780 con 0x7f6c8015b6f0 2023-11-28T11:58:03.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.916+0000 7f6c7cff9700 1 -- 172.21.15.39:0/3723923749 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c740073a0 con 0x7f6c8015b6f0 2023-11-28T11:58:03.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.916+0000 7f6c8550e700 1 -- 172.21.15.39:0/3723923749 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c80070080 con 0x7f6c8015b6f0 2023-11-28T11:58:03.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.916+0000 7f6c8550e700 1 -- 172.21.15.39:0/3723923749 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c800b2560 con 0x7f6c8015b6f0 2023-11-28T11:58:03.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.920+0000 7f6c7cff9700 1 -- 172.21.15.39:0/3723923749 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6c7402c070 con 0x7f6c8015b6f0 2023-11-28T11:58:03.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.920+0000 7f6c7cff9700 1 --2- 172.21.15.39:0/3723923749 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6c6c064ee0 0x7f6c6c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:03.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.920+0000 7f6c7cff9700 1 -- 172.21.15.39:0/3723923749 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6c74082b80 con 0x7f6c8015b6f0 2023-11-28T11:58:03.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.920+0000 7f6c7ffff700 1 --2- 172.21.15.39:0/3723923749 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6c6c064ee0 0x7f6c6c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:03.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.924+0000 7f6c7ffff700 1 --2- 172.21.15.39:0/3723923749 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6c6c064ee0 0x7f6c6c067390 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6c70001eb0 tx=0x7f6c70009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:03.931 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:03.924+0000 7f6c7cff9700 1 -- 172.21.15.39:0/3723923749 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6c74050af0 con 0x7f6c8015b6f0 2023-11-28T11:58:04.104 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.100+0000 7f6c8550e700 1 -- 172.21.15.39:0/3723923749 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c80073cb0 con 0x7f6c8015b6f0 2023-11-28T11:58:04.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.100+0000 7f6c7cff9700 1 -- 172.21.15.39:0/3723923749 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18045 (secure 0 0 0) 0x7f6c74054110 con 0x7f6c8015b6f0 2023-11-28T11:58:04.108 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:58:04.108 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":43,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:58:03.227208+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:58:01.523189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-28T11:58:02.259575+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:58:04.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.104+0000 7f6c8550e700 1 -- 172.21.15.39:0/3723923749 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6c6c064ee0 msgr2=0x7f6c6c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:04.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.104+0000 7f6c8550e700 1 --2- 172.21.15.39:0/3723923749 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6c6c064ee0 0x7f6c6c067390 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6c70001eb0 tx=0x7f6c70009040 comp rx=0 tx=0).stop 2023-11-28T11:58:04.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.104+0000 7f6c8550e700 1 -- 172.21.15.39:0/3723923749 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6c8015b6f0 msgr2=0x7f6c80154de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:04.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.104+0000 7f6c8550e700 1 --2- 172.21.15.39:0/3723923749 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6c8015b6f0 0x7f6c80154de0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6c7400c3c0 tx=0x7f6c740012d0 comp rx=0 tx=0).stop 2023-11-28T11:58:04.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.104+0000 7f6c8550e700 1 -- 172.21.15.39:0/3723923749 shutdown_connections 2023-11-28T11:58:04.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.104+0000 7f6c8550e700 1 --2- 172.21.15.39:0/3723923749 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c8015ad90 0x7f6c8015e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:04.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.104+0000 7f6c8550e700 1 --2- 172.21.15.39:0/3723923749 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6c8015b6f0 0x7f6c80154de0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:04.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.104+0000 7f6c8550e700 1 --2- 172.21.15.39:0/3723923749 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6c6c064ee0 0x7f6c6c067390 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:04.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.104+0000 7f6c8550e700 1 --2- 172.21.15.39:0/3723923749 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c68004870 0x7f6c800b2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:04.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.104+0000 7f6c8550e700 1 -- 172.21.15.39:0/3723923749 >> 172.21.15.39:0/3723923749 conn(0x7f6c800b0f80 msgr2=0x7f6c800c8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:04.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.104+0000 7f6c8550e700 1 -- 172.21.15.39:0/3723923749 shutdown_connections 2023-11-28T11:58:04.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.104+0000 7f6c8550e700 1 -- 172.21.15.39:0/3723923749 wait complete. 2023-11-28T11:58:04.135 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T11:58:04.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.332+0000 7eff07569700 1 Processor -- start 2023-11-28T11:58:04.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.332+0000 7eff07569700 1 -- start start 2023-11-28T11:58:04.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.336+0000 7eff07569700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7eff0015c150 0x7eff000b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:04.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.336+0000 7eff07569700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7eff0006ff10 0x7eff00070360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:04.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.336+0000 7eff07569700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff0015c520 con 0x7eff0015fc30 2023-11-28T11:58:04.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.336+0000 7eff07569700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff000b4240 con 0x7eff0015c150 2023-11-28T11:58:04.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.336+0000 7eff07569700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff000708a0 con 0x7eff0006ff10 2023-11-28T11:58:04.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.336+0000 7eff06567700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7eff0015c150 0x7eff000b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:04.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.336+0000 7eff06d68700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7eff0015fc30 0x7eff00160050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:49444/0 (socket says 172.21.15.39:49444) 2023-11-28T11:58:04.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.336+0000 7eff06567700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7eff0015c150 0x7eff000b3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53814/0 (socket says 172.21.15.39:53814) 2023-11-28T11:58:04.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.336+0000 7eff06d68700 1 -- 172.21.15.39:0/3085721215 learned_addr learned my addr 172.21.15.39:0/3085721215 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:58:04.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.336+0000 7eff05d66700 1 --2- 172.21.15.39:0/3085721215 >> v2:172.21.15.184:3300/0 conn(0x7eff0006ff10 0x7eff00070360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:04.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.336+0000 7eff06567700 1 -- 172.21.15.39:0/3085721215 >> v2:172.21.15.184:3300/0 conn(0x7eff0006ff10 msgr2=0x7eff00070360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:04.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.336+0000 7eff06567700 1 --2- 172.21.15.39:0/3085721215 >> v2:172.21.15.184:3300/0 conn(0x7eff0006ff10 0x7eff00070360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:04.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.336+0000 7eff06567700 1 -- 172.21.15.39:0/3085721215 >> v1:172.21.15.39:6789/0 conn(0x7eff0015fc30 legacy=0x7eff00160050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:04.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.336+0000 7eff06567700 1 -- 172.21.15.39:0/3085721215 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0006ac00 con 0x7eff0015c150 2023-11-28T11:58:04.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.336+0000 7eff05565700 1 -- 172.21.15.39:0/3085721215 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 245389464 0 0) 0x7eff0015c520 con 0x7eff0015fc30 2023-11-28T11:58:04.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.336+0000 7eff06567700 1 --2- 172.21.15.39:0/3085721215 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff0015c150 0x7eff000b3d00 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7eff00066d30 tx=0x7efefc009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7203860d429f6599 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:04.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.336+0000 7eff05565700 1 -- 172.21.15.39:0/3085721215 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc011830 con 0x7eff0015c150 2023-11-28T11:58:04.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.336+0000 7eff05565700 1 -- 172.21.15.39:0/3085721215 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efefc011990 con 0x7eff0015c150 2023-11-28T11:58:04.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.336+0000 7eff05565700 1 -- 172.21.15.39:0/3085721215 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc011d20 con 0x7eff0015c150 2023-11-28T11:58:04.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.340+0000 7eff07569700 1 -- 172.21.15.39:0/3085721215 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff0015c150 msgr2=0x7eff000b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:04.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.340+0000 7eff07569700 1 --2- 172.21.15.39:0/3085721215 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff0015c150 0x7eff000b3d00 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7eff00066d30 tx=0x7efefc009b30 comp rx=0 tx=0).stop 2023-11-28T11:58:04.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.340+0000 7eff07569700 1 -- 172.21.15.39:0/3085721215 shutdown_connections 2023-11-28T11:58:04.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.340+0000 7eff07569700 1 --2- 172.21.15.39:0/3085721215 >> v2:172.21.15.184:3300/0 conn(0x7eff0006ff10 0x7eff00070360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:04.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.340+0000 7eff07569700 1 --2- 172.21.15.39:0/3085721215 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff0015c150 0x7eff000b3d00 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:04.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.340+0000 7eff07569700 1 -- 172.21.15.39:0/3085721215 >> 172.21.15.39:0/3085721215 conn(0x7eff000d3680 msgr2=0x7eff000cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:04.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.340+0000 7eff07569700 1 -- 172.21.15.39:0/3085721215 shutdown_connections 2023-11-28T11:58:04.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.340+0000 7eff07569700 1 -- 172.21.15.39:0/3085721215 wait complete. 2023-11-28T11:58:04.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.340+0000 7eff07569700 1 Processor -- start 2023-11-28T11:58:04.348 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.340+0000 7eff07569700 1 -- start start 2023-11-28T11:58:04.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.344+0000 7eff07569700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff0006ff10 0x7eff000ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:04.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.344+0000 7eff07569700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff0015c150 0x7eff0015e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:04.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.344+0000 7eff07569700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff0015fc30 0x7eff000cf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:04.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.344+0000 7eff07569700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0014faa0 con 0x7eff0006ff10 2023-11-28T11:58:04.350 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.344+0000 7eff07569700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff000cd510 con 0x7eff0015fc30 2023-11-28T11:58:04.350 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.344+0000 7eff07569700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff000cd7f0 con 0x7eff0015c150 2023-11-28T11:58:04.352 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.344+0000 7eff06567700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff0006ff10 0x7eff000ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:04.352 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.344+0000 7eff06567700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff0006ff10 0x7eff000ce5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53824/0 (socket says 172.21.15.39:53824) 2023-11-28T11:58:04.352 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.344+0000 7eff06567700 1 -- 172.21.15.39:0/3285745683 learned_addr learned my addr 172.21.15.39:0/3285745683 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:04.352 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.344+0000 7eff05d66700 1 --2- 172.21.15.39:0/3285745683 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff0015c150 0x7eff0015e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:04.352 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.344+0000 7eff06d68700 1 --2- 172.21.15.39:0/3285745683 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff0015fc30 0x7eff000cf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:04.352 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.344+0000 7eff06567700 1 -- 172.21.15.39:0/3285745683 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff0015c150 msgr2=0x7eff0015e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:04.352 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.344+0000 7eff06567700 1 --2- 172.21.15.39:0/3285745683 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff0015c150 0x7eff0015e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:04.352 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.344+0000 7eff06567700 1 -- 172.21.15.39:0/3285745683 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff0015fc30 msgr2=0x7eff000cf3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:04.352 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.344+0000 7eff06567700 1 --2- 172.21.15.39:0/3285745683 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff0015fc30 0x7eff000cf3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:04.352 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.344+0000 7eff06567700 1 -- 172.21.15.39:0/3285745683 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efefc0094b0 con 0x7eff0006ff10 2023-11-28T11:58:04.353 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.344+0000 7eff06567700 1 --2- 172.21.15.39:0/3285745683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff0006ff10 0x7eff000ce5b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7efefc009fd0 tx=0x7efefc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:04.353 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.344+0000 7efef6ffd700 1 -- 172.21.15.39:0/3285745683 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc0045b0 con 0x7eff0006ff10 2023-11-28T11:58:04.353 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.344+0000 7efef6ffd700 1 -- 172.21.15.39:0/3285745683 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efefc01f070 con 0x7eff0006ff10 2023-11-28T11:58:04.353 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.344+0000 7eff07569700 1 -- 172.21.15.39:0/3285745683 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff000d2450 con 0x7eff0006ff10 2023-11-28T11:58:04.353 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.344+0000 7efef6ffd700 1 -- 172.21.15.39:0/3285745683 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc0038e0 con 0x7eff0006ff10 2023-11-28T11:58:04.353 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.344+0000 7eff07569700 1 -- 172.21.15.39:0/3285745683 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff0006cc50 con 0x7eff0006ff10 2023-11-28T11:58:04.353 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.348+0000 7eff07569700 1 -- 172.21.15.39:0/3285745683 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff000d2730 con 0x7eff0006ff10 2023-11-28T11:58:04.355 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.348+0000 7efef6ffd700 1 -- 172.21.15.39:0/3285745683 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7efefc02a020 con 0x7eff0006ff10 2023-11-28T11:58:04.356 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.352+0000 7efef6ffd700 1 --2- 172.21.15.39:0/3285745683 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7efee4064f10 0x7efee40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:04.356 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.352+0000 7efef6ffd700 1 -- 172.21.15.39:0/3285745683 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7efefc083680 con 0x7eff0006ff10 2023-11-28T11:58:04.357 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.352+0000 7eff05d66700 1 --2- 172.21.15.39:0/3285745683 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7efee4064f10 0x7efee40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:04.358 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.352+0000 7eff05d66700 1 --2- 172.21.15.39:0/3285745683 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7efee4064f10 0x7efee40673c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7eff000b4c50 tx=0x7efef0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:04.364 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.356+0000 7efef6ffd700 1 -- 172.21.15.39:0/3285745683 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7efefc0515f0 con 0x7eff0006ff10 2023-11-28T11:58:04.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:04.568+0000 7eff07569700 1 -- 172.21.15.39:0/3285745683 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7eff00073d20 con 0x7eff0006ff10 2023-11-28T11:58:05.257 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.248+0000 7efef6ffd700 1 -- 172.21.15.39:0/3285745683 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7efefc054c10 con 0x7eff0006ff10 2023-11-28T11:58:05.259 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.252+0000 7eff07569700 1 -- 172.21.15.39:0/3285745683 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7efee4064f10 msgr2=0x7efee40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:05.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.252+0000 7eff07569700 1 --2- 172.21.15.39:0/3285745683 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7efee4064f10 0x7efee40673c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7eff000b4c50 tx=0x7efef0008040 comp rx=0 tx=0).stop 2023-11-28T11:58:05.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.252+0000 7eff07569700 1 -- 172.21.15.39:0/3285745683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff0006ff10 msgr2=0x7eff000ce5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:05.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.252+0000 7eff07569700 1 --2- 172.21.15.39:0/3285745683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff0006ff10 0x7eff000ce5b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7efefc009fd0 tx=0x7efefc004770 comp rx=0 tx=0).stop 2023-11-28T11:58:05.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.252+0000 7eff07569700 1 -- 172.21.15.39:0/3285745683 shutdown_connections 2023-11-28T11:58:05.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.252+0000 7eff07569700 1 --2- 172.21.15.39:0/3285745683 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7efee4064f10 0x7efee40673c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:05.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.252+0000 7eff07569700 1 --2- 172.21.15.39:0/3285745683 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff0015fc30 0x7eff000cf3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:05.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.252+0000 7eff07569700 1 --2- 172.21.15.39:0/3285745683 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff0015c150 0x7eff0015e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:05.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.252+0000 7eff07569700 1 --2- 172.21.15.39:0/3285745683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff0006ff10 0x7eff000ce5b0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:05.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.252+0000 7eff07569700 1 -- 172.21.15.39:0/3285745683 >> 172.21.15.39:0/3285745683 conn(0x7eff000d3680 msgr2=0x7eff0015b310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:05.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.252+0000 7eff07569700 1 -- 172.21.15.39:0/3285745683 shutdown_connections 2023-11-28T11:58:05.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.252+0000 7eff07569700 1 -- 172.21.15.39:0/3285745683 wait complete. 2023-11-28T11:58:05.281 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T11:58:05.282 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T11:58:05.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.464+0000 7f6e2bf92700 1 Processor -- start 2023-11-28T11:58:05.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.464+0000 7f6e2bf92700 1 -- start start 2023-11-28T11:58:05.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.468+0000 7f6e2bf92700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6e2415c700 0x7f6e240702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:05.473 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.468+0000 7f6e2bf92700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e2406cf00 con 0x7f6e240b1be0 2023-11-28T11:58:05.473 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.468+0000 7f6e2bf92700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e2406ac00 con 0x7f6e240b2130 2023-11-28T11:58:05.474 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.468+0000 7f6e2bf92700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e240cd360 con 0x7f6e2415c700 2023-11-28T11:58:05.474 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.468+0000 7f6e29d2e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6e2415c700 0x7f6e240702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:05.474 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.468+0000 7f6e2a52f700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f6e240b1be0 0x7f6e2406c7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:49454/0 (socket says 172.21.15.39:49454) 2023-11-28T11:58:05.474 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.468+0000 7f6e2a52f700 1 -- 172.21.15.39:0/3627176866 learned_addr learned my addr 172.21.15.39:0/3627176866 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:58:05.475 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.468+0000 7f6e29d2e700 1 -- 172.21.15.39:0/3627176866 >> v1:172.21.15.184:6789/0 conn(0x7f6e240b2130 legacy=0x7f6e2406c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:05.476 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.468+0000 7f6e29d2e700 1 -- 172.21.15.39:0/3627176866 >> v1:172.21.15.39:6789/0 conn(0x7f6e240b1be0 legacy=0x7f6e2406c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:05.476 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.468+0000 7f6e29d2e700 1 -- 172.21.15.39:0/3627176866 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e24160190 con 0x7f6e2415c700 2023-11-28T11:58:05.476 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.468+0000 7f6e28d2c700 1 -- 172.21.15.39:0/3627176866 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1947125614 0 0) 0x7f6e2406cf00 con 0x7f6e240b1be0 2023-11-28T11:58:05.476 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.468+0000 7f6e29d2e700 1 --2- 172.21.15.39:0/3627176866 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e2415c700 0x7f6e240702f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6e20009850 tx=0x7f6e20009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e310872017f02a4c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:05.476 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.468+0000 7f6e28d2c700 1 -- 172.21.15.39:0/3627176866 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e20011830 con 0x7f6e2415c700 2023-11-28T11:58:05.476 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.468+0000 7f6e28d2c700 1 -- 172.21.15.39:0/3627176866 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e20011990 con 0x7f6e2415c700 2023-11-28T11:58:05.476 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.468+0000 7f6e28d2c700 1 -- 172.21.15.39:0/3627176866 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e20011d20 con 0x7f6e2415c700 2023-11-28T11:58:05.477 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.472+0000 7f6e2bf92700 1 -- 172.21.15.39:0/3627176866 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e2415c700 msgr2=0x7f6e240702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:05.477 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.472+0000 7f6e2bf92700 1 --2- 172.21.15.39:0/3627176866 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e2415c700 0x7f6e240702f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6e20009850 tx=0x7f6e20009b60 comp rx=0 tx=0).stop 2023-11-28T11:58:05.477 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.472+0000 7f6e2bf92700 1 -- 172.21.15.39:0/3627176866 shutdown_connections 2023-11-28T11:58:05.477 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.472+0000 7f6e2bf92700 1 --2- 172.21.15.39:0/3627176866 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e2415c700 0x7f6e240702f0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:05.478 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.472+0000 7f6e2bf92700 1 -- 172.21.15.39:0/3627176866 >> 172.21.15.39:0/3627176866 conn(0x7f6e240d2d10 msgr2=0x7f6e240d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:05.478 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.472+0000 7f6e2bf92700 1 -- 172.21.15.39:0/3627176866 shutdown_connections 2023-11-28T11:58:05.478 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.472+0000 7f6e2bf92700 1 -- 172.21.15.39:0/3627176866 wait complete. 2023-11-28T11:58:05.480 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.472+0000 7f6e2bf92700 1 Processor -- start 2023-11-28T11:58:05.480 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.472+0000 7f6e2bf92700 1 -- start start 2023-11-28T11:58:05.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.476+0000 7f6e2bf92700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e240b1be0 0x7f6e24155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:05.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.476+0000 7f6e2bf92700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e240b2130 0x7f6e241564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:05.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.476+0000 7f6e2bf92700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e2415c700 0x7f6e240c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:05.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.476+0000 7f6e2bf92700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e240ca9f0 con 0x7f6e240b1be0 2023-11-28T11:58:05.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.476+0000 7f6e2bf92700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e240c9de0 con 0x7f6e240b2130 2023-11-28T11:58:05.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.476+0000 7f6e2bf92700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e240ca0c0 con 0x7f6e2415c700 2023-11-28T11:58:05.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.476+0000 7f6e29d2e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e240b1be0 0x7f6e24155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:05.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.476+0000 7f6e29d2e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e240b1be0 0x7f6e24155fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53852/0 (socket says 172.21.15.39:53852) 2023-11-28T11:58:05.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.476+0000 7f6e29d2e700 1 -- 172.21.15.39:0/3156542358 learned_addr learned my addr 172.21.15.39:0/3156542358 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:05.484 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.476+0000 7f6e2952d700 1 --2- 172.21.15.39:0/3156542358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e240b2130 0x7f6e241564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:05.484 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.476+0000 7f6e2a52f700 1 --2- 172.21.15.39:0/3156542358 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e2415c700 0x7f6e240c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:05.484 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.476+0000 7f6e29d2e700 1 -- 172.21.15.39:0/3156542358 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e2415c700 msgr2=0x7f6e240c8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:05.484 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.476+0000 7f6e29d2e700 1 --2- 172.21.15.39:0/3156542358 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e2415c700 0x7f6e240c8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:05.484 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.476+0000 7f6e29d2e700 1 -- 172.21.15.39:0/3156542358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e240b2130 msgr2=0x7f6e241564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:05.484 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.476+0000 7f6e29d2e700 1 --2- 172.21.15.39:0/3156542358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e240b2130 0x7f6e241564e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:05.484 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.476+0000 7f6e29d2e700 1 -- 172.21.15.39:0/3156542358 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e200094b0 con 0x7f6e240b1be0 2023-11-28T11:58:05.485 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.476+0000 7f6e2a52f700 1 --2- 172.21.15.39:0/3156542358 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e2415c700 0x7f6e240c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:58:05.485 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.476+0000 7f6e29d2e700 1 --2- 172.21.15.39:0/3156542358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e240b1be0 0x7f6e24155fa0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6e200090b0 tx=0x7f6e20004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:05.485 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.476+0000 7f6e1a7fc700 1 -- 172.21.15.39:0/3156542358 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2000bc10 con 0x7f6e240b1be0 2023-11-28T11:58:05.485 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.476+0000 7f6e1a7fc700 1 -- 172.21.15.39:0/3156542358 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e2001f070 con 0x7f6e240b1be0 2023-11-28T11:58:05.485 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.476+0000 7f6e2bf92700 1 -- 172.21.15.39:0/3156542358 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e24160750 con 0x7f6e240b1be0 2023-11-28T11:58:05.485 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.476+0000 7f6e1a7fc700 1 -- 172.21.15.39:0/3156542358 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2001a430 con 0x7f6e240b1be0 2023-11-28T11:58:05.485 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.476+0000 7f6e2bf92700 1 -- 172.21.15.39:0/3156542358 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e24160470 con 0x7f6e240b1be0 2023-11-28T11:58:05.486 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.480+0000 7f6e2bf92700 1 -- 172.21.15.39:0/3156542358 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e24160a30 con 0x7f6e240b1be0 2023-11-28T11:58:05.486 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.480+0000 7f6e1a7fc700 1 -- 172.21.15.39:0/3156542358 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6e2000f050 con 0x7f6e240b1be0 2023-11-28T11:58:05.488 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.480+0000 7f6e1a7fc700 1 --2- 172.21.15.39:0/3156542358 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6e08064ee0 0x7f6e08067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:05.488 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.480+0000 7f6e1a7fc700 1 -- 172.21.15.39:0/3156542358 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6e20021070 con 0x7f6e240b1be0 2023-11-28T11:58:05.488 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.484+0000 7f6e2952d700 1 --2- 172.21.15.39:0/3156542358 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6e08064ee0 0x7f6e08067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:05.489 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.484+0000 7f6e2952d700 1 --2- 172.21.15.39:0/3156542358 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6e08064ee0 0x7f6e08067390 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6e240c8740 tx=0x7f6e14009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:05.493 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.488+0000 7f6e1a7fc700 1 -- 172.21.15.39:0/3156542358 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6e20051870 con 0x7f6e240b1be0 2023-11-28T11:58:05.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:05.700+0000 7f6e2bf92700 1 -- 172.21.15.39:0/3156542358 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6e240726c0 con 0x7f6e240b1be0 2023-11-28T11:58:05.708 INFO:tasks.ceph.mds.d.smithi184.stderr:2023-11-28T11:58:05.700+0000 7fc6523e1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T11:58:06.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.256+0000 7f6e1a7fc700 1 -- 172.21.15.39:0/3156542358 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6e20054e90 con 0x7f6e240b1be0 2023-11-28T11:58:06.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.260+0000 7f6e2bf92700 1 -- 172.21.15.39:0/3156542358 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6e08064ee0 msgr2=0x7f6e08067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:06.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.260+0000 7f6e2bf92700 1 --2- 172.21.15.39:0/3156542358 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6e08064ee0 0x7f6e08067390 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6e240c8740 tx=0x7f6e14009040 comp rx=0 tx=0).stop 2023-11-28T11:58:06.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.260+0000 7f6e2bf92700 1 -- 172.21.15.39:0/3156542358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e240b1be0 msgr2=0x7f6e24155fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:06.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.260+0000 7f6e2bf92700 1 --2- 172.21.15.39:0/3156542358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e240b1be0 0x7f6e24155fa0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6e200090b0 tx=0x7f6e20004770 comp rx=0 tx=0).stop 2023-11-28T11:58:06.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.260+0000 7f6e2bf92700 1 -- 172.21.15.39:0/3156542358 shutdown_connections 2023-11-28T11:58:06.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.260+0000 7f6e2bf92700 1 --2- 172.21.15.39:0/3156542358 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e2415c700 0x7f6e240c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:06.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.260+0000 7f6e2bf92700 1 --2- 172.21.15.39:0/3156542358 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6e08064ee0 0x7f6e08067390 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:06.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.260+0000 7f6e2bf92700 1 --2- 172.21.15.39:0/3156542358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e240b2130 0x7f6e241564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:06.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.260+0000 7f6e2bf92700 1 --2- 172.21.15.39:0/3156542358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e240b1be0 0x7f6e24155fa0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:06.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.260+0000 7f6e2bf92700 1 -- 172.21.15.39:0/3156542358 >> 172.21.15.39:0/3156542358 conn(0x7f6e240d2d10 msgr2=0x7f6e240b45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:06.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.260+0000 7f6e2bf92700 1 -- 172.21.15.39:0/3156542358 shutdown_connections 2023-11-28T11:58:06.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.260+0000 7f6e2bf92700 1 -- 172.21.15.39:0/3156542358 wait complete. 2023-11-28T11:58:06.290 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T11:58:06.290 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:58:06.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.460+0000 7fd98f59e700 1 Processor -- start 2023-11-28T11:58:06.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.460+0000 7fd98f59e700 1 -- start start 2023-11-28T11:58:06.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.464+0000 7fd98f59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd990160710 0x7fd9900cc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:06.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.464+0000 7fd98f59e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd9900cc860 0x7fd990070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:06.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.464+0000 7fd98f59e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd9900705c0 0x7fd990069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:06.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.464+0000 7fd98f59e700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd990070a60 con 0x7fd9900705c0 2023-11-28T11:58:06.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.464+0000 7fd98f59e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd99006b1c0 con 0x7fd9900cc860 2023-11-28T11:58:06.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.464+0000 7fd98f59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9900ad6c0 con 0x7fd990160710 2023-11-28T11:58:06.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.464+0000 7fd98ed9d700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd9900705c0 0x7fd990069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:06.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.464+0000 7fd985d9b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd9900cc860 0x7fd990070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:06.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.464+0000 7fd985d9b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd9900cc860 0x7fd990070080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:38108/0 (socket says 172.21.15.39:38108) 2023-11-28T11:58:06.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.464+0000 7fd985d9b700 1 -- 172.21.15.39:0/4192528755 learned_addr learned my addr 172.21.15.39:0/4192528755 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:06.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.464+0000 7fd98e59c700 1 --2- 172.21.15.39:0/4192528755 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd990160710 0x7fd9900cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:06.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.464+0000 7fd985d9b700 1 -- 172.21.15.39:0/4192528755 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd990160710 msgr2=0x7fd9900cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:06.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.464+0000 7fd985d9b700 1 --2- 172.21.15.39:0/4192528755 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd990160710 0x7fd9900cc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:06.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.464+0000 7fd985d9b700 1 -- 172.21.15.39:0/4192528755 >> v2:172.21.15.39:3300/0 conn(0x7fd9900705c0 msgr2=0x7fd990069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:06.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.464+0000 7fd985d9b700 1 --2- 172.21.15.39:0/4192528755 >> v2:172.21.15.39:3300/0 conn(0x7fd9900705c0 0x7fd990069bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:06.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.464+0000 7fd985d9b700 1 -- 172.21.15.39:0/4192528755 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9900adc60 con 0x7fd9900cc860 2023-11-28T11:58:06.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.464+0000 7fd985d9b700 1 --2- 172.21.15.39:0/4192528755 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9900cc860 0x7fd990070080 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd99006e590 tx=0x7fd97800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f82f95261731463 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:06.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.464+0000 7fd98dd9b700 1 -- 172.21.15.39:0/4192528755 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97800e070 con 0x7fd9900cc860 2023-11-28T11:58:06.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.464+0000 7fd98dd9b700 1 -- 172.21.15.39:0/4192528755 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97800b910 con 0x7fd9900cc860 2023-11-28T11:58:06.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.464+0000 7fd98dd9b700 1 -- 172.21.15.39:0/4192528755 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97800bcc0 con 0x7fd9900cc860 2023-11-28T11:58:06.473 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.468+0000 7fd98f59e700 1 -- 172.21.15.39:0/4192528755 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9900cc860 msgr2=0x7fd990070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:06.473 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.468+0000 7fd98f59e700 1 --2- 172.21.15.39:0/4192528755 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9900cc860 0x7fd990070080 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd99006e590 tx=0x7fd97800b330 comp rx=0 tx=0).stop 2023-11-28T11:58:06.474 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.468+0000 7fd98f59e700 1 -- 172.21.15.39:0/4192528755 shutdown_connections 2023-11-28T11:58:06.474 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.468+0000 7fd98f59e700 1 --2- 172.21.15.39:0/4192528755 >> v2:172.21.15.39:3300/0 conn(0x7fd9900705c0 0x7fd990069bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:06.474 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.468+0000 7fd98f59e700 1 --2- 172.21.15.39:0/4192528755 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9900cc860 0x7fd990070080 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:06.474 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.468+0000 7fd98f59e700 1 --2- 172.21.15.39:0/4192528755 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd990160710 0x7fd9900cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:06.474 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.468+0000 7fd98f59e700 1 -- 172.21.15.39:0/4192528755 >> 172.21.15.39:0/4192528755 conn(0x7fd9900b0f80 msgr2=0x7fd9900ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:06.474 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.468+0000 7fd98f59e700 1 -- 172.21.15.39:0/4192528755 shutdown_connections 2023-11-28T11:58:06.474 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.468+0000 7fd98f59e700 1 -- 172.21.15.39:0/4192528755 wait complete. 2023-11-28T11:58:06.475 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.468+0000 7fd98f59e700 1 Processor -- start 2023-11-28T11:58:06.476 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.468+0000 7fd98f59e700 1 -- start start 2023-11-28T11:58:06.477 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.472+0000 7fd98f59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9900705c0 0x7fd99015fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:06.478 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.472+0000 7fd98f59e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9900cc860 0x7fd990159b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:06.478 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.472+0000 7fd98f59e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd990160710 0x7fd99015d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:06.478 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.472+0000 7fd98f59e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9900b3430 con 0x7fd9900cc860 2023-11-28T11:58:06.478 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.472+0000 7fd98f59e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd99015a0b0 con 0x7fd990160710 2023-11-28T11:58:06.478 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.472+0000 7fd98f59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd99015dc20 con 0x7fd9900705c0 2023-11-28T11:58:06.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.472+0000 7fd985d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9900cc860 0x7fd990159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:06.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.472+0000 7fd985d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9900cc860 0x7fd990159b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53878/0 (socket says 172.21.15.39:53878) 2023-11-28T11:58:06.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.472+0000 7fd985d9b700 1 -- 172.21.15.39:0/3578679836 learned_addr learned my addr 172.21.15.39:0/3578679836 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:06.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.472+0000 7fd98ed9d700 1 --2- 172.21.15.39:0/3578679836 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd990160710 0x7fd99015d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:06.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.472+0000 7fd98e59c700 1 --2- 172.21.15.39:0/3578679836 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9900705c0 0x7fd99015fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:06.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.472+0000 7fd985d9b700 1 -- 172.21.15.39:0/3578679836 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9900705c0 msgr2=0x7fd99015fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:06.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.472+0000 7fd985d9b700 1 --2- 172.21.15.39:0/3578679836 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9900705c0 0x7fd99015fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:06.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.472+0000 7fd985d9b700 1 -- 172.21.15.39:0/3578679836 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd990160710 msgr2=0x7fd99015d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:06.480 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.472+0000 7fd985d9b700 1 --2- 172.21.15.39:0/3578679836 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd990160710 0x7fd99015d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:06.480 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.472+0000 7fd985d9b700 1 -- 172.21.15.39:0/3578679836 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd978009b30 con 0x7fd9900cc860 2023-11-28T11:58:06.480 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.472+0000 7fd98ed9d700 1 --2- 172.21.15.39:0/3578679836 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd990160710 0x7fd99015d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:58:06.480 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.472+0000 7fd98e59c700 1 --2- 172.21.15.39:0/3578679836 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9900705c0 0x7fd99015fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:58:06.480 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.472+0000 7fd985d9b700 1 --2- 172.21.15.39:0/3578679836 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9900cc860 0x7fd990159b70 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd97800b370 tx=0x7fd978004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:06.481 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.472+0000 7fd9877fe700 1 -- 172.21.15.39:0/3578679836 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97800ce80 con 0x7fd9900cc860 2023-11-28T11:58:06.481 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.472+0000 7fd9877fe700 1 -- 172.21.15.39:0/3578679836 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd978004250 con 0x7fd9900cc860 2023-11-28T11:58:06.481 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.472+0000 7fd9877fe700 1 -- 172.21.15.39:0/3578679836 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd978004600 con 0x7fd9900cc860 2023-11-28T11:58:06.481 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.472+0000 7fd98f59e700 1 -- 172.21.15.39:0/3578679836 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd99006b6b0 con 0x7fd9900cc860 2023-11-28T11:58:06.481 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.472+0000 7fd98f59e700 1 -- 172.21.15.39:0/3578679836 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd99006b3d0 con 0x7fd9900cc860 2023-11-28T11:58:06.481 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.476+0000 7fd98f59e700 1 -- 172.21.15.39:0/3578679836 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9900ad8f0 con 0x7fd9900cc860 2023-11-28T11:58:06.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.476+0000 7fd9877fe700 1 -- 172.21.15.39:0/3578679836 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd97802c070 con 0x7fd9900cc860 2023-11-28T11:58:06.484 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.480+0000 7fd9877fe700 1 --2- 172.21.15.39:0/3578679836 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd970064ee0 0x7fd970067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:06.485 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.480+0000 7fd9877fe700 1 -- 172.21.15.39:0/3578679836 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd978083780 con 0x7fd9900cc860 2023-11-28T11:58:06.485 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.480+0000 7fd98e59c700 1 --2- 172.21.15.39:0/3578679836 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd970064ee0 0x7fd970067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:06.486 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.480+0000 7fd98e59c700 1 --2- 172.21.15.39:0/3578679836 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd970064ee0 0x7fd970067390 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd980009a50 tx=0x7fd980008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:06.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.484+0000 7fd9877fe700 1 -- 172.21.15.39:0/3578679836 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd978051670 con 0x7fd9900cc860 2023-11-28T11:58:06.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.692+0000 7fd98f59e700 1 -- 172.21.15.39:0/3578679836 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd9900b3570 con 0x7fd9900cc860 2023-11-28T11:58:06.701 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.696+0000 7fd9877fe700 1 -- 172.21.15.39:0/3578679836 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4654 (secure 0 0 0) 0x7fd9900b3570 con 0x7fd9900cc860 2023-11-28T11:58:06.701 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:58:06.701 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/3875562914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3875562914},{"type":"v1","addr":"172.21.15.184:6836","nonce":3875562914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5295,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/4053840838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":4053840838},{"type":"v1","addr":"172.21.15.39:6833","nonce":4053840838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5304,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2819411287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2819411287},{"type":"v1","addr":"172.21.15.39:6835","nonce":2819411287}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:58:03.228365+0000","modified":"2023-11-28T11:58:06.252058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5317},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5317":{"gid":5317,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.184:6837/2775071992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":2775071992},{"type":"v1","addr":"172.21.15.184:6837","nonce":2775071992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T11:58:06.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.696+0000 7fd98f59e700 1 -- 172.21.15.39:0/3578679836 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd970064ee0 msgr2=0x7fd970067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:06.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.696+0000 7fd98f59e700 1 --2- 172.21.15.39:0/3578679836 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd970064ee0 0x7fd970067390 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd980009a50 tx=0x7fd980008040 comp rx=0 tx=0).stop 2023-11-28T11:58:06.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.696+0000 7fd98f59e700 1 -- 172.21.15.39:0/3578679836 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9900cc860 msgr2=0x7fd990159b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:06.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.696+0000 7fd98f59e700 1 --2- 172.21.15.39:0/3578679836 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9900cc860 0x7fd990159b70 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd97800b370 tx=0x7fd978004af0 comp rx=0 tx=0).stop 2023-11-28T11:58:06.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.696+0000 7fd98f59e700 1 -- 172.21.15.39:0/3578679836 shutdown_connections 2023-11-28T11:58:06.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.696+0000 7fd98f59e700 1 --2- 172.21.15.39:0/3578679836 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd970064ee0 0x7fd970067390 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:06.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.696+0000 7fd98f59e700 1 --2- 172.21.15.39:0/3578679836 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd990160710 0x7fd99015d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:06.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.696+0000 7fd98f59e700 1 --2- 172.21.15.39:0/3578679836 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9900cc860 0x7fd990159b70 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:06.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.696+0000 7fd98f59e700 1 --2- 172.21.15.39:0/3578679836 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9900705c0 0x7fd99015fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:06.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.696+0000 7fd98f59e700 1 -- 172.21.15.39:0/3578679836 >> 172.21.15.39:0/3578679836 conn(0x7fd9900b0f80 msgr2=0x7fd9900afb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:06.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.696+0000 7fd98f59e700 1 -- 172.21.15.39:0/3578679836 shutdown_connections 2023-11-28T11:58:06.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.696+0000 7fd98f59e700 1 -- 172.21.15.39:0/3578679836 wait complete. 2023-11-28T11:58:06.707 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 16 2023-11-28T11:58:06.725 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:58:06.904 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.900+0000 7f0605691700 1 Processor -- start 2023-11-28T11:58:06.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.900+0000 7f0605691700 1 -- start start 2023-11-28T11:58:06.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.900+0000 7f0605691700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f0600070790 0x7f06001670c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:06.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.900+0000 7f0605691700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06000d24d0 con 0x7f06000ced50 2023-11-28T11:58:06.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.900+0000 7f0605691700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06000d27b0 con 0x7f060006afc0 2023-11-28T11:58:06.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.900+0000 7f0605691700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f060006b440 con 0x7f0600070790 2023-11-28T11:58:06.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.900+0000 7f05fffff700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f06000ced50 0x7f0600160770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:49462/0 (socket says 172.21.15.39:49462) 2023-11-28T11:58:06.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.900+0000 7f05fffff700 1 -- 172.21.15.39:0/3885159739 learned_addr learned my addr 172.21.15.39:0/3885159739 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:58:06.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.904+0000 7f0604e90700 1 --2- 172.21.15.39:0/3885159739 >> v2:172.21.15.184:3300/0 conn(0x7f0600070790 0x7f06001670c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:06.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.904+0000 7f05ff7fe700 1 -- 172.21.15.39:0/3885159739 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2364801971 0 0) 0x7f06000d24d0 con 0x7f06000ced50 2023-11-28T11:58:06.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.904+0000 7f05ff7fe700 1 -- 172.21.15.39:0/3885159739 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05ec0035d0 con 0x7f06000ced50 2023-11-28T11:58:06.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.904+0000 7f05ff7fe700 1 -- 172.21.15.39:0/3885159739 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3513552288 0 0) 0x7f06000d27b0 con 0x7f060006afc0 2023-11-28T11:58:06.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.904+0000 7f05ff7fe700 1 -- 172.21.15.39:0/3885159739 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06000d24d0 con 0x7f060006afc0 2023-11-28T11:58:06.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.904+0000 7f0604e90700 1 -- 172.21.15.39:0/3885159739 >> v1:172.21.15.184:6789/0 conn(0x7f060006afc0 legacy=0x7f0600070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:06.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.904+0000 7f0604e90700 1 -- 172.21.15.39:0/3885159739 >> v1:172.21.15.39:6789/0 conn(0x7f06000ced50 legacy=0x7f0600160770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:06.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.904+0000 7f0604e90700 1 -- 172.21.15.39:0/3885159739 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06000d08d0 con 0x7f0600070790 2023-11-28T11:58:06.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.904+0000 7f0604e90700 1 --2- 172.21.15.39:0/3885159739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0600070790 0x7f06001670c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f05f8009d90 tx=0x7f05f800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e6b770068f76127 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:06.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.904+0000 7f05ff7fe700 1 -- 172.21.15.39:0/3885159739 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f800e070 con 0x7f0600070790 2023-11-28T11:58:06.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.904+0000 7f05ff7fe700 1 -- 172.21.15.39:0/3885159739 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f800bb20 con 0x7f0600070790 2023-11-28T11:58:06.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.904+0000 7f05ff7fe700 1 -- 172.21.15.39:0/3885159739 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f800be90 con 0x7f0600070790 2023-11-28T11:58:06.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.904+0000 7f0605691700 1 -- 172.21.15.39:0/3885159739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0600070790 msgr2=0x7f06001670c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:06.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.904+0000 7f0605691700 1 --2- 172.21.15.39:0/3885159739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0600070790 0x7f06001670c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f05f8009d90 tx=0x7f05f800b330 comp rx=0 tx=0).stop 2023-11-28T11:58:06.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.904+0000 7f0605691700 1 -- 172.21.15.39:0/3885159739 shutdown_connections 2023-11-28T11:58:06.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.904+0000 7f0605691700 1 --2- 172.21.15.39:0/3885159739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0600070790 0x7f06001670c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:06.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.904+0000 7f0605691700 1 -- 172.21.15.39:0/3885159739 >> 172.21.15.39:0/3885159739 conn(0x7f06000b53a0 msgr2=0x7f06000d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:06.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.904+0000 7f0605691700 1 -- 172.21.15.39:0/3885159739 shutdown_connections 2023-11-28T11:58:06.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.904+0000 7f0605691700 1 -- 172.21.15.39:0/3885159739 wait complete. 2023-11-28T11:58:06.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.908+0000 7f0605691700 1 Processor -- start 2023-11-28T11:58:06.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.908+0000 7f0605691700 1 -- start start 2023-11-28T11:58:06.916 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.912+0000 7f0605691700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f060006afc0 0x7f06000b83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:06.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.912+0000 7f0605691700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0600070790 0x7f060014e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:06.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.912+0000 7f0605691700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06000ced50 0x7f0600157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:06.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.912+0000 7f0605691700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06000c70a0 con 0x7f0600070790 2023-11-28T11:58:06.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.912+0000 7f0605691700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0600153040 con 0x7f060006afc0 2023-11-28T11:58:06.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.912+0000 7f0605691700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06000b6d40 con 0x7f06000ced50 2023-11-28T11:58:06.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.912+0000 7f05f77fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0600070790 0x7f060014e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:06.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.912+0000 7f05f77fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0600070790 0x7f060014e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53882/0 (socket says 172.21.15.39:53882) 2023-11-28T11:58:06.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.912+0000 7f05f77fe700 1 -- 172.21.15.39:0/3983701486 learned_addr learned my addr 172.21.15.39:0/3983701486 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:06.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.912+0000 7f05fffff700 1 --2- 172.21.15.39:0/3983701486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f060006afc0 0x7f06000b83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:06.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.912+0000 7f0604e90700 1 --2- 172.21.15.39:0/3983701486 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06000ced50 0x7f0600157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:06.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.912+0000 7f05f77fe700 1 -- 172.21.15.39:0/3983701486 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06000ced50 msgr2=0x7f0600157610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:06.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.912+0000 7f05f77fe700 1 --2- 172.21.15.39:0/3983701486 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06000ced50 0x7f0600157610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:06.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.912+0000 7f05f77fe700 1 -- 172.21.15.39:0/3983701486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f060006afc0 msgr2=0x7f06000b83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:06.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.912+0000 7f05f77fe700 1 --2- 172.21.15.39:0/3983701486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f060006afc0 0x7f06000b83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:06.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.912+0000 7f05f77fe700 1 -- 172.21.15.39:0/3983701486 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f8009a70 con 0x7f0600070790 2023-11-28T11:58:06.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.912+0000 7f0604e90700 1 --2- 172.21.15.39:0/3983701486 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06000ced50 0x7f0600157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:58:06.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.912+0000 7f05f77fe700 1 --2- 172.21.15.39:0/3983701486 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0600070790 0x7f060014e6d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f05e800c730 tx=0x7f05e800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:06.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.912+0000 7f05fd7fa700 1 -- 172.21.15.39:0/3983701486 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e80052d0 con 0x7f0600070790 2023-11-28T11:58:06.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.912+0000 7f05fd7fa700 1 -- 172.21.15.39:0/3983701486 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e8005450 con 0x7f0600070790 2023-11-28T11:58:06.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.912+0000 7f0605691700 1 -- 172.21.15.39:0/3983701486 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06000cf120 con 0x7f0600070790 2023-11-28T11:58:06.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.912+0000 7f05fd7fa700 1 -- 172.21.15.39:0/3983701486 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e80038e0 con 0x7f0600070790 2023-11-28T11:58:06.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.912+0000 7f0605691700 1 -- 172.21.15.39:0/3983701486 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06000d0bb0 con 0x7f0600070790 2023-11-28T11:58:06.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.916+0000 7f0605691700 1 -- 172.21.15.39:0/3983701486 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06000cd1b0 con 0x7f0600070790 2023-11-28T11:58:06.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.916+0000 7f05fd7fa700 1 -- 172.21.15.39:0/3983701486 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f05e8019030 con 0x7f0600070790 2023-11-28T11:58:06.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.916+0000 7f05fd7fa700 1 --2- 172.21.15.39:0/3983701486 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f05e0064ee0 0x7f05e0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:06.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.916+0000 7f05fd7fa700 1 -- 172.21.15.39:0/3983701486 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f05e8081410 con 0x7f0600070790 2023-11-28T11:58:06.924 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.920+0000 7f05fffff700 1 --2- 172.21.15.39:0/3983701486 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f05e0064ee0 0x7f05e0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:06.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.920+0000 7f05fffff700 1 --2- 172.21.15.39:0/3983701486 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f05e0064ee0 0x7f05e0067390 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f05f0007fd0 tx=0x7f05f0007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:06.930 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:06.924+0000 7f05fd7fa700 1 -- 172.21.15.39:0/3983701486 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f05e804f3f0 con 0x7f0600070790 2023-11-28T11:58:07.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.108+0000 7f0605691700 1 -- 172.21.15.39:0/3983701486 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0600073cb0 con 0x7f0600070790 2023-11-28T11:58:07.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.112+0000 7f05fd7fa700 1 -- 172.21.15.39:0/3983701486 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+18032 (secure 0 0 0) 0x7f05e8052a10 con 0x7f0600070790 2023-11-28T11:58:07.117 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:58:07.117 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":44,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:58:04.233062+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:58:01.523189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-28T11:58:02.259575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:58:07.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.112+0000 7f0605691700 1 -- 172.21.15.39:0/3983701486 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f05e0064ee0 msgr2=0x7f05e0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:07.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.112+0000 7f0605691700 1 --2- 172.21.15.39:0/3983701486 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f05e0064ee0 0x7f05e0067390 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f05f0007fd0 tx=0x7f05f0007de0 comp rx=0 tx=0).stop 2023-11-28T11:58:07.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.112+0000 7f0605691700 1 -- 172.21.15.39:0/3983701486 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0600070790 msgr2=0x7f060014e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:07.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.112+0000 7f0605691700 1 --2- 172.21.15.39:0/3983701486 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0600070790 0x7f060014e6d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f05e800c730 tx=0x7f05e800ca40 comp rx=0 tx=0).stop 2023-11-28T11:58:07.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.116+0000 7f0605691700 1 -- 172.21.15.39:0/3983701486 shutdown_connections 2023-11-28T11:58:07.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.116+0000 7f0605691700 1 --2- 172.21.15.39:0/3983701486 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06000ced50 0x7f0600157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:07.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.116+0000 7f0605691700 1 --2- 172.21.15.39:0/3983701486 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0600070790 0x7f060014e6d0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:07.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.116+0000 7f0605691700 1 --2- 172.21.15.39:0/3983701486 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f05e0064ee0 0x7f05e0067390 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:07.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.116+0000 7f0605691700 1 --2- 172.21.15.39:0/3983701486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f060006afc0 0x7f06000b83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:07.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.116+0000 7f0605691700 1 -- 172.21.15.39:0/3983701486 >> 172.21.15.39:0/3983701486 conn(0x7f06000b53a0 msgr2=0x7f06000cdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:07.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.116+0000 7f0605691700 1 -- 172.21.15.39:0/3983701486 shutdown_connections 2023-11-28T11:58:07.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.116+0000 7f0605691700 1 -- 172.21.15.39:0/3983701486 wait complete. 2023-11-28T11:58:07.143 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T11:58:07.143 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:58:07.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.336+0000 7f6ff9508700 1 Processor -- start 2023-11-28T11:58:07.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.336+0000 7f6ff9508700 1 -- start start 2023-11-28T11:58:07.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.336+0000 7f6ff9508700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6ff4069e00 0x7f6ff406a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:07.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.336+0000 7f6ff9508700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ff406c600 con 0x7f6ff4071aa0 2023-11-28T11:58:07.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.336+0000 7f6ff9508700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ff40722f0 con 0x7f6ff415c640 2023-11-28T11:58:07.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.336+0000 7f6ff9508700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ff406cef0 con 0x7f6ff4069e00 2023-11-28T11:58:07.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.340+0000 7f6ff37fe700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f6ff4071aa0 0x7f6ff406d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:49476/0 (socket says 172.21.15.39:49476) 2023-11-28T11:58:07.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.340+0000 7f6ff37fe700 1 -- 172.21.15.39:0/781044351 learned_addr learned my addr 172.21.15.39:0/781044351 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:58:07.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.340+0000 7f6ff8d07700 1 --2- 172.21.15.39:0/781044351 >> v2:172.21.15.184:3300/0 conn(0x7f6ff4069e00 0x7f6ff406a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:07.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.340+0000 7f6ff2ffd700 1 -- 172.21.15.39:0/781044351 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3859246111 0 0) 0x7f6ff406c600 con 0x7f6ff4071aa0 2023-11-28T11:58:07.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.340+0000 7f6ff2ffd700 1 -- 172.21.15.39:0/781044351 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fdc0035d0 con 0x7f6ff4071aa0 2023-11-28T11:58:07.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.340+0000 7f6ff2ffd700 1 -- 172.21.15.39:0/781044351 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 630754163 0 0) 0x7f6ff40722f0 con 0x7f6ff415c640 2023-11-28T11:58:07.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.340+0000 7f6ff2ffd700 1 -- 172.21.15.39:0/781044351 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ff406c600 con 0x7f6ff415c640 2023-11-28T11:58:07.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.340+0000 7f6ff2ffd700 1 -- 172.21.15.39:0/781044351 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 435194463 0 0) 0x7f6fdc0035d0 con 0x7f6ff4071aa0 2023-11-28T11:58:07.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.340+0000 7f6ff2ffd700 1 -- 172.21.15.39:0/781044351 >> v2:172.21.15.184:3300/0 conn(0x7f6ff4069e00 msgr2=0x7f6ff406a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:07.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.340+0000 7f6ff2ffd700 1 --2- 172.21.15.39:0/781044351 >> v2:172.21.15.184:3300/0 conn(0x7f6ff4069e00 0x7f6ff406a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:07.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.340+0000 7f6ff2ffd700 1 -- 172.21.15.39:0/781044351 >> v1:172.21.15.184:6789/0 conn(0x7f6ff415c640 legacy=0x7f6ff40d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:07.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.340+0000 7f6ff2ffd700 1 -- 172.21.15.39:0/781044351 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff406da20 con 0x7f6ff4071aa0 2023-11-28T11:58:07.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.340+0000 7f6ff2ffd700 1 -- 172.21.15.39:0/781044351 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4013383302 0 0) 0x7f6fe8001670 con 0x7f6ff4071aa0 2023-11-28T11:58:07.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.340+0000 7f6ff2ffd700 1 -- 172.21.15.39:0/781044351 >> v1:172.21.15.39:6789/0 conn(0x7f6ff4071aa0 legacy=0x7f6ff406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:07.348 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.340+0000 7f6ff2ffd700 1 --2- 172.21.15.39:0/781044351 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fdc003bb0 0x7f6fdc003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:07.348 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.340+0000 7f6ff2ffd700 1 --2- 172.21.15.39:0/781044351 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fdc004870 0x7f6fdc004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:07.348 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.340+0000 7f6ff2ffd700 1 --2- 172.21.15.39:0/781044351 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fdc005220 0x7f6fdc00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:07.348 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.340+0000 7f6ff2ffd700 1 -- 172.21.15.39:0/781044351 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff406cef0 con 0x7f6fdc004870 2023-11-28T11:58:07.348 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.340+0000 7f6ff2ffd700 1 -- 172.21.15.39:0/781044351 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc00c080 con 0x7f6fdc003bb0 2023-11-28T11:58:07.348 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.340+0000 7f6ff2ffd700 1 -- 172.21.15.39:0/781044351 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc00c240 con 0x7f6fdc005220 2023-11-28T11:58:07.348 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.340+0000 7f6ff3fff700 1 --2- 172.21.15.39:0/781044351 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fdc003bb0 0x7f6fdc003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:07.348 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.340+0000 7f6ff37fe700 1 --2- 172.21.15.39:0/781044351 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fdc004870 0x7f6fdc004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:07.348 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.340+0000 7f6ff8d07700 1 --2- 172.21.15.39:0/781044351 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fdc005220 0x7f6fdc00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:07.350 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.340+0000 7f6ff37fe700 1 -- 172.21.15.39:0/781044351 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fdc005220 msgr2=0x7f6fdc00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:07.351 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.340+0000 7f6ff37fe700 1 --2- 172.21.15.39:0/781044351 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fdc005220 0x7f6fdc00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:07.351 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.340+0000 7f6ff37fe700 1 -- 172.21.15.39:0/781044351 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fdc003bb0 msgr2=0x7f6fdc003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:07.351 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.340+0000 7f6ff37fe700 1 --2- 172.21.15.39:0/781044351 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fdc003bb0 0x7f6fdc003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:07.351 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.340+0000 7f6ff37fe700 1 -- 172.21.15.39:0/781044351 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fdc0035d0 con 0x7f6fdc004870 2023-11-28T11:58:07.351 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.340+0000 7f6ff8d07700 1 --2- 172.21.15.39:0/781044351 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fdc005220 0x7f6fdc00ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:58:07.351 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.340+0000 7f6ff3fff700 1 --2- 172.21.15.39:0/781044351 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fdc003bb0 0x7f6fdc003fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:58:07.351 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.340+0000 7f6ff8d07700 1 -- 172.21.15.39:0/781044351 reap_dead start 2023-11-28T11:58:07.351 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.344+0000 7f6ff37fe700 1 --2- 172.21.15.39:0/781044351 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fdc004870 0x7f6fdc004ce0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6fe800c210 tx=0x7f6fdc0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d7b1ea9a649520a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:07.351 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.344+0000 7f6ff2ffd700 1 -- 172.21.15.39:0/781044351 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe800cd70 con 0x7f6fdc004870 2023-11-28T11:58:07.351 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.344+0000 7f6ff2ffd700 1 -- 172.21.15.39:0/781044351 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe8005980 con 0x7f6fdc004870 2023-11-28T11:58:07.351 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.344+0000 7f6ff2ffd700 1 -- 172.21.15.39:0/781044351 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe8005cf0 con 0x7f6fdc004870 2023-11-28T11:58:07.351 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.344+0000 7f6ff9508700 1 -- 172.21.15.39:0/781044351 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fdc004870 msgr2=0x7f6fdc004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:07.352 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.344+0000 7f6ff9508700 1 --2- 172.21.15.39:0/781044351 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fdc004870 0x7f6fdc004ce0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6fe800c210 tx=0x7f6fdc0058a0 comp rx=0 tx=0).stop 2023-11-28T11:58:07.352 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.344+0000 7f6ff9508700 1 -- 172.21.15.39:0/781044351 shutdown_connections 2023-11-28T11:58:07.352 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.344+0000 7f6ff9508700 1 --2- 172.21.15.39:0/781044351 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fdc004870 0x7f6fdc004ce0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:07.352 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.344+0000 7f6ff9508700 1 -- 172.21.15.39:0/781044351 >> 172.21.15.39:0/781044351 conn(0x7f6ff40b6520 msgr2=0x7f6ff4071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:07.352 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.344+0000 7f6ff9508700 1 -- 172.21.15.39:0/781044351 shutdown_connections 2023-11-28T11:58:07.352 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.344+0000 7f6ff9508700 1 -- 172.21.15.39:0/781044351 wait complete. 2023-11-28T11:58:07.353 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.348+0000 7f6ff9508700 1 Processor -- start 2023-11-28T11:58:07.354 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.348+0000 7f6ff9508700 1 -- start start 2023-11-28T11:58:07.356 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.348+0000 7f6ff9508700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fdc004870 0x7f6ff40c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:07.356 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.348+0000 7f6ff9508700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ff40b1b30 0x7f6ff409bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:07.356 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.348+0000 7f6ff9508700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ff40cf530 0x7f6ff40c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:07.356 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.348+0000 7f6ff9508700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff40d38f0 con 0x7f6ff40cf530 2023-11-28T11:58:07.356 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.348+0000 7f6ff9508700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff40ce800 con 0x7f6ff40b1b30 2023-11-28T11:58:07.356 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.348+0000 7f6ff9508700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff40cf0a0 con 0x7f6fdc004870 2023-11-28T11:58:07.357 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.352+0000 7f6ff8d07700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ff40cf530 0x7f6ff40c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:07.357 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.352+0000 7f6ff8d07700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ff40cf530 0x7f6ff40c6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53898/0 (socket says 172.21.15.39:53898) 2023-11-28T11:58:07.357 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.352+0000 7f6ff8d07700 1 -- 172.21.15.39:0/4144455331 learned_addr learned my addr 172.21.15.39:0/4144455331 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:07.358 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.352+0000 7f6ff3fff700 1 --2- 172.21.15.39:0/4144455331 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fdc004870 0x7f6ff40c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:07.358 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.352+0000 7f6ff37fe700 1 --2- 172.21.15.39:0/4144455331 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ff40b1b30 0x7f6ff409bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:07.358 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.352+0000 7f6ff8d07700 1 -- 172.21.15.39:0/4144455331 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fdc004870 msgr2=0x7f6ff40c8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:07.358 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.352+0000 7f6ff8d07700 1 --2- 172.21.15.39:0/4144455331 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fdc004870 0x7f6ff40c8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:07.358 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.352+0000 7f6ff8d07700 1 -- 172.21.15.39:0/4144455331 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ff40b1b30 msgr2=0x7f6ff409bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:07.358 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.352+0000 7f6ff8d07700 1 --2- 172.21.15.39:0/4144455331 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ff40b1b30 0x7f6ff409bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:07.359 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.352+0000 7f6ff8d07700 1 -- 172.21.15.39:0/4144455331 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff4072010 con 0x7f6ff40cf530 2023-11-28T11:58:07.359 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.352+0000 7f6ff37fe700 1 --2- 172.21.15.39:0/4144455331 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ff40b1b30 0x7f6ff409bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:58:07.359 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.352+0000 7f6ff8d07700 1 --2- 172.21.15.39:0/4144455331 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ff40cf530 0x7f6ff40c6ad0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6ff406b3c0 tx=0x7f6fec00f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:07.359 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.352+0000 7f6ff0ff9700 1 -- 172.21.15.39:0/4144455331 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec01c070 con 0x7f6ff40cf530 2023-11-28T11:58:07.359 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.352+0000 7f6ff0ff9700 1 -- 172.21.15.39:0/4144455331 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fec00f040 con 0x7f6ff40cf530 2023-11-28T11:58:07.359 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.352+0000 7f6ff9508700 1 -- 172.21.15.39:0/4144455331 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ff415ca10 con 0x7f6ff40cf530 2023-11-28T11:58:07.359 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.352+0000 7f6ff0ff9700 1 -- 172.21.15.39:0/4144455331 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec00e040 con 0x7f6ff40cf530 2023-11-28T11:58:07.359 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.352+0000 7f6ff9508700 1 -- 172.21.15.39:0/4144455331 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff406c830 con 0x7f6ff40cf530 2023-11-28T11:58:07.360 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.356+0000 7f6ff9508700 1 -- 172.21.15.39:0/4144455331 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ff4073cb0 con 0x7f6ff40cf530 2023-11-28T11:58:07.362 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.356+0000 7f6ff0ff9700 1 -- 172.21.15.39:0/4144455331 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6fec015430 con 0x7f6ff40cf530 2023-11-28T11:58:07.363 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.356+0000 7f6ff0ff9700 1 --2- 172.21.15.39:0/4144455331 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6fe0064f10 0x7f6fe00673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:07.364 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.356+0000 7f6ff0ff9700 1 -- 172.21.15.39:0/4144455331 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6fec081f80 con 0x7f6ff40cf530 2023-11-28T11:58:07.364 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.360+0000 7f6ff3fff700 1 --2- 172.21.15.39:0/4144455331 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6fe0064f10 0x7f6fe00673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:07.365 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.360+0000 7f6ff3fff700 1 --2- 172.21.15.39:0/4144455331 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6fe0064f10 0x7f6fe00673c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6ff404f8c0 tx=0x7f6fe4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:07.371 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.364+0000 7f6ff0ff9700 1 -- 172.21.15.39:0/4144455331 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6fec04fe90 con 0x7f6ff40cf530 2023-11-28T11:58:07.542 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.536+0000 7f6ff9508700 1 -- 172.21.15.39:0/4144455331 --> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6ff40cf1e0 con 0x7f6fe0064f10 2023-11-28T11:58:07.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.552+0000 7f6ff0ff9700 1 -- 172.21.15.39:0/4144455331 <== mgr.4104 v2:172.21.15.184:6832/36166 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+298495 (secure 0 0 0) 0x7f6ff40cf1e0 con 0x7f6fe0064f10 2023-11-28T11:58:07.563 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:58:07.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.556+0000 7f6ff9508700 1 -- 172.21.15.39:0/4144455331 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6fe0064f10 msgr2=0x7f6fe00673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:07.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.556+0000 7f6ff9508700 1 --2- 172.21.15.39:0/4144455331 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6fe0064f10 0x7f6fe00673c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6ff404f8c0 tx=0x7f6fe4009040 comp rx=0 tx=0).stop 2023-11-28T11:58:07.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.556+0000 7f6ff9508700 1 -- 172.21.15.39:0/4144455331 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ff40cf530 msgr2=0x7f6ff40c6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:07.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.556+0000 7f6ff9508700 1 --2- 172.21.15.39:0/4144455331 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ff40cf530 0x7f6ff40c6ad0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6ff406b3c0 tx=0x7f6fec00f490 comp rx=0 tx=0).stop 2023-11-28T11:58:07.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.556+0000 7f6ff9508700 1 -- 172.21.15.39:0/4144455331 shutdown_connections 2023-11-28T11:58:07.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.556+0000 7f6ff9508700 1 --2- 172.21.15.39:0/4144455331 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ff40cf530 0x7f6ff40c6ad0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:07.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.556+0000 7f6ff9508700 1 --2- 172.21.15.39:0/4144455331 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6fe0064f10 0x7f6fe00673c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:07.567 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.556+0000 7f6ff9508700 1 --2- 172.21.15.39:0/4144455331 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ff40b1b30 0x7f6ff409bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:07.567 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.556+0000 7f6ff9508700 1 --2- 172.21.15.39:0/4144455331 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fdc004870 0x7f6ff40c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:07.567 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.560+0000 7f6ff9508700 1 -- 172.21.15.39:0/4144455331 >> 172.21.15.39:0/4144455331 conn(0x7f6ff40b6520 msgr2=0x7f6ff40b2890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:07.567 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.560+0000 7f6ff9508700 1 -- 172.21.15.39:0/4144455331 shutdown_connections 2023-11-28T11:58:07.567 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.560+0000 7f6ff9508700 1 -- 172.21.15.39:0/4144455331 wait complete. 2023-11-28T11:58:07.567 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2023-11-28T11:58:07.588 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2023-11-28T11:58:06.580529+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591938,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":178,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":72,"acting":72,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":43,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":70796,"kb_used_data":4812,"kb_used_omap":0,"kb_used_meta":65920,"kb_avail":754903924,"statfs":{"total":773094113280,"available":773021618176,"internally_reserved":0,"allocated":4927488,"data_stored":2803118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":67502080},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1570,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.828745"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416453+0000","last_change":"2023-11-28T11:58:03.280494+0000","last_active":"2023-11-28T11:58:05.416453+0000","last_peered":"2023-11-28T11:58:05.416453+0000","last_clean":"2023-11-28T11:58:05.416453+0000","last_became_active":"2023-11-28T11:58:03.273934+0000","last_became_peered":"2023-11-28T11:58:03.273934+0000","last_unstale":"2023-11-28T11:58:05.416453+0000","last_undegraded":"2023-11-28T11:58:05.416453+0000","last_fullsized":"2023-11-28T11:58:05.416453+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:56:29.140993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.415739+0000","last_change":"2023-11-28T11:58:03.278569+0000","last_active":"2023-11-28T11:58:05.415739+0000","last_peered":"2023-11-28T11:58:05.415739+0000","last_clean":"2023-11-28T11:58:05.415739+0000","last_became_active":"2023-11-28T11:58:03.278191+0000","last_became_peered":"2023-11-28T11:58:03.278191+0000","last_unstale":"2023-11-28T11:58:05.415739+0000","last_undegraded":"2023-11-28T11:58:05.415739+0000","last_fullsized":"2023-11-28T11:58:05.415739+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:14.419715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416724+0000","last_change":"2023-11-28T11:58:03.265015+0000","last_active":"2023-11-28T11:58:05.416724+0000","last_peered":"2023-11-28T11:58:05.416724+0000","last_clean":"2023-11-28T11:58:05.416724+0000","last_became_active":"2023-11-28T11:58:03.264639+0000","last_became_peered":"2023-11-28T11:58:03.264639+0000","last_unstale":"2023-11-28T11:58:05.416724+0000","last_undegraded":"2023-11-28T11:58:05.416724+0000","last_fullsized":"2023-11-28T11:58:05.416724+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:16:51.122441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416633+0000","last_change":"2023-11-28T11:58:03.283239+0000","last_active":"2023-11-28T11:58:05.416633+0000","last_peered":"2023-11-28T11:58:05.416633+0000","last_clean":"2023-11-28T11:58:05.416633+0000","last_became_active":"2023-11-28T11:58:03.280251+0000","last_became_peered":"2023-11-28T11:58:03.280251+0000","last_unstale":"2023-11-28T11:58:05.416633+0000","last_undegraded":"2023-11-28T11:58:05.416633+0000","last_fullsized":"2023-11-28T11:58:05.416633+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:36:30.647196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416432+0000","last_change":"2023-11-28T11:58:03.258812+0000","last_active":"2023-11-28T11:58:05.416432+0000","last_peered":"2023-11-28T11:58:05.416432+0000","last_clean":"2023-11-28T11:58:05.416432+0000","last_became_active":"2023-11-28T11:58:03.258368+0000","last_became_peered":"2023-11-28T11:58:03.258368+0000","last_unstale":"2023-11-28T11:58:05.416432+0000","last_undegraded":"2023-11-28T11:58:05.416432+0000","last_fullsized":"2023-11-28T11:58:05.416432+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:18:48.890788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.246940+0000","last_change":"2023-11-28T11:58:03.263075+0000","last_active":"2023-11-28T11:58:04.246940+0000","last_peered":"2023-11-28T11:58:04.246940+0000","last_clean":"2023-11-28T11:58:04.246940+0000","last_became_active":"2023-11-28T11:58:03.262800+0000","last_became_peered":"2023-11-28T11:58:03.262800+0000","last_unstale":"2023-11-28T11:58:04.246940+0000","last_undegraded":"2023-11-28T11:58:04.246940+0000","last_fullsized":"2023-11-28T11:58:04.246940+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:36:07.713099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.415805+0000","last_change":"2023-11-28T11:58:03.265606+0000","last_active":"2023-11-28T11:58:05.415805+0000","last_peered":"2023-11-28T11:58:05.415805+0000","last_clean":"2023-11-28T11:58:05.415805+0000","last_became_active":"2023-11-28T11:58:03.265347+0000","last_became_peered":"2023-11-28T11:58:03.265347+0000","last_unstale":"2023-11-28T11:58:05.415805+0000","last_undegraded":"2023-11-28T11:58:05.415805+0000","last_fullsized":"2023-11-28T11:58:05.415805+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:17:11.155874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.247370+0000","last_change":"2023-11-28T11:58:03.261719+0000","last_active":"2023-11-28T11:58:04.247370+0000","last_peered":"2023-11-28T11:58:04.247370+0000","last_clean":"2023-11-28T11:58:04.247370+0000","last_became_active":"2023-11-28T11:58:03.261481+0000","last_became_peered":"2023-11-28T11:58:03.261481+0000","last_unstale":"2023-11-28T11:58:04.247370+0000","last_undegraded":"2023-11-28T11:58:04.247370+0000","last_fullsized":"2023-11-28T11:58:04.247370+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:49:56.935045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.415975+0000","last_change":"2023-11-28T11:58:03.280229+0000","last_active":"2023-11-28T11:58:05.415975+0000","last_peered":"2023-11-28T11:58:05.415975+0000","last_clean":"2023-11-28T11:58:05.415975+0000","last_became_active":"2023-11-28T11:58:03.274838+0000","last_became_peered":"2023-11-28T11:58:03.274838+0000","last_unstale":"2023-11-28T11:58:05.415975+0000","last_undegraded":"2023-11-28T11:58:05.415975+0000","last_fullsized":"2023-11-28T11:58:05.415975+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:54:40.637592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.248044+0000","last_change":"2023-11-28T11:58:03.263235+0000","last_active":"2023-11-28T11:58:04.248044+0000","last_peered":"2023-11-28T11:58:04.248044+0000","last_clean":"2023-11-28T11:58:04.248044+0000","last_became_active":"2023-11-28T11:58:03.262984+0000","last_became_peered":"2023-11-28T11:58:03.262984+0000","last_unstale":"2023-11-28T11:58:04.248044+0000","last_undegraded":"2023-11-28T11:58:04.248044+0000","last_fullsized":"2023-11-28T11:58:04.248044+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:25:52.304471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.246306+0000","last_change":"2023-11-28T11:58:03.254255+0000","last_active":"2023-11-28T11:58:04.246306+0000","last_peered":"2023-11-28T11:58:04.246306+0000","last_clean":"2023-11-28T11:58:04.246306+0000","last_became_active":"2023-11-28T11:58:03.253952+0000","last_became_peered":"2023-11-28T11:58:03.253952+0000","last_unstale":"2023-11-28T11:58:04.246306+0000","last_undegraded":"2023-11-28T11:58:04.246306+0000","last_fullsized":"2023-11-28T11:58:04.246306+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:16:15.666991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416165+0000","last_change":"2023-11-28T11:58:03.258600+0000","last_active":"2023-11-28T11:58:05.416165+0000","last_peered":"2023-11-28T11:58:05.416165+0000","last_clean":"2023-11-28T11:58:05.416165+0000","last_became_active":"2023-11-28T11:58:03.258321+0000","last_became_peered":"2023-11-28T11:58:03.258321+0000","last_unstale":"2023-11-28T11:58:05.416165+0000","last_undegraded":"2023-11-28T11:58:05.416165+0000","last_fullsized":"2023-11-28T11:58:05.416165+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:44:36.459418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.415894+0000","last_change":"2023-11-28T11:58:03.283663+0000","last_active":"2023-11-28T11:58:05.415894+0000","last_peered":"2023-11-28T11:58:05.415894+0000","last_clean":"2023-11-28T11:58:05.415894+0000","last_became_active":"2023-11-28T11:58:03.274952+0000","last_became_peered":"2023-11-28T11:58:03.274952+0000","last_unstale":"2023-11-28T11:58:05.415894+0000","last_undegraded":"2023-11-28T11:58:05.415894+0000","last_fullsized":"2023-11-28T11:58:05.415894+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:01.925469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.415904+0000","last_change":"2023-11-28T11:58:02.785023+0000","last_active":"2023-11-28T11:58:05.415904+0000","last_peered":"2023-11-28T11:58:05.415904+0000","last_clean":"2023-11-28T11:58:05.415904+0000","last_became_active":"2023-11-28T11:58:02.784685+0000","last_became_peered":"2023-11-28T11:58:02.784685+0000","last_unstale":"2023-11-28T11:58:05.415904+0000","last_undegraded":"2023-11-28T11:58:05.415904+0000","last_fullsized":"2023-11-28T11:58:05.415904+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:27:27.811854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416772+0000","last_change":"2023-11-28T11:58:02.778715+0000","last_active":"2023-11-28T11:58:05.416772+0000","last_peered":"2023-11-28T11:58:05.416772+0000","last_clean":"2023-11-28T11:58:05.416772+0000","last_became_active":"2023-11-28T11:58:02.778424+0000","last_became_peered":"2023-11-28T11:58:02.778424+0000","last_unstale":"2023-11-28T11:58:05.416772+0000","last_undegraded":"2023-11-28T11:58:05.416772+0000","last_fullsized":"2023-11-28T11:58:05.416772+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:49:55.927853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"43'6","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.247491+0000","last_change":"2023-11-28T11:58:02.790035+0000","last_active":"2023-11-28T11:58:04.247491+0000","last_peered":"2023-11-28T11:58:04.247491+0000","last_clean":"2023-11-28T11:58:04.247491+0000","last_became_active":"2023-11-28T11:58:02.789147+0000","last_became_peered":"2023-11-28T11:58:02.789147+0000","last_unstale":"2023-11-28T11:58:04.247491+0000","last_undegraded":"2023-11-28T11:58:04.247491+0000","last_fullsized":"2023-11-28T11:58:04.247491+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:00:29.713180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416136+0000","last_change":"2023-11-28T11:58:03.265205+0000","last_active":"2023-11-28T11:58:05.416136+0000","last_peered":"2023-11-28T11:58:05.416136+0000","last_clean":"2023-11-28T11:58:05.416136+0000","last_became_active":"2023-11-28T11:58:03.264925+0000","last_became_peered":"2023-11-28T11:58:03.264925+0000","last_unstale":"2023-11-28T11:58:05.416136+0000","last_undegraded":"2023-11-28T11:58:05.416136+0000","last_fullsized":"2023-11-28T11:58:05.416136+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:20:28.291253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":19,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416125+0000","last_change":"2023-11-28T11:58:02.781485+0000","last_active":"2023-11-28T11:58:05.416125+0000","last_peered":"2023-11-28T11:58:05.416125+0000","last_clean":"2023-11-28T11:58:05.416125+0000","last_became_active":"2023-11-28T11:58:02.781225+0000","last_became_peered":"2023-11-28T11:58:02.781225+0000","last_unstale":"2023-11-28T11:58:05.416125+0000","last_undegraded":"2023-11-28T11:58:05.416125+0000","last_fullsized":"2023-11-28T11:58:05.416125+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:20:16.975860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.248464+0000","last_change":"2023-11-28T11:58:03.264759+0000","last_active":"2023-11-28T11:58:04.248464+0000","last_peered":"2023-11-28T11:58:04.248464+0000","last_clean":"2023-11-28T11:58:04.248464+0000","last_became_active":"2023-11-28T11:58:03.264511+0000","last_became_peered":"2023-11-28T11:58:03.264511+0000","last_unstale":"2023-11-28T11:58:04.248464+0000","last_undegraded":"2023-11-28T11:58:04.248464+0000","last_fullsized":"2023-11-28T11:58:04.248464+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:23.241400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"43'1","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.248774+0000","last_change":"2023-11-28T11:58:02.793922+0000","last_active":"2023-11-28T11:58:04.248774+0000","last_peered":"2023-11-28T11:58:04.248774+0000","last_clean":"2023-11-28T11:58:04.248774+0000","last_became_active":"2023-11-28T11:58:02.793596+0000","last_became_peered":"2023-11-28T11:58:02.793596+0000","last_unstale":"2023-11-28T11:58:04.248774+0000","last_undegraded":"2023-11-28T11:58:04.248774+0000","last_fullsized":"2023-11-28T11:58:04.248774+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:37:39.758646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416752+0000","last_change":"2023-11-28T11:58:03.263669+0000","last_active":"2023-11-28T11:58:05.416752+0000","last_peered":"2023-11-28T11:58:05.416752+0000","last_clean":"2023-11-28T11:58:05.416752+0000","last_became_active":"2023-11-28T11:58:03.263392+0000","last_became_peered":"2023-11-28T11:58:03.263392+0000","last_unstale":"2023-11-28T11:58:05.416752+0000","last_undegraded":"2023-11-28T11:58:05.416752+0000","last_fullsized":"2023-11-28T11:58:05.416752+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:14.962568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.246458+0000","last_change":"2023-11-28T11:58:03.255596+0000","last_active":"2023-11-28T11:58:04.246458+0000","last_peered":"2023-11-28T11:58:04.246458+0000","last_clean":"2023-11-28T11:58:04.246458+0000","last_became_active":"2023-11-28T11:58:03.255252+0000","last_became_peered":"2023-11-28T11:58:03.255252+0000","last_unstale":"2023-11-28T11:58:04.246458+0000","last_undegraded":"2023-11-28T11:58:04.246458+0000","last_fullsized":"2023-11-28T11:58:04.246458+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:20:17.983052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.415840+0000","last_change":"2023-11-28T11:58:02.779450+0000","last_active":"2023-11-28T11:58:05.415840+0000","last_peered":"2023-11-28T11:58:05.415840+0000","last_clean":"2023-11-28T11:58:05.415840+0000","last_became_active":"2023-11-28T11:58:02.779163+0000","last_became_peered":"2023-11-28T11:58:02.779163+0000","last_unstale":"2023-11-28T11:58:05.415840+0000","last_undegraded":"2023-11-28T11:58:05.415840+0000","last_fullsized":"2023-11-28T11:58:05.415840+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:01:36.211187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.415831+0000","last_change":"2023-11-28T11:58:03.260258+0000","last_active":"2023-11-28T11:58:05.415831+0000","last_peered":"2023-11-28T11:58:05.415831+0000","last_clean":"2023-11-28T11:58:05.415831+0000","last_became_active":"2023-11-28T11:58:03.259933+0000","last_became_peered":"2023-11-28T11:58:03.259933+0000","last_unstale":"2023-11-28T11:58:05.415831+0000","last_undegraded":"2023-11-28T11:58:05.415831+0000","last_fullsized":"2023-11-28T11:58:05.415831+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:14:43.182788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:57:54.978701+0000","last_change":"2023-11-28T11:56:34.384408+0000","last_active":"2023-11-28T11:57:54.978701+0000","last_peered":"2023-11-28T11:57:54.978701+0000","last_clean":"2023-11-28T11:57:54.978701+0000","last_became_active":"2023-11-28T11:56:34.384036+0000","last_became_peered":"2023-11-28T11:56:34.384036+0000","last_unstale":"2023-11-28T11:57:54.978701+0000","last_undegraded":"2023-11-28T11:57:54.978701+0000","last_fullsized":"2023-11-28T11:57:54.978701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:58:55.003786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:57:55.150723+0000","last_change":"2023-11-28T11:56:34.384088+0000","last_active":"2023-11-28T11:57:55.150723+0000","last_peered":"2023-11-28T11:57:55.150723+0000","last_clean":"2023-11-28T11:57:55.150723+0000","last_became_active":"2023-11-28T11:56:34.383631+0000","last_became_peered":"2023-11-28T11:56:34.383631+0000","last_unstale":"2023-11-28T11:57:55.150723+0000","last_undegraded":"2023-11-28T11:57:55.150723+0000","last_fullsized":"2023-11-28T11:57:55.150723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:15:42.772333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:57:54.979933+0000","last_change":"2023-11-28T11:56:34.386399+0000","last_active":"2023-11-28T11:57:54.979933+0000","last_peered":"2023-11-28T11:57:54.979933+0000","last_clean":"2023-11-28T11:57:54.979933+0000","last_became_active":"2023-11-28T11:56:34.385994+0000","last_became_peered":"2023-11-28T11:56:34.385994+0000","last_unstale":"2023-11-28T11:57:54.979933+0000","last_undegraded":"2023-11-28T11:57:54.979933+0000","last_fullsized":"2023-11-28T11:57:54.979933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:58:02.172295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416119+0000","last_change":"2023-11-28T11:58:02.794762+0000","last_active":"2023-11-28T11:58:05.416119+0000","last_peered":"2023-11-28T11:58:05.416119+0000","last_clean":"2023-11-28T11:58:05.416119+0000","last_became_active":"2023-11-28T11:58:02.794411+0000","last_became_peered":"2023-11-28T11:58:02.794411+0000","last_unstale":"2023-11-28T11:58:05.416119+0000","last_undegraded":"2023-11-28T11:58:05.416119+0000","last_fullsized":"2023-11-28T11:58:05.416119+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:22.234208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:57:55.150466+0000","last_change":"2023-11-28T11:56:34.384999+0000","last_active":"2023-11-28T11:57:55.150466+0000","last_peered":"2023-11-28T11:57:55.150466+0000","last_clean":"2023-11-28T11:57:55.150466+0000","last_became_active":"2023-11-28T11:56:34.384531+0000","last_became_peered":"2023-11-28T11:56:34.384531+0000","last_unstale":"2023-11-28T11:57:55.150466+0000","last_undegraded":"2023-11-28T11:57:55.150466+0000","last_fullsized":"2023-11-28T11:57:55.150466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:09:50.083366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:57:55.152211+0000","last_change":"2023-11-28T11:56:34.389076+0000","last_active":"2023-11-28T11:57:55.152211+0000","last_peered":"2023-11-28T11:57:55.152211+0000","last_clean":"2023-11-28T11:57:55.152211+0000","last_became_active":"2023-11-28T11:56:34.388689+0000","last_became_peered":"2023-11-28T11:56:34.388689+0000","last_unstale":"2023-11-28T11:57:55.152211+0000","last_undegraded":"2023-11-28T11:57:55.152211+0000","last_fullsized":"2023-11-28T11:57:55.152211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:20.936349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416316+0000","last_change":"2023-11-28T11:58:03.263283+0000","last_active":"2023-11-28T11:58:05.416316+0000","last_peered":"2023-11-28T11:58:05.416316+0000","last_clean":"2023-11-28T11:58:05.416316+0000","last_became_active":"2023-11-28T11:58:03.263034+0000","last_became_peered":"2023-11-28T11:58:03.263034+0000","last_unstale":"2023-11-28T11:58:05.416316+0000","last_undegraded":"2023-11-28T11:58:05.416316+0000","last_fullsized":"2023-11-28T11:58:05.416316+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:16:55.873337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T11:58:03.243608+0000","last_change":"2023-11-28T11:56:34.486178+0000","last_active":"2023-11-28T11:58:03.243608+0000","last_peered":"2023-11-28T11:58:03.243608+0000","last_clean":"2023-11-28T11:58:03.243608+0000","last_became_active":"2023-11-28T11:56:34.485702+0000","last_became_peered":"2023-11-28T11:56:34.485702+0000","last_unstale":"2023-11-28T11:58:03.243608+0000","last_undegraded":"2023-11-28T11:58:03.243608+0000","last_fullsized":"2023-11-28T11:58:03.243608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:06.323407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:57:54.979876+0000","last_change":"2023-11-28T11:56:34.387293+0000","last_active":"2023-11-28T11:57:54.979876+0000","last_peered":"2023-11-28T11:57:54.979876+0000","last_clean":"2023-11-28T11:57:54.979876+0000","last_became_active":"2023-11-28T11:56:34.386976+0000","last_became_peered":"2023-11-28T11:56:34.386976+0000","last_unstale":"2023-11-28T11:57:54.979876+0000","last_undegraded":"2023-11-28T11:57:54.979876+0000","last_fullsized":"2023-11-28T11:57:54.979876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:32.704729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416761+0000","last_change":"2023-11-28T11:58:03.262028+0000","last_active":"2023-11-28T11:58:05.416761+0000","last_peered":"2023-11-28T11:58:05.416761+0000","last_clean":"2023-11-28T11:58:05.416761+0000","last_became_active":"2023-11-28T11:58:03.261783+0000","last_became_peered":"2023-11-28T11:58:03.261783+0000","last_unstale":"2023-11-28T11:58:05.416761+0000","last_undegraded":"2023-11-28T11:58:05.416761+0000","last_fullsized":"2023-11-28T11:58:05.416761+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:33:57.968180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:57:55.152159+0000","last_change":"2023-11-28T11:56:34.389222+0000","last_active":"2023-11-28T11:57:55.152159+0000","last_peered":"2023-11-28T11:57:55.152159+0000","last_clean":"2023-11-28T11:57:55.152159+0000","last_became_active":"2023-11-28T11:56:34.388671+0000","last_became_peered":"2023-11-28T11:56:34.388671+0000","last_unstale":"2023-11-28T11:57:55.152159+0000","last_undegraded":"2023-11-28T11:57:55.152159+0000","last_fullsized":"2023-11-28T11:57:55.152159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:32.704729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:57:54.979966+0000","last_change":"2023-11-28T11:56:28.472008+0000","last_active":"2023-11-28T11:57:54.979966+0000","last_peered":"2023-11-28T11:57:54.979966+0000","last_clean":"2023-11-28T11:57:54.979966+0000","last_became_active":"2023-11-28T11:56:28.469273+0000","last_became_peered":"2023-11-28T11:56:28.469273+0000","last_unstale":"2023-11-28T11:57:54.979966+0000","last_undegraded":"2023-11-28T11:57:54.979966+0000","last_fullsized":"2023-11-28T11:57:54.979966+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:27.291192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:27.291192+0000","last_clean_scrub_stamp":"2023-11-28T11:56:27.291192+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:14:48.860420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":40,"acting":40,"num_store_stats":2},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1570,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":14,"acting":14,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509462,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9672,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362168,"statfs":{"total":96636764160,"available":96626860032,"internally_reserved":0,"allocated":1048576,"data_stored":786989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.88600000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.052}]},{"osd":2,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.85999999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.6000000000000001,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.117},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.1759999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.0489999999999999,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":0.98399999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":2.4710000000000001,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.081},{"interface":"front","average":{"1min":1.411,"5min":1.411,"15min":1.411},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":1.1379999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.575,"15min":1.575},"min":{"1min":1.266,"5min":1.266,"15min":1.266},"max":{"1min":2.4319999999999999,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.224},{"interface":"front","average":{"1min":1.47,"5min":1.47,"15min":1.47},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":2.468,"5min":2.468,"15min":2.468},"last":1.1930000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509462,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8452,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363388,"statfs":{"total":96636764160,"available":96628109312,"internally_reserved":0,"allocated":454656,"data_stored":196621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.347,"5min":2.347,"15min":2.347},"last":0.75600000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.93500000000000005}]},{"osd":2,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":3.9620000000000002,"5min":3.9620000000000002,"15min":3.9620000000000002},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.91300000000000003}]},{"osd":3,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.081},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":2.0790000000000002,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.109}]},{"osd":4,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.89400000000000002}]},{"osd":5,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":1.4339999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.306}]}]},{"osd":5,"up_from":15,"seq":64424509462,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8452,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363388,"statfs":{"total":96636764160,"available":96628109312,"internally_reserved":0,"allocated":454656,"data_stored":196621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.552}]},{"osd":1,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":1.72},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.3}]},{"osd":2,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":1.595}]},{"osd":3,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.085},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.2490000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.1950000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.28,"15min":1.28},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.355},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":1.0289999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":1.012,"5min":1.012,"15min":1.012},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.335},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.5109999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":8644,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363196,"statfs":{"total":96636764160,"available":96627912704,"internally_reserved":0,"allocated":454656,"data_stored":196621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.167},{"interface":"front","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.397}]},{"osd":1,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.8860000000000001,"5min":2.8860000000000001,"15min":2.8860000000000001},"last":0.59399999999999997}]},{"osd":2,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.3500000000000001,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":3.0630000000000002,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":1.0720000000000001}]},{"osd":3,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.252}]},{"osd":5,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":2.972,"5min":2.972,"15min":2.972},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.4470000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.3500000000000001,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.569,"5min":1.569,"15min":1.569},"min":{"1min":1.038,"5min":1.038,"15min":1.038},"max":{"1min":3.133,"5min":3.133,"15min":3.133},"last":1}]},{"osd":7,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.548,"5min":1.548,"15min":1.548},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":2.2679999999999998,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.492},{"interface":"front","average":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"min":{"1min":1.21,"5min":1.21,"15min":1.21},"max":{"1min":2.198,"5min":2.198,"15min":2.198},"last":1.355}]}]},{"osd":3,"up_from":15,"seq":64424509462,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8580,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363260,"statfs":{"total":96636764160,"available":96627978240,"internally_reserved":0,"allocated":454656,"data_stored":196621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":2.177,"5min":2.177,"15min":2.177},"last":1.248}]},{"osd":1,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.087},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.96999999999999997}]},{"osd":2,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.872},{"interface":"front","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":1.054}]},{"osd":4,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":2.8439999999999999,"5min":2.8439999999999999,"15min":2.8439999999999999},"last":1.29}]},{"osd":5,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.9670000000000001,"5min":2.9670000000000001,"15min":2.9670000000000001},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":3.7429999999999999,"5min":3.7429999999999999,"15min":3.7429999999999999},"last":1.131}]},{"osd":6,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.927,"5min":2.927,"15min":2.927},"last":1.3680000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":3.5030000000000001,"5min":3.5030000000000001,"15min":3.5030000000000001},"last":1.181},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.6320000000000001,"5min":2.6320000000000001,"15min":2.6320000000000001},"last":1.3360000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509462,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8516,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363324,"statfs":{"total":96636764160,"available":96628043776,"internally_reserved":0,"allocated":454656,"data_stored":196621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":2.7469999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":1.0600000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.73599999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.85699999999999998}]},{"osd":4,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":3.411,"5min":3.411,"15min":3.411},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.6680000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":1.208}]},{"osd":5,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":3.6869999999999998,"5min":3.6869999999999998,"15min":3.6869999999999998},"last":1.292},{"interface":"front","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.0609999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.127}]},{"osd":6,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"min":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":3.5379999999999998,"5min":3.5379999999999998,"15min":3.5379999999999998},"last":1.242},{"interface":"front","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.5739999999999998,"5min":2.5739999999999998,"15min":2.5739999999999998},"last":1.2549999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.4249999999999998,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.3200000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542167,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8644,"kb_used_data":508,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363196,"statfs":{"total":96636764160,"available":96627912704,"internally_reserved":0,"allocated":520192,"data_stored":226042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.0860000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.754,"5min":1.754,"15min":1.754},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.66600000000000004}]},{"osd":3,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":1.01},{"interface":"front","average":{"1min":1.3,"5min":1.3,"15min":1.3},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.617,"5min":2.617,"15min":2.617},"last":1.129}]},{"osd":4,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.9620000000000002,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.3860000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":1.3740000000000001}]},{"osd":5,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":2.738,"5min":2.738,"15min":2.738},"last":1.623},{"interface":"front","average":{"1min":1.575,"5min":1.575,"15min":1.575},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":4.0309999999999997,"5min":4.0309999999999997,"15min":4.0309999999999997},"last":1.3100000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":4.2240000000000002,"5min":4.2240000000000002,"15min":4.2240000000000002},"last":1.5720000000000001},{"interface":"front","average":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":3.0750000000000002,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":1.3460000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":2.3660000000000001,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.476},{"interface":"front","average":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":4.3570000000000002,"5min":4.3570000000000002,"15min":4.3570000000000002},"last":1.6719999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542167,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9836,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362004,"statfs":{"total":96636764160,"available":96626692096,"internally_reserved":0,"allocated":1085440,"data_stored":806982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":1.002},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.68000000000000005}]},{"osd":2,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.73499999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.0720000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":3.4809999999999999,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":3.1629999999999998,"5min":3.1629999999999998,"15min":3.1629999999999998},"last":1.2909999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.266,"5min":2.266,"15min":2.266},"last":1.1759999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.4060000000000001,"5min":2.4060000000000001,"15min":2.4060000000000001},"last":1.24},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"max":{"1min":2.3599999999999999,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":1.212}]},{"osd":7,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":2.3330000000000002,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.583,"5min":1.583,"15min":1.583},"min":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"max":{"1min":2.6040000000000001,"5min":2.6040000000000001,"15min":2.6040000000000001},"last":1.2629999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:58:07.594 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:58:07.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.800+0000 7f098aa74700 1 Processor -- start 2023-11-28T11:58:07.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.800+0000 7f098aa74700 1 -- start start 2023-11-28T11:58:07.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.804+0000 7f098aa74700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f0984070790 0x7f0984167110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:07.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.804+0000 7f098aa74700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09840adf90 con 0x7f09840cdeb0 2023-11-28T11:58:07.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.804+0000 7f098aa74700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09840ce370 con 0x7f098415c1a0 2023-11-28T11:58:07.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.804+0000 7f098aa74700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0984069bf0 con 0x7f0984070790 2023-11-28T11:58:07.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.804+0000 7f0989271700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f09840cdeb0 0x7f0984070080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:49484/0 (socket says 172.21.15.39:49484) 2023-11-28T11:58:07.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.804+0000 7f0989271700 1 -- 172.21.15.39:0/235867949 learned_addr learned my addr 172.21.15.39:0/235867949 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:58:07.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.804+0000 7f098a273700 1 --2- 172.21.15.39:0/235867949 >> v2:172.21.15.184:3300/0 conn(0x7f0984070790 0x7f0984167110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:07.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.804+0000 7f0988a70700 1 -- 172.21.15.39:0/235867949 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1228055928 0 0) 0x7f09840adf90 con 0x7f09840cdeb0 2023-11-28T11:58:07.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.804+0000 7f0988a70700 1 -- 172.21.15.39:0/235867949 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09700035d0 con 0x7f09840cdeb0 2023-11-28T11:58:07.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.804+0000 7f0988a70700 1 -- 172.21.15.39:0/235867949 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2939745112 0 0) 0x7f09840ce370 con 0x7f098415c1a0 2023-11-28T11:58:07.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.804+0000 7f0988a70700 1 -- 172.21.15.39:0/235867949 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09840adf90 con 0x7f098415c1a0 2023-11-28T11:58:07.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.804+0000 7f0988a70700 1 -- 172.21.15.39:0/235867949 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2939608989 0 0) 0x7f09700035d0 con 0x7f09840cdeb0 2023-11-28T11:58:07.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.804+0000 7f0988a70700 1 -- 172.21.15.39:0/235867949 >> v2:172.21.15.184:3300/0 conn(0x7f0984070790 msgr2=0x7f0984167110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:07.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.804+0000 7f0988a70700 1 --2- 172.21.15.39:0/235867949 >> v2:172.21.15.184:3300/0 conn(0x7f0984070790 0x7f0984167110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:07.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.804+0000 7f0988a70700 1 -- 172.21.15.39:0/235867949 >> v1:172.21.15.184:6789/0 conn(0x7f098415c1a0 legacy=0x7f098406c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:07.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.804+0000 7f0988a70700 1 -- 172.21.15.39:0/235867949 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09840cc4a0 con 0x7f09840cdeb0 2023-11-28T11:58:07.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.804+0000 7f0988a70700 1 -- 172.21.15.39:0/235867949 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4013383302 0 0) 0x7f0978001670 con 0x7f09840cdeb0 2023-11-28T11:58:07.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.804+0000 7f098a273700 1 --2- 172.21.15.39:0/235867949 >> v2:172.21.15.184:3300/0 conn(0x7f0984070790 0x7f0984167110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:58:07.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.804+0000 7f0988a70700 1 -- 172.21.15.39:0/235867949 >> v1:172.21.15.39:6789/0 conn(0x7f09840cdeb0 legacy=0x7f0984070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:07.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.804+0000 7f0988a70700 1 --2- 172.21.15.39:0/235867949 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0970003bb0 0x7f0970003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:07.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.804+0000 7f0988a70700 1 --2- 172.21.15.39:0/235867949 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0970004870 0x7f0970004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:07.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.804+0000 7f0988a70700 1 --2- 172.21.15.39:0/235867949 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0970005220 0x7f097000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:07.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.804+0000 7f0988a70700 1 -- 172.21.15.39:0/235867949 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0984069bf0 con 0x7f0970003bb0 2023-11-28T11:58:07.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.804+0000 7f0988a70700 1 -- 172.21.15.39:0/235867949 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097000c130 con 0x7f0970004870 2023-11-28T11:58:07.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.804+0000 7f0988a70700 1 -- 172.21.15.39:0/235867949 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f097000c2f0 con 0x7f0970005220 2023-11-28T11:58:07.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.804+0000 7f0989a72700 1 --2- 172.21.15.39:0/235867949 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0970003bb0 0x7f0970003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:07.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.808+0000 7f098a273700 1 --2- 172.21.15.39:0/235867949 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0970005220 0x7f097000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:07.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.808+0000 7f0989271700 1 --2- 172.21.15.39:0/235867949 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0970004870 0x7f0970004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:07.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.808+0000 7f0989a72700 1 -- 172.21.15.39:0/235867949 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0970005220 msgr2=0x7f097000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:07.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.808+0000 7f0989a72700 1 --2- 172.21.15.39:0/235867949 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0970005220 0x7f097000ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:07.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.808+0000 7f0989a72700 1 -- 172.21.15.39:0/235867949 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0970004870 msgr2=0x7f0970004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:07.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.808+0000 7f0989a72700 1 --2- 172.21.15.39:0/235867949 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0970004870 0x7f0970004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:07.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.808+0000 7f0989a72700 1 -- 172.21.15.39:0/235867949 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09700035d0 con 0x7f0970003bb0 2023-11-28T11:58:07.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.808+0000 7f0989271700 1 --2- 172.21.15.39:0/235867949 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0970004870 0x7f0970004ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:58:07.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.808+0000 7f098a273700 1 -- 172.21.15.39:0/235867949 reap_dead start 2023-11-28T11:58:07.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.808+0000 7f0989a72700 1 --2- 172.21.15.39:0/235867949 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0970003bb0 0x7f0970003fc0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0980001960 tx=0x7f09700058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fee2e4624878438f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:07.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.808+0000 7f0988a70700 1 -- 172.21.15.39:0/235867949 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0980001450 con 0x7f0970003bb0 2023-11-28T11:58:07.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.808+0000 7f0988a70700 1 -- 172.21.15.39:0/235867949 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09800052d0 con 0x7f0970003bb0 2023-11-28T11:58:07.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.808+0000 7f0988a70700 1 -- 172.21.15.39:0/235867949 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0980001d30 con 0x7f0970003bb0 2023-11-28T11:58:07.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.808+0000 7f098aa74700 1 -- 172.21.15.39:0/235867949 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0970003bb0 msgr2=0x7f0970003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:07.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.808+0000 7f098aa74700 1 --2- 172.21.15.39:0/235867949 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0970003bb0 0x7f0970003fc0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0980001960 tx=0x7f09700058a0 comp rx=0 tx=0).stop 2023-11-28T11:58:07.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.808+0000 7f098aa74700 1 -- 172.21.15.39:0/235867949 shutdown_connections 2023-11-28T11:58:07.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.808+0000 7f098aa74700 1 --2- 172.21.15.39:0/235867949 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0970003bb0 0x7f0970003fc0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:07.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.808+0000 7f098aa74700 1 -- 172.21.15.39:0/235867949 >> 172.21.15.39:0/235867949 conn(0x7f09840b0f80 msgr2=0x7f09840ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:07.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.808+0000 7f098aa74700 1 -- 172.21.15.39:0/235867949 shutdown_connections 2023-11-28T11:58:07.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.808+0000 7f098aa74700 1 -- 172.21.15.39:0/235867949 wait complete. 2023-11-28T11:58:07.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.812+0000 7f098aa74700 1 Processor -- start 2023-11-28T11:58:07.819 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.812+0000 7f098aa74700 1 -- start start 2023-11-28T11:58:07.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.816+0000 7f098aa74700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0970003bb0 0x7f0984155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:07.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.816+0000 7f098aa74700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09841f5d20 0x7f09840c6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:07.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.816+0000 7f098aa74700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f098415f430 0x7f09840b2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:07.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.816+0000 7f098aa74700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09841f61b0 con 0x7f09841f5d20 2023-11-28T11:58:07.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.816+0000 7f098aa74700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098415c7a0 con 0x7f098415f430 2023-11-28T11:58:07.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.816+0000 7f098aa74700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098415ca80 con 0x7f0970003bb0 2023-11-28T11:58:07.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.816+0000 7f0989271700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09841f5d20 0x7f09840c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:07.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.816+0000 7f0989271700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09841f5d20 0x7f09840c6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53912/0 (socket says 172.21.15.39:53912) 2023-11-28T11:58:07.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.816+0000 7f0989271700 1 -- 172.21.15.39:0/141722610 learned_addr learned my addr 172.21.15.39:0/141722610 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:07.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.816+0000 7f0989a72700 1 --2- 172.21.15.39:0/141722610 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0970003bb0 0x7f0984155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:07.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.816+0000 7f098a273700 1 --2- 172.21.15.39:0/141722610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f098415f430 0x7f09840b2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:07.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.816+0000 7f0989271700 1 -- 172.21.15.39:0/141722610 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0970003bb0 msgr2=0x7f0984155bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:07.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.816+0000 7f0989271700 1 --2- 172.21.15.39:0/141722610 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0970003bb0 0x7f0984155bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:07.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.816+0000 7f0989271700 1 -- 172.21.15.39:0/141722610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f098415f430 msgr2=0x7f09840b2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:07.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.816+0000 7f0989271700 1 --2- 172.21.15.39:0/141722610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f098415f430 0x7f09840b2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:07.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.816+0000 7f0989271700 1 -- 172.21.15.39:0/141722610 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098415c570 con 0x7f09841f5d20 2023-11-28T11:58:07.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.816+0000 7f0989271700 1 --2- 172.21.15.39:0/141722610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09841f5d20 0x7f09840c6170 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0978000f60 tx=0x7f097800da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:07.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.816+0000 7f09767fc700 1 -- 172.21.15.39:0/141722610 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0978007620 con 0x7f09841f5d20 2023-11-28T11:58:07.824 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.816+0000 7f09767fc700 1 -- 172.21.15.39:0/141722610 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0978004890 con 0x7f09841f5d20 2023-11-28T11:58:07.824 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.816+0000 7f098aa74700 1 -- 172.21.15.39:0/141722610 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09840cc780 con 0x7f09841f5d20 2023-11-28T11:58:07.824 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.816+0000 7f09767fc700 1 -- 172.21.15.39:0/141722610 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0978004c40 con 0x7f09841f5d20 2023-11-28T11:58:07.824 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.816+0000 7f098aa74700 1 -- 172.21.15.39:0/141722610 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0984070080 con 0x7f09841f5d20 2023-11-28T11:58:07.824 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.816+0000 7f098aa74700 1 -- 172.21.15.39:0/141722610 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0984073cb0 con 0x7f09841f5d20 2023-11-28T11:58:07.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.820+0000 7f09767fc700 1 -- 172.21.15.39:0/141722610 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0978014430 con 0x7f09841f5d20 2023-11-28T11:58:07.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.820+0000 7f09767fc700 1 --2- 172.21.15.39:0/141722610 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0968064ee0 0x7f0968067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:07.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.820+0000 7f09767fc700 1 -- 172.21.15.39:0/141722610 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0978082200 con 0x7f09841f5d20 2023-11-28T11:58:07.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.824+0000 7f0989a72700 1 --2- 172.21.15.39:0/141722610 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0968064ee0 0x7f0968067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:07.829 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.824+0000 7f0989a72700 1 --2- 172.21.15.39:0/141722610 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0968064ee0 0x7f0968067390 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0980000c00 tx=0x7f098000a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:07.834 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:07.828+0000 7f09767fc700 1 -- 172.21.15.39:0/141722610 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0978050110 con 0x7f09841f5d20 2023-11-28T11:58:08.008 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.004+0000 7f098aa74700 1 -- 172.21.15.39:0/141722610 --> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f098415f240 con 0x7f0968064ee0 2023-11-28T11:58:08.024 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.016+0000 7f09767fc700 1 -- 172.21.15.39:0/141722610 <== mgr.4104 v2:172.21.15.184:6832/36166 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+298495 (secure 0 0 0) 0x7f09800050d0 con 0x7f0968064ee0 2023-11-28T11:58:08.028 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:58:08.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.028+0000 7f098aa74700 1 -- 172.21.15.39:0/141722610 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0968064ee0 msgr2=0x7f0968067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:08.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.028+0000 7f098aa74700 1 --2- 172.21.15.39:0/141722610 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0968064ee0 0x7f0968067390 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0980000c00 tx=0x7f098000a000 comp rx=0 tx=0).stop 2023-11-28T11:58:08.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.028+0000 7f098aa74700 1 -- 172.21.15.39:0/141722610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09841f5d20 msgr2=0x7f09840c6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:08.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.028+0000 7f098aa74700 1 --2- 172.21.15.39:0/141722610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09841f5d20 0x7f09840c6170 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0978000f60 tx=0x7f097800da50 comp rx=0 tx=0).stop 2023-11-28T11:58:08.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.028+0000 7f098aa74700 1 -- 172.21.15.39:0/141722610 shutdown_connections 2023-11-28T11:58:08.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.028+0000 7f098aa74700 1 --2- 172.21.15.39:0/141722610 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0968064ee0 0x7f0968067390 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:08.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.028+0000 7f098aa74700 1 --2- 172.21.15.39:0/141722610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f098415f430 0x7f09840b2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:08.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.028+0000 7f098aa74700 1 --2- 172.21.15.39:0/141722610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09841f5d20 0x7f09840c6170 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:08.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.028+0000 7f098aa74700 1 --2- 172.21.15.39:0/141722610 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0970003bb0 0x7f0984155bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:08.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.028+0000 7f098aa74700 1 -- 172.21.15.39:0/141722610 >> 172.21.15.39:0/141722610 conn(0x7f09840b0f80 msgr2=0x7f0984156f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:08.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.028+0000 7f098aa74700 1 -- 172.21.15.39:0/141722610 shutdown_connections 2023-11-28T11:58:08.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.028+0000 7f098aa74700 1 -- 172.21.15.39:0/141722610 wait complete. 2023-11-28T11:58:08.035 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2023-11-28T11:58:08.057 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2023-11-28T11:58:06.580529+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591938,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":178,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":72,"acting":72,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":43,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":70796,"kb_used_data":4812,"kb_used_omap":0,"kb_used_meta":65920,"kb_avail":754903924,"statfs":{"total":773094113280,"available":773021618176,"internally_reserved":0,"allocated":4927488,"data_stored":2803118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":67502080},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1570,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.828745"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416453+0000","last_change":"2023-11-28T11:58:03.280494+0000","last_active":"2023-11-28T11:58:05.416453+0000","last_peered":"2023-11-28T11:58:05.416453+0000","last_clean":"2023-11-28T11:58:05.416453+0000","last_became_active":"2023-11-28T11:58:03.273934+0000","last_became_peered":"2023-11-28T11:58:03.273934+0000","last_unstale":"2023-11-28T11:58:05.416453+0000","last_undegraded":"2023-11-28T11:58:05.416453+0000","last_fullsized":"2023-11-28T11:58:05.416453+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:56:29.140993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.415739+0000","last_change":"2023-11-28T11:58:03.278569+0000","last_active":"2023-11-28T11:58:05.415739+0000","last_peered":"2023-11-28T11:58:05.415739+0000","last_clean":"2023-11-28T11:58:05.415739+0000","last_became_active":"2023-11-28T11:58:03.278191+0000","last_became_peered":"2023-11-28T11:58:03.278191+0000","last_unstale":"2023-11-28T11:58:05.415739+0000","last_undegraded":"2023-11-28T11:58:05.415739+0000","last_fullsized":"2023-11-28T11:58:05.415739+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:14.419715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416724+0000","last_change":"2023-11-28T11:58:03.265015+0000","last_active":"2023-11-28T11:58:05.416724+0000","last_peered":"2023-11-28T11:58:05.416724+0000","last_clean":"2023-11-28T11:58:05.416724+0000","last_became_active":"2023-11-28T11:58:03.264639+0000","last_became_peered":"2023-11-28T11:58:03.264639+0000","last_unstale":"2023-11-28T11:58:05.416724+0000","last_undegraded":"2023-11-28T11:58:05.416724+0000","last_fullsized":"2023-11-28T11:58:05.416724+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:16:51.122441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416633+0000","last_change":"2023-11-28T11:58:03.283239+0000","last_active":"2023-11-28T11:58:05.416633+0000","last_peered":"2023-11-28T11:58:05.416633+0000","last_clean":"2023-11-28T11:58:05.416633+0000","last_became_active":"2023-11-28T11:58:03.280251+0000","last_became_peered":"2023-11-28T11:58:03.280251+0000","last_unstale":"2023-11-28T11:58:05.416633+0000","last_undegraded":"2023-11-28T11:58:05.416633+0000","last_fullsized":"2023-11-28T11:58:05.416633+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:36:30.647196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416432+0000","last_change":"2023-11-28T11:58:03.258812+0000","last_active":"2023-11-28T11:58:05.416432+0000","last_peered":"2023-11-28T11:58:05.416432+0000","last_clean":"2023-11-28T11:58:05.416432+0000","last_became_active":"2023-11-28T11:58:03.258368+0000","last_became_peered":"2023-11-28T11:58:03.258368+0000","last_unstale":"2023-11-28T11:58:05.416432+0000","last_undegraded":"2023-11-28T11:58:05.416432+0000","last_fullsized":"2023-11-28T11:58:05.416432+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:18:48.890788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.246940+0000","last_change":"2023-11-28T11:58:03.263075+0000","last_active":"2023-11-28T11:58:04.246940+0000","last_peered":"2023-11-28T11:58:04.246940+0000","last_clean":"2023-11-28T11:58:04.246940+0000","last_became_active":"2023-11-28T11:58:03.262800+0000","last_became_peered":"2023-11-28T11:58:03.262800+0000","last_unstale":"2023-11-28T11:58:04.246940+0000","last_undegraded":"2023-11-28T11:58:04.246940+0000","last_fullsized":"2023-11-28T11:58:04.246940+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:36:07.713099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.415805+0000","last_change":"2023-11-28T11:58:03.265606+0000","last_active":"2023-11-28T11:58:05.415805+0000","last_peered":"2023-11-28T11:58:05.415805+0000","last_clean":"2023-11-28T11:58:05.415805+0000","last_became_active":"2023-11-28T11:58:03.265347+0000","last_became_peered":"2023-11-28T11:58:03.265347+0000","last_unstale":"2023-11-28T11:58:05.415805+0000","last_undegraded":"2023-11-28T11:58:05.415805+0000","last_fullsized":"2023-11-28T11:58:05.415805+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:17:11.155874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.247370+0000","last_change":"2023-11-28T11:58:03.261719+0000","last_active":"2023-11-28T11:58:04.247370+0000","last_peered":"2023-11-28T11:58:04.247370+0000","last_clean":"2023-11-28T11:58:04.247370+0000","last_became_active":"2023-11-28T11:58:03.261481+0000","last_became_peered":"2023-11-28T11:58:03.261481+0000","last_unstale":"2023-11-28T11:58:04.247370+0000","last_undegraded":"2023-11-28T11:58:04.247370+0000","last_fullsized":"2023-11-28T11:58:04.247370+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:49:56.935045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.415975+0000","last_change":"2023-11-28T11:58:03.280229+0000","last_active":"2023-11-28T11:58:05.415975+0000","last_peered":"2023-11-28T11:58:05.415975+0000","last_clean":"2023-11-28T11:58:05.415975+0000","last_became_active":"2023-11-28T11:58:03.274838+0000","last_became_peered":"2023-11-28T11:58:03.274838+0000","last_unstale":"2023-11-28T11:58:05.415975+0000","last_undegraded":"2023-11-28T11:58:05.415975+0000","last_fullsized":"2023-11-28T11:58:05.415975+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:54:40.637592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.248044+0000","last_change":"2023-11-28T11:58:03.263235+0000","last_active":"2023-11-28T11:58:04.248044+0000","last_peered":"2023-11-28T11:58:04.248044+0000","last_clean":"2023-11-28T11:58:04.248044+0000","last_became_active":"2023-11-28T11:58:03.262984+0000","last_became_peered":"2023-11-28T11:58:03.262984+0000","last_unstale":"2023-11-28T11:58:04.248044+0000","last_undegraded":"2023-11-28T11:58:04.248044+0000","last_fullsized":"2023-11-28T11:58:04.248044+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:25:52.304471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.246306+0000","last_change":"2023-11-28T11:58:03.254255+0000","last_active":"2023-11-28T11:58:04.246306+0000","last_peered":"2023-11-28T11:58:04.246306+0000","last_clean":"2023-11-28T11:58:04.246306+0000","last_became_active":"2023-11-28T11:58:03.253952+0000","last_became_peered":"2023-11-28T11:58:03.253952+0000","last_unstale":"2023-11-28T11:58:04.246306+0000","last_undegraded":"2023-11-28T11:58:04.246306+0000","last_fullsized":"2023-11-28T11:58:04.246306+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:16:15.666991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416165+0000","last_change":"2023-11-28T11:58:03.258600+0000","last_active":"2023-11-28T11:58:05.416165+0000","last_peered":"2023-11-28T11:58:05.416165+0000","last_clean":"2023-11-28T11:58:05.416165+0000","last_became_active":"2023-11-28T11:58:03.258321+0000","last_became_peered":"2023-11-28T11:58:03.258321+0000","last_unstale":"2023-11-28T11:58:05.416165+0000","last_undegraded":"2023-11-28T11:58:05.416165+0000","last_fullsized":"2023-11-28T11:58:05.416165+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:44:36.459418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.415894+0000","last_change":"2023-11-28T11:58:03.283663+0000","last_active":"2023-11-28T11:58:05.415894+0000","last_peered":"2023-11-28T11:58:05.415894+0000","last_clean":"2023-11-28T11:58:05.415894+0000","last_became_active":"2023-11-28T11:58:03.274952+0000","last_became_peered":"2023-11-28T11:58:03.274952+0000","last_unstale":"2023-11-28T11:58:05.415894+0000","last_undegraded":"2023-11-28T11:58:05.415894+0000","last_fullsized":"2023-11-28T11:58:05.415894+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:01.925469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.415904+0000","last_change":"2023-11-28T11:58:02.785023+0000","last_active":"2023-11-28T11:58:05.415904+0000","last_peered":"2023-11-28T11:58:05.415904+0000","last_clean":"2023-11-28T11:58:05.415904+0000","last_became_active":"2023-11-28T11:58:02.784685+0000","last_became_peered":"2023-11-28T11:58:02.784685+0000","last_unstale":"2023-11-28T11:58:05.415904+0000","last_undegraded":"2023-11-28T11:58:05.415904+0000","last_fullsized":"2023-11-28T11:58:05.415904+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:27:27.811854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416772+0000","last_change":"2023-11-28T11:58:02.778715+0000","last_active":"2023-11-28T11:58:05.416772+0000","last_peered":"2023-11-28T11:58:05.416772+0000","last_clean":"2023-11-28T11:58:05.416772+0000","last_became_active":"2023-11-28T11:58:02.778424+0000","last_became_peered":"2023-11-28T11:58:02.778424+0000","last_unstale":"2023-11-28T11:58:05.416772+0000","last_undegraded":"2023-11-28T11:58:05.416772+0000","last_fullsized":"2023-11-28T11:58:05.416772+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:49:55.927853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"43'6","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.247491+0000","last_change":"2023-11-28T11:58:02.790035+0000","last_active":"2023-11-28T11:58:04.247491+0000","last_peered":"2023-11-28T11:58:04.247491+0000","last_clean":"2023-11-28T11:58:04.247491+0000","last_became_active":"2023-11-28T11:58:02.789147+0000","last_became_peered":"2023-11-28T11:58:02.789147+0000","last_unstale":"2023-11-28T11:58:04.247491+0000","last_undegraded":"2023-11-28T11:58:04.247491+0000","last_fullsized":"2023-11-28T11:58:04.247491+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:00:29.713180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416136+0000","last_change":"2023-11-28T11:58:03.265205+0000","last_active":"2023-11-28T11:58:05.416136+0000","last_peered":"2023-11-28T11:58:05.416136+0000","last_clean":"2023-11-28T11:58:05.416136+0000","last_became_active":"2023-11-28T11:58:03.264925+0000","last_became_peered":"2023-11-28T11:58:03.264925+0000","last_unstale":"2023-11-28T11:58:05.416136+0000","last_undegraded":"2023-11-28T11:58:05.416136+0000","last_fullsized":"2023-11-28T11:58:05.416136+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:20:28.291253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":19,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416125+0000","last_change":"2023-11-28T11:58:02.781485+0000","last_active":"2023-11-28T11:58:05.416125+0000","last_peered":"2023-11-28T11:58:05.416125+0000","last_clean":"2023-11-28T11:58:05.416125+0000","last_became_active":"2023-11-28T11:58:02.781225+0000","last_became_peered":"2023-11-28T11:58:02.781225+0000","last_unstale":"2023-11-28T11:58:05.416125+0000","last_undegraded":"2023-11-28T11:58:05.416125+0000","last_fullsized":"2023-11-28T11:58:05.416125+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:20:16.975860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.248464+0000","last_change":"2023-11-28T11:58:03.264759+0000","last_active":"2023-11-28T11:58:04.248464+0000","last_peered":"2023-11-28T11:58:04.248464+0000","last_clean":"2023-11-28T11:58:04.248464+0000","last_became_active":"2023-11-28T11:58:03.264511+0000","last_became_peered":"2023-11-28T11:58:03.264511+0000","last_unstale":"2023-11-28T11:58:04.248464+0000","last_undegraded":"2023-11-28T11:58:04.248464+0000","last_fullsized":"2023-11-28T11:58:04.248464+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:23.241400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"43'1","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.248774+0000","last_change":"2023-11-28T11:58:02.793922+0000","last_active":"2023-11-28T11:58:04.248774+0000","last_peered":"2023-11-28T11:58:04.248774+0000","last_clean":"2023-11-28T11:58:04.248774+0000","last_became_active":"2023-11-28T11:58:02.793596+0000","last_became_peered":"2023-11-28T11:58:02.793596+0000","last_unstale":"2023-11-28T11:58:04.248774+0000","last_undegraded":"2023-11-28T11:58:04.248774+0000","last_fullsized":"2023-11-28T11:58:04.248774+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:37:39.758646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416752+0000","last_change":"2023-11-28T11:58:03.263669+0000","last_active":"2023-11-28T11:58:05.416752+0000","last_peered":"2023-11-28T11:58:05.416752+0000","last_clean":"2023-11-28T11:58:05.416752+0000","last_became_active":"2023-11-28T11:58:03.263392+0000","last_became_peered":"2023-11-28T11:58:03.263392+0000","last_unstale":"2023-11-28T11:58:05.416752+0000","last_undegraded":"2023-11-28T11:58:05.416752+0000","last_fullsized":"2023-11-28T11:58:05.416752+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:14.962568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.246458+0000","last_change":"2023-11-28T11:58:03.255596+0000","last_active":"2023-11-28T11:58:04.246458+0000","last_peered":"2023-11-28T11:58:04.246458+0000","last_clean":"2023-11-28T11:58:04.246458+0000","last_became_active":"2023-11-28T11:58:03.255252+0000","last_became_peered":"2023-11-28T11:58:03.255252+0000","last_unstale":"2023-11-28T11:58:04.246458+0000","last_undegraded":"2023-11-28T11:58:04.246458+0000","last_fullsized":"2023-11-28T11:58:04.246458+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:20:17.983052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.415840+0000","last_change":"2023-11-28T11:58:02.779450+0000","last_active":"2023-11-28T11:58:05.415840+0000","last_peered":"2023-11-28T11:58:05.415840+0000","last_clean":"2023-11-28T11:58:05.415840+0000","last_became_active":"2023-11-28T11:58:02.779163+0000","last_became_peered":"2023-11-28T11:58:02.779163+0000","last_unstale":"2023-11-28T11:58:05.415840+0000","last_undegraded":"2023-11-28T11:58:05.415840+0000","last_fullsized":"2023-11-28T11:58:05.415840+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:01:36.211187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.415831+0000","last_change":"2023-11-28T11:58:03.260258+0000","last_active":"2023-11-28T11:58:05.415831+0000","last_peered":"2023-11-28T11:58:05.415831+0000","last_clean":"2023-11-28T11:58:05.415831+0000","last_became_active":"2023-11-28T11:58:03.259933+0000","last_became_peered":"2023-11-28T11:58:03.259933+0000","last_unstale":"2023-11-28T11:58:05.415831+0000","last_undegraded":"2023-11-28T11:58:05.415831+0000","last_fullsized":"2023-11-28T11:58:05.415831+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:14:43.182788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:57:54.978701+0000","last_change":"2023-11-28T11:56:34.384408+0000","last_active":"2023-11-28T11:57:54.978701+0000","last_peered":"2023-11-28T11:57:54.978701+0000","last_clean":"2023-11-28T11:57:54.978701+0000","last_became_active":"2023-11-28T11:56:34.384036+0000","last_became_peered":"2023-11-28T11:56:34.384036+0000","last_unstale":"2023-11-28T11:57:54.978701+0000","last_undegraded":"2023-11-28T11:57:54.978701+0000","last_fullsized":"2023-11-28T11:57:54.978701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:58:55.003786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:57:55.150723+0000","last_change":"2023-11-28T11:56:34.384088+0000","last_active":"2023-11-28T11:57:55.150723+0000","last_peered":"2023-11-28T11:57:55.150723+0000","last_clean":"2023-11-28T11:57:55.150723+0000","last_became_active":"2023-11-28T11:56:34.383631+0000","last_became_peered":"2023-11-28T11:56:34.383631+0000","last_unstale":"2023-11-28T11:57:55.150723+0000","last_undegraded":"2023-11-28T11:57:55.150723+0000","last_fullsized":"2023-11-28T11:57:55.150723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:15:42.772333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:57:54.979933+0000","last_change":"2023-11-28T11:56:34.386399+0000","last_active":"2023-11-28T11:57:54.979933+0000","last_peered":"2023-11-28T11:57:54.979933+0000","last_clean":"2023-11-28T11:57:54.979933+0000","last_became_active":"2023-11-28T11:56:34.385994+0000","last_became_peered":"2023-11-28T11:56:34.385994+0000","last_unstale":"2023-11-28T11:57:54.979933+0000","last_undegraded":"2023-11-28T11:57:54.979933+0000","last_fullsized":"2023-11-28T11:57:54.979933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:58:02.172295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416119+0000","last_change":"2023-11-28T11:58:02.794762+0000","last_active":"2023-11-28T11:58:05.416119+0000","last_peered":"2023-11-28T11:58:05.416119+0000","last_clean":"2023-11-28T11:58:05.416119+0000","last_became_active":"2023-11-28T11:58:02.794411+0000","last_became_peered":"2023-11-28T11:58:02.794411+0000","last_unstale":"2023-11-28T11:58:05.416119+0000","last_undegraded":"2023-11-28T11:58:05.416119+0000","last_fullsized":"2023-11-28T11:58:05.416119+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:22.234208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:57:55.150466+0000","last_change":"2023-11-28T11:56:34.384999+0000","last_active":"2023-11-28T11:57:55.150466+0000","last_peered":"2023-11-28T11:57:55.150466+0000","last_clean":"2023-11-28T11:57:55.150466+0000","last_became_active":"2023-11-28T11:56:34.384531+0000","last_became_peered":"2023-11-28T11:56:34.384531+0000","last_unstale":"2023-11-28T11:57:55.150466+0000","last_undegraded":"2023-11-28T11:57:55.150466+0000","last_fullsized":"2023-11-28T11:57:55.150466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:09:50.083366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:57:55.152211+0000","last_change":"2023-11-28T11:56:34.389076+0000","last_active":"2023-11-28T11:57:55.152211+0000","last_peered":"2023-11-28T11:57:55.152211+0000","last_clean":"2023-11-28T11:57:55.152211+0000","last_became_active":"2023-11-28T11:56:34.388689+0000","last_became_peered":"2023-11-28T11:56:34.388689+0000","last_unstale":"2023-11-28T11:57:55.152211+0000","last_undegraded":"2023-11-28T11:57:55.152211+0000","last_fullsized":"2023-11-28T11:57:55.152211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:20.936349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416316+0000","last_change":"2023-11-28T11:58:03.263283+0000","last_active":"2023-11-28T11:58:05.416316+0000","last_peered":"2023-11-28T11:58:05.416316+0000","last_clean":"2023-11-28T11:58:05.416316+0000","last_became_active":"2023-11-28T11:58:03.263034+0000","last_became_peered":"2023-11-28T11:58:03.263034+0000","last_unstale":"2023-11-28T11:58:05.416316+0000","last_undegraded":"2023-11-28T11:58:05.416316+0000","last_fullsized":"2023-11-28T11:58:05.416316+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:16:55.873337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T11:58:03.243608+0000","last_change":"2023-11-28T11:56:34.486178+0000","last_active":"2023-11-28T11:58:03.243608+0000","last_peered":"2023-11-28T11:58:03.243608+0000","last_clean":"2023-11-28T11:58:03.243608+0000","last_became_active":"2023-11-28T11:56:34.485702+0000","last_became_peered":"2023-11-28T11:56:34.485702+0000","last_unstale":"2023-11-28T11:58:03.243608+0000","last_undegraded":"2023-11-28T11:58:03.243608+0000","last_fullsized":"2023-11-28T11:58:03.243608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:06.323407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:57:54.979876+0000","last_change":"2023-11-28T11:56:34.387293+0000","last_active":"2023-11-28T11:57:54.979876+0000","last_peered":"2023-11-28T11:57:54.979876+0000","last_clean":"2023-11-28T11:57:54.979876+0000","last_became_active":"2023-11-28T11:56:34.386976+0000","last_became_peered":"2023-11-28T11:56:34.386976+0000","last_unstale":"2023-11-28T11:57:54.979876+0000","last_undegraded":"2023-11-28T11:57:54.979876+0000","last_fullsized":"2023-11-28T11:57:54.979876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:32.704729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416761+0000","last_change":"2023-11-28T11:58:03.262028+0000","last_active":"2023-11-28T11:58:05.416761+0000","last_peered":"2023-11-28T11:58:05.416761+0000","last_clean":"2023-11-28T11:58:05.416761+0000","last_became_active":"2023-11-28T11:58:03.261783+0000","last_became_peered":"2023-11-28T11:58:03.261783+0000","last_unstale":"2023-11-28T11:58:05.416761+0000","last_undegraded":"2023-11-28T11:58:05.416761+0000","last_fullsized":"2023-11-28T11:58:05.416761+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:33:57.968180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:57:55.152159+0000","last_change":"2023-11-28T11:56:34.389222+0000","last_active":"2023-11-28T11:57:55.152159+0000","last_peered":"2023-11-28T11:57:55.152159+0000","last_clean":"2023-11-28T11:57:55.152159+0000","last_became_active":"2023-11-28T11:56:34.388671+0000","last_became_peered":"2023-11-28T11:56:34.388671+0000","last_unstale":"2023-11-28T11:57:55.152159+0000","last_undegraded":"2023-11-28T11:57:55.152159+0000","last_fullsized":"2023-11-28T11:57:55.152159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:32.704729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:57:54.979966+0000","last_change":"2023-11-28T11:56:28.472008+0000","last_active":"2023-11-28T11:57:54.979966+0000","last_peered":"2023-11-28T11:57:54.979966+0000","last_clean":"2023-11-28T11:57:54.979966+0000","last_became_active":"2023-11-28T11:56:28.469273+0000","last_became_peered":"2023-11-28T11:56:28.469273+0000","last_unstale":"2023-11-28T11:57:54.979966+0000","last_undegraded":"2023-11-28T11:57:54.979966+0000","last_fullsized":"2023-11-28T11:57:54.979966+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:27.291192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:27.291192+0000","last_clean_scrub_stamp":"2023-11-28T11:56:27.291192+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:14:48.860420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":40,"acting":40,"num_store_stats":2},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1570,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":14,"acting":14,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509462,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9672,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362168,"statfs":{"total":96636764160,"available":96626860032,"internally_reserved":0,"allocated":1048576,"data_stored":786989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.88600000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.052}]},{"osd":2,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.85999999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.6000000000000001,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.117},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.1759999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.0489999999999999,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":0.98399999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":2.4710000000000001,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.081},{"interface":"front","average":{"1min":1.411,"5min":1.411,"15min":1.411},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":1.1379999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.575,"15min":1.575},"min":{"1min":1.266,"5min":1.266,"15min":1.266},"max":{"1min":2.4319999999999999,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.224},{"interface":"front","average":{"1min":1.47,"5min":1.47,"15min":1.47},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":2.468,"5min":2.468,"15min":2.468},"last":1.1930000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509462,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8452,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363388,"statfs":{"total":96636764160,"available":96628109312,"internally_reserved":0,"allocated":454656,"data_stored":196621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.347,"5min":2.347,"15min":2.347},"last":0.75600000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.93500000000000005}]},{"osd":2,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":3.9620000000000002,"5min":3.9620000000000002,"15min":3.9620000000000002},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.91300000000000003}]},{"osd":3,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.081},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":2.0790000000000002,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.109}]},{"osd":4,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.89400000000000002}]},{"osd":5,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":1.4339999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.306}]}]},{"osd":5,"up_from":15,"seq":64424509462,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8452,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363388,"statfs":{"total":96636764160,"available":96628109312,"internally_reserved":0,"allocated":454656,"data_stored":196621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.552}]},{"osd":1,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":1.72},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.3}]},{"osd":2,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":1.595}]},{"osd":3,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.085},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.2490000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.1950000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.28,"15min":1.28},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.355},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":1.0289999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":1.012,"5min":1.012,"15min":1.012},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.335},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.5109999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":8644,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363196,"statfs":{"total":96636764160,"available":96627912704,"internally_reserved":0,"allocated":454656,"data_stored":196621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.167},{"interface":"front","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.397}]},{"osd":1,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.8860000000000001,"5min":2.8860000000000001,"15min":2.8860000000000001},"last":0.59399999999999997}]},{"osd":2,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.3500000000000001,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":3.0630000000000002,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":1.0720000000000001}]},{"osd":3,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.252}]},{"osd":5,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":2.972,"5min":2.972,"15min":2.972},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.4470000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.3500000000000001,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.569,"5min":1.569,"15min":1.569},"min":{"1min":1.038,"5min":1.038,"15min":1.038},"max":{"1min":3.133,"5min":3.133,"15min":3.133},"last":1}]},{"osd":7,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.548,"5min":1.548,"15min":1.548},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":2.2679999999999998,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.492},{"interface":"front","average":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"min":{"1min":1.21,"5min":1.21,"15min":1.21},"max":{"1min":2.198,"5min":2.198,"15min":2.198},"last":1.355}]}]},{"osd":3,"up_from":15,"seq":64424509462,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8580,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363260,"statfs":{"total":96636764160,"available":96627978240,"internally_reserved":0,"allocated":454656,"data_stored":196621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":2.177,"5min":2.177,"15min":2.177},"last":1.248}]},{"osd":1,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.087},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.96999999999999997}]},{"osd":2,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.872},{"interface":"front","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":1.054}]},{"osd":4,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":2.8439999999999999,"5min":2.8439999999999999,"15min":2.8439999999999999},"last":1.29}]},{"osd":5,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.9670000000000001,"5min":2.9670000000000001,"15min":2.9670000000000001},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":3.7429999999999999,"5min":3.7429999999999999,"15min":3.7429999999999999},"last":1.131}]},{"osd":6,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.927,"5min":2.927,"15min":2.927},"last":1.3680000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":3.5030000000000001,"5min":3.5030000000000001,"15min":3.5030000000000001},"last":1.181},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.6320000000000001,"5min":2.6320000000000001,"15min":2.6320000000000001},"last":1.3360000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509462,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8516,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363324,"statfs":{"total":96636764160,"available":96628043776,"internally_reserved":0,"allocated":454656,"data_stored":196621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":2.7469999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":1.0600000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.73599999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.85699999999999998}]},{"osd":4,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":3.411,"5min":3.411,"15min":3.411},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.6680000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":1.208}]},{"osd":5,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":3.6869999999999998,"5min":3.6869999999999998,"15min":3.6869999999999998},"last":1.292},{"interface":"front","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.0609999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.127}]},{"osd":6,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"min":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":3.5379999999999998,"5min":3.5379999999999998,"15min":3.5379999999999998},"last":1.242},{"interface":"front","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.5739999999999998,"5min":2.5739999999999998,"15min":2.5739999999999998},"last":1.2549999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.4249999999999998,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.3200000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542167,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8644,"kb_used_data":508,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363196,"statfs":{"total":96636764160,"available":96627912704,"internally_reserved":0,"allocated":520192,"data_stored":226042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.0860000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.754,"5min":1.754,"15min":1.754},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.66600000000000004}]},{"osd":3,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":1.01},{"interface":"front","average":{"1min":1.3,"5min":1.3,"15min":1.3},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.617,"5min":2.617,"15min":2.617},"last":1.129}]},{"osd":4,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.9620000000000002,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.3860000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":1.3740000000000001}]},{"osd":5,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":2.738,"5min":2.738,"15min":2.738},"last":1.623},{"interface":"front","average":{"1min":1.575,"5min":1.575,"15min":1.575},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":4.0309999999999997,"5min":4.0309999999999997,"15min":4.0309999999999997},"last":1.3100000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":4.2240000000000002,"5min":4.2240000000000002,"15min":4.2240000000000002},"last":1.5720000000000001},{"interface":"front","average":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":3.0750000000000002,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":1.3460000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":2.3660000000000001,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.476},{"interface":"front","average":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":4.3570000000000002,"5min":4.3570000000000002,"15min":4.3570000000000002},"last":1.6719999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542167,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9836,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362004,"statfs":{"total":96636764160,"available":96626692096,"internally_reserved":0,"allocated":1085440,"data_stored":806982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":1.002},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.68000000000000005}]},{"osd":2,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.73499999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.0720000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":3.4809999999999999,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":3.1629999999999998,"5min":3.1629999999999998,"15min":3.1629999999999998},"last":1.2909999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.266,"5min":2.266,"15min":2.266},"last":1.1759999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.4060000000000001,"5min":2.4060000000000001,"15min":2.4060000000000001},"last":1.24},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"max":{"1min":2.3599999999999999,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":1.212}]},{"osd":7,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":2.3330000000000002,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.583,"5min":1.583,"15min":1.583},"min":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"max":{"1min":2.6040000000000001,"5min":2.6040000000000001,"15min":2.6040000000000001},"last":1.2629999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:58:08.062 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:58:08.294 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.288+0000 7f2e0a228700 1 Processor -- start 2023-11-28T11:58:08.294 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.288+0000 7f2e0a228700 1 -- start start 2023-11-28T11:58:08.297 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.292+0000 7f2e0a228700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2e040ced50 0x7f2e0406afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:08.297 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.292+0000 7f2e0a228700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e040d24d0 con 0x7f2e04160770 2023-11-28T11:58:08.297 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.292+0000 7f2e0a228700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e040d27b0 con 0x7f2e04070790 2023-11-28T11:58:08.297 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.292+0000 7f2e0a228700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e040d08d0 con 0x7f2e040ced50 2023-11-28T11:58:08.297 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.292+0000 7f2e08a25700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f2e04160770 0x7f2e04070080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:40244/0 (socket says 172.21.15.39:40244) 2023-11-28T11:58:08.297 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.292+0000 7f2e08a25700 1 -- 172.21.15.39:0/1324110267 learned_addr learned my addr 172.21.15.39:0/1324110267 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:58:08.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.292+0000 7f2e09226700 1 --2- 172.21.15.39:0/1324110267 >> v2:172.21.15.184:3300/0 conn(0x7f2e040ced50 0x7f2e0406afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:08.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.292+0000 7f2dfbfff700 1 -- 172.21.15.39:0/1324110267 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 74077775 0 0) 0x7f2e040d24d0 con 0x7f2e04160770 2023-11-28T11:58:08.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.292+0000 7f2dfbfff700 1 -- 172.21.15.39:0/1324110267 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2df00035d0 con 0x7f2e04160770 2023-11-28T11:58:08.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.292+0000 7f2dfbfff700 1 -- 172.21.15.39:0/1324110267 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1762144508 0 0) 0x7f2e040d27b0 con 0x7f2e04070790 2023-11-28T11:58:08.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.292+0000 7f2dfbfff700 1 -- 172.21.15.39:0/1324110267 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e040d24d0 con 0x7f2e04070790 2023-11-28T11:58:08.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.292+0000 7f2dfbfff700 1 -- 172.21.15.39:0/1324110267 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3658111073 0 0) 0x7f2df00035d0 con 0x7f2e04160770 2023-11-28T11:58:08.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.292+0000 7f2e09226700 1 -- 172.21.15.39:0/1324110267 >> v1:172.21.15.184:6789/0 conn(0x7f2e04070790 legacy=0x7f2e04069cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:08.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.292+0000 7f2e09226700 1 -- 172.21.15.39:0/1324110267 >> v1:172.21.15.39:6789/0 conn(0x7f2e04160770 legacy=0x7f2e04070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:08.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.292+0000 7f2e09226700 1 -- 172.21.15.39:0/1324110267 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e040d0bb0 con 0x7f2e040ced50 2023-11-28T11:58:08.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.292+0000 7f2e09226700 1 --2- 172.21.15.39:0/1324110267 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e040ced50 0x7f2e0406afc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2e00009850 tx=0x7f2e00009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d1a361153410240 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:08.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.296+0000 7f2dfbfff700 1 -- 172.21.15.39:0/1324110267 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df4001670 con 0x7f2e040ced50 2023-11-28T11:58:08.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.296+0000 7f2dfbfff700 1 -- 172.21.15.39:0/1324110267 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e00004030 con 0x7f2e040ced50 2023-11-28T11:58:08.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.296+0000 7f2dfbfff700 1 -- 172.21.15.39:0/1324110267 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e000043c0 con 0x7f2e040ced50 2023-11-28T11:58:08.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.296+0000 7f2e0a228700 1 -- 172.21.15.39:0/1324110267 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e040ced50 msgr2=0x7f2e0406afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:08.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.296+0000 7f2e0a228700 1 --2- 172.21.15.39:0/1324110267 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e040ced50 0x7f2e0406afc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2e00009850 tx=0x7f2e00009b60 comp rx=0 tx=0).stop 2023-11-28T11:58:08.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.296+0000 7f2e0a228700 1 -- 172.21.15.39:0/1324110267 shutdown_connections 2023-11-28T11:58:08.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.296+0000 7f2e0a228700 1 --2- 172.21.15.39:0/1324110267 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e040ced50 0x7f2e0406afc0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:08.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.296+0000 7f2e0a228700 1 -- 172.21.15.39:0/1324110267 >> 172.21.15.39:0/1324110267 conn(0x7f2e040b53a0 msgr2=0x7f2e040d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:08.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.296+0000 7f2e0a228700 1 -- 172.21.15.39:0/1324110267 shutdown_connections 2023-11-28T11:58:08.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.296+0000 7f2e0a228700 1 -- 172.21.15.39:0/1324110267 wait complete. 2023-11-28T11:58:08.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.300+0000 7f2e0a228700 1 Processor -- start 2023-11-28T11:58:08.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.300+0000 7f2e0a228700 1 -- start start 2023-11-28T11:58:08.309 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.300+0000 7f2e0a228700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e04070790 0x7f2e040c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:08.309 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.300+0000 7f2e0a228700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e040ced50 0x7f2e041f1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:08.309 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.300+0000 7f2e0a228700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e04160770 0x7f2e041f55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:08.309 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.300+0000 7f2e0a228700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e041f2950 con 0x7f2e04070790 2023-11-28T11:58:08.309 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.300+0000 7f2e0a228700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e04156b10 con 0x7f2e040ced50 2023-11-28T11:58:08.309 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.300+0000 7f2e0a228700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e041f1e50 con 0x7f2e04160770 2023-11-28T11:58:08.309 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.300+0000 7f2e09226700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e04070790 0x7f2e040c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:08.309 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.300+0000 7f2e09226700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e04070790 0x7f2e040c8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46544/0 (socket says 172.21.15.39:46544) 2023-11-28T11:58:08.309 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.300+0000 7f2e09226700 1 -- 172.21.15.39:0/729740645 learned_addr learned my addr 172.21.15.39:0/729740645 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:08.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.300+0000 7f2e08a25700 1 --2- 172.21.15.39:0/729740645 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e040ced50 0x7f2e041f1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:08.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.300+0000 7f2e09226700 1 -- 172.21.15.39:0/729740645 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e04160770 msgr2=0x7f2e041f55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:08.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.300+0000 7f2e09226700 1 --2- 172.21.15.39:0/729740645 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e04160770 0x7f2e041f55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:08.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.304+0000 7f2e09226700 1 -- 172.21.15.39:0/729740645 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e040ced50 msgr2=0x7f2e041f1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:08.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.304+0000 7f2e09226700 1 --2- 172.21.15.39:0/729740645 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e040ced50 0x7f2e041f1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:08.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.304+0000 7f2e09226700 1 -- 172.21.15.39:0/729740645 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e000094b0 con 0x7f2e04070790 2023-11-28T11:58:08.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.304+0000 7f2e08a25700 1 --2- 172.21.15.39:0/729740645 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e040ced50 0x7f2e041f1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:58:08.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.304+0000 7f2e09226700 1 --2- 172.21.15.39:0/729740645 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e04070790 0x7f2e040c8bc0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2e04072f00 tx=0x7f2e00004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:08.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.304+0000 7f2df9ffb700 1 -- 172.21.15.39:0/729740645 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e00011830 con 0x7f2e04070790 2023-11-28T11:58:08.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.304+0000 7f2df9ffb700 1 -- 172.21.15.39:0/729740645 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0001f070 con 0x7f2e04070790 2023-11-28T11:58:08.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.304+0000 7f2df9ffb700 1 -- 172.21.15.39:0/729740645 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e00011bd0 con 0x7f2e04070790 2023-11-28T11:58:08.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.304+0000 7f2e0a228700 1 -- 172.21.15.39:0/729740645 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e04160bf0 con 0x7f2e04070790 2023-11-28T11:58:08.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.304+0000 7f2e0a228700 1 -- 172.21.15.39:0/729740645 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e040cf120 con 0x7f2e04070790 2023-11-28T11:58:08.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.304+0000 7f2e0a228700 1 -- 172.21.15.39:0/729740645 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e040cd1b0 con 0x7f2e04070790 2023-11-28T11:58:08.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.304+0000 7f2df9ffb700 1 -- 172.21.15.39:0/729740645 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2e00017020 con 0x7f2e04070790 2023-11-28T11:58:08.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.308+0000 7f2df9ffb700 1 --2- 172.21.15.39:0/729740645 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2de8064ee0 0x7f2de8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:08.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.308+0000 7f2df9ffb700 1 -- 172.21.15.39:0/729740645 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2e00021070 con 0x7f2e04070790 2023-11-28T11:58:08.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.308+0000 7f2e08a25700 1 --2- 172.21.15.39:0/729740645 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2de8064ee0 0x7f2de8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:08.315 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.308+0000 7f2e08a25700 1 --2- 172.21.15.39:0/729740645 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2de8064ee0 0x7f2de8067390 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2e040b43f0 tx=0x7f2df4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:08.317 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.312+0000 7f2df9ffb700 1 -- 172.21.15.39:0/729740645 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2e000519e0 con 0x7f2e04070790 2023-11-28T11:58:08.490 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.484+0000 7f2e0a228700 1 -- 172.21.15.39:0/729740645 --> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2e04073cb0 con 0x7f2de8064ee0 2023-11-28T11:58:08.505 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.500+0000 7f2df9ffb700 1 -- 172.21.15.39:0/729740645 <== mgr.4104 v2:172.21.15.184:6832/36166 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+298495 (secure 0 0 0) 0x7f2e04073cb0 con 0x7f2de8064ee0 2023-11-28T11:58:08.510 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:58:08.514 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.508+0000 7f2e0a228700 1 -- 172.21.15.39:0/729740645 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2de8064ee0 msgr2=0x7f2de8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:08.515 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.508+0000 7f2e0a228700 1 --2- 172.21.15.39:0/729740645 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2de8064ee0 0x7f2de8067390 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2e040b43f0 tx=0x7f2df4009040 comp rx=0 tx=0).stop 2023-11-28T11:58:08.515 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.508+0000 7f2e0a228700 1 -- 172.21.15.39:0/729740645 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e04070790 msgr2=0x7f2e040c8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:08.515 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.508+0000 7f2e0a228700 1 --2- 172.21.15.39:0/729740645 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e04070790 0x7f2e040c8bc0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2e04072f00 tx=0x7f2e00004770 comp rx=0 tx=0).stop 2023-11-28T11:58:08.515 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.508+0000 7f2e0a228700 1 -- 172.21.15.39:0/729740645 shutdown_connections 2023-11-28T11:58:08.515 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.508+0000 7f2e0a228700 1 --2- 172.21.15.39:0/729740645 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e04160770 0x7f2e041f55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:08.516 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.508+0000 7f2e0a228700 1 --2- 172.21.15.39:0/729740645 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2de8064ee0 0x7f2de8067390 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:08.516 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.508+0000 7f2e0a228700 1 --2- 172.21.15.39:0/729740645 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e040ced50 0x7f2e041f1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:08.516 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.508+0000 7f2e0a228700 1 --2- 172.21.15.39:0/729740645 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e04070790 0x7f2e040c8bc0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:08.516 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.508+0000 7f2e0a228700 1 -- 172.21.15.39:0/729740645 >> 172.21.15.39:0/729740645 conn(0x7f2e040b53a0 msgr2=0x7f2e04070060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:08.516 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.508+0000 7f2e0a228700 1 -- 172.21.15.39:0/729740645 shutdown_connections 2023-11-28T11:58:08.516 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.508+0000 7f2e0a228700 1 -- 172.21.15.39:0/729740645 wait complete. 2023-11-28T11:58:08.517 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2023-11-28T11:58:08.538 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2023-11-28T11:58:06.580529+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591938,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":178,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":72,"acting":72,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":43,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":70796,"kb_used_data":4812,"kb_used_omap":0,"kb_used_meta":65920,"kb_avail":754903924,"statfs":{"total":773094113280,"available":773021618176,"internally_reserved":0,"allocated":4927488,"data_stored":2803118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":67502080},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1570,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.828745"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416453+0000","last_change":"2023-11-28T11:58:03.280494+0000","last_active":"2023-11-28T11:58:05.416453+0000","last_peered":"2023-11-28T11:58:05.416453+0000","last_clean":"2023-11-28T11:58:05.416453+0000","last_became_active":"2023-11-28T11:58:03.273934+0000","last_became_peered":"2023-11-28T11:58:03.273934+0000","last_unstale":"2023-11-28T11:58:05.416453+0000","last_undegraded":"2023-11-28T11:58:05.416453+0000","last_fullsized":"2023-11-28T11:58:05.416453+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:56:29.140993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.415739+0000","last_change":"2023-11-28T11:58:03.278569+0000","last_active":"2023-11-28T11:58:05.415739+0000","last_peered":"2023-11-28T11:58:05.415739+0000","last_clean":"2023-11-28T11:58:05.415739+0000","last_became_active":"2023-11-28T11:58:03.278191+0000","last_became_peered":"2023-11-28T11:58:03.278191+0000","last_unstale":"2023-11-28T11:58:05.415739+0000","last_undegraded":"2023-11-28T11:58:05.415739+0000","last_fullsized":"2023-11-28T11:58:05.415739+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:14.419715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416724+0000","last_change":"2023-11-28T11:58:03.265015+0000","last_active":"2023-11-28T11:58:05.416724+0000","last_peered":"2023-11-28T11:58:05.416724+0000","last_clean":"2023-11-28T11:58:05.416724+0000","last_became_active":"2023-11-28T11:58:03.264639+0000","last_became_peered":"2023-11-28T11:58:03.264639+0000","last_unstale":"2023-11-28T11:58:05.416724+0000","last_undegraded":"2023-11-28T11:58:05.416724+0000","last_fullsized":"2023-11-28T11:58:05.416724+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:16:51.122441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416633+0000","last_change":"2023-11-28T11:58:03.283239+0000","last_active":"2023-11-28T11:58:05.416633+0000","last_peered":"2023-11-28T11:58:05.416633+0000","last_clean":"2023-11-28T11:58:05.416633+0000","last_became_active":"2023-11-28T11:58:03.280251+0000","last_became_peered":"2023-11-28T11:58:03.280251+0000","last_unstale":"2023-11-28T11:58:05.416633+0000","last_undegraded":"2023-11-28T11:58:05.416633+0000","last_fullsized":"2023-11-28T11:58:05.416633+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:36:30.647196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416432+0000","last_change":"2023-11-28T11:58:03.258812+0000","last_active":"2023-11-28T11:58:05.416432+0000","last_peered":"2023-11-28T11:58:05.416432+0000","last_clean":"2023-11-28T11:58:05.416432+0000","last_became_active":"2023-11-28T11:58:03.258368+0000","last_became_peered":"2023-11-28T11:58:03.258368+0000","last_unstale":"2023-11-28T11:58:05.416432+0000","last_undegraded":"2023-11-28T11:58:05.416432+0000","last_fullsized":"2023-11-28T11:58:05.416432+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:18:48.890788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.246940+0000","last_change":"2023-11-28T11:58:03.263075+0000","last_active":"2023-11-28T11:58:04.246940+0000","last_peered":"2023-11-28T11:58:04.246940+0000","last_clean":"2023-11-28T11:58:04.246940+0000","last_became_active":"2023-11-28T11:58:03.262800+0000","last_became_peered":"2023-11-28T11:58:03.262800+0000","last_unstale":"2023-11-28T11:58:04.246940+0000","last_undegraded":"2023-11-28T11:58:04.246940+0000","last_fullsized":"2023-11-28T11:58:04.246940+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:36:07.713099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.415805+0000","last_change":"2023-11-28T11:58:03.265606+0000","last_active":"2023-11-28T11:58:05.415805+0000","last_peered":"2023-11-28T11:58:05.415805+0000","last_clean":"2023-11-28T11:58:05.415805+0000","last_became_active":"2023-11-28T11:58:03.265347+0000","last_became_peered":"2023-11-28T11:58:03.265347+0000","last_unstale":"2023-11-28T11:58:05.415805+0000","last_undegraded":"2023-11-28T11:58:05.415805+0000","last_fullsized":"2023-11-28T11:58:05.415805+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:17:11.155874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.247370+0000","last_change":"2023-11-28T11:58:03.261719+0000","last_active":"2023-11-28T11:58:04.247370+0000","last_peered":"2023-11-28T11:58:04.247370+0000","last_clean":"2023-11-28T11:58:04.247370+0000","last_became_active":"2023-11-28T11:58:03.261481+0000","last_became_peered":"2023-11-28T11:58:03.261481+0000","last_unstale":"2023-11-28T11:58:04.247370+0000","last_undegraded":"2023-11-28T11:58:04.247370+0000","last_fullsized":"2023-11-28T11:58:04.247370+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:49:56.935045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.415975+0000","last_change":"2023-11-28T11:58:03.280229+0000","last_active":"2023-11-28T11:58:05.415975+0000","last_peered":"2023-11-28T11:58:05.415975+0000","last_clean":"2023-11-28T11:58:05.415975+0000","last_became_active":"2023-11-28T11:58:03.274838+0000","last_became_peered":"2023-11-28T11:58:03.274838+0000","last_unstale":"2023-11-28T11:58:05.415975+0000","last_undegraded":"2023-11-28T11:58:05.415975+0000","last_fullsized":"2023-11-28T11:58:05.415975+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:54:40.637592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.248044+0000","last_change":"2023-11-28T11:58:03.263235+0000","last_active":"2023-11-28T11:58:04.248044+0000","last_peered":"2023-11-28T11:58:04.248044+0000","last_clean":"2023-11-28T11:58:04.248044+0000","last_became_active":"2023-11-28T11:58:03.262984+0000","last_became_peered":"2023-11-28T11:58:03.262984+0000","last_unstale":"2023-11-28T11:58:04.248044+0000","last_undegraded":"2023-11-28T11:58:04.248044+0000","last_fullsized":"2023-11-28T11:58:04.248044+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:25:52.304471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.246306+0000","last_change":"2023-11-28T11:58:03.254255+0000","last_active":"2023-11-28T11:58:04.246306+0000","last_peered":"2023-11-28T11:58:04.246306+0000","last_clean":"2023-11-28T11:58:04.246306+0000","last_became_active":"2023-11-28T11:58:03.253952+0000","last_became_peered":"2023-11-28T11:58:03.253952+0000","last_unstale":"2023-11-28T11:58:04.246306+0000","last_undegraded":"2023-11-28T11:58:04.246306+0000","last_fullsized":"2023-11-28T11:58:04.246306+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:16:15.666991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416165+0000","last_change":"2023-11-28T11:58:03.258600+0000","last_active":"2023-11-28T11:58:05.416165+0000","last_peered":"2023-11-28T11:58:05.416165+0000","last_clean":"2023-11-28T11:58:05.416165+0000","last_became_active":"2023-11-28T11:58:03.258321+0000","last_became_peered":"2023-11-28T11:58:03.258321+0000","last_unstale":"2023-11-28T11:58:05.416165+0000","last_undegraded":"2023-11-28T11:58:05.416165+0000","last_fullsized":"2023-11-28T11:58:05.416165+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:44:36.459418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.415894+0000","last_change":"2023-11-28T11:58:03.283663+0000","last_active":"2023-11-28T11:58:05.415894+0000","last_peered":"2023-11-28T11:58:05.415894+0000","last_clean":"2023-11-28T11:58:05.415894+0000","last_became_active":"2023-11-28T11:58:03.274952+0000","last_became_peered":"2023-11-28T11:58:03.274952+0000","last_unstale":"2023-11-28T11:58:05.415894+0000","last_undegraded":"2023-11-28T11:58:05.415894+0000","last_fullsized":"2023-11-28T11:58:05.415894+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:01.925469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.415904+0000","last_change":"2023-11-28T11:58:02.785023+0000","last_active":"2023-11-28T11:58:05.415904+0000","last_peered":"2023-11-28T11:58:05.415904+0000","last_clean":"2023-11-28T11:58:05.415904+0000","last_became_active":"2023-11-28T11:58:02.784685+0000","last_became_peered":"2023-11-28T11:58:02.784685+0000","last_unstale":"2023-11-28T11:58:05.415904+0000","last_undegraded":"2023-11-28T11:58:05.415904+0000","last_fullsized":"2023-11-28T11:58:05.415904+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:27:27.811854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416772+0000","last_change":"2023-11-28T11:58:02.778715+0000","last_active":"2023-11-28T11:58:05.416772+0000","last_peered":"2023-11-28T11:58:05.416772+0000","last_clean":"2023-11-28T11:58:05.416772+0000","last_became_active":"2023-11-28T11:58:02.778424+0000","last_became_peered":"2023-11-28T11:58:02.778424+0000","last_unstale":"2023-11-28T11:58:05.416772+0000","last_undegraded":"2023-11-28T11:58:05.416772+0000","last_fullsized":"2023-11-28T11:58:05.416772+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:49:55.927853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"43'6","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.247491+0000","last_change":"2023-11-28T11:58:02.790035+0000","last_active":"2023-11-28T11:58:04.247491+0000","last_peered":"2023-11-28T11:58:04.247491+0000","last_clean":"2023-11-28T11:58:04.247491+0000","last_became_active":"2023-11-28T11:58:02.789147+0000","last_became_peered":"2023-11-28T11:58:02.789147+0000","last_unstale":"2023-11-28T11:58:04.247491+0000","last_undegraded":"2023-11-28T11:58:04.247491+0000","last_fullsized":"2023-11-28T11:58:04.247491+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:00:29.713180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416136+0000","last_change":"2023-11-28T11:58:03.265205+0000","last_active":"2023-11-28T11:58:05.416136+0000","last_peered":"2023-11-28T11:58:05.416136+0000","last_clean":"2023-11-28T11:58:05.416136+0000","last_became_active":"2023-11-28T11:58:03.264925+0000","last_became_peered":"2023-11-28T11:58:03.264925+0000","last_unstale":"2023-11-28T11:58:05.416136+0000","last_undegraded":"2023-11-28T11:58:05.416136+0000","last_fullsized":"2023-11-28T11:58:05.416136+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:20:28.291253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":19,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416125+0000","last_change":"2023-11-28T11:58:02.781485+0000","last_active":"2023-11-28T11:58:05.416125+0000","last_peered":"2023-11-28T11:58:05.416125+0000","last_clean":"2023-11-28T11:58:05.416125+0000","last_became_active":"2023-11-28T11:58:02.781225+0000","last_became_peered":"2023-11-28T11:58:02.781225+0000","last_unstale":"2023-11-28T11:58:05.416125+0000","last_undegraded":"2023-11-28T11:58:05.416125+0000","last_fullsized":"2023-11-28T11:58:05.416125+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:20:16.975860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.248464+0000","last_change":"2023-11-28T11:58:03.264759+0000","last_active":"2023-11-28T11:58:04.248464+0000","last_peered":"2023-11-28T11:58:04.248464+0000","last_clean":"2023-11-28T11:58:04.248464+0000","last_became_active":"2023-11-28T11:58:03.264511+0000","last_became_peered":"2023-11-28T11:58:03.264511+0000","last_unstale":"2023-11-28T11:58:04.248464+0000","last_undegraded":"2023-11-28T11:58:04.248464+0000","last_fullsized":"2023-11-28T11:58:04.248464+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:23.241400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"43'1","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.248774+0000","last_change":"2023-11-28T11:58:02.793922+0000","last_active":"2023-11-28T11:58:04.248774+0000","last_peered":"2023-11-28T11:58:04.248774+0000","last_clean":"2023-11-28T11:58:04.248774+0000","last_became_active":"2023-11-28T11:58:02.793596+0000","last_became_peered":"2023-11-28T11:58:02.793596+0000","last_unstale":"2023-11-28T11:58:04.248774+0000","last_undegraded":"2023-11-28T11:58:04.248774+0000","last_fullsized":"2023-11-28T11:58:04.248774+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:37:39.758646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416752+0000","last_change":"2023-11-28T11:58:03.263669+0000","last_active":"2023-11-28T11:58:05.416752+0000","last_peered":"2023-11-28T11:58:05.416752+0000","last_clean":"2023-11-28T11:58:05.416752+0000","last_became_active":"2023-11-28T11:58:03.263392+0000","last_became_peered":"2023-11-28T11:58:03.263392+0000","last_unstale":"2023-11-28T11:58:05.416752+0000","last_undegraded":"2023-11-28T11:58:05.416752+0000","last_fullsized":"2023-11-28T11:58:05.416752+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:14.962568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.246458+0000","last_change":"2023-11-28T11:58:03.255596+0000","last_active":"2023-11-28T11:58:04.246458+0000","last_peered":"2023-11-28T11:58:04.246458+0000","last_clean":"2023-11-28T11:58:04.246458+0000","last_became_active":"2023-11-28T11:58:03.255252+0000","last_became_peered":"2023-11-28T11:58:03.255252+0000","last_unstale":"2023-11-28T11:58:04.246458+0000","last_undegraded":"2023-11-28T11:58:04.246458+0000","last_fullsized":"2023-11-28T11:58:04.246458+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:20:17.983052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.415840+0000","last_change":"2023-11-28T11:58:02.779450+0000","last_active":"2023-11-28T11:58:05.415840+0000","last_peered":"2023-11-28T11:58:05.415840+0000","last_clean":"2023-11-28T11:58:05.415840+0000","last_became_active":"2023-11-28T11:58:02.779163+0000","last_became_peered":"2023-11-28T11:58:02.779163+0000","last_unstale":"2023-11-28T11:58:05.415840+0000","last_undegraded":"2023-11-28T11:58:05.415840+0000","last_fullsized":"2023-11-28T11:58:05.415840+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:01:36.211187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.415831+0000","last_change":"2023-11-28T11:58:03.260258+0000","last_active":"2023-11-28T11:58:05.415831+0000","last_peered":"2023-11-28T11:58:05.415831+0000","last_clean":"2023-11-28T11:58:05.415831+0000","last_became_active":"2023-11-28T11:58:03.259933+0000","last_became_peered":"2023-11-28T11:58:03.259933+0000","last_unstale":"2023-11-28T11:58:05.415831+0000","last_undegraded":"2023-11-28T11:58:05.415831+0000","last_fullsized":"2023-11-28T11:58:05.415831+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:14:43.182788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:57:54.978701+0000","last_change":"2023-11-28T11:56:34.384408+0000","last_active":"2023-11-28T11:57:54.978701+0000","last_peered":"2023-11-28T11:57:54.978701+0000","last_clean":"2023-11-28T11:57:54.978701+0000","last_became_active":"2023-11-28T11:56:34.384036+0000","last_became_peered":"2023-11-28T11:56:34.384036+0000","last_unstale":"2023-11-28T11:57:54.978701+0000","last_undegraded":"2023-11-28T11:57:54.978701+0000","last_fullsized":"2023-11-28T11:57:54.978701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:58:55.003786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:57:55.150723+0000","last_change":"2023-11-28T11:56:34.384088+0000","last_active":"2023-11-28T11:57:55.150723+0000","last_peered":"2023-11-28T11:57:55.150723+0000","last_clean":"2023-11-28T11:57:55.150723+0000","last_became_active":"2023-11-28T11:56:34.383631+0000","last_became_peered":"2023-11-28T11:56:34.383631+0000","last_unstale":"2023-11-28T11:57:55.150723+0000","last_undegraded":"2023-11-28T11:57:55.150723+0000","last_fullsized":"2023-11-28T11:57:55.150723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:15:42.772333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:57:54.979933+0000","last_change":"2023-11-28T11:56:34.386399+0000","last_active":"2023-11-28T11:57:54.979933+0000","last_peered":"2023-11-28T11:57:54.979933+0000","last_clean":"2023-11-28T11:57:54.979933+0000","last_became_active":"2023-11-28T11:56:34.385994+0000","last_became_peered":"2023-11-28T11:56:34.385994+0000","last_unstale":"2023-11-28T11:57:54.979933+0000","last_undegraded":"2023-11-28T11:57:54.979933+0000","last_fullsized":"2023-11-28T11:57:54.979933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:58:02.172295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416119+0000","last_change":"2023-11-28T11:58:02.794762+0000","last_active":"2023-11-28T11:58:05.416119+0000","last_peered":"2023-11-28T11:58:05.416119+0000","last_clean":"2023-11-28T11:58:05.416119+0000","last_became_active":"2023-11-28T11:58:02.794411+0000","last_became_peered":"2023-11-28T11:58:02.794411+0000","last_unstale":"2023-11-28T11:58:05.416119+0000","last_undegraded":"2023-11-28T11:58:05.416119+0000","last_fullsized":"2023-11-28T11:58:05.416119+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:22.234208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:57:55.150466+0000","last_change":"2023-11-28T11:56:34.384999+0000","last_active":"2023-11-28T11:57:55.150466+0000","last_peered":"2023-11-28T11:57:55.150466+0000","last_clean":"2023-11-28T11:57:55.150466+0000","last_became_active":"2023-11-28T11:56:34.384531+0000","last_became_peered":"2023-11-28T11:56:34.384531+0000","last_unstale":"2023-11-28T11:57:55.150466+0000","last_undegraded":"2023-11-28T11:57:55.150466+0000","last_fullsized":"2023-11-28T11:57:55.150466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:09:50.083366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:57:55.152211+0000","last_change":"2023-11-28T11:56:34.389076+0000","last_active":"2023-11-28T11:57:55.152211+0000","last_peered":"2023-11-28T11:57:55.152211+0000","last_clean":"2023-11-28T11:57:55.152211+0000","last_became_active":"2023-11-28T11:56:34.388689+0000","last_became_peered":"2023-11-28T11:56:34.388689+0000","last_unstale":"2023-11-28T11:57:55.152211+0000","last_undegraded":"2023-11-28T11:57:55.152211+0000","last_fullsized":"2023-11-28T11:57:55.152211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:20.936349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416316+0000","last_change":"2023-11-28T11:58:03.263283+0000","last_active":"2023-11-28T11:58:05.416316+0000","last_peered":"2023-11-28T11:58:05.416316+0000","last_clean":"2023-11-28T11:58:05.416316+0000","last_became_active":"2023-11-28T11:58:03.263034+0000","last_became_peered":"2023-11-28T11:58:03.263034+0000","last_unstale":"2023-11-28T11:58:05.416316+0000","last_undegraded":"2023-11-28T11:58:05.416316+0000","last_fullsized":"2023-11-28T11:58:05.416316+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:16:55.873337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T11:58:03.243608+0000","last_change":"2023-11-28T11:56:34.486178+0000","last_active":"2023-11-28T11:58:03.243608+0000","last_peered":"2023-11-28T11:58:03.243608+0000","last_clean":"2023-11-28T11:58:03.243608+0000","last_became_active":"2023-11-28T11:56:34.485702+0000","last_became_peered":"2023-11-28T11:56:34.485702+0000","last_unstale":"2023-11-28T11:58:03.243608+0000","last_undegraded":"2023-11-28T11:58:03.243608+0000","last_fullsized":"2023-11-28T11:58:03.243608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:06.323407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:02.747286+0000","last_change":"2023-11-28T11:58:02.747286+0000","last_active":"2023-11-28T11:58:02.747286+0000","last_peered":"2023-11-28T11:58:02.747286+0000","last_clean":"2023-11-28T11:58:02.747286+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:02.747286+0000","last_undegraded":"2023-11-28T11:58:02.747286+0000","last_fullsized":"2023-11-28T11:58:02.747286+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:57:54.979876+0000","last_change":"2023-11-28T11:56:34.387293+0000","last_active":"2023-11-28T11:57:54.979876+0000","last_peered":"2023-11-28T11:57:54.979876+0000","last_clean":"2023-11-28T11:57:54.979876+0000","last_became_active":"2023-11-28T11:56:34.386976+0000","last_became_peered":"2023-11-28T11:56:34.386976+0000","last_unstale":"2023-11-28T11:57:54.979876+0000","last_undegraded":"2023-11-28T11:57:54.979876+0000","last_fullsized":"2023-11-28T11:57:54.979876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:32.704729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416761+0000","last_change":"2023-11-28T11:58:03.262028+0000","last_active":"2023-11-28T11:58:05.416761+0000","last_peered":"2023-11-28T11:58:05.416761+0000","last_clean":"2023-11-28T11:58:05.416761+0000","last_became_active":"2023-11-28T11:58:03.261783+0000","last_became_peered":"2023-11-28T11:58:03.261783+0000","last_unstale":"2023-11-28T11:58:05.416761+0000","last_undegraded":"2023-11-28T11:58:05.416761+0000","last_fullsized":"2023-11-28T11:58:05.416761+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:33:57.968180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:01.740094+0000","last_change":"2023-11-28T11:58:01.740094+0000","last_active":"2023-11-28T11:58:01.740094+0000","last_peered":"2023-11-28T11:58:01.740094+0000","last_clean":"2023-11-28T11:58:01.740094+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:01.740094+0000","last_undegraded":"2023-11-28T11:58:01.740094+0000","last_fullsized":"2023-11-28T11:58:01.740094+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:57:55.152159+0000","last_change":"2023-11-28T11:56:34.389222+0000","last_active":"2023-11-28T11:57:55.152159+0000","last_peered":"2023-11-28T11:57:55.152159+0000","last_clean":"2023-11-28T11:57:55.152159+0000","last_became_active":"2023-11-28T11:56:34.388671+0000","last_became_peered":"2023-11-28T11:56:34.388671+0000","last_unstale":"2023-11-28T11:57:55.152159+0000","last_undegraded":"2023-11-28T11:57:55.152159+0000","last_fullsized":"2023-11-28T11:57:55.152159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:32.704729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:57:54.979966+0000","last_change":"2023-11-28T11:56:28.472008+0000","last_active":"2023-11-28T11:57:54.979966+0000","last_peered":"2023-11-28T11:57:54.979966+0000","last_clean":"2023-11-28T11:57:54.979966+0000","last_became_active":"2023-11-28T11:56:28.469273+0000","last_became_peered":"2023-11-28T11:56:28.469273+0000","last_unstale":"2023-11-28T11:57:54.979966+0000","last_undegraded":"2023-11-28T11:57:54.979966+0000","last_fullsized":"2023-11-28T11:57:54.979966+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:27.291192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:27.291192+0000","last_clean_scrub_stamp":"2023-11-28T11:56:27.291192+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:14:48.860420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":40,"acting":40,"num_store_stats":2},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1570,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":14,"acting":14,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509462,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9672,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362168,"statfs":{"total":96636764160,"available":96626860032,"internally_reserved":0,"allocated":1048576,"data_stored":786989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.88600000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.052}]},{"osd":2,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.85999999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.6000000000000001,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.117},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.1759999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.0489999999999999,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":0.98399999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":2.4710000000000001,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.081},{"interface":"front","average":{"1min":1.411,"5min":1.411,"15min":1.411},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":1.1379999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.575,"15min":1.575},"min":{"1min":1.266,"5min":1.266,"15min":1.266},"max":{"1min":2.4319999999999999,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.224},{"interface":"front","average":{"1min":1.47,"5min":1.47,"15min":1.47},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":2.468,"5min":2.468,"15min":2.468},"last":1.1930000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509462,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8452,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363388,"statfs":{"total":96636764160,"available":96628109312,"internally_reserved":0,"allocated":454656,"data_stored":196621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.347,"5min":2.347,"15min":2.347},"last":0.75600000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.93500000000000005}]},{"osd":2,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":3.9620000000000002,"5min":3.9620000000000002,"15min":3.9620000000000002},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.91300000000000003}]},{"osd":3,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.081},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":2.0790000000000002,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.109}]},{"osd":4,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.89400000000000002}]},{"osd":5,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":1.4339999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.306}]}]},{"osd":5,"up_from":15,"seq":64424509462,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8452,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363388,"statfs":{"total":96636764160,"available":96628109312,"internally_reserved":0,"allocated":454656,"data_stored":196621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.552}]},{"osd":1,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":1.72},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.3}]},{"osd":2,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":1.595}]},{"osd":3,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.085},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.2490000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.1950000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.28,"15min":1.28},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.355},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":1.0289999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":1.012,"5min":1.012,"15min":1.012},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.335},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.5109999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":8644,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363196,"statfs":{"total":96636764160,"available":96627912704,"internally_reserved":0,"allocated":454656,"data_stored":196621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.167},{"interface":"front","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.397}]},{"osd":1,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.8860000000000001,"5min":2.8860000000000001,"15min":2.8860000000000001},"last":0.59399999999999997}]},{"osd":2,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.3500000000000001,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":3.0630000000000002,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":1.0720000000000001}]},{"osd":3,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.252}]},{"osd":5,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":2.972,"5min":2.972,"15min":2.972},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.4470000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.3500000000000001,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.569,"5min":1.569,"15min":1.569},"min":{"1min":1.038,"5min":1.038,"15min":1.038},"max":{"1min":3.133,"5min":3.133,"15min":3.133},"last":1}]},{"osd":7,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.548,"5min":1.548,"15min":1.548},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":2.2679999999999998,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.492},{"interface":"front","average":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"min":{"1min":1.21,"5min":1.21,"15min":1.21},"max":{"1min":2.198,"5min":2.198,"15min":2.198},"last":1.355}]}]},{"osd":3,"up_from":15,"seq":64424509462,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8580,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363260,"statfs":{"total":96636764160,"available":96627978240,"internally_reserved":0,"allocated":454656,"data_stored":196621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":2.177,"5min":2.177,"15min":2.177},"last":1.248}]},{"osd":1,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.087},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.96999999999999997}]},{"osd":2,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.872},{"interface":"front","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":1.054}]},{"osd":4,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":2.8439999999999999,"5min":2.8439999999999999,"15min":2.8439999999999999},"last":1.29}]},{"osd":5,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.9670000000000001,"5min":2.9670000000000001,"15min":2.9670000000000001},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":3.7429999999999999,"5min":3.7429999999999999,"15min":3.7429999999999999},"last":1.131}]},{"osd":6,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.927,"5min":2.927,"15min":2.927},"last":1.3680000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":3.5030000000000001,"5min":3.5030000000000001,"15min":3.5030000000000001},"last":1.181},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.6320000000000001,"5min":2.6320000000000001,"15min":2.6320000000000001},"last":1.3360000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509462,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8516,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363324,"statfs":{"total":96636764160,"available":96628043776,"internally_reserved":0,"allocated":454656,"data_stored":196621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":2.7469999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":1.0600000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.73599999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.85699999999999998}]},{"osd":4,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":3.411,"5min":3.411,"15min":3.411},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.6680000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":1.208}]},{"osd":5,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":3.6869999999999998,"5min":3.6869999999999998,"15min":3.6869999999999998},"last":1.292},{"interface":"front","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.0609999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.127}]},{"osd":6,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"min":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":3.5379999999999998,"5min":3.5379999999999998,"15min":3.5379999999999998},"last":1.242},{"interface":"front","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.5739999999999998,"5min":2.5739999999999998,"15min":2.5739999999999998},"last":1.2549999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.4249999999999998,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.3200000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542167,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8644,"kb_used_data":508,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363196,"statfs":{"total":96636764160,"available":96627912704,"internally_reserved":0,"allocated":520192,"data_stored":226042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.0860000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.754,"5min":1.754,"15min":1.754},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.66600000000000004}]},{"osd":3,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":1.01},{"interface":"front","average":{"1min":1.3,"5min":1.3,"15min":1.3},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.617,"5min":2.617,"15min":2.617},"last":1.129}]},{"osd":4,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.9620000000000002,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.3860000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":1.3740000000000001}]},{"osd":5,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":2.738,"5min":2.738,"15min":2.738},"last":1.623},{"interface":"front","average":{"1min":1.575,"5min":1.575,"15min":1.575},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":4.0309999999999997,"5min":4.0309999999999997,"15min":4.0309999999999997},"last":1.3100000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":4.2240000000000002,"5min":4.2240000000000002,"15min":4.2240000000000002},"last":1.5720000000000001},{"interface":"front","average":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":3.0750000000000002,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":1.3460000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":2.3660000000000001,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.476},{"interface":"front","average":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":4.3570000000000002,"5min":4.3570000000000002,"15min":4.3570000000000002},"last":1.6719999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542167,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9836,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362004,"statfs":{"total":96636764160,"available":96626692096,"internally_reserved":0,"allocated":1085440,"data_stored":806982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":1.002},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.68000000000000005}]},{"osd":2,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.73499999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.0720000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":3.4809999999999999,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":3.1629999999999998,"5min":3.1629999999999998,"15min":3.1629999999999998},"last":1.2909999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.266,"5min":2.266,"15min":2.266},"last":1.1759999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.4060000000000001,"5min":2.4060000000000001,"15min":2.4060000000000001},"last":1.24},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"max":{"1min":2.3599999999999999,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":1.212}]},{"osd":7,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":2.3330000000000002,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.583,"5min":1.583,"15min":1.583},"min":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"max":{"1min":2.6040000000000001,"5min":2.6040000000000001,"15min":2.6040000000000001},"last":1.2629999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:58:08.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3f is not active+clean 2023-11-28T11:58:08.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3e is not active+clean 2023-11-28T11:58:08.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3d is not active+clean 2023-11-28T11:58:08.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3b is not active+clean 2023-11-28T11:58:08.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3a is not active+clean 2023-11-28T11:58:08.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.39 is not active+clean 2023-11-28T11:58:08.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.34 is not active+clean 2023-11-28T11:58:08.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.31 is not active+clean 2023-11-28T11:58:08.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.30 is not active+clean 2023-11-28T11:58:08.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2f is not active+clean 2023-11-28T11:58:08.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2e is not active+clean 2023-11-28T11:58:08.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2d is not active+clean 2023-11-28T11:58:08.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2b is not active+clean 2023-11-28T11:58:08.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.29 is not active+clean 2023-11-28T11:58:08.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.28 is not active+clean 2023-11-28T11:58:08.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.27 is not active+clean 2023-11-28T11:58:08.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.25 is not active+clean 2023-11-28T11:58:08.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.24 is not active+clean 2023-11-28T11:58:08.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.23 is not active+clean 2023-11-28T11:58:08.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.22 is not active+clean 2023-11-28T11:58:08.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.21 is not active+clean 2023-11-28T11:58:08.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1e is not active+clean 2023-11-28T11:58:08.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2023-11-28T11:58:08.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:01.740094+0000', 'last_change': '2023-11-28T11:58:01.740094+0000', 'last_active': '2023-11-28T11:58:01.740094+0000', 'last_peered': '2023-11-28T11:58:01.740094+0000', 'last_clean': '2023-11-28T11:58:01.740094+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:01.740094+0000', 'last_undegraded': '2023-11-28T11:58:01.740094+0000', 'last_fullsized': '2023-11-28T11:58:01.740094+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2023-11-28T11:58:08.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2023-11-28T11:58:08.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:01.740094+0000', 'last_change': '2023-11-28T11:58:01.740094+0000', 'last_active': '2023-11-28T11:58:01.740094+0000', 'last_peered': '2023-11-28T11:58:01.740094+0000', 'last_clean': '2023-11-28T11:58:01.740094+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:01.740094+0000', 'last_undegraded': '2023-11-28T11:58:01.740094+0000', 'last_fullsized': '2023-11-28T11:58:01.740094+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1c is not active+clean 2023-11-28T11:58:08.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2023-11-28T11:58:08.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:01.740094+0000', 'last_change': '2023-11-28T11:58:01.740094+0000', 'last_active': '2023-11-28T11:58:01.740094+0000', 'last_peered': '2023-11-28T11:58:01.740094+0000', 'last_clean': '2023-11-28T11:58:01.740094+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:01.740094+0000', 'last_undegraded': '2023-11-28T11:58:01.740094+0000', 'last_fullsized': '2023-11-28T11:58:01.740094+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1d is not active+clean 2023-11-28T11:58:08.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2023-11-28T11:58:08.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:01.740094+0000', 'last_change': '2023-11-28T11:58:01.740094+0000', 'last_active': '2023-11-28T11:58:01.740094+0000', 'last_peered': '2023-11-28T11:58:01.740094+0000', 'last_clean': '2023-11-28T11:58:01.740094+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:01.740094+0000', 'last_undegraded': '2023-11-28T11:58:01.740094+0000', 'last_fullsized': '2023-11-28T11:58:01.740094+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2023-11-28T11:58:08.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2023-11-28T11:58:08.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:01.740094+0000', 'last_change': '2023-11-28T11:58:01.740094+0000', 'last_active': '2023-11-28T11:58:01.740094+0000', 'last_peered': '2023-11-28T11:58:01.740094+0000', 'last_clean': '2023-11-28T11:58:01.740094+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:01.740094+0000', 'last_undegraded': '2023-11-28T11:58:01.740094+0000', 'last_fullsized': '2023-11-28T11:58:01.740094+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2023-11-28T11:58:08.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:01.740094+0000', 'last_change': '2023-11-28T11:58:01.740094+0000', 'last_active': '2023-11-28T11:58:01.740094+0000', 'last_peered': '2023-11-28T11:58:01.740094+0000', 'last_clean': '2023-11-28T11:58:01.740094+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:01.740094+0000', 'last_undegraded': '2023-11-28T11:58:01.740094+0000', 'last_fullsized': '2023-11-28T11:58:01.740094+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2023-11-28T11:58:08.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:01.740094+0000', 'last_change': '2023-11-28T11:58:01.740094+0000', 'last_active': '2023-11-28T11:58:01.740094+0000', 'last_peered': '2023-11-28T11:58:01.740094+0000', 'last_clean': '2023-11-28T11:58:01.740094+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:01.740094+0000', 'last_undegraded': '2023-11-28T11:58:01.740094+0000', 'last_fullsized': '2023-11-28T11:58:01.740094+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2023-11-28T11:58:08.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2023-11-28T11:58:08.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2023-11-28T11:58:08.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:01.740094+0000', 'last_change': '2023-11-28T11:58:01.740094+0000', 'last_active': '2023-11-28T11:58:01.740094+0000', 'last_peered': '2023-11-28T11:58:01.740094+0000', 'last_clean': '2023-11-28T11:58:01.740094+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:01.740094+0000', 'last_undegraded': '2023-11-28T11:58:01.740094+0000', 'last_fullsized': '2023-11-28T11:58:01.740094+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2023-11-28T11:58:08.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.14 is not active+clean 2023-11-28T11:58:08.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2023-11-28T11:58:08.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:01.740094+0000', 'last_change': '2023-11-28T11:58:01.740094+0000', 'last_active': '2023-11-28T11:58:01.740094+0000', 'last_peered': '2023-11-28T11:58:01.740094+0000', 'last_clean': '2023-11-28T11:58:01.740094+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:01.740094+0000', 'last_undegraded': '2023-11-28T11:58:01.740094+0000', 'last_fullsized': '2023-11-28T11:58:01.740094+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2023-11-28T11:58:08.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2023-11-28T11:58:08.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.553 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2023-11-28T11:58:08.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:01.740094+0000', 'last_change': '2023-11-28T11:58:01.740094+0000', 'last_active': '2023-11-28T11:58:01.740094+0000', 'last_peered': '2023-11-28T11:58:01.740094+0000', 'last_clean': '2023-11-28T11:58:01.740094+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:01.740094+0000', 'last_undegraded': '2023-11-28T11:58:01.740094+0000', 'last_fullsized': '2023-11-28T11:58:01.740094+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.553 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2023-11-28T11:58:08.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:01.740094+0000', 'last_change': '2023-11-28T11:58:01.740094+0000', 'last_active': '2023-11-28T11:58:01.740094+0000', 'last_peered': '2023-11-28T11:58:01.740094+0000', 'last_clean': '2023-11-28T11:58:01.740094+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:01.740094+0000', 'last_undegraded': '2023-11-28T11:58:01.740094+0000', 'last_fullsized': '2023-11-28T11:58:01.740094+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.553 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.10 is not active+clean 2023-11-28T11:58:08.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.553 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2023-11-28T11:58:08.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:01.740094+0000', 'last_change': '2023-11-28T11:58:01.740094+0000', 'last_active': '2023-11-28T11:58:01.740094+0000', 'last_peered': '2023-11-28T11:58:01.740094+0000', 'last_clean': '2023-11-28T11:58:01.740094+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:01.740094+0000', 'last_undegraded': '2023-11-28T11:58:01.740094+0000', 'last_fullsized': '2023-11-28T11:58:01.740094+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.554 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2023-11-28T11:58:08.554 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.554 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2023-11-28T11:58:08.554 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:01.740094+0000', 'last_change': '2023-11-28T11:58:01.740094+0000', 'last_active': '2023-11-28T11:58:01.740094+0000', 'last_peered': '2023-11-28T11:58:01.740094+0000', 'last_clean': '2023-11-28T11:58:01.740094+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:01.740094+0000', 'last_undegraded': '2023-11-28T11:58:01.740094+0000', 'last_fullsized': '2023-11-28T11:58:01.740094+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.554 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2023-11-28T11:58:08.554 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.554 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2023-11-28T11:58:08.554 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:01.740094+0000', 'last_change': '2023-11-28T11:58:01.740094+0000', 'last_active': '2023-11-28T11:58:01.740094+0000', 'last_peered': '2023-11-28T11:58:01.740094+0000', 'last_clean': '2023-11-28T11:58:01.740094+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:01.740094+0000', 'last_undegraded': '2023-11-28T11:58:01.740094+0000', 'last_fullsized': '2023-11-28T11:58:01.740094+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.554 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2023-11-28T11:58:08.555 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.555 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2023-11-28T11:58:08.555 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:01.740094+0000', 'last_change': '2023-11-28T11:58:01.740094+0000', 'last_active': '2023-11-28T11:58:01.740094+0000', 'last_peered': '2023-11-28T11:58:01.740094+0000', 'last_clean': '2023-11-28T11:58:01.740094+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:01.740094+0000', 'last_undegraded': '2023-11-28T11:58:01.740094+0000', 'last_fullsized': '2023-11-28T11:58:01.740094+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.555 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.a is not active+clean 2023-11-28T11:58:08.555 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.555 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2023-11-28T11:58:08.555 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:01.740094+0000', 'last_change': '2023-11-28T11:58:01.740094+0000', 'last_active': '2023-11-28T11:58:01.740094+0000', 'last_peered': '2023-11-28T11:58:01.740094+0000', 'last_clean': '2023-11-28T11:58:01.740094+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:01.740094+0000', 'last_undegraded': '2023-11-28T11:58:01.740094+0000', 'last_fullsized': '2023-11-28T11:58:01.740094+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.555 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.b is not active+clean 2023-11-28T11:58:08.555 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.555 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2023-11-28T11:58:08.556 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:01.740094+0000', 'last_change': '2023-11-28T11:58:01.740094+0000', 'last_active': '2023-11-28T11:58:01.740094+0000', 'last_peered': '2023-11-28T11:58:01.740094+0000', 'last_clean': '2023-11-28T11:58:01.740094+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:01.740094+0000', 'last_undegraded': '2023-11-28T11:58:01.740094+0000', 'last_fullsized': '2023-11-28T11:58:01.740094+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.556 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2023-11-28T11:58:08.556 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:01.740094+0000', 'last_change': '2023-11-28T11:58:01.740094+0000', 'last_active': '2023-11-28T11:58:01.740094+0000', 'last_peered': '2023-11-28T11:58:01.740094+0000', 'last_clean': '2023-11-28T11:58:01.740094+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:01.740094+0000', 'last_undegraded': '2023-11-28T11:58:01.740094+0000', 'last_fullsized': '2023-11-28T11:58:01.740094+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.556 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2 is not active+clean 2023-11-28T11:58:08.556 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.556 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2023-11-28T11:58:08.556 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:01.740094+0000', 'last_change': '2023-11-28T11:58:01.740094+0000', 'last_active': '2023-11-28T11:58:01.740094+0000', 'last_peered': '2023-11-28T11:58:01.740094+0000', 'last_clean': '2023-11-28T11:58:01.740094+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:01.740094+0000', 'last_undegraded': '2023-11-28T11:58:01.740094+0000', 'last_fullsized': '2023-11-28T11:58:01.740094+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.556 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3 is not active+clean 2023-11-28T11:58:08.556 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.556 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2023-11-28T11:58:08.556 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:01.740094+0000', 'last_change': '2023-11-28T11:58:01.740094+0000', 'last_active': '2023-11-28T11:58:01.740094+0000', 'last_peered': '2023-11-28T11:58:01.740094+0000', 'last_clean': '2023-11-28T11:58:01.740094+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:01.740094+0000', 'last_undegraded': '2023-11-28T11:58:01.740094+0000', 'last_fullsized': '2023-11-28T11:58:01.740094+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.557 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2023-11-28T11:58:08.557 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.557 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2023-11-28T11:58:08.557 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:01.740094+0000', 'last_change': '2023-11-28T11:58:01.740094+0000', 'last_active': '2023-11-28T11:58:01.740094+0000', 'last_peered': '2023-11-28T11:58:01.740094+0000', 'last_clean': '2023-11-28T11:58:01.740094+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:01.740094+0000', 'last_undegraded': '2023-11-28T11:58:01.740094+0000', 'last_fullsized': '2023-11-28T11:58:01.740094+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.557 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2023-11-28T11:58:08.557 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.557 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2023-11-28T11:58:08.557 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.557 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2023-11-28T11:58:08.557 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:01.740094+0000', 'last_change': '2023-11-28T11:58:01.740094+0000', 'last_active': '2023-11-28T11:58:01.740094+0000', 'last_peered': '2023-11-28T11:58:01.740094+0000', 'last_clean': '2023-11-28T11:58:01.740094+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:01.740094+0000', 'last_undegraded': '2023-11-28T11:58:01.740094+0000', 'last_fullsized': '2023-11-28T11:58:01.740094+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.558 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2023-11-28T11:58:08.558 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:01.740094+0000', 'last_change': '2023-11-28T11:58:01.740094+0000', 'last_active': '2023-11-28T11:58:01.740094+0000', 'last_peered': '2023-11-28T11:58:01.740094+0000', 'last_clean': '2023-11-28T11:58:01.740094+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:01.740094+0000', 'last_undegraded': '2023-11-28T11:58:01.740094+0000', 'last_fullsized': '2023-11-28T11:58:01.740094+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.558 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2023-11-28T11:58:08.558 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:02.747286+0000', 'last_change': '2023-11-28T11:58:02.747286+0000', 'last_active': '2023-11-28T11:58:02.747286+0000', 'last_peered': '2023-11-28T11:58:02.747286+0000', 'last_clean': '2023-11-28T11:58:02.747286+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:02.747286+0000', 'last_undegraded': '2023-11-28T11:58:02.747286+0000', 'last_fullsized': '2023-11-28T11:58:02.747286+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:02.747286+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.558 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2023-11-28T11:58:08.558 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:01.740094+0000', 'last_change': '2023-11-28T11:58:01.740094+0000', 'last_active': '2023-11-28T11:58:01.740094+0000', 'last_peered': '2023-11-28T11:58:01.740094+0000', 'last_clean': '2023-11-28T11:58:01.740094+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:01.740094+0000', 'last_undegraded': '2023-11-28T11:58:01.740094+0000', 'last_fullsized': '2023-11-28T11:58:01.740094+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.558 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2023-11-28T11:58:08.558 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:58:01.740094+0000', 'last_change': '2023-11-28T11:58:01.740094+0000', 'last_active': '2023-11-28T11:58:01.740094+0000', 'last_peered': '2023-11-28T11:58:01.740094+0000', 'last_clean': '2023-11-28T11:58:01.740094+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:01.740094+0000', 'last_undegraded': '2023-11-28T11:58:01.740094+0000', 'last_fullsized': '2023-11-28T11:58:01.740094+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:01.740094+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:58:08.559 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-28T11:58:08.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.752+0000 7fc59a8e4700 1 Processor -- start 2023-11-28T11:58:08.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.752+0000 7fc59a8e4700 1 -- start start 2023-11-28T11:58:08.758 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.752+0000 7fc59a8e4700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc594159dd0 0x7fc59415e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:08.758 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.752+0000 7fc59a8e4700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc59406eeb0 0x7fc5940cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:08.758 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.752+0000 7fc59a8e4700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5940cd000 con 0x7fc5940b21f0 2023-11-28T11:58:08.758 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.752+0000 7fc59a8e4700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc59406f350 con 0x7fc594159dd0 2023-11-28T11:58:08.758 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.752+0000 7fc59a8e4700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5940ccb10 con 0x7fc59406eeb0 2023-11-28T11:58:08.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.752+0000 7fc5998e2700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc594159dd0 0x7fc59415e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:08.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.752+0000 7fc5998e2700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc594159dd0 0x7fc59415e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46546/0 (socket says 172.21.15.39:46546) 2023-11-28T11:58:08.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.752+0000 7fc5998e2700 1 -- 172.21.15.39:0/4124548247 learned_addr learned my addr 172.21.15.39:0/4124548247 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:08.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.752+0000 7fc5990e1700 1 --2- 172.21.15.39:0/4124548247 >> v2:172.21.15.184:3300/0 conn(0x7fc59406eeb0 0x7fc5940cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:08.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.752+0000 7fc5998e2700 1 -- 172.21.15.39:0/4124548247 >> v2:172.21.15.184:3300/0 conn(0x7fc59406eeb0 msgr2=0x7fc5940cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:08.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.752+0000 7fc5998e2700 1 --2- 172.21.15.39:0/4124548247 >> v2:172.21.15.184:3300/0 conn(0x7fc59406eeb0 0x7fc5940cc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:08.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.752+0000 7fc5998e2700 1 -- 172.21.15.39:0/4124548247 >> v1:172.21.15.39:6789/0 conn(0x7fc5940b21f0 legacy=0x7fc5940b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:08.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.752+0000 7fc5998e2700 1 -- 172.21.15.39:0/4124548247 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc59415dad0 con 0x7fc594159dd0 2023-11-28T11:58:08.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.752+0000 7fc5998e2700 1 --2- 172.21.15.39:0/4124548247 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc594159dd0 0x7fc59415e550 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc5940cdd40 tx=0x7fc590009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eceffa2c4a6699e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:08.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.756+0000 7fc5988e0700 1 -- 172.21.15.39:0/4124548247 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59000b8a0 con 0x7fc594159dd0 2023-11-28T11:58:08.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.756+0000 7fc5988e0700 1 -- 172.21.15.39:0/4124548247 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59000ba00 con 0x7fc594159dd0 2023-11-28T11:58:08.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.756+0000 7fc5988e0700 1 -- 172.21.15.39:0/4124548247 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59000bd90 con 0x7fc594159dd0 2023-11-28T11:58:08.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.756+0000 7fc59a8e4700 1 -- 172.21.15.39:0/4124548247 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc594159dd0 msgr2=0x7fc59415e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:08.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.756+0000 7fc59a8e4700 1 --2- 172.21.15.39:0/4124548247 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc594159dd0 0x7fc59415e550 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc5940cdd40 tx=0x7fc590009bf0 comp rx=0 tx=0).stop 2023-11-28T11:58:08.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.756+0000 7fc59a8e4700 1 -- 172.21.15.39:0/4124548247 shutdown_connections 2023-11-28T11:58:08.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.756+0000 7fc59a8e4700 1 --2- 172.21.15.39:0/4124548247 >> v2:172.21.15.184:3300/0 conn(0x7fc59406eeb0 0x7fc5940cc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:08.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.756+0000 7fc59a8e4700 1 --2- 172.21.15.39:0/4124548247 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc594159dd0 0x7fc59415e550 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:08.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.756+0000 7fc59a8e4700 1 -- 172.21.15.39:0/4124548247 >> 172.21.15.39:0/4124548247 conn(0x7fc5940cd1f0 msgr2=0x7fc5940cd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:08.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.756+0000 7fc59a8e4700 1 -- 172.21.15.39:0/4124548247 shutdown_connections 2023-11-28T11:58:08.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.756+0000 7fc59a8e4700 1 -- 172.21.15.39:0/4124548247 wait complete. 2023-11-28T11:58:08.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.756+0000 7fc59a8e4700 1 Processor -- start 2023-11-28T11:58:08.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.760+0000 7fc59a8e4700 1 -- start start 2023-11-28T11:58:08.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.760+0000 7fc59a8e4700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc59406eeb0 0x7fc594152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:08.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.760+0000 7fc59a8e4700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5940b21f0 0x7fc5940b50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:08.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.760+0000 7fc59a8e4700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc594159dd0 0x7fc594155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:08.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.760+0000 7fc59a8e4700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5940c4260 con 0x7fc5940b21f0 2023-11-28T11:58:08.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.760+0000 7fc59a8e4700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc594152db0 con 0x7fc59406eeb0 2023-11-28T11:58:08.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.760+0000 7fc59a8e4700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5940ca1e0 con 0x7fc594159dd0 2023-11-28T11:58:08.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.760+0000 7fc5990e1700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5940b21f0 0x7fc5940b50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:08.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.760+0000 7fc5990e1700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5940b21f0 0x7fc5940b50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46550/0 (socket says 172.21.15.39:46550) 2023-11-28T11:58:08.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.760+0000 7fc5990e1700 1 -- 172.21.15.39:0/1609140974 learned_addr learned my addr 172.21.15.39:0/1609140974 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:08.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.760+0000 7fc5998e2700 1 --2- 172.21.15.39:0/1609140974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc59406eeb0 0x7fc594152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:08.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.760+0000 7fc59a0e3700 1 --2- 172.21.15.39:0/1609140974 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc594159dd0 0x7fc594155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:08.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.760+0000 7fc5990e1700 1 -- 172.21.15.39:0/1609140974 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc594159dd0 msgr2=0x7fc594155ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:08.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.760+0000 7fc5990e1700 1 --2- 172.21.15.39:0/1609140974 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc594159dd0 0x7fc594155ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:08.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.760+0000 7fc5990e1700 1 -- 172.21.15.39:0/1609140974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc59406eeb0 msgr2=0x7fc594152870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:08.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.760+0000 7fc5990e1700 1 --2- 172.21.15.39:0/1609140974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc59406eeb0 0x7fc594152870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:08.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.760+0000 7fc5990e1700 1 -- 172.21.15.39:0/1609140974 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc590009570 con 0x7fc5940b21f0 2023-11-28T11:58:08.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.760+0000 7fc5990e1700 1 --2- 172.21.15.39:0/1609140974 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5940b21f0 0x7fc5940b50c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc58400e760 tx=0x7fc58400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:08.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.760+0000 7fc58a7fc700 1 -- 172.21.15.39:0/1609140974 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58400c070 con 0x7fc5940b21f0 2023-11-28T11:58:08.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.764+0000 7fc58a7fc700 1 -- 172.21.15.39:0/1609140974 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc584013610 con 0x7fc5940b21f0 2023-11-28T11:58:08.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.764+0000 7fc59a8e4700 1 -- 172.21.15.39:0/1609140974 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5940ccd20 con 0x7fc5940b21f0 2023-11-28T11:58:08.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.764+0000 7fc58a7fc700 1 -- 172.21.15.39:0/1609140974 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc584013980 con 0x7fc5940b21f0 2023-11-28T11:58:08.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.764+0000 7fc59a8e4700 1 -- 172.21.15.39:0/1609140974 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5940cb130 con 0x7fc5940b21f0 2023-11-28T11:58:08.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.764+0000 7fc59a8e4700 1 -- 172.21.15.39:0/1609140974 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc59415dd70 con 0x7fc5940b21f0 2023-11-28T11:58:08.771 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.764+0000 7fc58a7fc700 1 -- 172.21.15.39:0/1609140974 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc584023070 con 0x7fc5940b21f0 2023-11-28T11:58:08.772 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.768+0000 7fc58a7fc700 1 --2- 172.21.15.39:0/1609140974 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc578064ee0 0x7fc578067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:08.772 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.768+0000 7fc58a7fc700 1 -- 172.21.15.39:0/1609140974 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc584081dc0 con 0x7fc5940b21f0 2023-11-28T11:58:08.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.768+0000 7fc5998e2700 1 --2- 172.21.15.39:0/1609140974 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc578064ee0 0x7fc578067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:08.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.768+0000 7fc5998e2700 1 --2- 172.21.15.39:0/1609140974 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc578064ee0 0x7fc578067390 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc590000c00 tx=0x7fc590008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:08.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:08.772+0000 7fc58a7fc700 1 -- 172.21.15.39:0/1609140974 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc58404fd30 con 0x7fc5940b21f0 2023-11-28T11:58:09.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.004+0000 7fc59a8e4700 1 -- 172.21.15.39:0/1609140974 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fc5940d0560 con 0x7fc5940b21f0 2023-11-28T11:58:09.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.004+0000 7fc58a7fc700 1 -- 172.21.15.39:0/1609140974 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1087 (secure 0 0 0) 0x7fc58400f040 con 0x7fc5940b21f0 2023-11-28T11:58:09.012 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:58:09.012 INFO:teuthology.orchestra.run.smithi039.stdout:{"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":115,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":44,"num_osds":8,"num_up_osds":8,"osd_up_since":1701172586,"num_in_osds":8,"osd_in_since":1701172576,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":69},{"state_name":"active+clean","count":36}],"num_pgs":105,"num_pools":4,"num_objects":11,"data_bytes":591938,"bytes_used":72495104,"bytes_avail":773021618176,"bytes_total":773094113280,"unknown_pgs_ratio":0.65714287757873535,"write_bytes_sec":848,"read_op_per_sec":0,"write_op_per_sec":3},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"d","status":"up:active","gid":5317}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-11-28T11:57:46.574329+0000","services":{}},"progress_events":{}} 2023-11-28T11:58:09.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.008+0000 7fc59a8e4700 1 -- 172.21.15.39:0/1609140974 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc578064ee0 msgr2=0x7fc578067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:09.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.008+0000 7fc59a8e4700 1 --2- 172.21.15.39:0/1609140974 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc578064ee0 0x7fc578067390 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc590000c00 tx=0x7fc590008030 comp rx=0 tx=0).stop 2023-11-28T11:58:09.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.008+0000 7fc59a8e4700 1 -- 172.21.15.39:0/1609140974 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5940b21f0 msgr2=0x7fc5940b50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:09.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.008+0000 7fc59a8e4700 1 --2- 172.21.15.39:0/1609140974 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5940b21f0 0x7fc5940b50c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc58400e760 tx=0x7fc58400ea70 comp rx=0 tx=0).stop 2023-11-28T11:58:09.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.008+0000 7fc59a8e4700 1 -- 172.21.15.39:0/1609140974 shutdown_connections 2023-11-28T11:58:09.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.008+0000 7fc59a8e4700 1 --2- 172.21.15.39:0/1609140974 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc594159dd0 0x7fc594155ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:09.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.008+0000 7fc59a8e4700 1 --2- 172.21.15.39:0/1609140974 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5940b21f0 0x7fc5940b50c0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:09.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.008+0000 7fc59a8e4700 1 --2- 172.21.15.39:0/1609140974 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc578064ee0 0x7fc578067390 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:09.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.008+0000 7fc59a8e4700 1 --2- 172.21.15.39:0/1609140974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc59406eeb0 0x7fc594152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:09.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.008+0000 7fc59a8e4700 1 -- 172.21.15.39:0/1609140974 >> 172.21.15.39:0/1609140974 conn(0x7fc5940cd1f0 msgr2=0x7fc5940af680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:09.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.008+0000 7fc59a8e4700 1 -- 172.21.15.39:0/1609140974 shutdown_connections 2023-11-28T11:58:09.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.008+0000 7fc59a8e4700 1 -- 172.21.15.39:0/1609140974 wait complete. 2023-11-28T11:58:09.037 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-28T11:58:09.037 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:58:09.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.208+0000 7f470c05e700 1 Processor -- start 2023-11-28T11:58:09.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.208+0000 7f470c05e700 1 -- start start 2023-11-28T11:58:09.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.212+0000 7f470c05e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f47041534a0 0x7f470415d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:09.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.212+0000 7f470c05e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f47040b6200 0x7f4704070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:09.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.212+0000 7f470c05e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f470415d080 con 0x7f4704160920 2023-11-28T11:58:09.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.212+0000 7f470c05e700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4704153870 con 0x7f47041534a0 2023-11-28T11:58:09.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.212+0000 7f470c05e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47040b53c0 con 0x7f47040b6200 2023-11-28T11:58:09.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.212+0000 7f4709dfa700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f47041534a0 0x7f470415d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:09.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.212+0000 7f4709dfa700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f47041534a0 0x7f470415d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46552/0 (socket says 172.21.15.39:46552) 2023-11-28T11:58:09.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.212+0000 7f4709dfa700 1 -- 172.21.15.39:0/3492015427 learned_addr learned my addr 172.21.15.39:0/3492015427 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:09.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.212+0000 7f470a5fb700 1 --2- 172.21.15.39:0/3492015427 >> v2:172.21.15.184:3300/0 conn(0x7f47040b6200 0x7f4704070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:09.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.212+0000 7f4709dfa700 1 -- 172.21.15.39:0/3492015427 >> v2:172.21.15.184:3300/0 conn(0x7f47040b6200 msgr2=0x7f4704070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:09.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.212+0000 7f4709dfa700 1 --2- 172.21.15.39:0/3492015427 >> v2:172.21.15.184:3300/0 conn(0x7f47040b6200 0x7f4704070630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:09.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.212+0000 7f4709dfa700 1 -- 172.21.15.39:0/3492015427 >> v1:172.21.15.184:6789/0 conn(0x7f4704160920 legacy=0x7f47040b5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:09.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.212+0000 7f4709dfa700 1 -- 172.21.15.39:0/3492015427 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47040b56a0 con 0x7f47041534a0 2023-11-28T11:58:09.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.212+0000 7f4708df8700 1 -- 172.21.15.39:0/3492015427 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1711582192 0 0) 0x7f470415d080 con 0x7f4704160920 2023-11-28T11:58:09.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.212+0000 7f4709dfa700 1 --2- 172.21.15.39:0/3492015427 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47041534a0 0x7f470415d510 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4704071f60 tx=0x7f4700009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e8eccece825eb19 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:09.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.216+0000 7f4708df8700 1 -- 172.21.15.39:0/3492015427 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4700011830 con 0x7f47041534a0 2023-11-28T11:58:09.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.216+0000 7f4708df8700 1 -- 172.21.15.39:0/3492015427 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4700011990 con 0x7f47041534a0 2023-11-28T11:58:09.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.216+0000 7f4708df8700 1 -- 172.21.15.39:0/3492015427 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4700011d20 con 0x7f47041534a0 2023-11-28T11:58:09.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.216+0000 7f470c05e700 1 -- 172.21.15.39:0/3492015427 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47041534a0 msgr2=0x7f470415d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:09.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.216+0000 7f470c05e700 1 --2- 172.21.15.39:0/3492015427 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47041534a0 0x7f470415d510 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4704071f60 tx=0x7f4700009bf0 comp rx=0 tx=0).stop 2023-11-28T11:58:09.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.216+0000 7f470c05e700 1 -- 172.21.15.39:0/3492015427 shutdown_connections 2023-11-28T11:58:09.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.216+0000 7f470c05e700 1 --2- 172.21.15.39:0/3492015427 >> v2:172.21.15.184:3300/0 conn(0x7f47040b6200 0x7f4704070630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:09.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.216+0000 7f470c05e700 1 --2- 172.21.15.39:0/3492015427 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47041534a0 0x7f470415d510 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:09.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.216+0000 7f470c05e700 1 -- 172.21.15.39:0/3492015427 >> 172.21.15.39:0/3492015427 conn(0x7f470406bfc0 msgr2=0x7f470406c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:09.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.216+0000 7f470c05e700 1 -- 172.21.15.39:0/3492015427 shutdown_connections 2023-11-28T11:58:09.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.216+0000 7f470c05e700 1 -- 172.21.15.39:0/3492015427 wait complete. 2023-11-28T11:58:09.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.216+0000 7f470c05e700 1 Processor -- start 2023-11-28T11:58:09.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.216+0000 7f470c05e700 1 -- start start 2023-11-28T11:58:09.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.220+0000 7f470c05e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47040b6200 0x7f47040d3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:09.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.220+0000 7f470c05e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47041534a0 0x7f47041579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:09.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.220+0000 7f470c05e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4704160920 0x7f47041f1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:09.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.220+0000 7f470c05e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4704158ec0 con 0x7f4704160920 2023-11-28T11:58:09.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.220+0000 7f470c05e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4704158240 con 0x7f47040b6200 2023-11-28T11:58:09.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.220+0000 7f470c05e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4704158520 con 0x7f47041534a0 2023-11-28T11:58:09.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.220+0000 7f470a5fb700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4704160920 0x7f47041f1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:09.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.220+0000 7f470a5fb700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4704160920 0x7f47041f1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46556/0 (socket says 172.21.15.39:46556) 2023-11-28T11:58:09.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.220+0000 7f470a5fb700 1 -- 172.21.15.39:0/3257094879 learned_addr learned my addr 172.21.15.39:0/3257094879 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:09.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.220+0000 7f4709dfa700 1 --2- 172.21.15.39:0/3257094879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47040b6200 0x7f47040d3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:09.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.220+0000 7f47095f9700 1 --2- 172.21.15.39:0/3257094879 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47041534a0 0x7f47041579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:09.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.220+0000 7f470a5fb700 1 -- 172.21.15.39:0/3257094879 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47041534a0 msgr2=0x7f47041579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:09.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.220+0000 7f470a5fb700 1 --2- 172.21.15.39:0/3257094879 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47041534a0 0x7f47041579f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:09.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.220+0000 7f470a5fb700 1 -- 172.21.15.39:0/3257094879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47040b6200 msgr2=0x7f47040d3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:09.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.220+0000 7f470a5fb700 1 --2- 172.21.15.39:0/3257094879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47040b6200 0x7f47040d3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:09.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.220+0000 7f470a5fb700 1 -- 172.21.15.39:0/3257094879 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4700009570 con 0x7f4704160920 2023-11-28T11:58:09.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.220+0000 7f470a5fb700 1 --2- 172.21.15.39:0/3257094879 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4704160920 0x7f47041f1970 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f46fc00efc0 tx=0x7f46fc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:09.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.220+0000 7f46fa7fc700 1 -- 172.21.15.39:0/3257094879 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46fc009ea0 con 0x7f4704160920 2023-11-28T11:58:09.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.220+0000 7f46fa7fc700 1 -- 172.21.15.39:0/3257094879 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46fc00f040 con 0x7f4704160920 2023-11-28T11:58:09.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.220+0000 7f470c05e700 1 -- 172.21.15.39:0/3257094879 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f470415cd10 con 0x7f4704160920 2023-11-28T11:58:09.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.220+0000 7f46fa7fc700 1 -- 172.21.15.39:0/3257094879 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46fc014480 con 0x7f4704160920 2023-11-28T11:58:09.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.220+0000 7f470c05e700 1 -- 172.21.15.39:0/3257094879 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f470415ca30 con 0x7f4704160920 2023-11-28T11:58:09.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.224+0000 7f470c05e700 1 -- 172.21.15.39:0/3257094879 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47040b7f10 con 0x7f4704160920 2023-11-28T11:58:09.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.224+0000 7f46fa7fc700 1 -- 172.21.15.39:0/3257094879 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f46fc0145e0 con 0x7f4704160920 2023-11-28T11:58:09.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.224+0000 7f46fa7fc700 1 --2- 172.21.15.39:0/3257094879 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f46e8064ee0 0x7f46e8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:09.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.224+0000 7f46fa7fc700 1 -- 172.21.15.39:0/3257094879 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f46fc082c80 con 0x7f4704160920 2023-11-28T11:58:09.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.228+0000 7f4709dfa700 1 --2- 172.21.15.39:0/3257094879 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f46e8064ee0 0x7f46e8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:09.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.228+0000 7f4709dfa700 1 --2- 172.21.15.39:0/3257094879 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f46e8064ee0 0x7f46e8067390 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4700000c00 tx=0x7f4700008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:09.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.232+0000 7f46fa7fc700 1 -- 172.21.15.39:0/3257094879 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f46fc050ce0 con 0x7f4704160920 2023-11-28T11:58:09.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.400+0000 7f470c05e700 1 -- 172.21.15.39:0/3257094879 --> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4704158690 con 0x7f46e8064ee0 2023-11-28T11:58:09.423 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.416+0000 7f46fa7fc700 1 -- 172.21.15.39:0/3257094879 <== mgr.4104 v2:172.21.15.184:6832/36166 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309271 (secure 0 0 0) 0x7f4704158690 con 0x7f46e8064ee0 2023-11-28T11:58:09.428 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:58:09.431 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.424+0000 7f470c05e700 1 -- 172.21.15.39:0/3257094879 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f46e8064ee0 msgr2=0x7f46e8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:09.431 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.424+0000 7f470c05e700 1 --2- 172.21.15.39:0/3257094879 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f46e8064ee0 0x7f46e8067390 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4700000c00 tx=0x7f4700008030 comp rx=0 tx=0).stop 2023-11-28T11:58:09.431 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.424+0000 7f470c05e700 1 -- 172.21.15.39:0/3257094879 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4704160920 msgr2=0x7f47041f1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:09.431 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.424+0000 7f470c05e700 1 --2- 172.21.15.39:0/3257094879 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4704160920 0x7f47041f1970 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f46fc00efc0 tx=0x7f46fc00c3a0 comp rx=0 tx=0).stop 2023-11-28T11:58:09.431 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.424+0000 7f470c05e700 1 -- 172.21.15.39:0/3257094879 shutdown_connections 2023-11-28T11:58:09.431 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.424+0000 7f470c05e700 1 --2- 172.21.15.39:0/3257094879 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4704160920 0x7f47041f1970 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:09.431 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.424+0000 7f470c05e700 1 --2- 172.21.15.39:0/3257094879 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47041534a0 0x7f47041579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:09.431 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.424+0000 7f470c05e700 1 --2- 172.21.15.39:0/3257094879 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f46e8064ee0 0x7f46e8067390 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:09.431 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.424+0000 7f470c05e700 1 --2- 172.21.15.39:0/3257094879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47040b6200 0x7f47040d3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:09.431 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.424+0000 7f470c05e700 1 -- 172.21.15.39:0/3257094879 >> 172.21.15.39:0/3257094879 conn(0x7f470406bfc0 msgr2=0x7f470415e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:09.431 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.424+0000 7f470c05e700 1 -- 172.21.15.39:0/3257094879 shutdown_connections 2023-11-28T11:58:09.431 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:09.424+0000 7f470c05e700 1 -- 172.21.15.39:0/3257094879 wait complete. 2023-11-28T11:58:09.432 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2023-11-28T11:58:09.451 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2023-11-28T11:58:08.581265+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":168,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":72088,"kb_used_data":5144,"kb_used_omap":0,"kb_used_meta":66880,"kb_avail":754902632,"statfs":{"total":773094113280,"available":773020295168,"internally_reserved":0,"allocated":5267456,"data_stored":2973280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68485120},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002009"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.552748+0000","last_change":"2023-11-28T11:58:03.270216+0000","last_active":"2023-11-28T11:58:04.552748+0000","last_peered":"2023-11-28T11:58:04.552748+0000","last_clean":"2023-11-28T11:58:04.552748+0000","last_became_active":"2023-11-28T11:58:03.269922+0000","last_became_peered":"2023-11-28T11:58:03.269922+0000","last_unstale":"2023-11-28T11:58:04.552748+0000","last_undegraded":"2023-11-28T11:58:04.552748+0000","last_fullsized":"2023-11-28T11:58:04.552748+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:33:55.992729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.412291+0000","last_change":"2023-11-28T11:58:03.266449+0000","last_active":"2023-11-28T11:58:05.412291+0000","last_peered":"2023-11-28T11:58:05.412291+0000","last_clean":"2023-11-28T11:58:05.412291+0000","last_became_active":"2023-11-28T11:58:03.266041+0000","last_became_peered":"2023-11-28T11:58:03.266041+0000","last_unstale":"2023-11-28T11:58:05.412291+0000","last_undegraded":"2023-11-28T11:58:05.412291+0000","last_fullsized":"2023-11-28T11:58:05.412291+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:28:32.437170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.937443+0000","last_change":"2023-11-28T11:58:03.270342+0000","last_active":"2023-11-28T11:58:04.937443+0000","last_peered":"2023-11-28T11:58:04.937443+0000","last_clean":"2023-11-28T11:58:04.937443+0000","last_became_active":"2023-11-28T11:58:03.270091+0000","last_became_peered":"2023-11-28T11:58:03.270091+0000","last_unstale":"2023-11-28T11:58:04.937443+0000","last_undegraded":"2023-11-28T11:58:04.937443+0000","last_fullsized":"2023-11-28T11:58:04.937443+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:24:20.457472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416453+0000","last_change":"2023-11-28T11:58:03.280494+0000","last_active":"2023-11-28T11:58:05.416453+0000","last_peered":"2023-11-28T11:58:05.416453+0000","last_clean":"2023-11-28T11:58:05.416453+0000","last_became_active":"2023-11-28T11:58:03.273934+0000","last_became_peered":"2023-11-28T11:58:03.273934+0000","last_unstale":"2023-11-28T11:58:05.416453+0000","last_undegraded":"2023-11-28T11:58:05.416453+0000","last_fullsized":"2023-11-28T11:58:05.416453+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:56:29.140993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.411863+0000","last_change":"2023-11-28T11:58:03.275390+0000","last_active":"2023-11-28T11:58:05.411863+0000","last_peered":"2023-11-28T11:58:05.411863+0000","last_clean":"2023-11-28T11:58:05.411863+0000","last_became_active":"2023-11-28T11:58:03.275106+0000","last_became_peered":"2023-11-28T11:58:03.275106+0000","last_unstale":"2023-11-28T11:58:05.411863+0000","last_undegraded":"2023-11-28T11:58:05.411863+0000","last_fullsized":"2023-11-28T11:58:05.411863+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:30:06.175061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.248648+0000","last_change":"2023-11-28T11:58:03.263018+0000","last_active":"2023-11-28T11:58:04.248648+0000","last_peered":"2023-11-28T11:58:04.248648+0000","last_clean":"2023-11-28T11:58:04.248648+0000","last_became_active":"2023-11-28T11:58:03.262759+0000","last_became_peered":"2023-11-28T11:58:03.262759+0000","last_unstale":"2023-11-28T11:58:04.248648+0000","last_undegraded":"2023-11-28T11:58:04.248648+0000","last_fullsized":"2023-11-28T11:58:04.248648+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:11:43.926744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.552172+0000","last_change":"2023-11-28T11:58:03.267202+0000","last_active":"2023-11-28T11:58:04.552172+0000","last_peered":"2023-11-28T11:58:04.552172+0000","last_clean":"2023-11-28T11:58:04.552172+0000","last_became_active":"2023-11-28T11:58:03.266928+0000","last_became_peered":"2023-11-28T11:58:03.266928+0000","last_unstale":"2023-11-28T11:58:04.552172+0000","last_undegraded":"2023-11-28T11:58:04.552172+0000","last_fullsized":"2023-11-28T11:58:04.552172+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:30:06.175061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.415739+0000","last_change":"2023-11-28T11:58:03.278569+0000","last_active":"2023-11-28T11:58:05.415739+0000","last_peered":"2023-11-28T11:58:05.415739+0000","last_clean":"2023-11-28T11:58:05.415739+0000","last_became_active":"2023-11-28T11:58:03.278191+0000","last_became_peered":"2023-11-28T11:58:03.278191+0000","last_unstale":"2023-11-28T11:58:05.415739+0000","last_undegraded":"2023-11-28T11:58:05.415739+0000","last_fullsized":"2023-11-28T11:58:05.415739+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:14.419715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416724+0000","last_change":"2023-11-28T11:58:03.265015+0000","last_active":"2023-11-28T11:58:05.416724+0000","last_peered":"2023-11-28T11:58:05.416724+0000","last_clean":"2023-11-28T11:58:05.416724+0000","last_became_active":"2023-11-28T11:58:03.264639+0000","last_became_peered":"2023-11-28T11:58:03.264639+0000","last_unstale":"2023-11-28T11:58:05.416724+0000","last_undegraded":"2023-11-28T11:58:05.416724+0000","last_fullsized":"2023-11-28T11:58:05.416724+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:16:51.122441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416633+0000","last_change":"2023-11-28T11:58:03.283239+0000","last_active":"2023-11-28T11:58:05.416633+0000","last_peered":"2023-11-28T11:58:05.416633+0000","last_clean":"2023-11-28T11:58:05.416633+0000","last_became_active":"2023-11-28T11:58:03.280251+0000","last_became_peered":"2023-11-28T11:58:03.280251+0000","last_unstale":"2023-11-28T11:58:05.416633+0000","last_undegraded":"2023-11-28T11:58:05.416633+0000","last_fullsized":"2023-11-28T11:58:05.416633+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:36:30.647196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416432+0000","last_change":"2023-11-28T11:58:03.258812+0000","last_active":"2023-11-28T11:58:05.416432+0000","last_peered":"2023-11-28T11:58:05.416432+0000","last_clean":"2023-11-28T11:58:05.416432+0000","last_became_active":"2023-11-28T11:58:03.258368+0000","last_became_peered":"2023-11-28T11:58:03.258368+0000","last_unstale":"2023-11-28T11:58:05.416432+0000","last_undegraded":"2023-11-28T11:58:05.416432+0000","last_fullsized":"2023-11-28T11:58:05.416432+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:18:48.890788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.411765+0000","last_change":"2023-11-28T11:58:03.268545+0000","last_active":"2023-11-28T11:58:05.411765+0000","last_peered":"2023-11-28T11:58:05.411765+0000","last_clean":"2023-11-28T11:58:05.411765+0000","last_became_active":"2023-11-28T11:58:03.268005+0000","last_became_peered":"2023-11-28T11:58:03.268005+0000","last_unstale":"2023-11-28T11:58:05.411765+0000","last_undegraded":"2023-11-28T11:58:05.411765+0000","last_fullsized":"2023-11-28T11:58:05.411765+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:15.258186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.246940+0000","last_change":"2023-11-28T11:58:03.263075+0000","last_active":"2023-11-28T11:58:04.246940+0000","last_peered":"2023-11-28T11:58:04.246940+0000","last_clean":"2023-11-28T11:58:04.246940+0000","last_became_active":"2023-11-28T11:58:03.262800+0000","last_became_peered":"2023-11-28T11:58:03.262800+0000","last_unstale":"2023-11-28T11:58:04.246940+0000","last_undegraded":"2023-11-28T11:58:04.246940+0000","last_fullsized":"2023-11-28T11:58:04.246940+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:36:07.713099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.415805+0000","last_change":"2023-11-28T11:58:03.265606+0000","last_active":"2023-11-28T11:58:05.415805+0000","last_peered":"2023-11-28T11:58:05.415805+0000","last_clean":"2023-11-28T11:58:05.415805+0000","last_became_active":"2023-11-28T11:58:03.265347+0000","last_became_peered":"2023-11-28T11:58:03.265347+0000","last_unstale":"2023-11-28T11:58:05.415805+0000","last_undegraded":"2023-11-28T11:58:05.415805+0000","last_fullsized":"2023-11-28T11:58:05.415805+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:17:11.155874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.248302+0000","last_change":"2023-11-28T11:58:03.263871+0000","last_active":"2023-11-28T11:58:04.248302+0000","last_peered":"2023-11-28T11:58:04.248302+0000","last_clean":"2023-11-28T11:58:04.248302+0000","last_became_active":"2023-11-28T11:58:03.263630+0000","last_became_peered":"2023-11-28T11:58:03.263630+0000","last_unstale":"2023-11-28T11:58:04.248302+0000","last_undegraded":"2023-11-28T11:58:04.248302+0000","last_fullsized":"2023-11-28T11:58:04.248302+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:52:47.083282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.246279+0000","last_change":"2023-11-28T11:58:03.266537+0000","last_active":"2023-11-28T11:58:04.246279+0000","last_peered":"2023-11-28T11:58:04.246279+0000","last_clean":"2023-11-28T11:58:04.246279+0000","last_became_active":"2023-11-28T11:58:03.262136+0000","last_became_peered":"2023-11-28T11:58:03.262136+0000","last_unstale":"2023-11-28T11:58:04.246279+0000","last_undegraded":"2023-11-28T11:58:04.246279+0000","last_fullsized":"2023-11-28T11:58:04.246279+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:54.460812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.937776+0000","last_change":"2023-11-28T11:58:03.270088+0000","last_active":"2023-11-28T11:58:04.937776+0000","last_peered":"2023-11-28T11:58:04.937776+0000","last_clean":"2023-11-28T11:58:04.937776+0000","last_became_active":"2023-11-28T11:58:03.269805+0000","last_became_peered":"2023-11-28T11:58:03.269805+0000","last_unstale":"2023-11-28T11:58:04.937776+0000","last_undegraded":"2023-11-28T11:58:04.937776+0000","last_fullsized":"2023-11-28T11:58:04.937776+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:08:37.723634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.937378+0000","last_change":"2023-11-28T11:58:03.276821+0000","last_active":"2023-11-28T11:58:04.937378+0000","last_peered":"2023-11-28T11:58:04.937378+0000","last_clean":"2023-11-28T11:58:04.937378+0000","last_became_active":"2023-11-28T11:58:03.276560+0000","last_became_peered":"2023-11-28T11:58:03.276560+0000","last_unstale":"2023-11-28T11:58:04.937378+0000","last_undegraded":"2023-11-28T11:58:04.937378+0000","last_fullsized":"2023-11-28T11:58:04.937378+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:52:47.083282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.246861+0000","last_change":"2023-11-28T11:58:03.259943+0000","last_active":"2023-11-28T11:58:04.246861+0000","last_peered":"2023-11-28T11:58:04.246861+0000","last_clean":"2023-11-28T11:58:04.246861+0000","last_became_active":"2023-11-28T11:58:03.259341+0000","last_became_peered":"2023-11-28T11:58:03.259341+0000","last_unstale":"2023-11-28T11:58:04.246861+0000","last_undegraded":"2023-11-28T11:58:04.246861+0000","last_fullsized":"2023-11-28T11:58:04.246861+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:43:10.142409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.247370+0000","last_change":"2023-11-28T11:58:03.261719+0000","last_active":"2023-11-28T11:58:04.247370+0000","last_peered":"2023-11-28T11:58:04.247370+0000","last_clean":"2023-11-28T11:58:04.247370+0000","last_became_active":"2023-11-28T11:58:03.261481+0000","last_became_peered":"2023-11-28T11:58:03.261481+0000","last_unstale":"2023-11-28T11:58:04.247370+0000","last_undegraded":"2023-11-28T11:58:04.247370+0000","last_fullsized":"2023-11-28T11:58:04.247370+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:49:56.935045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.248719+0000","last_change":"2023-11-28T11:58:03.272263+0000","last_active":"2023-11-28T11:58:04.248719+0000","last_peered":"2023-11-28T11:58:04.248719+0000","last_clean":"2023-11-28T11:58:04.248719+0000","last_became_active":"2023-11-28T11:58:03.271919+0000","last_became_peered":"2023-11-28T11:58:03.271919+0000","last_unstale":"2023-11-28T11:58:04.248719+0000","last_undegraded":"2023-11-28T11:58:04.248719+0000","last_fullsized":"2023-11-28T11:58:04.248719+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:19:45.288978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.415975+0000","last_change":"2023-11-28T11:58:03.280229+0000","last_active":"2023-11-28T11:58:05.415975+0000","last_peered":"2023-11-28T11:58:05.415975+0000","last_clean":"2023-11-28T11:58:05.415975+0000","last_became_active":"2023-11-28T11:58:03.274838+0000","last_became_peered":"2023-11-28T11:58:03.274838+0000","last_unstale":"2023-11-28T11:58:05.415975+0000","last_undegraded":"2023-11-28T11:58:05.415975+0000","last_fullsized":"2023-11-28T11:58:05.415975+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:54:40.637592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.246253+0000","last_change":"2023-11-28T11:58:03.267816+0000","last_active":"2023-11-28T11:58:04.246253+0000","last_peered":"2023-11-28T11:58:04.246253+0000","last_clean":"2023-11-28T11:58:04.246253+0000","last_became_active":"2023-11-28T11:58:03.267536+0000","last_became_peered":"2023-11-28T11:58:03.267536+0000","last_unstale":"2023-11-28T11:58:04.246253+0000","last_undegraded":"2023-11-28T11:58:04.246253+0000","last_fullsized":"2023-11-28T11:58:04.246253+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:08:59.303593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.246182+0000","last_change":"2023-11-28T11:58:03.266282+0000","last_active":"2023-11-28T11:58:04.246182+0000","last_peered":"2023-11-28T11:58:04.246182+0000","last_clean":"2023-11-28T11:58:04.246182+0000","last_became_active":"2023-11-28T11:58:03.262340+0000","last_became_peered":"2023-11-28T11:58:03.262340+0000","last_unstale":"2023-11-28T11:58:04.246182+0000","last_undegraded":"2023-11-28T11:58:04.246182+0000","last_fullsized":"2023-11-28T11:58:04.246182+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:44:11.868082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.246645+0000","last_change":"2023-11-28T11:58:03.260694+0000","last_active":"2023-11-28T11:58:04.246645+0000","last_peered":"2023-11-28T11:58:04.246645+0000","last_clean":"2023-11-28T11:58:04.246645+0000","last_became_active":"2023-11-28T11:58:03.260382+0000","last_became_peered":"2023-11-28T11:58:03.260382+0000","last_unstale":"2023-11-28T11:58:04.246645+0000","last_undegraded":"2023-11-28T11:58:04.246645+0000","last_fullsized":"2023-11-28T11:58:04.246645+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:42:11.493385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.248044+0000","last_change":"2023-11-28T11:58:03.263235+0000","last_active":"2023-11-28T11:58:04.248044+0000","last_peered":"2023-11-28T11:58:04.248044+0000","last_clean":"2023-11-28T11:58:04.248044+0000","last_became_active":"2023-11-28T11:58:03.262984+0000","last_became_peered":"2023-11-28T11:58:03.262984+0000","last_unstale":"2023-11-28T11:58:04.248044+0000","last_undegraded":"2023-11-28T11:58:04.248044+0000","last_fullsized":"2023-11-28T11:58:04.248044+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:25:52.304471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.937507+0000","last_change":"2023-11-28T11:58:03.273450+0000","last_active":"2023-11-28T11:58:04.937507+0000","last_peered":"2023-11-28T11:58:04.937507+0000","last_clean":"2023-11-28T11:58:04.937507+0000","last_became_active":"2023-11-28T11:58:03.271689+0000","last_became_peered":"2023-11-28T11:58:03.271689+0000","last_unstale":"2023-11-28T11:58:04.937507+0000","last_undegraded":"2023-11-28T11:58:04.937507+0000","last_fullsized":"2023-11-28T11:58:04.937507+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:13:06.602427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.411809+0000","last_change":"2023-11-28T11:58:03.268284+0000","last_active":"2023-11-28T11:58:05.411809+0000","last_peered":"2023-11-28T11:58:05.411809+0000","last_clean":"2023-11-28T11:58:05.411809+0000","last_became_active":"2023-11-28T11:58:03.267661+0000","last_became_peered":"2023-11-28T11:58:03.267661+0000","last_unstale":"2023-11-28T11:58:05.411809+0000","last_undegraded":"2023-11-28T11:58:05.411809+0000","last_fullsized":"2023-11-28T11:58:05.411809+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:07.970088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.246625+0000","last_change":"2023-11-28T11:58:03.265238+0000","last_active":"2023-11-28T11:58:04.246625+0000","last_peered":"2023-11-28T11:58:04.246625+0000","last_clean":"2023-11-28T11:58:04.246625+0000","last_became_active":"2023-11-28T11:58:03.264888+0000","last_became_peered":"2023-11-28T11:58:03.264888+0000","last_unstale":"2023-11-28T11:58:04.246625+0000","last_undegraded":"2023-11-28T11:58:04.246625+0000","last_fullsized":"2023-11-28T11:58:04.246625+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:52:44.555111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.937179+0000","last_change":"2023-11-28T11:58:03.263887+0000","last_active":"2023-11-28T11:58:04.937179+0000","last_peered":"2023-11-28T11:58:04.937179+0000","last_clean":"2023-11-28T11:58:04.937179+0000","last_became_active":"2023-11-28T11:58:03.263539+0000","last_became_peered":"2023-11-28T11:58:03.263539+0000","last_unstale":"2023-11-28T11:58:04.937179+0000","last_undegraded":"2023-11-28T11:58:04.937179+0000","last_fullsized":"2023-11-28T11:58:04.937179+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:23:52.213219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.248471+0000","last_change":"2023-11-28T11:58:03.272795+0000","last_active":"2023-11-28T11:58:04.248471+0000","last_peered":"2023-11-28T11:58:04.248471+0000","last_clean":"2023-11-28T11:58:04.248471+0000","last_became_active":"2023-11-28T11:58:03.272545+0000","last_became_peered":"2023-11-28T11:58:03.272545+0000","last_unstale":"2023-11-28T11:58:04.248471+0000","last_undegraded":"2023-11-28T11:58:04.248471+0000","last_fullsized":"2023-11-28T11:58:04.248471+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:13:06.602427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.246306+0000","last_change":"2023-11-28T11:58:03.254255+0000","last_active":"2023-11-28T11:58:04.246306+0000","last_peered":"2023-11-28T11:58:04.246306+0000","last_clean":"2023-11-28T11:58:04.246306+0000","last_became_active":"2023-11-28T11:58:03.253952+0000","last_became_peered":"2023-11-28T11:58:03.253952+0000","last_unstale":"2023-11-28T11:58:04.246306+0000","last_undegraded":"2023-11-28T11:58:04.246306+0000","last_fullsized":"2023-11-28T11:58:04.246306+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:16:15.666991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.846828+0000","last_change":"2023-11-28T11:58:03.265801+0000","last_active":"2023-11-28T11:58:04.846828+0000","last_peered":"2023-11-28T11:58:04.846828+0000","last_clean":"2023-11-28T11:58:04.846828+0000","last_became_active":"2023-11-28T11:58:03.265565+0000","last_became_peered":"2023-11-28T11:58:03.265565+0000","last_unstale":"2023-11-28T11:58:04.846828+0000","last_undegraded":"2023-11-28T11:58:04.846828+0000","last_fullsized":"2023-11-28T11:58:04.846828+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:43:59.166062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"43'4","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.249449+0000","last_change":"2023-11-28T11:58:02.782611+0000","last_active":"2023-11-28T11:58:04.249449+0000","last_peered":"2023-11-28T11:58:04.249449+0000","last_clean":"2023-11-28T11:58:04.249449+0000","last_became_active":"2023-11-28T11:58:02.779458+0000","last_became_peered":"2023-11-28T11:58:02.779458+0000","last_unstale":"2023-11-28T11:58:04.249449+0000","last_undegraded":"2023-11-28T11:58:04.249449+0000","last_fullsized":"2023-11-28T11:58:04.249449+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:22:06.273063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.246609+0000","last_change":"2023-11-28T11:58:03.273965+0000","last_active":"2023-11-28T11:58:04.246609+0000","last_peered":"2023-11-28T11:58:04.246609+0000","last_clean":"2023-11-28T11:58:04.246609+0000","last_became_active":"2023-11-28T11:58:03.269167+0000","last_became_peered":"2023-11-28T11:58:03.269167+0000","last_unstale":"2023-11-28T11:58:04.246609+0000","last_undegraded":"2023-11-28T11:58:04.246609+0000","last_fullsized":"2023-11-28T11:58:04.246609+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:43:59.166062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"43'1","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.937718+0000","last_change":"2023-11-28T11:58:02.794227+0000","last_active":"2023-11-28T11:58:04.937718+0000","last_peered":"2023-11-28T11:58:04.937718+0000","last_clean":"2023-11-28T11:58:04.937718+0000","last_became_active":"2023-11-28T11:58:02.793925+0000","last_became_peered":"2023-11-28T11:58:02.793925+0000","last_unstale":"2023-11-28T11:58:04.937718+0000","last_undegraded":"2023-11-28T11:58:04.937718+0000","last_fullsized":"2023-11-28T11:58:04.937718+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:22:06.273063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.412081+0000","last_change":"2023-11-28T11:58:03.279736+0000","last_active":"2023-11-28T11:58:05.412081+0000","last_peered":"2023-11-28T11:58:05.412081+0000","last_clean":"2023-11-28T11:58:05.412081+0000","last_became_active":"2023-11-28T11:58:03.279479+0000","last_became_peered":"2023-11-28T11:58:03.279479+0000","last_unstale":"2023-11-28T11:58:05.412081+0000","last_undegraded":"2023-11-28T11:58:05.412081+0000","last_fullsized":"2023-11-28T11:58:05.412081+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:35:55.672200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"43'2","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.846959+0000","last_change":"2023-11-28T11:58:02.781115+0000","last_active":"2023-11-28T11:58:04.846959+0000","last_peered":"2023-11-28T11:58:04.846959+0000","last_clean":"2023-11-28T11:58:04.846959+0000","last_became_active":"2023-11-28T11:58:02.780802+0000","last_became_peered":"2023-11-28T11:58:02.780802+0000","last_unstale":"2023-11-28T11:58:04.846959+0000","last_undegraded":"2023-11-28T11:58:04.846959+0000","last_fullsized":"2023-11-28T11:58:04.846959+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:53.453620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.846839+0000","last_change":"2023-11-28T11:58:03.276028+0000","last_active":"2023-11-28T11:58:04.846839+0000","last_peered":"2023-11-28T11:58:04.846839+0000","last_clean":"2023-11-28T11:58:04.846839+0000","last_became_active":"2023-11-28T11:58:03.275659+0000","last_became_peered":"2023-11-28T11:58:03.275659+0000","last_unstale":"2023-11-28T11:58:04.846839+0000","last_undegraded":"2023-11-28T11:58:04.846839+0000","last_fullsized":"2023-11-28T11:58:04.846839+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:42:11.493385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"43'2","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.552383+0000","last_change":"2023-11-28T11:58:02.779978+0000","last_active":"2023-11-28T11:58:04.552383+0000","last_peered":"2023-11-28T11:58:04.552383+0000","last_clean":"2023-11-28T11:58:04.552383+0000","last_became_active":"2023-11-28T11:58:02.779643+0000","last_became_peered":"2023-11-28T11:58:02.779643+0000","last_unstale":"2023-11-28T11:58:04.552383+0000","last_undegraded":"2023-11-28T11:58:04.552383+0000","last_fullsized":"2023-11-28T11:58:04.552383+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:34:57.055750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.937270+0000","last_change":"2023-11-28T11:58:03.275992+0000","last_active":"2023-11-28T11:58:04.937270+0000","last_peered":"2023-11-28T11:58:04.937270+0000","last_clean":"2023-11-28T11:58:04.937270+0000","last_became_active":"2023-11-28T11:58:03.275682+0000","last_became_peered":"2023-11-28T11:58:03.275682+0000","last_unstale":"2023-11-28T11:58:04.937270+0000","last_undegraded":"2023-11-28T11:58:04.937270+0000","last_fullsized":"2023-11-28T11:58:04.937270+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:18:38.026787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"43'1","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.248868+0000","last_change":"2023-11-28T11:58:02.788881+0000","last_active":"2023-11-28T11:58:04.248868+0000","last_peered":"2023-11-28T11:58:04.248868+0000","last_clean":"2023-11-28T11:58:04.248868+0000","last_became_active":"2023-11-28T11:58:02.786632+0000","last_became_peered":"2023-11-28T11:58:02.786632+0000","last_unstale":"2023-11-28T11:58:04.248868+0000","last_undegraded":"2023-11-28T11:58:04.248868+0000","last_fullsized":"2023-11-28T11:58:04.248868+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:11:26.588287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416165+0000","last_change":"2023-11-28T11:58:03.258600+0000","last_active":"2023-11-28T11:58:05.416165+0000","last_peered":"2023-11-28T11:58:05.416165+0000","last_clean":"2023-11-28T11:58:05.416165+0000","last_became_active":"2023-11-28T11:58:03.258321+0000","last_became_peered":"2023-11-28T11:58:03.258321+0000","last_unstale":"2023-11-28T11:58:05.416165+0000","last_undegraded":"2023-11-28T11:58:05.416165+0000","last_fullsized":"2023-11-28T11:58:05.416165+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:44:36.459418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"43'1","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.937333+0000","last_change":"2023-11-28T11:58:02.788473+0000","last_active":"2023-11-28T11:58:04.937333+0000","last_peered":"2023-11-28T11:58:04.937333+0000","last_clean":"2023-11-28T11:58:04.937333+0000","last_became_active":"2023-11-28T11:58:02.788148+0000","last_became_peered":"2023-11-28T11:58:02.788148+0000","last_unstale":"2023-11-28T11:58:04.937333+0000","last_undegraded":"2023-11-28T11:58:04.937333+0000","last_fullsized":"2023-11-28T11:58:04.937333+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:11:26.588287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.415894+0000","last_change":"2023-11-28T11:58:03.283663+0000","last_active":"2023-11-28T11:58:05.415894+0000","last_peered":"2023-11-28T11:58:05.415894+0000","last_clean":"2023-11-28T11:58:05.415894+0000","last_became_active":"2023-11-28T11:58:03.274952+0000","last_became_peered":"2023-11-28T11:58:03.274952+0000","last_unstale":"2023-11-28T11:58:05.415894+0000","last_undegraded":"2023-11-28T11:58:05.415894+0000","last_fullsized":"2023-11-28T11:58:05.415894+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:01.925469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.411452+0000","last_change":"2023-11-28T11:58:02.787112+0000","last_active":"2023-11-28T11:58:05.411452+0000","last_peered":"2023-11-28T11:58:05.411452+0000","last_clean":"2023-11-28T11:58:05.411452+0000","last_became_active":"2023-11-28T11:58:02.786428+0000","last_became_peered":"2023-11-28T11:58:02.786428+0000","last_unstale":"2023-11-28T11:58:05.411452+0000","last_undegraded":"2023-11-28T11:58:05.411452+0000","last_fullsized":"2023-11-28T11:58:05.411452+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:52:43.547919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.246164+0000","last_change":"2023-11-28T11:58:03.267713+0000","last_active":"2023-11-28T11:58:04.246164+0000","last_peered":"2023-11-28T11:58:04.246164+0000","last_clean":"2023-11-28T11:58:04.246164+0000","last_became_active":"2023-11-28T11:58:03.267395+0000","last_became_peered":"2023-11-28T11:58:03.267395+0000","last_unstale":"2023-11-28T11:58:04.246164+0000","last_undegraded":"2023-11-28T11:58:04.246164+0000","last_fullsized":"2023-11-28T11:58:04.246164+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:52:31.322927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.415904+0000","last_change":"2023-11-28T11:58:02.785023+0000","last_active":"2023-11-28T11:58:05.415904+0000","last_peered":"2023-11-28T11:58:05.415904+0000","last_clean":"2023-11-28T11:58:05.415904+0000","last_became_active":"2023-11-28T11:58:02.784685+0000","last_became_peered":"2023-11-28T11:58:02.784685+0000","last_unstale":"2023-11-28T11:58:05.415904+0000","last_undegraded":"2023-11-28T11:58:05.415904+0000","last_fullsized":"2023-11-28T11:58:05.415904+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:27:27.811854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.937514+0000","last_change":"2023-11-28T11:58:03.271095+0000","last_active":"2023-11-28T11:58:04.937514+0000","last_peered":"2023-11-28T11:58:04.937514+0000","last_clean":"2023-11-28T11:58:04.937514+0000","last_became_active":"2023-11-28T11:58:03.270831+0000","last_became_peered":"2023-11-28T11:58:03.270831+0000","last_unstale":"2023-11-28T11:58:04.937514+0000","last_undegraded":"2023-11-28T11:58:04.937514+0000","last_fullsized":"2023-11-28T11:58:04.937514+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:39.242400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.937860+0000","last_change":"2023-11-28T11:58:02.788193+0000","last_active":"2023-11-28T11:58:04.937860+0000","last_peered":"2023-11-28T11:58:04.937860+0000","last_clean":"2023-11-28T11:58:04.937860+0000","last_became_active":"2023-11-28T11:58:02.787539+0000","last_became_peered":"2023-11-28T11:58:02.787539+0000","last_unstale":"2023-11-28T11:58:04.937860+0000","last_undegraded":"2023-11-28T11:58:04.937860+0000","last_fullsized":"2023-11-28T11:58:04.937860+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:30:05.167869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.552998+0000","last_change":"2023-11-28T11:58:03.272411+0000","last_active":"2023-11-28T11:58:04.552998+0000","last_peered":"2023-11-28T11:58:04.552998+0000","last_clean":"2023-11-28T11:58:04.552998+0000","last_became_active":"2023-11-28T11:58:03.272106+0000","last_became_peered":"2023-11-28T11:58:03.272106+0000","last_unstale":"2023-11-28T11:58:04.552998+0000","last_undegraded":"2023-11-28T11:58:04.552998+0000","last_fullsized":"2023-11-28T11:58:04.552998+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:07.970088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416772+0000","last_change":"2023-11-28T11:58:02.778715+0000","last_active":"2023-11-28T11:58:05.416772+0000","last_peered":"2023-11-28T11:58:05.416772+0000","last_clean":"2023-11-28T11:58:05.416772+0000","last_became_active":"2023-11-28T11:58:02.778424+0000","last_became_peered":"2023-11-28T11:58:02.778424+0000","last_unstale":"2023-11-28T11:58:05.416772+0000","last_undegraded":"2023-11-28T11:58:05.416772+0000","last_fullsized":"2023-11-28T11:58:05.416772+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:49:55.927853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.249224+0000","last_change":"2023-11-28T11:58:03.260621+0000","last_active":"2023-11-28T11:58:04.249224+0000","last_peered":"2023-11-28T11:58:04.249224+0000","last_clean":"2023-11-28T11:58:04.249224+0000","last_became_active":"2023-11-28T11:58:03.260335+0000","last_became_peered":"2023-11-28T11:58:03.260335+0000","last_unstale":"2023-11-28T11:58:04.249224+0000","last_undegraded":"2023-11-28T11:58:04.249224+0000","last_fullsized":"2023-11-28T11:58:04.249224+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:55.829381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"43'3","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.552854+0000","last_change":"2023-11-28T11:58:02.779164+0000","last_active":"2023-11-28T11:58:04.552854+0000","last_peered":"2023-11-28T11:58:04.552854+0000","last_clean":"2023-11-28T11:58:04.552854+0000","last_became_active":"2023-11-28T11:58:02.778389+0000","last_became_peered":"2023-11-28T11:58:02.778389+0000","last_unstale":"2023-11-28T11:58:04.552854+0000","last_undegraded":"2023-11-28T11:58:04.552854+0000","last_fullsized":"2023-11-28T11:58:04.552854+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:43:58.158870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.552591+0000","last_change":"2023-11-28T11:58:03.263147+0000","last_active":"2023-11-28T11:58:04.552591+0000","last_peered":"2023-11-28T11:58:04.552591+0000","last_clean":"2023-11-28T11:58:04.552591+0000","last_became_active":"2023-11-28T11:58:03.262834+0000","last_became_peered":"2023-11-28T11:58:03.262834+0000","last_unstale":"2023-11-28T11:58:04.552591+0000","last_undegraded":"2023-11-28T11:58:04.552591+0000","last_fullsized":"2023-11-28T11:58:04.552591+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:28:32.437170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"43'6","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.247491+0000","last_change":"2023-11-28T11:58:02.790035+0000","last_active":"2023-11-28T11:58:04.247491+0000","last_peered":"2023-11-28T11:58:04.247491+0000","last_clean":"2023-11-28T11:58:04.247491+0000","last_became_active":"2023-11-28T11:58:02.789147+0000","last_became_peered":"2023-11-28T11:58:02.789147+0000","last_unstale":"2023-11-28T11:58:04.247491+0000","last_undegraded":"2023-11-28T11:58:04.247491+0000","last_fullsized":"2023-11-28T11:58:04.247491+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:00:29.713180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.246426+0000","last_change":"2023-11-28T11:58:03.258333+0000","last_active":"2023-11-28T11:58:04.246426+0000","last_peered":"2023-11-28T11:58:04.246426+0000","last_clean":"2023-11-28T11:58:04.246426+0000","last_became_active":"2023-11-28T11:58:03.258063+0000","last_became_peered":"2023-11-28T11:58:03.258063+0000","last_unstale":"2023-11-28T11:58:04.246426+0000","last_undegraded":"2023-11-28T11:58:04.246426+0000","last_fullsized":"2023-11-28T11:58:04.246426+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:34:58.062942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"43'2","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.249165+0000","last_change":"2023-11-28T11:58:02.783179+0000","last_active":"2023-11-28T11:58:04.249165+0000","last_peered":"2023-11-28T11:58:04.249165+0000","last_clean":"2023-11-28T11:58:04.249165+0000","last_became_active":"2023-11-28T11:58:02.782893+0000","last_became_peered":"2023-11-28T11:58:02.782893+0000","last_unstale":"2023-11-28T11:58:04.249165+0000","last_undegraded":"2023-11-28T11:58:04.249165+0000","last_fullsized":"2023-11-28T11:58:04.249165+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:30:05.167869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416136+0000","last_change":"2023-11-28T11:58:03.265205+0000","last_active":"2023-11-28T11:58:05.416136+0000","last_peered":"2023-11-28T11:58:05.416136+0000","last_clean":"2023-11-28T11:58:05.416136+0000","last_became_active":"2023-11-28T11:58:03.264925+0000","last_became_peered":"2023-11-28T11:58:03.264925+0000","last_unstale":"2023-11-28T11:58:05.416136+0000","last_undegraded":"2023-11-28T11:58:05.416136+0000","last_fullsized":"2023-11-28T11:58:05.416136+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:20:28.291253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.552333+0000","last_change":"2023-11-28T11:58:02.782896+0000","last_active":"2023-11-28T11:58:04.552333+0000","last_peered":"2023-11-28T11:58:04.552333+0000","last_clean":"2023-11-28T11:58:04.552333+0000","last_became_active":"2023-11-28T11:58:02.782552+0000","last_became_peered":"2023-11-28T11:58:02.782552+0000","last_unstale":"2023-11-28T11:58:04.552333+0000","last_undegraded":"2023-11-28T11:58:04.552333+0000","last_fullsized":"2023-11-28T11:58:04.552333+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:41:20.970782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.248365+0000","last_change":"2023-11-28T11:58:03.254056+0000","last_active":"2023-11-28T11:58:04.248365+0000","last_peered":"2023-11-28T11:58:04.248365+0000","last_clean":"2023-11-28T11:58:04.248365+0000","last_became_active":"2023-11-28T11:58:03.253744+0000","last_became_peered":"2023-11-28T11:58:03.253744+0000","last_unstale":"2023-11-28T11:58:04.248365+0000","last_undegraded":"2023-11-28T11:58:04.248365+0000","last_fullsized":"2023-11-28T11:58:04.248365+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:39.242400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.248520+0000","last_change":"2023-11-28T11:58:02.786758+0000","last_active":"2023-11-28T11:58:04.248520+0000","last_peered":"2023-11-28T11:58:04.248520+0000","last_clean":"2023-11-28T11:58:04.248520+0000","last_became_active":"2023-11-28T11:58:02.786454+0000","last_became_peered":"2023-11-28T11:58:02.786454+0000","last_unstale":"2023-11-28T11:58:04.248520+0000","last_undegraded":"2023-11-28T11:58:04.248520+0000","last_fullsized":"2023-11-28T11:58:04.248520+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:28:31.429978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.552404+0000","last_change":"2023-11-28T11:58:03.274057+0000","last_active":"2023-11-28T11:58:04.552404+0000","last_peered":"2023-11-28T11:58:04.552404+0000","last_clean":"2023-11-28T11:58:04.552404+0000","last_became_active":"2023-11-28T11:58:03.273700+0000","last_became_peered":"2023-11-28T11:58:03.273700+0000","last_unstale":"2023-11-28T11:58:04.552404+0000","last_undegraded":"2023-11-28T11:58:04.552404+0000","last_fullsized":"2023-11-28T11:58:04.552404+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:35:55.672200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":19,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416125+0000","last_change":"2023-11-28T11:58:02.781485+0000","last_active":"2023-11-28T11:58:05.416125+0000","last_peered":"2023-11-28T11:58:05.416125+0000","last_clean":"2023-11-28T11:58:05.416125+0000","last_became_active":"2023-11-28T11:58:02.781225+0000","last_became_peered":"2023-11-28T11:58:02.781225+0000","last_unstale":"2023-11-28T11:58:05.416125+0000","last_undegraded":"2023-11-28T11:58:05.416125+0000","last_fullsized":"2023-11-28T11:58:05.416125+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:20:16.975860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.248464+0000","last_change":"2023-11-28T11:58:03.264759+0000","last_active":"2023-11-28T11:58:04.248464+0000","last_peered":"2023-11-28T11:58:04.248464+0000","last_clean":"2023-11-28T11:58:04.248464+0000","last_became_active":"2023-11-28T11:58:03.264511+0000","last_became_peered":"2023-11-28T11:58:03.264511+0000","last_unstale":"2023-11-28T11:58:04.248464+0000","last_undegraded":"2023-11-28T11:58:04.248464+0000","last_fullsized":"2023-11-28T11:58:04.248464+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:23.241400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"43'1","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.248774+0000","last_change":"2023-11-28T11:58:02.793922+0000","last_active":"2023-11-28T11:58:04.248774+0000","last_peered":"2023-11-28T11:58:04.248774+0000","last_clean":"2023-11-28T11:58:04.248774+0000","last_became_active":"2023-11-28T11:58:02.793596+0000","last_became_peered":"2023-11-28T11:58:02.793596+0000","last_unstale":"2023-11-28T11:58:04.248774+0000","last_undegraded":"2023-11-28T11:58:04.248774+0000","last_fullsized":"2023-11-28T11:58:04.248774+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:37:39.758646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416752+0000","last_change":"2023-11-28T11:58:03.263669+0000","last_active":"2023-11-28T11:58:05.416752+0000","last_peered":"2023-11-28T11:58:05.416752+0000","last_clean":"2023-11-28T11:58:05.416752+0000","last_became_active":"2023-11-28T11:58:03.263392+0000","last_became_peered":"2023-11-28T11:58:03.263392+0000","last_unstale":"2023-11-28T11:58:05.416752+0000","last_undegraded":"2023-11-28T11:58:05.416752+0000","last_fullsized":"2023-11-28T11:58:05.416752+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:14.962568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"43'2","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.937694+0000","last_change":"2023-11-28T11:58:02.791005+0000","last_active":"2023-11-28T11:58:04.937694+0000","last_peered":"2023-11-28T11:58:04.937694+0000","last_clean":"2023-11-28T11:58:04.937694+0000","last_became_active":"2023-11-28T11:58:02.790156+0000","last_became_peered":"2023-11-28T11:58:02.790156+0000","last_unstale":"2023-11-28T11:58:04.937694+0000","last_undegraded":"2023-11-28T11:58:04.937694+0000","last_fullsized":"2023-11-28T11:58:04.937694+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:28:31.429978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.246489+0000","last_change":"2023-11-28T11:58:03.265485+0000","last_active":"2023-11-28T11:58:04.246489+0000","last_peered":"2023-11-28T11:58:04.246489+0000","last_clean":"2023-11-28T11:58:04.246489+0000","last_became_active":"2023-11-28T11:58:03.265196+0000","last_became_peered":"2023-11-28T11:58:03.265196+0000","last_unstale":"2023-11-28T11:58:04.246489+0000","last_undegraded":"2023-11-28T11:58:04.246489+0000","last_fullsized":"2023-11-28T11:58:04.246489+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:41:21.977974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"43'1","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.412117+0000","last_change":"2023-11-28T11:58:02.786374+0000","last_active":"2023-11-28T11:58:05.412117+0000","last_peered":"2023-11-28T11:58:05.412117+0000","last_clean":"2023-11-28T11:58:05.412117+0000","last_became_active":"2023-11-28T11:58:02.785992+0000","last_became_peered":"2023-11-28T11:58:02.785992+0000","last_unstale":"2023-11-28T11:58:05.412117+0000","last_undegraded":"2023-11-28T11:58:05.412117+0000","last_fullsized":"2023-11-28T11:58:05.412117+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:42:10.486193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.246660+0000","last_change":"2023-11-28T11:58:03.260116+0000","last_active":"2023-11-28T11:58:04.246660+0000","last_peered":"2023-11-28T11:58:04.246660+0000","last_clean":"2023-11-28T11:58:04.246660+0000","last_became_active":"2023-11-28T11:58:03.259698+0000","last_became_peered":"2023-11-28T11:58:03.259698+0000","last_unstale":"2023-11-28T11:58:04.246660+0000","last_undegraded":"2023-11-28T11:58:04.246660+0000","last_fullsized":"2023-11-28T11:58:04.246660+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:09:10.312631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.249385+0000","last_change":"2023-11-28T11:58:02.778867+0000","last_active":"2023-11-28T11:58:04.249385+0000","last_peered":"2023-11-28T11:58:04.249385+0000","last_clean":"2023-11-28T11:58:04.249385+0000","last_became_active":"2023-11-28T11:58:02.778545+0000","last_became_peered":"2023-11-28T11:58:02.778545+0000","last_unstale":"2023-11-28T11:58:04.249385+0000","last_undegraded":"2023-11-28T11:58:04.249385+0000","last_fullsized":"2023-11-28T11:58:04.249385+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:18:36.541295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.248815+0000","last_change":"2023-11-28T11:58:03.255028+0000","last_active":"2023-11-28T11:58:04.248815+0000","last_peered":"2023-11-28T11:58:04.248815+0000","last_clean":"2023-11-28T11:58:04.248815+0000","last_became_active":"2023-11-28T11:58:03.254772+0000","last_became_peered":"2023-11-28T11:58:03.254772+0000","last_unstale":"2023-11-28T11:58:04.248815+0000","last_undegraded":"2023-11-28T11:58:04.248815+0000","last_fullsized":"2023-11-28T11:58:04.248815+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:08:37.723634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"43'2","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.249126+0000","last_change":"2023-11-28T11:58:02.779771+0000","last_active":"2023-11-28T11:58:04.249126+0000","last_peered":"2023-11-28T11:58:04.249126+0000","last_clean":"2023-11-28T11:58:04.249126+0000","last_became_active":"2023-11-28T11:58:02.779407+0000","last_became_peered":"2023-11-28T11:58:02.779407+0000","last_unstale":"2023-11-28T11:58:04.249126+0000","last_undegraded":"2023-11-28T11:58:04.249126+0000","last_fullsized":"2023-11-28T11:58:04.249126+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:24:05.191653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.846428+0000","last_change":"2023-11-28T11:58:03.258637+0000","last_active":"2023-11-28T11:58:04.846428+0000","last_peered":"2023-11-28T11:58:04.846428+0000","last_clean":"2023-11-28T11:58:04.846428+0000","last_became_active":"2023-11-28T11:58:03.258244+0000","last_became_peered":"2023-11-28T11:58:03.258244+0000","last_unstale":"2023-11-28T11:58:04.846428+0000","last_undegraded":"2023-11-28T11:58:04.846428+0000","last_fullsized":"2023-11-28T11:58:04.846428+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:52:44.555111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.411507+0000","last_change":"2023-11-28T11:58:02.777818+0000","last_active":"2023-11-28T11:58:05.411507+0000","last_peered":"2023-11-28T11:58:05.411507+0000","last_clean":"2023-11-28T11:58:05.411507+0000","last_became_active":"2023-11-28T11:58:02.777590+0000","last_became_peered":"2023-11-28T11:58:02.777590+0000","last_unstale":"2023-11-28T11:58:05.411507+0000","last_undegraded":"2023-11-28T11:58:05.411507+0000","last_fullsized":"2023-11-28T11:58:05.411507+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:41:20.970782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.246458+0000","last_change":"2023-11-28T11:58:03.255596+0000","last_active":"2023-11-28T11:58:04.246458+0000","last_peered":"2023-11-28T11:58:04.246458+0000","last_clean":"2023-11-28T11:58:04.246458+0000","last_became_active":"2023-11-28T11:58:03.255252+0000","last_became_peered":"2023-11-28T11:58:03.255252+0000","last_unstale":"2023-11-28T11:58:04.246458+0000","last_undegraded":"2023-11-28T11:58:04.246458+0000","last_fullsized":"2023-11-28T11:58:04.246458+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:20:17.983052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.415840+0000","last_change":"2023-11-28T11:58:02.779450+0000","last_active":"2023-11-28T11:58:05.415840+0000","last_peered":"2023-11-28T11:58:05.415840+0000","last_clean":"2023-11-28T11:58:05.415840+0000","last_became_active":"2023-11-28T11:58:02.779163+0000","last_became_peered":"2023-11-28T11:58:02.779163+0000","last_unstale":"2023-11-28T11:58:05.415840+0000","last_undegraded":"2023-11-28T11:58:05.415840+0000","last_fullsized":"2023-11-28T11:58:05.415840+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:01:36.211187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.415831+0000","last_change":"2023-11-28T11:58:03.260258+0000","last_active":"2023-11-28T11:58:05.415831+0000","last_peered":"2023-11-28T11:58:05.415831+0000","last_clean":"2023-11-28T11:58:05.415831+0000","last_became_active":"2023-11-28T11:58:03.259933+0000","last_became_peered":"2023-11-28T11:58:03.259933+0000","last_unstale":"2023-11-28T11:58:05.415831+0000","last_undegraded":"2023-11-28T11:58:05.415831+0000","last_fullsized":"2023-11-28T11:58:05.415831+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:14:43.182788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.552165+0000","last_change":"2023-11-28T11:58:02.782263+0000","last_active":"2023-11-28T11:58:04.552165+0000","last_peered":"2023-11-28T11:58:04.552165+0000","last_clean":"2023-11-28T11:58:04.552165+0000","last_became_active":"2023-11-28T11:58:02.782002+0000","last_became_peered":"2023-11-28T11:58:02.782002+0000","last_unstale":"2023-11-28T11:58:04.552165+0000","last_undegraded":"2023-11-28T11:58:04.552165+0000","last_fullsized":"2023-11-28T11:58:04.552165+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:09:46.078789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.248925+0000","last_change":"2023-11-28T11:58:03.254490+0000","last_active":"2023-11-28T11:58:04.248925+0000","last_peered":"2023-11-28T11:58:04.248925+0000","last_clean":"2023-11-28T11:58:04.248925+0000","last_became_active":"2023-11-28T11:58:03.253311+0000","last_became_peered":"2023-11-28T11:58:03.253311+0000","last_unstale":"2023-11-28T11:58:04.248925+0000","last_undegraded":"2023-11-28T11:58:04.248925+0000","last_fullsized":"2023-11-28T11:58:04.248925+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:09:27.852595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.552786+0000","last_change":"2023-11-28T11:58:02.777509+0000","last_active":"2023-11-28T11:58:04.552786+0000","last_peered":"2023-11-28T11:58:04.552786+0000","last_clean":"2023-11-28T11:58:04.552786+0000","last_became_active":"2023-11-28T11:58:02.777160+0000","last_became_peered":"2023-11-28T11:58:02.777160+0000","last_unstale":"2023-11-28T11:58:04.552786+0000","last_undegraded":"2023-11-28T11:58:04.552786+0000","last_fullsized":"2023-11-28T11:58:04.552786+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:42:10.486193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T11:58:03.246436+0000","last_change":"2023-11-28T11:56:34.384408+0000","last_active":"2023-11-28T11:58:03.246436+0000","last_peered":"2023-11-28T11:58:03.246436+0000","last_clean":"2023-11-28T11:58:03.246436+0000","last_became_active":"2023-11-28T11:56:34.384036+0000","last_became_peered":"2023-11-28T11:56:34.384036+0000","last_unstale":"2023-11-28T11:58:03.246436+0000","last_undegraded":"2023-11-28T11:58:03.246436+0000","last_fullsized":"2023-11-28T11:58:03.246436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:58:55.003786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.248816+0000","last_change":"2023-11-28T11:58:03.265874+0000","last_active":"2023-11-28T11:58:04.248816+0000","last_peered":"2023-11-28T11:58:04.248816+0000","last_clean":"2023-11-28T11:58:04.248816+0000","last_became_active":"2023-11-28T11:58:03.265349+0000","last_became_peered":"2023-11-28T11:58:03.265349+0000","last_unstale":"2023-11-28T11:58:04.248816+0000","last_undegraded":"2023-11-28T11:58:04.248816+0000","last_fullsized":"2023-11-28T11:58:04.248816+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:43:21.050204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.937462+0000","last_change":"2023-11-28T11:58:02.794736+0000","last_active":"2023-11-28T11:58:04.937462+0000","last_peered":"2023-11-28T11:58:04.937462+0000","last_clean":"2023-11-28T11:58:04.937462+0000","last_became_active":"2023-11-28T11:58:02.794428+0000","last_became_peered":"2023-11-28T11:58:02.794428+0000","last_unstale":"2023-11-28T11:58:04.937462+0000","last_undegraded":"2023-11-28T11:58:04.937462+0000","last_fullsized":"2023-11-28T11:58:04.937462+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:24:05.191653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":30,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T11:58:03.241269+0000","last_change":"2023-11-28T11:56:34.384088+0000","last_active":"2023-11-28T11:58:03.241269+0000","last_peered":"2023-11-28T11:58:03.241269+0000","last_clean":"2023-11-28T11:58:03.241269+0000","last_became_active":"2023-11-28T11:56:34.383631+0000","last_became_peered":"2023-11-28T11:56:34.383631+0000","last_unstale":"2023-11-28T11:58:03.241269+0000","last_undegraded":"2023-11-28T11:58:03.241269+0000","last_fullsized":"2023-11-28T11:58:03.241269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:15:42.772333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.411553+0000","last_change":"2023-11-28T11:58:03.262779+0000","last_active":"2023-11-28T11:58:05.411553+0000","last_peered":"2023-11-28T11:58:05.411553+0000","last_clean":"2023-11-28T11:58:05.411553+0000","last_became_active":"2023-11-28T11:58:03.261978+0000","last_became_peered":"2023-11-28T11:58:03.261978+0000","last_unstale":"2023-11-28T11:58:05.411553+0000","last_undegraded":"2023-11-28T11:58:05.411553+0000","last_fullsized":"2023-11-28T11:58:05.411553+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:24:06.198845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.846328+0000","last_change":"2023-11-28T11:58:02.781638+0000","last_active":"2023-11-28T11:58:04.846328+0000","last_peered":"2023-11-28T11:58:04.846328+0000","last_clean":"2023-11-28T11:58:04.846328+0000","last_became_active":"2023-11-28T11:58:02.781417+0000","last_became_peered":"2023-11-28T11:58:02.781417+0000","last_unstale":"2023-11-28T11:58:04.846328+0000","last_undegraded":"2023-11-28T11:58:04.846328+0000","last_fullsized":"2023-11-28T11:58:04.846328+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:43:09.135217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T11:58:03.253844+0000","last_change":"2023-11-28T11:56:34.386399+0000","last_active":"2023-11-28T11:58:03.253844+0000","last_peered":"2023-11-28T11:58:03.253844+0000","last_clean":"2023-11-28T11:58:03.253844+0000","last_became_active":"2023-11-28T11:56:34.385994+0000","last_became_peered":"2023-11-28T11:56:34.385994+0000","last_unstale":"2023-11-28T11:58:03.253844+0000","last_undegraded":"2023-11-28T11:58:03.253844+0000","last_fullsized":"2023-11-28T11:58:03.253844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:58:02.172295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.937252+0000","last_change":"2023-11-28T11:58:03.273536+0000","last_active":"2023-11-28T11:58:04.937252+0000","last_peered":"2023-11-28T11:58:04.937252+0000","last_clean":"2023-11-28T11:58:04.937252+0000","last_became_active":"2023-11-28T11:58:03.273217+0000","last_became_peered":"2023-11-28T11:58:03.273217+0000","last_unstale":"2023-11-28T11:58:04.937252+0000","last_undegraded":"2023-11-28T11:58:04.937252+0000","last_fullsized":"2023-11-28T11:58:04.937252+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:30:27.850141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416119+0000","last_change":"2023-11-28T11:58:02.794762+0000","last_active":"2023-11-28T11:58:05.416119+0000","last_peered":"2023-11-28T11:58:05.416119+0000","last_clean":"2023-11-28T11:58:05.416119+0000","last_became_active":"2023-11-28T11:58:02.794411+0000","last_became_peered":"2023-11-28T11:58:02.794411+0000","last_unstale":"2023-11-28T11:58:05.416119+0000","last_undegraded":"2023-11-28T11:58:05.416119+0000","last_fullsized":"2023-11-28T11:58:05.416119+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:22.234208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T11:58:03.240416+0000","last_change":"2023-11-28T11:56:34.384999+0000","last_active":"2023-11-28T11:58:03.240416+0000","last_peered":"2023-11-28T11:58:03.240416+0000","last_clean":"2023-11-28T11:58:03.240416+0000","last_became_active":"2023-11-28T11:56:34.384531+0000","last_became_peered":"2023-11-28T11:56:34.384531+0000","last_unstale":"2023-11-28T11:58:03.240416+0000","last_undegraded":"2023-11-28T11:58:03.240416+0000","last_fullsized":"2023-11-28T11:58:03.240416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:09:50.083366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.246724+0000","last_change":"2023-11-28T11:58:03.269420+0000","last_active":"2023-11-28T11:58:04.246724+0000","last_peered":"2023-11-28T11:58:04.246724+0000","last_clean":"2023-11-28T11:58:04.246724+0000","last_became_active":"2023-11-28T11:58:03.268779+0000","last_became_peered":"2023-11-28T11:58:03.268779+0000","last_unstale":"2023-11-28T11:58:04.246724+0000","last_undegraded":"2023-11-28T11:58:04.246724+0000","last_fullsized":"2023-11-28T11:58:04.246724+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:53:33.868493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"44'1","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.935817+0000","last_change":"2023-11-28T11:58:02.790499+0000","last_active":"2023-11-28T11:58:04.935817+0000","last_peered":"2023-11-28T11:58:04.935817+0000","last_clean":"2023-11-28T11:58:04.935817+0000","last_became_active":"2023-11-28T11:58:02.790189+0000","last_became_peered":"2023-11-28T11:58:02.790189+0000","last_unstale":"2023-11-28T11:58:04.935817+0000","last_undegraded":"2023-11-28T11:58:04.935817+0000","last_fullsized":"2023-11-28T11:58:04.935817+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:20:21.379132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":29,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T11:58:03.254938+0000","last_change":"2023-11-28T11:56:34.389076+0000","last_active":"2023-11-28T11:58:03.254938+0000","last_peered":"2023-11-28T11:58:03.254938+0000","last_clean":"2023-11-28T11:58:03.254938+0000","last_became_active":"2023-11-28T11:56:34.388689+0000","last_became_peered":"2023-11-28T11:56:34.388689+0000","last_unstale":"2023-11-28T11:58:03.254938+0000","last_undegraded":"2023-11-28T11:58:03.254938+0000","last_fullsized":"2023-11-28T11:58:03.254938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:20.936349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416316+0000","last_change":"2023-11-28T11:58:03.263283+0000","last_active":"2023-11-28T11:58:05.416316+0000","last_peered":"2023-11-28T11:58:05.416316+0000","last_clean":"2023-11-28T11:58:05.416316+0000","last_became_active":"2023-11-28T11:58:03.263034+0000","last_became_peered":"2023-11-28T11:58:03.263034+0000","last_unstale":"2023-11-28T11:58:05.416316+0000","last_undegraded":"2023-11-28T11:58:05.416316+0000","last_fullsized":"2023-11-28T11:58:05.416316+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:16:55.873337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.552971+0000","last_change":"2023-11-28T11:58:02.783459+0000","last_active":"2023-11-28T11:58:04.552971+0000","last_peered":"2023-11-28T11:58:04.552971+0000","last_clean":"2023-11-28T11:58:04.552971+0000","last_became_active":"2023-11-28T11:58:02.778683+0000","last_became_peered":"2023-11-28T11:58:02.778683+0000","last_unstale":"2023-11-28T11:58:04.552971+0000","last_undegraded":"2023-11-28T11:58:04.552971+0000","last_fullsized":"2023-11-28T11:58:04.552971+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:52:43.547919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T11:58:03.243608+0000","last_change":"2023-11-28T11:56:34.486178+0000","last_active":"2023-11-28T11:58:03.243608+0000","last_peered":"2023-11-28T11:58:03.243608+0000","last_clean":"2023-11-28T11:58:03.243608+0000","last_became_active":"2023-11-28T11:56:34.485702+0000","last_became_peered":"2023-11-28T11:56:34.485702+0000","last_unstale":"2023-11-28T11:58:03.243608+0000","last_undegraded":"2023-11-28T11:58:03.243608+0000","last_fullsized":"2023-11-28T11:58:03.243608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:06.323407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.552749+0000","last_change":"2023-11-28T11:58:03.268801+0000","last_active":"2023-11-28T11:58:04.552749+0000","last_peered":"2023-11-28T11:58:04.552749+0000","last_clean":"2023-11-28T11:58:04.552749+0000","last_became_active":"2023-11-28T11:58:03.268546+0000","last_became_peered":"2023-11-28T11:58:03.268546+0000","last_unstale":"2023-11-28T11:58:04.552749+0000","last_undegraded":"2023-11-28T11:58:04.552749+0000","last_fullsized":"2023-11-28T11:58:04.552749+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:15.258186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.846486+0000","last_change":"2023-11-28T11:58:02.781150+0000","last_active":"2023-11-28T11:58:04.846486+0000","last_peered":"2023-11-28T11:58:04.846486+0000","last_clean":"2023-11-28T11:58:04.846486+0000","last_became_active":"2023-11-28T11:58:02.780878+0000","last_became_peered":"2023-11-28T11:58:02.780878+0000","last_unstale":"2023-11-28T11:58:04.846486+0000","last_undegraded":"2023-11-28T11:58:04.846486+0000","last_fullsized":"2023-11-28T11:58:04.846486+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:51:26.103192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T11:58:03.252706+0000","last_change":"2023-11-28T11:56:34.387293+0000","last_active":"2023-11-28T11:58:03.252706+0000","last_peered":"2023-11-28T11:58:03.252706+0000","last_clean":"2023-11-28T11:58:03.252706+0000","last_became_active":"2023-11-28T11:56:34.386976+0000","last_became_peered":"2023-11-28T11:56:34.386976+0000","last_unstale":"2023-11-28T11:58:03.252706+0000","last_undegraded":"2023-11-28T11:58:03.252706+0000","last_fullsized":"2023-11-28T11:58:03.252706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:32.704729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416761+0000","last_change":"2023-11-28T11:58:03.262028+0000","last_active":"2023-11-28T11:58:05.416761+0000","last_peered":"2023-11-28T11:58:05.416761+0000","last_clean":"2023-11-28T11:58:05.416761+0000","last_became_active":"2023-11-28T11:58:03.261783+0000","last_became_peered":"2023-11-28T11:58:03.261783+0000","last_unstale":"2023-11-28T11:58:05.416761+0000","last_undegraded":"2023-11-28T11:58:05.416761+0000","last_fullsized":"2023-11-28T11:58:05.416761+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:33:57.968180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"43'2","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.412488+0000","last_change":"2023-11-28T11:58:02.794029+0000","last_active":"2023-11-28T11:58:05.412488+0000","last_peered":"2023-11-28T11:58:05.412488+0000","last_clean":"2023-11-28T11:58:05.412488+0000","last_became_active":"2023-11-28T11:58:02.793731+0000","last_became_peered":"2023-11-28T11:58:02.793731+0000","last_unstale":"2023-11-28T11:58:05.412488+0000","last_undegraded":"2023-11-28T11:58:05.412488+0000","last_fullsized":"2023-11-28T11:58:05.412488+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:09:09.305439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T11:58:03.256407+0000","last_change":"2023-11-28T11:56:34.389222+0000","last_active":"2023-11-28T11:58:03.256407+0000","last_peered":"2023-11-28T11:58:03.256407+0000","last_clean":"2023-11-28T11:58:03.256407+0000","last_became_active":"2023-11-28T11:56:34.388671+0000","last_became_peered":"2023-11-28T11:56:34.388671+0000","last_unstale":"2023-11-28T11:58:03.256407+0000","last_undegraded":"2023-11-28T11:58:03.256407+0000","last_fullsized":"2023-11-28T11:58:03.256407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:32.704729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":182,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T11:58:03.252894+0000","last_change":"2023-11-28T11:56:28.472008+0000","last_active":"2023-11-28T11:58:03.252894+0000","last_peered":"2023-11-28T11:58:03.252894+0000","last_clean":"2023-11-28T11:58:03.252894+0000","last_became_active":"2023-11-28T11:56:28.469273+0000","last_became_peered":"2023-11-28T11:56:28.469273+0000","last_unstale":"2023-11-28T11:58:03.252894+0000","last_undegraded":"2023-11-28T11:58:03.252894+0000","last_fullsized":"2023-11-28T11:58:03.252894+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:27.291192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:27.291192+0000","last_clean_scrub_stamp":"2023-11-28T11:56:27.291192+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:14:48.860420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509463,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9852,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94361988,"statfs":{"total":96636764160,"available":96626675712,"internally_reserved":0,"allocated":1101824,"data_stored":814930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.4830000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.3700000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.409},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.3280000000000001}]},{"osd":3,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.6000000000000001,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.4390000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.0489999999999999,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.2010000000000001}]},{"osd":5,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":2.4710000000000001,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.411,"5min":1.411,"15min":1.411},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":1.0049999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.575,"15min":1.575},"min":{"1min":1.266,"5min":1.266,"15min":1.266},"max":{"1min":2.4319999999999999,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.633},{"interface":"front","average":{"1min":1.47,"5min":1.47,"15min":1.47},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":2.468,"5min":2.468,"15min":2.468},"last":1.357}]}]},{"osd":6,"up_from":15,"seq":64424509463,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8700,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363140,"statfs":{"total":96636764160,"available":96627855360,"internally_reserved":0,"allocated":512000,"data_stored":225128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.347,"5min":2.347,"15min":2.347},"last":1.5569999999999999}]},{"osd":1,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.25},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":1.2170000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":3.9620000000000002,"5min":3.9620000000000002,"15min":3.9620000000000002},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.97699999999999998}]},{"osd":3,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.325},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":2.0790000000000002,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.645}]},{"osd":4,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.7250000000000001}]},{"osd":5,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":1.1299999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.772},{"interface":"front","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.163}]}]},{"osd":5,"up_from":15,"seq":64424509463,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8696,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363144,"statfs":{"total":96636764160,"available":96627859456,"internally_reserved":0,"allocated":507904,"data_stored":224542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.1719999999999999}]},{"osd":1,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.1259999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.266},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":1.2969999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.0089999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.23},{"interface":"front","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.343}]},{"osd":6,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.28,"15min":1.28},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.407},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":1.3819999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":1.012,"5min":1.012,"15min":1.012},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.5680000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8832,"kb_used_data":504,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363008,"statfs":{"total":96636764160,"available":96627720192,"internally_reserved":0,"allocated":516096,"data_stored":226020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.64800000000000002}]},{"osd":1,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.8860000000000001,"5min":2.8860000000000001,"15min":2.8860000000000001},"last":1.3979999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.3500000000000001,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.02},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":3.0630000000000002,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":1.486}]},{"osd":3,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.117}]},{"osd":5,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":2.972,"5min":2.972,"15min":2.972},"last":1.202},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.90000000000000002}]},{"osd":6,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.3500000000000001,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.569,"5min":1.569,"15min":1.569},"min":{"1min":1.038,"5min":1.038,"15min":1.038},"max":{"1min":3.133,"5min":3.133,"15min":3.133},"last":1.579}]},{"osd":7,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.548,"5min":1.548,"15min":1.548},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":2.2679999999999998,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"min":{"1min":1.21,"5min":1.21,"15min":1.21},"max":{"1min":2.198,"5min":2.198,"15min":2.198},"last":1.2529999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509463,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8768,"kb_used_data":504,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363072,"statfs":{"total":96636764160,"available":96627785728,"internally_reserved":0,"allocated":516096,"data_stored":225094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":2.177,"5min":2.177,"15min":2.177},"last":1}]},{"osd":1,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.871}]},{"osd":2,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":1.423}]},{"osd":4,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":2.8439999999999999,"5min":2.8439999999999999,"15min":2.8439999999999999},"last":1.2090000000000001}]},{"osd":5,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.9670000000000001,"5min":2.9670000000000001,"15min":2.9670000000000001},"last":1.331},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":3.7429999999999999,"5min":3.7429999999999999,"15min":3.7429999999999999},"last":1.6830000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.927,"5min":2.927,"15min":2.927},"last":1.506}]},{"osd":7,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":3.5030000000000001,"5min":3.5030000000000001,"15min":3.5030000000000001},"last":1.6220000000000001},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.6320000000000001,"5min":2.6320000000000001,"15min":2.6320000000000001},"last":1.25}]}]},{"osd":1,"up_from":15,"seq":64424509463,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8760,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363080,"statfs":{"total":96636764160,"available":96627793920,"internally_reserved":0,"allocated":507904,"data_stored":224542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":2.7469999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":1.0980000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.6899999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":1.4970000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":3.411,"5min":3.411,"15min":3.411},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.6680000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":1.3029999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":3.6869999999999998,"5min":3.6869999999999998,"15min":3.6869999999999998},"last":1.359},{"interface":"front","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.0609999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.333}]},{"osd":6,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"min":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":3.5379999999999998,"5min":3.5379999999999998,"15min":3.5379999999999998},"last":1.708},{"interface":"front","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.5739999999999998,"5min":2.5739999999999998,"15min":2.5739999999999998},"last":1.2230000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.7410000000000001},{"interface":"front","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.4249999999999998,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.591}]}]},{"osd":2,"up_from":14,"seq":60129542167,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8644,"kb_used_data":508,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363196,"statfs":{"total":96636764160,"available":96627912704,"internally_reserved":0,"allocated":520192,"data_stored":226042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.0860000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.754,"5min":1.754,"15min":1.754},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.66600000000000004}]},{"osd":3,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":1.01},{"interface":"front","average":{"1min":1.3,"5min":1.3,"15min":1.3},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.617,"5min":2.617,"15min":2.617},"last":1.129}]},{"osd":4,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.9620000000000002,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.3860000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":1.3740000000000001}]},{"osd":5,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":2.738,"5min":2.738,"15min":2.738},"last":1.623},{"interface":"front","average":{"1min":1.575,"5min":1.575,"15min":1.575},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":4.0309999999999997,"5min":4.0309999999999997,"15min":4.0309999999999997},"last":1.3100000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":4.2240000000000002,"5min":4.2240000000000002,"15min":4.2240000000000002},"last":1.5720000000000001},{"interface":"front","average":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":3.0750000000000002,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":1.3460000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":2.3660000000000001,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.476},{"interface":"front","average":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":4.3570000000000002,"5min":4.3570000000000002,"15min":4.3570000000000002},"last":1.6719999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542167,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9836,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362004,"statfs":{"total":96636764160,"available":96626692096,"internally_reserved":0,"allocated":1085440,"data_stored":806982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":1.002},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.68000000000000005}]},{"osd":2,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.73499999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.0720000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":3.4809999999999999,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":3.1629999999999998,"5min":3.1629999999999998,"15min":3.1629999999999998},"last":1.2909999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.266,"5min":2.266,"15min":2.266},"last":1.1759999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.4060000000000001,"5min":2.4060000000000001,"15min":2.4060000000000001},"last":1.24},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"max":{"1min":2.3599999999999999,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":1.212}]},{"osd":7,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":2.3330000000000002,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.583,"5min":1.583,"15min":1.583},"min":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"max":{"1min":2.6040000000000001,"5min":2.6040000000000001,"15min":2.6040000000000001},"last":1.2629999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:58:12.458 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:58:12.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.636+0000 7f02a5792700 1 Processor -- start 2023-11-28T11:58:12.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.636+0000 7f02a5792700 1 -- start start 2023-11-28T11:58:12.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.640+0000 7f02a5792700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02a00cf190 0x7f02a0070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:12.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.640+0000 7f02a5792700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02a0169450 con 0x7f02a00adb80 2023-11-28T11:58:12.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.640+0000 7f02a5792700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02a00ce390 con 0x7f02a00cdf20 2023-11-28T11:58:12.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.640+0000 7f02a5792700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a016ccc0 con 0x7f02a00cf190 2023-11-28T11:58:12.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.640+0000 7f029effd700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f02a00adb80 0x7f02a016d1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:40252/0 (socket says 172.21.15.39:40252) 2023-11-28T11:58:12.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.640+0000 7f029effd700 1 -- 172.21.15.39:0/1010444693 learned_addr learned my addr 172.21.15.39:0/1010444693 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:58:12.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.640+0000 7f029f7fe700 1 --2- 172.21.15.39:0/1010444693 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02a00cf190 0x7f02a0070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:12.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.640+0000 7f029e7fc700 1 -- 172.21.15.39:0/1010444693 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 148697432 0 0) 0x7f02a0169450 con 0x7f02a00adb80 2023-11-28T11:58:12.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.812+0000 7f029e7fc700 1 -- 172.21.15.39:0/1010444693 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f028c0035b0 con 0x7f02a00adb80 2023-11-28T11:58:12.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.812+0000 7f029e7fc700 1 -- 172.21.15.39:0/1010444693 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 397803538 0 0) 0x7f02a00ce390 con 0x7f02a00cdf20 2023-11-28T11:58:12.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.812+0000 7f029e7fc700 1 -- 172.21.15.39:0/1010444693 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02a0169450 con 0x7f02a00cdf20 2023-11-28T11:58:12.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.816+0000 7f029e7fc700 1 -- 172.21.15.39:0/1010444693 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3159199630 0 0) 0x7f028c0035b0 con 0x7f02a00adb80 2023-11-28T11:58:12.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.816+0000 7f029f7fe700 1 -- 172.21.15.39:0/1010444693 >> v1:172.21.15.184:6789/0 conn(0x7f02a00cdf20 legacy=0x7f02a0069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:12.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.816+0000 7f029f7fe700 1 -- 172.21.15.39:0/1010444693 >> v1:172.21.15.39:6789/0 conn(0x7f02a00adb80 legacy=0x7f02a016d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:12.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.816+0000 7f029f7fe700 1 -- 172.21.15.39:0/1010444693 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a00adf50 con 0x7f02a00cf190 2023-11-28T11:58:12.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.816+0000 7f029f7fe700 1 --2- 172.21.15.39:0/1010444693 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02a00cf190 0x7f02a0070080 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f02980098a0 tx=0x7f0298009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1439efa2fe600484 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:12.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.816+0000 7f029e7fc700 1 -- 172.21.15.39:0/1010444693 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029800e070 con 0x7f02a00cf190 2023-11-28T11:58:12.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.816+0000 7f029e7fc700 1 -- 172.21.15.39:0/1010444693 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02980093a0 con 0x7f02a00cf190 2023-11-28T11:58:12.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.816+0000 7f029e7fc700 1 -- 172.21.15.39:0/1010444693 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02900019f0 con 0x7f02a00cf190 2023-11-28T11:58:12.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.816+0000 7f02a5792700 1 -- 172.21.15.39:0/1010444693 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02a00cf190 msgr2=0x7f02a0070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:12.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.816+0000 7f02a5792700 1 --2- 172.21.15.39:0/1010444693 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02a00cf190 0x7f02a0070080 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f02980098a0 tx=0x7f0298009bb0 comp rx=0 tx=0).stop 2023-11-28T11:58:12.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.816+0000 7f02a5792700 1 -- 172.21.15.39:0/1010444693 shutdown_connections 2023-11-28T11:58:12.824 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.816+0000 7f02a5792700 1 --2- 172.21.15.39:0/1010444693 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02a00cf190 0x7f02a0070080 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:12.824 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.816+0000 7f02a5792700 1 -- 172.21.15.39:0/1010444693 >> 172.21.15.39:0/1010444693 conn(0x7f02a00b0f90 msgr2=0x7f02a00ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:12.824 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.816+0000 7f02a5792700 1 -- 172.21.15.39:0/1010444693 shutdown_connections 2023-11-28T11:58:12.824 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.816+0000 7f02a5792700 1 -- 172.21.15.39:0/1010444693 wait complete. 2023-11-28T11:58:12.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.820+0000 7f02a5792700 1 Processor -- start 2023-11-28T11:58:12.829 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.824+0000 7f02a5792700 1 -- start start 2023-11-28T11:58:12.830 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.824+0000 7f02a5792700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02a00adb80 0x7f02a00b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:12.830 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.824+0000 7f02a5792700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02a00cdf20 0x7f02a00c2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:12.830 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.824+0000 7f02a5792700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f02a00cf190 0x7f02a0162840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:12.831 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.824+0000 7f02a5792700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a00b3550 con 0x7f02a00cf190 2023-11-28T11:58:12.831 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.824+0000 7f02a5792700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a00b2940 con 0x7f02a00adb80 2023-11-28T11:58:12.831 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.824+0000 7f02a5792700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a00b2c20 con 0x7f02a00cdf20 2023-11-28T11:58:12.831 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.824+0000 7f029f7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f02a00cf190 0x7f02a0162840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:12.831 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.824+0000 7f029f7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f02a00cf190 0x7f02a0162840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46572/0 (socket says 172.21.15.39:46572) 2023-11-28T11:58:12.831 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.824+0000 7f029f7fe700 1 -- 172.21.15.39:0/1176199285 learned_addr learned my addr 172.21.15.39:0/1176199285 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:12.832 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.824+0000 7f029effd700 1 --2- 172.21.15.39:0/1176199285 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02a00adb80 0x7f02a00b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:12.832 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.824+0000 7f02967fc700 1 --2- 172.21.15.39:0/1176199285 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02a00cdf20 0x7f02a00c2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:12.833 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.824+0000 7f029f7fe700 1 -- 172.21.15.39:0/1176199285 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02a00cdf20 msgr2=0x7f02a00c2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:12.833 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.824+0000 7f029f7fe700 1 --2- 172.21.15.39:0/1176199285 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02a00cdf20 0x7f02a00c2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:12.833 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.824+0000 7f029f7fe700 1 -- 172.21.15.39:0/1176199285 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02a00adb80 msgr2=0x7f02a00b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:12.833 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.824+0000 7f029f7fe700 1 --2- 172.21.15.39:0/1176199285 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02a00adb80 0x7f02a00b39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:12.833 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.824+0000 7f029f7fe700 1 -- 172.21.15.39:0/1176199285 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0298009550 con 0x7f02a00cf190 2023-11-28T11:58:12.833 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.824+0000 7f029f7fe700 1 --2- 172.21.15.39:0/1176199285 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f02a00cf190 0x7f02a0162840 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f0298009bf0 tx=0x7f0298004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:12.833 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.828+0000 7f0297fff700 1 -- 172.21.15.39:0/1176199285 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0298006e80 con 0x7f02a00cf190 2023-11-28T11:58:12.833 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.828+0000 7f02a5792700 1 -- 172.21.15.39:0/1176199285 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02a00cc4c0 con 0x7f02a00cf190 2023-11-28T11:58:12.833 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.828+0000 7f0297fff700 1 -- 172.21.15.39:0/1176199285 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0298003e20 con 0x7f02a00cf190 2023-11-28T11:58:12.833 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.828+0000 7f0297fff700 1 -- 172.21.15.39:0/1176199285 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02980076b0 con 0x7f02a00cf190 2023-11-28T11:58:12.833 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.828+0000 7f02a5792700 1 -- 172.21.15.39:0/1176199285 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02a00cca80 con 0x7f02a00cf190 2023-11-28T11:58:12.834 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.828+0000 7f02a5792700 1 -- 172.21.15.39:0/1176199285 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02a00cc7a0 con 0x7f02a00cf190 2023-11-28T11:58:12.836 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.832+0000 7f0297fff700 1 -- 172.21.15.39:0/1176199285 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0298007810 con 0x7f02a00cf190 2023-11-28T11:58:12.838 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.832+0000 7f0297fff700 1 --2- 172.21.15.39:0/1176199285 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0280064ee0 0x7f0280067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:12.838 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.832+0000 7f0297fff700 1 -- 172.21.15.39:0/1176199285 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f02980832a0 con 0x7f02a00cf190 2023-11-28T11:58:12.838 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.832+0000 7f029effd700 1 --2- 172.21.15.39:0/1176199285 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0280064ee0 0x7f0280067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:12.839 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.832+0000 7f029effd700 1 --2- 172.21.15.39:0/1176199285 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0280064ee0 0x7f0280067390 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f02900012e0 tx=0x7f0290001f80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:12.843 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:12.836+0000 7f0297fff700 1 -- 172.21.15.39:0/1176199285 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0298051280 con 0x7f02a00cf190 2023-11-28T11:58:13.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.012+0000 7f02a5792700 1 -- 172.21.15.39:0/1176199285 --> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f02a0073cb0 con 0x7f0280064ee0 2023-11-28T11:58:13.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.032+0000 7f0297fff700 1 -- 172.21.15.39:0/1176199285 <== mgr.4104 v2:172.21.15.184:6832/36166 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308998 (secure 0 0 0) 0x7f02a0073cb0 con 0x7f0280064ee0 2023-11-28T11:58:13.040 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:58:13.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.044+0000 7f02a5792700 1 -- 172.21.15.39:0/1176199285 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0280064ee0 msgr2=0x7f0280067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:13.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.044+0000 7f02a5792700 1 --2- 172.21.15.39:0/1176199285 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0280064ee0 0x7f0280067390 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f02900012e0 tx=0x7f0290001f80 comp rx=0 tx=0).stop 2023-11-28T11:58:13.050 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.044+0000 7f02a5792700 1 -- 172.21.15.39:0/1176199285 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f02a00cf190 msgr2=0x7f02a0162840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:13.050 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.044+0000 7f02a5792700 1 --2- 172.21.15.39:0/1176199285 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f02a00cf190 0x7f02a0162840 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f0298009bf0 tx=0x7f0298004770 comp rx=0 tx=0).stop 2023-11-28T11:58:13.050 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.044+0000 7f02a5792700 1 -- 172.21.15.39:0/1176199285 shutdown_connections 2023-11-28T11:58:13.050 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.044+0000 7f02a5792700 1 --2- 172.21.15.39:0/1176199285 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f02a00cf190 0x7f02a0162840 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:13.050 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.044+0000 7f02a5792700 1 --2- 172.21.15.39:0/1176199285 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02a00cdf20 0x7f02a00c2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:13.050 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.044+0000 7f02a5792700 1 --2- 172.21.15.39:0/1176199285 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0280064ee0 0x7f0280067390 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:13.050 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.044+0000 7f02a5792700 1 --2- 172.21.15.39:0/1176199285 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02a00adb80 0x7f02a00b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:13.050 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.044+0000 7f02a5792700 1 -- 172.21.15.39:0/1176199285 >> 172.21.15.39:0/1176199285 conn(0x7f02a00b0f90 msgr2=0x7f02a00af940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:13.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.044+0000 7f02a5792700 1 -- 172.21.15.39:0/1176199285 shutdown_connections 2023-11-28T11:58:13.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.044+0000 7f02a5792700 1 -- 172.21.15.39:0/1176199285 wait complete. 2023-11-28T11:58:13.051 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2023-11-28T11:58:13.072 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2023-11-28T11:58:12.582700+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":72100,"kb_used_data":5156,"kb_used_omap":0,"kb_used_meta":66880,"kb_avail":754902620,"statfs":{"total":773094113280,"available":773020282880,"internally_reserved":0,"allocated":5279744,"data_stored":2980253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68485120},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.343065"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.552748+0000","last_change":"2023-11-28T11:58:03.270216+0000","last_active":"2023-11-28T11:58:04.552748+0000","last_peered":"2023-11-28T11:58:04.552748+0000","last_clean":"2023-11-28T11:58:04.552748+0000","last_became_active":"2023-11-28T11:58:03.269922+0000","last_became_peered":"2023-11-28T11:58:03.269922+0000","last_unstale":"2023-11-28T11:58:04.552748+0000","last_undegraded":"2023-11-28T11:58:04.552748+0000","last_fullsized":"2023-11-28T11:58:04.552748+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:33:55.992729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.412291+0000","last_change":"2023-11-28T11:58:03.266449+0000","last_active":"2023-11-28T11:58:05.412291+0000","last_peered":"2023-11-28T11:58:05.412291+0000","last_clean":"2023-11-28T11:58:05.412291+0000","last_became_active":"2023-11-28T11:58:03.266041+0000","last_became_peered":"2023-11-28T11:58:03.266041+0000","last_unstale":"2023-11-28T11:58:05.412291+0000","last_undegraded":"2023-11-28T11:58:05.412291+0000","last_fullsized":"2023-11-28T11:58:05.412291+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:28:32.437170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.937443+0000","last_change":"2023-11-28T11:58:03.270342+0000","last_active":"2023-11-28T11:58:04.937443+0000","last_peered":"2023-11-28T11:58:04.937443+0000","last_clean":"2023-11-28T11:58:04.937443+0000","last_became_active":"2023-11-28T11:58:03.270091+0000","last_became_peered":"2023-11-28T11:58:03.270091+0000","last_unstale":"2023-11-28T11:58:04.937443+0000","last_undegraded":"2023-11-28T11:58:04.937443+0000","last_fullsized":"2023-11-28T11:58:04.937443+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:24:20.457472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416453+0000","last_change":"2023-11-28T11:58:03.280494+0000","last_active":"2023-11-28T11:58:05.416453+0000","last_peered":"2023-11-28T11:58:05.416453+0000","last_clean":"2023-11-28T11:58:05.416453+0000","last_became_active":"2023-11-28T11:58:03.273934+0000","last_became_peered":"2023-11-28T11:58:03.273934+0000","last_unstale":"2023-11-28T11:58:05.416453+0000","last_undegraded":"2023-11-28T11:58:05.416453+0000","last_fullsized":"2023-11-28T11:58:05.416453+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:56:29.140993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.411863+0000","last_change":"2023-11-28T11:58:03.275390+0000","last_active":"2023-11-28T11:58:05.411863+0000","last_peered":"2023-11-28T11:58:05.411863+0000","last_clean":"2023-11-28T11:58:05.411863+0000","last_became_active":"2023-11-28T11:58:03.275106+0000","last_became_peered":"2023-11-28T11:58:03.275106+0000","last_unstale":"2023-11-28T11:58:05.411863+0000","last_undegraded":"2023-11-28T11:58:05.411863+0000","last_fullsized":"2023-11-28T11:58:05.411863+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:30:06.175061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.248648+0000","last_change":"2023-11-28T11:58:03.263018+0000","last_active":"2023-11-28T11:58:04.248648+0000","last_peered":"2023-11-28T11:58:04.248648+0000","last_clean":"2023-11-28T11:58:04.248648+0000","last_became_active":"2023-11-28T11:58:03.262759+0000","last_became_peered":"2023-11-28T11:58:03.262759+0000","last_unstale":"2023-11-28T11:58:04.248648+0000","last_undegraded":"2023-11-28T11:58:04.248648+0000","last_fullsized":"2023-11-28T11:58:04.248648+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:11:43.926744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.552172+0000","last_change":"2023-11-28T11:58:03.267202+0000","last_active":"2023-11-28T11:58:04.552172+0000","last_peered":"2023-11-28T11:58:04.552172+0000","last_clean":"2023-11-28T11:58:04.552172+0000","last_became_active":"2023-11-28T11:58:03.266928+0000","last_became_peered":"2023-11-28T11:58:03.266928+0000","last_unstale":"2023-11-28T11:58:04.552172+0000","last_undegraded":"2023-11-28T11:58:04.552172+0000","last_fullsized":"2023-11-28T11:58:04.552172+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:30:06.175061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.415739+0000","last_change":"2023-11-28T11:58:03.278569+0000","last_active":"2023-11-28T11:58:05.415739+0000","last_peered":"2023-11-28T11:58:05.415739+0000","last_clean":"2023-11-28T11:58:05.415739+0000","last_became_active":"2023-11-28T11:58:03.278191+0000","last_became_peered":"2023-11-28T11:58:03.278191+0000","last_unstale":"2023-11-28T11:58:05.415739+0000","last_undegraded":"2023-11-28T11:58:05.415739+0000","last_fullsized":"2023-11-28T11:58:05.415739+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:14.419715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416724+0000","last_change":"2023-11-28T11:58:03.265015+0000","last_active":"2023-11-28T11:58:05.416724+0000","last_peered":"2023-11-28T11:58:05.416724+0000","last_clean":"2023-11-28T11:58:05.416724+0000","last_became_active":"2023-11-28T11:58:03.264639+0000","last_became_peered":"2023-11-28T11:58:03.264639+0000","last_unstale":"2023-11-28T11:58:05.416724+0000","last_undegraded":"2023-11-28T11:58:05.416724+0000","last_fullsized":"2023-11-28T11:58:05.416724+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:16:51.122441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416633+0000","last_change":"2023-11-28T11:58:03.283239+0000","last_active":"2023-11-28T11:58:05.416633+0000","last_peered":"2023-11-28T11:58:05.416633+0000","last_clean":"2023-11-28T11:58:05.416633+0000","last_became_active":"2023-11-28T11:58:03.280251+0000","last_became_peered":"2023-11-28T11:58:03.280251+0000","last_unstale":"2023-11-28T11:58:05.416633+0000","last_undegraded":"2023-11-28T11:58:05.416633+0000","last_fullsized":"2023-11-28T11:58:05.416633+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:36:30.647196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416432+0000","last_change":"2023-11-28T11:58:03.258812+0000","last_active":"2023-11-28T11:58:05.416432+0000","last_peered":"2023-11-28T11:58:05.416432+0000","last_clean":"2023-11-28T11:58:05.416432+0000","last_became_active":"2023-11-28T11:58:03.258368+0000","last_became_peered":"2023-11-28T11:58:03.258368+0000","last_unstale":"2023-11-28T11:58:05.416432+0000","last_undegraded":"2023-11-28T11:58:05.416432+0000","last_fullsized":"2023-11-28T11:58:05.416432+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:18:48.890788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.411765+0000","last_change":"2023-11-28T11:58:03.268545+0000","last_active":"2023-11-28T11:58:05.411765+0000","last_peered":"2023-11-28T11:58:05.411765+0000","last_clean":"2023-11-28T11:58:05.411765+0000","last_became_active":"2023-11-28T11:58:03.268005+0000","last_became_peered":"2023-11-28T11:58:03.268005+0000","last_unstale":"2023-11-28T11:58:05.411765+0000","last_undegraded":"2023-11-28T11:58:05.411765+0000","last_fullsized":"2023-11-28T11:58:05.411765+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:15.258186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.246940+0000","last_change":"2023-11-28T11:58:03.263075+0000","last_active":"2023-11-28T11:58:04.246940+0000","last_peered":"2023-11-28T11:58:04.246940+0000","last_clean":"2023-11-28T11:58:04.246940+0000","last_became_active":"2023-11-28T11:58:03.262800+0000","last_became_peered":"2023-11-28T11:58:03.262800+0000","last_unstale":"2023-11-28T11:58:04.246940+0000","last_undegraded":"2023-11-28T11:58:04.246940+0000","last_fullsized":"2023-11-28T11:58:04.246940+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:36:07.713099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.415805+0000","last_change":"2023-11-28T11:58:03.265606+0000","last_active":"2023-11-28T11:58:05.415805+0000","last_peered":"2023-11-28T11:58:05.415805+0000","last_clean":"2023-11-28T11:58:05.415805+0000","last_became_active":"2023-11-28T11:58:03.265347+0000","last_became_peered":"2023-11-28T11:58:03.265347+0000","last_unstale":"2023-11-28T11:58:05.415805+0000","last_undegraded":"2023-11-28T11:58:05.415805+0000","last_fullsized":"2023-11-28T11:58:05.415805+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:17:11.155874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.248302+0000","last_change":"2023-11-28T11:58:03.263871+0000","last_active":"2023-11-28T11:58:04.248302+0000","last_peered":"2023-11-28T11:58:04.248302+0000","last_clean":"2023-11-28T11:58:04.248302+0000","last_became_active":"2023-11-28T11:58:03.263630+0000","last_became_peered":"2023-11-28T11:58:03.263630+0000","last_unstale":"2023-11-28T11:58:04.248302+0000","last_undegraded":"2023-11-28T11:58:04.248302+0000","last_fullsized":"2023-11-28T11:58:04.248302+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:52:47.083282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.246279+0000","last_change":"2023-11-28T11:58:03.266537+0000","last_active":"2023-11-28T11:58:04.246279+0000","last_peered":"2023-11-28T11:58:04.246279+0000","last_clean":"2023-11-28T11:58:04.246279+0000","last_became_active":"2023-11-28T11:58:03.262136+0000","last_became_peered":"2023-11-28T11:58:03.262136+0000","last_unstale":"2023-11-28T11:58:04.246279+0000","last_undegraded":"2023-11-28T11:58:04.246279+0000","last_fullsized":"2023-11-28T11:58:04.246279+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:54.460812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.937776+0000","last_change":"2023-11-28T11:58:03.270088+0000","last_active":"2023-11-28T11:58:04.937776+0000","last_peered":"2023-11-28T11:58:04.937776+0000","last_clean":"2023-11-28T11:58:04.937776+0000","last_became_active":"2023-11-28T11:58:03.269805+0000","last_became_peered":"2023-11-28T11:58:03.269805+0000","last_unstale":"2023-11-28T11:58:04.937776+0000","last_undegraded":"2023-11-28T11:58:04.937776+0000","last_fullsized":"2023-11-28T11:58:04.937776+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:08:37.723634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.937378+0000","last_change":"2023-11-28T11:58:03.276821+0000","last_active":"2023-11-28T11:58:04.937378+0000","last_peered":"2023-11-28T11:58:04.937378+0000","last_clean":"2023-11-28T11:58:04.937378+0000","last_became_active":"2023-11-28T11:58:03.276560+0000","last_became_peered":"2023-11-28T11:58:03.276560+0000","last_unstale":"2023-11-28T11:58:04.937378+0000","last_undegraded":"2023-11-28T11:58:04.937378+0000","last_fullsized":"2023-11-28T11:58:04.937378+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:52:47.083282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.246861+0000","last_change":"2023-11-28T11:58:03.259943+0000","last_active":"2023-11-28T11:58:04.246861+0000","last_peered":"2023-11-28T11:58:04.246861+0000","last_clean":"2023-11-28T11:58:04.246861+0000","last_became_active":"2023-11-28T11:58:03.259341+0000","last_became_peered":"2023-11-28T11:58:03.259341+0000","last_unstale":"2023-11-28T11:58:04.246861+0000","last_undegraded":"2023-11-28T11:58:04.246861+0000","last_fullsized":"2023-11-28T11:58:04.246861+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:43:10.142409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.247370+0000","last_change":"2023-11-28T11:58:03.261719+0000","last_active":"2023-11-28T11:58:04.247370+0000","last_peered":"2023-11-28T11:58:04.247370+0000","last_clean":"2023-11-28T11:58:04.247370+0000","last_became_active":"2023-11-28T11:58:03.261481+0000","last_became_peered":"2023-11-28T11:58:03.261481+0000","last_unstale":"2023-11-28T11:58:04.247370+0000","last_undegraded":"2023-11-28T11:58:04.247370+0000","last_fullsized":"2023-11-28T11:58:04.247370+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:49:56.935045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.248719+0000","last_change":"2023-11-28T11:58:03.272263+0000","last_active":"2023-11-28T11:58:04.248719+0000","last_peered":"2023-11-28T11:58:04.248719+0000","last_clean":"2023-11-28T11:58:04.248719+0000","last_became_active":"2023-11-28T11:58:03.271919+0000","last_became_peered":"2023-11-28T11:58:03.271919+0000","last_unstale":"2023-11-28T11:58:04.248719+0000","last_undegraded":"2023-11-28T11:58:04.248719+0000","last_fullsized":"2023-11-28T11:58:04.248719+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:19:45.288978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.415975+0000","last_change":"2023-11-28T11:58:03.280229+0000","last_active":"2023-11-28T11:58:05.415975+0000","last_peered":"2023-11-28T11:58:05.415975+0000","last_clean":"2023-11-28T11:58:05.415975+0000","last_became_active":"2023-11-28T11:58:03.274838+0000","last_became_peered":"2023-11-28T11:58:03.274838+0000","last_unstale":"2023-11-28T11:58:05.415975+0000","last_undegraded":"2023-11-28T11:58:05.415975+0000","last_fullsized":"2023-11-28T11:58:05.415975+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:54:40.637592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.246253+0000","last_change":"2023-11-28T11:58:03.267816+0000","last_active":"2023-11-28T11:58:04.246253+0000","last_peered":"2023-11-28T11:58:04.246253+0000","last_clean":"2023-11-28T11:58:04.246253+0000","last_became_active":"2023-11-28T11:58:03.267536+0000","last_became_peered":"2023-11-28T11:58:03.267536+0000","last_unstale":"2023-11-28T11:58:04.246253+0000","last_undegraded":"2023-11-28T11:58:04.246253+0000","last_fullsized":"2023-11-28T11:58:04.246253+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:08:59.303593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.246182+0000","last_change":"2023-11-28T11:58:03.266282+0000","last_active":"2023-11-28T11:58:04.246182+0000","last_peered":"2023-11-28T11:58:04.246182+0000","last_clean":"2023-11-28T11:58:04.246182+0000","last_became_active":"2023-11-28T11:58:03.262340+0000","last_became_peered":"2023-11-28T11:58:03.262340+0000","last_unstale":"2023-11-28T11:58:04.246182+0000","last_undegraded":"2023-11-28T11:58:04.246182+0000","last_fullsized":"2023-11-28T11:58:04.246182+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:44:11.868082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.246645+0000","last_change":"2023-11-28T11:58:03.260694+0000","last_active":"2023-11-28T11:58:04.246645+0000","last_peered":"2023-11-28T11:58:04.246645+0000","last_clean":"2023-11-28T11:58:04.246645+0000","last_became_active":"2023-11-28T11:58:03.260382+0000","last_became_peered":"2023-11-28T11:58:03.260382+0000","last_unstale":"2023-11-28T11:58:04.246645+0000","last_undegraded":"2023-11-28T11:58:04.246645+0000","last_fullsized":"2023-11-28T11:58:04.246645+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:42:11.493385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.248044+0000","last_change":"2023-11-28T11:58:03.263235+0000","last_active":"2023-11-28T11:58:04.248044+0000","last_peered":"2023-11-28T11:58:04.248044+0000","last_clean":"2023-11-28T11:58:04.248044+0000","last_became_active":"2023-11-28T11:58:03.262984+0000","last_became_peered":"2023-11-28T11:58:03.262984+0000","last_unstale":"2023-11-28T11:58:04.248044+0000","last_undegraded":"2023-11-28T11:58:04.248044+0000","last_fullsized":"2023-11-28T11:58:04.248044+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:25:52.304471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.937507+0000","last_change":"2023-11-28T11:58:03.273450+0000","last_active":"2023-11-28T11:58:04.937507+0000","last_peered":"2023-11-28T11:58:04.937507+0000","last_clean":"2023-11-28T11:58:04.937507+0000","last_became_active":"2023-11-28T11:58:03.271689+0000","last_became_peered":"2023-11-28T11:58:03.271689+0000","last_unstale":"2023-11-28T11:58:04.937507+0000","last_undegraded":"2023-11-28T11:58:04.937507+0000","last_fullsized":"2023-11-28T11:58:04.937507+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:13:06.602427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.411809+0000","last_change":"2023-11-28T11:58:03.268284+0000","last_active":"2023-11-28T11:58:05.411809+0000","last_peered":"2023-11-28T11:58:05.411809+0000","last_clean":"2023-11-28T11:58:05.411809+0000","last_became_active":"2023-11-28T11:58:03.267661+0000","last_became_peered":"2023-11-28T11:58:03.267661+0000","last_unstale":"2023-11-28T11:58:05.411809+0000","last_undegraded":"2023-11-28T11:58:05.411809+0000","last_fullsized":"2023-11-28T11:58:05.411809+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:07.970088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.246625+0000","last_change":"2023-11-28T11:58:03.265238+0000","last_active":"2023-11-28T11:58:04.246625+0000","last_peered":"2023-11-28T11:58:04.246625+0000","last_clean":"2023-11-28T11:58:04.246625+0000","last_became_active":"2023-11-28T11:58:03.264888+0000","last_became_peered":"2023-11-28T11:58:03.264888+0000","last_unstale":"2023-11-28T11:58:04.246625+0000","last_undegraded":"2023-11-28T11:58:04.246625+0000","last_fullsized":"2023-11-28T11:58:04.246625+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:52:44.555111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.937179+0000","last_change":"2023-11-28T11:58:03.263887+0000","last_active":"2023-11-28T11:58:04.937179+0000","last_peered":"2023-11-28T11:58:04.937179+0000","last_clean":"2023-11-28T11:58:04.937179+0000","last_became_active":"2023-11-28T11:58:03.263539+0000","last_became_peered":"2023-11-28T11:58:03.263539+0000","last_unstale":"2023-11-28T11:58:04.937179+0000","last_undegraded":"2023-11-28T11:58:04.937179+0000","last_fullsized":"2023-11-28T11:58:04.937179+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:23:52.213219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.248471+0000","last_change":"2023-11-28T11:58:03.272795+0000","last_active":"2023-11-28T11:58:04.248471+0000","last_peered":"2023-11-28T11:58:04.248471+0000","last_clean":"2023-11-28T11:58:04.248471+0000","last_became_active":"2023-11-28T11:58:03.272545+0000","last_became_peered":"2023-11-28T11:58:03.272545+0000","last_unstale":"2023-11-28T11:58:04.248471+0000","last_undegraded":"2023-11-28T11:58:04.248471+0000","last_fullsized":"2023-11-28T11:58:04.248471+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:13:06.602427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.246306+0000","last_change":"2023-11-28T11:58:03.254255+0000","last_active":"2023-11-28T11:58:04.246306+0000","last_peered":"2023-11-28T11:58:04.246306+0000","last_clean":"2023-11-28T11:58:04.246306+0000","last_became_active":"2023-11-28T11:58:03.253952+0000","last_became_peered":"2023-11-28T11:58:03.253952+0000","last_unstale":"2023-11-28T11:58:04.246306+0000","last_undegraded":"2023-11-28T11:58:04.246306+0000","last_fullsized":"2023-11-28T11:58:04.246306+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:16:15.666991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.846828+0000","last_change":"2023-11-28T11:58:03.265801+0000","last_active":"2023-11-28T11:58:04.846828+0000","last_peered":"2023-11-28T11:58:04.846828+0000","last_clean":"2023-11-28T11:58:04.846828+0000","last_became_active":"2023-11-28T11:58:03.265565+0000","last_became_peered":"2023-11-28T11:58:03.265565+0000","last_unstale":"2023-11-28T11:58:04.846828+0000","last_undegraded":"2023-11-28T11:58:04.846828+0000","last_fullsized":"2023-11-28T11:58:04.846828+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:43:59.166062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"43'4","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.249449+0000","last_change":"2023-11-28T11:58:02.782611+0000","last_active":"2023-11-28T11:58:04.249449+0000","last_peered":"2023-11-28T11:58:04.249449+0000","last_clean":"2023-11-28T11:58:04.249449+0000","last_became_active":"2023-11-28T11:58:02.779458+0000","last_became_peered":"2023-11-28T11:58:02.779458+0000","last_unstale":"2023-11-28T11:58:04.249449+0000","last_undegraded":"2023-11-28T11:58:04.249449+0000","last_fullsized":"2023-11-28T11:58:04.249449+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:22:06.273063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.246609+0000","last_change":"2023-11-28T11:58:03.273965+0000","last_active":"2023-11-28T11:58:04.246609+0000","last_peered":"2023-11-28T11:58:04.246609+0000","last_clean":"2023-11-28T11:58:04.246609+0000","last_became_active":"2023-11-28T11:58:03.269167+0000","last_became_peered":"2023-11-28T11:58:03.269167+0000","last_unstale":"2023-11-28T11:58:04.246609+0000","last_undegraded":"2023-11-28T11:58:04.246609+0000","last_fullsized":"2023-11-28T11:58:04.246609+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:43:59.166062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"43'1","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.937718+0000","last_change":"2023-11-28T11:58:02.794227+0000","last_active":"2023-11-28T11:58:04.937718+0000","last_peered":"2023-11-28T11:58:04.937718+0000","last_clean":"2023-11-28T11:58:04.937718+0000","last_became_active":"2023-11-28T11:58:02.793925+0000","last_became_peered":"2023-11-28T11:58:02.793925+0000","last_unstale":"2023-11-28T11:58:04.937718+0000","last_undegraded":"2023-11-28T11:58:04.937718+0000","last_fullsized":"2023-11-28T11:58:04.937718+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:22:06.273063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.412081+0000","last_change":"2023-11-28T11:58:03.279736+0000","last_active":"2023-11-28T11:58:05.412081+0000","last_peered":"2023-11-28T11:58:05.412081+0000","last_clean":"2023-11-28T11:58:05.412081+0000","last_became_active":"2023-11-28T11:58:03.279479+0000","last_became_peered":"2023-11-28T11:58:03.279479+0000","last_unstale":"2023-11-28T11:58:05.412081+0000","last_undegraded":"2023-11-28T11:58:05.412081+0000","last_fullsized":"2023-11-28T11:58:05.412081+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:35:55.672200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"43'2","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.846959+0000","last_change":"2023-11-28T11:58:02.781115+0000","last_active":"2023-11-28T11:58:04.846959+0000","last_peered":"2023-11-28T11:58:04.846959+0000","last_clean":"2023-11-28T11:58:04.846959+0000","last_became_active":"2023-11-28T11:58:02.780802+0000","last_became_peered":"2023-11-28T11:58:02.780802+0000","last_unstale":"2023-11-28T11:58:04.846959+0000","last_undegraded":"2023-11-28T11:58:04.846959+0000","last_fullsized":"2023-11-28T11:58:04.846959+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:53.453620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.846839+0000","last_change":"2023-11-28T11:58:03.276028+0000","last_active":"2023-11-28T11:58:04.846839+0000","last_peered":"2023-11-28T11:58:04.846839+0000","last_clean":"2023-11-28T11:58:04.846839+0000","last_became_active":"2023-11-28T11:58:03.275659+0000","last_became_peered":"2023-11-28T11:58:03.275659+0000","last_unstale":"2023-11-28T11:58:04.846839+0000","last_undegraded":"2023-11-28T11:58:04.846839+0000","last_fullsized":"2023-11-28T11:58:04.846839+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:42:11.493385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"43'2","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.552383+0000","last_change":"2023-11-28T11:58:02.779978+0000","last_active":"2023-11-28T11:58:04.552383+0000","last_peered":"2023-11-28T11:58:04.552383+0000","last_clean":"2023-11-28T11:58:04.552383+0000","last_became_active":"2023-11-28T11:58:02.779643+0000","last_became_peered":"2023-11-28T11:58:02.779643+0000","last_unstale":"2023-11-28T11:58:04.552383+0000","last_undegraded":"2023-11-28T11:58:04.552383+0000","last_fullsized":"2023-11-28T11:58:04.552383+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:34:57.055750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.937270+0000","last_change":"2023-11-28T11:58:03.275992+0000","last_active":"2023-11-28T11:58:04.937270+0000","last_peered":"2023-11-28T11:58:04.937270+0000","last_clean":"2023-11-28T11:58:04.937270+0000","last_became_active":"2023-11-28T11:58:03.275682+0000","last_became_peered":"2023-11-28T11:58:03.275682+0000","last_unstale":"2023-11-28T11:58:04.937270+0000","last_undegraded":"2023-11-28T11:58:04.937270+0000","last_fullsized":"2023-11-28T11:58:04.937270+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:18:38.026787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"43'1","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.248868+0000","last_change":"2023-11-28T11:58:02.788881+0000","last_active":"2023-11-28T11:58:04.248868+0000","last_peered":"2023-11-28T11:58:04.248868+0000","last_clean":"2023-11-28T11:58:04.248868+0000","last_became_active":"2023-11-28T11:58:02.786632+0000","last_became_peered":"2023-11-28T11:58:02.786632+0000","last_unstale":"2023-11-28T11:58:04.248868+0000","last_undegraded":"2023-11-28T11:58:04.248868+0000","last_fullsized":"2023-11-28T11:58:04.248868+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:11:26.588287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416165+0000","last_change":"2023-11-28T11:58:03.258600+0000","last_active":"2023-11-28T11:58:05.416165+0000","last_peered":"2023-11-28T11:58:05.416165+0000","last_clean":"2023-11-28T11:58:05.416165+0000","last_became_active":"2023-11-28T11:58:03.258321+0000","last_became_peered":"2023-11-28T11:58:03.258321+0000","last_unstale":"2023-11-28T11:58:05.416165+0000","last_undegraded":"2023-11-28T11:58:05.416165+0000","last_fullsized":"2023-11-28T11:58:05.416165+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:44:36.459418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"43'1","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.937333+0000","last_change":"2023-11-28T11:58:02.788473+0000","last_active":"2023-11-28T11:58:04.937333+0000","last_peered":"2023-11-28T11:58:04.937333+0000","last_clean":"2023-11-28T11:58:04.937333+0000","last_became_active":"2023-11-28T11:58:02.788148+0000","last_became_peered":"2023-11-28T11:58:02.788148+0000","last_unstale":"2023-11-28T11:58:04.937333+0000","last_undegraded":"2023-11-28T11:58:04.937333+0000","last_fullsized":"2023-11-28T11:58:04.937333+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:11:26.588287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.415894+0000","last_change":"2023-11-28T11:58:03.283663+0000","last_active":"2023-11-28T11:58:05.415894+0000","last_peered":"2023-11-28T11:58:05.415894+0000","last_clean":"2023-11-28T11:58:05.415894+0000","last_became_active":"2023-11-28T11:58:03.274952+0000","last_became_peered":"2023-11-28T11:58:03.274952+0000","last_unstale":"2023-11-28T11:58:05.415894+0000","last_undegraded":"2023-11-28T11:58:05.415894+0000","last_fullsized":"2023-11-28T11:58:05.415894+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:01.925469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.411452+0000","last_change":"2023-11-28T11:58:02.787112+0000","last_active":"2023-11-28T11:58:05.411452+0000","last_peered":"2023-11-28T11:58:05.411452+0000","last_clean":"2023-11-28T11:58:05.411452+0000","last_became_active":"2023-11-28T11:58:02.786428+0000","last_became_peered":"2023-11-28T11:58:02.786428+0000","last_unstale":"2023-11-28T11:58:05.411452+0000","last_undegraded":"2023-11-28T11:58:05.411452+0000","last_fullsized":"2023-11-28T11:58:05.411452+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:52:43.547919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.246164+0000","last_change":"2023-11-28T11:58:03.267713+0000","last_active":"2023-11-28T11:58:04.246164+0000","last_peered":"2023-11-28T11:58:04.246164+0000","last_clean":"2023-11-28T11:58:04.246164+0000","last_became_active":"2023-11-28T11:58:03.267395+0000","last_became_peered":"2023-11-28T11:58:03.267395+0000","last_unstale":"2023-11-28T11:58:04.246164+0000","last_undegraded":"2023-11-28T11:58:04.246164+0000","last_fullsized":"2023-11-28T11:58:04.246164+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:52:31.322927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.415904+0000","last_change":"2023-11-28T11:58:02.785023+0000","last_active":"2023-11-28T11:58:05.415904+0000","last_peered":"2023-11-28T11:58:05.415904+0000","last_clean":"2023-11-28T11:58:05.415904+0000","last_became_active":"2023-11-28T11:58:02.784685+0000","last_became_peered":"2023-11-28T11:58:02.784685+0000","last_unstale":"2023-11-28T11:58:05.415904+0000","last_undegraded":"2023-11-28T11:58:05.415904+0000","last_fullsized":"2023-11-28T11:58:05.415904+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:27:27.811854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.937514+0000","last_change":"2023-11-28T11:58:03.271095+0000","last_active":"2023-11-28T11:58:04.937514+0000","last_peered":"2023-11-28T11:58:04.937514+0000","last_clean":"2023-11-28T11:58:04.937514+0000","last_became_active":"2023-11-28T11:58:03.270831+0000","last_became_peered":"2023-11-28T11:58:03.270831+0000","last_unstale":"2023-11-28T11:58:04.937514+0000","last_undegraded":"2023-11-28T11:58:04.937514+0000","last_fullsized":"2023-11-28T11:58:04.937514+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:39.242400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.937860+0000","last_change":"2023-11-28T11:58:02.788193+0000","last_active":"2023-11-28T11:58:04.937860+0000","last_peered":"2023-11-28T11:58:04.937860+0000","last_clean":"2023-11-28T11:58:04.937860+0000","last_became_active":"2023-11-28T11:58:02.787539+0000","last_became_peered":"2023-11-28T11:58:02.787539+0000","last_unstale":"2023-11-28T11:58:04.937860+0000","last_undegraded":"2023-11-28T11:58:04.937860+0000","last_fullsized":"2023-11-28T11:58:04.937860+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:30:05.167869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.552998+0000","last_change":"2023-11-28T11:58:03.272411+0000","last_active":"2023-11-28T11:58:04.552998+0000","last_peered":"2023-11-28T11:58:04.552998+0000","last_clean":"2023-11-28T11:58:04.552998+0000","last_became_active":"2023-11-28T11:58:03.272106+0000","last_became_peered":"2023-11-28T11:58:03.272106+0000","last_unstale":"2023-11-28T11:58:04.552998+0000","last_undegraded":"2023-11-28T11:58:04.552998+0000","last_fullsized":"2023-11-28T11:58:04.552998+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:07.970088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416772+0000","last_change":"2023-11-28T11:58:02.778715+0000","last_active":"2023-11-28T11:58:05.416772+0000","last_peered":"2023-11-28T11:58:05.416772+0000","last_clean":"2023-11-28T11:58:05.416772+0000","last_became_active":"2023-11-28T11:58:02.778424+0000","last_became_peered":"2023-11-28T11:58:02.778424+0000","last_unstale":"2023-11-28T11:58:05.416772+0000","last_undegraded":"2023-11-28T11:58:05.416772+0000","last_fullsized":"2023-11-28T11:58:05.416772+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:49:55.927853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.249224+0000","last_change":"2023-11-28T11:58:03.260621+0000","last_active":"2023-11-28T11:58:04.249224+0000","last_peered":"2023-11-28T11:58:04.249224+0000","last_clean":"2023-11-28T11:58:04.249224+0000","last_became_active":"2023-11-28T11:58:03.260335+0000","last_became_peered":"2023-11-28T11:58:03.260335+0000","last_unstale":"2023-11-28T11:58:04.249224+0000","last_undegraded":"2023-11-28T11:58:04.249224+0000","last_fullsized":"2023-11-28T11:58:04.249224+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:55.829381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"43'3","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.552854+0000","last_change":"2023-11-28T11:58:02.779164+0000","last_active":"2023-11-28T11:58:04.552854+0000","last_peered":"2023-11-28T11:58:04.552854+0000","last_clean":"2023-11-28T11:58:04.552854+0000","last_became_active":"2023-11-28T11:58:02.778389+0000","last_became_peered":"2023-11-28T11:58:02.778389+0000","last_unstale":"2023-11-28T11:58:04.552854+0000","last_undegraded":"2023-11-28T11:58:04.552854+0000","last_fullsized":"2023-11-28T11:58:04.552854+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:43:58.158870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.552591+0000","last_change":"2023-11-28T11:58:03.263147+0000","last_active":"2023-11-28T11:58:04.552591+0000","last_peered":"2023-11-28T11:58:04.552591+0000","last_clean":"2023-11-28T11:58:04.552591+0000","last_became_active":"2023-11-28T11:58:03.262834+0000","last_became_peered":"2023-11-28T11:58:03.262834+0000","last_unstale":"2023-11-28T11:58:04.552591+0000","last_undegraded":"2023-11-28T11:58:04.552591+0000","last_fullsized":"2023-11-28T11:58:04.552591+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:28:32.437170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"43'6","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.247491+0000","last_change":"2023-11-28T11:58:02.790035+0000","last_active":"2023-11-28T11:58:04.247491+0000","last_peered":"2023-11-28T11:58:04.247491+0000","last_clean":"2023-11-28T11:58:04.247491+0000","last_became_active":"2023-11-28T11:58:02.789147+0000","last_became_peered":"2023-11-28T11:58:02.789147+0000","last_unstale":"2023-11-28T11:58:04.247491+0000","last_undegraded":"2023-11-28T11:58:04.247491+0000","last_fullsized":"2023-11-28T11:58:04.247491+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:00:29.713180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.246426+0000","last_change":"2023-11-28T11:58:03.258333+0000","last_active":"2023-11-28T11:58:04.246426+0000","last_peered":"2023-11-28T11:58:04.246426+0000","last_clean":"2023-11-28T11:58:04.246426+0000","last_became_active":"2023-11-28T11:58:03.258063+0000","last_became_peered":"2023-11-28T11:58:03.258063+0000","last_unstale":"2023-11-28T11:58:04.246426+0000","last_undegraded":"2023-11-28T11:58:04.246426+0000","last_fullsized":"2023-11-28T11:58:04.246426+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:34:58.062942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"43'2","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.249165+0000","last_change":"2023-11-28T11:58:02.783179+0000","last_active":"2023-11-28T11:58:04.249165+0000","last_peered":"2023-11-28T11:58:04.249165+0000","last_clean":"2023-11-28T11:58:04.249165+0000","last_became_active":"2023-11-28T11:58:02.782893+0000","last_became_peered":"2023-11-28T11:58:02.782893+0000","last_unstale":"2023-11-28T11:58:04.249165+0000","last_undegraded":"2023-11-28T11:58:04.249165+0000","last_fullsized":"2023-11-28T11:58:04.249165+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:30:05.167869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416136+0000","last_change":"2023-11-28T11:58:03.265205+0000","last_active":"2023-11-28T11:58:05.416136+0000","last_peered":"2023-11-28T11:58:05.416136+0000","last_clean":"2023-11-28T11:58:05.416136+0000","last_became_active":"2023-11-28T11:58:03.264925+0000","last_became_peered":"2023-11-28T11:58:03.264925+0000","last_unstale":"2023-11-28T11:58:05.416136+0000","last_undegraded":"2023-11-28T11:58:05.416136+0000","last_fullsized":"2023-11-28T11:58:05.416136+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:20:28.291253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.552333+0000","last_change":"2023-11-28T11:58:02.782896+0000","last_active":"2023-11-28T11:58:04.552333+0000","last_peered":"2023-11-28T11:58:04.552333+0000","last_clean":"2023-11-28T11:58:04.552333+0000","last_became_active":"2023-11-28T11:58:02.782552+0000","last_became_peered":"2023-11-28T11:58:02.782552+0000","last_unstale":"2023-11-28T11:58:04.552333+0000","last_undegraded":"2023-11-28T11:58:04.552333+0000","last_fullsized":"2023-11-28T11:58:04.552333+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:41:20.970782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.248365+0000","last_change":"2023-11-28T11:58:03.254056+0000","last_active":"2023-11-28T11:58:04.248365+0000","last_peered":"2023-11-28T11:58:04.248365+0000","last_clean":"2023-11-28T11:58:04.248365+0000","last_became_active":"2023-11-28T11:58:03.253744+0000","last_became_peered":"2023-11-28T11:58:03.253744+0000","last_unstale":"2023-11-28T11:58:04.248365+0000","last_undegraded":"2023-11-28T11:58:04.248365+0000","last_fullsized":"2023-11-28T11:58:04.248365+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:39.242400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.248520+0000","last_change":"2023-11-28T11:58:02.786758+0000","last_active":"2023-11-28T11:58:04.248520+0000","last_peered":"2023-11-28T11:58:04.248520+0000","last_clean":"2023-11-28T11:58:04.248520+0000","last_became_active":"2023-11-28T11:58:02.786454+0000","last_became_peered":"2023-11-28T11:58:02.786454+0000","last_unstale":"2023-11-28T11:58:04.248520+0000","last_undegraded":"2023-11-28T11:58:04.248520+0000","last_fullsized":"2023-11-28T11:58:04.248520+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:28:31.429978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.552404+0000","last_change":"2023-11-28T11:58:03.274057+0000","last_active":"2023-11-28T11:58:04.552404+0000","last_peered":"2023-11-28T11:58:04.552404+0000","last_clean":"2023-11-28T11:58:04.552404+0000","last_became_active":"2023-11-28T11:58:03.273700+0000","last_became_peered":"2023-11-28T11:58:03.273700+0000","last_unstale":"2023-11-28T11:58:04.552404+0000","last_undegraded":"2023-11-28T11:58:04.552404+0000","last_fullsized":"2023-11-28T11:58:04.552404+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:35:55.672200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":19,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416125+0000","last_change":"2023-11-28T11:58:02.781485+0000","last_active":"2023-11-28T11:58:05.416125+0000","last_peered":"2023-11-28T11:58:05.416125+0000","last_clean":"2023-11-28T11:58:05.416125+0000","last_became_active":"2023-11-28T11:58:02.781225+0000","last_became_peered":"2023-11-28T11:58:02.781225+0000","last_unstale":"2023-11-28T11:58:05.416125+0000","last_undegraded":"2023-11-28T11:58:05.416125+0000","last_fullsized":"2023-11-28T11:58:05.416125+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:20:16.975860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.248464+0000","last_change":"2023-11-28T11:58:03.264759+0000","last_active":"2023-11-28T11:58:04.248464+0000","last_peered":"2023-11-28T11:58:04.248464+0000","last_clean":"2023-11-28T11:58:04.248464+0000","last_became_active":"2023-11-28T11:58:03.264511+0000","last_became_peered":"2023-11-28T11:58:03.264511+0000","last_unstale":"2023-11-28T11:58:04.248464+0000","last_undegraded":"2023-11-28T11:58:04.248464+0000","last_fullsized":"2023-11-28T11:58:04.248464+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:23.241400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"43'1","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.248774+0000","last_change":"2023-11-28T11:58:02.793922+0000","last_active":"2023-11-28T11:58:04.248774+0000","last_peered":"2023-11-28T11:58:04.248774+0000","last_clean":"2023-11-28T11:58:04.248774+0000","last_became_active":"2023-11-28T11:58:02.793596+0000","last_became_peered":"2023-11-28T11:58:02.793596+0000","last_unstale":"2023-11-28T11:58:04.248774+0000","last_undegraded":"2023-11-28T11:58:04.248774+0000","last_fullsized":"2023-11-28T11:58:04.248774+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:37:39.758646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416752+0000","last_change":"2023-11-28T11:58:03.263669+0000","last_active":"2023-11-28T11:58:05.416752+0000","last_peered":"2023-11-28T11:58:05.416752+0000","last_clean":"2023-11-28T11:58:05.416752+0000","last_became_active":"2023-11-28T11:58:03.263392+0000","last_became_peered":"2023-11-28T11:58:03.263392+0000","last_unstale":"2023-11-28T11:58:05.416752+0000","last_undegraded":"2023-11-28T11:58:05.416752+0000","last_fullsized":"2023-11-28T11:58:05.416752+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:14.962568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"43'2","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.937694+0000","last_change":"2023-11-28T11:58:02.791005+0000","last_active":"2023-11-28T11:58:04.937694+0000","last_peered":"2023-11-28T11:58:04.937694+0000","last_clean":"2023-11-28T11:58:04.937694+0000","last_became_active":"2023-11-28T11:58:02.790156+0000","last_became_peered":"2023-11-28T11:58:02.790156+0000","last_unstale":"2023-11-28T11:58:04.937694+0000","last_undegraded":"2023-11-28T11:58:04.937694+0000","last_fullsized":"2023-11-28T11:58:04.937694+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:28:31.429978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.246489+0000","last_change":"2023-11-28T11:58:03.265485+0000","last_active":"2023-11-28T11:58:04.246489+0000","last_peered":"2023-11-28T11:58:04.246489+0000","last_clean":"2023-11-28T11:58:04.246489+0000","last_became_active":"2023-11-28T11:58:03.265196+0000","last_became_peered":"2023-11-28T11:58:03.265196+0000","last_unstale":"2023-11-28T11:58:04.246489+0000","last_undegraded":"2023-11-28T11:58:04.246489+0000","last_fullsized":"2023-11-28T11:58:04.246489+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:41:21.977974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"43'1","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.412117+0000","last_change":"2023-11-28T11:58:02.786374+0000","last_active":"2023-11-28T11:58:05.412117+0000","last_peered":"2023-11-28T11:58:05.412117+0000","last_clean":"2023-11-28T11:58:05.412117+0000","last_became_active":"2023-11-28T11:58:02.785992+0000","last_became_peered":"2023-11-28T11:58:02.785992+0000","last_unstale":"2023-11-28T11:58:05.412117+0000","last_undegraded":"2023-11-28T11:58:05.412117+0000","last_fullsized":"2023-11-28T11:58:05.412117+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:42:10.486193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.246660+0000","last_change":"2023-11-28T11:58:03.260116+0000","last_active":"2023-11-28T11:58:04.246660+0000","last_peered":"2023-11-28T11:58:04.246660+0000","last_clean":"2023-11-28T11:58:04.246660+0000","last_became_active":"2023-11-28T11:58:03.259698+0000","last_became_peered":"2023-11-28T11:58:03.259698+0000","last_unstale":"2023-11-28T11:58:04.246660+0000","last_undegraded":"2023-11-28T11:58:04.246660+0000","last_fullsized":"2023-11-28T11:58:04.246660+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:09:10.312631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.249385+0000","last_change":"2023-11-28T11:58:02.778867+0000","last_active":"2023-11-28T11:58:04.249385+0000","last_peered":"2023-11-28T11:58:04.249385+0000","last_clean":"2023-11-28T11:58:04.249385+0000","last_became_active":"2023-11-28T11:58:02.778545+0000","last_became_peered":"2023-11-28T11:58:02.778545+0000","last_unstale":"2023-11-28T11:58:04.249385+0000","last_undegraded":"2023-11-28T11:58:04.249385+0000","last_fullsized":"2023-11-28T11:58:04.249385+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:18:36.541295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.248815+0000","last_change":"2023-11-28T11:58:03.255028+0000","last_active":"2023-11-28T11:58:04.248815+0000","last_peered":"2023-11-28T11:58:04.248815+0000","last_clean":"2023-11-28T11:58:04.248815+0000","last_became_active":"2023-11-28T11:58:03.254772+0000","last_became_peered":"2023-11-28T11:58:03.254772+0000","last_unstale":"2023-11-28T11:58:04.248815+0000","last_undegraded":"2023-11-28T11:58:04.248815+0000","last_fullsized":"2023-11-28T11:58:04.248815+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:08:37.723634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"43'2","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.249126+0000","last_change":"2023-11-28T11:58:02.779771+0000","last_active":"2023-11-28T11:58:04.249126+0000","last_peered":"2023-11-28T11:58:04.249126+0000","last_clean":"2023-11-28T11:58:04.249126+0000","last_became_active":"2023-11-28T11:58:02.779407+0000","last_became_peered":"2023-11-28T11:58:02.779407+0000","last_unstale":"2023-11-28T11:58:04.249126+0000","last_undegraded":"2023-11-28T11:58:04.249126+0000","last_fullsized":"2023-11-28T11:58:04.249126+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:24:05.191653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.846428+0000","last_change":"2023-11-28T11:58:03.258637+0000","last_active":"2023-11-28T11:58:04.846428+0000","last_peered":"2023-11-28T11:58:04.846428+0000","last_clean":"2023-11-28T11:58:04.846428+0000","last_became_active":"2023-11-28T11:58:03.258244+0000","last_became_peered":"2023-11-28T11:58:03.258244+0000","last_unstale":"2023-11-28T11:58:04.846428+0000","last_undegraded":"2023-11-28T11:58:04.846428+0000","last_fullsized":"2023-11-28T11:58:04.846428+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:52:44.555111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.411507+0000","last_change":"2023-11-28T11:58:02.777818+0000","last_active":"2023-11-28T11:58:05.411507+0000","last_peered":"2023-11-28T11:58:05.411507+0000","last_clean":"2023-11-28T11:58:05.411507+0000","last_became_active":"2023-11-28T11:58:02.777590+0000","last_became_peered":"2023-11-28T11:58:02.777590+0000","last_unstale":"2023-11-28T11:58:05.411507+0000","last_undegraded":"2023-11-28T11:58:05.411507+0000","last_fullsized":"2023-11-28T11:58:05.411507+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:41:20.970782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.246458+0000","last_change":"2023-11-28T11:58:03.255596+0000","last_active":"2023-11-28T11:58:04.246458+0000","last_peered":"2023-11-28T11:58:04.246458+0000","last_clean":"2023-11-28T11:58:04.246458+0000","last_became_active":"2023-11-28T11:58:03.255252+0000","last_became_peered":"2023-11-28T11:58:03.255252+0000","last_unstale":"2023-11-28T11:58:04.246458+0000","last_undegraded":"2023-11-28T11:58:04.246458+0000","last_fullsized":"2023-11-28T11:58:04.246458+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:20:17.983052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.415840+0000","last_change":"2023-11-28T11:58:02.779450+0000","last_active":"2023-11-28T11:58:05.415840+0000","last_peered":"2023-11-28T11:58:05.415840+0000","last_clean":"2023-11-28T11:58:05.415840+0000","last_became_active":"2023-11-28T11:58:02.779163+0000","last_became_peered":"2023-11-28T11:58:02.779163+0000","last_unstale":"2023-11-28T11:58:05.415840+0000","last_undegraded":"2023-11-28T11:58:05.415840+0000","last_fullsized":"2023-11-28T11:58:05.415840+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:01:36.211187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.415831+0000","last_change":"2023-11-28T11:58:03.260258+0000","last_active":"2023-11-28T11:58:05.415831+0000","last_peered":"2023-11-28T11:58:05.415831+0000","last_clean":"2023-11-28T11:58:05.415831+0000","last_became_active":"2023-11-28T11:58:03.259933+0000","last_became_peered":"2023-11-28T11:58:03.259933+0000","last_unstale":"2023-11-28T11:58:05.415831+0000","last_undegraded":"2023-11-28T11:58:05.415831+0000","last_fullsized":"2023-11-28T11:58:05.415831+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:14:43.182788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.552165+0000","last_change":"2023-11-28T11:58:02.782263+0000","last_active":"2023-11-28T11:58:04.552165+0000","last_peered":"2023-11-28T11:58:04.552165+0000","last_clean":"2023-11-28T11:58:04.552165+0000","last_became_active":"2023-11-28T11:58:02.782002+0000","last_became_peered":"2023-11-28T11:58:02.782002+0000","last_unstale":"2023-11-28T11:58:04.552165+0000","last_undegraded":"2023-11-28T11:58:04.552165+0000","last_fullsized":"2023-11-28T11:58:04.552165+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:09:46.078789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.248925+0000","last_change":"2023-11-28T11:58:03.254490+0000","last_active":"2023-11-28T11:58:04.248925+0000","last_peered":"2023-11-28T11:58:04.248925+0000","last_clean":"2023-11-28T11:58:04.248925+0000","last_became_active":"2023-11-28T11:58:03.253311+0000","last_became_peered":"2023-11-28T11:58:03.253311+0000","last_unstale":"2023-11-28T11:58:04.248925+0000","last_undegraded":"2023-11-28T11:58:04.248925+0000","last_fullsized":"2023-11-28T11:58:04.248925+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:09:27.852595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.552786+0000","last_change":"2023-11-28T11:58:02.777509+0000","last_active":"2023-11-28T11:58:04.552786+0000","last_peered":"2023-11-28T11:58:04.552786+0000","last_clean":"2023-11-28T11:58:04.552786+0000","last_became_active":"2023-11-28T11:58:02.777160+0000","last_became_peered":"2023-11-28T11:58:02.777160+0000","last_unstale":"2023-11-28T11:58:04.552786+0000","last_undegraded":"2023-11-28T11:58:04.552786+0000","last_fullsized":"2023-11-28T11:58:04.552786+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:42:10.486193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T11:58:03.246436+0000","last_change":"2023-11-28T11:56:34.384408+0000","last_active":"2023-11-28T11:58:03.246436+0000","last_peered":"2023-11-28T11:58:03.246436+0000","last_clean":"2023-11-28T11:58:03.246436+0000","last_became_active":"2023-11-28T11:56:34.384036+0000","last_became_peered":"2023-11-28T11:56:34.384036+0000","last_unstale":"2023-11-28T11:58:03.246436+0000","last_undegraded":"2023-11-28T11:58:03.246436+0000","last_fullsized":"2023-11-28T11:58:03.246436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:58:55.003786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.248816+0000","last_change":"2023-11-28T11:58:03.265874+0000","last_active":"2023-11-28T11:58:04.248816+0000","last_peered":"2023-11-28T11:58:04.248816+0000","last_clean":"2023-11-28T11:58:04.248816+0000","last_became_active":"2023-11-28T11:58:03.265349+0000","last_became_peered":"2023-11-28T11:58:03.265349+0000","last_unstale":"2023-11-28T11:58:04.248816+0000","last_undegraded":"2023-11-28T11:58:04.248816+0000","last_fullsized":"2023-11-28T11:58:04.248816+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:43:21.050204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.937462+0000","last_change":"2023-11-28T11:58:02.794736+0000","last_active":"2023-11-28T11:58:04.937462+0000","last_peered":"2023-11-28T11:58:04.937462+0000","last_clean":"2023-11-28T11:58:04.937462+0000","last_became_active":"2023-11-28T11:58:02.794428+0000","last_became_peered":"2023-11-28T11:58:02.794428+0000","last_unstale":"2023-11-28T11:58:04.937462+0000","last_undegraded":"2023-11-28T11:58:04.937462+0000","last_fullsized":"2023-11-28T11:58:04.937462+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:24:05.191653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":30,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T11:58:03.241269+0000","last_change":"2023-11-28T11:56:34.384088+0000","last_active":"2023-11-28T11:58:03.241269+0000","last_peered":"2023-11-28T11:58:03.241269+0000","last_clean":"2023-11-28T11:58:03.241269+0000","last_became_active":"2023-11-28T11:56:34.383631+0000","last_became_peered":"2023-11-28T11:56:34.383631+0000","last_unstale":"2023-11-28T11:58:03.241269+0000","last_undegraded":"2023-11-28T11:58:03.241269+0000","last_fullsized":"2023-11-28T11:58:03.241269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:15:42.772333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.411553+0000","last_change":"2023-11-28T11:58:03.262779+0000","last_active":"2023-11-28T11:58:05.411553+0000","last_peered":"2023-11-28T11:58:05.411553+0000","last_clean":"2023-11-28T11:58:05.411553+0000","last_became_active":"2023-11-28T11:58:03.261978+0000","last_became_peered":"2023-11-28T11:58:03.261978+0000","last_unstale":"2023-11-28T11:58:05.411553+0000","last_undegraded":"2023-11-28T11:58:05.411553+0000","last_fullsized":"2023-11-28T11:58:05.411553+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:24:06.198845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.846328+0000","last_change":"2023-11-28T11:58:02.781638+0000","last_active":"2023-11-28T11:58:04.846328+0000","last_peered":"2023-11-28T11:58:04.846328+0000","last_clean":"2023-11-28T11:58:04.846328+0000","last_became_active":"2023-11-28T11:58:02.781417+0000","last_became_peered":"2023-11-28T11:58:02.781417+0000","last_unstale":"2023-11-28T11:58:04.846328+0000","last_undegraded":"2023-11-28T11:58:04.846328+0000","last_fullsized":"2023-11-28T11:58:04.846328+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:43:09.135217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T11:58:03.253844+0000","last_change":"2023-11-28T11:56:34.386399+0000","last_active":"2023-11-28T11:58:03.253844+0000","last_peered":"2023-11-28T11:58:03.253844+0000","last_clean":"2023-11-28T11:58:03.253844+0000","last_became_active":"2023-11-28T11:56:34.385994+0000","last_became_peered":"2023-11-28T11:56:34.385994+0000","last_unstale":"2023-11-28T11:58:03.253844+0000","last_undegraded":"2023-11-28T11:58:03.253844+0000","last_fullsized":"2023-11-28T11:58:03.253844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:58:02.172295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.937252+0000","last_change":"2023-11-28T11:58:03.273536+0000","last_active":"2023-11-28T11:58:04.937252+0000","last_peered":"2023-11-28T11:58:04.937252+0000","last_clean":"2023-11-28T11:58:04.937252+0000","last_became_active":"2023-11-28T11:58:03.273217+0000","last_became_peered":"2023-11-28T11:58:03.273217+0000","last_unstale":"2023-11-28T11:58:04.937252+0000","last_undegraded":"2023-11-28T11:58:04.937252+0000","last_fullsized":"2023-11-28T11:58:04.937252+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:30:27.850141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416119+0000","last_change":"2023-11-28T11:58:02.794762+0000","last_active":"2023-11-28T11:58:05.416119+0000","last_peered":"2023-11-28T11:58:05.416119+0000","last_clean":"2023-11-28T11:58:05.416119+0000","last_became_active":"2023-11-28T11:58:02.794411+0000","last_became_peered":"2023-11-28T11:58:02.794411+0000","last_unstale":"2023-11-28T11:58:05.416119+0000","last_undegraded":"2023-11-28T11:58:05.416119+0000","last_fullsized":"2023-11-28T11:58:05.416119+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:22.234208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T11:58:03.240416+0000","last_change":"2023-11-28T11:56:34.384999+0000","last_active":"2023-11-28T11:58:03.240416+0000","last_peered":"2023-11-28T11:58:03.240416+0000","last_clean":"2023-11-28T11:58:03.240416+0000","last_became_active":"2023-11-28T11:56:34.384531+0000","last_became_peered":"2023-11-28T11:56:34.384531+0000","last_unstale":"2023-11-28T11:58:03.240416+0000","last_undegraded":"2023-11-28T11:58:03.240416+0000","last_fullsized":"2023-11-28T11:58:03.240416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:09:50.083366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.246724+0000","last_change":"2023-11-28T11:58:03.269420+0000","last_active":"2023-11-28T11:58:04.246724+0000","last_peered":"2023-11-28T11:58:04.246724+0000","last_clean":"2023-11-28T11:58:04.246724+0000","last_became_active":"2023-11-28T11:58:03.268779+0000","last_became_peered":"2023-11-28T11:58:03.268779+0000","last_unstale":"2023-11-28T11:58:04.246724+0000","last_undegraded":"2023-11-28T11:58:04.246724+0000","last_fullsized":"2023-11-28T11:58:04.246724+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:53:33.868493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"44'1","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.935817+0000","last_change":"2023-11-28T11:58:02.790499+0000","last_active":"2023-11-28T11:58:04.935817+0000","last_peered":"2023-11-28T11:58:04.935817+0000","last_clean":"2023-11-28T11:58:04.935817+0000","last_became_active":"2023-11-28T11:58:02.790189+0000","last_became_peered":"2023-11-28T11:58:02.790189+0000","last_unstale":"2023-11-28T11:58:04.935817+0000","last_undegraded":"2023-11-28T11:58:04.935817+0000","last_fullsized":"2023-11-28T11:58:04.935817+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:20:21.379132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":29,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T11:58:03.254938+0000","last_change":"2023-11-28T11:56:34.389076+0000","last_active":"2023-11-28T11:58:03.254938+0000","last_peered":"2023-11-28T11:58:03.254938+0000","last_clean":"2023-11-28T11:58:03.254938+0000","last_became_active":"2023-11-28T11:56:34.388689+0000","last_became_peered":"2023-11-28T11:56:34.388689+0000","last_unstale":"2023-11-28T11:58:03.254938+0000","last_undegraded":"2023-11-28T11:58:03.254938+0000","last_fullsized":"2023-11-28T11:58:03.254938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:20.936349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416316+0000","last_change":"2023-11-28T11:58:03.263283+0000","last_active":"2023-11-28T11:58:05.416316+0000","last_peered":"2023-11-28T11:58:05.416316+0000","last_clean":"2023-11-28T11:58:05.416316+0000","last_became_active":"2023-11-28T11:58:03.263034+0000","last_became_peered":"2023-11-28T11:58:03.263034+0000","last_unstale":"2023-11-28T11:58:05.416316+0000","last_undegraded":"2023-11-28T11:58:05.416316+0000","last_fullsized":"2023-11-28T11:58:05.416316+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:16:55.873337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.552971+0000","last_change":"2023-11-28T11:58:02.783459+0000","last_active":"2023-11-28T11:58:04.552971+0000","last_peered":"2023-11-28T11:58:04.552971+0000","last_clean":"2023-11-28T11:58:04.552971+0000","last_became_active":"2023-11-28T11:58:02.778683+0000","last_became_peered":"2023-11-28T11:58:02.778683+0000","last_unstale":"2023-11-28T11:58:04.552971+0000","last_undegraded":"2023-11-28T11:58:04.552971+0000","last_fullsized":"2023-11-28T11:58:04.552971+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:52:43.547919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T11:58:03.243608+0000","last_change":"2023-11-28T11:56:34.486178+0000","last_active":"2023-11-28T11:58:03.243608+0000","last_peered":"2023-11-28T11:58:03.243608+0000","last_clean":"2023-11-28T11:58:03.243608+0000","last_became_active":"2023-11-28T11:56:34.485702+0000","last_became_peered":"2023-11-28T11:56:34.485702+0000","last_unstale":"2023-11-28T11:58:03.243608+0000","last_undegraded":"2023-11-28T11:58:03.243608+0000","last_fullsized":"2023-11-28T11:58:03.243608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:06.323407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.552749+0000","last_change":"2023-11-28T11:58:03.268801+0000","last_active":"2023-11-28T11:58:04.552749+0000","last_peered":"2023-11-28T11:58:04.552749+0000","last_clean":"2023-11-28T11:58:04.552749+0000","last_became_active":"2023-11-28T11:58:03.268546+0000","last_became_peered":"2023-11-28T11:58:03.268546+0000","last_unstale":"2023-11-28T11:58:04.552749+0000","last_undegraded":"2023-11-28T11:58:04.552749+0000","last_fullsized":"2023-11-28T11:58:04.552749+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:15.258186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:04.846486+0000","last_change":"2023-11-28T11:58:02.781150+0000","last_active":"2023-11-28T11:58:04.846486+0000","last_peered":"2023-11-28T11:58:04.846486+0000","last_clean":"2023-11-28T11:58:04.846486+0000","last_became_active":"2023-11-28T11:58:02.780878+0000","last_became_peered":"2023-11-28T11:58:02.780878+0000","last_unstale":"2023-11-28T11:58:04.846486+0000","last_undegraded":"2023-11-28T11:58:04.846486+0000","last_fullsized":"2023-11-28T11:58:04.846486+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:51:26.103192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T11:58:03.252706+0000","last_change":"2023-11-28T11:56:34.387293+0000","last_active":"2023-11-28T11:58:03.252706+0000","last_peered":"2023-11-28T11:58:03.252706+0000","last_clean":"2023-11-28T11:58:03.252706+0000","last_became_active":"2023-11-28T11:56:34.386976+0000","last_became_peered":"2023-11-28T11:56:34.386976+0000","last_unstale":"2023-11-28T11:58:03.252706+0000","last_undegraded":"2023-11-28T11:58:03.252706+0000","last_fullsized":"2023-11-28T11:58:03.252706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:32.704729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.416761+0000","last_change":"2023-11-28T11:58:03.262028+0000","last_active":"2023-11-28T11:58:05.416761+0000","last_peered":"2023-11-28T11:58:05.416761+0000","last_clean":"2023-11-28T11:58:05.416761+0000","last_became_active":"2023-11-28T11:58:03.261783+0000","last_became_peered":"2023-11-28T11:58:03.261783+0000","last_unstale":"2023-11-28T11:58:05.416761+0000","last_undegraded":"2023-11-28T11:58:05.416761+0000","last_fullsized":"2023-11-28T11:58:05.416761+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:02.747286+0000","last_clean_scrub_stamp":"2023-11-28T11:58:02.747286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:33:57.968180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"43'2","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-28T11:58:05.412488+0000","last_change":"2023-11-28T11:58:02.794029+0000","last_active":"2023-11-28T11:58:05.412488+0000","last_peered":"2023-11-28T11:58:05.412488+0000","last_clean":"2023-11-28T11:58:05.412488+0000","last_became_active":"2023-11-28T11:58:02.793731+0000","last_became_peered":"2023-11-28T11:58:02.793731+0000","last_unstale":"2023-11-28T11:58:05.412488+0000","last_undegraded":"2023-11-28T11:58:05.412488+0000","last_fullsized":"2023-11-28T11:58:05.412488+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:01.740094+0000","last_clean_scrub_stamp":"2023-11-28T11:58:01.740094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:09:09.305439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T11:58:03.256407+0000","last_change":"2023-11-28T11:56:34.389222+0000","last_active":"2023-11-28T11:58:03.256407+0000","last_peered":"2023-11-28T11:58:03.256407+0000","last_clean":"2023-11-28T11:58:03.256407+0000","last_became_active":"2023-11-28T11:56:34.388671+0000","last_became_peered":"2023-11-28T11:56:34.388671+0000","last_unstale":"2023-11-28T11:58:03.256407+0000","last_undegraded":"2023-11-28T11:58:03.256407+0000","last_fullsized":"2023-11-28T11:58:03.256407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:32.704729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":182,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-28T11:58:03.252894+0000","last_change":"2023-11-28T11:56:28.472008+0000","last_active":"2023-11-28T11:58:03.252894+0000","last_peered":"2023-11-28T11:58:03.252894+0000","last_clean":"2023-11-28T11:58:03.252894+0000","last_became_active":"2023-11-28T11:56:28.469273+0000","last_became_peered":"2023-11-28T11:56:28.469273+0000","last_unstale":"2023-11-28T11:58:03.252894+0000","last_undegraded":"2023-11-28T11:58:03.252894+0000","last_fullsized":"2023-11-28T11:58:03.252894+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:27.291192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:27.291192+0000","last_clean_scrub_stamp":"2023-11-28T11:56:27.291192+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:14:48.860420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509464,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9852,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94361988,"statfs":{"total":96636764160,"available":96626675712,"internally_reserved":0,"allocated":1101824,"data_stored":814930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.93300000000000005}]},{"osd":1,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.1180000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.454}]},{"osd":3,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.6000000000000001,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.55}]},{"osd":4,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.0489999999999999,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.347}]},{"osd":5,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":2.4710000000000001,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.411,"5min":1.411,"15min":1.411},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":1.212}]},{"osd":6,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.575,"15min":1.575},"min":{"1min":1.266,"5min":1.266,"15min":1.266},"max":{"1min":2.4319999999999999,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.47,"5min":1.47,"15min":1.47},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":2.468,"5min":2.468,"15min":2.468},"last":1.494}]}]},{"osd":6,"up_from":15,"seq":64424509464,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8700,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363140,"statfs":{"total":96636764160,"available":96627855360,"internally_reserved":0,"allocated":512000,"data_stored":225128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.347,"5min":2.347,"15min":2.347},"last":0.90900000000000003}]},{"osd":1,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":1.24}]},{"osd":2,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":3.9620000000000002,"5min":3.9620000000000002,"15min":3.9620000000000002},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.96999999999999997}]},{"osd":3,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.319},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":2.0790000000000002,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.4610000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.361},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.2889999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":1.4970000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:57:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.546},{"interface":"front","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.177}]}]},{"osd":5,"up_from":15,"seq":64424509464,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8696,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363144,"statfs":{"total":96636764160,"available":96627859456,"internally_reserved":0,"allocated":507904,"data_stored":224542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.456}]},{"osd":1,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.046}]},{"osd":2,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":1.79}]},{"osd":3,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.113},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.5329999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.319},{"interface":"front","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.224}]},{"osd":6,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.28,"15min":1.28},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.712},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":1.4430000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":1.012,"5min":1.012,"15min":1.012},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.5149999999999999},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.629}]}]},{"osd":4,"up_from":15,"seq":64424509464,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8832,"kb_used_data":504,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363008,"statfs":{"total":96636764160,"available":96627720192,"internally_reserved":0,"allocated":516096,"data_stored":226020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.96499999999999997}]},{"osd":1,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.8860000000000001,"5min":2.8860000000000001,"15min":2.8860000000000001},"last":1.1799999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.3500000000000001,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.27},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":3.0630000000000002,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":1.488}]},{"osd":3,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.3280000000000001}]},{"osd":5,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":2.972,"5min":2.972,"15min":2.972},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.87}]},{"osd":6,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.3500000000000001,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.008},{"interface":"front","average":{"1min":1.569,"5min":1.569,"15min":1.569},"min":{"1min":1.038,"5min":1.038,"15min":1.038},"max":{"1min":3.133,"5min":3.133,"15min":3.133},"last":1.298}]},{"osd":7,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.548,"5min":1.548,"15min":1.548},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":2.2679999999999998,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.04},{"interface":"front","average":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"min":{"1min":1.21,"5min":1.21,"15min":1.21},"max":{"1min":2.198,"5min":2.198,"15min":2.198},"last":1.099}]}]},{"osd":3,"up_from":15,"seq":64424509464,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8768,"kb_used_data":504,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363072,"statfs":{"total":96636764160,"available":96627785728,"internally_reserved":0,"allocated":516096,"data_stored":225094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":2.177,"5min":2.177,"15min":2.177},"last":0.76500000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.73799999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.25},{"interface":"front","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":0.98799999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":2.8439999999999999,"5min":2.8439999999999999,"15min":2.8439999999999999},"last":1.032}]},{"osd":5,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.9670000000000001,"5min":2.9670000000000001,"15min":2.9670000000000001},"last":1.151},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":3.7429999999999999,"5min":3.7429999999999999,"15min":3.7429999999999999},"last":1.133}]},{"osd":6,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.927,"5min":2.927,"15min":2.927},"last":1.3440000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":3.5030000000000001,"5min":3.5030000000000001,"15min":3.5030000000000001},"last":1.28},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.6320000000000001,"5min":2.6320000000000001,"15min":2.6320000000000001},"last":1.3069999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509464,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8760,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363080,"statfs":{"total":96636764160,"available":96627793920,"internally_reserved":0,"allocated":507904,"data_stored":224542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":2.7469999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.98099999999999998}]},{"osd":2,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.196}]},{"osd":3,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.81799999999999995}]},{"osd":4,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":3.411,"5min":3.411,"15min":3.411},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.6680000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":1.417}]},{"osd":5,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":3.6869999999999998,"5min":3.6869999999999998,"15min":3.6869999999999998},"last":1.278},{"interface":"front","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.0609999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.5269999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"min":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":3.5379999999999998,"5min":3.5379999999999998,"15min":3.5379999999999998},"last":1.242},{"interface":"front","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.5739999999999998,"5min":2.5739999999999998,"15min":2.5739999999999998},"last":1.5}]},{"osd":7,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.452},{"interface":"front","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.4249999999999998,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.349}]}]},{"osd":2,"up_from":14,"seq":60129542168,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8644,"kb_used_data":508,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363196,"statfs":{"total":96636764160,"available":96627912704,"internally_reserved":0,"allocated":520192,"data_stored":226042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:57:25 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.0860000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.754,"5min":1.754,"15min":1.754},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.66600000000000004}]},{"osd":3,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":1.01},{"interface":"front","average":{"1min":1.3,"5min":1.3,"15min":1.3},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.617,"5min":2.617,"15min":2.617},"last":1.129}]},{"osd":4,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.9620000000000002,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.3860000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":1.3740000000000001}]},{"osd":5,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":2.738,"5min":2.738,"15min":2.738},"last":1.623},{"interface":"front","average":{"1min":1.575,"5min":1.575,"15min":1.575},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":4.0309999999999997,"5min":4.0309999999999997,"15min":4.0309999999999997},"last":1.3100000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":4.2240000000000002,"5min":4.2240000000000002,"15min":4.2240000000000002},"last":1.5720000000000001},{"interface":"front","average":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":3.0750000000000002,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":1.3460000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:57:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":2.3660000000000001,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.476},{"interface":"front","average":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":4.3570000000000002,"5min":4.3570000000000002,"15min":4.3570000000000002},"last":1.6719999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542168,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9848,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94361992,"statfs":{"total":96636764160,"available":96626679808,"internally_reserved":0,"allocated":1097728,"data_stored":813955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":1.179}]},{"osd":2,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.077},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":1.5089999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.94699999999999995}]},{"osd":4,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":3.4809999999999999,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.262},{"interface":"front","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":3.1629999999999998,"5min":3.1629999999999998,"15min":3.1629999999999998},"last":1.0129999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":1.8580000000000001},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.266,"5min":2.266,"15min":2.266},"last":1.298}]},{"osd":6,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.4060000000000001,"5min":2.4060000000000001,"15min":2.4060000000000001},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"max":{"1min":2.3599999999999999,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":1.7969999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:57:29 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":2.3330000000000002,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.361},{"interface":"front","average":{"1min":1.583,"5min":1.583,"15min":1.583},"min":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"max":{"1min":2.6040000000000001,"5min":2.6040000000000001,"15min":2.6040000000000001},"last":1.903}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:58:13.078 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T11:58:13.078 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2023-11-28T11:58:13.322 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.308+0000 7f2219d58700 1 Processor -- start 2023-11-28T11:58:13.322 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.308+0000 7f2219d58700 1 -- start start 2023-11-28T11:58:13.322 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.312+0000 7f2219d58700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f221415c7c0 0x7f221406cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:13.322 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.312+0000 7f2219d58700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22140cdba0 con 0x7f22140cddf0 2023-11-28T11:58:13.322 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.312+0000 7f2219d58700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22140cd8d0 con 0x7f2214161030 2023-11-28T11:58:13.322 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.312+0000 7f2219d58700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f221406c010 con 0x7f221415c7c0 2023-11-28T11:58:13.322 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.312+0000 7f2219557700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f22140cddf0 0x7f22140ce1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:40260/0 (socket says 172.21.15.39:40260) 2023-11-28T11:58:13.322 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.312+0000 7f2219557700 1 -- 172.21.15.39:0/2875863340 learned_addr learned my addr 172.21.15.39:0/2875863340 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:58:13.322 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.312+0000 7f2218d56700 1 --2- 172.21.15.39:0/2875863340 >> v2:172.21.15.184:3300/0 conn(0x7f221415c7c0 0x7f221406cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:13.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.316+0000 7f22137fe700 1 -- 172.21.15.39:0/2875863340 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1778833155 0 0) 0x7f22140cdba0 con 0x7f22140cddf0 2023-11-28T11:58:13.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.316+0000 7f22137fe700 1 -- 172.21.15.39:0/2875863340 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22040035d0 con 0x7f22140cddf0 2023-11-28T11:58:13.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.316+0000 7f2218d56700 1 -- 172.21.15.39:0/2875863340 >> v1:172.21.15.184:6789/0 conn(0x7f2214161030 legacy=0x7f22140cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:13.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.316+0000 7f22137fe700 1 -- 172.21.15.39:0/2875863340 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2595181988 0 0) 0x7f22140cd8d0 con 0x7f2214161030 2023-11-28T11:58:13.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.316+0000 7f2218d56700 1 -- 172.21.15.39:0/2875863340 >> v1:172.21.15.39:6789/0 conn(0x7f22140cddf0 legacy=0x7f22140ce1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:13.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.316+0000 7f2218d56700 1 -- 172.21.15.39:0/2875863340 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f221406c2f0 con 0x7f221415c7c0 2023-11-28T11:58:13.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.316+0000 7f2218d56700 1 --2- 172.21.15.39:0/2875863340 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f221415c7c0 0x7f221406cdd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2208009850 tx=0x7f2208009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e2758dc19da4ee3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:13.324 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.316+0000 7f22137fe700 1 -- 172.21.15.39:0/2875863340 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2208011830 con 0x7f221415c7c0 2023-11-28T11:58:13.324 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.316+0000 7f22137fe700 1 -- 172.21.15.39:0/2875863340 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2208011990 con 0x7f221415c7c0 2023-11-28T11:58:13.324 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.316+0000 7f22137fe700 1 -- 172.21.15.39:0/2875863340 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2208011d40 con 0x7f221415c7c0 2023-11-28T11:58:13.324 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.316+0000 7f2219d58700 1 -- 172.21.15.39:0/2875863340 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f221415c7c0 msgr2=0x7f221406cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:13.324 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.316+0000 7f2219d58700 1 --2- 172.21.15.39:0/2875863340 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f221415c7c0 0x7f221406cdd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2208009850 tx=0x7f2208009b60 comp rx=0 tx=0).stop 2023-11-28T11:58:13.324 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.316+0000 7f2219d58700 1 -- 172.21.15.39:0/2875863340 shutdown_connections 2023-11-28T11:58:13.324 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.316+0000 7f2219d58700 1 --2- 172.21.15.39:0/2875863340 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f221415c7c0 0x7f221406cdd0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:13.325 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.316+0000 7f2219d58700 1 -- 172.21.15.39:0/2875863340 >> 172.21.15.39:0/2875863340 conn(0x7f22140d3800 msgr2=0x7f22140cf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:13.325 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.316+0000 7f2219d58700 1 -- 172.21.15.39:0/2875863340 shutdown_connections 2023-11-28T11:58:13.325 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.316+0000 7f2219d58700 1 -- 172.21.15.39:0/2875863340 wait complete. 2023-11-28T11:58:13.328 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.320+0000 7f2219d58700 1 Processor -- start 2023-11-28T11:58:13.328 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.320+0000 7f2219d58700 1 -- start start 2023-11-28T11:58:13.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.324+0000 7f2219d58700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22140cddf0 0x7f22140c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:13.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.324+0000 7f2219d58700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f221415c7c0 0x7f221414e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:13.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.324+0000 7f2219d58700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22140c8f00 0x7f22140cb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:13.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.324+0000 7f2219d58700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22140ccb90 con 0x7f22140cddf0 2023-11-28T11:58:13.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.324+0000 7f2219d58700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22140ca180 con 0x7f221415c7c0 2023-11-28T11:58:13.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.324+0000 7f2219d58700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f221414e570 con 0x7f22140c8f00 2023-11-28T11:58:13.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.324+0000 7f2218d56700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22140cddf0 0x7f22140c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:13.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.324+0000 7f2218d56700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22140cddf0 0x7f22140c9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46576/0 (socket says 172.21.15.39:46576) 2023-11-28T11:58:13.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.324+0000 7f2218d56700 1 -- 172.21.15.39:0/2358739668 learned_addr learned my addr 172.21.15.39:0/2358739668 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:13.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.324+0000 7f2219557700 1 --2- 172.21.15.39:0/2358739668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22140c8f00 0x7f22140cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:13.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.324+0000 7f2213fff700 1 --2- 172.21.15.39:0/2358739668 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f221415c7c0 0x7f221414e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:13.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.324+0000 7f2218d56700 1 -- 172.21.15.39:0/2358739668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22140c8f00 msgr2=0x7f22140cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:13.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.324+0000 7f2218d56700 1 --2- 172.21.15.39:0/2358739668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22140c8f00 0x7f22140cb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:13.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.324+0000 7f2218d56700 1 -- 172.21.15.39:0/2358739668 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f221415c7c0 msgr2=0x7f221414e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:13.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.324+0000 7f2218d56700 1 --2- 172.21.15.39:0/2358739668 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f221415c7c0 0x7f221414e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:13.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.324+0000 7f2218d56700 1 -- 172.21.15.39:0/2358739668 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22080094b0 con 0x7f22140cddf0 2023-11-28T11:58:13.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.324+0000 7f2213fff700 1 --2- 172.21.15.39:0/2358739668 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f221415c7c0 0x7f221414e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:58:13.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.324+0000 7f2218d56700 1 --2- 172.21.15.39:0/2358739668 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22140cddf0 0x7f22140c9c40 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f221406fdb0 tx=0x7f2208004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:13.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.324+0000 7f22117fa700 1 -- 172.21.15.39:0/2358739668 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220801ab70 con 0x7f22140cddf0 2023-11-28T11:58:13.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.324+0000 7f22117fa700 1 -- 172.21.15.39:0/2358739668 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f220801f070 con 0x7f22140cddf0 2023-11-28T11:58:13.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.324+0000 7f2219d58700 1 -- 172.21.15.39:0/2358739668 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f221406c8b0 con 0x7f22140cddf0 2023-11-28T11:58:13.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.324+0000 7f22117fa700 1 -- 172.21.15.39:0/2358739668 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220801b430 con 0x7f22140cddf0 2023-11-28T11:58:13.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.324+0000 7f2219d58700 1 -- 172.21.15.39:0/2358739668 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f221406c5d0 con 0x7f22140cddf0 2023-11-28T11:58:13.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.328+0000 7f2219d58700 1 -- 172.21.15.39:0/2358739668 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f221415cb90 con 0x7f22140cddf0 2023-11-28T11:58:13.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.328+0000 7f22117fa700 1 -- 172.21.15.39:0/2358739668 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f220800f050 con 0x7f22140cddf0 2023-11-28T11:58:13.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.328+0000 7f22117fa700 1 --2- 172.21.15.39:0/2358739668 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f21f8064ee0 0x7f21f8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:13.338 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.328+0000 7f22117fa700 1 -- 172.21.15.39:0/2358739668 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2208083230 con 0x7f22140cddf0 2023-11-28T11:58:13.338 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.328+0000 7f2213fff700 1 --2- 172.21.15.39:0/2358739668 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f21f8064ee0 0x7f21f8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:13.338 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.332+0000 7f2213fff700 1 --2- 172.21.15.39:0/2358739668 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f21f8064ee0 0x7f21f8067390 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f22140b50e0 tx=0x7f2200009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:13.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.336+0000 7f22117fa700 1 -- 172.21.15.39:0/2358739668 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f22080511a0 con 0x7f22140cddf0 2023-11-28T11:58:13.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.568+0000 7f2219d58700 1 -- 172.21.15.39:0/2358739668 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7f22140cccd0 con 0x7f22140cddf0 2023-11-28T11:58:13.586 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.580+0000 7f22117fa700 1 -- 172.21.15.39:0/2358739668 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 184+0+0 (secure 0 0 0) 0x7f22140cccd0 con 0x7f22140cddf0 2023-11-28T11:58:13.589 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.584+0000 7f2219d58700 1 -- 172.21.15.39:0/2358739668 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f21f8064ee0 msgr2=0x7f21f8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:13.589 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.584+0000 7f2219d58700 1 --2- 172.21.15.39:0/2358739668 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f21f8064ee0 0x7f21f8067390 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f22140b50e0 tx=0x7f2200009040 comp rx=0 tx=0).stop 2023-11-28T11:58:13.589 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.584+0000 7f2219d58700 1 -- 172.21.15.39:0/2358739668 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22140cddf0 msgr2=0x7f22140c9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:13.589 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.584+0000 7f2219d58700 1 --2- 172.21.15.39:0/2358739668 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22140cddf0 0x7f22140c9c40 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f221406fdb0 tx=0x7f2208004770 comp rx=0 tx=0).stop 2023-11-28T11:58:13.590 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.584+0000 7f2219d58700 1 -- 172.21.15.39:0/2358739668 shutdown_connections 2023-11-28T11:58:13.590 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.584+0000 7f2219d58700 1 --2- 172.21.15.39:0/2358739668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22140c8f00 0x7f22140cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:13.590 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.584+0000 7f2219d58700 1 --2- 172.21.15.39:0/2358739668 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f21f8064ee0 0x7f21f8067390 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:13.590 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.584+0000 7f2219d58700 1 --2- 172.21.15.39:0/2358739668 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f221415c7c0 0x7f221414e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:13.590 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.584+0000 7f2219d58700 1 --2- 172.21.15.39:0/2358739668 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22140cddf0 0x7f22140c9c40 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:13.590 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.584+0000 7f2219d58700 1 -- 172.21.15.39:0/2358739668 >> 172.21.15.39:0/2358739668 conn(0x7f22140d3800 msgr2=0x7f2214060740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:13.590 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.584+0000 7f2219d58700 1 -- 172.21.15.39:0/2358739668 shutdown_connections 2023-11-28T11:58:13.591 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.584+0000 7f2219d58700 1 -- 172.21.15.39:0/2358739668 wait complete. 2023-11-28T11:58:13.591 INFO:teuthology.orchestra.run.smithi039.stderr:updated caps for client.0 2023-11-28T11:58:13.612 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:58:13.792 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.788+0000 7fcad69a1700 1 Processor -- start 2023-11-28T11:58:13.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.788+0000 7fcad69a1700 1 -- start start 2023-11-28T11:58:13.795 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.788+0000 7fcad69a1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcad015c640 0x7fcad00d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:13.795 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.788+0000 7fcad69a1700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fcad0069e00 0x7fcad006a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:13.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.788+0000 7fcad69a1700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad006c600 con 0x7fcad0071aa0 2023-11-28T11:58:13.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.788+0000 7fcad69a1700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad006cef0 con 0x7fcad0069e00 2023-11-28T11:58:13.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.788+0000 7fcad69a1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad006a7c0 con 0x7fcad015c640 2023-11-28T11:58:13.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.788+0000 7fcad519e700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fcad0071aa0 0x7fcad006d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:40272/0 (socket says 172.21.15.39:40272) 2023-11-28T11:58:13.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.788+0000 7fcad519e700 1 -- 172.21.15.39:0/935339649 learned_addr learned my addr 172.21.15.39:0/935339649 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:58:13.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.792+0000 7fcad599f700 1 --2- 172.21.15.39:0/935339649 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcad015c640 0x7fcad00d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:13.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.792+0000 7fcad61a0700 1 --2- 172.21.15.39:0/935339649 >> v2:172.21.15.39:3300/0 conn(0x7fcad0069e00 0x7fcad006a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:13.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.792+0000 7fcad499d700 1 -- 172.21.15.39:0/935339649 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3773400800 0 0) 0x7fcad006c600 con 0x7fcad0071aa0 2023-11-28T11:58:13.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.792+0000 7fcad499d700 1 -- 172.21.15.39:0/935339649 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcabc0035d0 con 0x7fcad0071aa0 2023-11-28T11:58:13.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.792+0000 7fcad61a0700 1 -- 172.21.15.39:0/935339649 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcad015c640 msgr2=0x7fcad00d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:13.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.792+0000 7fcad61a0700 1 --2- 172.21.15.39:0/935339649 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcad015c640 0x7fcad00d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:13.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.792+0000 7fcad61a0700 1 -- 172.21.15.39:0/935339649 >> v1:172.21.15.39:6789/0 conn(0x7fcad0071aa0 legacy=0x7fcad006d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:13.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.792+0000 7fcad499d700 1 -- 172.21.15.39:0/935339649 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 543899100 0 0) 0x7fcabc0035d0 con 0x7fcad0071aa0 2023-11-28T11:58:13.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.792+0000 7fcad61a0700 1 -- 172.21.15.39:0/935339649 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad00722f0 con 0x7fcad0069e00 2023-11-28T11:58:13.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.792+0000 7fcad599f700 1 --2- 172.21.15.39:0/935339649 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcad015c640 0x7fcad00d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:58:13.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.792+0000 7fcad61a0700 1 --2- 172.21.15.39:0/935339649 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcad0069e00 0x7fcad006a280 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fcac8009d90 tx=0x7fcac800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbec055698f8e4b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:13.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.792+0000 7fcad499d700 1 -- 172.21.15.39:0/935339649 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac800e070 con 0x7fcad0069e00 2023-11-28T11:58:13.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.792+0000 7fcad499d700 1 -- 172.21.15.39:0/935339649 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac8003a40 con 0x7fcad0069e00 2023-11-28T11:58:13.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.792+0000 7fcad499d700 1 -- 172.21.15.39:0/935339649 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac0001670 con 0x7fcad0069e00 2023-11-28T11:58:13.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.792+0000 7fcad69a1700 1 -- 172.21.15.39:0/935339649 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcad0069e00 msgr2=0x7fcad006a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:13.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.792+0000 7fcad69a1700 1 --2- 172.21.15.39:0/935339649 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcad0069e00 0x7fcad006a280 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fcac8009d90 tx=0x7fcac800b330 comp rx=0 tx=0).stop 2023-11-28T11:58:13.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.796+0000 7fcad69a1700 1 -- 172.21.15.39:0/935339649 shutdown_connections 2023-11-28T11:58:13.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.796+0000 7fcad69a1700 1 --2- 172.21.15.39:0/935339649 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcad0069e00 0x7fcad006a280 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:13.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.796+0000 7fcad69a1700 1 --2- 172.21.15.39:0/935339649 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcad015c640 0x7fcad00d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:13.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.796+0000 7fcad69a1700 1 -- 172.21.15.39:0/935339649 >> 172.21.15.39:0/935339649 conn(0x7fcad00b6520 msgr2=0x7fcad0071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:13.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.796+0000 7fcad69a1700 1 -- 172.21.15.39:0/935339649 shutdown_connections 2023-11-28T11:58:13.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.796+0000 7fcad69a1700 1 -- 172.21.15.39:0/935339649 wait complete. 2023-11-28T11:58:13.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.796+0000 7fcad69a1700 1 Processor -- start 2023-11-28T11:58:13.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.796+0000 7fcad69a1700 1 -- start start 2023-11-28T11:58:13.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.796+0000 7fcad69a1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcad0069e00 0x7fcad0158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:13.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.796+0000 7fcad69a1700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcad0071aa0 0x7fcad00c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:13.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.796+0000 7fcad69a1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcad015c640 0x7fcad00afb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:13.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.796+0000 7fcad69a1700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad00c8f00 con 0x7fcad0071aa0 2023-11-28T11:58:13.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.796+0000 7fcad69a1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad00c7e60 con 0x7fcad0069e00 2023-11-28T11:58:13.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.796+0000 7fcad69a1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad00c8140 con 0x7fcad015c640 2023-11-28T11:58:13.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.796+0000 7fcad519e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcad0071aa0 0x7fcad00c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:13.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.800+0000 7fcad519e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcad0071aa0 0x7fcad00c7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46592/0 (socket says 172.21.15.39:46592) 2023-11-28T11:58:13.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.800+0000 7fcad519e700 1 -- 172.21.15.39:0/715592340 learned_addr learned my addr 172.21.15.39:0/715592340 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:13.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.800+0000 7fcad61a0700 1 --2- 172.21.15.39:0/715592340 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcad015c640 0x7fcad00afb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:13.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.800+0000 7fcad599f700 1 --2- 172.21.15.39:0/715592340 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcad0069e00 0x7fcad0158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:13.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.800+0000 7fcad519e700 1 -- 172.21.15.39:0/715592340 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcad015c640 msgr2=0x7fcad00afb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:13.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.800+0000 7fcad519e700 1 --2- 172.21.15.39:0/715592340 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcad015c640 0x7fcad00afb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:13.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.800+0000 7fcad519e700 1 -- 172.21.15.39:0/715592340 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcad0069e00 msgr2=0x7fcad0158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:13.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.800+0000 7fcad519e700 1 --2- 172.21.15.39:0/715592340 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcad0069e00 0x7fcad0158e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:13.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.800+0000 7fcad519e700 1 -- 172.21.15.39:0/715592340 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcacc0094b0 con 0x7fcad0071aa0 2023-11-28T11:58:13.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.800+0000 7fcad599f700 1 --2- 172.21.15.39:0/715592340 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcad0069e00 0x7fcad0158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:58:13.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.800+0000 7fcad519e700 1 --2- 172.21.15.39:0/715592340 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcad0071aa0 0x7fcad00c7530 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fcac000c520 tx=0x7fcac000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:13.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.800+0000 7fcac67fc700 1 -- 172.21.15.39:0/715592340 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac0004ca0 con 0x7fcad0071aa0 2023-11-28T11:58:13.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.800+0000 7fcac67fc700 1 -- 172.21.15.39:0/715592340 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac0004e00 con 0x7fcad0071aa0 2023-11-28T11:58:13.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.800+0000 7fcad69a1700 1 -- 172.21.15.39:0/715592340 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcac8009a70 con 0x7fcad0071aa0 2023-11-28T11:58:13.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.800+0000 7fcac67fc700 1 -- 172.21.15.39:0/715592340 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac00072f0 con 0x7fcad0071aa0 2023-11-28T11:58:13.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.800+0000 7fcad69a1700 1 -- 172.21.15.39:0/715592340 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad015ca10 con 0x7fcad0071aa0 2023-11-28T11:58:13.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.800+0000 7fcad69a1700 1 -- 172.21.15.39:0/715592340 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcad006da20 con 0x7fcad0071aa0 2023-11-28T11:58:13.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.804+0000 7fcac67fc700 1 -- 172.21.15.39:0/715592340 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fcac001a020 con 0x7fcad0071aa0 2023-11-28T11:58:13.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.804+0000 7fcac67fc700 1 --2- 172.21.15.39:0/715592340 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcab4064ee0 0x7fcab4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:13.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.804+0000 7fcac67fc700 1 -- 172.21.15.39:0/715592340 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fcac0081d50 con 0x7fcad0071aa0 2023-11-28T11:58:13.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.804+0000 7fcad599f700 1 --2- 172.21.15.39:0/715592340 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcab4064ee0 0x7fcab4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:13.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.804+0000 7fcad599f700 1 --2- 172.21.15.39:0/715592340 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcab4064ee0 0x7fcab4067390 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcacc009d00 tx=0x7fcacc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:13.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:13.812+0000 7fcac67fc700 1 -- 172.21.15.39:0/715592340 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcac004fc40 con 0x7fcad0071aa0 2023-11-28T11:58:14.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.020+0000 7fcad69a1700 1 -- 172.21.15.39:0/715592340 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcad0072010 con 0x7fcad0071aa0 2023-11-28T11:58:14.026 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.020+0000 7fcac67fc700 1 -- 172.21.15.39:0/715592340 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4654 (secure 0 0 0) 0x7fcac0007db0 con 0x7fcad0071aa0 2023-11-28T11:58:14.026 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:58:14.026 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/3875562914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3875562914},{"type":"v1","addr":"172.21.15.184:6836","nonce":3875562914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5295,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/4053840838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":4053840838},{"type":"v1","addr":"172.21.15.39:6833","nonce":4053840838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5304,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2819411287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2819411287},{"type":"v1","addr":"172.21.15.39:6835","nonce":2819411287}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:58:03.228365+0000","modified":"2023-11-28T11:58:06.252058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5317},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5317":{"gid":5317,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.184:6837/2775071992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":2775071992},{"type":"v1","addr":"172.21.15.184:6837","nonce":2775071992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T11:58:14.029 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.024+0000 7fcad69a1700 1 -- 172.21.15.39:0/715592340 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcab4064ee0 msgr2=0x7fcab4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:14.029 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.024+0000 7fcad69a1700 1 --2- 172.21.15.39:0/715592340 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcab4064ee0 0x7fcab4067390 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcacc009d00 tx=0x7fcacc008040 comp rx=0 tx=0).stop 2023-11-28T11:58:14.029 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.024+0000 7fcad69a1700 1 -- 172.21.15.39:0/715592340 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcad0071aa0 msgr2=0x7fcad00c7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:14.029 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.024+0000 7fcad69a1700 1 --2- 172.21.15.39:0/715592340 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcad0071aa0 0x7fcad00c7530 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fcac000c520 tx=0x7fcac000c8e0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.029 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.024+0000 7fcad69a1700 1 -- 172.21.15.39:0/715592340 shutdown_connections 2023-11-28T11:58:14.030 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.024+0000 7fcad69a1700 1 --2- 172.21.15.39:0/715592340 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcad015c640 0x7fcad00afb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.030 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.024+0000 7fcad69a1700 1 --2- 172.21.15.39:0/715592340 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcad0071aa0 0x7fcad00c7530 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.030 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.024+0000 7fcad69a1700 1 --2- 172.21.15.39:0/715592340 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcab4064ee0 0x7fcab4067390 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.030 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.024+0000 7fcad69a1700 1 --2- 172.21.15.39:0/715592340 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcad0069e00 0x7fcad0158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.030 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.024+0000 7fcad69a1700 1 -- 172.21.15.39:0/715592340 >> 172.21.15.39:0/715592340 conn(0x7fcad00b6520 msgr2=0x7fcad015eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:14.030 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.024+0000 7fcad69a1700 1 -- 172.21.15.39:0/715592340 shutdown_connections 2023-11-28T11:58:14.030 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.024+0000 7fcad69a1700 1 -- 172.21.15.39:0/715592340 wait complete. 2023-11-28T11:58:14.032 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 16 2023-11-28T11:58:14.455 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T11:58:03.228365+0000', 'modified': '2023-11-28T11:58:06.252058+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5317}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5317': {'gid': 5317, 'name': 'd', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.184:6837/2775071992', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6835', 'nonce': 2775071992}, {'type': 'v1', 'addr': '172.21.15.184:6837', 'nonce': 2775071992}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T11:58:14.455 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T11:58:14.455 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-28T11:58:14.648 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.640+0000 7f7b55e34700 1 Processor -- start 2023-11-28T11:58:14.648 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.640+0000 7f7b55e34700 1 -- start start 2023-11-28T11:58:14.648 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.644+0000 7f7b55e34700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7b5015d510 0x7f7b500b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:14.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.644+0000 7f7b55e34700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7b500b6030 0x7f7b50070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:14.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.644+0000 7f7b55e34700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b5015d080 con 0x7f7b501534a0 2023-11-28T11:58:14.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.644+0000 7f7b55e34700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b5015d970 con 0x7f7b500b6030 2023-11-28T11:58:14.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.644+0000 7f7b55e34700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b50153870 con 0x7f7b5015d510 2023-11-28T11:58:14.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.644+0000 7f7b4ffff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7b500b6030 0x7f7b50070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:14.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.644+0000 7f7b4ffff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7b500b6030 0x7f7b50070630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46598/0 (socket says 172.21.15.39:46598) 2023-11-28T11:58:14.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.644+0000 7f7b4ffff700 1 -- 172.21.15.39:0/3561219355 learned_addr learned my addr 172.21.15.39:0/3561219355 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:14.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.644+0000 7f7b4effd700 1 --2- 172.21.15.39:0/3561219355 >> v2:172.21.15.184:3300/0 conn(0x7f7b5015d510 0x7f7b500b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:14.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.644+0000 7f7b4ffff700 1 -- 172.21.15.39:0/3561219355 >> v2:172.21.15.184:3300/0 conn(0x7f7b5015d510 msgr2=0x7f7b500b5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:14.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.644+0000 7f7b4ffff700 1 --2- 172.21.15.39:0/3561219355 >> v2:172.21.15.184:3300/0 conn(0x7f7b5015d510 0x7f7b500b5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.644+0000 7f7b4ffff700 1 -- 172.21.15.39:0/3561219355 >> v1:172.21.15.39:6789/0 conn(0x7f7b501534a0 legacy=0x7f7b50160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:14.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.644+0000 7f7b4ffff700 1 -- 172.21.15.39:0/3561219355 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b500b6430 con 0x7f7b500b6030 2023-11-28T11:58:14.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.644+0000 7f7b4ffff700 1 --2- 172.21.15.39:0/3561219355 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b500b6030 0x7f7b50070630 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f7b50072450 tx=0x7f7b4800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f9ab78deedf549 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:14.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.644+0000 7f7b4e7fc700 1 -- 172.21.15.39:0/3561219355 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4800e070 con 0x7f7b500b6030 2023-11-28T11:58:14.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.644+0000 7f7b4e7fc700 1 -- 172.21.15.39:0/3561219355 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4800b910 con 0x7f7b500b6030 2023-11-28T11:58:14.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.644+0000 7f7b4e7fc700 1 -- 172.21.15.39:0/3561219355 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4800bcc0 con 0x7f7b500b6030 2023-11-28T11:58:14.652 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.644+0000 7f7b55e34700 1 -- 172.21.15.39:0/3561219355 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b500b6030 msgr2=0x7f7b50070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:14.652 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.644+0000 7f7b55e34700 1 --2- 172.21.15.39:0/3561219355 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b500b6030 0x7f7b50070630 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f7b50072450 tx=0x7f7b4800b330 comp rx=0 tx=0).stop 2023-11-28T11:58:14.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.648+0000 7f7b55e34700 1 -- 172.21.15.39:0/3561219355 shutdown_connections 2023-11-28T11:58:14.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.648+0000 7f7b55e34700 1 --2- 172.21.15.39:0/3561219355 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b500b6030 0x7f7b50070630 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.648+0000 7f7b55e34700 1 --2- 172.21.15.39:0/3561219355 >> v2:172.21.15.184:3300/0 conn(0x7f7b5015d510 0x7f7b500b5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.648+0000 7f7b55e34700 1 -- 172.21.15.39:0/3561219355 >> 172.21.15.39:0/3561219355 conn(0x7f7b5006bfc0 msgr2=0x7f7b5006c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:14.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.648+0000 7f7b55e34700 1 -- 172.21.15.39:0/3561219355 shutdown_connections 2023-11-28T11:58:14.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.648+0000 7f7b55e34700 1 -- 172.21.15.39:0/3561219355 wait complete. 2023-11-28T11:58:14.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.648+0000 7f7b55e34700 1 Processor -- start 2023-11-28T11:58:14.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.648+0000 7f7b55e34700 1 -- start start 2023-11-28T11:58:14.656 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.648+0000 7f7b55e34700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b500b6030 0x7f7b500708a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:14.656 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.648+0000 7f7b55e34700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b501534a0 0x7f7b5008d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:14.656 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.648+0000 7f7b55e34700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b5015d510 0x7f7b5008d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:14.656 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.648+0000 7f7b55e34700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5008df30 con 0x7f7b501534a0 2023-11-28T11:58:14.656 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.648+0000 7f7b55e34700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b501f61f0 con 0x7f7b5015d510 2023-11-28T11:58:14.656 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.648+0000 7f7b55e34700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5008a900 con 0x7f7b500b6030 2023-11-28T11:58:14.657 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.652+0000 7f7b4effd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b501534a0 0x7f7b5008d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:14.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.652+0000 7f7b4effd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b501534a0 0x7f7b5008d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46606/0 (socket says 172.21.15.39:46606) 2023-11-28T11:58:14.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.652+0000 7f7b4effd700 1 -- 172.21.15.39:0/3882400428 learned_addr learned my addr 172.21.15.39:0/3882400428 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:14.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.652+0000 7f7b4ffff700 1 --2- 172.21.15.39:0/3882400428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b5015d510 0x7f7b5008d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:14.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.652+0000 7f7b4f7fe700 1 --2- 172.21.15.39:0/3882400428 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b500b6030 0x7f7b500708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:14.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.652+0000 7f7b4effd700 1 -- 172.21.15.39:0/3882400428 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b500b6030 msgr2=0x7f7b500708a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:14.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.652+0000 7f7b4effd700 1 --2- 172.21.15.39:0/3882400428 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b500b6030 0x7f7b500708a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.652+0000 7f7b4effd700 1 -- 172.21.15.39:0/3882400428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b5015d510 msgr2=0x7f7b5008d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:14.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.652+0000 7f7b4effd700 1 --2- 172.21.15.39:0/3882400428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b5015d510 0x7f7b5008d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.652+0000 7f7b4effd700 1 -- 172.21.15.39:0/3882400428 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b48009b30 con 0x7f7b501534a0 2023-11-28T11:58:14.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.652+0000 7f7b4effd700 1 --2- 172.21.15.39:0/3882400428 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b501534a0 0x7f7b5008d4b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7b4400e870 tx=0x7f7b4400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:14.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.652+0000 7f7b37fff700 1 -- 172.21.15.39:0/3882400428 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b440095a0 con 0x7f7b501534a0 2023-11-28T11:58:14.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.652+0000 7f7b37fff700 1 -- 172.21.15.39:0/3882400428 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b44013680 con 0x7f7b501534a0 2023-11-28T11:58:14.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.652+0000 7f7b37fff700 1 -- 172.21.15.39:0/3882400428 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b440139f0 con 0x7f7b501534a0 2023-11-28T11:58:14.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.652+0000 7f7b55e34700 1 -- 172.21.15.39:0/3882400428 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b500b56a0 con 0x7f7b501534a0 2023-11-28T11:58:14.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.652+0000 7f7b55e34700 1 -- 172.21.15.39:0/3882400428 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b500b53c0 con 0x7f7b501534a0 2023-11-28T11:58:14.661 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.656+0000 7f7b37fff700 1 -- 172.21.15.39:0/3882400428 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7b44019030 con 0x7f7b501534a0 2023-11-28T11:58:14.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.656+0000 7f7b37fff700 1 --2- 172.21.15.39:0/3882400428 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7b3c064f30 0x7f7b3c0673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:14.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.656+0000 7f7b37fff700 1 -- 172.21.15.39:0/3882400428 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7b44081e10 con 0x7f7b501534a0 2023-11-28T11:58:14.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.656+0000 7f7b4f7fe700 1 --2- 172.21.15.39:0/3882400428 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7b3c064f30 0x7f7b3c0673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:14.664 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.660+0000 7f7b590c2740 1 Processor -- start 2023-11-28T11:58:14.664 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.660+0000 7f7b590c2740 1 -- start start 2023-11-28T11:58:14.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.660+0000 7f7b4f7fe700 1 --2- 172.21.15.39:0/3882400428 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7b3c064f30 0x7f7b3c0673e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7b40000f60 tx=0x7f7b40009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:14.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.660+0000 7f7b590c2740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x28a7ae0 0x2b57e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:14.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.660+0000 7f7b590c2740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x28a7710 0x2b58340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:14.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.660+0000 7f7b590c2740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x28f2790 0x2b58880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:14.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.660+0000 7f7b590c2740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a16ae0 con 0x28a7710 2023-11-28T11:58:14.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.660+0000 7f7b590c2740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a86bd0 con 0x28f2790 2023-11-28T11:58:14.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.660+0000 7f7b590c2740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x2a7fed0 con 0x28a7ae0 2023-11-28T11:58:14.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.660+0000 7f7b4effd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x28a7710 0x2b58340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:14.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.660+0000 7f7b4effd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x28a7710 0x2b58340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46622/0 (socket says 172.21.15.39:46622) 2023-11-28T11:58:14.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.660+0000 7f7b4effd700 1 -- 172.21.15.39:0/3913561791 learned_addr learned my addr 172.21.15.39:0/3913561791 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:14.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.660+0000 7f7b4ffff700 1 --2- 172.21.15.39:0/3913561791 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x28f2790 0x2b58880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:14.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.660+0000 7f7b4f7fe700 1 --2- 172.21.15.39:0/3913561791 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x28a7ae0 0x2b57e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:14.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.660+0000 7f7b4effd700 1 -- 172.21.15.39:0/3913561791 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x28a7ae0 msgr2=0x2b57e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:14.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.660+0000 7f7b4effd700 1 --2- 172.21.15.39:0/3913561791 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x28a7ae0 0x2b57e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.660+0000 7f7b4effd700 1 -- 172.21.15.39:0/3913561791 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x28f2790 msgr2=0x2b58880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:14.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.660+0000 7f7b4effd700 1 --2- 172.21.15.39:0/3913561791 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x28f2790 0x2b58880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.660+0000 7f7b4effd700 1 -- 172.21.15.39:0/3913561791 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2aa5cc0 con 0x28a7710 2023-11-28T11:58:14.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.660+0000 7f7b4f7fe700 1 --2- 172.21.15.39:0/3913561791 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x28a7ae0 0x2b57e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:58:14.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.660+0000 7f7b4effd700 1 --2- 172.21.15.39:0/3913561791 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x28a7710 0x2b58340 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7b44051ba0 tx=0x7f7b44051bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af4bd1f8785f9c55 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:14.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.660+0000 7f7b357fa700 1 -- 172.21.15.39:0/3913561791 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4405b6c0 con 0x28a7710 2023-11-28T11:58:14.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.660+0000 7f7b357fa700 1 -- 172.21.15.39:0/3913561791 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4405b820 con 0x28a7710 2023-11-28T11:58:14.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.660+0000 7f7b357fa700 1 -- 172.21.15.39:0/3913561791 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4405b990 con 0x28a7710 2023-11-28T11:58:14.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.664+0000 7f7b590c2740 1 -- 172.21.15.39:0/3913561791 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x28a7710 msgr2=0x2b58340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:14.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.664+0000 7f7b590c2740 1 --2- 172.21.15.39:0/3913561791 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x28a7710 0x2b58340 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7b44051ba0 tx=0x7f7b44051bd0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.664+0000 7f7b590c2740 1 -- 172.21.15.39:0/3913561791 shutdown_connections 2023-11-28T11:58:14.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.664+0000 7f7b590c2740 1 --2- 172.21.15.39:0/3913561791 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x28f2790 0x2b58880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.664+0000 7f7b590c2740 1 --2- 172.21.15.39:0/3913561791 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x28a7710 0x2b58340 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.664+0000 7f7b590c2740 1 --2- 172.21.15.39:0/3913561791 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x28a7ae0 0x2b57e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.664+0000 7f7b590c2740 1 -- 172.21.15.39:0/3913561791 >> 172.21.15.39:0/3913561791 conn(0x28a7eb0 msgr2=0x2b40700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:14.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.664+0000 7f7b590c2740 1 -- 172.21.15.39:0/3913561791 shutdown_connections 2023-11-28T11:58:14.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.664+0000 7f7b590c2740 1 -- 172.21.15.39:0/3913561791 wait complete. 2023-11-28T11:58:14.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.664+0000 7f7b590c2740 1 -- start start 2023-11-28T11:58:14.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.664+0000 7f7b590c2740 1 Processor -- start 2023-11-28T11:58:14.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.668+0000 7f7b590c2740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x28a7710 0x2b41930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:14.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.668+0000 7f7b590c2740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x28a7ae0 0x2b2ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:14.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.668+0000 7f7b590c2740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x28f2790 0x2b2f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:14.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.668+0000 7f7b590c2740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x292cb20 con 0x28a7ae0 2023-11-28T11:58:14.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.668+0000 7f7b590c2740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b43090 con 0x28f2790 2023-11-28T11:58:14.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.668+0000 7f7b590c2740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x2b41e70 con 0x28a7710 2023-11-28T11:58:14.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.668+0000 7f7b590c2740 10 client.0 _ll_register_callbacks cb 0x2adc0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:58:14.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.668+0000 7f7b4effd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x28a7ae0 0x2b2ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:14.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.668+0000 7f7b4effd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x28a7ae0 0x2b2ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46630/0 (socket says 172.21.15.39:46630) 2023-11-28T11:58:14.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.668+0000 7f7b4effd700 1 -- 172.21.15.39:0/4142584290 learned_addr learned my addr 172.21.15.39:0/4142584290 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:14.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.668+0000 7f7b4f7fe700 1 --2- 172.21.15.39:0/4142584290 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x28a7710 0x2b41930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:14.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.668+0000 7f7b4ffff700 1 --2- 172.21.15.39:0/4142584290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x28f2790 0x2b2f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:14.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.668+0000 7f7b4effd700 1 -- 172.21.15.39:0/4142584290 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x28a7710 msgr2=0x2b41930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:14.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.668+0000 7f7b4effd700 1 --2- 172.21.15.39:0/4142584290 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x28a7710 0x2b41930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.668+0000 7f7b4effd700 1 -- 172.21.15.39:0/4142584290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x28f2790 msgr2=0x2b2f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:14.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.668+0000 7f7b4effd700 1 --2- 172.21.15.39:0/4142584290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x28f2790 0x2b2f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.668+0000 7f7b4effd700 1 -- 172.21.15.39:0/4142584290 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b500b53c0 con 0x28a7ae0 2023-11-28T11:58:14.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.668+0000 7f7b4effd700 1 --2- 172.21.15.39:0/4142584290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x28a7ae0 0x2b2ef50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7b44050480 tx=0x7f7b44004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=745a0b5cb5d99f7a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:14.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.668+0000 7f7b2e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-11-28T11:58:14.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.668+0000 7f7b2e7fc700 1 -- 172.21.15.39:0/4142584290 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4405b6c0 con 0x28a7ae0 2023-11-28T11:58:14.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.668+0000 7f7b2e7fc700 1 -- 172.21.15.39:0/4142584290 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7b440529c0 con 0x28a7ae0 2023-11-28T11:58:14.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.668+0000 7f7b590c2740 1 -- 172.21.15.39:0/4142584290 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2a78f50 con 0x28a7ae0 2023-11-28T11:58:14.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.668+0000 7f7b2e7fc700 1 -- 172.21.15.39:0/4142584290 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b4404fda0 con 0x28a7ae0 2023-11-28T11:58:14.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.668+0000 7f7b590c2740 10 client.5508 fetch_fsmap learned FSMap version 16 2023-11-28T11:58:14.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.668+0000 7f7b590c2740 1 -- 172.21.15.39:0/4142584290 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x28f39e0 con 0x28a7ae0 2023-11-28T11:58:14.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.668+0000 7f7b2e7fc700 1 -- 172.21.15.39:0/4142584290 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2a78f50 con 0x28a7ae0 2023-11-28T11:58:14.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.672+0000 7f7b2e7fc700 1 -- 172.21.15.39:0/4142584290 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 16) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f7b4406a070 con 0x28a7ae0 2023-11-28T11:58:14.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.672+0000 7f7b590c2740 10 client.5508 fetch_fsmap finished waiting for FSMap version 16 2023-11-28T11:58:14.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.672+0000 7f7b590c2740 10 client.5508 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-28T11:58:14.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.672+0000 7f7b590c2740 20 client.5508 populate_metadata read hostname 'smithi039' 2023-11-28T11:58:14.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.672+0000 7f7b590c2740 1 --2- 172.21.15.39:0/4142584290 >> [v2:172.21.15.184:6835/2775071992,v1:172.21.15.184:6837/2775071992] conn(0x2b6f440 0x2b71820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:14.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.672+0000 7f7b590c2740 4 client.5508 mds_command: new command op to 5317 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T11:58:14.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.672+0000 7f7b590c2740 1 -- 172.21.15.39:0/4142584290 --> [v2:172.21.15.184:6835/2775071992,v1:172.21.15.184:6837/2775071992] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2a78c70 con 0x2b6f440 2023-11-28T11:58:14.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.672+0000 7f7b4f7fe700 1 --2- 172.21.15.39:0/4142584290 >> [v2:172.21.15.184:6835/2775071992,v1:172.21.15.184:6837/2775071992] conn(0x2b6f440 0x2b71820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:14.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.672+0000 7f7b4f7fe700 1 --2- 172.21.15.39:0/4142584290 >> [v2:172.21.15.184:6835/2775071992,v1:172.21.15.184:6837/2775071992] conn(0x2b6f440 0x2b71820 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17e13e792a1495c5 server_cookie=afa8d7002cd5e75f in_seq=0 out_seq=0 2023-11-28T11:58:14.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.672+0000 7f7b2e7fc700 10 client.5508 ms_handle_connect on v2:172.21.15.184:6835/2775071992 2023-11-28T11:58:14.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.672+0000 7f7b2e7fc700 1 -- 172.21.15.39:0/4142584290 <== mds.0 v2:172.21.15.184:6835/2775071992 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x2a78c70 con 0x2b6f440 2023-11-28T11:58:14.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.672+0000 7f7b2e7fc700 10 client.5508 handle_command_reply: tid=0 2023-11-28T11:58:14.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.672+0000 7f7b590c2740 1 client.5508 shutdown 2023-11-28T11:58:14.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.676+0000 7f7b590c2740 1 -- 172.21.15.39:0/4142584290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x28a7ae0 msgr2=0x2b2ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:14.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.676+0000 7f7b590c2740 1 --2- 172.21.15.39:0/4142584290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x28a7ae0 0x2b2ef50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7b44050480 tx=0x7f7b44004770 comp rx=0 tx=0).stop 2023-11-28T11:58:14.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.676+0000 7f7b590c2740 1 -- 172.21.15.39:0/4142584290 shutdown_connections 2023-11-28T11:58:14.689 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.676+0000 7f7b590c2740 1 --2- 172.21.15.39:0/4142584290 >> [v2:172.21.15.184:6835/2775071992,v1:172.21.15.184:6837/2775071992] conn(0x2b6f440 0x2b71820 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.689 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.676+0000 7f7b590c2740 1 --2- 172.21.15.39:0/4142584290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x28f2790 0x2b2f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.689 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.676+0000 7f7b590c2740 1 --2- 172.21.15.39:0/4142584290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x28a7ae0 0x2b2ef50 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.689 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.676+0000 7f7b590c2740 1 --2- 172.21.15.39:0/4142584290 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x28a7710 0x2b41930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.689 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.676+0000 7f7b590c2740 1 -- 172.21.15.39:0/4142584290 >> 172.21.15.39:0/4142584290 conn(0x28a7eb0 msgr2=0x2b593c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:14.689 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.676+0000 7f7b2e7fc700 0 client.5508 ms_handle_reset on v2:172.21.15.184:6835/2775071992 2023-11-28T11:58:14.690 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.676+0000 7f7b590c2740 1 -- 172.21.15.39:0/4142584290 shutdown_connections 2023-11-28T11:58:14.690 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.676+0000 7f7b590c2740 1 -- 172.21.15.39:0/4142584290 wait complete. 2023-11-28T11:58:14.690 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.676+0000 7f7b590c2740 20 client.5508 trim_cache size 0 max 16384 2023-11-28T11:58:14.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.696+0000 7f7b590c2740 1 Processor -- start 2023-11-28T11:58:14.701 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.696+0000 7f7b590c2740 1 -- start start 2023-11-28T11:58:14.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.696+0000 7f7b590c2740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x28a7eb0 0x2b58b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:14.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.696+0000 7f7b590c2740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x28a7710 0x2b59070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:14.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.696+0000 7f7b590c2740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x28a7ae0 0x2b2f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:14.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.696+0000 7f7b590c2740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a7ed60 con 0x28a7710 2023-11-28T11:58:14.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.696+0000 7f7b590c2740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b1a070 con 0x28a7eb0 2023-11-28T11:58:14.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.696+0000 7f7b590c2740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x2a84040 con 0x28a7ae0 2023-11-28T11:58:14.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.696+0000 7f7b4effd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x28a7710 0x2b59070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:14.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.696+0000 7f7b4effd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x28a7710 0x2b59070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46638/0 (socket says 172.21.15.39:46638) 2023-11-28T11:58:14.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.696+0000 7f7b4effd700 1 -- 172.21.15.39:0/1929980063 learned_addr learned my addr 172.21.15.39:0/1929980063 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:14.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.696+0000 7f7b4f7fe700 1 --2- 172.21.15.39:0/1929980063 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x28a7eb0 0x2b58b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:14.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.696+0000 7f7b4ffff700 1 --2- 172.21.15.39:0/1929980063 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x28a7ae0 0x2b2f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:14.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.696+0000 7f7b4effd700 1 -- 172.21.15.39:0/1929980063 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x28a7ae0 msgr2=0x2b2f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:14.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.696+0000 7f7b4effd700 1 --2- 172.21.15.39:0/1929980063 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x28a7ae0 0x2b2f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.696+0000 7f7b4effd700 1 -- 172.21.15.39:0/1929980063 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x28a7eb0 msgr2=0x2b58b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:14.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.696+0000 7f7b4effd700 1 --2- 172.21.15.39:0/1929980063 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x28a7eb0 0x2b58b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.696+0000 7f7b4effd700 1 -- 172.21.15.39:0/1929980063 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b5008a550 con 0x28a7710 2023-11-28T11:58:14.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.696+0000 7f7b4effd700 1 --2- 172.21.15.39:0/1929980063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x28a7710 0x2b59070 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7b4400f010 tx=0x7f7b4407d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac27d60e260fc7d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:14.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.696+0000 7f7b35ffb700 1 -- 172.21.15.39:0/1929980063 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4405b6c0 con 0x28a7710 2023-11-28T11:58:14.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.696+0000 7f7b35ffb700 1 -- 172.21.15.39:0/1929980063 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4407f070 con 0x28a7710 2023-11-28T11:58:14.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.696+0000 7f7b35ffb700 1 -- 172.21.15.39:0/1929980063 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b44080270 con 0x28a7710 2023-11-28T11:58:14.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.700+0000 7f7b590c2740 1 -- 172.21.15.39:0/1929980063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x28a7710 msgr2=0x2b59070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:14.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.700+0000 7f7b590c2740 1 --2- 172.21.15.39:0/1929980063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x28a7710 0x2b59070 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7b4400f010 tx=0x7f7b4407d070 comp rx=0 tx=0).stop 2023-11-28T11:58:14.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.700+0000 7f7b590c2740 1 -- 172.21.15.39:0/1929980063 shutdown_connections 2023-11-28T11:58:14.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.700+0000 7f7b590c2740 1 --2- 172.21.15.39:0/1929980063 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x28a7ae0 0x2b2f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.700+0000 7f7b590c2740 1 --2- 172.21.15.39:0/1929980063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x28a7710 0x2b59070 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.700+0000 7f7b590c2740 1 --2- 172.21.15.39:0/1929980063 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x28a7eb0 0x2b58b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.700+0000 7f7b590c2740 1 -- 172.21.15.39:0/1929980063 >> 172.21.15.39:0/1929980063 conn(0x2b64630 msgr2=0x2b40790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:14.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.700+0000 7f7b590c2740 1 -- 172.21.15.39:0/1929980063 shutdown_connections 2023-11-28T11:58:14.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.700+0000 7f7b590c2740 1 -- 172.21.15.39:0/1929980063 wait complete. 2023-11-28T11:58:14.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.700+0000 7f7b590c2740 1 -- start start 2023-11-28T11:58:14.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.700+0000 7f7b590c2740 1 Processor -- start 2023-11-28T11:58:14.709 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.704+0000 7f7b590c2740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x28a7710 0x2b17e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:14.709 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.704+0000 7f7b590c2740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x28a7ae0 0x2b16d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:14.709 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.704+0000 7f7b590c2740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x28a7eb0 0x2bba450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:14.709 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.704+0000 7f7b590c2740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b18350 con 0x28a7710 2023-11-28T11:58:14.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.704+0000 7f7b590c2740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b67730 con 0x28a7ae0 2023-11-28T11:58:14.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.704+0000 7f7b590c2740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x2b17250 con 0x28a7eb0 2023-11-28T11:58:14.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.704+0000 7f7b590c2740 10 client.0 _ll_register_callbacks cb 0x2a2c2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:58:14.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.704+0000 7f7b4f7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x28a7710 0x2b17e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:14.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.704+0000 7f7b4f7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x28a7710 0x2b17e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46644/0 (socket says 172.21.15.39:46644) 2023-11-28T11:58:14.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.704+0000 7f7b4f7fe700 1 -- 172.21.15.39:0/3816190767 learned_addr learned my addr 172.21.15.39:0/3816190767 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:14.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.704+0000 7f7b4effd700 1 --2- 172.21.15.39:0/3816190767 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x28a7ae0 0x2b16d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:14.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.704+0000 7f7b4ffff700 1 --2- 172.21.15.39:0/3816190767 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x28a7eb0 0x2bba450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:14.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.704+0000 7f7b4f7fe700 1 -- 172.21.15.39:0/3816190767 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x28a7eb0 msgr2=0x2bba450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:14.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.704+0000 7f7b4f7fe700 1 --2- 172.21.15.39:0/3816190767 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x28a7eb0 0x2bba450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.704+0000 7f7b4f7fe700 1 -- 172.21.15.39:0/3816190767 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x28a7ae0 msgr2=0x2b16d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:14.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.704+0000 7f7b4f7fe700 1 --2- 172.21.15.39:0/3816190767 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x28a7ae0 0x2b16d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.704+0000 7f7b4f7fe700 1 -- 172.21.15.39:0/3816190767 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x28f39e0 con 0x28a7710 2023-11-28T11:58:14.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.704+0000 7f7b4effd700 1 --2- 172.21.15.39:0/3816190767 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x28a7ae0 0x2b16d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:58:14.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.704+0000 7f7b4f7fe700 1 --2- 172.21.15.39:0/3816190767 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x28a7710 0x2b17e10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7b40009010 tx=0x7f7b40000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b4340582b5ef53c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:14.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.704+0000 7f7b2e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-11-28T11:58:14.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.704+0000 7f7b2e7fc700 1 -- 172.21.15.39:0/3816190767 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b400038b0 con 0x28a7710 2023-11-28T11:58:14.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.704+0000 7f7b2e7fc700 1 -- 172.21.15.39:0/3816190767 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7b40003a10 con 0x28a7710 2023-11-28T11:58:14.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.704+0000 7f7b590c2740 1 -- 172.21.15.39:0/3816190767 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7b4405b820 con 0x28a7710 2023-11-28T11:58:14.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.704+0000 7f7b2e7fc700 1 -- 172.21.15.39:0/3816190767 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b40003bd0 con 0x28a7710 2023-11-28T11:58:14.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.704+0000 7f7b590c2740 10 client.5514 fetch_fsmap learned FSMap version 16 2023-11-28T11:58:14.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.704+0000 7f7b590c2740 1 -- 172.21.15.39:0/3816190767 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x2a2ca20 con 0x28a7710 2023-11-28T11:58:14.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.708+0000 7f7b2e7fc700 1 -- 172.21.15.39:0/3816190767 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4405b820 con 0x28a7710 2023-11-28T11:58:14.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.708+0000 7f7b2e7fc700 1 -- 172.21.15.39:0/3816190767 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 16) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f7b40020070 con 0x28a7710 2023-11-28T11:58:14.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.708+0000 7f7b590c2740 10 client.5514 fetch_fsmap finished waiting for FSMap version 16 2023-11-28T11:58:14.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.708+0000 7f7b590c2740 10 client.5514 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-28T11:58:14.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.708+0000 7f7b590c2740 20 client.5514 populate_metadata read hostname 'smithi039' 2023-11-28T11:58:14.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.708+0000 7f7b590c2740 1 --2- 172.21.15.39:0/3816190767 >> [v2:172.21.15.184:6835/2775071992,v1:172.21.15.184:6837/2775071992] conn(0x28f2790 0x2b18af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:14.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.708+0000 7f7b590c2740 4 client.5514 mds_command: new command op to 5317 tid=0[{"prefix": "status"}] 2023-11-28T11:58:14.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.708+0000 7f7b590c2740 1 -- 172.21.15.39:0/3816190767 --> [v2:172.21.15.184:6835/2775071992,v1:172.21.15.184:6837/2775071992] -- command(tid 0: {"prefix": "status"}) v1 -- 0x2924260 con 0x28f2790 2023-11-28T11:58:14.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.708+0000 7f7b4effd700 1 --2- 172.21.15.39:0/3816190767 >> [v2:172.21.15.184:6835/2775071992,v1:172.21.15.184:6837/2775071992] conn(0x28f2790 0x2b18af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:14.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.708+0000 7f7b4effd700 1 --2- 172.21.15.39:0/3816190767 >> [v2:172.21.15.184:6835/2775071992,v1:172.21.15.184:6837/2775071992] conn(0x28f2790 0x2b18af0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a8b773c4a552c57 server_cookie=cf2ba439b7aa4a1d in_seq=0 out_seq=0 2023-11-28T11:58:14.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.708+0000 7f7b2e7fc700 10 client.5514 ms_handle_connect on v2:172.21.15.184:6835/2775071992 2023-11-28T11:58:14.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.708+0000 7f7b2e7fc700 1 -- 172.21.15.39:0/3816190767 <== mds.0 v2:172.21.15.184:6835/2775071992 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x2924260 con 0x28f2790 2023-11-28T11:58:14.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.708+0000 7f7b2e7fc700 10 client.5514 handle_command_reply: tid=0 2023-11-28T11:58:14.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.708+0000 7f7b590c2740 1 client.5514 shutdown 2023-11-28T11:58:14.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.708+0000 7f7b590c2740 1 -- 172.21.15.39:0/3816190767 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x28a7710 msgr2=0x2b17e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:14.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.708+0000 7f7b590c2740 1 --2- 172.21.15.39:0/3816190767 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x28a7710 0x2b17e10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7b40009010 tx=0x7f7b40000ed0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.708+0000 7f7b590c2740 1 -- 172.21.15.39:0/3816190767 shutdown_connections 2023-11-28T11:58:14.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.708+0000 7f7b590c2740 1 --2- 172.21.15.39:0/3816190767 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x28a7eb0 0x2bba450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.708+0000 7f7b590c2740 1 --2- 172.21.15.39:0/3816190767 >> [v2:172.21.15.184:6835/2775071992,v1:172.21.15.184:6837/2775071992] conn(0x28f2790 0x2b18af0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.708+0000 7f7b590c2740 1 --2- 172.21.15.39:0/3816190767 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x28a7ae0 0x2b16d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.708+0000 7f7b590c2740 1 --2- 172.21.15.39:0/3816190767 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x28a7710 0x2b17e10 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.708+0000 7f7b590c2740 1 -- 172.21.15.39:0/3816190767 >> 172.21.15.39:0/3816190767 conn(0x2b64630 msgr2=0x2b66a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:14.717 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.708+0000 7f7b2e7fc700 0 client.5514 ms_handle_reset on v2:172.21.15.184:6835/2775071992 2023-11-28T11:58:14.717 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.708+0000 7f7b590c2740 1 -- 172.21.15.39:0/3816190767 shutdown_connections 2023-11-28T11:58:14.717 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.708+0000 7f7b590c2740 1 -- 172.21.15.39:0/3816190767 wait complete. 2023-11-28T11:58:14.717 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.708+0000 7f7b590c2740 20 client.5514 trim_cache size 0 max 16384 2023-11-28T11:58:14.717 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2023-11-28T11:58:14.717 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "67ce95b1-cd7e-4478-b863-c714ef275520", 2023-11-28T11:58:14.717 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 0, 2023-11-28T11:58:14.717 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 5317, 2023-11-28T11:58:14.717 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2023-11-28T11:58:14.718 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2023-11-28T11:58:14.718 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2023-11-28T11:58:14.718 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 11.477198208000001, 2023-11-28T11:58:14.718 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 16, 2023-11-28T11:58:14.718 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 44, 2023-11-28T11:58:14.718 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 44, 2023-11-28T11:58:14.718 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 19.786941469999999 2023-11-28T11:58:14.718 INFO:teuthology.orchestra.run.smithi039.stdout:} 2023-11-28T11:58:14.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.712+0000 7f7b55e34700 1 -- 172.21.15.39:0/3882400428 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7b3c064f30 msgr2=0x7f7b3c0673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:14.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.712+0000 7f7b55e34700 1 --2- 172.21.15.39:0/3882400428 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7b3c064f30 0x7f7b3c0673e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7b40000f60 tx=0x7f7b40009040 comp rx=0 tx=0).stop 2023-11-28T11:58:14.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.712+0000 7f7b55e34700 1 -- 172.21.15.39:0/3882400428 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b501534a0 msgr2=0x7f7b5008d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:14.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.712+0000 7f7b55e34700 1 --2- 172.21.15.39:0/3882400428 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b501534a0 0x7f7b5008d4b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7b4400e870 tx=0x7f7b4400eb80 comp rx=0 tx=0).stop 2023-11-28T11:58:14.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.712+0000 7f7b55e34700 1 -- 172.21.15.39:0/3882400428 shutdown_connections 2023-11-28T11:58:14.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.712+0000 7f7b55e34700 1 --2- 172.21.15.39:0/3882400428 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7b3c064f30 0x7f7b3c0673e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.712+0000 7f7b55e34700 1 --2- 172.21.15.39:0/3882400428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b5015d510 0x7f7b5008d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.712+0000 7f7b55e34700 1 --2- 172.21.15.39:0/3882400428 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b501534a0 0x7f7b5008d4b0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.712+0000 7f7b55e34700 1 --2- 172.21.15.39:0/3882400428 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b500b6030 0x7f7b500708a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.712+0000 7f7b55e34700 1 -- 172.21.15.39:0/3882400428 >> 172.21.15.39:0/3882400428 conn(0x7f7b5006bfc0 msgr2=0x7f7b5015a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:14.720 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.712+0000 7f7b55e34700 1 -- 172.21.15.39:0/3882400428 shutdown_connections 2023-11-28T11:58:14.720 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.712+0000 7f7b55e34700 1 -- 172.21.15.39:0/3882400428 wait complete. 2023-11-28T11:58:14.741 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T11:58:14.931 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.924+0000 7fdd47fa0700 1 Processor -- start 2023-11-28T11:58:14.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.924+0000 7fdd47fa0700 1 -- start start 2023-11-28T11:58:14.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.928+0000 7fdd47fa0700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fdd401534a0 0x7fdd4015d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:14.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.928+0000 7fdd47fa0700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fdd40160920 0x7fdd400b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:14.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.928+0000 7fdd47fa0700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd4015d080 con 0x7fdd400b6030 2023-11-28T11:58:14.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.928+0000 7fdd47fa0700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd40153870 con 0x7fdd401534a0 2023-11-28T11:58:14.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.928+0000 7fdd47fa0700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd400b6430 con 0x7fdd40160920 2023-11-28T11:58:14.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.928+0000 7fdd45d3c700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fdd401534a0 0x7fdd4015d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:14.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.928+0000 7fdd45d3c700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fdd401534a0 0x7fdd4015d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46648/0 (socket says 172.21.15.39:46648) 2023-11-28T11:58:14.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.928+0000 7fdd45d3c700 1 -- 172.21.15.39:0/785741828 learned_addr learned my addr 172.21.15.39:0/785741828 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:14.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.928+0000 7fdd4553b700 1 --2- 172.21.15.39:0/785741828 >> v2:172.21.15.184:3300/0 conn(0x7fdd40160920 0x7fdd400b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:14.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.928+0000 7fdd45d3c700 1 -- 172.21.15.39:0/785741828 >> v2:172.21.15.184:3300/0 conn(0x7fdd40160920 msgr2=0x7fdd400b5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:14.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.928+0000 7fdd45d3c700 1 --2- 172.21.15.39:0/785741828 >> v2:172.21.15.184:3300/0 conn(0x7fdd40160920 0x7fdd400b5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.928+0000 7fdd45d3c700 1 -- 172.21.15.39:0/785741828 >> v1:172.21.15.184:6789/0 conn(0x7fdd400b6030 legacy=0x7fdd40070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:14.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.928+0000 7fdd45d3c700 1 -- 172.21.15.39:0/785741828 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd400b53c0 con 0x7fdd401534a0 2023-11-28T11:58:14.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.932+0000 7fdd45d3c700 1 --2- 172.21.15.39:0/785741828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd401534a0 0x7fdd4015d510 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fdd40072450 tx=0x7fdd3c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f6b9e89c73fb66 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:14.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.932+0000 7fdd44d3a700 1 -- 172.21.15.39:0/785741828 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c00b8a0 con 0x7fdd401534a0 2023-11-28T11:58:14.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.932+0000 7fdd44d3a700 1 -- 172.21.15.39:0/785741828 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3c00ba00 con 0x7fdd401534a0 2023-11-28T11:58:14.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.932+0000 7fdd44d3a700 1 -- 172.21.15.39:0/785741828 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c00bd90 con 0x7fdd401534a0 2023-11-28T11:58:14.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.932+0000 7fdd47fa0700 1 -- 172.21.15.39:0/785741828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd401534a0 msgr2=0x7fdd4015d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:14.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.932+0000 7fdd47fa0700 1 --2- 172.21.15.39:0/785741828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd401534a0 0x7fdd4015d510 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fdd40072450 tx=0x7fdd3c009bf0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.932+0000 7fdd47fa0700 1 -- 172.21.15.39:0/785741828 shutdown_connections 2023-11-28T11:58:14.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.932+0000 7fdd47fa0700 1 --2- 172.21.15.39:0/785741828 >> v2:172.21.15.184:3300/0 conn(0x7fdd40160920 0x7fdd400b5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.932+0000 7fdd47fa0700 1 --2- 172.21.15.39:0/785741828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd401534a0 0x7fdd4015d510 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.932+0000 7fdd47fa0700 1 -- 172.21.15.39:0/785741828 >> 172.21.15.39:0/785741828 conn(0x7fdd4006bfc0 msgr2=0x7fdd4006c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:14.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.932+0000 7fdd47fa0700 1 -- 172.21.15.39:0/785741828 shutdown_connections 2023-11-28T11:58:14.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.932+0000 7fdd47fa0700 1 -- 172.21.15.39:0/785741828 wait complete. 2023-11-28T11:58:14.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.936+0000 7fdd47fa0700 1 Processor -- start 2023-11-28T11:58:14.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.936+0000 7fdd47fa0700 1 -- start start 2023-11-28T11:58:14.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.936+0000 7fdd47fa0700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd400b6030 0x7fdd401554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:14.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.936+0000 7fdd47fa0700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd401534a0 0x7fdd4015b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:14.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.936+0000 7fdd47fa0700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd40160920 0x7fdd4015bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:14.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.936+0000 7fdd47fa0700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4013f4b0 con 0x7fdd40160920 2023-11-28T11:58:14.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.936+0000 7fdd47fa0700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4015c0a0 con 0x7fdd400b6030 2023-11-28T11:58:14.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.936+0000 7fdd47fa0700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd40155cf0 con 0x7fdd401534a0 2023-11-28T11:58:14.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.936+0000 7fdd45d3c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd400b6030 0x7fdd401554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:14.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.936+0000 7fdd4653d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd40160920 0x7fdd4015bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:14.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.936+0000 7fdd45d3c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd400b6030 0x7fdd401554a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:36832/0 (socket says 172.21.15.39:36832) 2023-11-28T11:58:14.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.936+0000 7fdd45d3c700 1 -- 172.21.15.39:0/1281712169 learned_addr learned my addr 172.21.15.39:0/1281712169 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:14.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.936+0000 7fdd4553b700 1 --2- 172.21.15.39:0/1281712169 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd401534a0 0x7fdd4015b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:14.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.936+0000 7fdd4653d700 1 -- 172.21.15.39:0/1281712169 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd401534a0 msgr2=0x7fdd4015b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:14.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.936+0000 7fdd4653d700 1 --2- 172.21.15.39:0/1281712169 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd401534a0 0x7fdd4015b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.936+0000 7fdd4653d700 1 -- 172.21.15.39:0/1281712169 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd400b6030 msgr2=0x7fdd401554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:14.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.936+0000 7fdd4653d700 1 --2- 172.21.15.39:0/1281712169 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd400b6030 0x7fdd401554a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:14.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.936+0000 7fdd4653d700 1 -- 172.21.15.39:0/1281712169 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd3c009570 con 0x7fdd40160920 2023-11-28T11:58:14.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.936+0000 7fdd4653d700 1 --2- 172.21.15.39:0/1281712169 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd40160920 0x7fdd4015bb60 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fdd3800cb90 tx=0x7fdd3800cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:14.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.940+0000 7fdd367fc700 1 -- 172.21.15.39:0/1281712169 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd38003c20 con 0x7fdd40160920 2023-11-28T11:58:14.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.940+0000 7fdd367fc700 1 -- 172.21.15.39:0/1281712169 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd38003d80 con 0x7fdd40160920 2023-11-28T11:58:14.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.940+0000 7fdd47fa0700 1 -- 172.21.15.39:0/1281712169 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd4015ca30 con 0x7fdd40160920 2023-11-28T11:58:14.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.940+0000 7fdd367fc700 1 -- 172.21.15.39:0/1281712169 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3800aa80 con 0x7fdd40160920 2023-11-28T11:58:14.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.940+0000 7fdd47fa0700 1 -- 172.21.15.39:0/1281712169 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd400b56a0 con 0x7fdd40160920 2023-11-28T11:58:14.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.940+0000 7fdd47fa0700 1 -- 172.21.15.39:0/1281712169 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd4015cd10 con 0x7fdd40160920 2023-11-28T11:58:14.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.940+0000 7fdd367fc700 1 -- 172.21.15.39:0/1281712169 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdd38010050 con 0x7fdd40160920 2023-11-28T11:58:14.949 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.944+0000 7fdd367fc700 1 --2- 172.21.15.39:0/1281712169 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fdd24064ee0 0x7fdd24067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:14.949 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.944+0000 7fdd367fc700 1 -- 172.21.15.39:0/1281712169 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fdd38081e40 con 0x7fdd40160920 2023-11-28T11:58:14.950 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.944+0000 7fdd45d3c700 1 --2- 172.21.15.39:0/1281712169 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fdd24064ee0 0x7fdd24067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:14.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.944+0000 7fdd45d3c700 1 --2- 172.21.15.39:0/1281712169 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fdd24064ee0 0x7fdd24067390 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c009150 tx=0x7fdd3c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:14.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:14.948+0000 7fdd367fc700 1 -- 172.21.15.39:0/1281712169 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdd3804fdb0 con 0x7fdd40160920 2023-11-28T11:58:15.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:15.156+0000 7fdd47fa0700 1 -- 172.21.15.39:0/1281712169 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdd4013f660 con 0x7fdd40160920 2023-11-28T11:58:15.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:15.156+0000 7fdd367fc700 1 -- 172.21.15.39:0/1281712169 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7fdd4013f660 con 0x7fdd40160920 2023-11-28T11:58:15.163 INFO:teuthology.orchestra.run.smithi039.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T11:58:15.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:15.164+0000 7fdd47fa0700 1 -- 172.21.15.39:0/1281712169 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fdd24064ee0 msgr2=0x7fdd24067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:15.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:15.164+0000 7fdd47fa0700 1 --2- 172.21.15.39:0/1281712169 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fdd24064ee0 0x7fdd24067390 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c009150 tx=0x7fdd3c008030 comp rx=0 tx=0).stop 2023-11-28T11:58:15.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:15.164+0000 7fdd47fa0700 1 -- 172.21.15.39:0/1281712169 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd40160920 msgr2=0x7fdd4015bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:15.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:15.164+0000 7fdd47fa0700 1 --2- 172.21.15.39:0/1281712169 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd40160920 0x7fdd4015bb60 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fdd3800cb90 tx=0x7fdd3800cea0 comp rx=0 tx=0).stop 2023-11-28T11:58:15.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:15.164+0000 7fdd47fa0700 1 -- 172.21.15.39:0/1281712169 shutdown_connections 2023-11-28T11:58:15.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:15.164+0000 7fdd47fa0700 1 --2- 172.21.15.39:0/1281712169 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd40160920 0x7fdd4015bb60 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:15.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:15.164+0000 7fdd47fa0700 1 --2- 172.21.15.39:0/1281712169 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd401534a0 0x7fdd4015b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:15.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:15.164+0000 7fdd47fa0700 1 --2- 172.21.15.39:0/1281712169 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fdd24064ee0 0x7fdd24067390 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:15.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:15.164+0000 7fdd47fa0700 1 --2- 172.21.15.39:0/1281712169 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd400b6030 0x7fdd401554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:15.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:15.164+0000 7fdd47fa0700 1 -- 172.21.15.39:0/1281712169 >> 172.21.15.39:0/1281712169 conn(0x7fdd4006bfc0 msgr2=0x7fdd400d0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:15.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:15.164+0000 7fdd47fa0700 1 -- 172.21.15.39:0/1281712169 shutdown_connections 2023-11-28T11:58:15.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:15.164+0000 7fdd47fa0700 1 -- 172.21.15.39:0/1281712169 wait complete. 2023-11-28T11:58:15.190 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-28T11:58:15.190 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T11:58:15.190 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi039.front.sepia.ceph.com 2023-11-28T11:58:15.190 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T11:58:15.190 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T11:58:15.190 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-28T11:58:15.190 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T11:58:15.190 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T11:58:15.190 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T11:58:15.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:58:15.191 DEBUG:teuthology.orchestra.run.smithi039:> ip addr 2023-11-28T11:58:15.206 INFO:teuthology.orchestra.run.smithi039.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T11:58:15.207 INFO:teuthology.orchestra.run.smithi039.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T11:58:15.207 INFO:teuthology.orchestra.run.smithi039.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T11:58:15.207 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:58:15.207 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 ::1/128 scope host 2023-11-28T11:58:15.207 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:58:15.207 INFO:teuthology.orchestra.run.smithi039.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:58:15.207 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c6 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:58:15.207 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f0 2023-11-28T11:58:15.207 INFO:teuthology.orchestra.run.smithi039.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T11:58:15.207 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:70 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:58:15.207 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f0 2023-11-28T11:58:15.208 INFO:teuthology.orchestra.run.smithi039.stdout: inet 172.21.15.39/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-28T11:58:15.208 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft 42280sec preferred_lft 42280sec 2023-11-28T11:58:15.208 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::ec4:7aff:febd:1370/64 scope link 2023-11-28T11:58:15.208 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:58:15.208 INFO:teuthology.orchestra.run.smithi039.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:58:15.208 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c7 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:58:15.208 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f1 2023-11-28T11:58:15.208 INFO:teuthology.orchestra.run.smithi039.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:58:15.208 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:71 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:58:15.208 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f1 2023-11-28T11:58:15.208 INFO:teuthology.orchestra.run.smithi039.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T11:58:15.208 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 02:42:df:e8:d2:63 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:58:15.209 INFO:teuthology.orchestra.run.smithi039.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T11:58:15.209 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:58:15.209 INFO:teuthology.orchestra.run.smithi039.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T11:58:15.209 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 82:c4:07:ce:89:23 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:58:15.209 INFO:teuthology.orchestra.run.smithi039.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T11:58:15.209 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:58:15.209 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::48e6:ebff:fe99:9ca6/64 scope link 2023-11-28T11:58:15.209 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:58:15.209 INFO:teuthology.orchestra.run.smithi039.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T11:58:15.209 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 82:c4:07:ce:89:23 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T11:58:15.209 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::80c4:7ff:fece:8923/64 scope link 2023-11-28T11:58:15.209 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:58:15.210 INFO:teuthology.orchestra.run.smithi039.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T11:58:15.210 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 9e:bb:6e:23:db:6b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T11:58:15.210 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::9cbb:6eff:fe23:db6b/64 scope link 2023-11-28T11:58:15.210 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:58:15.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:58:15.211 DEBUG:teuthology.orchestra.run.smithi039:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T11:58:15.291 INFO:teuthology.orchestra.run.smithi039.stdout:1 2023-11-28T11:58:15.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:58:15.294 DEBUG:teuthology.orchestra.run.smithi039:> route 2023-11-28T11:58:15.357 INFO:teuthology.orchestra.run.smithi039.stdout:Kernel IP routing table 2023-11-28T11:58:15.357 INFO:teuthology.orchestra.run.smithi039.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T11:58:15.357 INFO:teuthology.orchestra.run.smithi039.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-28T11:58:15.357 INFO:teuthology.orchestra.run.smithi039.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T11:58:15.357 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-28T11:58:15.357 INFO:teuthology.orchestra.run.smithi039.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T11:58:15.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:58:15.358 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2023-11-28T11:58:15.358 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2023-11-28T11:58:15.358 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-28T11:58:15.358 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-28T11:58:15.358 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-28T11:58:15.358 DEBUG:teuthology.orchestra.run.smithi039:> ') 2023-11-28T11:58:15.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:58:15.504 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2023-11-28T11:58:15.521 INFO:teuthology.orchestra.run.smithi039.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T11:58:15.522 INFO:teuthology.orchestra.run.smithi039.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-28T11:58:15.523 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T11:58:15.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:58:15.523 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set brx.0 up 2023-11-28T11:58:15.602 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:58:15.602 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T11:58:15.662 INFO:teuthology.orchestra.run.smithi039.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T11:58:15.662 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:58:15.662 DEBUG:teuthology.orchestra.run.smithi039:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T11:58:15.724 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-28T11:58:15.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:58:15.724 DEBUG:teuthology.orchestra.run.smithi039:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T11:58:15.870 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T11:58:15.870 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-28T11:58:15.871 INFO:teuthology.orchestra.run.smithi039.stdout:invalid new device string format 2023-11-28T11:58:15.904 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T11:58:15.904 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-28T11:58:15.904 INFO:teuthology.orchestra.run.smithi039.stdout:invalid new device string format 2023-11-28T11:58:15.904 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-11-28T11:58:15.905 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-28T11:58:15.922 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T11:58:15.923 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-28T11:58:15.923 INFO:teuthology.orchestra.run.smithi039.stdout:invalid new device string format 2023-11-28T11:58:15.923 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-11-28T11:58:15.923 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-28T11:58:15.924 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.39:6789,172.21.15.184:6789,172.21.15.184:6790" 2023-11-28T11:58:15.924 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.39:6789,172.21.15.184:6789,172.21.15.184:6790:/ 2023-11-28T11:58:15.925 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=67ce95b1-cd7e-4478-b863-c714ef275520" will pass to kernel 2023-11-28T11:58:15.930 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T11:58:15.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:58:15.931 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T11:58:15.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:58:15.966 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T11:58:16.053 INFO:teuthology.orchestra.run.smithi039.stdout:client5542 2023-11-28T11:58:16.053 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:58:16.054 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:58:16.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:58:16.118 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir) 2023-11-28T11:58:16.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:58:16.225 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir/childdir) 2023-11-28T11:58:16.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:58:16.267 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch rfile) 2023-11-28T11:58:16.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:58:16.336 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/pfile) 2023-11-28T11:58:16.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:58:16.411 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/childdir/cfile) 2023-11-28T11:58:16.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:58:16.479 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2023-11-28T11:58:16.559 INFO:teuthology.orchestra.run.smithi039.stdout:./ 2023-11-28T11:58:16.560 INFO:teuthology.orchestra.run.smithi039.stdout:./rfile 2023-11-28T11:58:16.560 INFO:teuthology.orchestra.run.smithi039.stdout:./parentdir 2023-11-28T11:58:16.560 INFO:teuthology.orchestra.run.smithi039.stdout:./parentdir/pfile 2023-11-28T11:58:16.560 INFO:teuthology.orchestra.run.smithi039.stdout:./parentdir/childdir 2023-11-28T11:58:16.560 INFO:teuthology.orchestra.run.smithi039.stdout:./parentdir/childdir/cfile 2023-11-28T11:58:16.561 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T11:58:16.562 DEBUG:teuthology.orchestra.run.smithi039:> import os 2023-11-28T11:58:16.562 DEBUG:teuthology.orchestra.run.smithi039:> import stat 2023-11-28T11:58:16.562 DEBUG:teuthology.orchestra.run.smithi039:> 2023-11-28T11:58:16.562 DEBUG:teuthology.orchestra.run.smithi039:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2023-11-28T11:58:16.562 DEBUG:teuthology.orchestra.run.smithi039:> ' 2023-11-28T11:58:16.704 INFO:teuthology.orchestra.run.smithi039.stdout:1 2023-11-28T11:58:16.895 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T11:58:16.895 DEBUG:teuthology.orchestra.run.smithi039:> import os 2023-11-28T11:58:16.895 DEBUG:teuthology.orchestra.run.smithi039:> import stat 2023-11-28T11:58:16.895 DEBUG:teuthology.orchestra.run.smithi039:> 2023-11-28T11:58:16.895 DEBUG:teuthology.orchestra.run.smithi039:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./rfile").st_ino) 2023-11-28T11:58:16.895 DEBUG:teuthology.orchestra.run.smithi039:> ' 2023-11-28T11:58:17.033 INFO:teuthology.orchestra.run.smithi039.stdout:1099511627778 2023-11-28T11:58:17.221 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T11:58:17.221 DEBUG:teuthology.orchestra.run.smithi039:> import os 2023-11-28T11:58:17.221 DEBUG:teuthology.orchestra.run.smithi039:> import stat 2023-11-28T11:58:17.221 DEBUG:teuthology.orchestra.run.smithi039:> 2023-11-28T11:58:17.221 DEBUG:teuthology.orchestra.run.smithi039:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir").st_ino) 2023-11-28T11:58:17.221 DEBUG:teuthology.orchestra.run.smithi039:> ' 2023-11-28T11:58:17.373 INFO:teuthology.orchestra.run.smithi039.stdout:1099511627776 2023-11-28T11:58:17.557 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T11:58:17.557 DEBUG:teuthology.orchestra.run.smithi039:> import os 2023-11-28T11:58:17.557 DEBUG:teuthology.orchestra.run.smithi039:> import stat 2023-11-28T11:58:17.558 DEBUG:teuthology.orchestra.run.smithi039:> 2023-11-28T11:58:17.558 DEBUG:teuthology.orchestra.run.smithi039:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/pfile").st_ino) 2023-11-28T11:58:17.558 DEBUG:teuthology.orchestra.run.smithi039:> ' 2023-11-28T11:58:17.706 INFO:teuthology.orchestra.run.smithi039.stdout:1099511628279 2023-11-28T11:58:17.895 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T11:58:17.895 DEBUG:teuthology.orchestra.run.smithi039:> import os 2023-11-28T11:58:17.895 DEBUG:teuthology.orchestra.run.smithi039:> import stat 2023-11-28T11:58:17.895 DEBUG:teuthology.orchestra.run.smithi039:> 2023-11-28T11:58:17.895 DEBUG:teuthology.orchestra.run.smithi039:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir").st_ino) 2023-11-28T11:58:17.895 DEBUG:teuthology.orchestra.run.smithi039:> ' 2023-11-28T11:58:18.036 INFO:teuthology.orchestra.run.smithi039.stdout:1099511627777 2023-11-28T11:58:18.224 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T11:58:18.224 DEBUG:teuthology.orchestra.run.smithi039:> import os 2023-11-28T11:58:18.225 DEBUG:teuthology.orchestra.run.smithi039:> import stat 2023-11-28T11:58:18.225 DEBUG:teuthology.orchestra.run.smithi039:> 2023-11-28T11:58:18.225 DEBUG:teuthology.orchestra.run.smithi039:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir/cfile").st_ino) 2023-11-28T11:58:18.225 DEBUG:teuthology.orchestra.run.smithi039:> ' 2023-11-28T11:58:18.369 INFO:teuthology.orchestra.run.smithi039.stdout:1099511628280 2023-11-28T11:58:18.558 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:58:18.558 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:58:18.618 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:58:18.618 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:58:18.680 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:58:18.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.904+0000 7f89a9253700 1 Processor -- start 2023-11-28T11:58:18.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.904+0000 7f89a9253700 1 -- start start 2023-11-28T11:58:18.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.908+0000 7f89a9253700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f89a40704b0 0x7f89a4164960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:18.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.908+0000 7f89a9253700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89a40ad6c0 con 0x7f89a4160710 2023-11-28T11:58:18.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.908+0000 7f89a9253700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89a40adc60 con 0x7f89a4070080 2023-11-28T11:58:18.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.908+0000 7f89a9253700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89a406b1c0 con 0x7f89a40704b0 2023-11-28T11:58:18.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.908+0000 7f89a3fff700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f89a4160710 0x7f89a40cc320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:49324/0 (socket says 172.21.15.39:49324) 2023-11-28T11:58:18.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.908+0000 7f89a3fff700 1 -- 172.21.15.39:0/3807563515 learned_addr learned my addr 172.21.15.39:0/3807563515 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:58:18.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.908+0000 7f89a8a52700 1 --2- 172.21.15.39:0/3807563515 >> v2:172.21.15.39:3300/0 conn(0x7f89a40704b0 0x7f89a4164960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:18.916 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.908+0000 7f89a37fe700 1 -- 172.21.15.39:0/3807563515 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 944758710 0 0) 0x7f89a40ad6c0 con 0x7f89a4160710 2023-11-28T11:58:18.916 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.908+0000 7f89a37fe700 1 -- 172.21.15.39:0/3807563515 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89840035d0 con 0x7f89a4160710 2023-11-28T11:58:18.916 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.912+0000 7f89a37fe700 1 -- 172.21.15.39:0/3807563515 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3229045456 0 0) 0x7f89a40adc60 con 0x7f89a4070080 2023-11-28T11:58:18.916 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.912+0000 7f89a8a52700 1 -- 172.21.15.39:0/3807563515 >> v1:172.21.15.184:6789/0 conn(0x7f89a4070080 legacy=0x7f89a4164250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:18.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.912+0000 7f89a8a52700 1 -- 172.21.15.39:0/3807563515 >> v1:172.21.15.39:6789/0 conn(0x7f89a4160710 legacy=0x7f89a40cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:18.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.912+0000 7f89a8a52700 1 -- 172.21.15.39:0/3807563515 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a40cca30 con 0x7f89a40704b0 2023-11-28T11:58:18.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.912+0000 7f89a8a52700 1 --2- 172.21.15.39:0/3807563515 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89a40704b0 0x7f89a4164960 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f899c009d90 tx=0x7f899c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3da705f04a528b8f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:18.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.912+0000 7f89a37fe700 1 -- 172.21.15.39:0/3807563515 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899c00e070 con 0x7f89a40704b0 2023-11-28T11:58:18.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.912+0000 7f89a37fe700 1 -- 172.21.15.39:0/3807563515 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899c00bb20 con 0x7f89a40704b0 2023-11-28T11:58:18.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.912+0000 7f89a37fe700 1 -- 172.21.15.39:0/3807563515 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899c00bed0 con 0x7f89a40704b0 2023-11-28T11:58:18.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.912+0000 7f89a9253700 1 -- 172.21.15.39:0/3807563515 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89a40704b0 msgr2=0x7f89a4164960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:18.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.912+0000 7f89a9253700 1 --2- 172.21.15.39:0/3807563515 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89a40704b0 0x7f89a4164960 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f899c009d90 tx=0x7f899c00b330 comp rx=0 tx=0).stop 2023-11-28T11:58:18.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.912+0000 7f89a9253700 1 -- 172.21.15.39:0/3807563515 shutdown_connections 2023-11-28T11:58:18.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.912+0000 7f89a9253700 1 --2- 172.21.15.39:0/3807563515 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89a40704b0 0x7f89a4164960 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:18.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.912+0000 7f89a9253700 1 -- 172.21.15.39:0/3807563515 >> 172.21.15.39:0/3807563515 conn(0x7f89a40b0f80 msgr2=0x7f89a40ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:18.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.912+0000 7f89a9253700 1 -- 172.21.15.39:0/3807563515 shutdown_connections 2023-11-28T11:58:18.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.912+0000 7f89a9253700 1 -- 172.21.15.39:0/3807563515 wait complete. 2023-11-28T11:58:18.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.916+0000 7f89a9253700 1 Processor -- start 2023-11-28T11:58:18.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.916+0000 7f89a9253700 1 -- start start 2023-11-28T11:58:18.924 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.916+0000 7f89a9253700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89a4070080 0x7f89a415f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:18.924 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.916+0000 7f89a9253700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f89a40704b0 0x7f89a415cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:18.924 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.916+0000 7f89a9253700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89a4160710 0x7f89a415d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:18.924 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.916+0000 7f89a9253700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a414d480 con 0x7f89a4070080 2023-11-28T11:58:18.924 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.916+0000 7f89a9253700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a415fb40 con 0x7f89a4160710 2023-11-28T11:58:18.924 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.916+0000 7f89a9253700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a415fe20 con 0x7f89a40704b0 2023-11-28T11:58:18.924 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.916+0000 7f89a3fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89a4070080 0x7f89a415f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:18.924 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.916+0000 7f89a3fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89a4070080 0x7f89a415f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35016/0 (socket says 172.21.15.39:35016) 2023-11-28T11:58:18.924 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.916+0000 7f89a3fff700 1 -- 172.21.15.39:0/2711868700 learned_addr learned my addr 172.21.15.39:0/2711868700 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:18.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.920+0000 7f899bfff700 1 --2- 172.21.15.39:0/2711868700 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f89a40704b0 0x7f89a415cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:18.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.920+0000 7f89a8a52700 1 --2- 172.21.15.39:0/2711868700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89a4160710 0x7f89a415d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:18.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.920+0000 7f89a3fff700 1 -- 172.21.15.39:0/2711868700 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f89a40704b0 msgr2=0x7f89a415cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:18.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.920+0000 7f89a3fff700 1 --2- 172.21.15.39:0/2711868700 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f89a40704b0 0x7f89a415cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:18.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.920+0000 7f89a3fff700 1 -- 172.21.15.39:0/2711868700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89a4160710 msgr2=0x7f89a415d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:18.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.920+0000 7f89a3fff700 1 --2- 172.21.15.39:0/2711868700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89a4160710 0x7f89a415d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:18.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.920+0000 7f89a3fff700 1 -- 172.21.15.39:0/2711868700 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f899c009a70 con 0x7f89a4070080 2023-11-28T11:58:18.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.920+0000 7f89a3fff700 1 --2- 172.21.15.39:0/2711868700 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89a4070080 0x7f89a415f440 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f899400c4d0 tx=0x7f899400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:18.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.920+0000 7f89a17fa700 1 -- 172.21.15.39:0/2711868700 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89940011d0 con 0x7f89a4070080 2023-11-28T11:58:18.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.920+0000 7f89a17fa700 1 -- 172.21.15.39:0/2711868700 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8994005d90 con 0x7f89a4070080 2023-11-28T11:58:18.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.920+0000 7f89a17fa700 1 -- 172.21.15.39:0/2711868700 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89940072d0 con 0x7f89a4070080 2023-11-28T11:58:18.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.920+0000 7f89a9253700 1 -- 172.21.15.39:0/2711868700 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89a406b6b0 con 0x7f89a4070080 2023-11-28T11:58:18.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.920+0000 7f89a9253700 1 -- 172.21.15.39:0/2711868700 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89a406b3d0 con 0x7f89a4070080 2023-11-28T11:58:18.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.920+0000 7f89a9253700 1 -- 172.21.15.39:0/2711868700 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89a40ad8f0 con 0x7f89a4070080 2023-11-28T11:58:18.931 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.924+0000 7f89a17fa700 1 -- 172.21.15.39:0/2711868700 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8994019030 con 0x7f89a4070080 2023-11-28T11:58:18.931 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.924+0000 7f89a17fa700 1 --2- 172.21.15.39:0/2711868700 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8988064ee0 0x7f8988067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:18.931 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.924+0000 7f89a17fa700 1 -- 172.21.15.39:0/2711868700 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f89940812d0 con 0x7f89a4070080 2023-11-28T11:58:18.931 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.924+0000 7f899bfff700 1 --2- 172.21.15.39:0/2711868700 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8988064ee0 0x7f8988067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:18.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.928+0000 7f899bfff700 1 --2- 172.21.15.39:0/2711868700 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8988064ee0 0x7f8988067390 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f89a4160120 tx=0x7f898c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:18.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:18.932+0000 7f89a17fa700 1 -- 172.21.15.39:0/2711868700 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f899404a400 con 0x7f89a4070080 2023-11-28T11:58:19.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.108+0000 7f89a9253700 1 -- 172.21.15.39:0/2711868700 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89a4073cb0 con 0x7f89a4070080 2023-11-28T11:58:19.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.112+0000 7f89a17fa700 1 -- 172.21.15.39:0/2711868700 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+18032 (secure 0 0 0) 0x7f8994056e60 con 0x7f89a4070080 2023-11-28T11:58:19.117 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:58:19.117 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":44,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:58:04.233062+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:58:01.523189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-28T11:58:02.259575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:58:19.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.112+0000 7f89a9253700 1 -- 172.21.15.39:0/2711868700 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8988064ee0 msgr2=0x7f8988067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:19.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.112+0000 7f89a9253700 1 --2- 172.21.15.39:0/2711868700 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8988064ee0 0x7f8988067390 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f89a4160120 tx=0x7f898c009040 comp rx=0 tx=0).stop 2023-11-28T11:58:19.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.112+0000 7f89a9253700 1 -- 172.21.15.39:0/2711868700 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89a4070080 msgr2=0x7f89a415f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:19.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.112+0000 7f89a9253700 1 --2- 172.21.15.39:0/2711868700 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89a4070080 0x7f89a415f440 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f899400c4d0 tx=0x7f899400c890 comp rx=0 tx=0).stop 2023-11-28T11:58:19.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.112+0000 7f89a9253700 1 -- 172.21.15.39:0/2711868700 shutdown_connections 2023-11-28T11:58:19.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.112+0000 7f89a9253700 1 --2- 172.21.15.39:0/2711868700 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8988064ee0 0x7f8988067390 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:19.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.112+0000 7f89a9253700 1 --2- 172.21.15.39:0/2711868700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89a4160710 0x7f89a415d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:19.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.112+0000 7f89a9253700 1 --2- 172.21.15.39:0/2711868700 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f89a40704b0 0x7f89a415cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:19.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.112+0000 7f89a9253700 1 --2- 172.21.15.39:0/2711868700 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89a4070080 0x7f89a415f440 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:19.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.112+0000 7f89a9253700 1 -- 172.21.15.39:0/2711868700 >> 172.21.15.39:0/2711868700 conn(0x7f89a40b0f80 msgr2=0x7f89a40aec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:19.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.112+0000 7f89a9253700 1 -- 172.21.15.39:0/2711868700 shutdown_connections 2023-11-28T11:58:19.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.112+0000 7f89a9253700 1 -- 172.21.15.39:0/2711868700 wait complete. 2023-11-28T11:58:19.142 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:56:26.631457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:56:33.242202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:58:01.523189+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:58:02.259575+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:58:19.143 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:58:19.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.324+0000 7fc5fceae700 1 Processor -- start 2023-11-28T11:58:19.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.324+0000 7fc5fceae700 1 -- start start 2023-11-28T11:58:19.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.324+0000 7fc5fceae700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5f80af650 0x7fc5f806c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:19.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.324+0000 7fc5fceae700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc5f80adb20 0x7fc5f806ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:19.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.324+0000 7fc5fceae700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5f806c040 con 0x7fc5f80b4280 2023-11-28T11:58:19.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.324+0000 7fc5fceae700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5f815a920 con 0x7fc5f80adb20 2023-11-28T11:58:19.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.324+0000 7fc5fceae700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f815eac0 con 0x7fc5f80af650 2023-11-28T11:58:19.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.328+0000 7fc5f6d9d700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc5f80adb20 0x7fc5f806ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:19.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.328+0000 7fc5f6d9d700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc5f80adb20 0x7fc5f806ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35030/0 (socket says 172.21.15.39:35030) 2023-11-28T11:58:19.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.328+0000 7fc5f6d9d700 1 -- 172.21.15.39:0/4086849862 learned_addr learned my addr 172.21.15.39:0/4086849862 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:19.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.328+0000 7fc5edd9b700 1 --2- 172.21.15.39:0/4086849862 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5f80af650 0x7fc5f806c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:19.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.328+0000 7fc5f6d9d700 1 -- 172.21.15.39:0/4086849862 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5f80af650 msgr2=0x7fc5f806c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:19.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.328+0000 7fc5f6d9d700 1 --2- 172.21.15.39:0/4086849862 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5f80af650 0x7fc5f806c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:19.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.328+0000 7fc5f6d9d700 1 -- 172.21.15.39:0/4086849862 >> v1:172.21.15.184:6789/0 conn(0x7fc5f80b4280 legacy=0x7fc5f80aef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:19.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.328+0000 7fc5f6d9d700 1 -- 172.21.15.39:0/4086849862 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f80b4650 con 0x7fc5f80adb20 2023-11-28T11:58:19.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.328+0000 7fc5f6d9d700 1 --2- 172.21.15.39:0/4086849862 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5f80adb20 0x7fc5f806ca10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0009910 tx=0x7fc5f0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c4c411af385ad6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:19.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.328+0000 7fc5f5d9b700 1 -- 172.21.15.39:0/4086849862 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f000ba60 con 0x7fc5f80adb20 2023-11-28T11:58:19.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.328+0000 7fc5f5d9b700 1 -- 172.21.15.39:0/4086849862 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f000bbc0 con 0x7fc5f80adb20 2023-11-28T11:58:19.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.328+0000 7fc5f5d9b700 1 -- 172.21.15.39:0/4086849862 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f0009e60 con 0x7fc5f80adb20 2023-11-28T11:58:19.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.328+0000 7fc5fceae700 1 -- 172.21.15.39:0/4086849862 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5f80adb20 msgr2=0x7fc5f806ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:19.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.328+0000 7fc5fceae700 1 --2- 172.21.15.39:0/4086849862 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5f80adb20 0x7fc5f806ca10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0009910 tx=0x7fc5f0009c20 comp rx=0 tx=0).stop 2023-11-28T11:58:19.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.328+0000 7fc5fceae700 1 -- 172.21.15.39:0/4086849862 shutdown_connections 2023-11-28T11:58:19.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.328+0000 7fc5fceae700 1 --2- 172.21.15.39:0/4086849862 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5f80adb20 0x7fc5f806ca10 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:19.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.328+0000 7fc5fceae700 1 --2- 172.21.15.39:0/4086849862 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5f80af650 0x7fc5f806c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:19.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.328+0000 7fc5fceae700 1 -- 172.21.15.39:0/4086849862 >> 172.21.15.39:0/4086849862 conn(0x7fc5f80cf580 msgr2=0x7fc5f80cb370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:19.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.328+0000 7fc5fceae700 1 -- 172.21.15.39:0/4086849862 shutdown_connections 2023-11-28T11:58:19.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.328+0000 7fc5fceae700 1 -- 172.21.15.39:0/4086849862 wait complete. 2023-11-28T11:58:19.339 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.332+0000 7fc5fceae700 1 Processor -- start 2023-11-28T11:58:19.339 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.332+0000 7fc5fceae700 1 -- start start 2023-11-28T11:58:19.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.336+0000 7fc5fceae700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5f80adb20 0x7fc5f8150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:19.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.336+0000 7fc5fceae700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5f80af650 0x7fc5f80c2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:19.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.336+0000 7fc5fceae700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5f80b4280 0x7fc5f80701b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:19.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.336+0000 7fc5fceae700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f80c38b0 con 0x7fc5f80adb20 2023-11-28T11:58:19.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.336+0000 7fc5fceae700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f80c3b90 con 0x7fc5f80b4280 2023-11-28T11:58:19.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.336+0000 7fc5fceae700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f80c3e70 con 0x7fc5f80af650 2023-11-28T11:58:19.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.336+0000 7fc5f659c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5f80adb20 0x7fc5f8150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:19.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.336+0000 7fc5f659c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5f80adb20 0x7fc5f8150b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35046/0 (socket says 172.21.15.39:35046) 2023-11-28T11:58:19.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.336+0000 7fc5f659c700 1 -- 172.21.15.39:0/489683046 learned_addr learned my addr 172.21.15.39:0/489683046 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:19.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.336+0000 7fc5edd9b700 1 --2- 172.21.15.39:0/489683046 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5f80af650 0x7fc5f80c2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:19.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.336+0000 7fc5f6d9d700 1 --2- 172.21.15.39:0/489683046 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5f80b4280 0x7fc5f80701b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:19.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.336+0000 7fc5f659c700 1 -- 172.21.15.39:0/489683046 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5f80af650 msgr2=0x7fc5f80c2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:19.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.336+0000 7fc5f659c700 1 --2- 172.21.15.39:0/489683046 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5f80af650 0x7fc5f80c2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:19.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.336+0000 7fc5f659c700 1 -- 172.21.15.39:0/489683046 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5f80b4280 msgr2=0x7fc5f80701b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:19.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.336+0000 7fc5f659c700 1 --2- 172.21.15.39:0/489683046 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5f80b4280 0x7fc5f80701b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:19.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.336+0000 7fc5f659c700 1 -- 172.21.15.39:0/489683046 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f0009570 con 0x7fc5f80adb20 2023-11-28T11:58:19.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.336+0000 7fc5f659c700 1 --2- 172.21.15.39:0/489683046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5f80adb20 0x7fc5f8150b80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8001ed0 tx=0x7fc5e800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:19.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.336+0000 7fc5ef7fe700 1 -- 172.21.15.39:0/489683046 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e800ade0 con 0x7fc5f80adb20 2023-11-28T11:58:19.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.336+0000 7fc5ef7fe700 1 -- 172.21.15.39:0/489683046 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e80020d0 con 0x7fc5f80adb20 2023-11-28T11:58:19.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.336+0000 7fc5fceae700 1 -- 172.21.15.39:0/489683046 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5f80b1350 con 0x7fc5f80adb20 2023-11-28T11:58:19.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.336+0000 7fc5ef7fe700 1 -- 172.21.15.39:0/489683046 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8003c40 con 0x7fc5f80adb20 2023-11-28T11:58:19.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.336+0000 7fc5fceae700 1 -- 172.21.15.39:0/489683046 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5f815ed60 con 0x7fc5f80adb20 2023-11-28T11:58:19.346 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.340+0000 7fc5fceae700 1 -- 172.21.15.39:0/489683046 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5f80b17e0 con 0x7fc5f80adb20 2023-11-28T11:58:19.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.340+0000 7fc5ef7fe700 1 -- 172.21.15.39:0/489683046 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc5e8010050 con 0x7fc5f80adb20 2023-11-28T11:58:19.348 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.344+0000 7fc5ef7fe700 1 --2- 172.21.15.39:0/489683046 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc5d8064ee0 0x7fc5d8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:19.348 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.344+0000 7fc5ef7fe700 1 -- 172.21.15.39:0/489683046 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc5e8082010 con 0x7fc5f80adb20 2023-11-28T11:58:19.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.344+0000 7fc5edd9b700 1 --2- 172.21.15.39:0/489683046 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc5d8064ee0 0x7fc5d8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:19.350 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.344+0000 7fc5edd9b700 1 --2- 172.21.15.39:0/489683046 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc5d8064ee0 0x7fc5d8067390 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc5f80ce320 tx=0x7fc5e0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:19.357 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.352+0000 7fc5ef7fe700 1 -- 172.21.15.39:0/489683046 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc5e8050070 con 0x7fc5f80adb20 2023-11-28T11:58:19.532 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.524+0000 7fc5fceae700 1 -- 172.21.15.39:0/489683046 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc5f806d330 con 0x7fc5f80adb20 2023-11-28T11:58:19.533 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.528+0000 7fc5ef7fe700 1 -- 172.21.15.39:0/489683046 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc5e8053690 con 0x7fc5f80adb20 2023-11-28T11:58:19.533 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-11-28T11:58:19.536 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.528+0000 7fc5fceae700 1 -- 172.21.15.39:0/489683046 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc5d8064ee0 msgr2=0x7fc5d8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:19.536 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.528+0000 7fc5fceae700 1 --2- 172.21.15.39:0/489683046 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc5d8064ee0 0x7fc5d8067390 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc5f80ce320 tx=0x7fc5e0008040 comp rx=0 tx=0).stop 2023-11-28T11:58:19.536 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.528+0000 7fc5fceae700 1 -- 172.21.15.39:0/489683046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5f80adb20 msgr2=0x7fc5f8150b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:19.536 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.528+0000 7fc5fceae700 1 --2- 172.21.15.39:0/489683046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5f80adb20 0x7fc5f8150b80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8001ed0 tx=0x7fc5e800a340 comp rx=0 tx=0).stop 2023-11-28T11:58:19.536 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.528+0000 7fc5fceae700 1 -- 172.21.15.39:0/489683046 shutdown_connections 2023-11-28T11:58:19.536 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.528+0000 7fc5fceae700 1 --2- 172.21.15.39:0/489683046 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc5d8064ee0 0x7fc5d8067390 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:19.536 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.528+0000 7fc5fceae700 1 --2- 172.21.15.39:0/489683046 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5f80b4280 0x7fc5f80701b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:19.537 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.528+0000 7fc5fceae700 1 --2- 172.21.15.39:0/489683046 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5f80af650 0x7fc5f80c2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:19.537 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.528+0000 7fc5fceae700 1 --2- 172.21.15.39:0/489683046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5f80adb20 0x7fc5f8150b80 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:19.537 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.528+0000 7fc5fceae700 1 -- 172.21.15.39:0/489683046 >> 172.21.15.39:0/489683046 conn(0x7fc5f80cf580 msgr2=0x7fc5f8159e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:19.537 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.532+0000 7fc5fceae700 1 -- 172.21.15.39:0/489683046 shutdown_connections 2023-11-28T11:58:19.537 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.532+0000 7fc5fceae700 1 -- 172.21.15.39:0/489683046 wait complete. 2023-11-28T11:58:19.560 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:58:19.748 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.740+0000 7f18b94d1700 1 Processor -- start 2023-11-28T11:58:19.748 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.740+0000 7f18b94d1700 1 -- start start 2023-11-28T11:58:19.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.744+0000 7f18b94d1700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f18b415c700 0x7f18b40702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:19.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.744+0000 7f18b94d1700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f18b40b1be0 0x7f18b4070830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:19.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.744+0000 7f18b94d1700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18b406ac00 con 0x7f18b40b2130 2023-11-28T11:58:19.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.744+0000 7f18b94d1700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18b40cd360 con 0x7f18b415c700 2023-11-28T11:58:19.751 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.744+0000 7f18b94d1700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18b4160190 con 0x7f18b40b1be0 2023-11-28T11:58:19.751 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.744+0000 7f18b2ffd700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f18b415c700 0x7f18b40702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:19.751 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.744+0000 7f18b37fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f18b40b1be0 0x7f18b4070830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:19.751 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.744+0000 7f18b37fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f18b40b1be0 0x7f18b4070830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:60228/0 (socket says 172.21.15.39:60228) 2023-11-28T11:58:19.751 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.744+0000 7f18b37fe700 1 -- 172.21.15.39:0/3597137773 learned_addr learned my addr 172.21.15.39:0/3597137773 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:19.751 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.744+0000 7f18abfff700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f18b40b2130 0x7f18b406c0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:55470/0 (socket says 172.21.15.39:55470) 2023-11-28T11:58:19.752 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.744+0000 7f18b37fe700 1 -- 172.21.15.39:0/3597137773 >> v2:172.21.15.39:3300/0 conn(0x7f18b415c700 msgr2=0x7f18b40702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:19.752 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.744+0000 7f18b37fe700 1 --2- 172.21.15.39:0/3597137773 >> v2:172.21.15.39:3300/0 conn(0x7f18b415c700 0x7f18b40702f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:19.752 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.744+0000 7f18b37fe700 1 -- 172.21.15.39:0/3597137773 >> v1:172.21.15.184:6789/0 conn(0x7f18b40b2130 legacy=0x7f18b406c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:19.752 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.744+0000 7f18b37fe700 1 -- 172.21.15.39:0/3597137773 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b4160470 con 0x7f18b40b1be0 2023-11-28T11:58:19.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.748+0000 7f18b37fe700 1 --2- 172.21.15.39:0/3597137773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18b40b1be0 0x7f18b4070830 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f18b40c9d70 tx=0x7f18ac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59c137dc51715de7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:19.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.748+0000 7f18b27fc700 1 -- 172.21.15.39:0/3597137773 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ac00e070 con 0x7f18b40b1be0 2023-11-28T11:58:19.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.748+0000 7f18b27fc700 1 -- 172.21.15.39:0/3597137773 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18ac00b910 con 0x7f18b40b1be0 2023-11-28T11:58:19.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.748+0000 7f18b27fc700 1 -- 172.21.15.39:0/3597137773 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ac00bcc0 con 0x7f18b40b1be0 2023-11-28T11:58:19.754 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.748+0000 7f18b94d1700 1 -- 172.21.15.39:0/3597137773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18b40b1be0 msgr2=0x7f18b4070830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:19.755 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.748+0000 7f18b94d1700 1 --2- 172.21.15.39:0/3597137773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18b40b1be0 0x7f18b4070830 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f18b40c9d70 tx=0x7f18ac00b330 comp rx=0 tx=0).stop 2023-11-28T11:58:19.755 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.748+0000 7f18b94d1700 1 -- 172.21.15.39:0/3597137773 shutdown_connections 2023-11-28T11:58:19.755 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.748+0000 7f18b94d1700 1 --2- 172.21.15.39:0/3597137773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18b40b1be0 0x7f18b4070830 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:19.755 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.748+0000 7f18b94d1700 1 --2- 172.21.15.39:0/3597137773 >> v2:172.21.15.39:3300/0 conn(0x7f18b415c700 0x7f18b40702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:19.755 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.748+0000 7f18b94d1700 1 -- 172.21.15.39:0/3597137773 >> 172.21.15.39:0/3597137773 conn(0x7f18b40d2d10 msgr2=0x7f18b40d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:19.755 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.748+0000 7f18b94d1700 1 -- 172.21.15.39:0/3597137773 shutdown_connections 2023-11-28T11:58:19.755 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.748+0000 7f18b94d1700 1 -- 172.21.15.39:0/3597137773 wait complete. 2023-11-28T11:58:19.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.752+0000 7f18b94d1700 1 Processor -- start 2023-11-28T11:58:19.758 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.752+0000 7f18b94d1700 1 -- start start 2023-11-28T11:58:19.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.752+0000 7f18b94d1700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18b40b1be0 0x7f18b40cc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:19.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.752+0000 7f18b94d1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18b40b2130 0x7f18b41f5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:19.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.752+0000 7f18b94d1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f18b415c700 0x7f18b415d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:19.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.752+0000 7f18b94d1700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b41f61b0 con 0x7f18b40b1be0 2023-11-28T11:58:19.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.752+0000 7f18b94d1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b415da90 con 0x7f18b40b2130 2023-11-28T11:58:19.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.752+0000 7f18b94d1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b40c9de0 con 0x7f18b415c700 2023-11-28T11:58:19.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.752+0000 7f18b2ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18b40b1be0 0x7f18b40cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:19.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.756+0000 7f18b2ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18b40b1be0 0x7f18b40cc180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35060/0 (socket says 172.21.15.39:35060) 2023-11-28T11:58:19.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.756+0000 7f18b2ffd700 1 -- 172.21.15.39:0/2540047991 learned_addr learned my addr 172.21.15.39:0/2540047991 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:19.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.756+0000 7f18abfff700 1 --2- 172.21.15.39:0/2540047991 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18b40b2130 0x7f18b41f5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:19.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.756+0000 7f18b37fe700 1 --2- 172.21.15.39:0/2540047991 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f18b415c700 0x7f18b415d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:19.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.756+0000 7f18b2ffd700 1 -- 172.21.15.39:0/2540047991 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f18b415c700 msgr2=0x7f18b415d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:19.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.756+0000 7f18b2ffd700 1 --2- 172.21.15.39:0/2540047991 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f18b415c700 0x7f18b415d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:19.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.756+0000 7f18b2ffd700 1 -- 172.21.15.39:0/2540047991 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18b40b2130 msgr2=0x7f18b41f5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:19.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.756+0000 7f18b2ffd700 1 --2- 172.21.15.39:0/2540047991 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18b40b2130 0x7f18b41f5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:19.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.756+0000 7f18b2ffd700 1 -- 172.21.15.39:0/2540047991 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ac009b30 con 0x7f18b40b1be0 2023-11-28T11:58:19.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.756+0000 7f18b2ffd700 1 --2- 172.21.15.39:0/2540047991 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18b40b1be0 0x7f18b40cc180 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f18a400e9d0 tx=0x7f18a400ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:19.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.756+0000 7f18ab7fe700 1 -- 172.21.15.39:0/2540047991 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a4009720 con 0x7f18b40b1be0 2023-11-28T11:58:19.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.756+0000 7f18ab7fe700 1 -- 172.21.15.39:0/2540047991 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a400c850 con 0x7f18b40b1be0 2023-11-28T11:58:19.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.756+0000 7f18ab7fe700 1 -- 172.21.15.39:0/2540047991 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a400cbc0 con 0x7f18b40b1be0 2023-11-28T11:58:19.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.756+0000 7f18b94d1700 1 -- 172.21.15.39:0/2540047991 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18b4160a30 con 0x7f18b40b1be0 2023-11-28T11:58:19.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.756+0000 7f18b94d1700 1 -- 172.21.15.39:0/2540047991 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b4160750 con 0x7f18b40b1be0 2023-11-28T11:58:19.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.756+0000 7f18b94d1700 1 -- 172.21.15.39:0/2540047991 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18b406b530 con 0x7f18b40b1be0 2023-11-28T11:58:19.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.772+0000 7f18ab7fe700 1 -- 172.21.15.39:0/2540047991 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f18a4019030 con 0x7f18b40b1be0 2023-11-28T11:58:19.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.772+0000 7f18ab7fe700 1 --2- 172.21.15.39:0/2540047991 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1894064ee0 0x7f1894067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:19.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.772+0000 7f18ab7fe700 1 -- 172.21.15.39:0/2540047991 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f18a4082820 con 0x7f18b40b1be0 2023-11-28T11:58:19.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.772+0000 7f18abfff700 1 --2- 172.21.15.39:0/2540047991 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1894064ee0 0x7f1894067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:19.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.776+0000 7f18abfff700 1 --2- 172.21.15.39:0/2540047991 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1894064ee0 0x7f1894067390 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f18b406dd40 tx=0x7f189c007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:19.782 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.776+0000 7f18ab7fe700 1 -- 172.21.15.39:0/2540047991 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f18a4050810 con 0x7f18b40b1be0 2023-11-28T11:58:19.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.948+0000 7f18b94d1700 1 -- 172.21.15.39:0/2540047991 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f18b40726c0 con 0x7f18b40b1be0 2023-11-28T11:58:19.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.948+0000 7f18ab7fe700 1 -- 172.21.15.39:0/2540047991 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v44) v1 ==== 92+0+10 (secure 0 0 0) 0x7f18a4053e30 con 0x7f18b40b1be0 2023-11-28T11:58:19.954 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-11-28T11:58:19.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.952+0000 7f18b94d1700 1 -- 172.21.15.39:0/2540047991 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1894064ee0 msgr2=0x7f1894067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:19.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.952+0000 7f18b94d1700 1 --2- 172.21.15.39:0/2540047991 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1894064ee0 0x7f1894067390 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f18b406dd40 tx=0x7f189c007d50 comp rx=0 tx=0).stop 2023-11-28T11:58:19.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.952+0000 7f18b94d1700 1 -- 172.21.15.39:0/2540047991 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18b40b1be0 msgr2=0x7f18b40cc180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:19.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.952+0000 7f18b94d1700 1 --2- 172.21.15.39:0/2540047991 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18b40b1be0 0x7f18b40cc180 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f18a400e9d0 tx=0x7f18a400ed90 comp rx=0 tx=0).stop 2023-11-28T11:58:19.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.952+0000 7f18b94d1700 1 -- 172.21.15.39:0/2540047991 shutdown_connections 2023-11-28T11:58:19.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.952+0000 7f18b94d1700 1 --2- 172.21.15.39:0/2540047991 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f18b415c700 0x7f18b415d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:19.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.952+0000 7f18b94d1700 1 --2- 172.21.15.39:0/2540047991 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1894064ee0 0x7f1894067390 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:19.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.952+0000 7f18b94d1700 1 --2- 172.21.15.39:0/2540047991 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18b40b2130 0x7f18b41f5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:19.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.952+0000 7f18b94d1700 1 --2- 172.21.15.39:0/2540047991 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f18b40b1be0 0x7f18b40cc180 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:19.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.952+0000 7f18b94d1700 1 -- 172.21.15.39:0/2540047991 >> 172.21.15.39:0/2540047991 conn(0x7f18b40d2d10 msgr2=0x7f18b40b4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:19.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.952+0000 7f18b94d1700 1 -- 172.21.15.39:0/2540047991 shutdown_connections 2023-11-28T11:58:19.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:19.952+0000 7f18b94d1700 1 -- 172.21.15.39:0/2540047991 wait complete. 2023-11-28T11:58:19.977 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:58:20.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.152+0000 7f4b25384700 1 Processor -- start 2023-11-28T11:58:20.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.152+0000 7f4b25384700 1 -- start start 2023-11-28T11:58:20.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.152+0000 7f4b25384700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b200b22e0 0x7f4b200ce430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:20.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.152+0000 7f4b25384700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f4b2006ad00 0x7f4b2015d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:20.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.152+0000 7f4b25384700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4b200b26b0 0x7f4b2006fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:20.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.152+0000 7f4b25384700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b2006cca0 con 0x7f4b200b26b0 2023-11-28T11:58:20.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.152+0000 7f4b25384700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b2015d670 con 0x7f4b2006ad00 2023-11-28T11:58:20.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.152+0000 7f4b25384700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2006f040 con 0x7f4b200b22e0 2023-11-28T11:58:20.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.152+0000 7f4b24b83700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4b200b26b0 0x7f4b2006fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:20.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.156+0000 7f4b1f7fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f4b2006ad00 0x7f4b2015d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:20.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.156+0000 7f4b1ffff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b200b22e0 0x7f4b200ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:20.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.156+0000 7f4b24b83700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4b200b26b0 0x7f4b2006fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35064/0 (socket says 172.21.15.39:35064) 2023-11-28T11:58:20.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.156+0000 7f4b24b83700 1 -- 172.21.15.39:0/2013523292 learned_addr learned my addr 172.21.15.39:0/2013523292 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:20.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.156+0000 7f4b24b83700 1 -- 172.21.15.39:0/2013523292 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b200b22e0 msgr2=0x7f4b200ce430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:20.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.156+0000 7f4b24b83700 1 --2- 172.21.15.39:0/2013523292 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b200b22e0 0x7f4b200ce430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:20.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.156+0000 7f4b24b83700 1 -- 172.21.15.39:0/2013523292 >> v2:172.21.15.184:3300/0 conn(0x7f4b2006ad00 msgr2=0x7f4b2015d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:20.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.156+0000 7f4b24b83700 1 --2- 172.21.15.39:0/2013523292 >> v2:172.21.15.184:3300/0 conn(0x7f4b2006ad00 0x7f4b2015d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:20.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.156+0000 7f4b24b83700 1 -- 172.21.15.39:0/2013523292 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b200cffc0 con 0x7f4b200b26b0 2023-11-28T11:58:20.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.156+0000 7f4b24b83700 1 --2- 172.21.15.39:0/2013523292 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b200b26b0 0x7f4b2006fd00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f4b10009910 tx=0x7f4b10009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7072c13b3a0ec7a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:20.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.156+0000 7f4b1effd700 1 -- 172.21.15.39:0/2013523292 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b10011830 con 0x7f4b200b26b0 2023-11-28T11:58:20.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.156+0000 7f4b1effd700 1 -- 172.21.15.39:0/2013523292 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b10011990 con 0x7f4b200b26b0 2023-11-28T11:58:20.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.156+0000 7f4b1effd700 1 -- 172.21.15.39:0/2013523292 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b10011d40 con 0x7f4b200b26b0 2023-11-28T11:58:20.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.156+0000 7f4b25384700 1 -- 172.21.15.39:0/2013523292 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b200b26b0 msgr2=0x7f4b2006fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:20.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.156+0000 7f4b25384700 1 --2- 172.21.15.39:0/2013523292 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b200b26b0 0x7f4b2006fd00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f4b10009910 tx=0x7f4b10009c20 comp rx=0 tx=0).stop 2023-11-28T11:58:20.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.156+0000 7f4b25384700 1 -- 172.21.15.39:0/2013523292 shutdown_connections 2023-11-28T11:58:20.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.156+0000 7f4b25384700 1 --2- 172.21.15.39:0/2013523292 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b200b26b0 0x7f4b2006fd00 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:20.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.156+0000 7f4b25384700 1 --2- 172.21.15.39:0/2013523292 >> v2:172.21.15.184:3300/0 conn(0x7f4b2006ad00 0x7f4b2015d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:20.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.156+0000 7f4b25384700 1 --2- 172.21.15.39:0/2013523292 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b200b22e0 0x7f4b200ce430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:20.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.160+0000 7f4b25384700 1 -- 172.21.15.39:0/2013523292 >> 172.21.15.39:0/2013523292 conn(0x7f4b200cd2e0 msgr2=0x7f4b200cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:20.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.160+0000 7f4b25384700 1 -- 172.21.15.39:0/2013523292 shutdown_connections 2023-11-28T11:58:20.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.160+0000 7f4b25384700 1 -- 172.21.15.39:0/2013523292 wait complete. 2023-11-28T11:58:20.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.164+0000 7f4b25384700 1 Processor -- start 2023-11-28T11:58:20.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.164+0000 7f4b25384700 1 -- start start 2023-11-28T11:58:20.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.164+0000 7f4b25384700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b2006ad00 0x7f4b20159de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:20.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.164+0000 7f4b25384700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b200b22e0 0x7f4b200c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:20.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.164+0000 7f4b25384700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b200b26b0 0x7f4b200c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:20.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.164+0000 7f4b25384700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b200c4430 con 0x7f4b2006ad00 2023-11-28T11:58:20.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.164+0000 7f4b25384700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b200c4710 con 0x7f4b200b26b0 2023-11-28T11:58:20.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.164+0000 7f4b25384700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b200c49f0 con 0x7f4b200b22e0 2023-11-28T11:58:20.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.164+0000 7f4b1ffff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b2006ad00 0x7f4b20159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:20.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.164+0000 7f4b1ffff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b2006ad00 0x7f4b20159de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35070/0 (socket says 172.21.15.39:35070) 2023-11-28T11:58:20.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.164+0000 7f4b1ffff700 1 -- 172.21.15.39:0/3290048037 learned_addr learned my addr 172.21.15.39:0/3290048037 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:20.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.164+0000 7f4b24b83700 1 --2- 172.21.15.39:0/3290048037 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b200b26b0 0x7f4b200c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:20.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.164+0000 7f4b1f7fe700 1 --2- 172.21.15.39:0/3290048037 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b200b22e0 0x7f4b200c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:20.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.164+0000 7f4b1ffff700 1 -- 172.21.15.39:0/3290048037 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b200b22e0 msgr2=0x7f4b200c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:20.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.164+0000 7f4b1ffff700 1 --2- 172.21.15.39:0/3290048037 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b200b22e0 0x7f4b200c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:20.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.164+0000 7f4b1ffff700 1 -- 172.21.15.39:0/3290048037 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b200b26b0 msgr2=0x7f4b200c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:20.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.164+0000 7f4b1ffff700 1 --2- 172.21.15.39:0/3290048037 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b200b26b0 0x7f4b200c96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:20.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.164+0000 7f4b1ffff700 1 -- 172.21.15.39:0/3290048037 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b10009570 con 0x7f4b2006ad00 2023-11-28T11:58:20.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.168+0000 7f4b1ffff700 1 --2- 172.21.15.39:0/3290048037 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b2006ad00 0x7f4b20159de0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f4b1800efc0 tx=0x7f4b1800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:20.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.168+0000 7f4b1cff9700 1 -- 172.21.15.39:0/3290048037 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1800cc00 con 0x7f4b2006ad00 2023-11-28T11:58:20.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.168+0000 7f4b1cff9700 1 -- 172.21.15.39:0/3290048037 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1800f040 con 0x7f4b2006ad00 2023-11-28T11:58:20.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.168+0000 7f4b1cff9700 1 -- 172.21.15.39:0/3290048037 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b18014480 con 0x7f4b2006ad00 2023-11-28T11:58:20.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.168+0000 7f4b25384700 1 -- 172.21.15.39:0/3290048037 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b2006f320 con 0x7f4b2006ad00 2023-11-28T11:58:20.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.168+0000 7f4b25384700 1 -- 172.21.15.39:0/3290048037 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b200d02a0 con 0x7f4b2006ad00 2023-11-28T11:58:20.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.168+0000 7f4b25384700 1 -- 172.21.15.39:0/3290048037 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b200b2b50 con 0x7f4b2006ad00 2023-11-28T11:58:20.176 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.168+0000 7f4b1cff9700 1 -- 172.21.15.39:0/3290048037 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4b180145e0 con 0x7f4b2006ad00 2023-11-28T11:58:20.177 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.172+0000 7f4b1cff9700 1 --2- 172.21.15.39:0/3290048037 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4b0c064ee0 0x7f4b0c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:20.177 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.172+0000 7f4b1cff9700 1 -- 172.21.15.39:0/3290048037 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4b18082960 con 0x7f4b2006ad00 2023-11-28T11:58:20.178 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.172+0000 7f4b1f7fe700 1 --2- 172.21.15.39:0/3290048037 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4b0c064ee0 0x7f4b0c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:20.179 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.172+0000 7f4b1f7fe700 1 --2- 172.21.15.39:0/3290048037 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4b0c064ee0 0x7f4b0c067390 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4b200afb00 tx=0x7f4b14008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:20.184 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.176+0000 7f4b1cff9700 1 -- 172.21.15.39:0/3290048037 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4b180509c0 con 0x7f4b2006ad00 2023-11-28T11:58:20.355 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.348+0000 7f4b25384700 1 -- 172.21.15.39:0/3290048037 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4b200c4570 con 0x7f4b2006ad00 2023-11-28T11:58:20.355 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.348+0000 7f4b1cff9700 1 -- 172.21.15.39:0/3290048037 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4b200c4570 con 0x7f4b2006ad00 2023-11-28T11:58:20.356 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-11-28T11:58:20.359 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.352+0000 7f4b25384700 1 -- 172.21.15.39:0/3290048037 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4b0c064ee0 msgr2=0x7f4b0c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:20.359 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.352+0000 7f4b25384700 1 --2- 172.21.15.39:0/3290048037 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4b0c064ee0 0x7f4b0c067390 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4b200afb00 tx=0x7f4b14008040 comp rx=0 tx=0).stop 2023-11-28T11:58:20.359 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.352+0000 7f4b25384700 1 -- 172.21.15.39:0/3290048037 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b2006ad00 msgr2=0x7f4b20159de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:20.359 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.352+0000 7f4b25384700 1 --2- 172.21.15.39:0/3290048037 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b2006ad00 0x7f4b20159de0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f4b1800efc0 tx=0x7f4b1800c0c0 comp rx=0 tx=0).stop 2023-11-28T11:58:20.359 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.352+0000 7f4b25384700 1 -- 172.21.15.39:0/3290048037 shutdown_connections 2023-11-28T11:58:20.359 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.352+0000 7f4b25384700 1 --2- 172.21.15.39:0/3290048037 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4b0c064ee0 0x7f4b0c067390 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:20.359 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.352+0000 7f4b25384700 1 --2- 172.21.15.39:0/3290048037 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b200b26b0 0x7f4b200c96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:20.359 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.352+0000 7f4b25384700 1 --2- 172.21.15.39:0/3290048037 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b200b22e0 0x7f4b200c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:20.359 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.352+0000 7f4b25384700 1 --2- 172.21.15.39:0/3290048037 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b2006ad00 0x7f4b20159de0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:20.360 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.352+0000 7f4b25384700 1 -- 172.21.15.39:0/3290048037 >> 172.21.15.39:0/3290048037 conn(0x7f4b200cd2e0 msgr2=0x7f4b2015bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:20.360 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.352+0000 7f4b25384700 1 -- 172.21.15.39:0/3290048037 shutdown_connections 2023-11-28T11:58:20.360 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.352+0000 7f4b25384700 1 -- 172.21.15.39:0/3290048037 wait complete. 2023-11-28T11:58:20.380 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:58:20.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.552+0000 7f95c2ab1700 1 Processor -- start 2023-11-28T11:58:20.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.552+0000 7f95c2ab1700 1 -- start start 2023-11-28T11:58:20.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.552+0000 7f95c2ab1700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f95bc15e190 0x7f95bc0cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:20.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.552+0000 7f95c2ab1700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f95bc161560 0x7f95bc069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:20.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.552+0000 7f95c2ab1700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95bc15e560 con 0x7f95bc06ff10 2023-11-28T11:58:20.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.552+0000 7f95c2ab1700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95bc06be80 con 0x7f95bc161560 2023-11-28T11:58:20.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.552+0000 7f95c2ab1700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95bc0ce330 con 0x7f95bc15e190 2023-11-28T11:58:20.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.552+0000 7f95c12ae700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f95bc161560 0x7f95bc069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:20.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.552+0000 7f95c12ae700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f95bc161560 0x7f95bc069bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35084/0 (socket says 172.21.15.39:35084) 2023-11-28T11:58:20.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.552+0000 7f95c12ae700 1 -- 172.21.15.39:0/1344985232 learned_addr learned my addr 172.21.15.39:0/1344985232 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:20.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.552+0000 7f95c1aaf700 1 --2- 172.21.15.39:0/1344985232 >> v2:172.21.15.184:3300/0 conn(0x7f95bc15e190 0x7f95bc0cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:20.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.556+0000 7f95c12ae700 1 -- 172.21.15.39:0/1344985232 >> v2:172.21.15.184:3300/0 conn(0x7f95bc15e190 msgr2=0x7f95bc0cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:20.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.556+0000 7f95c12ae700 1 --2- 172.21.15.39:0/1344985232 >> v2:172.21.15.184:3300/0 conn(0x7f95bc15e190 0x7f95bc0cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:20.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.556+0000 7f95c12ae700 1 -- 172.21.15.39:0/1344985232 >> v1:172.21.15.184:6789/0 conn(0x7f95bc06ff10 legacy=0x7f95bc06c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:20.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.556+0000 7f95c12ae700 1 -- 172.21.15.39:0/1344985232 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95bc0af990 con 0x7f95bc161560 2023-11-28T11:58:20.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.556+0000 7f95c12ae700 1 --2- 172.21.15.39:0/1344985232 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95bc161560 0x7f95bc069bf0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0cb9b0 tx=0x7f95b0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53b7499ffda984b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:20.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.556+0000 7f95c0aad700 1 -- 172.21.15.39:0/1344985232 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b000b8a0 con 0x7f95bc161560 2023-11-28T11:58:20.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.556+0000 7f95c0aad700 1 -- 172.21.15.39:0/1344985232 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b000ba00 con 0x7f95bc161560 2023-11-28T11:58:20.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.556+0000 7f95c0aad700 1 -- 172.21.15.39:0/1344985232 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b000bd90 con 0x7f95bc161560 2023-11-28T11:58:20.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.556+0000 7f95c2ab1700 1 -- 172.21.15.39:0/1344985232 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95bc161560 msgr2=0x7f95bc069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:20.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.556+0000 7f95c2ab1700 1 --2- 172.21.15.39:0/1344985232 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95bc161560 0x7f95bc069bf0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0cb9b0 tx=0x7f95b0009bf0 comp rx=0 tx=0).stop 2023-11-28T11:58:20.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.556+0000 7f95c2ab1700 1 -- 172.21.15.39:0/1344985232 shutdown_connections 2023-11-28T11:58:20.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.556+0000 7f95c2ab1700 1 --2- 172.21.15.39:0/1344985232 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95bc161560 0x7f95bc069bf0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:20.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.556+0000 7f95c2ab1700 1 --2- 172.21.15.39:0/1344985232 >> v2:172.21.15.184:3300/0 conn(0x7f95bc15e190 0x7f95bc0cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:20.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.556+0000 7f95c2ab1700 1 -- 172.21.15.39:0/1344985232 >> 172.21.15.39:0/1344985232 conn(0x7f95bc0cf280 msgr2=0x7f95bc0cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:20.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.556+0000 7f95c2ab1700 1 -- 172.21.15.39:0/1344985232 shutdown_connections 2023-11-28T11:58:20.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.556+0000 7f95c2ab1700 1 -- 172.21.15.39:0/1344985232 wait complete. 2023-11-28T11:58:20.567 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.560+0000 7f95c2ab1700 1 Processor -- start 2023-11-28T11:58:20.567 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.560+0000 7f95c2ab1700 1 -- start start 2023-11-28T11:58:20.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.564+0000 7f95c2ab1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95bc06ff10 0x7f95bc1497c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:20.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.564+0000 7f95c2ab1700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95bc15e190 0x7f95bc158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:20.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.564+0000 7f95c2ab1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95bc161560 0x7f95bc0c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:20.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.564+0000 7f95c2ab1700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc0c5630 con 0x7f95bc15e190 2023-11-28T11:58:20.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.564+0000 7f95c2ab1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc0c5810 con 0x7f95bc161560 2023-11-28T11:58:20.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.564+0000 7f95c2ab1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc0c5af0 con 0x7f95bc06ff10 2023-11-28T11:58:20.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.564+0000 7f95c12ae700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95bc15e190 0x7f95bc158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:20.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.564+0000 7f95c12ae700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95bc15e190 0x7f95bc158be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35100/0 (socket says 172.21.15.39:35100) 2023-11-28T11:58:20.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.564+0000 7f95c12ae700 1 -- 172.21.15.39:0/2183708039 learned_addr learned my addr 172.21.15.39:0/2183708039 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:20.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.564+0000 7f95c1aaf700 1 --2- 172.21.15.39:0/2183708039 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95bc06ff10 0x7f95bc1497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:20.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.564+0000 7f95c22b0700 1 --2- 172.21.15.39:0/2183708039 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95bc161560 0x7f95bc0c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:20.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.564+0000 7f95c12ae700 1 -- 172.21.15.39:0/2183708039 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95bc06ff10 msgr2=0x7f95bc1497c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:20.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.564+0000 7f95c12ae700 1 --2- 172.21.15.39:0/2183708039 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95bc06ff10 0x7f95bc1497c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:20.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.564+0000 7f95c12ae700 1 -- 172.21.15.39:0/2183708039 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95bc161560 msgr2=0x7f95bc0c9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:20.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.564+0000 7f95c12ae700 1 --2- 172.21.15.39:0/2183708039 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95bc161560 0x7f95bc0c9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:20.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.564+0000 7f95c12ae700 1 -- 172.21.15.39:0/2183708039 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b0009570 con 0x7f95bc15e190 2023-11-28T11:58:20.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.564+0000 7f95c12ae700 1 --2- 172.21.15.39:0/2183708039 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95bc15e190 0x7f95bc158be0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0717e0 tx=0x7f95b0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:20.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.564+0000 7f95ba7fc700 1 -- 172.21.15.39:0/2183708039 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b00036c0 con 0x7f95bc15e190 2023-11-28T11:58:20.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.564+0000 7f95ba7fc700 1 -- 172.21.15.39:0/2183708039 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b001f070 con 0x7f95bc15e190 2023-11-28T11:58:20.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.564+0000 7f95c2ab1700 1 -- 172.21.15.39:0/2183708039 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95bc0aff50 con 0x7f95bc15e190 2023-11-28T11:58:20.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.564+0000 7f95ba7fc700 1 -- 172.21.15.39:0/2183708039 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b0003a80 con 0x7f95bc15e190 2023-11-28T11:58:20.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.564+0000 7f95c2ab1700 1 -- 172.21.15.39:0/2183708039 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95bc0afc70 con 0x7f95bc15e190 2023-11-28T11:58:20.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.568+0000 7f95c2ab1700 1 -- 172.21.15.39:0/2183708039 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95bc06a130 con 0x7f95bc15e190 2023-11-28T11:58:20.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.568+0000 7f95ba7fc700 1 -- 172.21.15.39:0/2183708039 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f95b002a020 con 0x7f95bc15e190 2023-11-28T11:58:20.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.572+0000 7f95ba7fc700 1 --2- 172.21.15.39:0/2183708039 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f95a8064ee0 0x7f95a8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:20.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.572+0000 7f95ba7fc700 1 -- 172.21.15.39:0/2183708039 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f95b0083860 con 0x7f95bc15e190 2023-11-28T11:58:20.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.572+0000 7f95c1aaf700 1 --2- 172.21.15.39:0/2183708039 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f95a8064ee0 0x7f95a8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:20.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.572+0000 7f95c1aaf700 1 --2- 172.21.15.39:0/2183708039 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f95a8064ee0 0x7f95a8067390 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f95ac009a00 tx=0x7f95ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:20.583 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.576+0000 7f95ba7fc700 1 -- 172.21.15.39:0/2183708039 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f95b0051750 con 0x7f95bc15e190 2023-11-28T11:58:20.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.752+0000 7f95c2ab1700 1 -- 172.21.15.39:0/2183708039 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f95bc073d20 con 0x7f95bc15e190 2023-11-28T11:58:20.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.752+0000 7f95ba7fc700 1 -- 172.21.15.39:0/2183708039 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) v1 ==== 100+0+11 (secure 0 0 0) 0x7f95b0054d70 con 0x7f95bc15e190 2023-11-28T11:58:20.758 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2023-11-28T11:58:20.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.756+0000 7f95c2ab1700 1 -- 172.21.15.39:0/2183708039 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f95a8064ee0 msgr2=0x7f95a8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:20.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.756+0000 7f95c2ab1700 1 --2- 172.21.15.39:0/2183708039 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f95a8064ee0 0x7f95a8067390 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f95ac009a00 tx=0x7f95ac008040 comp rx=0 tx=0).stop 2023-11-28T11:58:20.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.756+0000 7f95c2ab1700 1 -- 172.21.15.39:0/2183708039 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95bc15e190 msgr2=0x7f95bc158be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:20.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.756+0000 7f95c2ab1700 1 --2- 172.21.15.39:0/2183708039 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95bc15e190 0x7f95bc158be0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0717e0 tx=0x7f95b0004770 comp rx=0 tx=0).stop 2023-11-28T11:58:20.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.756+0000 7f95c2ab1700 1 -- 172.21.15.39:0/2183708039 shutdown_connections 2023-11-28T11:58:20.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.756+0000 7f95c2ab1700 1 --2- 172.21.15.39:0/2183708039 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f95a8064ee0 0x7f95a8067390 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:20.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.756+0000 7f95c2ab1700 1 --2- 172.21.15.39:0/2183708039 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95bc161560 0x7f95bc0c9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:20.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.756+0000 7f95c2ab1700 1 --2- 172.21.15.39:0/2183708039 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95bc15e190 0x7f95bc158be0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:20.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.756+0000 7f95c2ab1700 1 --2- 172.21.15.39:0/2183708039 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95bc06ff10 0x7f95bc1497c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:20.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.756+0000 7f95c2ab1700 1 -- 172.21.15.39:0/2183708039 >> 172.21.15.39:0/2183708039 conn(0x7f95bc0cf280 msgr2=0x7f95bc0c3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:20.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.756+0000 7f95c2ab1700 1 -- 172.21.15.39:0/2183708039 shutdown_connections 2023-11-28T11:58:20.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.756+0000 7f95c2ab1700 1 -- 172.21.15.39:0/2183708039 wait complete. 2023-11-28T11:58:20.783 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T11:58:20.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.956+0000 7f63ba113700 1 Processor -- start 2023-11-28T11:58:20.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.956+0000 7f63ba113700 1 -- start start 2023-11-28T11:58:20.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.960+0000 7f63ba113700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f63b41534a0 0x7f63b415d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:20.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.960+0000 7f63ba113700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f63b40b6200 0x7f63b4070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:20.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.960+0000 7f63ba113700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63b415d080 con 0x7f63b4160920 2023-11-28T11:58:20.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.960+0000 7f63ba113700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63b4153870 con 0x7f63b41534a0 2023-11-28T11:58:20.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.960+0000 7f63ba113700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63b40b53c0 con 0x7f63b40b6200 2023-11-28T11:58:20.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.960+0000 7f63b37fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f63b41534a0 0x7f63b415d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:20.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.960+0000 7f63abfff700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f63b4160920 0x7f63b40b5af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:49330/0 (socket says 172.21.15.39:49330) 2023-11-28T11:58:20.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.960+0000 7f63abfff700 1 -- 172.21.15.39:0/3221549674 learned_addr learned my addr 172.21.15.39:0/3221549674 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:58:20.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.960+0000 7f63b3fff700 1 --2- 172.21.15.39:0/3221549674 >> v2:172.21.15.184:3300/0 conn(0x7f63b40b6200 0x7f63b4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:20.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.960+0000 7f63b37fe700 1 -- 172.21.15.39:0/3221549674 >> v2:172.21.15.184:3300/0 conn(0x7f63b40b6200 msgr2=0x7f63b4070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:20.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.960+0000 7f63b37fe700 1 --2- 172.21.15.39:0/3221549674 >> v2:172.21.15.184:3300/0 conn(0x7f63b40b6200 0x7f63b4070630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:20.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.960+0000 7f63b37fe700 1 -- 172.21.15.39:0/3221549674 >> v1:172.21.15.39:6789/0 conn(0x7f63b4160920 legacy=0x7f63b40b5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:20.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.960+0000 7f63b2ffd700 1 -- 172.21.15.39:0/3221549674 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3308483285 0 0) 0x7f63b415d080 con 0x7f63b4160920 2023-11-28T11:58:20.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.960+0000 7f63b37fe700 1 -- 172.21.15.39:0/3221549674 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b40b56a0 con 0x7f63b41534a0 2023-11-28T11:58:20.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.960+0000 7f63b37fe700 1 --2- 172.21.15.39:0/3221549674 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63b41534a0 0x7f63b415d510 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f63b4071f60 tx=0x7f63a4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdd7bb4de538722e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:20.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.960+0000 7f63b2ffd700 1 -- 172.21.15.39:0/3221549674 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a4011830 con 0x7f63b41534a0 2023-11-28T11:58:20.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.960+0000 7f63b2ffd700 1 -- 172.21.15.39:0/3221549674 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a4011990 con 0x7f63b41534a0 2023-11-28T11:58:20.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.960+0000 7f63b2ffd700 1 -- 172.21.15.39:0/3221549674 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a4011d20 con 0x7f63b41534a0 2023-11-28T11:58:20.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.964+0000 7f63ba113700 1 -- 172.21.15.39:0/3221549674 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63b41534a0 msgr2=0x7f63b415d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:20.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.964+0000 7f63ba113700 1 --2- 172.21.15.39:0/3221549674 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63b41534a0 0x7f63b415d510 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f63b4071f60 tx=0x7f63a4009b30 comp rx=0 tx=0).stop 2023-11-28T11:58:20.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.964+0000 7f63ba113700 1 -- 172.21.15.39:0/3221549674 shutdown_connections 2023-11-28T11:58:20.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.964+0000 7f63ba113700 1 --2- 172.21.15.39:0/3221549674 >> v2:172.21.15.184:3300/0 conn(0x7f63b40b6200 0x7f63b4070630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:20.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.964+0000 7f63ba113700 1 --2- 172.21.15.39:0/3221549674 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63b41534a0 0x7f63b415d510 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:20.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.964+0000 7f63ba113700 1 -- 172.21.15.39:0/3221549674 >> 172.21.15.39:0/3221549674 conn(0x7f63b406bfc0 msgr2=0x7f63b406c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:20.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.964+0000 7f63ba113700 1 -- 172.21.15.39:0/3221549674 shutdown_connections 2023-11-28T11:58:20.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.964+0000 7f63ba113700 1 -- 172.21.15.39:0/3221549674 wait complete. 2023-11-28T11:58:20.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.968+0000 7f63ba113700 1 Processor -- start 2023-11-28T11:58:20.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.968+0000 7f63ba113700 1 -- start start 2023-11-28T11:58:20.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.968+0000 7f63ba113700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63b40b6200 0x7f63b4157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:20.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.968+0000 7f63ba113700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63b41534a0 0x7f63b41583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:20.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.968+0000 7f63ba113700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63b4160920 0x7f63b4158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:20.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.968+0000 7f63ba113700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b4158200 con 0x7f63b40b6200 2023-11-28T11:58:20.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.968+0000 7f63ba113700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b40d33f0 con 0x7f63b41534a0 2023-11-28T11:58:20.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.968+0000 7f63ba113700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b40d36d0 con 0x7f63b4160920 2023-11-28T11:58:20.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.968+0000 7f63b37fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63b40b6200 0x7f63b4157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:20.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.972+0000 7f63b37fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63b40b6200 0x7f63b4157cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35118/0 (socket says 172.21.15.39:35118) 2023-11-28T11:58:20.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.972+0000 7f63b37fe700 1 -- 172.21.15.39:0/3986679545 learned_addr learned my addr 172.21.15.39:0/3986679545 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:20.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.972+0000 7f63abfff700 1 --2- 172.21.15.39:0/3986679545 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63b41534a0 0x7f63b41583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:20.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.972+0000 7f63b3fff700 1 --2- 172.21.15.39:0/3986679545 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63b4160920 0x7f63b4158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:20.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.972+0000 7f63b37fe700 1 -- 172.21.15.39:0/3986679545 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63b4160920 msgr2=0x7f63b4158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:20.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.972+0000 7f63b37fe700 1 --2- 172.21.15.39:0/3986679545 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63b4160920 0x7f63b4158920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:20.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.972+0000 7f63b37fe700 1 -- 172.21.15.39:0/3986679545 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63b41534a0 msgr2=0x7f63b41583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:20.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.972+0000 7f63b37fe700 1 --2- 172.21.15.39:0/3986679545 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63b41534a0 0x7f63b41583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:20.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.972+0000 7f63b37fe700 1 -- 172.21.15.39:0/3986679545 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a40094b0 con 0x7f63b40b6200 2023-11-28T11:58:20.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.972+0000 7f63abfff700 1 --2- 172.21.15.39:0/3986679545 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63b41534a0 0x7f63b41583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:58:20.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.972+0000 7f63b3fff700 1 --2- 172.21.15.39:0/3986679545 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63b4160920 0x7f63b4158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:58:20.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.972+0000 7f63b37fe700 1 --2- 172.21.15.39:0/3986679545 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63b40b6200 0x7f63b4157cc0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f63a4009fd0 tx=0x7f63a4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:20.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.972+0000 7f63b0ff9700 1 -- 172.21.15.39:0/3986679545 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a40045b0 con 0x7f63b40b6200 2023-11-28T11:58:20.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.972+0000 7f63b0ff9700 1 -- 172.21.15.39:0/3986679545 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a401f070 con 0x7f63b40b6200 2023-11-28T11:58:20.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.972+0000 7f63ba113700 1 -- 172.21.15.39:0/3986679545 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63b415cd10 con 0x7f63b40b6200 2023-11-28T11:58:20.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.972+0000 7f63b0ff9700 1 -- 172.21.15.39:0/3986679545 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a40038e0 con 0x7f63b40b6200 2023-11-28T11:58:20.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.972+0000 7f63ba113700 1 -- 172.21.15.39:0/3986679545 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63b415ca30 con 0x7f63b40b6200 2023-11-28T11:58:20.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.972+0000 7f63ba113700 1 -- 172.21.15.39:0/3986679545 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63b40b7f10 con 0x7f63b40b6200 2023-11-28T11:58:20.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.976+0000 7f63b0ff9700 1 -- 172.21.15.39:0/3986679545 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f63a400f050 con 0x7f63b40b6200 2023-11-28T11:58:20.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.976+0000 7f63b0ff9700 1 --2- 172.21.15.39:0/3986679545 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6394064ee0 0x7f6394067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:20.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.976+0000 7f63b0ff9700 1 -- 172.21.15.39:0/3986679545 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f63a4082e50 con 0x7f63b40b6200 2023-11-28T11:58:20.984 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.976+0000 7f63abfff700 1 --2- 172.21.15.39:0/3986679545 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6394064ee0 0x7f6394067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:20.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.980+0000 7f63abfff700 1 --2- 172.21.15.39:0/3986679545 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6394064ee0 0x7f6394067390 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f63b4070c40 tx=0x7f639c007d70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:20.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:20.984+0000 7f63b0ff9700 1 -- 172.21.15.39:0/3986679545 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f63a4050dc0 con 0x7f63b40b6200 2023-11-28T11:58:21.178 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.172+0000 7f63ba113700 1 -- 172.21.15.39:0/3986679545 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f63b40726c0 con 0x7f63b40b6200 2023-11-28T11:58:21.179 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.172+0000 7f63b0ff9700 1 -- 172.21.15.39:0/3986679545 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v44) v1 ==== 80+0+0 (secure 0 0 0) 0x7f63a4015080 con 0x7f63b40b6200 2023-11-28T11:58:21.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.176+0000 7f63ba113700 1 -- 172.21.15.39:0/3986679545 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6394064ee0 msgr2=0x7f6394067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:21.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.176+0000 7f63ba113700 1 --2- 172.21.15.39:0/3986679545 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6394064ee0 0x7f6394067390 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f63b4070c40 tx=0x7f639c007d70 comp rx=0 tx=0).stop 2023-11-28T11:58:21.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.176+0000 7f63ba113700 1 -- 172.21.15.39:0/3986679545 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63b40b6200 msgr2=0x7f63b4157cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:21.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.176+0000 7f63ba113700 1 --2- 172.21.15.39:0/3986679545 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63b40b6200 0x7f63b4157cc0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f63a4009fd0 tx=0x7f63a4004770 comp rx=0 tx=0).stop 2023-11-28T11:58:21.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.176+0000 7f63ba113700 1 -- 172.21.15.39:0/3986679545 shutdown_connections 2023-11-28T11:58:21.186 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.176+0000 7f63ba113700 1 --2- 172.21.15.39:0/3986679545 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63b4160920 0x7f63b4158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:21.186 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.176+0000 7f63ba113700 1 --2- 172.21.15.39:0/3986679545 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6394064ee0 0x7f6394067390 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:21.186 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.176+0000 7f63ba113700 1 --2- 172.21.15.39:0/3986679545 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63b41534a0 0x7f63b41583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:21.186 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.176+0000 7f63ba113700 1 --2- 172.21.15.39:0/3986679545 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63b40b6200 0x7f63b4157cc0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:21.186 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.176+0000 7f63ba113700 1 -- 172.21.15.39:0/3986679545 >> 172.21.15.39:0/3986679545 conn(0x7f63b406bfc0 msgr2=0x7f63b41518d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:21.187 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.176+0000 7f63ba113700 1 -- 172.21.15.39:0/3986679545 shutdown_connections 2023-11-28T11:58:21.187 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.176+0000 7f63ba113700 1 -- 172.21.15.39:0/3986679545 wait complete. 2023-11-28T11:58:21.187 INFO:teuthology.orchestra.run.smithi039.stderr:listed 0 entries 2023-11-28T11:58:21.208 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-28T11:58:21.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:58:21.209 DEBUG:teuthology.orchestra.run.smithi039:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-28T11:58:21.300 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi039.front.sepia.ceph.com 2023-11-28T11:58:21.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:58:21.301 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T11:58:21.317 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:58:21.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.552+0000 7fb588a5a700 1 Processor -- start 2023-11-28T11:58:21.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.552+0000 7fb588a5a700 1 -- start start 2023-11-28T11:58:21.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.556+0000 7fb588a5a700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb58415c650 0x7fb58406b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:21.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.556+0000 7fb588a5a700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb5840cd0d0 0x7fb5840b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:21.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.556+0000 7fb588a5a700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5840c9d40 con 0x7fb5840b1b80 2023-11-28T11:58:21.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.556+0000 7fb588a5a700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb58406b140 con 0x7fb58415c650 2023-11-28T11:58:21.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.556+0000 7fb588a5a700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb58406b820 con 0x7fb5840cd0d0 2023-11-28T11:58:21.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.556+0000 7fb5837fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb58415c650 0x7fb58406b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:21.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.556+0000 7fb5837fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb58415c650 0x7fb58406b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35130/0 (socket says 172.21.15.39:35130) 2023-11-28T11:58:21.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.556+0000 7fb5837fe700 1 -- 172.21.15.39:0/3767408667 learned_addr learned my addr 172.21.15.39:0/3767408667 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:21.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.556+0000 7fb57affd700 1 --2- 172.21.15.39:0/3767408667 >> v2:172.21.15.184:3300/0 conn(0x7fb5840cd0d0 0x7fb5840b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:21.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.556+0000 7fb5837fe700 1 -- 172.21.15.39:0/3767408667 >> v2:172.21.15.184:3300/0 conn(0x7fb5840cd0d0 msgr2=0x7fb5840b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:21.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.556+0000 7fb5837fe700 1 --2- 172.21.15.39:0/3767408667 >> v2:172.21.15.184:3300/0 conn(0x7fb5840cd0d0 0x7fb5840b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:21.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.556+0000 7fb5837fe700 1 -- 172.21.15.39:0/3767408667 >> v1:172.21.15.184:6789/0 conn(0x7fb5840b1b80 legacy=0x7fb58406bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:21.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.556+0000 7fb5837fe700 1 -- 172.21.15.39:0/3767408667 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5840cd5d0 con 0x7fb58415c650 2023-11-28T11:58:21.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.556+0000 7fb57affd700 1 --2- 172.21.15.39:0/3767408667 >> v2:172.21.15.184:3300/0 conn(0x7fb5840cd0d0 0x7fb5840b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:58:21.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.556+0000 7fb5837fe700 1 --2- 172.21.15.39:0/3767408667 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb58415c650 0x7fb58406b2e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb5840cf4d0 tx=0x7fb574009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2add5fee2c153410 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:21.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.560+0000 7fb582ffd700 1 -- 172.21.15.39:0/3767408667 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57400b8a0 con 0x7fb58415c650 2023-11-28T11:58:21.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.560+0000 7fb582ffd700 1 -- 172.21.15.39:0/3767408667 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57400ba00 con 0x7fb58415c650 2023-11-28T11:58:21.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.560+0000 7fb582ffd700 1 -- 172.21.15.39:0/3767408667 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57400bd90 con 0x7fb58415c650 2023-11-28T11:58:21.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.560+0000 7fb588a5a700 1 -- 172.21.15.39:0/3767408667 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb58415c650 msgr2=0x7fb58406b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:21.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.560+0000 7fb588a5a700 1 --2- 172.21.15.39:0/3767408667 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb58415c650 0x7fb58406b2e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb5840cf4d0 tx=0x7fb574009bf0 comp rx=0 tx=0).stop 2023-11-28T11:58:21.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.560+0000 7fb588a5a700 1 -- 172.21.15.39:0/3767408667 shutdown_connections 2023-11-28T11:58:21.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.560+0000 7fb588a5a700 1 --2- 172.21.15.39:0/3767408667 >> v2:172.21.15.184:3300/0 conn(0x7fb5840cd0d0 0x7fb5840b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:21.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.560+0000 7fb588a5a700 1 --2- 172.21.15.39:0/3767408667 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb58415c650 0x7fb58406b2e0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:21.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.560+0000 7fb588a5a700 1 -- 172.21.15.39:0/3767408667 >> 172.21.15.39:0/3767408667 conn(0x7fb5840b0f80 msgr2=0x7fb5840ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:21.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.560+0000 7fb588a5a700 1 -- 172.21.15.39:0/3767408667 shutdown_connections 2023-11-28T11:58:21.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.560+0000 7fb588a5a700 1 -- 172.21.15.39:0/3767408667 wait complete. 2023-11-28T11:58:21.568 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.564+0000 7fb588a5a700 1 Processor -- start 2023-11-28T11:58:21.569 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.564+0000 7fb588a5a700 1 -- start start 2023-11-28T11:58:21.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.564+0000 7fb588a5a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5840b1b80 0x7fb5841e61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:21.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.564+0000 7fb588a5a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5840cd0d0 0x7fb58415b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:21.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.564+0000 7fb588a5a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb58415c650 0x7fb58406a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:21.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.564+0000 7fb588a5a700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5840c6680 con 0x7fb58415c650 2023-11-28T11:58:21.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.564+0000 7fb588a5a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5841e1ad0 con 0x7fb5840cd0d0 2023-11-28T11:58:21.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.564+0000 7fb588a5a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5841e1db0 con 0x7fb5840b1b80 2023-11-28T11:58:21.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.564+0000 7fb583fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb58415c650 0x7fb58406a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:21.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.564+0000 7fb583fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb58415c650 0x7fb58406a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35134/0 (socket says 172.21.15.39:35134) 2023-11-28T11:58:21.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.564+0000 7fb583fff700 1 -- 172.21.15.39:0/261888343 learned_addr learned my addr 172.21.15.39:0/261888343 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:21.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.564+0000 7fb57affd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5840cd0d0 0x7fb58415b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:21.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.568+0000 7fb5837fe700 1 --2- 172.21.15.39:0/261888343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5840b1b80 0x7fb5841e61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:21.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.568+0000 7fb583fff700 1 -- 172.21.15.39:0/261888343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5840b1b80 msgr2=0x7fb5841e61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:21.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.568+0000 7fb583fff700 1 --2- 172.21.15.39:0/261888343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5840b1b80 0x7fb5841e61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:21.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.568+0000 7fb583fff700 1 -- 172.21.15.39:0/261888343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5840cd0d0 msgr2=0x7fb58415b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:21.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.568+0000 7fb583fff700 1 --2- 172.21.15.39:0/261888343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5840cd0d0 0x7fb58415b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:21.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.568+0000 7fb583fff700 1 -- 172.21.15.39:0/261888343 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb574009570 con 0x7fb58415c650 2023-11-28T11:58:21.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.568+0000 7fb583fff700 1 --2- 172.21.15.39:0/261888343 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb58415c650 0x7fb58406a320 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb57c00cb10 tx=0x7fb57c00ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:21.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.568+0000 7fb580ff9700 1 -- 172.21.15.39:0/261888343 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c003c20 con 0x7fb58415c650 2023-11-28T11:58:21.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.568+0000 7fb588a5a700 1 -- 172.21.15.39:0/261888343 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5840c99d0 con 0x7fb58415c650 2023-11-28T11:58:21.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.568+0000 7fb580ff9700 1 -- 172.21.15.39:0/261888343 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57c003d80 con 0x7fb58415c650 2023-11-28T11:58:21.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.568+0000 7fb580ff9700 1 -- 172.21.15.39:0/261888343 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c00a9e0 con 0x7fb58415c650 2023-11-28T11:58:21.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.568+0000 7fb588a5a700 1 -- 172.21.15.39:0/261888343 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5840cd8b0 con 0x7fb58415c650 2023-11-28T11:58:21.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.572+0000 7fb588a5a700 1 -- 172.21.15.39:0/261888343 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5840c9680 con 0x7fb58415c650 2023-11-28T11:58:21.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.572+0000 7fb580ff9700 1 -- 172.21.15.39:0/261888343 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb57c010050 con 0x7fb58415c650 2023-11-28T11:58:21.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.572+0000 7fb580ff9700 1 --2- 172.21.15.39:0/261888343 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb564064ee0 0x7fb564067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:21.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.572+0000 7fb580ff9700 1 -- 172.21.15.39:0/261888343 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb57c081d50 con 0x7fb58415c650 2023-11-28T11:58:21.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.576+0000 7fb5837fe700 1 --2- 172.21.15.39:0/261888343 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb564064ee0 0x7fb564067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:21.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.576+0000 7fb5837fe700 1 --2- 172.21.15.39:0/261888343 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb564064ee0 0x7fb564067390 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb574000c00 tx=0x7fb574008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:21.586 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.580+0000 7fb580ff9700 1 -- 172.21.15.39:0/261888343 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb57c04fd30 con 0x7fb58415c650 2023-11-28T11:58:21.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.800+0000 7fb588a5a700 1 -- 172.21.15.39:0/261888343 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5840c67c0 con 0x7fb58415c650 2023-11-28T11:58:21.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.800+0000 7fb580ff9700 1 -- 172.21.15.39:0/261888343 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4654 (secure 0 0 0) 0x7fb57c053350 con 0x7fb58415c650 2023-11-28T11:58:21.806 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:58:21.806 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/3875562914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3875562914},{"type":"v1","addr":"172.21.15.184:6836","nonce":3875562914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5295,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/4053840838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":4053840838},{"type":"v1","addr":"172.21.15.39:6833","nonce":4053840838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5304,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2819411287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2819411287},{"type":"v1","addr":"172.21.15.39:6835","nonce":2819411287}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:58:03.228365+0000","modified":"2023-11-28T11:58:06.252058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5317},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5317":{"gid":5317,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.184:6837/2775071992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":2775071992},{"type":"v1","addr":"172.21.15.184:6837","nonce":2775071992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T11:58:21.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.800+0000 7fb588a5a700 1 -- 172.21.15.39:0/261888343 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb564064ee0 msgr2=0x7fb564067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:21.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.800+0000 7fb588a5a700 1 --2- 172.21.15.39:0/261888343 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb564064ee0 0x7fb564067390 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb574000c00 tx=0x7fb574008030 comp rx=0 tx=0).stop 2023-11-28T11:58:21.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.800+0000 7fb588a5a700 1 -- 172.21.15.39:0/261888343 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb58415c650 msgr2=0x7fb58406a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:21.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.800+0000 7fb588a5a700 1 --2- 172.21.15.39:0/261888343 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb58415c650 0x7fb58406a320 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb57c00cb10 tx=0x7fb57c00ce20 comp rx=0 tx=0).stop 2023-11-28T11:58:21.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.800+0000 7fb588a5a700 1 -- 172.21.15.39:0/261888343 shutdown_connections 2023-11-28T11:58:21.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.800+0000 7fb588a5a700 1 --2- 172.21.15.39:0/261888343 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb58415c650 0x7fb58406a320 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:21.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.800+0000 7fb588a5a700 1 --2- 172.21.15.39:0/261888343 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb564064ee0 0x7fb564067390 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:21.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.800+0000 7fb588a5a700 1 --2- 172.21.15.39:0/261888343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5840cd0d0 0x7fb58415b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:21.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.800+0000 7fb588a5a700 1 --2- 172.21.15.39:0/261888343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5840b1b80 0x7fb5841e61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:21.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.800+0000 7fb588a5a700 1 -- 172.21.15.39:0/261888343 >> 172.21.15.39:0/261888343 conn(0x7fb5840b0f80 msgr2=0x7fb5840abf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:21.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.800+0000 7fb588a5a700 1 -- 172.21.15.39:0/261888343 shutdown_connections 2023-11-28T11:58:21.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:21.800+0000 7fb588a5a700 1 -- 172.21.15.39:0/261888343 wait complete. 2023-11-28T11:58:21.811 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 16 2023-11-28T11:58:21.831 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2023-11-28T11:58:22.949 INFO:teuthology.orchestra.run.smithi184.stdout:{"message":"","return_code":0} 2023-11-28T11:58:22.950 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-11-28T11:58:22.960 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:58:23.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.144+0000 7f44b5eb1700 1 Processor -- start 2023-11-28T11:58:23.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.144+0000 7f44b5eb1700 1 -- start start 2023-11-28T11:58:23.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.144+0000 7f44b5eb1700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f44b015c640 0x7f44b00d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:23.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.144+0000 7f44b5eb1700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f44b0071aa0 0x7f44b006d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:23.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.144+0000 7f44b5eb1700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44b006c600 con 0x7f44b0069e00 2023-11-28T11:58:23.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.144+0000 7f44b5eb1700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b006cef0 con 0x7f44b0071aa0 2023-11-28T11:58:23.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.144+0000 7f44b5eb1700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b00722f0 con 0x7f44b015c640 2023-11-28T11:58:23.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.144+0000 7f44b56b0700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f44b0069e00 0x7f44b00d0580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:49342/0 (socket says 172.21.15.39:49342) 2023-11-28T11:58:23.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.144+0000 7f44b56b0700 1 -- 172.21.15.39:0/3915752748 learned_addr learned my addr 172.21.15.39:0/3915752748 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:58:23.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.144+0000 7f44a7fff700 1 --2- 172.21.15.39:0/3915752748 >> v2:172.21.15.39:3300/0 conn(0x7f44b0071aa0 0x7f44b006d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:23.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.144+0000 7f44b4eaf700 1 --2- 172.21.15.39:0/3915752748 >> v2:172.21.15.184:3300/0 conn(0x7f44b015c640 0x7f44b00d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:23.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.144+0000 7f44a7fff700 1 -- 172.21.15.39:0/3915752748 >> v2:172.21.15.184:3300/0 conn(0x7f44b015c640 msgr2=0x7f44b00d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:23.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.144+0000 7f44a7fff700 1 --2- 172.21.15.39:0/3915752748 >> v2:172.21.15.184:3300/0 conn(0x7f44b015c640 0x7f44b00d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:23.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.144+0000 7f44a7fff700 1 -- 172.21.15.39:0/3915752748 >> v1:172.21.15.39:6789/0 conn(0x7f44b0069e00 legacy=0x7f44b00d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:23.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.144+0000 7f44a7fff700 1 -- 172.21.15.39:0/3915752748 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b015ca10 con 0x7f44b0071aa0 2023-11-28T11:58:23.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.144+0000 7f44a7fff700 1 --2- 172.21.15.39:0/3915752748 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44b0071aa0 0x7f44b006d310 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f44b006e290 tx=0x7f44a0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40a60ac0a780e60e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:23.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.148+0000 7f44a77fe700 1 -- 172.21.15.39:0/3915752748 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a0011830 con 0x7f44b0071aa0 2023-11-28T11:58:23.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.148+0000 7f44a77fe700 1 -- 172.21.15.39:0/3915752748 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a0011990 con 0x7f44b0071aa0 2023-11-28T11:58:23.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.148+0000 7f44a77fe700 1 -- 172.21.15.39:0/3915752748 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a0011d20 con 0x7f44b0071aa0 2023-11-28T11:58:23.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.148+0000 7f44b5eb1700 1 -- 172.21.15.39:0/3915752748 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44b0071aa0 msgr2=0x7f44b006d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:23.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.148+0000 7f44b5eb1700 1 --2- 172.21.15.39:0/3915752748 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44b0071aa0 0x7f44b006d310 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f44b006e290 tx=0x7f44a0009b30 comp rx=0 tx=0).stop 2023-11-28T11:58:23.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.148+0000 7f44b5eb1700 1 -- 172.21.15.39:0/3915752748 shutdown_connections 2023-11-28T11:58:23.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.148+0000 7f44b5eb1700 1 --2- 172.21.15.39:0/3915752748 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44b0071aa0 0x7f44b006d310 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:23.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.148+0000 7f44b5eb1700 1 --2- 172.21.15.39:0/3915752748 >> v2:172.21.15.184:3300/0 conn(0x7f44b015c640 0x7f44b00d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:23.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.148+0000 7f44b5eb1700 1 -- 172.21.15.39:0/3915752748 >> 172.21.15.39:0/3915752748 conn(0x7f44b00b6520 msgr2=0x7f44b0071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:23.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.148+0000 7f44b5eb1700 1 -- 172.21.15.39:0/3915752748 shutdown_connections 2023-11-28T11:58:23.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.148+0000 7f44b5eb1700 1 -- 172.21.15.39:0/3915752748 wait complete. 2023-11-28T11:58:23.158 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.148+0000 7f44b5eb1700 1 Processor -- start 2023-11-28T11:58:23.158 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.148+0000 7f44b5eb1700 1 -- start start 2023-11-28T11:58:23.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.152+0000 7f44b5eb1700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44b0069e00 0x7f44b01f1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:23.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.152+0000 7f44b5eb1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44b0071aa0 0x7f44b00b05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:23.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.152+0000 7f44b5eb1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44b015c640 0x7f44b00b0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:23.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.152+0000 7f44b5eb1700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b00cdb00 con 0x7f44b0069e00 2023-11-28T11:58:23.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.152+0000 7f44b5eb1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b00cc940 con 0x7f44b0071aa0 2023-11-28T11:58:23.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.152+0000 7f44b5eb1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b00cbd30 con 0x7f44b015c640 2023-11-28T11:58:23.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.152+0000 7f44b4eaf700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44b0069e00 0x7f44b01f1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:23.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.152+0000 7f44b4eaf700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44b0069e00 0x7f44b01f1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35156/0 (socket says 172.21.15.39:35156) 2023-11-28T11:58:23.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.152+0000 7f44b4eaf700 1 -- 172.21.15.39:0/3183276680 learned_addr learned my addr 172.21.15.39:0/3183276680 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:23.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.152+0000 7f44a7fff700 1 --2- 172.21.15.39:0/3183276680 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44b0071aa0 0x7f44b00b05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:23.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.152+0000 7f44b56b0700 1 --2- 172.21.15.39:0/3183276680 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44b015c640 0x7f44b00b0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:23.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.152+0000 7f44b4eaf700 1 -- 172.21.15.39:0/3183276680 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44b015c640 msgr2=0x7f44b00b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:23.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.152+0000 7f44b4eaf700 1 --2- 172.21.15.39:0/3183276680 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44b015c640 0x7f44b00b0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:23.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.152+0000 7f44b4eaf700 1 -- 172.21.15.39:0/3183276680 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44b0071aa0 msgr2=0x7f44b00b05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:23.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.152+0000 7f44b4eaf700 1 --2- 172.21.15.39:0/3183276680 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44b0071aa0 0x7f44b00b05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:23.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.152+0000 7f44b4eaf700 1 -- 172.21.15.39:0/3183276680 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a00094b0 con 0x7f44b0069e00 2023-11-28T11:58:23.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.152+0000 7f44b4eaf700 1 --2- 172.21.15.39:0/3183276680 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44b0069e00 0x7f44b01f1640 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f44ac00efc0 tx=0x7f44ac00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:23.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.152+0000 7f44a57fa700 1 -- 172.21.15.39:0/3183276680 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac00cdc0 con 0x7f44b0069e00 2023-11-28T11:58:23.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.152+0000 7f44a57fa700 1 -- 172.21.15.39:0/3183276680 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ac00f040 con 0x7f44b0069e00 2023-11-28T11:58:23.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.152+0000 7f44b5eb1700 1 -- 172.21.15.39:0/3183276680 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b006c830 con 0x7f44b0069e00 2023-11-28T11:58:23.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.152+0000 7f44a57fa700 1 -- 172.21.15.39:0/3183276680 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac0146a0 con 0x7f44b0069e00 2023-11-28T11:58:23.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.156+0000 7f44b5eb1700 1 -- 172.21.15.39:0/3183276680 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b0072010 con 0x7f44b0069e00 2023-11-28T11:58:23.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.156+0000 7f44b5eb1700 1 -- 172.21.15.39:0/3183276680 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b006cb10 con 0x7f44b0069e00 2023-11-28T11:58:23.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.156+0000 7f44a57fa700 1 -- 172.21.15.39:0/3183276680 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f44ac014800 con 0x7f44b0069e00 2023-11-28T11:58:23.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.160+0000 7f44a57fa700 1 --2- 172.21.15.39:0/3183276680 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f449c064ee0 0x7f449c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:23.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.160+0000 7f44a57fa700 1 -- 172.21.15.39:0/3183276680 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f44ac082de0 con 0x7f44b0069e00 2023-11-28T11:58:23.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.160+0000 7f44a7fff700 1 --2- 172.21.15.39:0/3183276680 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f449c064ee0 0x7f449c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:23.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.160+0000 7f44a7fff700 1 --2- 172.21.15.39:0/3183276680 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f449c064ee0 0x7f449c067390 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f44a0009fd0 tx=0x7f44a0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:23.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.164+0000 7f44a57fa700 1 -- 172.21.15.39:0/3183276680 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f44ac050d10 con 0x7f44b0069e00 2023-11-28T11:58:23.379 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.371+0000 7f44b5eb1700 1 -- 172.21.15.39:0/3183276680 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f44b0073cb0 con 0x7f44b0069e00 2023-11-28T11:58:23.380 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.371+0000 7f44a57fa700 1 -- 172.21.15.39:0/3183276680 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4654 (secure 0 0 0) 0x7f44ac054330 con 0x7f44b0069e00 2023-11-28T11:58:23.380 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:58:23.380 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/3875562914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3875562914},{"type":"v1","addr":"172.21.15.184:6836","nonce":3875562914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5295,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/4053840838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":4053840838},{"type":"v1","addr":"172.21.15.39:6833","nonce":4053840838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5304,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2819411287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2819411287},{"type":"v1","addr":"172.21.15.39:6835","nonce":2819411287}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:58:03.228365+0000","modified":"2023-11-28T11:58:06.252058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5317},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5317":{"gid":5317,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.184:6837/2775071992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":2775071992},{"type":"v1","addr":"172.21.15.184:6837","nonce":2775071992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T11:58:23.383 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.375+0000 7f44b5eb1700 1 -- 172.21.15.39:0/3183276680 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f449c064ee0 msgr2=0x7f449c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:23.383 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.375+0000 7f44b5eb1700 1 --2- 172.21.15.39:0/3183276680 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f449c064ee0 0x7f449c067390 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f44a0009fd0 tx=0x7f44a0008030 comp rx=0 tx=0).stop 2023-11-28T11:58:23.383 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.375+0000 7f44b5eb1700 1 -- 172.21.15.39:0/3183276680 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44b0069e00 msgr2=0x7f44b01f1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:23.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.375+0000 7f44b5eb1700 1 --2- 172.21.15.39:0/3183276680 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44b0069e00 0x7f44b01f1640 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f44ac00efc0 tx=0x7f44ac00c3a0 comp rx=0 tx=0).stop 2023-11-28T11:58:23.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.375+0000 7f44b5eb1700 1 -- 172.21.15.39:0/3183276680 shutdown_connections 2023-11-28T11:58:23.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.375+0000 7f44b5eb1700 1 --2- 172.21.15.39:0/3183276680 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44b015c640 0x7f44b00b0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:23.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.375+0000 7f44b5eb1700 1 --2- 172.21.15.39:0/3183276680 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f449c064ee0 0x7f449c067390 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:23.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.375+0000 7f44b5eb1700 1 --2- 172.21.15.39:0/3183276680 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44b0071aa0 0x7f44b00b05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:23.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.375+0000 7f44b5eb1700 1 --2- 172.21.15.39:0/3183276680 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44b0069e00 0x7f44b01f1640 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:23.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.375+0000 7f44b5eb1700 1 -- 172.21.15.39:0/3183276680 >> 172.21.15.39:0/3183276680 conn(0x7f44b00b6520 msgr2=0x7f44b00b3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:23.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.375+0000 7f44b5eb1700 1 -- 172.21.15.39:0/3183276680 shutdown_connections 2023-11-28T11:58:23.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:23.375+0000 7f44b5eb1700 1 -- 172.21.15.39:0/3183276680 wait complete. 2023-11-28T11:58:23.386 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 16 2023-11-28T11:58:23.405 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json tag path /parentdir mytag 2023-11-28T11:58:23.593 INFO:teuthology.orchestra.run.smithi184.stdout:{"return_code":0,"scrub_tag":"mytag","mode":"asynchronous"} 2023-11-28T11:58:23.594 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mode": "asynchronous", "return_code": 0, "scrub_tag": "mytag" } 2023-11-28T11:58:29.970 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:58:29.978 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:58:33.594 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000000.00000000 scrub_tag 2023-11-28T11:58:33.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.667+0000 7f90ce6c1140 1 Processor -- start 2023-11-28T11:58:33.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.667+0000 7f90ce6c1140 1 -- start start 2023-11-28T11:58:33.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.667+0000 7f90ce6c1140 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x561fad172700 0x561fad2338c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:33.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.667+0000 7f90ce6c1140 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561fad1a5980 0x561fad238340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:33.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.667+0000 7f90ce6c1140 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561fad230f40 0x561fad1c0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:33.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.667+0000 7f90ce6c1140 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fad107180 con 0x561fad1a5980 2023-11-28T11:58:33.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.667+0000 7f90ce6c1140 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fad09a240 con 0x561fad230f40 2023-11-28T11:58:33.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.667+0000 7f90ce6c1140 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x561fad234270 con 0x561fad172700 2023-11-28T11:58:33.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.667+0000 7f90cb9f5700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561fad1a5980 0x561fad238340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:33.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.667+0000 7f90cb9f5700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561fad1a5980 0x561fad238340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47814/0 (socket says 172.21.15.39:47814) 2023-11-28T11:58:33.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.667+0000 7f90cb9f5700 1 -- 172.21.15.39:0/539194788 learned_addr learned my addr 172.21.15.39:0/539194788 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:33.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.667+0000 7f90cc1f6700 1 --2- 172.21.15.39:0/539194788 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x561fad172700 0x561fad2338c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:33.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.667+0000 7f90cc9f7700 1 --2- 172.21.15.39:0/539194788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561fad230f40 0x561fad1c0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:33.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.671+0000 7f90cb9f5700 1 -- 172.21.15.39:0/539194788 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x561fad172700 msgr2=0x561fad2338c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:33.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.671+0000 7f90cb9f5700 1 --2- 172.21.15.39:0/539194788 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x561fad172700 0x561fad2338c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.671+0000 7f90cb9f5700 1 -- 172.21.15.39:0/539194788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561fad230f40 msgr2=0x561fad1c0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:33.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.671+0000 7f90cb9f5700 1 --2- 172.21.15.39:0/539194788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561fad230f40 0x561fad1c0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.671+0000 7f90cb9f5700 1 -- 172.21.15.39:0/539194788 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90bc005d20 con 0x561fad1a5980 2023-11-28T11:58:33.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.671+0000 7f90cc9f7700 1 --2- 172.21.15.39:0/539194788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561fad230f40 0x561fad1c0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:58:33.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.671+0000 7f90cb9f5700 1 --2- 172.21.15.39:0/539194788 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561fad1a5980 0x561fad238340 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f90b4001e00 tx=0x7f90b400b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=165eda9981481578 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:33.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.671+0000 7f90ca9f3700 1 -- 172.21.15.39:0/539194788 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b4014070 con 0x561fad1a5980 2023-11-28T11:58:33.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.671+0000 7f90ca9f3700 1 -- 172.21.15.39:0/539194788 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b4001e90 con 0x561fad1a5980 2023-11-28T11:58:33.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.671+0000 7f90ca9f3700 1 -- 172.21.15.39:0/539194788 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b400bd60 con 0x561fad1a5980 2023-11-28T11:58:33.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.671+0000 7f90ce6c1140 1 -- 172.21.15.39:0/539194788 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561fad1a5980 msgr2=0x561fad238340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:33.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.671+0000 7f90ce6c1140 1 --2- 172.21.15.39:0/539194788 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561fad1a5980 0x561fad238340 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f90b4001e00 tx=0x7f90b400b4c0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.671+0000 7f90ce6c1140 1 -- 172.21.15.39:0/539194788 shutdown_connections 2023-11-28T11:58:33.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.671+0000 7f90ce6c1140 1 --2- 172.21.15.39:0/539194788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561fad230f40 0x561fad1c0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.671+0000 7f90ce6c1140 1 --2- 172.21.15.39:0/539194788 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561fad1a5980 0x561fad238340 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.671+0000 7f90ce6c1140 1 --2- 172.21.15.39:0/539194788 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x561fad172700 0x561fad2338c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.671+0000 7f90ce6c1140 1 -- 172.21.15.39:0/539194788 >> 172.21.15.39:0/539194788 conn(0x561fad178c30 msgr2=0x561fad24d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:33.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.671+0000 7f90ce6c1140 1 -- 172.21.15.39:0/539194788 shutdown_connections 2023-11-28T11:58:33.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.671+0000 7f90ce6c1140 1 -- 172.21.15.39:0/539194788 wait complete. 2023-11-28T11:58:33.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.671+0000 7f90ce6c1140 1 Processor -- start 2023-11-28T11:58:33.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.675+0000 7f90ce6c1140 1 -- start start 2023-11-28T11:58:33.679 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.675+0000 7f90ce6c1140 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561fad172700 0x561fad179260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:33.679 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.675+0000 7f90ce6c1140 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x561fad1a5980 0x561fad22f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:33.679 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.675+0000 7f90ce6c1140 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561fad230f40 0x561fad175850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:33.679 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.675+0000 7f90ce6c1140 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fad199740 con 0x561fad172700 2023-11-28T11:58:33.679 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.675+0000 7f90ce6c1140 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fad22e6e0 con 0x561fad230f40 2023-11-28T11:58:33.679 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.675+0000 7f90ce6c1140 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x561fad22e980 con 0x561fad1a5980 2023-11-28T11:58:33.679 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.675+0000 7f90cc1f6700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561fad172700 0x561fad179260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:33.679 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.675+0000 7f90cc1f6700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561fad172700 0x561fad179260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47824/0 (socket says 172.21.15.39:47824) 2023-11-28T11:58:33.679 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.675+0000 7f90cc1f6700 1 -- 172.21.15.39:0/2054217188 learned_addr learned my addr 172.21.15.39:0/2054217188 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:33.679 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.675+0000 7f90cc9f7700 1 --2- 172.21.15.39:0/2054217188 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561fad230f40 0x561fad175850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:33.679 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.675+0000 7f90cb9f5700 1 --2- 172.21.15.39:0/2054217188 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x561fad1a5980 0x561fad22f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:33.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.675+0000 7f90cc9f7700 1 -- 172.21.15.39:0/2054217188 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x561fad1a5980 msgr2=0x561fad22f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:33.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.675+0000 7f90cc9f7700 1 --2- 172.21.15.39:0/2054217188 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x561fad1a5980 0x561fad22f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.675+0000 7f90cc9f7700 1 -- 172.21.15.39:0/2054217188 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561fad172700 msgr2=0x561fad179260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:33.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.675+0000 7f90cc9f7700 1 --2- 172.21.15.39:0/2054217188 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561fad172700 0x561fad179260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.675+0000 7f90cc9f7700 1 -- 172.21.15.39:0/2054217188 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b400a040 con 0x561fad230f40 2023-11-28T11:58:33.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.675+0000 7f90cc1f6700 1 --2- 172.21.15.39:0/2054217188 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561fad172700 0x561fad179260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:58:33.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.675+0000 7f90cc9f7700 1 --2- 172.21.15.39:0/2054217188 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561fad230f40 0x561fad175850 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f90c4004d40 tx=0x7f90c40016e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:33.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.679+0000 7f90c99f1700 1 -- 172.21.15.39:0/2054217188 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c4004e90 con 0x561fad230f40 2023-11-28T11:58:33.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.679+0000 7f90c99f1700 1 -- 172.21.15.39:0/2054217188 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c4001e50 con 0x561fad230f40 2023-11-28T11:58:33.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.679+0000 7f90ce6c1140 1 -- 172.21.15.39:0/2054217188 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561fad0a58b0 con 0x561fad230f40 2023-11-28T11:58:33.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.679+0000 7f90c99f1700 1 -- 172.21.15.39:0/2054217188 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c4013480 con 0x561fad230f40 2023-11-28T11:58:33.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.679+0000 7f90ce6c1140 1 -- 172.21.15.39:0/2054217188 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561fad0b25d0 con 0x561fad230f40 2023-11-28T11:58:33.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.683+0000 7f90c99f1700 1 -- 172.21.15.39:0/2054217188 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f90c401a030 con 0x561fad230f40 2023-11-28T11:58:33.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.683+0000 7f90c99f1700 1 --2- 172.21.15.39:0/2054217188 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f90ac063810 0x7f90ac065cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:33.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.683+0000 7f90c99f1700 1 -- 172.21.15.39:0/2054217188 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f90c4080240 con 0x561fad230f40 2023-11-28T11:58:33.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.683+0000 7f90ce6c1140 1 --2- 172.21.15.39:0/2054217188 >> [v2:172.21.15.39:6800/36179,v1:172.21.15.39:6801/36179] conn(0x561fad1797a0 0x561fad22d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:33.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.683+0000 7f90cc1f6700 1 --2- 172.21.15.39:0/2054217188 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f90ac063810 0x7f90ac065cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:33.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.683+0000 7f90ce6c1140 1 -- 172.21.15.39:0/2054217188 --> [v2:172.21.15.39:6800/36179,v1:172.21.15.39:6801/36179] -- osd_op(unknown.0.0:1 6.10 6:0cf6ad0f:::10000000000.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x561fad22fee0 con 0x561fad1797a0 2023-11-28T11:58:33.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.683+0000 7f90cb9f5700 1 --2- 172.21.15.39:0/2054217188 >> [v2:172.21.15.39:6800/36179,v1:172.21.15.39:6801/36179] conn(0x561fad1797a0 0x561fad22d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:33.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.683+0000 7f90cc1f6700 1 --2- 172.21.15.39:0/2054217188 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f90ac063810 0x7f90ac065cc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f90bc000c00 tx=0x7f90bc00f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:33.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.683+0000 7f90cb9f5700 1 --2- 172.21.15.39:0/2054217188 >> [v2:172.21.15.39:6800/36179,v1:172.21.15.39:6801/36179] conn(0x561fad1797a0 0x561fad22d920 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:33.690 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.687+0000 7f90cb9f5700 1 -- 172.21.15.39:0/2054217188 <== osd.0 v2:172.21.15.39:6800/36179 1 ==== osd_op_reply(1 10000000000.00000000 [getxattr (9) out=9b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7f90b4016070 con 0x561fad1797a0 2023-11-28T11:58:33.690 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.687+0000 7f90ce6c1140 1 -- 172.21.15.39:0/2054217188 >> [v2:172.21.15.39:6800/36179,v1:172.21.15.39:6801/36179] conn(0x561fad1797a0 msgr2=0x561fad22d920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:33.690 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.687+0000 7f90ce6c1140 1 --2- 172.21.15.39:0/2054217188 >> [v2:172.21.15.39:6800/36179,v1:172.21.15.39:6801/36179] conn(0x561fad1797a0 0x561fad22d920 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.691 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.687+0000 7f90ce6c1140 1 -- 172.21.15.39:0/2054217188 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f90ac063810 msgr2=0x7f90ac065cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:33.691 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.687+0000 7f90ce6c1140 1 --2- 172.21.15.39:0/2054217188 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f90ac063810 0x7f90ac065cc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f90bc000c00 tx=0x7f90bc00f000 comp rx=0 tx=0).stop 2023-11-28T11:58:33.691 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.687+0000 7f90ce6c1140 1 -- 172.21.15.39:0/2054217188 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561fad230f40 msgr2=0x561fad175850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:33.691 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.687+0000 7f90ce6c1140 1 --2- 172.21.15.39:0/2054217188 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561fad230f40 0x561fad175850 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f90c4004d40 tx=0x7f90c40016e0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.691 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.687+0000 7f90cc9f7700 1 -- 172.21.15.39:0/2054217188 reap_dead start 2023-11-28T11:58:33.691 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.687+0000 7f90ce6c1140 1 -- 172.21.15.39:0/2054217188 shutdown_connections 2023-11-28T11:58:33.691 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.687+0000 7f90ce6c1140 1 -- 172.21.15.39:0/2054217188 >> 172.21.15.39:0/2054217188 conn(0x561fad178c30 msgr2=0x561fad237900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:33.691 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.687+0000 7f90ce6c1140 1 -- 172.21.15.39:0/2054217188 shutdown_connections 2023-11-28T11:58:33.691 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.687+0000 7f90ce6c1140 1 -- 172.21.15.39:0/2054217188 wait complete. 2023-11-28T11:58:33.698 INFO:teuthology.orchestra.run.smithi039.stdout:mytag 2023-11-28T11:58:33.698 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000001.00000000 scrub_tag 2023-11-28T11:58:33.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.767+0000 7f87a2340140 1 Processor -- start 2023-11-28T11:58:33.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.767+0000 7f87a2340140 1 -- start start 2023-11-28T11:58:33.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.767+0000 7f87a2340140 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559547886700 0x5595478b3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:33.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.767+0000 7f87a2340140 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595478b9980 0x5595478d4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:33.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.767+0000 7f87a2340140 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559547960890 0x5595478aeb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:33.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.767+0000 7f87a2340140 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55954781b180 con 0x559547886700 2023-11-28T11:58:33.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.767+0000 7f87a2340140 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595477ae240 con 0x5595478b9980 2023-11-28T11:58:33.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.767+0000 7f87a2340140 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x5595478b4830 con 0x559547960890 2023-11-28T11:58:33.771 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.767+0000 7f879fe75700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559547886700 0x5595478b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:33.771 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.767+0000 7f879fe75700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559547886700 0x5595478b3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47828/0 (socket says 172.21.15.39:47828) 2023-11-28T11:58:33.771 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.767+0000 7f879fe75700 1 -- 172.21.15.39:0/1801574418 learned_addr learned my addr 172.21.15.39:0/1801574418 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:33.771 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.767+0000 7f87a0676700 1 --2- 172.21.15.39:0/1801574418 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559547960890 0x5595478aeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:33.771 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.767+0000 7f8797674700 1 --2- 172.21.15.39:0/1801574418 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595478b9980 0x5595478d4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:33.772 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.767+0000 7f879fe75700 1 -- 172.21.15.39:0/1801574418 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559547960890 msgr2=0x5595478aeb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:33.772 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.767+0000 7f879fe75700 1 --2- 172.21.15.39:0/1801574418 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559547960890 0x5595478aeb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.772 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.767+0000 7f879fe75700 1 -- 172.21.15.39:0/1801574418 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595478b9980 msgr2=0x5595478d4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:33.772 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.767+0000 7f879fe75700 1 --2- 172.21.15.39:0/1801574418 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595478b9980 0x5595478d4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.772 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.767+0000 7f879fe75700 1 -- 172.21.15.39:0/1801574418 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878800a100 con 0x559547886700 2023-11-28T11:58:33.772 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.767+0000 7f879fe75700 1 --2- 172.21.15.39:0/1801574418 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559547886700 0x5595478b3790 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8790001de0 tx=0x7f879000b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26764f19a8b066d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:33.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.771+0000 7f879ee73700 1 -- 172.21.15.39:0/1801574418 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8790014070 con 0x559547886700 2023-11-28T11:58:33.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.771+0000 7f879ee73700 1 -- 172.21.15.39:0/1801574418 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8790008030 con 0x559547886700 2023-11-28T11:58:33.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.771+0000 7f879ee73700 1 -- 172.21.15.39:0/1801574418 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879000bd40 con 0x559547886700 2023-11-28T11:58:33.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.771+0000 7f87a2340140 1 -- 172.21.15.39:0/1801574418 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559547886700 msgr2=0x5595478b3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:33.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.771+0000 7f87a2340140 1 --2- 172.21.15.39:0/1801574418 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559547886700 0x5595478b3790 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8790001de0 tx=0x7f879000b4c0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.771+0000 7f87a2340140 1 -- 172.21.15.39:0/1801574418 shutdown_connections 2023-11-28T11:58:33.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.771+0000 7f87a2340140 1 --2- 172.21.15.39:0/1801574418 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559547960890 0x5595478aeb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.771+0000 7f87a2340140 1 --2- 172.21.15.39:0/1801574418 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595478b9980 0x5595478d4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.771+0000 7f87a2340140 1 --2- 172.21.15.39:0/1801574418 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559547886700 0x5595478b3790 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.771+0000 7f87a2340140 1 -- 172.21.15.39:0/1801574418 >> 172.21.15.39:0/1801574418 conn(0x55954788cc30 msgr2=0x5595479614b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:33.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.771+0000 7f87a2340140 1 -- 172.21.15.39:0/1801574418 shutdown_connections 2023-11-28T11:58:33.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.771+0000 7f87a2340140 1 -- 172.21.15.39:0/1801574418 wait complete. 2023-11-28T11:58:33.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.771+0000 7f87a2340140 1 Processor -- start 2023-11-28T11:58:33.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.771+0000 7f87a2340140 1 -- start start 2023-11-28T11:58:33.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.775+0000 7f87a2340140 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559547886700 0x559547943d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:33.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.775+0000 7f87a2340140 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595478b9980 0x55954788d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:33.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.775+0000 7f87a2340140 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559547960890 0x55954788d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:33.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.775+0000 7f87a2340140 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595479f40d0 con 0x559547960890 2023-11-28T11:58:33.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.775+0000 7f87a2340140 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595478cbda0 con 0x5595478b9980 2023-11-28T11:58:33.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.775+0000 7f87a2340140 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x5595478cc040 con 0x559547886700 2023-11-28T11:58:33.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.775+0000 7f87a0676700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559547960890 0x55954788d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:33.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.775+0000 7f87a0676700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559547960890 0x55954788d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47844/0 (socket says 172.21.15.39:47844) 2023-11-28T11:58:33.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.775+0000 7f87a0676700 1 -- 172.21.15.39:0/605552201 learned_addr learned my addr 172.21.15.39:0/605552201 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:33.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.775+0000 7f879fe75700 1 --2- 172.21.15.39:0/605552201 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559547886700 0x559547943d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:33.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.775+0000 7f8797674700 1 --2- 172.21.15.39:0/605552201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595478b9980 0x55954788d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:33.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.775+0000 7f87a0676700 1 -- 172.21.15.39:0/605552201 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559547886700 msgr2=0x559547943d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:33.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.775+0000 7f87a0676700 1 --2- 172.21.15.39:0/605552201 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559547886700 0x559547943d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.775+0000 7f87a0676700 1 -- 172.21.15.39:0/605552201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595478b9980 msgr2=0x55954788d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:33.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.775+0000 7f87a0676700 1 --2- 172.21.15.39:0/605552201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595478b9980 0x55954788d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.775+0000 7f87a0676700 1 -- 172.21.15.39:0/605552201 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f879000a040 con 0x559547960890 2023-11-28T11:58:33.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.775+0000 7f87a0676700 1 --2- 172.21.15.39:0/605552201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559547960890 0x55954788d540 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8798001e60 tx=0x7f8798001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:33.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.775+0000 7f879de71700 1 -- 172.21.15.39:0/605552201 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8798001aa0 con 0x559547960890 2023-11-28T11:58:33.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.775+0000 7f879de71700 1 -- 172.21.15.39:0/605552201 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8798005030 con 0x559547960890 2023-11-28T11:58:33.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.775+0000 7f87a2340140 1 -- 172.21.15.39:0/605552201 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5595477b98b0 con 0x559547960890 2023-11-28T11:58:33.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.775+0000 7f879de71700 1 -- 172.21.15.39:0/605552201 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879800f690 con 0x559547960890 2023-11-28T11:58:33.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.775+0000 7f87a2340140 1 -- 172.21.15.39:0/605552201 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5595477c65d0 con 0x559547960890 2023-11-28T11:58:33.782 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.779+0000 7f879de71700 1 -- 172.21.15.39:0/605552201 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f879801f070 con 0x559547960890 2023-11-28T11:58:33.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.779+0000 7f879de71700 1 --2- 172.21.15.39:0/605552201 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8780063840 0x7f8780065cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:33.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.779+0000 7f879de71700 1 -- 172.21.15.39:0/605552201 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f87980810d0 con 0x559547960890 2023-11-28T11:58:33.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.783+0000 7f87a2340140 1 --2- 172.21.15.39:0/605552201 >> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] conn(0x5595479f47a0 0x5595479f4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:33.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.783+0000 7f879fe75700 1 --2- 172.21.15.39:0/605552201 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8780063840 0x7f8780065cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:33.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.783+0000 7f87a2340140 1 -- 172.21.15.39:0/605552201 --> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] -- osd_op(unknown.0.0:1 6.7 6:e2e07930:::10000000001.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x5595479f50e0 con 0x5595479f47a0 2023-11-28T11:58:33.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.783+0000 7f8797674700 1 --2- 172.21.15.39:0/605552201 >> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] conn(0x5595479f47a0 0x5595479f4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:33.785 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.783+0000 7f879fe75700 1 --2- 172.21.15.39:0/605552201 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8780063840 0x7f8780065cf0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f879000b500 tx=0x7f8790009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:33.786 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.783+0000 7f8797674700 1 --2- 172.21.15.39:0/605552201 >> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] conn(0x5595479f47a0 0x5595479f4ba0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:33.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.783+0000 7f8797674700 1 -- 172.21.15.39:0/605552201 <== osd.5 v2:172.21.15.184:6808/36505 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (9) out=9b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7f878800f590 con 0x5595479f47a0 2023-11-28T11:58:33.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.783+0000 7f87a2340140 1 -- 172.21.15.39:0/605552201 >> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] conn(0x5595479f47a0 msgr2=0x5595479f4ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:33.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.783+0000 7f87a2340140 1 --2- 172.21.15.39:0/605552201 >> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] conn(0x5595479f47a0 0x5595479f4ba0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.783+0000 7f87a2340140 1 -- 172.21.15.39:0/605552201 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8780063840 msgr2=0x7f8780065cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:33.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.783+0000 7f87a2340140 1 --2- 172.21.15.39:0/605552201 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8780063840 0x7f8780065cf0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f879000b500 tx=0x7f8790009000 comp rx=0 tx=0).stop 2023-11-28T11:58:33.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.783+0000 7f87a2340140 1 -- 172.21.15.39:0/605552201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559547960890 msgr2=0x55954788d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:33.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.783+0000 7f87a2340140 1 --2- 172.21.15.39:0/605552201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559547960890 0x55954788d540 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8798001e60 tx=0x7f8798001e90 comp rx=0 tx=0).stop 2023-11-28T11:58:33.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.783+0000 7f87a0676700 1 -- 172.21.15.39:0/605552201 reap_dead start 2023-11-28T11:58:33.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.783+0000 7f87a2340140 1 -- 172.21.15.39:0/605552201 shutdown_connections 2023-11-28T11:58:33.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.783+0000 7f87a2340140 1 -- 172.21.15.39:0/605552201 >> 172.21.15.39:0/605552201 conn(0x55954788cc30 msgr2=0x55954795fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:33.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.783+0000 7f87a2340140 1 -- 172.21.15.39:0/605552201 shutdown_connections 2023-11-28T11:58:33.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.783+0000 7f87a2340140 1 -- 172.21.15.39:0/605552201 wait complete. 2023-11-28T11:58:33.796 INFO:teuthology.orchestra.run.smithi039.stdout:mytag 2023-11-28T11:58:33.796 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f7.00000000 scrub_tag 2023-11-28T11:58:33.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.867+0000 7fb75d160140 1 Processor -- start 2023-11-28T11:58:33.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.867+0000 7fb75d160140 1 -- start start 2023-11-28T11:58:33.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.867+0000 7fb75d160140 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x564d051a7700 0x564d051ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:33.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.867+0000 7fb75d160140 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564d051da980 0x564d052685d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:33.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.867+0000 7fb75d160140 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564d05265f40 0x564d0526b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:33.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.867+0000 7fb75d160140 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d0513c180 con 0x564d05265f40 2023-11-28T11:58:33.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.867+0000 7fb75d160140 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d050cf240 con 0x564d051da980 2023-11-28T11:58:33.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.867+0000 7fb75d160140 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x564d0526d590 con 0x564d051a7700 2023-11-28T11:58:33.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.867+0000 7fb75b496700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564d05265f40 0x564d0526b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:33.873 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.867+0000 7fb75b496700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564d05265f40 0x564d0526b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47856/0 (socket says 172.21.15.39:47856) 2023-11-28T11:58:33.873 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.867+0000 7fb75b496700 1 -- 172.21.15.39:0/3797327825 learned_addr learned my addr 172.21.15.39:0/3797327825 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:33.873 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.867+0000 7fb75a494700 1 --2- 172.21.15.39:0/3797327825 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564d051da980 0x564d052685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:33.873 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.867+0000 7fb75ac95700 1 --2- 172.21.15.39:0/3797327825 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x564d051a7700 0x564d051ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:33.873 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.871+0000 7fb75b496700 1 -- 172.21.15.39:0/3797327825 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x564d051a7700 msgr2=0x564d051ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:33.873 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.871+0000 7fb75b496700 1 --2- 172.21.15.39:0/3797327825 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x564d051a7700 0x564d051ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.873 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.871+0000 7fb75b496700 1 -- 172.21.15.39:0/3797327825 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564d051da980 msgr2=0x564d052685d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:33.873 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.871+0000 7fb75b496700 1 --2- 172.21.15.39:0/3797327825 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564d051da980 0x564d052685d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.873 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.871+0000 7fb75b496700 1 -- 172.21.15.39:0/3797327825 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb74c005d20 con 0x564d05265f40 2023-11-28T11:58:33.873 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.871+0000 7fb75b496700 1 --2- 172.21.15.39:0/3797327825 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564d05265f40 0x564d0526b710 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb754006f20 tx=0x7fb754001890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33676670c55027b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:33.874 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.871+0000 7fb759492700 1 -- 172.21.15.39:0/3797327825 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb754006310 con 0x564d05265f40 2023-11-28T11:58:33.874 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.871+0000 7fb759492700 1 -- 172.21.15.39:0/3797327825 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7540020c0 con 0x564d05265f40 2023-11-28T11:58:33.874 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.871+0000 7fb759492700 1 -- 172.21.15.39:0/3797327825 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb754004760 con 0x564d05265f40 2023-11-28T11:58:33.876 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.871+0000 7fb75d160140 1 -- 172.21.15.39:0/3797327825 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564d05265f40 msgr2=0x564d0526b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:33.876 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.871+0000 7fb75d160140 1 --2- 172.21.15.39:0/3797327825 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564d05265f40 0x564d0526b710 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb754006f20 tx=0x7fb754001890 comp rx=0 tx=0).stop 2023-11-28T11:58:33.876 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.871+0000 7fb75d160140 1 -- 172.21.15.39:0/3797327825 shutdown_connections 2023-11-28T11:58:33.876 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.871+0000 7fb75d160140 1 --2- 172.21.15.39:0/3797327825 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564d05265f40 0x564d0526b710 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.871+0000 7fb75d160140 1 --2- 172.21.15.39:0/3797327825 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564d051da980 0x564d052685d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.871+0000 7fb75d160140 1 --2- 172.21.15.39:0/3797327825 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x564d051a7700 0x564d051ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.871+0000 7fb75d160140 1 -- 172.21.15.39:0/3797327825 >> 172.21.15.39:0/3797327825 conn(0x564d051adc30 msgr2=0x564d051d95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:33.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.871+0000 7fb75d160140 1 -- 172.21.15.39:0/3797327825 shutdown_connections 2023-11-28T11:58:33.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.871+0000 7fb75d160140 1 -- 172.21.15.39:0/3797327825 wait complete. 2023-11-28T11:58:33.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.875+0000 7fb75d160140 1 Processor -- start 2023-11-28T11:58:33.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.875+0000 7fb75d160140 1 -- start start 2023-11-28T11:58:33.879 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.875+0000 7fb75d160140 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564d051a7700 0x564d05317a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:33.879 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.875+0000 7fb75d160140 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x564d051da980 0x564d052685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:33.879 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.875+0000 7fb75d160140 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564d05265f40 0x564d05268b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:33.879 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.875+0000 7fb75d160140 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d05282cc0 con 0x564d05265f40 2023-11-28T11:58:33.879 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.875+0000 7fb75d160140 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d0525a540 con 0x564d051a7700 2023-11-28T11:58:33.879 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.875+0000 7fb75d160140 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x564d0525a7e0 con 0x564d051da980 2023-11-28T11:58:33.880 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.875+0000 7fb75b496700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564d05265f40 0x564d05268b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:33.880 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.875+0000 7fb75ac95700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564d051a7700 0x564d05317a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:33.880 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.875+0000 7fb75b496700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564d05265f40 0x564d05268b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47866/0 (socket says 172.21.15.39:47866) 2023-11-28T11:58:33.880 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.875+0000 7fb75b496700 1 -- 172.21.15.39:0/1031660436 learned_addr learned my addr 172.21.15.39:0/1031660436 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:33.881 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.875+0000 7fb75a494700 1 --2- 172.21.15.39:0/1031660436 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x564d051da980 0x564d052685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:33.881 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.879+0000 7fb75ac95700 1 -- 172.21.15.39:0/1031660436 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x564d051da980 msgr2=0x564d052685d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:33.881 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.879+0000 7fb75ac95700 1 --2- 172.21.15.39:0/1031660436 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x564d051da980 0x564d052685d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.881 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.879+0000 7fb75ac95700 1 -- 172.21.15.39:0/1031660436 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564d05265f40 msgr2=0x564d05268b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:33.881 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.879+0000 7fb75ac95700 1 --2- 172.21.15.39:0/1031660436 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564d05265f40 0x564d05268b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.881 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.879+0000 7fb75ac95700 1 -- 172.21.15.39:0/1031660436 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb744001e10 con 0x564d051a7700 2023-11-28T11:58:33.881 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.879+0000 7fb75b496700 1 --2- 172.21.15.39:0/1031660436 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564d05265f40 0x564d05268b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:58:33.881 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.879+0000 7fb75ac95700 1 --2- 172.21.15.39:0/1031660436 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564d051a7700 0x564d05317a30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb74c014000 tx=0x7fb74c002fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:33.882 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.879+0000 7fb743fff700 1 -- 172.21.15.39:0/1031660436 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74c026660 con 0x564d051a7700 2023-11-28T11:58:33.882 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.879+0000 7fb743fff700 1 -- 172.21.15.39:0/1031660436 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb74c0267c0 con 0x564d051a7700 2023-11-28T11:58:33.882 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.879+0000 7fb743fff700 1 -- 172.21.15.39:0/1031660436 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74c026b50 con 0x564d051a7700 2023-11-28T11:58:33.882 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.879+0000 7fb75d160140 1 -- 172.21.15.39:0/1031660436 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564d050da8b0 con 0x564d051a7700 2023-11-28T11:58:33.883 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.879+0000 7fb75d160140 1 -- 172.21.15.39:0/1031660436 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564d050e75d0 con 0x564d051a7700 2023-11-28T11:58:33.885 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.883+0000 7fb743fff700 1 -- 172.21.15.39:0/1031660436 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb74c009410 con 0x564d051a7700 2023-11-28T11:58:33.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.883+0000 7fb743fff700 1 --2- 172.21.15.39:0/1031660436 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb748063840 0x7fb748065cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:33.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.883+0000 7fb743fff700 1 -- 172.21.15.39:0/1031660436 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fb74c00ae40 con 0x564d051a7700 2023-11-28T11:58:33.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.883+0000 7fb75d160140 1 --2- 172.21.15.39:0/1031660436 >> [v2:172.21.15.39:6800/36179,v1:172.21.15.39:6801/36179] conn(0x564d05314b10 0x564d05314ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:33.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.883+0000 7fb75d160140 1 -- 172.21.15.39:0/1031660436 --> [v2:172.21.15.39:6800/36179,v1:172.21.15.39:6801/36179] -- osd_op(unknown.0.0:1 7.36 7:6fe38dc2:::100000001f7.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x564d05315420 con 0x564d05314b10 2023-11-28T11:58:33.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.883+0000 7fb75a494700 1 --2- 172.21.15.39:0/1031660436 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb748063840 0x7fb748065cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:33.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.887+0000 7fb75b496700 1 --2- 172.21.15.39:0/1031660436 >> [v2:172.21.15.39:6800/36179,v1:172.21.15.39:6801/36179] conn(0x564d05314b10 0x564d05314ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:33.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.887+0000 7fb75a494700 1 --2- 172.21.15.39:0/1031660436 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb748063840 0x7fb748065cf0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb750003f10 tx=0x7fb750003990 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:33.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.887+0000 7fb75b496700 1 --2- 172.21.15.39:0/1031660436 >> [v2:172.21.15.39:6800/36179,v1:172.21.15.39:6801/36179] conn(0x564d05314b10 0x564d05314ee0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:33.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.887+0000 7fb75b496700 1 -- 172.21.15.39:0/1031660436 <== osd.0 v2:172.21.15.39:6800/36179 1 ==== osd_op_reply(1 100000001f7.00000000 [getxattr (9) out=9b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7fb754004760 con 0x564d05314b10 2023-11-28T11:58:33.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.887+0000 7fb75d160140 1 -- 172.21.15.39:0/1031660436 >> [v2:172.21.15.39:6800/36179,v1:172.21.15.39:6801/36179] conn(0x564d05314b10 msgr2=0x564d05314ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:33.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.887+0000 7fb75d160140 1 --2- 172.21.15.39:0/1031660436 >> [v2:172.21.15.39:6800/36179,v1:172.21.15.39:6801/36179] conn(0x564d05314b10 0x564d05314ee0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.887+0000 7fb75d160140 1 -- 172.21.15.39:0/1031660436 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb748063840 msgr2=0x7fb748065cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:33.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.887+0000 7fb75d160140 1 --2- 172.21.15.39:0/1031660436 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb748063840 0x7fb748065cf0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb750003f10 tx=0x7fb750003990 comp rx=0 tx=0).stop 2023-11-28T11:58:33.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.887+0000 7fb75d160140 1 -- 172.21.15.39:0/1031660436 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564d051a7700 msgr2=0x564d05317a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:33.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.887+0000 7fb75d160140 1 --2- 172.21.15.39:0/1031660436 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564d051a7700 0x564d05317a30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb74c014000 tx=0x7fb74c002fb0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.887+0000 7fb75b496700 1 -- 172.21.15.39:0/1031660436 reap_dead start 2023-11-28T11:58:33.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.887+0000 7fb75d160140 1 -- 172.21.15.39:0/1031660436 shutdown_connections 2023-11-28T11:58:33.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.887+0000 7fb75d160140 1 -- 172.21.15.39:0/1031660436 >> 172.21.15.39:0/1031660436 conn(0x564d051adc30 msgr2=0x564d051d95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:33.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.887+0000 7fb75d160140 1 -- 172.21.15.39:0/1031660436 shutdown_connections 2023-11-28T11:58:33.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.887+0000 7fb75d160140 1 -- 172.21.15.39:0/1031660436 wait complete. 2023-11-28T11:58:33.898 INFO:teuthology.orchestra.run.smithi039.stdout:mytag 2023-11-28T11:58:33.898 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f8.00000000 scrub_tag 2023-11-28T11:58:33.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.963+0000 7f2191101140 1 Processor -- start 2023-11-28T11:58:33.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.963+0000 7f2191101140 1 -- start start 2023-11-28T11:58:33.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.963+0000 7f2191101140 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55656c94d700 0x55656cab0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:33.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.963+0000 7f2191101140 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55656c980980 0x55656c973bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:33.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.963+0000 7f2191101140 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55656ca0b830 0x55656ca28580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:33.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.963+0000 7f2191101140 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55656c875240 con 0x55656ca0b830 2023-11-28T11:58:33.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.963+0000 7f2191101140 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55656caaf4f0 con 0x55656c980980 2023-11-28T11:58:33.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.963+0000 7f2191101140 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55656caaf790 con 0x55656c94d700 2023-11-28T11:58:33.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.963+0000 7f218f437700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55656ca0b830 0x55656ca28580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:33.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.963+0000 7f2186435700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55656c980980 0x55656c973bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:33.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.963+0000 7f218ec36700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55656c94d700 0x55656cab0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:33.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.963+0000 7f2186435700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55656c980980 0x55656c973bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:58302/0 (socket says 172.21.15.39:58302) 2023-11-28T11:58:33.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.963+0000 7f2186435700 1 -- 172.21.15.39:0/1112131269 learned_addr learned my addr 172.21.15.39:0/1112131269 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:33.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.963+0000 7f218f437700 1 -- 172.21.15.39:0/1112131269 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55656c94d700 msgr2=0x55656cab0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:33.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.963+0000 7f218f437700 1 --2- 172.21.15.39:0/1112131269 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55656c94d700 0x55656cab0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.963+0000 7f218f437700 1 -- 172.21.15.39:0/1112131269 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55656c980980 msgr2=0x55656c973bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:33.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.963+0000 7f218f437700 1 --2- 172.21.15.39:0/1112131269 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55656c980980 0x55656c973bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.963+0000 7f218f437700 1 -- 172.21.15.39:0/1112131269 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2178005de0 con 0x55656ca0b830 2023-11-28T11:58:33.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.963+0000 7f2186435700 1 --2- 172.21.15.39:0/1112131269 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55656c980980 0x55656c973bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:58:33.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.967+0000 7f218f437700 1 --2- 172.21.15.39:0/1112131269 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55656ca0b830 0x55656ca28580 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2188001ba0 tx=0x7f218800b1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25f67ddc1ba89fd5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:33.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.967+0000 7f218dc34700 1 -- 172.21.15.39:0/1112131269 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2188014070 con 0x55656ca0b830 2023-11-28T11:58:33.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.967+0000 7f218dc34700 1 -- 172.21.15.39:0/1112131269 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2188008030 con 0x55656ca0b830 2023-11-28T11:58:33.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.967+0000 7f218dc34700 1 -- 172.21.15.39:0/1112131269 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218800baf0 con 0x55656ca0b830 2023-11-28T11:58:33.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.967+0000 7f2191101140 1 -- 172.21.15.39:0/1112131269 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55656ca0b830 msgr2=0x55656ca28580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:33.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.967+0000 7f2191101140 1 --2- 172.21.15.39:0/1112131269 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55656ca0b830 0x55656ca28580 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2188001ba0 tx=0x7f218800b1e0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.967+0000 7f2191101140 1 -- 172.21.15.39:0/1112131269 shutdown_connections 2023-11-28T11:58:33.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.967+0000 7f2191101140 1 --2- 172.21.15.39:0/1112131269 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55656ca0b830 0x55656ca28580 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.967+0000 7f2191101140 1 --2- 172.21.15.39:0/1112131269 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55656c980980 0x55656c973bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.967+0000 7f2191101140 1 --2- 172.21.15.39:0/1112131269 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55656c94d700 0x55656cab0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.967+0000 7f2191101140 1 -- 172.21.15.39:0/1112131269 >> 172.21.15.39:0/1112131269 conn(0x55656c953c30 msgr2=0x55656ca0bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:33.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.967+0000 7f2191101140 1 -- 172.21.15.39:0/1112131269 shutdown_connections 2023-11-28T11:58:33.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.967+0000 7f2191101140 1 -- 172.21.15.39:0/1112131269 wait complete. 2023-11-28T11:58:33.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.967+0000 7f2191101140 1 Processor -- start 2023-11-28T11:58:33.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.967+0000 7f2191101140 1 -- start start 2023-11-28T11:58:33.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.971+0000 7f2191101140 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55656c94d700 0x55656c97d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:33.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.971+0000 7f2191101140 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55656c980980 0x55656ca272e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:33.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.971+0000 7f2191101140 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55656ca0b830 0x55656c99b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:33.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.971+0000 7f2191101140 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55656cabb010 con 0x55656ca0b830 2023-11-28T11:58:33.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.971+0000 7f2191101140 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55656cab41e0 con 0x55656c980980 2023-11-28T11:58:33.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.971+0000 7f2191101140 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55656cab4480 con 0x55656c94d700 2023-11-28T11:58:33.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.971+0000 7f218f437700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55656ca0b830 0x55656c99b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:33.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.971+0000 7f218f437700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55656ca0b830 0x55656c99b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47878/0 (socket says 172.21.15.39:47878) 2023-11-28T11:58:33.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.971+0000 7f218f437700 1 -- 172.21.15.39:0/3215100115 learned_addr learned my addr 172.21.15.39:0/3215100115 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:33.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.971+0000 7f2186435700 1 --2- 172.21.15.39:0/3215100115 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55656c980980 0x55656ca272e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:33.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.971+0000 7f218ec36700 1 --2- 172.21.15.39:0/3215100115 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55656c94d700 0x55656c97d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:33.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.971+0000 7f218f437700 1 -- 172.21.15.39:0/3215100115 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55656c94d700 msgr2=0x55656c97d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:33.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.971+0000 7f218f437700 1 --2- 172.21.15.39:0/3215100115 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55656c94d700 0x55656c97d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.971+0000 7f218f437700 1 -- 172.21.15.39:0/3215100115 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55656c980980 msgr2=0x55656ca272e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:33.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.971+0000 7f218f437700 1 --2- 172.21.15.39:0/3215100115 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55656c980980 0x55656ca272e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.971+0000 7f218f437700 1 -- 172.21.15.39:0/3215100115 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55656c8a7760 con 0x55656ca0b830 2023-11-28T11:58:33.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.971+0000 7f218f437700 1 --2- 172.21.15.39:0/3215100115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55656ca0b830 0x55656c99b5c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2188001eb0 tx=0x7f2188000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:33.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.971+0000 7f218cc32700 1 -- 172.21.15.39:0/3215100115 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2188014040 con 0x55656ca0b830 2023-11-28T11:58:33.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.971+0000 7f218cc32700 1 -- 172.21.15.39:0/3215100115 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218800fb30 con 0x55656ca0b830 2023-11-28T11:58:33.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.971+0000 7f2191101140 1 -- 172.21.15.39:0/3215100115 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f218800a040 con 0x55656ca0b830 2023-11-28T11:58:33.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.971+0000 7f218cc32700 1 -- 172.21.15.39:0/3215100115 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2188001830 con 0x55656ca0b830 2023-11-28T11:58:33.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.971+0000 7f2191101140 1 -- 172.21.15.39:0/3215100115 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55656c88d390 con 0x55656ca0b830 2023-11-28T11:58:33.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.975+0000 7f218cc32700 1 -- 172.21.15.39:0/3215100115 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f218802b070 con 0x55656ca0b830 2023-11-28T11:58:33.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.975+0000 7f218cc32700 1 --2- 172.21.15.39:0/3215100115 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2170063810 0x7f2170065cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:33.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.975+0000 7f218cc32700 1 -- 172.21.15.39:0/3215100115 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f2188081d30 con 0x55656ca0b830 2023-11-28T11:58:33.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.979+0000 7f218ec36700 1 --2- 172.21.15.39:0/3215100115 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2170063810 0x7f2170065cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:33.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.979+0000 7f2191101140 1 --2- 172.21.15.39:0/3215100115 >> [v2:172.21.15.184:6821/36507,v1:172.21.15.184:6824/36507] conn(0x55656cabc410 0x55656cab3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:33.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.979+0000 7f2191101140 1 -- 172.21.15.39:0/3215100115 --> [v2:172.21.15.184:6821/36507,v1:172.21.15.184:6824/36507] -- osd_op(unknown.0.0:1 7.19 7:997b7129:::100000001f8.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x55656ca27820 con 0x55656cabc410 2023-11-28T11:58:33.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.979+0000 7f2186435700 1 --2- 172.21.15.39:0/3215100115 >> [v2:172.21.15.184:6821/36507,v1:172.21.15.184:6824/36507] conn(0x55656cabc410 0x55656cab3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:33.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.979+0000 7f218ec36700 1 --2- 172.21.15.39:0/3215100115 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2170063810 0x7f2170065cc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2180005fd0 tx=0x7f2180007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:33.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.979+0000 7f2186435700 1 --2- 172.21.15.39:0/3215100115 >> [v2:172.21.15.184:6821/36507,v1:172.21.15.184:6824/36507] conn(0x55656cabc410 0x55656cab3040 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:33.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.979+0000 7f2186435700 1 -- 172.21.15.39:0/3215100115 <== osd.6 v2:172.21.15.184:6821/36507 1 ==== osd_op_reply(1 100000001f8.00000000 [getxattr (9) out=9b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7f2178019040 con 0x55656cabc410 2023-11-28T11:58:33.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.979+0000 7f2191101140 1 -- 172.21.15.39:0/3215100115 >> [v2:172.21.15.184:6821/36507,v1:172.21.15.184:6824/36507] conn(0x55656cabc410 msgr2=0x55656cab3040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:33.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.979+0000 7f2191101140 1 --2- 172.21.15.39:0/3215100115 >> [v2:172.21.15.184:6821/36507,v1:172.21.15.184:6824/36507] conn(0x55656cabc410 0x55656cab3040 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.979+0000 7f2191101140 1 -- 172.21.15.39:0/3215100115 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2170063810 msgr2=0x7f2170065cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:33.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.979+0000 7f2191101140 1 --2- 172.21.15.39:0/3215100115 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2170063810 0x7f2170065cc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2180005fd0 tx=0x7f2180007040 comp rx=0 tx=0).stop 2023-11-28T11:58:33.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.979+0000 7f2191101140 1 -- 172.21.15.39:0/3215100115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55656ca0b830 msgr2=0x55656c99b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:33.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.979+0000 7f2191101140 1 --2- 172.21.15.39:0/3215100115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55656ca0b830 0x55656c99b5c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2188001eb0 tx=0x7f2188000bc0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.979+0000 7f218f437700 1 -- 172.21.15.39:0/3215100115 reap_dead start 2023-11-28T11:58:33.984 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.979+0000 7f2191101140 1 -- 172.21.15.39:0/3215100115 shutdown_connections 2023-11-28T11:58:33.984 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.979+0000 7f2191101140 1 -- 172.21.15.39:0/3215100115 >> 172.21.15.39:0/3215100115 conn(0x55656c953c30 msgr2=0x55656ca0e380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:33.984 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.979+0000 7f2191101140 1 -- 172.21.15.39:0/3215100115 shutdown_connections 2023-11-28T11:58:33.984 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:33.979+0000 7f2191101140 1 -- 172.21.15.39:0/3215100115 wait complete. 2023-11-28T11:58:33.989 INFO:teuthology.orchestra.run.smithi039.stdout:mytag 2023-11-28T11:58:33.990 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000002.00000000 scrub_tag 2023-11-28T11:58:34.065 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.063+0000 7fcf28794140 1 Processor -- start 2023-11-28T11:58:34.065 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.063+0000 7fcf28794140 1 -- start start 2023-11-28T11:58:34.066 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.063+0000 7fcf28794140 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x561ee7617700 0x561ee76476b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:34.066 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.063+0000 7fcf28794140 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ee764a980 0x561ee76d8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:34.066 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.063+0000 7fcf28794140 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ee76d5830 0x561ee76d8940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:34.066 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.063+0000 7fcf28794140 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ee76d8e80 con 0x561ee764a980 2023-11-28T11:58:34.066 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.063+0000 7fcf28794140 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ee76db310 con 0x561ee76d5830 2023-11-28T11:58:34.066 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.063+0000 7fcf28794140 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ee76db5b0 con 0x561ee7617700 2023-11-28T11:58:34.067 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.063+0000 7fcf25ac8700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ee764a980 0x561ee76d8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:34.067 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.063+0000 7fcf25ac8700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ee764a980 0x561ee76d8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47908/0 (socket says 172.21.15.39:47908) 2023-11-28T11:58:34.067 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.063+0000 7fcf25ac8700 1 -- 172.21.15.39:0/1003209466 learned_addr learned my addr 172.21.15.39:0/1003209466 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:34.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.063+0000 7fcf26aca700 1 --2- 172.21.15.39:0/1003209466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ee76d5830 0x561ee76d8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:34.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.063+0000 7fcf262c9700 1 --2- 172.21.15.39:0/1003209466 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x561ee7617700 0x561ee76476b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:34.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.063+0000 7fcf25ac8700 1 -- 172.21.15.39:0/1003209466 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x561ee7617700 msgr2=0x561ee76476b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:34.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.063+0000 7fcf25ac8700 1 --2- 172.21.15.39:0/1003209466 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x561ee7617700 0x561ee76476b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:34.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.063+0000 7fcf25ac8700 1 -- 172.21.15.39:0/1003209466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ee76d5830 msgr2=0x561ee76d8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:34.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.063+0000 7fcf25ac8700 1 --2- 172.21.15.39:0/1003209466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ee76d5830 0x561ee76d8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:34.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.063+0000 7fcf25ac8700 1 -- 172.21.15.39:0/1003209466 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf18005de0 con 0x561ee764a980 2023-11-28T11:58:34.069 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.063+0000 7fcf25ac8700 1 --2- 172.21.15.39:0/1003209466 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ee764a980 0x561ee76d8400 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c009860 tx=0x7fcf1c005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d584ea6ebc7fa17 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:34.069 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.067+0000 7fcf24ac6700 1 -- 172.21.15.39:0/1003209466 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c00f040 con 0x561ee764a980 2023-11-28T11:58:34.069 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.067+0000 7fcf24ac6700 1 -- 172.21.15.39:0/1003209466 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1c008930 con 0x561ee764a980 2023-11-28T11:58:34.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.067+0000 7fcf24ac6700 1 -- 172.21.15.39:0/1003209466 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c008ce0 con 0x561ee764a980 2023-11-28T11:58:34.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.067+0000 7fcf28794140 1 -- 172.21.15.39:0/1003209466 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ee764a980 msgr2=0x561ee76d8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:34.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.067+0000 7fcf28794140 1 --2- 172.21.15.39:0/1003209466 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ee764a980 0x561ee76d8400 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c009860 tx=0x7fcf1c005a00 comp rx=0 tx=0).stop 2023-11-28T11:58:34.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.067+0000 7fcf28794140 1 -- 172.21.15.39:0/1003209466 shutdown_connections 2023-11-28T11:58:34.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.067+0000 7fcf28794140 1 --2- 172.21.15.39:0/1003209466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ee76d5830 0x561ee76d8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:34.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.067+0000 7fcf28794140 1 --2- 172.21.15.39:0/1003209466 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ee764a980 0x561ee76d8400 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:34.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.067+0000 7fcf28794140 1 --2- 172.21.15.39:0/1003209466 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x561ee7617700 0x561ee76476b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:34.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.067+0000 7fcf28794140 1 -- 172.21.15.39:0/1003209466 >> 172.21.15.39:0/1003209466 conn(0x561ee761dc30 msgr2=0x561ee76d7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:34.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.067+0000 7fcf28794140 1 -- 172.21.15.39:0/1003209466 shutdown_connections 2023-11-28T11:58:34.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.067+0000 7fcf28794140 1 -- 172.21.15.39:0/1003209466 wait complete. 2023-11-28T11:58:34.071 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.067+0000 7fcf28794140 1 Processor -- start 2023-11-28T11:58:34.071 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.067+0000 7fcf28794140 1 -- start start 2023-11-28T11:58:34.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.071+0000 7fcf28794140 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x561ee7617700 0x561ee76d82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:34.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.071+0000 7fcf28794140 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ee764a980 0x561ee76404a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:34.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.071+0000 7fcf28794140 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ee76d5830 0x561ee7787680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:34.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.071+0000 7fcf28794140 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ee7786760 con 0x561ee76d5830 2023-11-28T11:58:34.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.071+0000 7fcf28794140 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ee7786a00 con 0x561ee764a980 2023-11-28T11:58:34.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.071+0000 7fcf28794140 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ee7786ca0 con 0x561ee7617700 2023-11-28T11:58:34.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.071+0000 7fcf26aca700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ee76d5830 0x561ee7787680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:34.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.071+0000 7fcf26aca700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ee76d5830 0x561ee7787680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47918/0 (socket says 172.21.15.39:47918) 2023-11-28T11:58:34.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.071+0000 7fcf26aca700 1 -- 172.21.15.39:0/1880703000 learned_addr learned my addr 172.21.15.39:0/1880703000 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:34.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.071+0000 7fcf25ac8700 1 --2- 172.21.15.39:0/1880703000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ee764a980 0x561ee76404a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:34.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.071+0000 7fcf262c9700 1 --2- 172.21.15.39:0/1880703000 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x561ee7617700 0x561ee76d82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:34.075 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.071+0000 7fcf26aca700 1 -- 172.21.15.39:0/1880703000 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x561ee7617700 msgr2=0x561ee76d82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:34.075 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.071+0000 7fcf26aca700 1 --2- 172.21.15.39:0/1880703000 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x561ee7617700 0x561ee76d82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:34.075 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.071+0000 7fcf26aca700 1 -- 172.21.15.39:0/1880703000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ee764a980 msgr2=0x561ee76404a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:34.075 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.071+0000 7fcf26aca700 1 --2- 172.21.15.39:0/1880703000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ee764a980 0x561ee76404a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:34.075 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.071+0000 7fcf26aca700 1 -- 172.21.15.39:0/1880703000 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1c009490 con 0x561ee76d5830 2023-11-28T11:58:34.075 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.071+0000 7fcf26aca700 1 --2- 172.21.15.39:0/1880703000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ee76d5830 0x561ee7787680 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fcf200106b0 tx=0x7fcf200109c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:34.075 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.071+0000 7fcf177fe700 1 -- 172.21.15.39:0/1880703000 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf20013650 con 0x561ee76d5830 2023-11-28T11:58:34.075 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.071+0000 7fcf177fe700 1 -- 172.21.15.39:0/1880703000 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf200137b0 con 0x561ee76d5830 2023-11-28T11:58:34.075 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.071+0000 7fcf28794140 1 -- 172.21.15.39:0/1880703000 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561ee7571760 con 0x561ee76d5830 2023-11-28T11:58:34.075 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.071+0000 7fcf177fe700 1 -- 172.21.15.39:0/1880703000 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf20013b60 con 0x561ee76d5830 2023-11-28T11:58:34.075 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.071+0000 7fcf28794140 1 -- 172.21.15.39:0/1880703000 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561ee7557390 con 0x561ee76d5830 2023-11-28T11:58:34.078 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.075+0000 7fcf177fe700 1 -- 172.21.15.39:0/1880703000 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fcf20024070 con 0x561ee76d5830 2023-11-28T11:58:34.081 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.075+0000 7fcf177fe700 1 --2- 172.21.15.39:0/1880703000 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcf08063840 0x7fcf08065cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:34.082 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.075+0000 7fcf177fe700 1 -- 172.21.15.39:0/1880703000 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fcf20080fa0 con 0x561ee76d5830 2023-11-28T11:58:34.082 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.079+0000 7fcf262c9700 1 --2- 172.21.15.39:0/1880703000 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcf08063840 0x7fcf08065cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:34.082 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.079+0000 7fcf28794140 1 --2- 172.21.15.39:0/1880703000 >> [v2:172.21.15.184:6821/36507,v1:172.21.15.184:6824/36507] conn(0x561ee76d8810 0x561ee7786160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:34.083 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.079+0000 7fcf28794140 1 -- 172.21.15.39:0/1880703000 --> [v2:172.21.15.184:6821/36507,v1:172.21.15.184:6824/36507] -- osd_op(unknown.0.0:1 7.12 7:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x561ee76409e0 con 0x561ee76d8810 2023-11-28T11:58:34.083 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.079+0000 7fcf25ac8700 1 --2- 172.21.15.39:0/1880703000 >> [v2:172.21.15.184:6821/36507,v1:172.21.15.184:6824/36507] conn(0x561ee76d8810 0x561ee7786160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:34.084 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.079+0000 7fcf262c9700 1 --2- 172.21.15.39:0/1880703000 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcf08063840 0x7fcf08065cf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fcf18015040 tx=0x7fcf1800f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:34.084 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.079+0000 7fcf25ac8700 1 --2- 172.21.15.39:0/1880703000 >> [v2:172.21.15.184:6821/36507,v1:172.21.15.184:6824/36507] conn(0x561ee76d8810 0x561ee7786160 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:34.084 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.079+0000 7fcf25ac8700 1 -- 172.21.15.39:0/1880703000 <== osd.6 v2:172.21.15.184:6821/36507 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x7fcf1c019020 con 0x561ee76d8810 2023-11-28T11:58:34.084 INFO:teuthology.orchestra.run.smithi039.stderr:error getting xattr cephfs_data/10000000002.00000000/scrub_tag: (61) No data available 2023-11-28T11:58:34.084 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.079+0000 7fcf28794140 1 -- 172.21.15.39:0/1880703000 >> [v2:172.21.15.184:6821/36507,v1:172.21.15.184:6824/36507] conn(0x561ee76d8810 msgr2=0x561ee7786160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:34.084 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.079+0000 7fcf28794140 1 --2- 172.21.15.39:0/1880703000 >> [v2:172.21.15.184:6821/36507,v1:172.21.15.184:6824/36507] conn(0x561ee76d8810 0x561ee7786160 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:34.085 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.079+0000 7fcf28794140 1 -- 172.21.15.39:0/1880703000 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcf08063840 msgr2=0x7fcf08065cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:34.085 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.079+0000 7fcf28794140 1 --2- 172.21.15.39:0/1880703000 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcf08063840 0x7fcf08065cf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fcf18015040 tx=0x7fcf1800f000 comp rx=0 tx=0).stop 2023-11-28T11:58:34.085 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.079+0000 7fcf28794140 1 -- 172.21.15.39:0/1880703000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ee76d5830 msgr2=0x561ee7787680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:34.085 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.079+0000 7fcf28794140 1 --2- 172.21.15.39:0/1880703000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561ee76d5830 0x561ee7787680 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fcf200106b0 tx=0x7fcf200109c0 comp rx=0 tx=0).stop 2023-11-28T11:58:34.085 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.079+0000 7fcf26aca700 1 -- 172.21.15.39:0/1880703000 reap_dead start 2023-11-28T11:58:34.085 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.079+0000 7fcf28794140 1 -- 172.21.15.39:0/1880703000 shutdown_connections 2023-11-28T11:58:34.085 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.079+0000 7fcf28794140 1 -- 172.21.15.39:0/1880703000 >> 172.21.15.39:0/1880703000 conn(0x561ee761dc30 msgr2=0x561ee76d9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:34.085 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.079+0000 7fcf28794140 1 -- 172.21.15.39:0/1880703000 shutdown_connections 2023-11-28T11:58:34.085 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.079+0000 7fcf28794140 1 -- 172.21.15.39:0/1880703000 wait complete. 2023-11-28T11:58:34.090 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:58:34.091 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T11:58:34.092 DEBUG:teuthology.orchestra.run.smithi039:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T11:58:34.136 DEBUG:teuthology.orchestra.run.smithi184:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T11:58:34.179 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T11:58:34.179 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:58:34.179 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:58:34.198 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352324k,nr_inodes=4088081,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6229 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T11:58:34.198 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:58:34.199 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:58:34.238 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352324k,nr_inodes=4088081,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9254 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T11:58:34.238 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:58:34.238 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:58:34.261 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352324k,nr_inodes=4088081,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6229 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T11:58:34.261 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:58:34.261 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:58:34.298 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352324k,nr_inodes=4088081,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9254 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T11:58:34.299 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:58:34.489 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.487+0000 7fab52453700 1 Processor -- start 2023-11-28T11:58:34.489 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.487+0000 7fab52453700 1 -- start start 2023-11-28T11:58:34.492 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.487+0000 7fab52453700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fab4c15c6d0 0x7fab4c0b17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:34.492 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.491+0000 7fab52453700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fab4c0cfc40 0x7fab4c069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:34.492 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.491+0000 7fab52453700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab4c06d5b0 con 0x7fab4c06a130 2023-11-28T11:58:34.492 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.491+0000 7fab52453700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab4c0d0400 con 0x7fab4c0cfc40 2023-11-28T11:58:34.493 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.491+0000 7fab52453700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab4c072270 con 0x7fab4c15c6d0 2023-11-28T11:58:34.494 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.491+0000 7fab50c50700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fab4c0cfc40 0x7fab4c069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:34.494 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.491+0000 7fab50c50700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fab4c0cfc40 0x7fab4c069bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47920/0 (socket says 172.21.15.39:47920) 2023-11-28T11:58:34.494 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.491+0000 7fab50c50700 1 -- 172.21.15.39:0/3913267241 learned_addr learned my addr 172.21.15.39:0/3913267241 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:34.494 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.491+0000 7fab51451700 1 --2- 172.21.15.39:0/3913267241 >> v2:172.21.15.184:3300/0 conn(0x7fab4c15c6d0 0x7fab4c0b17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:34.494 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.491+0000 7fab50c50700 1 -- 172.21.15.39:0/3913267241 >> v2:172.21.15.184:3300/0 conn(0x7fab4c15c6d0 msgr2=0x7fab4c0b17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:34.494 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.491+0000 7fab50c50700 1 --2- 172.21.15.39:0/3913267241 >> v2:172.21.15.184:3300/0 conn(0x7fab4c15c6d0 0x7fab4c0b17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:34.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.491+0000 7fab50c50700 1 -- 172.21.15.39:0/3913267241 >> v1:172.21.15.184:6789/0 conn(0x7fab4c06a130 legacy=0x7fab4c0b7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:34.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.491+0000 7fab50c50700 1 -- 172.21.15.39:0/3913267241 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4c06a530 con 0x7fab4c0cfc40 2023-11-28T11:58:34.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.491+0000 7fab50c50700 1 --2- 172.21.15.39:0/3913267241 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab4c0cfc40 0x7fab4c069bf0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fab4c066bf0 tx=0x7fab40009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51c211e9f145461a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:34.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.491+0000 7fab4bfff700 1 -- 172.21.15.39:0/3913267241 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4000b8a0 con 0x7fab4c0cfc40 2023-11-28T11:58:34.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.491+0000 7fab4bfff700 1 -- 172.21.15.39:0/3913267241 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4000ba00 con 0x7fab4c0cfc40 2023-11-28T11:58:34.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.491+0000 7fab4bfff700 1 -- 172.21.15.39:0/3913267241 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4000bd90 con 0x7fab4c0cfc40 2023-11-28T11:58:34.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.491+0000 7fab52453700 1 -- 172.21.15.39:0/3913267241 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab4c0cfc40 msgr2=0x7fab4c069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:34.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.491+0000 7fab52453700 1 --2- 172.21.15.39:0/3913267241 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab4c0cfc40 0x7fab4c069bf0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fab4c066bf0 tx=0x7fab40009bf0 comp rx=0 tx=0).stop 2023-11-28T11:58:34.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.491+0000 7fab52453700 1 -- 172.21.15.39:0/3913267241 shutdown_connections 2023-11-28T11:58:34.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.491+0000 7fab52453700 1 --2- 172.21.15.39:0/3913267241 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab4c0cfc40 0x7fab4c069bf0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:34.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.491+0000 7fab52453700 1 --2- 172.21.15.39:0/3913267241 >> v2:172.21.15.184:3300/0 conn(0x7fab4c15c6d0 0x7fab4c0b17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:34.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.491+0000 7fab52453700 1 -- 172.21.15.39:0/3913267241 >> 172.21.15.39:0/3913267241 conn(0x7fab4c0b6520 msgr2=0x7fab4c071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:34.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.495+0000 7fab52453700 1 -- 172.21.15.39:0/3913267241 shutdown_connections 2023-11-28T11:58:34.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.495+0000 7fab52453700 1 -- 172.21.15.39:0/3913267241 wait complete. 2023-11-28T11:58:34.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.495+0000 7fab52453700 1 Processor -- start 2023-11-28T11:58:34.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.495+0000 7fab52453700 1 -- start start 2023-11-28T11:58:34.500 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.495+0000 7fab52453700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab4c06a130 0x7fab4c14a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:34.500 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.495+0000 7fab52453700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab4c0cfc40 0x7fab4c1f4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:34.500 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.495+0000 7fab52453700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab4c15c6d0 0x7fab4c1f5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:34.501 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.495+0000 7fab52453700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c1e4320 con 0x7fab4c06a130 2023-11-28T11:58:34.501 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.495+0000 7fab52453700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c14ac70 con 0x7fab4c15c6d0 2023-11-28T11:58:34.501 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.495+0000 7fab52453700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c1f5aa0 con 0x7fab4c0cfc40 2023-11-28T11:58:34.501 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.499+0000 7fab51451700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab4c06a130 0x7fab4c14a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:34.501 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.499+0000 7fab51451700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab4c06a130 0x7fab4c14a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47922/0 (socket says 172.21.15.39:47922) 2023-11-28T11:58:34.501 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.499+0000 7fab51451700 1 -- 172.21.15.39:0/819025753 learned_addr learned my addr 172.21.15.39:0/819025753 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:34.502 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.499+0000 7fab50c50700 1 --2- 172.21.15.39:0/819025753 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab4c0cfc40 0x7fab4c1f4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:34.502 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.499+0000 7fab51c52700 1 --2- 172.21.15.39:0/819025753 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab4c15c6d0 0x7fab4c1f5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:34.503 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.499+0000 7fab51451700 1 -- 172.21.15.39:0/819025753 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab4c0cfc40 msgr2=0x7fab4c1f4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:34.503 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.499+0000 7fab51451700 1 --2- 172.21.15.39:0/819025753 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab4c0cfc40 0x7fab4c1f4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:34.503 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.499+0000 7fab51451700 1 -- 172.21.15.39:0/819025753 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab4c15c6d0 msgr2=0x7fab4c1f5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:34.503 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.499+0000 7fab51451700 1 --2- 172.21.15.39:0/819025753 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab4c15c6d0 0x7fab4c1f5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:34.503 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.499+0000 7fab51451700 1 -- 172.21.15.39:0/819025753 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab40009570 con 0x7fab4c06a130 2023-11-28T11:58:34.503 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.499+0000 7fab51c52700 1 --2- 172.21.15.39:0/819025753 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab4c15c6d0 0x7fab4c1f5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:58:34.503 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.499+0000 7fab51451700 1 --2- 172.21.15.39:0/819025753 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab4c06a130 0x7fab4c14a730 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fab3c007e40 tx=0x7fab3c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:34.503 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.499+0000 7fab49ffb700 1 -- 172.21.15.39:0/819025753 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3c00ede0 con 0x7fab4c06a130 2023-11-28T11:58:34.503 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.499+0000 7fab49ffb700 1 -- 172.21.15.39:0/819025753 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab3c014420 con 0x7fab4c06a130 2023-11-28T11:58:34.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.499+0000 7fab52453700 1 -- 172.21.15.39:0/819025753 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab4c071c20 con 0x7fab4c06a130 2023-11-28T11:58:34.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.499+0000 7fab49ffb700 1 -- 172.21.15.39:0/819025753 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3c0147d0 con 0x7fab4c06a130 2023-11-28T11:58:34.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.499+0000 7fab52453700 1 -- 172.21.15.39:0/819025753 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab4c0d0120 con 0x7fab4c06a130 2023-11-28T11:58:34.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.503+0000 7fab52453700 1 -- 172.21.15.39:0/819025753 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab4c071f00 con 0x7fab4c06a130 2023-11-28T11:58:34.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.503+0000 7fab49ffb700 1 -- 172.21.15.39:0/819025753 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fab3c012050 con 0x7fab4c06a130 2023-11-28T11:58:34.507 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.503+0000 7fab49ffb700 1 --2- 172.21.15.39:0/819025753 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fab38064ee0 0x7fab38067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:34.508 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.503+0000 7fab49ffb700 1 -- 172.21.15.39:0/819025753 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fab3c0826d0 con 0x7fab4c06a130 2023-11-28T11:58:34.508 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.507+0000 7fab50c50700 1 --2- 172.21.15.39:0/819025753 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fab38064ee0 0x7fab38067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:34.509 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.507+0000 7fab50c50700 1 --2- 172.21.15.39:0/819025753 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fab38064ee0 0x7fab38067390 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fab40000c00 tx=0x7fab40008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:34.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.511+0000 7fab49ffb700 1 -- 172.21.15.39:0/819025753 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fab3c050600 con 0x7fab4c06a130 2023-11-28T11:58:34.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.715+0000 7fab52453700 1 -- 172.21.15.39:0/819025753 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab4c073cb0 con 0x7fab4c06a130 2023-11-28T11:58:34.720 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.719+0000 7fab49ffb700 1 -- 172.21.15.39:0/819025753 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4654 (secure 0 0 0) 0x7fab3c053c20 con 0x7fab4c06a130 2023-11-28T11:58:34.720 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:58:34.721 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/3875562914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3875562914},{"type":"v1","addr":"172.21.15.184:6836","nonce":3875562914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5295,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/4053840838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":4053840838},{"type":"v1","addr":"172.21.15.39:6833","nonce":4053840838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5304,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2819411287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2819411287},{"type":"v1","addr":"172.21.15.39:6835","nonce":2819411287}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:58:03.228365+0000","modified":"2023-11-28T11:58:06.252058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5317},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5317":{"gid":5317,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.184:6837/2775071992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":2775071992},{"type":"v1","addr":"172.21.15.184:6837","nonce":2775071992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T11:58:34.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.719+0000 7fab52453700 1 -- 172.21.15.39:0/819025753 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fab38064ee0 msgr2=0x7fab38067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:34.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.719+0000 7fab52453700 1 --2- 172.21.15.39:0/819025753 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fab38064ee0 0x7fab38067390 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fab40000c00 tx=0x7fab40008030 comp rx=0 tx=0).stop 2023-11-28T11:58:34.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.719+0000 7fab52453700 1 -- 172.21.15.39:0/819025753 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab4c06a130 msgr2=0x7fab4c14a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:34.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.719+0000 7fab52453700 1 --2- 172.21.15.39:0/819025753 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab4c06a130 0x7fab4c14a730 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fab3c007e40 tx=0x7fab3c00e3c0 comp rx=0 tx=0).stop 2023-11-28T11:58:34.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.719+0000 7fab52453700 1 -- 172.21.15.39:0/819025753 shutdown_connections 2023-11-28T11:58:34.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.719+0000 7fab52453700 1 --2- 172.21.15.39:0/819025753 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fab38064ee0 0x7fab38067390 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:34.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.719+0000 7fab52453700 1 --2- 172.21.15.39:0/819025753 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab4c15c6d0 0x7fab4c1f5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:34.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.719+0000 7fab52453700 1 --2- 172.21.15.39:0/819025753 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab4c0cfc40 0x7fab4c1f4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:34.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.719+0000 7fab52453700 1 --2- 172.21.15.39:0/819025753 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab4c06a130 0x7fab4c14a730 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:34.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.719+0000 7fab52453700 1 -- 172.21.15.39:0/819025753 >> 172.21.15.39:0/819025753 conn(0x7fab4c0b6520 msgr2=0x7fab4c15b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:34.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.719+0000 7fab52453700 1 -- 172.21.15.39:0/819025753 shutdown_connections 2023-11-28T11:58:34.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.719+0000 7fab52453700 1 -- 172.21.15.39:0/819025753 wait complete. 2023-11-28T11:58:34.725 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 16 2023-11-28T11:58:34.745 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:58:34.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.915+0000 7fb2ca698700 1 Processor -- start 2023-11-28T11:58:34.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.915+0000 7fb2ca698700 1 -- start start 2023-11-28T11:58:34.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.915+0000 7fb2ca698700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb2c4069e00 0x7fb2c406a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:34.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.915+0000 7fb2ca698700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2c406c600 con 0x7fb2c415c640 2023-11-28T11:58:34.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.915+0000 7fb2ca698700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2c40722f0 con 0x7fb2c4071aa0 2023-11-28T11:58:34.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.915+0000 7fb2ca698700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2c406cef0 con 0x7fb2c4069e00 2023-11-28T11:58:34.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.915+0000 7fb2c9696700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fb2c415c640 0x7fb2c40d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:43654/0 (socket says 172.21.15.39:43654) 2023-11-28T11:58:34.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.915+0000 7fb2c9696700 1 -- 172.21.15.39:0/1647610292 learned_addr learned my addr 172.21.15.39:0/1647610292 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:58:34.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.919+0000 7fb2c9e97700 1 --2- 172.21.15.39:0/1647610292 >> v2:172.21.15.184:3300/0 conn(0x7fb2c4069e00 0x7fb2c406a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:34.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.919+0000 7fb2c3fff700 1 -- 172.21.15.39:0/1647610292 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2188117249 0 0) 0x7fb2c406c600 con 0x7fb2c415c640 2023-11-28T11:58:34.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.919+0000 7fb2c3fff700 1 -- 172.21.15.39:0/1647610292 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2ac0035d0 con 0x7fb2c415c640 2023-11-28T11:58:34.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.919+0000 7fb2c3fff700 1 -- 172.21.15.39:0/1647610292 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 341125274 0 0) 0x7fb2ac0035d0 con 0x7fb2c415c640 2023-11-28T11:58:34.924 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.919+0000 7fb2c3fff700 1 -- 172.21.15.39:0/1647610292 >> v2:172.21.15.184:3300/0 conn(0x7fb2c4069e00 msgr2=0x7fb2c406a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:34.924 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.919+0000 7fb2c3fff700 1 --2- 172.21.15.39:0/1647610292 >> v2:172.21.15.184:3300/0 conn(0x7fb2c4069e00 0x7fb2c406a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:34.924 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.919+0000 7fb2c3fff700 1 -- 172.21.15.39:0/1647610292 >> v1:172.21.15.184:6789/0 conn(0x7fb2c4071aa0 legacy=0x7fb2c406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:34.924 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.919+0000 7fb2c3fff700 1 -- 172.21.15.39:0/1647610292 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c406da20 con 0x7fb2c415c640 2023-11-28T11:58:34.924 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.919+0000 7fb2c3fff700 1 -- 172.21.15.39:0/1647610292 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4013383302 0 0) 0x7fb2b40019f0 con 0x7fb2c415c640 2023-11-28T11:58:34.924 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.919+0000 7fb2c3fff700 1 -- 172.21.15.39:0/1647610292 >> v1:172.21.15.39:6789/0 conn(0x7fb2c415c640 legacy=0x7fb2c40d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:34.924 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.919+0000 7fb2c3fff700 1 --2- 172.21.15.39:0/1647610292 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2ac003a20 0x7fb2ac003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:34.924 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.919+0000 7fb2c3fff700 1 --2- 172.21.15.39:0/1647610292 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2ac004870 0x7fb2ac004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:34.924 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.919+0000 7fb2c3fff700 1 --2- 172.21.15.39:0/1647610292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2ac005220 0x7fb2ac00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:34.924 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.919+0000 7fb2c3fff700 1 -- 172.21.15.39:0/1647610292 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c406cef0 con 0x7fb2ac004870 2023-11-28T11:58:34.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.919+0000 7fb2c3fff700 1 -- 172.21.15.39:0/1647610292 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ac00c0a0 con 0x7fb2ac005220 2023-11-28T11:58:34.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.919+0000 7fb2c3fff700 1 -- 172.21.15.39:0/1647610292 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ac00c260 con 0x7fb2ac003a20 2023-11-28T11:58:34.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.919+0000 7fb2c8e95700 1 --2- 172.21.15.39:0/1647610292 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2ac004870 0x7fb2ac004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:34.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.919+0000 7fb2c9696700 1 --2- 172.21.15.39:0/1647610292 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2ac003a20 0x7fb2ac003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:34.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.919+0000 7fb2c9e97700 1 --2- 172.21.15.39:0/1647610292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2ac005220 0x7fb2ac00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:34.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.919+0000 7fb2c9696700 1 -- 172.21.15.39:0/1647610292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2ac005220 msgr2=0x7fb2ac00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:34.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.919+0000 7fb2c9696700 1 --2- 172.21.15.39:0/1647610292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2ac005220 0x7fb2ac00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:34.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.919+0000 7fb2c9696700 1 -- 172.21.15.39:0/1647610292 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2ac004870 msgr2=0x7fb2ac004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:34.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.919+0000 7fb2c9696700 1 --2- 172.21.15.39:0/1647610292 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2ac004870 0x7fb2ac004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:34.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.919+0000 7fb2c9696700 1 -- 172.21.15.39:0/1647610292 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ac0035d0 con 0x7fb2ac003a20 2023-11-28T11:58:34.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.919+0000 7fb2c9e97700 1 -- 172.21.15.39:0/1647610292 reap_dead start 2023-11-28T11:58:34.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.919+0000 7fb2c9696700 1 --2- 172.21.15.39:0/1647610292 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2ac003a20 0x7fb2ac003e30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb2b400a830 tx=0x7fb2ac0058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffcd86549d2a2c19 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:34.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.923+0000 7fb2c3fff700 1 -- 172.21.15.39:0/1647610292 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b400a2f0 con 0x7fb2ac003a20 2023-11-28T11:58:34.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.923+0000 7fb2c3fff700 1 -- 172.21.15.39:0/1647610292 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b40072f0 con 0x7fb2ac003a20 2023-11-28T11:58:34.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.923+0000 7fb2c3fff700 1 -- 172.21.15.39:0/1647610292 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b40076a0 con 0x7fb2ac003a20 2023-11-28T11:58:34.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.923+0000 7fb2ca698700 1 -- 172.21.15.39:0/1647610292 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2ac003a20 msgr2=0x7fb2ac003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:34.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.923+0000 7fb2ca698700 1 --2- 172.21.15.39:0/1647610292 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2ac003a20 0x7fb2ac003e30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb2b400a830 tx=0x7fb2ac0058a0 comp rx=0 tx=0).stop 2023-11-28T11:58:34.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.923+0000 7fb2ca698700 1 -- 172.21.15.39:0/1647610292 shutdown_connections 2023-11-28T11:58:34.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.923+0000 7fb2ca698700 1 --2- 172.21.15.39:0/1647610292 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2ac003a20 0x7fb2ac003e30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:34.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.923+0000 7fb2ca698700 1 -- 172.21.15.39:0/1647610292 >> 172.21.15.39:0/1647610292 conn(0x7fb2c40b6520 msgr2=0x7fb2c4071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:34.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.923+0000 7fb2ca698700 1 -- 172.21.15.39:0/1647610292 shutdown_connections 2023-11-28T11:58:34.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.923+0000 7fb2ca698700 1 -- 172.21.15.39:0/1647610292 wait complete. 2023-11-28T11:58:34.929 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.927+0000 7fb2ca698700 1 Processor -- start 2023-11-28T11:58:34.929 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.927+0000 7fb2ca698700 1 -- start start 2023-11-28T11:58:34.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.927+0000 7fb2ca698700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2ac003a20 0x7fb2c41f1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:34.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.927+0000 7fb2ca698700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2c40ca650 0x7fb2c40c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:34.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.927+0000 7fb2ca698700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2c40c8ba0 0x7fb2c40b4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:34.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.927+0000 7fb2ca698700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c40d38f0 con 0x7fb2ac003a20 2023-11-28T11:58:34.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.927+0000 7fb2ca698700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c40ca230 con 0x7fb2c40c8ba0 2023-11-28T11:58:34.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.927+0000 7fb2ca698700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c40cc120 con 0x7fb2c40ca650 2023-11-28T11:58:34.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.927+0000 7fb2c9696700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2ac003a20 0x7fb2c41f1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:34.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.927+0000 7fb2c9696700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2ac003a20 0x7fb2c41f1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47940/0 (socket says 172.21.15.39:47940) 2023-11-28T11:58:34.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.927+0000 7fb2c9696700 1 -- 172.21.15.39:0/4257299485 learned_addr learned my addr 172.21.15.39:0/4257299485 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:34.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.927+0000 7fb2c9e97700 1 --2- 172.21.15.39:0/4257299485 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2c40c8ba0 0x7fb2c40b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:34.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.931+0000 7fb2c8e95700 1 --2- 172.21.15.39:0/4257299485 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2c40ca650 0x7fb2c40c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:34.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.931+0000 7fb2c9696700 1 -- 172.21.15.39:0/4257299485 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2c40ca650 msgr2=0x7fb2c40c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:34.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.931+0000 7fb2c9696700 1 --2- 172.21.15.39:0/4257299485 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2c40ca650 0x7fb2c40c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:34.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.931+0000 7fb2c9696700 1 -- 172.21.15.39:0/4257299485 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2c40c8ba0 msgr2=0x7fb2c40b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:34.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.931+0000 7fb2c9696700 1 --2- 172.21.15.39:0/4257299485 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2c40c8ba0 0x7fb2c40b4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:34.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.931+0000 7fb2c9696700 1 -- 172.21.15.39:0/4257299485 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c4072010 con 0x7fb2ac003a20 2023-11-28T11:58:34.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.931+0000 7fb2c9696700 1 --2- 172.21.15.39:0/4257299485 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2ac003a20 0x7fb2c41f1c20 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb2b400ab40 tx=0x7fb2b4001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:34.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.931+0000 7fb2c1ffb700 1 -- 172.21.15.39:0/4257299485 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b4007870 con 0x7fb2ac003a20 2023-11-28T11:58:34.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.931+0000 7fb2c1ffb700 1 -- 172.21.15.39:0/4257299485 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b40079d0 con 0x7fb2ac003a20 2023-11-28T11:58:34.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.931+0000 7fb2c1ffb700 1 -- 172.21.15.39:0/4257299485 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b4012620 con 0x7fb2ac003a20 2023-11-28T11:58:34.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.931+0000 7fb2ca698700 1 -- 172.21.15.39:0/4257299485 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2c415ca10 con 0x7fb2ac003a20 2023-11-28T11:58:34.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.931+0000 7fb2ca698700 1 -- 172.21.15.39:0/4257299485 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2c406c830 con 0x7fb2ac003a20 2023-11-28T11:58:34.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.931+0000 7fb2ca698700 1 -- 172.21.15.39:0/4257299485 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2c4066bb0 con 0x7fb2ac003a20 2023-11-28T11:58:34.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.935+0000 7fb2c1ffb700 1 -- 172.21.15.39:0/4257299485 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb2b402e070 con 0x7fb2ac003a20 2023-11-28T11:58:34.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.935+0000 7fb2c1ffb700 1 --2- 172.21.15.39:0/4257299485 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb2b0064ee0 0x7fb2b0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:34.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.935+0000 7fb2c1ffb700 1 -- 172.21.15.39:0/4257299485 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fb2b4083ba0 con 0x7fb2ac003a20 2023-11-28T11:58:34.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.935+0000 7fb2c8e95700 1 --2- 172.21.15.39:0/4257299485 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb2b0064ee0 0x7fb2b0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:34.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.939+0000 7fb2c8e95700 1 --2- 172.21.15.39:0/4257299485 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb2b0064ee0 0x7fb2b0067390 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb2c415bc30 tx=0x7fb2b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:34.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:34.943+0000 7fb2c1ffb700 1 -- 172.21.15.39:0/4257299485 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb2b4051b90 con 0x7fb2ac003a20 2023-11-28T11:58:35.124 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.119+0000 7fb2ca698700 1 -- 172.21.15.39:0/4257299485 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2c4073cb0 con 0x7fb2ac003a20 2023-11-28T11:58:35.127 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.123+0000 7fb2c1ffb700 1 -- 172.21.15.39:0/4257299485 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+18183 (secure 0 0 0) 0x7fb2b402c090 con 0x7fb2ac003a20 2023-11-28T11:58:35.128 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:58:35.128 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":46,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:58:22.793502+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:58:01.523189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-28T11:58:02.259575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.f","mappings":[{"from":0,"to":5}]},{"pgid":"7.12","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:58:35.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.127+0000 7fb2ca698700 1 -- 172.21.15.39:0/4257299485 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb2b0064ee0 msgr2=0x7fb2b0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:35.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.127+0000 7fb2ca698700 1 --2- 172.21.15.39:0/4257299485 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb2b0064ee0 0x7fb2b0067390 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb2c415bc30 tx=0x7fb2b8009040 comp rx=0 tx=0).stop 2023-11-28T11:58:35.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.127+0000 7fb2ca698700 1 -- 172.21.15.39:0/4257299485 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2ac003a20 msgr2=0x7fb2c41f1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:35.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.127+0000 7fb2ca698700 1 --2- 172.21.15.39:0/4257299485 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2ac003a20 0x7fb2c41f1c20 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb2b400ab40 tx=0x7fb2b4001d80 comp rx=0 tx=0).stop 2023-11-28T11:58:35.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.127+0000 7fb2ca698700 1 -- 172.21.15.39:0/4257299485 shutdown_connections 2023-11-28T11:58:35.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.127+0000 7fb2ca698700 1 --2- 172.21.15.39:0/4257299485 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb2b0064ee0 0x7fb2b0067390 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:35.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.127+0000 7fb2ca698700 1 --2- 172.21.15.39:0/4257299485 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2c40c8ba0 0x7fb2c40b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:35.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.127+0000 7fb2ca698700 1 --2- 172.21.15.39:0/4257299485 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2c40ca650 0x7fb2c40c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:35.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.127+0000 7fb2ca698700 1 --2- 172.21.15.39:0/4257299485 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2ac003a20 0x7fb2c41f1c20 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:35.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.127+0000 7fb2ca698700 1 -- 172.21.15.39:0/4257299485 >> 172.21.15.39:0/4257299485 conn(0x7fb2c40b6520 msgr2=0x7fb2c40d2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:35.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.127+0000 7fb2ca698700 1 -- 172.21.15.39:0/4257299485 shutdown_connections 2023-11-28T11:58:35.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.127+0000 7fb2ca698700 1 -- 172.21.15.39:0/4257299485 wait complete. 2023-11-28T11:58:35.154 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:56:26.631457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:56:33.242202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:58:01.523189+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:58:02.259575+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:58:35.155 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:58:35.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.331+0000 7f03c0b29700 1 Processor -- start 2023-11-28T11:58:35.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.331+0000 7f03c0b29700 1 -- start start 2023-11-28T11:58:35.339 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.335+0000 7f03c0b29700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f03bc15c150 0x7f03bc0b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:35.339 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.335+0000 7f03c0b29700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f03bc06ff10 0x7f03bc070360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:35.339 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.335+0000 7f03c0b29700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03bc15fc30 0x7f03bc160090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:35.339 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.335+0000 7f03c0b29700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03bc0b4240 con 0x7f03bc15c150 2023-11-28T11:58:35.339 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.335+0000 7f03c0b29700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03bc15c520 con 0x7f03bc06ff10 2023-11-28T11:58:35.339 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.335+0000 7f03c0b29700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03bc0708a0 con 0x7f03bc15fc30 2023-11-28T11:58:35.340 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.335+0000 7f03bb7fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f03bc15c150 0x7f03bc0b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:35.340 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.335+0000 7f03bb7fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f03bc15c150 0x7f03bc0b3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47956/0 (socket says 172.21.15.39:47956) 2023-11-28T11:58:35.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.335+0000 7f03bb7fe700 1 -- 172.21.15.39:0/1473816302 learned_addr learned my addr 172.21.15.39:0/1473816302 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:35.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.335+0000 7f03baffd700 1 --2- 172.21.15.39:0/1473816302 >> v2:172.21.15.184:3300/0 conn(0x7f03bc06ff10 0x7f03bc070360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:35.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.335+0000 7f03bbfff700 1 --2- 172.21.15.39:0/1473816302 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03bc15fc30 0x7f03bc160090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:35.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.335+0000 7f03bb7fe700 1 -- 172.21.15.39:0/1473816302 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03bc15fc30 msgr2=0x7f03bc160090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:35.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.335+0000 7f03bb7fe700 1 --2- 172.21.15.39:0/1473816302 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03bc15fc30 0x7f03bc160090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:35.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.335+0000 7f03bb7fe700 1 -- 172.21.15.39:0/1473816302 >> v2:172.21.15.184:3300/0 conn(0x7f03bc06ff10 msgr2=0x7f03bc070360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:35.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.335+0000 7f03bb7fe700 1 --2- 172.21.15.39:0/1473816302 >> v2:172.21.15.184:3300/0 conn(0x7f03bc06ff10 0x7f03bc070360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:35.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.335+0000 7f03bb7fe700 1 -- 172.21.15.39:0/1473816302 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03bc06cc50 con 0x7f03bc15c150 2023-11-28T11:58:35.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.335+0000 7f03baffd700 1 --2- 172.21.15.39:0/1473816302 >> v2:172.21.15.184:3300/0 conn(0x7f03bc06ff10 0x7f03bc070360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:58:35.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.339+0000 7f03bb7fe700 1 --2- 172.21.15.39:0/1473816302 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f03bc15c150 0x7f03bc0b3d00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f03bc066d30 tx=0x7f03ac009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58277a2caeefb908 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:35.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.339+0000 7f03ba7fc700 1 -- 172.21.15.39:0/1473816302 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ac00ba20 con 0x7f03bc15c150 2023-11-28T11:58:35.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.339+0000 7f03ba7fc700 1 -- 172.21.15.39:0/1473816302 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03ac00bb80 con 0x7f03bc15c150 2023-11-28T11:58:35.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.339+0000 7f03ba7fc700 1 -- 172.21.15.39:0/1473816302 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ac009e60 con 0x7f03bc15c150 2023-11-28T11:58:35.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.339+0000 7f03c0b29700 1 -- 172.21.15.39:0/1473816302 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f03bc15c150 msgr2=0x7f03bc0b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:35.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.339+0000 7f03c0b29700 1 --2- 172.21.15.39:0/1473816302 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f03bc15c150 0x7f03bc0b3d00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f03bc066d30 tx=0x7f03ac009c20 comp rx=0 tx=0).stop 2023-11-28T11:58:35.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.339+0000 7f03c0b29700 1 -- 172.21.15.39:0/1473816302 shutdown_connections 2023-11-28T11:58:35.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.339+0000 7f03c0b29700 1 --2- 172.21.15.39:0/1473816302 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03bc15fc30 0x7f03bc160090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:35.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.339+0000 7f03c0b29700 1 --2- 172.21.15.39:0/1473816302 >> v2:172.21.15.184:3300/0 conn(0x7f03bc06ff10 0x7f03bc070360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:35.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.339+0000 7f03c0b29700 1 --2- 172.21.15.39:0/1473816302 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f03bc15c150 0x7f03bc0b3d00 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:35.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.339+0000 7f03c0b29700 1 -- 172.21.15.39:0/1473816302 >> 172.21.15.39:0/1473816302 conn(0x7f03bc0d3680 msgr2=0x7f03bc0cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:35.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.339+0000 7f03c0b29700 1 -- 172.21.15.39:0/1473816302 shutdown_connections 2023-11-28T11:58:35.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.339+0000 7f03c0b29700 1 -- 172.21.15.39:0/1473816302 wait complete. 2023-11-28T11:58:35.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.343+0000 7f03c0b29700 1 Processor -- start 2023-11-28T11:58:35.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.343+0000 7f03c0b29700 1 -- start start 2023-11-28T11:58:35.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.343+0000 7f03c0b29700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03bc06ff10 0x7f03bc150690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:35.348 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.343+0000 7f03c0b29700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03bc15c150 0x7f03bc0c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:35.348 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.343+0000 7f03c0b29700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f03bc15fc30 0x7f03bc0cf310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:35.348 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.343+0000 7f03c0b29700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03bc0c9f80 con 0x7f03bc15fc30 2023-11-28T11:58:35.348 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.343+0000 7f03c0b29700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03bc0cf850 con 0x7f03bc06ff10 2023-11-28T11:58:35.348 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.343+0000 7f03c0b29700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03bc0ca190 con 0x7f03bc15c150 2023-11-28T11:58:35.348 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.343+0000 7f03bbfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f03bc15fc30 0x7f03bc0cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:35.348 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.343+0000 7f03bbfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f03bc15fc30 0x7f03bc0cf310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47960/0 (socket says 172.21.15.39:47960) 2023-11-28T11:58:35.348 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.343+0000 7f03bbfff700 1 -- 172.21.15.39:0/2470739828 learned_addr learned my addr 172.21.15.39:0/2470739828 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:35.348 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.343+0000 7f03bb7fe700 1 --2- 172.21.15.39:0/2470739828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03bc06ff10 0x7f03bc150690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:35.348 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.343+0000 7f03baffd700 1 --2- 172.21.15.39:0/2470739828 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03bc15c150 0x7f03bc0c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:35.348 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.343+0000 7f03bbfff700 1 -- 172.21.15.39:0/2470739828 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03bc15c150 msgr2=0x7f03bc0c9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:35.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.343+0000 7f03bbfff700 1 --2- 172.21.15.39:0/2470739828 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03bc15c150 0x7f03bc0c9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:35.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.343+0000 7f03bbfff700 1 -- 172.21.15.39:0/2470739828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03bc06ff10 msgr2=0x7f03bc150690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:35.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.343+0000 7f03bbfff700 1 --2- 172.21.15.39:0/2470739828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03bc06ff10 0x7f03bc150690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:35.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.343+0000 7f03bbfff700 1 -- 172.21.15.39:0/2470739828 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ac009570 con 0x7f03bc15fc30 2023-11-28T11:58:35.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.343+0000 7f03bbfff700 1 --2- 172.21.15.39:0/2470739828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f03bc15fc30 0x7f03bc0cf310 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f03b4007e60 tx=0x7f03b400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:35.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.347+0000 7f03a3fff700 1 -- 172.21.15.39:0/2470739828 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b400ed30 con 0x7f03bc15fc30 2023-11-28T11:58:35.350 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.347+0000 7f03a3fff700 1 -- 172.21.15.39:0/2470739828 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b4014420 con 0x7f03bc15fc30 2023-11-28T11:58:35.350 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.347+0000 7f03a3fff700 1 -- 172.21.15.39:0/2470739828 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b40147d0 con 0x7f03bc15fc30 2023-11-28T11:58:35.350 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.347+0000 7f03c0b29700 1 -- 172.21.15.39:0/2470739828 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03bc0d2730 con 0x7f03bc15fc30 2023-11-28T11:58:35.350 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.347+0000 7f03c0b29700 1 -- 172.21.15.39:0/2470739828 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03bc0d2450 con 0x7f03bc15fc30 2023-11-28T11:58:35.350 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.347+0000 7f03c0b29700 1 -- 172.21.15.39:0/2470739828 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03bc0d05e0 con 0x7f03bc15fc30 2023-11-28T11:58:35.351 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.347+0000 7f03a3fff700 1 -- 172.21.15.39:0/2470739828 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f03b4012050 con 0x7f03bc15fc30 2023-11-28T11:58:35.353 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.351+0000 7f03a3fff700 1 --2- 172.21.15.39:0/2470739828 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f03a8064ee0 0x7f03a8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:35.353 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.351+0000 7f03a3fff700 1 -- 172.21.15.39:0/2470739828 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f03b40825b0 con 0x7f03bc15fc30 2023-11-28T11:58:35.354 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.351+0000 7f03bb7fe700 1 --2- 172.21.15.39:0/2470739828 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f03a8064ee0 0x7f03a8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:35.355 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.351+0000 7f03bb7fe700 1 --2- 172.21.15.39:0/2470739828 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f03a8064ee0 0x7f03a8067390 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f03ac000c00 tx=0x7f03ac008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:35.359 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.355+0000 7f03a3fff700 1 -- 172.21.15.39:0/2470739828 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f03b40504e0 con 0x7f03bc15fc30 2023-11-28T11:58:35.537 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.535+0000 7f03c0b29700 1 -- 172.21.15.39:0/2470739828 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f03bc073d20 con 0x7f03bc15fc30 2023-11-28T11:58:35.538 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.535+0000 7f03a3fff700 1 -- 172.21.15.39:0/2470739828 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7f03b4053b00 con 0x7f03bc15fc30 2023-11-28T11:58:35.538 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-11-28T11:58:35.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.539+0000 7f03c0b29700 1 -- 172.21.15.39:0/2470739828 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f03a8064ee0 msgr2=0x7f03a8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:35.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.539+0000 7f03c0b29700 1 --2- 172.21.15.39:0/2470739828 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f03a8064ee0 0x7f03a8067390 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f03ac000c00 tx=0x7f03ac008030 comp rx=0 tx=0).stop 2023-11-28T11:58:35.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.539+0000 7f03c0b29700 1 -- 172.21.15.39:0/2470739828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f03bc15fc30 msgr2=0x7f03bc0cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:35.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.539+0000 7f03c0b29700 1 --2- 172.21.15.39:0/2470739828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f03bc15fc30 0x7f03bc0cf310 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f03b4007e60 tx=0x7f03b400e3c0 comp rx=0 tx=0).stop 2023-11-28T11:58:35.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.539+0000 7f03c0b29700 1 -- 172.21.15.39:0/2470739828 shutdown_connections 2023-11-28T11:58:35.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.539+0000 7f03c0b29700 1 --2- 172.21.15.39:0/2470739828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f03bc15fc30 0x7f03bc0cf310 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:35.544 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.539+0000 7f03c0b29700 1 --2- 172.21.15.39:0/2470739828 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03bc15c150 0x7f03bc0c9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:35.544 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.539+0000 7f03c0b29700 1 --2- 172.21.15.39:0/2470739828 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f03a8064ee0 0x7f03a8067390 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:35.544 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.539+0000 7f03c0b29700 1 --2- 172.21.15.39:0/2470739828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03bc06ff10 0x7f03bc150690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:35.544 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.539+0000 7f03c0b29700 1 -- 172.21.15.39:0/2470739828 >> 172.21.15.39:0/2470739828 conn(0x7f03bc0d3680 msgr2=0x7f03bc0c7fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:35.544 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.539+0000 7f03c0b29700 1 -- 172.21.15.39:0/2470739828 shutdown_connections 2023-11-28T11:58:35.544 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.539+0000 7f03c0b29700 1 -- 172.21.15.39:0/2470739828 wait complete. 2023-11-28T11:58:35.566 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:58:35.744 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.739+0000 7fa1354d8700 1 Processor -- start 2023-11-28T11:58:35.744 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.743+0000 7fa1354d8700 1 -- start start 2023-11-28T11:58:35.748 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.743+0000 7fa1354d8700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa13015e190 0x7fa1300cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:35.748 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.743+0000 7fa1354d8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa130161560 0x7fa130069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:35.748 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.743+0000 7fa1354d8700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa13015e560 con 0x7fa13006ff10 2023-11-28T11:58:35.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.743+0000 7fa1354d8700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa13006be80 con 0x7fa13015e190 2023-11-28T11:58:35.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.743+0000 7fa1354d8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1300ce330 con 0x7fa130161560 2023-11-28T11:58:35.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.743+0000 7fa12effd700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa13015e190 0x7fa1300cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:35.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.743+0000 7fa12f7fe700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fa13006ff10 0x7fa13006c310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:43658/0 (socket says 172.21.15.39:43658) 2023-11-28T11:58:35.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.743+0000 7fa12f7fe700 1 -- 172.21.15.39:0/1569177840 learned_addr learned my addr 172.21.15.39:0/1569177840 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:58:35.752 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.747+0000 7fa12e7fc700 1 --2- 172.21.15.39:0/1569177840 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa130161560 0x7fa130069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:35.752 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.747+0000 7fa12dffb700 1 -- 172.21.15.39:0/1569177840 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4252545824 0 0) 0x7fa128001490 con 0x7fa13006ff10 2023-11-28T11:58:35.752 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.747+0000 7fa12dffb700 1 -- 172.21.15.39:0/1569177840 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1180035d0 con 0x7fa13006ff10 2023-11-28T11:58:35.752 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.747+0000 7fa12effd700 1 -- 172.21.15.39:0/1569177840 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa130161560 msgr2=0x7fa130069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:35.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.747+0000 7fa12effd700 1 --2- 172.21.15.39:0/1569177840 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa130161560 0x7fa130069bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:35.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.747+0000 7fa12effd700 1 -- 172.21.15.39:0/1569177840 >> v1:172.21.15.39:6789/0 conn(0x7fa13006ff10 legacy=0x7fa13006c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:35.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.747+0000 7fa12effd700 1 -- 172.21.15.39:0/1569177840 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1300af990 con 0x7fa13015e190 2023-11-28T11:58:35.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.747+0000 7fa12effd700 1 --2- 172.21.15.39:0/1569177840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa13015e190 0x7fa1300cdc50 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa120009850 tx=0x7fa120009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5172636413ee410c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:35.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.747+0000 7fa12dffb700 1 -- 172.21.15.39:0/1569177840 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa120011830 con 0x7fa13015e190 2023-11-28T11:58:35.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.747+0000 7fa12dffb700 1 -- 172.21.15.39:0/1569177840 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa120011990 con 0x7fa13015e190 2023-11-28T11:58:35.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.747+0000 7fa12dffb700 1 -- 172.21.15.39:0/1569177840 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa120011d40 con 0x7fa13015e190 2023-11-28T11:58:35.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.747+0000 7fa1354d8700 1 -- 172.21.15.39:0/1569177840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa13015e190 msgr2=0x7fa1300cdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:35.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.747+0000 7fa1354d8700 1 --2- 172.21.15.39:0/1569177840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa13015e190 0x7fa1300cdc50 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa120009850 tx=0x7fa120009b60 comp rx=0 tx=0).stop 2023-11-28T11:58:35.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.747+0000 7fa1354d8700 1 -- 172.21.15.39:0/1569177840 shutdown_connections 2023-11-28T11:58:35.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.747+0000 7fa1354d8700 1 --2- 172.21.15.39:0/1569177840 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa130161560 0x7fa130069bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:35.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.747+0000 7fa1354d8700 1 --2- 172.21.15.39:0/1569177840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa13015e190 0x7fa1300cdc50 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:35.754 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.747+0000 7fa1354d8700 1 -- 172.21.15.39:0/1569177840 >> 172.21.15.39:0/1569177840 conn(0x7fa1300cf280 msgr2=0x7fa1300cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:35.754 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.747+0000 7fa1354d8700 1 -- 172.21.15.39:0/1569177840 shutdown_connections 2023-11-28T11:58:35.754 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.747+0000 7fa1354d8700 1 -- 172.21.15.39:0/1569177840 wait complete. 2023-11-28T11:58:35.754 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.751+0000 7fa1354d8700 1 Processor -- start 2023-11-28T11:58:35.755 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.751+0000 7fa1354d8700 1 -- start start 2023-11-28T11:58:35.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.755+0000 7fa1354d8700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa13006ff10 0x7fa1300b4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:35.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.755+0000 7fa1354d8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa13015e190 0x7fa130153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:35.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.755+0000 7fa1354d8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa130161560 0x7fa130163450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:35.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.755+0000 7fa1354d8700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1300b40a0 con 0x7fa13006ff10 2023-11-28T11:58:35.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.755+0000 7fa1354d8700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa130163b50 con 0x7fa130161560 2023-11-28T11:58:35.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.755+0000 7fa1354d8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1300c56d0 con 0x7fa13015e190 2023-11-28T11:58:35.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.755+0000 7fa12effd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa13006ff10 0x7fa1300b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:35.758 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.755+0000 7fa12effd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa13006ff10 0x7fa1300b4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47980/0 (socket says 172.21.15.39:47980) 2023-11-28T11:58:35.758 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.755+0000 7fa12effd700 1 -- 172.21.15.39:0/1068421466 learned_addr learned my addr 172.21.15.39:0/1068421466 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:35.758 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.755+0000 7fa12e7fc700 1 --2- 172.21.15.39:0/1068421466 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa13015e190 0x7fa130153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:35.758 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.755+0000 7fa12f7fe700 1 --2- 172.21.15.39:0/1068421466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa130161560 0x7fa130163450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:35.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.755+0000 7fa12effd700 1 -- 172.21.15.39:0/1068421466 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa13015e190 msgr2=0x7fa130153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:35.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.755+0000 7fa12effd700 1 --2- 172.21.15.39:0/1068421466 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa13015e190 0x7fa130153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:35.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.755+0000 7fa12effd700 1 -- 172.21.15.39:0/1068421466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa130161560 msgr2=0x7fa130163450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:35.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.755+0000 7fa12effd700 1 --2- 172.21.15.39:0/1068421466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa130161560 0x7fa130163450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:35.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.755+0000 7fa12effd700 1 -- 172.21.15.39:0/1068421466 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1200094b0 con 0x7fa13006ff10 2023-11-28T11:58:35.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.755+0000 7fa12effd700 1 --2- 172.21.15.39:0/1068421466 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa13006ff10 0x7fa1300b4290 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa1200090b0 tx=0x7fa120004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:35.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.755+0000 7fa1177fe700 1 -- 172.21.15.39:0/1068421466 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa120004380 con 0x7fa13006ff10 2023-11-28T11:58:35.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.755+0000 7fa1177fe700 1 -- 172.21.15.39:0/1068421466 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa12001f070 con 0x7fa13006ff10 2023-11-28T11:58:35.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.755+0000 7fa1177fe700 1 -- 172.21.15.39:0/1068421466 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1200036c0 con 0x7fa13006ff10 2023-11-28T11:58:35.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.755+0000 7fa1354d8700 1 -- 172.21.15.39:0/1068421466 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1300aff50 con 0x7fa13006ff10 2023-11-28T11:58:35.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.755+0000 7fa1354d8700 1 -- 172.21.15.39:0/1068421466 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1300afc70 con 0x7fa13006ff10 2023-11-28T11:58:35.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.759+0000 7fa1354d8700 1 -- 172.21.15.39:0/1068421466 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa13006a130 con 0x7fa13006ff10 2023-11-28T11:58:35.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.759+0000 7fa1177fe700 1 -- 172.21.15.39:0/1068421466 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa12002a020 con 0x7fa13006ff10 2023-11-28T11:58:35.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.763+0000 7fa1177fe700 1 --2- 172.21.15.39:0/1068421466 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa11c064f10 0x7fa11c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:35.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.763+0000 7fa1177fe700 1 -- 172.21.15.39:0/1068421466 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fa120083460 con 0x7fa13006ff10 2023-11-28T11:58:35.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.763+0000 7fa12e7fc700 1 --2- 172.21.15.39:0/1068421466 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa11c064f10 0x7fa11c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:35.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.763+0000 7fa12e7fc700 1 --2- 172.21.15.39:0/1068421466 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa11c064f10 0x7fa11c0673c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa1300c5430 tx=0x7fa124009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:35.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.767+0000 7fa1177fe700 1 -- 172.21.15.39:0/1068421466 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa120051390 con 0x7fa13006ff10 2023-11-28T11:58:35.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.939+0000 7fa1354d8700 1 -- 172.21.15.39:0/1068421466 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa130073d20 con 0x7fa13006ff10 2023-11-28T11:58:35.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.943+0000 7fa1177fe700 1 -- 172.21.15.39:0/1068421466 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v46) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa120006ce0 con 0x7fa13006ff10 2023-11-28T11:58:35.945 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-11-28T11:58:35.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.947+0000 7fa1354d8700 1 -- 172.21.15.39:0/1068421466 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa11c064f10 msgr2=0x7fa11c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:35.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.947+0000 7fa1354d8700 1 --2- 172.21.15.39:0/1068421466 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa11c064f10 0x7fa11c0673c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa1300c5430 tx=0x7fa124009240 comp rx=0 tx=0).stop 2023-11-28T11:58:35.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.947+0000 7fa1354d8700 1 -- 172.21.15.39:0/1068421466 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa13006ff10 msgr2=0x7fa1300b4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:35.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.947+0000 7fa1354d8700 1 --2- 172.21.15.39:0/1068421466 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa13006ff10 0x7fa1300b4290 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa1200090b0 tx=0x7fa120004770 comp rx=0 tx=0).stop 2023-11-28T11:58:35.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.947+0000 7fa1354d8700 1 -- 172.21.15.39:0/1068421466 shutdown_connections 2023-11-28T11:58:35.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.947+0000 7fa1354d8700 1 --2- 172.21.15.39:0/1068421466 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa11c064f10 0x7fa11c0673c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:35.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.947+0000 7fa1354d8700 1 --2- 172.21.15.39:0/1068421466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa130161560 0x7fa130163450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:35.952 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.947+0000 7fa1354d8700 1 --2- 172.21.15.39:0/1068421466 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa13015e190 0x7fa130153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:35.952 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.947+0000 7fa1354d8700 1 --2- 172.21.15.39:0/1068421466 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa13006ff10 0x7fa1300b4290 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:35.952 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.947+0000 7fa1354d8700 1 -- 172.21.15.39:0/1068421466 >> 172.21.15.39:0/1068421466 conn(0x7fa1300cf280 msgr2=0x7fa1300c3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:35.952 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.947+0000 7fa1354d8700 1 -- 172.21.15.39:0/1068421466 shutdown_connections 2023-11-28T11:58:35.952 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:35.947+0000 7fa1354d8700 1 -- 172.21.15.39:0/1068421466 wait complete. 2023-11-28T11:58:35.973 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:58:36.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.151+0000 7f2fd9a98700 1 Processor -- start 2023-11-28T11:58:36.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.151+0000 7f2fd9a98700 1 -- start start 2023-11-28T11:58:36.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.155+0000 7f2fd9a98700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f2fd40cdc50 0x7f2fd4069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:36.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.155+0000 7f2fd9a98700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fd415e560 con 0x7f2fd406ff10 2023-11-28T11:58:36.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.155+0000 7f2fd9a98700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fd406be80 con 0x7f2fd415e190 2023-11-28T11:58:36.158 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.155+0000 7f2fd9a98700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd40ce0a0 con 0x7f2fd40cdc50 2023-11-28T11:58:36.158 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.155+0000 7f2fd3fff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f2fd40cdc50 0x7f2fd4069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:36.158 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.155+0000 7f2fd9297700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f2fd406ff10 0x7f2fd406c310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:43662/0 (socket says 172.21.15.39:43662) 2023-11-28T11:58:36.158 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.155+0000 7f2fd9297700 1 -- 172.21.15.39:0/699986144 learned_addr learned my addr 172.21.15.39:0/699986144 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:58:36.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.155+0000 7f2fd37fe700 1 -- 172.21.15.39:0/699986144 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1867145903 0 0) 0x7f2fcc001490 con 0x7f2fd406ff10 2023-11-28T11:58:36.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.155+0000 7f2fd37fe700 1 -- 172.21.15.39:0/699986144 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fc40035d0 con 0x7f2fd406ff10 2023-11-28T11:58:36.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.155+0000 7f2fd37fe700 1 -- 172.21.15.39:0/699986144 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1996860628 0 0) 0x7f2fd406be80 con 0x7f2fd415e190 2023-11-28T11:58:36.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.155+0000 7f2fd3fff700 1 -- 172.21.15.39:0/699986144 >> v1:172.21.15.184:6789/0 conn(0x7f2fd415e190 legacy=0x7f2fd4161560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:36.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.155+0000 7f2fd3fff700 1 -- 172.21.15.39:0/699986144 >> v1:172.21.15.39:6789/0 conn(0x7f2fd406ff10 legacy=0x7f2fd406c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:36.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.155+0000 7f2fd3fff700 1 -- 172.21.15.39:0/699986144 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd40ce330 con 0x7f2fd40cdc50 2023-11-28T11:58:36.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.155+0000 7f2fd3fff700 1 --2- 172.21.15.39:0/699986144 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fd40cdc50 0x7f2fd4069bf0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0009850 tx=0x7f2fc0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c04081ec1524a7e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:36.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.155+0000 7f2fd37fe700 1 -- 172.21.15.39:0/699986144 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc0011830 con 0x7f2fd40cdc50 2023-11-28T11:58:36.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.155+0000 7f2fd37fe700 1 -- 172.21.15.39:0/699986144 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc0011990 con 0x7f2fd40cdc50 2023-11-28T11:58:36.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.159+0000 7f2fd37fe700 1 -- 172.21.15.39:0/699986144 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc0011d40 con 0x7f2fd40cdc50 2023-11-28T11:58:36.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.159+0000 7f2fd9a98700 1 -- 172.21.15.39:0/699986144 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fd40cdc50 msgr2=0x7f2fd4069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:36.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.159+0000 7f2fd9a98700 1 --2- 172.21.15.39:0/699986144 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fd40cdc50 0x7f2fd4069bf0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0009850 tx=0x7f2fc0009b60 comp rx=0 tx=0).stop 2023-11-28T11:58:36.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.159+0000 7f2fd9a98700 1 -- 172.21.15.39:0/699986144 shutdown_connections 2023-11-28T11:58:36.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.159+0000 7f2fd9a98700 1 --2- 172.21.15.39:0/699986144 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fd40cdc50 0x7f2fd4069bf0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:36.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.159+0000 7f2fd9a98700 1 -- 172.21.15.39:0/699986144 >> 172.21.15.39:0/699986144 conn(0x7f2fd40cf280 msgr2=0x7f2fd40cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:36.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.159+0000 7f2fd9a98700 1 -- 172.21.15.39:0/699986144 shutdown_connections 2023-11-28T11:58:36.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.159+0000 7f2fd9a98700 1 -- 172.21.15.39:0/699986144 wait complete. 2023-11-28T11:58:36.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.163+0000 7f2fd9a98700 1 Processor -- start 2023-11-28T11:58:36.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.163+0000 7f2fd9a98700 1 -- start start 2023-11-28T11:58:36.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.163+0000 7f2fd9a98700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fd406ff10 0x7f2fd415b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:36.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.163+0000 7f2fd9a98700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fd40cdc50 0x7f2fd4154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:36.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.163+0000 7f2fd9a98700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fd415e190 0x7f2fd40b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:36.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.163+0000 7f2fd9a98700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd4154b60 con 0x7f2fd406ff10 2023-11-28T11:58:36.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.163+0000 7f2fd9a98700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd40b23a0 con 0x7f2fd415e190 2023-11-28T11:58:36.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.163+0000 7f2fd9a98700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd4156700 con 0x7f2fd40cdc50 2023-11-28T11:58:36.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.163+0000 7f2fd8a96700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fd406ff10 0x7f2fd415b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:36.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.163+0000 7f2fd8a96700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fd406ff10 0x7f2fd415b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47998/0 (socket says 172.21.15.39:47998) 2023-11-28T11:58:36.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.163+0000 7f2fd8a96700 1 -- 172.21.15.39:0/2771766628 learned_addr learned my addr 172.21.15.39:0/2771766628 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:36.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.163+0000 7f2fd9297700 1 --2- 172.21.15.39:0/2771766628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fd415e190 0x7f2fd40b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:36.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.163+0000 7f2fd3fff700 1 --2- 172.21.15.39:0/2771766628 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fd40cdc50 0x7f2fd4154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:36.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.167+0000 7f2fd8a96700 1 -- 172.21.15.39:0/2771766628 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fd40cdc50 msgr2=0x7f2fd4154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:36.170 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.167+0000 7f2fd8a96700 1 --2- 172.21.15.39:0/2771766628 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fd40cdc50 0x7f2fd4154620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:36.170 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.167+0000 7f2fd8a96700 1 -- 172.21.15.39:0/2771766628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fd415e190 msgr2=0x7f2fd40b3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:36.170 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.167+0000 7f2fd8a96700 1 --2- 172.21.15.39:0/2771766628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fd415e190 0x7f2fd40b3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:36.170 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.167+0000 7f2fd8a96700 1 -- 172.21.15.39:0/2771766628 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc00094b0 con 0x7f2fd406ff10 2023-11-28T11:58:36.170 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.167+0000 7f2fd8a96700 1 --2- 172.21.15.39:0/2771766628 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fd406ff10 0x7f2fd415b780 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f2fc800c550 tx=0x7f2fc800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:36.170 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.167+0000 7f2fd17fa700 1 -- 172.21.15.39:0/2771766628 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc80054e0 con 0x7f2fd406ff10 2023-11-28T11:58:36.170 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.167+0000 7f2fd17fa700 1 -- 172.21.15.39:0/2771766628 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc80036a0 con 0x7f2fd406ff10 2023-11-28T11:58:36.170 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.167+0000 7f2fd9a98700 1 -- 172.21.15.39:0/2771766628 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fd40afc70 con 0x7f2fd406ff10 2023-11-28T11:58:36.170 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.167+0000 7f2fd17fa700 1 -- 172.21.15.39:0/2771766628 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc8003a50 con 0x7f2fd406ff10 2023-11-28T11:58:36.170 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.167+0000 7f2fd9a98700 1 -- 172.21.15.39:0/2771766628 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fd40af990 con 0x7f2fd406ff10 2023-11-28T11:58:36.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.167+0000 7f2fd9a98700 1 -- 172.21.15.39:0/2771766628 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fd40aff50 con 0x7f2fd406ff10 2023-11-28T11:58:36.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.171+0000 7f2fd17fa700 1 -- 172.21.15.39:0/2771766628 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2fc8019030 con 0x7f2fd406ff10 2023-11-28T11:58:36.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.171+0000 7f2fd17fa700 1 --2- 172.21.15.39:0/2771766628 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2fb8064ee0 0x7f2fb8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:36.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.171+0000 7f2fd17fa700 1 -- 172.21.15.39:0/2771766628 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f2fc80813d0 con 0x7f2fd406ff10 2023-11-28T11:58:36.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.171+0000 7f2fd3fff700 1 --2- 172.21.15.39:0/2771766628 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2fb8064ee0 0x7f2fb8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:36.176 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.171+0000 7f2fd3fff700 1 --2- 172.21.15.39:0/2771766628 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2fb8064ee0 0x7f2fb8067390 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2fc00090b0 tx=0x7f2fc0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:36.180 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.175+0000 7f2fd17fa700 1 -- 172.21.15.39:0/2771766628 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2fc804f300 con 0x7f2fd406ff10 2023-11-28T11:58:36.352 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.347+0000 7f2fd9a98700 1 -- 172.21.15.39:0/2771766628 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2fd4073d20 con 0x7f2fd406ff10 2023-11-28T11:58:36.353 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.351+0000 7f2fd17fa700 1 -- 172.21.15.39:0/2771766628 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v46) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2fc8052920 con 0x7f2fd406ff10 2023-11-28T11:58:36.353 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-11-28T11:58:36.355 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.351+0000 7f2fd9a98700 1 -- 172.21.15.39:0/2771766628 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2fb8064ee0 msgr2=0x7f2fb8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:36.355 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.351+0000 7f2fd9a98700 1 --2- 172.21.15.39:0/2771766628 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2fb8064ee0 0x7f2fb8067390 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2fc00090b0 tx=0x7f2fc0008030 comp rx=0 tx=0).stop 2023-11-28T11:58:36.355 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.351+0000 7f2fd9a98700 1 -- 172.21.15.39:0/2771766628 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fd406ff10 msgr2=0x7f2fd415b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:36.355 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.351+0000 7f2fd9a98700 1 --2- 172.21.15.39:0/2771766628 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fd406ff10 0x7f2fd415b780 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f2fc800c550 tx=0x7f2fc800c860 comp rx=0 tx=0).stop 2023-11-28T11:58:36.356 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.351+0000 7f2fd9a98700 1 -- 172.21.15.39:0/2771766628 shutdown_connections 2023-11-28T11:58:36.356 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.351+0000 7f2fd9a98700 1 --2- 172.21.15.39:0/2771766628 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2fb8064ee0 0x7f2fb8067390 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:36.356 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.351+0000 7f2fd9a98700 1 --2- 172.21.15.39:0/2771766628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fd415e190 0x7f2fd40b3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:36.356 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.351+0000 7f2fd9a98700 1 --2- 172.21.15.39:0/2771766628 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fd40cdc50 0x7f2fd4154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:36.356 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.351+0000 7f2fd9a98700 1 --2- 172.21.15.39:0/2771766628 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fd406ff10 0x7f2fd415b780 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:36.357 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.351+0000 7f2fd9a98700 1 -- 172.21.15.39:0/2771766628 >> 172.21.15.39:0/2771766628 conn(0x7f2fd40cf280 msgr2=0x7f2fd40c3500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:36.357 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.351+0000 7f2fd9a98700 1 -- 172.21.15.39:0/2771766628 shutdown_connections 2023-11-28T11:58:36.357 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.355+0000 7f2fd9a98700 1 -- 172.21.15.39:0/2771766628 wait complete. 2023-11-28T11:58:36.379 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:58:36.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.563+0000 7fc6dcb29700 1 Processor -- start 2023-11-28T11:58:36.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.563+0000 7fc6dcb29700 1 -- start start 2023-11-28T11:58:36.567 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.563+0000 7fc6dcb29700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6d8070620 0x7fc6d80b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:36.567 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.563+0000 7fc6dcb29700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc6d8069bf0 0x7fc6d806a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:36.567 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.563+0000 7fc6dcb29700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6d815c520 con 0x7fc6d815c150 2023-11-28T11:58:36.567 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.563+0000 7fc6dcb29700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6d80b4240 con 0x7fc6d8069bf0 2023-11-28T11:58:36.567 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.563+0000 7fc6dcb29700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d806cc50 con 0x7fc6d8070620 2023-11-28T11:58:36.568 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.563+0000 7fc6d7fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc6d8069bf0 0x7fc6d806a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:36.568 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.563+0000 7fc6d6ffd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6d8070620 0x7fc6d80b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:36.568 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.563+0000 7fc6d77fe700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fc6d815c150 0x7fc6d806ff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:58326/0 (socket says 172.21.15.39:58326) 2023-11-28T11:58:36.568 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.563+0000 7fc6d77fe700 1 -- 172.21.15.39:0/3423279464 learned_addr learned my addr 172.21.15.39:0/3423279464 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:58:36.568 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.567+0000 7fc6d7fff700 1 -- 172.21.15.39:0/3423279464 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6d8070620 msgr2=0x7fc6d80b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:36.568 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.567+0000 7fc6d7fff700 1 --2- 172.21.15.39:0/3423279464 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6d8070620 0x7fc6d80b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:36.569 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.567+0000 7fc6d7fff700 1 -- 172.21.15.39:0/3423279464 >> v1:172.21.15.184:6789/0 conn(0x7fc6d815c150 legacy=0x7fc6d806ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:36.569 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.567+0000 7fc6d7fff700 1 -- 172.21.15.39:0/3423279464 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d80d2450 con 0x7fc6d8069bf0 2023-11-28T11:58:36.569 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.567+0000 7fc6d7fff700 1 --2- 172.21.15.39:0/3423279464 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6d8069bf0 0x7fc6d806a050 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0009d90 tx=0x7fc6d000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74cf97e5febe5a8c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:36.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.567+0000 7fc6d67fc700 1 -- 172.21.15.39:0/3423279464 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d000e070 con 0x7fc6d8069bf0 2023-11-28T11:58:36.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.567+0000 7fc6d67fc700 1 -- 172.21.15.39:0/3423279464 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d000bb20 con 0x7fc6d8069bf0 2023-11-28T11:58:36.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.567+0000 7fc6d67fc700 1 -- 172.21.15.39:0/3423279464 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0012430 con 0x7fc6d8069bf0 2023-11-28T11:58:36.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.567+0000 7fc6dcb29700 1 -- 172.21.15.39:0/3423279464 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6d8069bf0 msgr2=0x7fc6d806a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:36.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.567+0000 7fc6dcb29700 1 --2- 172.21.15.39:0/3423279464 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6d8069bf0 0x7fc6d806a050 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0009d90 tx=0x7fc6d000b330 comp rx=0 tx=0).stop 2023-11-28T11:58:36.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.567+0000 7fc6dcb29700 1 -- 172.21.15.39:0/3423279464 shutdown_connections 2023-11-28T11:58:36.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.567+0000 7fc6dcb29700 1 --2- 172.21.15.39:0/3423279464 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6d8069bf0 0x7fc6d806a050 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:36.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.567+0000 7fc6dcb29700 1 --2- 172.21.15.39:0/3423279464 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6d8070620 0x7fc6d80b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:36.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.567+0000 7fc6dcb29700 1 -- 172.21.15.39:0/3423279464 >> 172.21.15.39:0/3423279464 conn(0x7fc6d80d3680 msgr2=0x7fc6d80cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:36.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.567+0000 7fc6dcb29700 1 -- 172.21.15.39:0/3423279464 shutdown_connections 2023-11-28T11:58:36.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.567+0000 7fc6dcb29700 1 -- 172.21.15.39:0/3423279464 wait complete. 2023-11-28T11:58:36.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.571+0000 7fc6dcb29700 1 Processor -- start 2023-11-28T11:58:36.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.571+0000 7fc6dcb29700 1 -- start start 2023-11-28T11:58:36.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.571+0000 7fc6dcb29700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6d8069bf0 0x7fc6d81506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:36.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.571+0000 7fc6dcb29700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6d8070620 0x7fc6d80ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:36.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.571+0000 7fc6dcb29700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6d815c150 0x7fc6d80cbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:36.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.571+0000 7fc6dcb29700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d80cff90 con 0x7fc6d815c150 2023-11-28T11:58:36.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.571+0000 7fc6dcb29700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d80c9f50 con 0x7fc6d8070620 2023-11-28T11:58:36.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.571+0000 7fc6dcb29700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d8150be0 con 0x7fc6d8069bf0 2023-11-28T11:58:36.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.575+0000 7fc6d7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6d815c150 0x7fc6d80cbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:36.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.575+0000 7fc6d6ffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6d8070620 0x7fc6d80ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:36.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.575+0000 7fc6d7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6d815c150 0x7fc6d80cbbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48012/0 (socket says 172.21.15.39:48012) 2023-11-28T11:58:36.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.575+0000 7fc6d7fff700 1 -- 172.21.15.39:0/3968871920 learned_addr learned my addr 172.21.15.39:0/3968871920 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:36.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.575+0000 7fc6d77fe700 1 --2- 172.21.15.39:0/3968871920 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6d8069bf0 0x7fc6d81506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:36.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.575+0000 7fc6d6ffd700 1 -- 172.21.15.39:0/3968871920 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6d8069bf0 msgr2=0x7fc6d81506a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:36.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.575+0000 7fc6d6ffd700 1 --2- 172.21.15.39:0/3968871920 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6d8069bf0 0x7fc6d81506a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:36.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.575+0000 7fc6d6ffd700 1 -- 172.21.15.39:0/3968871920 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6d815c150 msgr2=0x7fc6d80cbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:36.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.575+0000 7fc6d6ffd700 1 --2- 172.21.15.39:0/3968871920 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6d815c150 0x7fc6d80cbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:36.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.575+0000 7fc6d6ffd700 1 -- 172.21.15.39:0/3968871920 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d0009a70 con 0x7fc6d8070620 2023-11-28T11:58:36.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.575+0000 7fc6d7fff700 1 --2- 172.21.15.39:0/3968871920 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6d815c150 0x7fc6d80cbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:58:36.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.575+0000 7fc6d6ffd700 1 --2- 172.21.15.39:0/3968871920 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6d8070620 0x7fc6d80ceff0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc00e8d0 tx=0x7fc6cc00ebe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:36.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.575+0000 7fc6bffff700 1 -- 172.21.15.39:0/3968871920 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc013680 con 0x7fc6d8070620 2023-11-28T11:58:36.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.575+0000 7fc6bffff700 1 -- 172.21.15.39:0/3968871920 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6cc0137e0 con 0x7fc6d8070620 2023-11-28T11:58:36.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.575+0000 7fc6bffff700 1 -- 172.21.15.39:0/3968871920 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc013b50 con 0x7fc6d8070620 2023-11-28T11:58:36.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.575+0000 7fc6dcb29700 1 -- 172.21.15.39:0/3968871920 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6d80d05e0 con 0x7fc6d8070620 2023-11-28T11:58:36.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.575+0000 7fc6dcb29700 1 -- 172.21.15.39:0/3968871920 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6d80d2730 con 0x7fc6d8070620 2023-11-28T11:58:36.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.579+0000 7fc6dcb29700 1 -- 172.21.15.39:0/3968871920 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6d80d2140 con 0x7fc6d8070620 2023-11-28T11:58:36.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.579+0000 7fc6bffff700 1 -- 172.21.15.39:0/3968871920 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc6cc019030 con 0x7fc6d8070620 2023-11-28T11:58:36.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.579+0000 7fc6bffff700 1 --2- 172.21.15.39:0/3968871920 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc6c4064f10 0x7fc6c40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:36.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.579+0000 7fc6bffff700 1 -- 172.21.15.39:0/3968871920 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fc6cc081fd0 con 0x7fc6d8070620 2023-11-28T11:58:36.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.583+0000 7fc6d77fe700 1 --2- 172.21.15.39:0/3968871920 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc6c4064f10 0x7fc6c40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:36.586 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.583+0000 7fc6d77fe700 1 --2- 172.21.15.39:0/3968871920 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc6c4064f10 0x7fc6c40673c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8005930 tx=0x7fc6c8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:36.592 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.591+0000 7fc6bffff700 1 -- 172.21.15.39:0/3968871920 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc6cc04fe80 con 0x7fc6d8070620 2023-11-28T11:58:36.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.767+0000 7fc6dcb29700 1 -- 172.21.15.39:0/3968871920 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc6d8073d20 con 0x7fc6d8070620 2023-11-28T11:58:36.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.767+0000 7fc6bffff700 1 -- 172.21.15.39:0/3968871920 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v46) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc6cc013cb0 con 0x7fc6d8070620 2023-11-28T11:58:36.770 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2023-11-28T11:58:36.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.771+0000 7fc6dcb29700 1 -- 172.21.15.39:0/3968871920 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc6c4064f10 msgr2=0x7fc6c40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:36.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.771+0000 7fc6dcb29700 1 --2- 172.21.15.39:0/3968871920 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc6c4064f10 0x7fc6c40673c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8005930 tx=0x7fc6c8009040 comp rx=0 tx=0).stop 2023-11-28T11:58:36.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.771+0000 7fc6dcb29700 1 -- 172.21.15.39:0/3968871920 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6d8070620 msgr2=0x7fc6d80ceff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:36.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.771+0000 7fc6dcb29700 1 --2- 172.21.15.39:0/3968871920 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6d8070620 0x7fc6d80ceff0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc00e8d0 tx=0x7fc6cc00ebe0 comp rx=0 tx=0).stop 2023-11-28T11:58:36.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.771+0000 7fc6dcb29700 1 -- 172.21.15.39:0/3968871920 shutdown_connections 2023-11-28T11:58:36.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.771+0000 7fc6dcb29700 1 --2- 172.21.15.39:0/3968871920 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6d815c150 0x7fc6d80cbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:36.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.771+0000 7fc6dcb29700 1 --2- 172.21.15.39:0/3968871920 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc6c4064f10 0x7fc6c40673c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:36.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.771+0000 7fc6dcb29700 1 --2- 172.21.15.39:0/3968871920 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6d8070620 0x7fc6d80ceff0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:36.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.771+0000 7fc6dcb29700 1 --2- 172.21.15.39:0/3968871920 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6d8069bf0 0x7fc6d81506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:36.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.771+0000 7fc6dcb29700 1 -- 172.21.15.39:0/3968871920 >> 172.21.15.39:0/3968871920 conn(0x7fc6d80d3680 msgr2=0x7fc6d8155890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:36.776 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.771+0000 7fc6dcb29700 1 -- 172.21.15.39:0/3968871920 shutdown_connections 2023-11-28T11:58:36.776 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.771+0000 7fc6dcb29700 1 -- 172.21.15.39:0/3968871920 wait complete. 2023-11-28T11:58:36.798 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:58:36.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.975+0000 7f4025190700 1 Processor -- start 2023-11-28T11:58:36.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.975+0000 7f4025190700 1 -- start start 2023-11-28T11:58:36.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.975+0000 7f4025190700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f40200b43a0 0x7f402015e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:36.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.975+0000 7f4025190700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f40200b1640 0x7f4020070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:36.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.975+0000 7f4025190700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f402015a550 con 0x7f40200c9040 2023-11-28T11:58:36.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.975+0000 7f4025190700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f402006b0a0 con 0x7f40200b1640 2023-11-28T11:58:36.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.975+0000 7f4025190700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40200caac0 con 0x7f40200b43a0 2023-11-28T11:58:36.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.975+0000 7f40177fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f40200b1640 0x7f4020070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:36.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.975+0000 7f40177fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f40200b1640 0x7f4020070080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48026/0 (socket says 172.21.15.39:48026) 2023-11-28T11:58:36.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.975+0000 7f40177fe700 1 -- 172.21.15.39:0/1412301937 learned_addr learned my addr 172.21.15.39:0/1412301937 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:36.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.975+0000 7f401ffff700 1 --2- 172.21.15.39:0/1412301937 >> v2:172.21.15.184:3300/0 conn(0x7f40200b43a0 0x7f402015e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:36.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.975+0000 7f40177fe700 1 -- 172.21.15.39:0/1412301937 >> v2:172.21.15.184:3300/0 conn(0x7f40200b43a0 msgr2=0x7f402015e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:36.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.975+0000 7f40177fe700 1 --2- 172.21.15.39:0/1412301937 >> v2:172.21.15.184:3300/0 conn(0x7f40200b43a0 0x7f402015e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:36.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.975+0000 7f40177fe700 1 -- 172.21.15.39:0/1412301937 >> v1:172.21.15.184:6789/0 conn(0x7f40200c9040 legacy=0x7f4020069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:36.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.975+0000 7f40177fe700 1 -- 172.21.15.39:0/1412301937 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40200cada0 con 0x7f40200b1640 2023-11-28T11:58:36.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.975+0000 7f40177fe700 1 --2- 172.21.15.39:0/1412301937 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40200b1640 0x7f4020070080 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f402006fe80 tx=0x7f4008009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a2a46d9d27e4eb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:36.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.979+0000 7f401f7fe700 1 -- 172.21.15.39:0/1412301937 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400800b8a0 con 0x7f40200b1640 2023-11-28T11:58:36.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.979+0000 7f401f7fe700 1 -- 172.21.15.39:0/1412301937 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400800ba00 con 0x7f40200b1640 2023-11-28T11:58:36.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.979+0000 7f401f7fe700 1 -- 172.21.15.39:0/1412301937 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400800bd90 con 0x7f40200b1640 2023-11-28T11:58:36.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.979+0000 7f4025190700 1 -- 172.21.15.39:0/1412301937 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40200b1640 msgr2=0x7f4020070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:36.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.979+0000 7f4025190700 1 --2- 172.21.15.39:0/1412301937 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40200b1640 0x7f4020070080 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f402006fe80 tx=0x7f4008009bf0 comp rx=0 tx=0).stop 2023-11-28T11:58:36.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.979+0000 7f4025190700 1 -- 172.21.15.39:0/1412301937 shutdown_connections 2023-11-28T11:58:36.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.979+0000 7f4025190700 1 --2- 172.21.15.39:0/1412301937 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40200b1640 0x7f4020070080 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:36.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.979+0000 7f4025190700 1 --2- 172.21.15.39:0/1412301937 >> v2:172.21.15.184:3300/0 conn(0x7f40200b43a0 0x7f402015e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:36.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.979+0000 7f4025190700 1 -- 172.21.15.39:0/1412301937 >> 172.21.15.39:0/1412301937 conn(0x7f40200b0f80 msgr2=0x7f40200ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:36.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.979+0000 7f4025190700 1 -- 172.21.15.39:0/1412301937 shutdown_connections 2023-11-28T11:58:36.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.979+0000 7f4025190700 1 -- 172.21.15.39:0/1412301937 wait complete. 2023-11-28T11:58:36.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.979+0000 7f4025190700 1 Processor -- start 2023-11-28T11:58:36.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.983+0000 7f4025190700 1 -- start start 2023-11-28T11:58:36.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.983+0000 7f4025190700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40200b1640 0x7f4020157950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:36.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.983+0000 7f4025190700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40200b43a0 0x7f40200cd800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:36.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.983+0000 7f4025190700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40200c9040 0x7f4020070040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:36.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.983+0000 7f4025190700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40200ce1e0 con 0x7f40200c9040 2023-11-28T11:58:36.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.983+0000 7f4025190700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40201f17c0 con 0x7f40200b1640 2023-11-28T11:58:36.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.983+0000 7f4025190700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40201f1aa0 con 0x7f40200b43a0 2023-11-28T11:58:36.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.983+0000 7f402498f700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40200c9040 0x7f4020070040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:36.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.983+0000 7f402498f700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40200c9040 0x7f4020070040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48038/0 (socket says 172.21.15.39:48038) 2023-11-28T11:58:36.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.983+0000 7f402498f700 1 -- 172.21.15.39:0/1213500085 learned_addr learned my addr 172.21.15.39:0/1213500085 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:36.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.983+0000 7f401ffff700 1 --2- 172.21.15.39:0/1213500085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40200b1640 0x7f4020157950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:36.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.983+0000 7f40177fe700 1 --2- 172.21.15.39:0/1213500085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40200b43a0 0x7f40200cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:36.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.983+0000 7f402498f700 1 -- 172.21.15.39:0/1213500085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40200b43a0 msgr2=0x7f40200cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:36.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.983+0000 7f402498f700 1 --2- 172.21.15.39:0/1213500085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40200b43a0 0x7f40200cd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:36.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.983+0000 7f402498f700 1 -- 172.21.15.39:0/1213500085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40200b1640 msgr2=0x7f4020157950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:36.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.983+0000 7f402498f700 1 --2- 172.21.15.39:0/1213500085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40200b1640 0x7f4020157950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:36.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.983+0000 7f402498f700 1 -- 172.21.15.39:0/1213500085 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4008009570 con 0x7f40200c9040 2023-11-28T11:58:36.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.983+0000 7f402498f700 1 --2- 172.21.15.39:0/1213500085 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40200c9040 0x7f4020070040 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f401800c480 tx=0x7f401800c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:36.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.983+0000 7f401d7fa700 1 -- 172.21.15.39:0/1213500085 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40180052d0 con 0x7f40200c9040 2023-11-28T11:58:36.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.983+0000 7f401d7fa700 1 -- 172.21.15.39:0/1213500085 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4018005430 con 0x7f40200c9040 2023-11-28T11:58:36.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.983+0000 7f401d7fa700 1 -- 172.21.15.39:0/1213500085 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40180055a0 con 0x7f40200c9040 2023-11-28T11:58:36.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.983+0000 7f4025190700 1 -- 172.21.15.39:0/1213500085 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f402006b5d0 con 0x7f40200c9040 2023-11-28T11:58:36.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.987+0000 7f4025190700 1 -- 172.21.15.39:0/1213500085 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f402006b2f0 con 0x7f40200c9040 2023-11-28T11:58:36.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.987+0000 7f4025190700 1 -- 172.21.15.39:0/1213500085 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40200ce320 con 0x7f40200c9040 2023-11-28T11:58:36.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.987+0000 7f401d7fa700 1 -- 172.21.15.39:0/1213500085 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4018019030 con 0x7f40200c9040 2023-11-28T11:58:36.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.991+0000 7f401d7fa700 1 --2- 172.21.15.39:0/1213500085 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4000064ee0 0x7f4000067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:36.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.991+0000 7f401d7fa700 1 -- 172.21.15.39:0/1213500085 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f40180810c0 con 0x7f40200c9040 2023-11-28T11:58:36.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.991+0000 7f401ffff700 1 --2- 172.21.15.39:0/1213500085 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4000064ee0 0x7f4000067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:36.994 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.991+0000 7f401ffff700 1 --2- 172.21.15.39:0/1213500085 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4000064ee0 0x7f4000067390 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f402015a3a0 tx=0x7f40100098a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:36.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:36.995+0000 7f401d7fa700 1 -- 172.21.15.39:0/1213500085 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f401804f1a0 con 0x7f40200c9040 2023-11-28T11:58:37.206 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.203+0000 7f4025190700 1 -- 172.21.15.39:0/1213500085 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f402015eaf0 con 0x7f40200c9040 2023-11-28T11:58:37.208 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.203+0000 7f401d7fa700 1 -- 172.21.15.39:0/1213500085 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4654 (secure 0 0 0) 0x7f40180527c0 con 0x7f40200c9040 2023-11-28T11:58:37.208 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:58:37.208 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/3875562914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3875562914},{"type":"v1","addr":"172.21.15.184:6836","nonce":3875562914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5295,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/4053840838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":4053840838},{"type":"v1","addr":"172.21.15.39:6833","nonce":4053840838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5304,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2819411287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2819411287},{"type":"v1","addr":"172.21.15.39:6835","nonce":2819411287}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:58:03.228365+0000","modified":"2023-11-28T11:58:06.252058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5317},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5317":{"gid":5317,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.184:6837/2775071992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":2775071992},{"type":"v1","addr":"172.21.15.184:6837","nonce":2775071992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T11:58:37.212 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.211+0000 7f4025190700 1 -- 172.21.15.39:0/1213500085 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4000064ee0 msgr2=0x7f4000067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:37.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.211+0000 7f4025190700 1 --2- 172.21.15.39:0/1213500085 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4000064ee0 0x7f4000067390 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f402015a3a0 tx=0x7f40100098a0 comp rx=0 tx=0).stop 2023-11-28T11:58:37.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.211+0000 7f4025190700 1 -- 172.21.15.39:0/1213500085 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40200c9040 msgr2=0x7f4020070040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:37.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.211+0000 7f4025190700 1 --2- 172.21.15.39:0/1213500085 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40200c9040 0x7f4020070040 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f401800c480 tx=0x7f401800c790 comp rx=0 tx=0).stop 2023-11-28T11:58:37.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.211+0000 7f4025190700 1 -- 172.21.15.39:0/1213500085 shutdown_connections 2023-11-28T11:58:37.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.211+0000 7f4025190700 1 --2- 172.21.15.39:0/1213500085 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40200c9040 0x7f4020070040 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:37.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.211+0000 7f4025190700 1 --2- 172.21.15.39:0/1213500085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40200b43a0 0x7f40200cd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:37.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.211+0000 7f4025190700 1 --2- 172.21.15.39:0/1213500085 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4000064ee0 0x7f4000067390 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:37.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.211+0000 7f4025190700 1 --2- 172.21.15.39:0/1213500085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40200b1640 0x7f4020157950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:37.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.211+0000 7f4025190700 1 -- 172.21.15.39:0/1213500085 >> 172.21.15.39:0/1213500085 conn(0x7f40200b0f80 msgr2=0x7f40200ae6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:37.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.211+0000 7f4025190700 1 -- 172.21.15.39:0/1213500085 shutdown_connections 2023-11-28T11:58:37.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.211+0000 7f4025190700 1 -- 172.21.15.39:0/1213500085 wait complete. 2023-11-28T11:58:37.216 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 16 2023-11-28T11:58:37.236 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:58:37.417 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.415+0000 7f73216c3700 1 Processor -- start 2023-11-28T11:58:37.417 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.415+0000 7f73216c3700 1 -- start start 2023-11-28T11:58:37.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.415+0000 7f73216c3700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f731c15a480 0x7f731c0cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:37.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.415+0000 7f73216c3700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f731c0c8d10 0x7f731c0cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:37.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.415+0000 7f73216c3700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f731c15a850 con 0x7f731c0ccd10 2023-11-28T11:58:37.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.415+0000 7f73216c3700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f731c0ce060 con 0x7f731c0c8d10 2023-11-28T11:58:37.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.415+0000 7f73216c3700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f731c0ce300 con 0x7f731c15a480 2023-11-28T11:58:37.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.415+0000 7f731affd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f731c15a480 0x7f731c0cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:37.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.415+0000 7f731a7fc700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f731c0c8d10 0x7f731c0cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:37.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.415+0000 7f731b7fe700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f731c0ccd10 0x7f731c15dee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:58356/0 (socket says 172.21.15.39:58356) 2023-11-28T11:58:37.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.415+0000 7f731b7fe700 1 -- 172.21.15.39:0/2072129917 learned_addr learned my addr 172.21.15.39:0/2072129917 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:58:37.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.419+0000 7f731affd700 1 -- 172.21.15.39:0/2072129917 >> v2:172.21.15.184:3300/0 conn(0x7f731c0c8d10 msgr2=0x7f731c0cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:37.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.419+0000 7f731affd700 1 --2- 172.21.15.39:0/2072129917 >> v2:172.21.15.184:3300/0 conn(0x7f731c0c8d10 0x7f731c0cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:37.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.419+0000 7f731affd700 1 -- 172.21.15.39:0/2072129917 >> v1:172.21.15.184:6789/0 conn(0x7f731c0ccd10 legacy=0x7f731c15dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:37.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.419+0000 7f731affd700 1 -- 172.21.15.39:0/2072129917 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f731c0cada0 con 0x7f731c15a480 2023-11-28T11:58:37.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.419+0000 7f731affd700 1 --2- 172.21.15.39:0/2072129917 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f731c15a480 0x7f731c0cc290 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f730c009850 tx=0x7f730c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=961227f42bb40fa8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:37.422 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.419+0000 7f7319ffb700 1 -- 172.21.15.39:0/2072129917 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730c011830 con 0x7f731c15a480 2023-11-28T11:58:37.422 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.419+0000 7f7319ffb700 1 -- 172.21.15.39:0/2072129917 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730c011990 con 0x7f731c15a480 2023-11-28T11:58:37.422 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.419+0000 7f7319ffb700 1 -- 172.21.15.39:0/2072129917 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730c011d40 con 0x7f731c15a480 2023-11-28T11:58:37.423 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.419+0000 7f73216c3700 1 -- 172.21.15.39:0/2072129917 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f731c15a480 msgr2=0x7f731c0cc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:37.424 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.419+0000 7f73216c3700 1 --2- 172.21.15.39:0/2072129917 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f731c15a480 0x7f731c0cc290 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f730c009850 tx=0x7f730c009b60 comp rx=0 tx=0).stop 2023-11-28T11:58:37.424 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.419+0000 7f73216c3700 1 -- 172.21.15.39:0/2072129917 shutdown_connections 2023-11-28T11:58:37.424 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.419+0000 7f73216c3700 1 --2- 172.21.15.39:0/2072129917 >> v2:172.21.15.184:3300/0 conn(0x7f731c0c8d10 0x7f731c0cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:37.424 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.419+0000 7f73216c3700 1 --2- 172.21.15.39:0/2072129917 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f731c15a480 0x7f731c0cc290 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:37.424 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.419+0000 7f73216c3700 1 -- 172.21.15.39:0/2072129917 >> 172.21.15.39:0/2072129917 conn(0x7f731c0cf350 msgr2=0x7f731c0b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:37.425 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.419+0000 7f73216c3700 1 -- 172.21.15.39:0/2072129917 shutdown_connections 2023-11-28T11:58:37.425 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.419+0000 7f73216c3700 1 -- 172.21.15.39:0/2072129917 wait complete. 2023-11-28T11:58:37.427 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.423+0000 7f73216c3700 1 Processor -- start 2023-11-28T11:58:37.427 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.423+0000 7f73216c3700 1 -- start start 2023-11-28T11:58:37.430 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.427+0000 7f73216c3700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f731c0c8d10 0x7f731c15bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:37.430 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.427+0000 7f73216c3700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f731c0ccd10 0x7f731c15d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:37.430 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.427+0000 7f73216c3700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f731c15a480 0x7f731c15a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:37.430 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.427+0000 7f73216c3700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731c1524d0 con 0x7f731c0c8d10 2023-11-28T11:58:37.430 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.427+0000 7f73216c3700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731c15b1c0 con 0x7f731c0ccd10 2023-11-28T11:58:37.430 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.427+0000 7f73216c3700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f731c1f0560 con 0x7f731c15a480 2023-11-28T11:58:37.430 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.427+0000 7f731affd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f731c0c8d10 0x7f731c15bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:37.431 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.427+0000 7f731affd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f731c0c8d10 0x7f731c15bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48048/0 (socket says 172.21.15.39:48048) 2023-11-28T11:58:37.431 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.427+0000 7f731affd700 1 -- 172.21.15.39:0/2642849354 learned_addr learned my addr 172.21.15.39:0/2642849354 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:37.431 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.427+0000 7f731a7fc700 1 --2- 172.21.15.39:0/2642849354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f731c0ccd10 0x7f731c15d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:37.431 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.427+0000 7f731b7fe700 1 --2- 172.21.15.39:0/2642849354 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f731c15a480 0x7f731c15a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:37.432 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.427+0000 7f731affd700 1 -- 172.21.15.39:0/2642849354 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f731c15a480 msgr2=0x7f731c15a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:37.432 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.427+0000 7f731affd700 1 --2- 172.21.15.39:0/2642849354 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f731c15a480 0x7f731c15a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:37.432 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.427+0000 7f731affd700 1 -- 172.21.15.39:0/2642849354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f731c0ccd10 msgr2=0x7f731c15d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:37.432 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.427+0000 7f731affd700 1 --2- 172.21.15.39:0/2642849354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f731c0ccd10 0x7f731c15d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:37.432 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.427+0000 7f731affd700 1 -- 172.21.15.39:0/2642849354 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f730c0094b0 con 0x7f731c0c8d10 2023-11-28T11:58:37.432 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.427+0000 7f731affd700 1 --2- 172.21.15.39:0/2642849354 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f731c0c8d10 0x7f731c15bcd0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f730c0097a0 tx=0x7f730c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:37.432 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.427+0000 7f73037fe700 1 -- 172.21.15.39:0/2642849354 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730c0036c0 con 0x7f731c0c8d10 2023-11-28T11:58:37.433 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.427+0000 7f73037fe700 1 -- 172.21.15.39:0/2642849354 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730c003840 con 0x7f731c0c8d10 2023-11-28T11:58:37.433 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.427+0000 7f73037fe700 1 -- 172.21.15.39:0/2642849354 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730c003bf0 con 0x7f731c0c8d10 2023-11-28T11:58:37.433 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.427+0000 7f73216c3700 1 -- 172.21.15.39:0/2642849354 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f731c0add50 con 0x7f731c0c8d10 2023-11-28T11:58:37.433 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.427+0000 7f73216c3700 1 -- 172.21.15.39:0/2642849354 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f731c0caa30 con 0x7f731c0c8d10 2023-11-28T11:58:37.433 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.431+0000 7f73216c3700 1 -- 172.21.15.39:0/2642849354 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f731c0ca6e0 con 0x7f731c0c8d10 2023-11-28T11:58:37.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.431+0000 7f73037fe700 1 -- 172.21.15.39:0/2642849354 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f730c00f050 con 0x7f731c0c8d10 2023-11-28T11:58:37.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.435+0000 7f73037fe700 1 --2- 172.21.15.39:0/2642849354 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7308064ee0 0x7f7308067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:37.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.435+0000 7f73037fe700 1 -- 172.21.15.39:0/2642849354 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f730c083480 con 0x7f731c0c8d10 2023-11-28T11:58:37.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.435+0000 7f731a7fc700 1 --2- 172.21.15.39:0/2642849354 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7308064ee0 0x7f7308067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:37.439 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.435+0000 7f731a7fc700 1 --2- 172.21.15.39:0/2642849354 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7308064ee0 0x7f7308067390 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f731c0b3610 tx=0x7f7310009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:37.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.439+0000 7f73037fe700 1 -- 172.21.15.39:0/2642849354 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f730c0513b0 con 0x7f731c0c8d10 2023-11-28T11:58:37.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.611+0000 7f73216c3700 1 -- 172.21.15.39:0/2642849354 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f731c0726c0 con 0x7f731c0c8d10 2023-11-28T11:58:37.616 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.615+0000 7f73037fe700 1 -- 172.21.15.39:0/2642849354 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+18183 (secure 0 0 0) 0x7f730c0549d0 con 0x7f731c0c8d10 2023-11-28T11:58:37.617 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:58:37.617 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":46,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:58:22.793502+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:58:01.523189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-28T11:58:02.259575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.f","mappings":[{"from":0,"to":5}]},{"pgid":"7.12","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:58:37.619 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.615+0000 7f73216c3700 1 -- 172.21.15.39:0/2642849354 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7308064ee0 msgr2=0x7f7308067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:37.620 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.615+0000 7f73216c3700 1 --2- 172.21.15.39:0/2642849354 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7308064ee0 0x7f7308067390 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f731c0b3610 tx=0x7f7310009240 comp rx=0 tx=0).stop 2023-11-28T11:58:37.620 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.615+0000 7f73216c3700 1 -- 172.21.15.39:0/2642849354 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f731c0c8d10 msgr2=0x7f731c15bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:37.620 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.615+0000 7f73216c3700 1 --2- 172.21.15.39:0/2642849354 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f731c0c8d10 0x7f731c15bcd0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f730c0097a0 tx=0x7f730c004770 comp rx=0 tx=0).stop 2023-11-28T11:58:37.620 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.615+0000 7f73216c3700 1 -- 172.21.15.39:0/2642849354 shutdown_connections 2023-11-28T11:58:37.621 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.615+0000 7f73216c3700 1 --2- 172.21.15.39:0/2642849354 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f731c15a480 0x7f731c15a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:37.621 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.615+0000 7f73216c3700 1 --2- 172.21.15.39:0/2642849354 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7308064ee0 0x7f7308067390 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:37.621 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.615+0000 7f73216c3700 1 --2- 172.21.15.39:0/2642849354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f731c0ccd10 0x7f731c15d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:37.622 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.615+0000 7f73216c3700 1 --2- 172.21.15.39:0/2642849354 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f731c0c8d10 0x7f731c15bcd0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:37.622 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.615+0000 7f73216c3700 1 -- 172.21.15.39:0/2642849354 >> 172.21.15.39:0/2642849354 conn(0x7f731c0cf350 msgr2=0x7f731c154be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:37.622 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.615+0000 7f73216c3700 1 -- 172.21.15.39:0/2642849354 shutdown_connections 2023-11-28T11:58:37.622 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.619+0000 7f73216c3700 1 -- 172.21.15.39:0/2642849354 wait complete. 2023-11-28T11:58:37.643 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T11:58:37.644 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:58:37.829 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.827+0000 7f79a5676700 1 Processor -- start 2023-11-28T11:58:37.829 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.827+0000 7f79a5676700 1 -- start start 2023-11-28T11:58:37.831 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.827+0000 7f79a5676700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79a0160710 0x7f79a00cc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:37.831 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.827+0000 7f79a5676700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a00ad6c0 con 0x7f79a0070790 2023-11-28T11:58:37.831 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.827+0000 7f79a5676700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a00adc60 con 0x7f79a00cc860 2023-11-28T11:58:37.831 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.827+0000 7f79a5676700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a006b1c0 con 0x7f79a0160710 2023-11-28T11:58:37.832 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.827+0000 7f79a4e75700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f79a0070790 0x7f79a0164250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:43674/0 (socket says 172.21.15.39:43674) 2023-11-28T11:58:37.832 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.827+0000 7f79a4e75700 1 -- 172.21.15.39:0/768803600 learned_addr learned my addr 172.21.15.39:0/768803600 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:58:37.832 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.827+0000 7f799ffff700 1 --2- 172.21.15.39:0/768803600 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79a0160710 0x7f79a00cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:37.833 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.831+0000 7f799effd700 1 -- 172.21.15.39:0/768803600 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2704233037 0 0) 0x7f79a00adc60 con 0x7f79a00cc860 2023-11-28T11:58:37.833 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.831+0000 7f799effd700 1 -- 172.21.15.39:0/768803600 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79880035d0 con 0x7f79a00cc860 2023-11-28T11:58:37.833 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.831+0000 7f799effd700 1 -- 172.21.15.39:0/768803600 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 541385449 0 0) 0x7f79a00ad6c0 con 0x7f79a0070790 2023-11-28T11:58:37.834 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.831+0000 7f799ffff700 1 -- 172.21.15.39:0/768803600 >> v1:172.21.15.184:6789/0 conn(0x7f79a00cc860 legacy=0x7f79a0070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:37.834 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.831+0000 7f799ffff700 1 -- 172.21.15.39:0/768803600 >> v1:172.21.15.39:6789/0 conn(0x7f79a0070790 legacy=0x7f79a0164250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:37.834 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.831+0000 7f799ffff700 1 -- 172.21.15.39:0/768803600 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a006b3d0 con 0x7f79a0160710 2023-11-28T11:58:37.835 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.831+0000 7f799ffff700 1 --2- 172.21.15.39:0/768803600 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79a0160710 0x7f79a00cc320 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7990009880 tx=0x7f7990009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=926c24d82a1f902c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:37.835 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.831+0000 7f799effd700 1 -- 172.21.15.39:0/768803600 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7990011830 con 0x7f79a0160710 2023-11-28T11:58:37.835 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.831+0000 7f799effd700 1 -- 172.21.15.39:0/768803600 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7990011990 con 0x7f79a0160710 2023-11-28T11:58:37.836 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.831+0000 7f799effd700 1 -- 172.21.15.39:0/768803600 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7990011d20 con 0x7f79a0160710 2023-11-28T11:58:37.836 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.831+0000 7f79a5676700 1 -- 172.21.15.39:0/768803600 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79a0160710 msgr2=0x7f79a00cc320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:37.836 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.831+0000 7f79a5676700 1 --2- 172.21.15.39:0/768803600 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79a0160710 0x7f79a00cc320 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7990009880 tx=0x7f7990009b90 comp rx=0 tx=0).stop 2023-11-28T11:58:37.837 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.831+0000 7f79a5676700 1 -- 172.21.15.39:0/768803600 shutdown_connections 2023-11-28T11:58:37.837 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.831+0000 7f79a5676700 1 --2- 172.21.15.39:0/768803600 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79a0160710 0x7f79a00cc320 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:37.837 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.831+0000 7f79a5676700 1 -- 172.21.15.39:0/768803600 >> 172.21.15.39:0/768803600 conn(0x7f79a00b0f80 msgr2=0x7f79a00ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:37.838 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.831+0000 7f79a5676700 1 -- 172.21.15.39:0/768803600 shutdown_connections 2023-11-28T11:58:37.838 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.835+0000 7f79a5676700 1 -- 172.21.15.39:0/768803600 wait complete. 2023-11-28T11:58:37.839 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.835+0000 7f79a5676700 1 Processor -- start 2023-11-28T11:58:37.839 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.835+0000 7f79a5676700 1 -- start start 2023-11-28T11:58:37.843 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.839+0000 7f79a5676700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79a0070790 0x7f79a0159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:37.843 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.839+0000 7f79a5676700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79a00cc860 0x7f79a015f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:37.843 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.839+0000 7f79a5676700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79a0160710 0x7f79a015d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:37.843 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.839+0000 7f79a5676700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a00c30d0 con 0x7f79a0070790 2023-11-28T11:58:37.843 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.839+0000 7f79a5676700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a015a300 con 0x7f79a0160710 2023-11-28T11:58:37.843 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.839+0000 7f79a5676700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a015ff70 con 0x7f79a00cc860 2023-11-28T11:58:37.843 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.839+0000 7f799ffff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79a0070790 0x7f79a0159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:37.843 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.839+0000 7f799ffff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79a0070790 0x7f79a0159ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48054/0 (socket says 172.21.15.39:48054) 2023-11-28T11:58:37.844 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.839+0000 7f799ffff700 1 -- 172.21.15.39:0/2910183351 learned_addr learned my addr 172.21.15.39:0/2910183351 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:37.844 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.839+0000 7f79a4e75700 1 --2- 172.21.15.39:0/2910183351 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79a0160710 0x7f79a015d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:37.844 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.839+0000 7f799f7fe700 1 --2- 172.21.15.39:0/2910183351 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79a00cc860 0x7f79a015f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:37.844 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.839+0000 7f799ffff700 1 -- 172.21.15.39:0/2910183351 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79a00cc860 msgr2=0x7f79a015f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:37.844 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.839+0000 7f799ffff700 1 --2- 172.21.15.39:0/2910183351 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79a00cc860 0x7f79a015f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:37.844 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.839+0000 7f799ffff700 1 -- 172.21.15.39:0/2910183351 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79a0160710 msgr2=0x7f79a015d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:37.844 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.839+0000 7f799ffff700 1 --2- 172.21.15.39:0/2910183351 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79a0160710 0x7f79a015d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:37.844 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.839+0000 7f799ffff700 1 -- 172.21.15.39:0/2910183351 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79900094b0 con 0x7f79a0070790 2023-11-28T11:58:37.844 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.839+0000 7f79a4e75700 1 --2- 172.21.15.39:0/2910183351 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79a0160710 0x7f79a015d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:58:37.844 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.839+0000 7f799ffff700 1 --2- 172.21.15.39:0/2910183351 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79a0070790 0x7f79a0159ac0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f7990013040 tx=0x7f7990004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:37.845 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.839+0000 7f799cff9700 1 -- 172.21.15.39:0/2910183351 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7990006ea0 con 0x7f79a0070790 2023-11-28T11:58:37.845 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.839+0000 7f799cff9700 1 -- 172.21.15.39:0/2910183351 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799001e070 con 0x7f79a0070790 2023-11-28T11:58:37.845 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.839+0000 7f799cff9700 1 -- 172.21.15.39:0/2910183351 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7990019ca0 con 0x7f79a0070790 2023-11-28T11:58:37.845 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.839+0000 7f79a5676700 1 -- 172.21.15.39:0/2910183351 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79a00ad8f0 con 0x7f79a0070790 2023-11-28T11:58:37.845 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.839+0000 7f79a5676700 1 -- 172.21.15.39:0/2910183351 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79a006b6b0 con 0x7f79a0070790 2023-11-28T11:58:37.846 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.843+0000 7f79a5676700 1 -- 172.21.15.39:0/2910183351 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79a0160ae0 con 0x7f79a0070790 2023-11-28T11:58:37.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.843+0000 7f799cff9700 1 -- 172.21.15.39:0/2910183351 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f799000f050 con 0x7f79a0070790 2023-11-28T11:58:37.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.843+0000 7f799cff9700 1 --2- 172.21.15.39:0/2910183351 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f798c064ee0 0x7f798c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:37.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.843+0000 7f799cff9700 1 -- 172.21.15.39:0/2910183351 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f7990082ff0 con 0x7f79a0070790 2023-11-28T11:58:37.848 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.847+0000 7f799f7fe700 1 --2- 172.21.15.39:0/2910183351 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f798c064ee0 0x7f798c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:37.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.847+0000 7f799f7fe700 1 --2- 172.21.15.39:0/2910183351 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f798c064ee0 0x7f798c067390 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7994007fd0 tx=0x7f7994009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:37.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:37.851+0000 7f799cff9700 1 -- 172.21.15.39:0/2910183351 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7990051010 con 0x7f79a0070790 2023-11-28T11:58:38.064 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.063+0000 7f79a5676700 1 -- 172.21.15.39:0/2910183351 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f79a0073cb0 con 0x7f79a0070790 2023-11-28T11:58:38.066 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.063+0000 7f799cff9700 1 -- 172.21.15.39:0/2910183351 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4654 (secure 0 0 0) 0x7f7990020090 con 0x7f79a0070790 2023-11-28T11:58:38.066 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:58:38.066 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/3875562914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3875562914},{"type":"v1","addr":"172.21.15.184:6836","nonce":3875562914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5295,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/4053840838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":4053840838},{"type":"v1","addr":"172.21.15.39:6833","nonce":4053840838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5304,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2819411287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2819411287},{"type":"v1","addr":"172.21.15.39:6835","nonce":2819411287}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:58:03.228365+0000","modified":"2023-11-28T11:58:06.252058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5317},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5317":{"gid":5317,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.184:6837/2775071992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":2775071992},{"type":"v1","addr":"172.21.15.184:6837","nonce":2775071992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T11:58:38.069 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.067+0000 7f79a5676700 1 -- 172.21.15.39:0/2910183351 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f798c064ee0 msgr2=0x7f798c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:38.069 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.067+0000 7f79a5676700 1 --2- 172.21.15.39:0/2910183351 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f798c064ee0 0x7f798c067390 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7994007fd0 tx=0x7f7994009040 comp rx=0 tx=0).stop 2023-11-28T11:58:38.069 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.067+0000 7f79a5676700 1 -- 172.21.15.39:0/2910183351 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79a0070790 msgr2=0x7f79a0159ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:38.069 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.067+0000 7f79a5676700 1 --2- 172.21.15.39:0/2910183351 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79a0070790 0x7f79a0159ac0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f7990013040 tx=0x7f7990004770 comp rx=0 tx=0).stop 2023-11-28T11:58:38.069 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.067+0000 7f79a5676700 1 -- 172.21.15.39:0/2910183351 shutdown_connections 2023-11-28T11:58:38.069 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.067+0000 7f79a5676700 1 --2- 172.21.15.39:0/2910183351 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f798c064ee0 0x7f798c067390 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:38.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.067+0000 7f79a5676700 1 --2- 172.21.15.39:0/2910183351 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79a0160710 0x7f79a015d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:38.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.067+0000 7f79a5676700 1 --2- 172.21.15.39:0/2910183351 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79a00cc860 0x7f79a015f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:38.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.067+0000 7f79a5676700 1 --2- 172.21.15.39:0/2910183351 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79a0070790 0x7f79a0159ac0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:38.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.067+0000 7f79a5676700 1 -- 172.21.15.39:0/2910183351 >> 172.21.15.39:0/2910183351 conn(0x7f79a00b0f80 msgr2=0x7f79a00afb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:38.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.067+0000 7f79a5676700 1 -- 172.21.15.39:0/2910183351 shutdown_connections 2023-11-28T11:58:38.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.067+0000 7f79a5676700 1 -- 172.21.15.39:0/2910183351 wait complete. 2023-11-28T11:58:38.072 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 16 2023-11-28T11:58:38.094 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:58:38.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.267+0000 7f4915cbc700 1 Processor -- start 2023-11-28T11:58:38.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.267+0000 7f4915cbc700 1 -- start start 2023-11-28T11:58:38.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.267+0000 7f4915cbc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4910071aa0 0x7f491006d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:38.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.267+0000 7f4915cbc700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f4910069e00 0x7f491006a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:38.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.267+0000 7f4915cbc700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f491006c600 con 0x7f491015c640 2023-11-28T11:58:38.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.267+0000 7f4915cbc700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f491006cef0 con 0x7f4910069e00 2023-11-28T11:58:38.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.267+0000 7f4915cbc700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49100d38f0 con 0x7f4910071aa0 2023-11-28T11:58:38.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.267+0000 7f4907fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4910071aa0 0x7f491006d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:38.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.267+0000 7f4914cba700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f491015c640 0x7f49100d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42392/0 (socket says 172.21.15.39:42392) 2023-11-28T11:58:38.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.267+0000 7f4914cba700 1 -- 172.21.15.39:0/1521100591 learned_addr learned my addr 172.21.15.39:0/1521100591 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:58:38.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.267+0000 7f49154bb700 1 --2- 172.21.15.39:0/1521100591 >> v2:172.21.15.184:3300/0 conn(0x7f4910069e00 0x7f491006a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:38.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.271+0000 7f4907fff700 1 -- 172.21.15.39:0/1521100591 >> v2:172.21.15.184:3300/0 conn(0x7f4910069e00 msgr2=0x7f491006a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:38.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.271+0000 7f4907fff700 1 --2- 172.21.15.39:0/1521100591 >> v2:172.21.15.184:3300/0 conn(0x7f4910069e00 0x7f491006a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:38.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.271+0000 7f4907fff700 1 -- 172.21.15.39:0/1521100591 >> v1:172.21.15.39:6789/0 conn(0x7f491015c640 legacy=0x7f49100d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:38.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.271+0000 7f4907fff700 1 -- 172.21.15.39:0/1521100591 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49100722f0 con 0x7f4910071aa0 2023-11-28T11:58:38.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.271+0000 7f4907fff700 1 --2- 172.21.15.39:0/1521100591 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4910071aa0 0x7f491006d310 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4900009850 tx=0x7f4900009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b66b2af011f601ae server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:38.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.271+0000 7f49077fe700 1 -- 172.21.15.39:0/1521100591 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4900011830 con 0x7f4910071aa0 2023-11-28T11:58:38.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.271+0000 7f49077fe700 1 -- 172.21.15.39:0/1521100591 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4900011990 con 0x7f4910071aa0 2023-11-28T11:58:38.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.271+0000 7f49077fe700 1 -- 172.21.15.39:0/1521100591 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4900011d40 con 0x7f4910071aa0 2023-11-28T11:58:38.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.271+0000 7f4915cbc700 1 -- 172.21.15.39:0/1521100591 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4910071aa0 msgr2=0x7f491006d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:38.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.271+0000 7f4915cbc700 1 --2- 172.21.15.39:0/1521100591 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4910071aa0 0x7f491006d310 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4900009850 tx=0x7f4900009b60 comp rx=0 tx=0).stop 2023-11-28T11:58:38.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.271+0000 7f4915cbc700 1 -- 172.21.15.39:0/1521100591 shutdown_connections 2023-11-28T11:58:38.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.271+0000 7f4915cbc700 1 --2- 172.21.15.39:0/1521100591 >> v2:172.21.15.184:3300/0 conn(0x7f4910069e00 0x7f491006a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:38.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.271+0000 7f4915cbc700 1 --2- 172.21.15.39:0/1521100591 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4910071aa0 0x7f491006d310 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:38.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.271+0000 7f4915cbc700 1 -- 172.21.15.39:0/1521100591 >> 172.21.15.39:0/1521100591 conn(0x7f49100b6520 msgr2=0x7f4910071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:38.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.271+0000 7f4915cbc700 1 -- 172.21.15.39:0/1521100591 shutdown_connections 2023-11-28T11:58:38.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.271+0000 7f4915cbc700 1 -- 172.21.15.39:0/1521100591 wait complete. 2023-11-28T11:58:38.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.275+0000 7f4915cbc700 1 Processor -- start 2023-11-28T11:58:38.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.275+0000 7f4915cbc700 1 -- start start 2023-11-28T11:58:38.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.275+0000 7f4915cbc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4910069e00 0x7f49100b2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:38.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.275+0000 7f4915cbc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f491015c640 0x7f491014f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:38.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.275+0000 7f4915cbc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49101588d0 0x7f49100cf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:38.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.275+0000 7f4915cbc700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4910159210 con 0x7f491015c640 2023-11-28T11:58:38.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.275+0000 7f4915cbc700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49100cf0a0 con 0x7f4910069e00 2023-11-28T11:58:38.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.275+0000 7f4915cbc700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f491015bc60 con 0x7f49101588d0 2023-11-28T11:58:38.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.275+0000 7f4907fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f491015c640 0x7f491014f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:38.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.275+0000 7f4907fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f491015c640 0x7f491014f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55592/0 (socket says 172.21.15.39:55592) 2023-11-28T11:58:38.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.275+0000 7f4907fff700 1 -- 172.21.15.39:0/3430728045 learned_addr learned my addr 172.21.15.39:0/3430728045 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:38.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.275+0000 7f4914cba700 1 --2- 172.21.15.39:0/3430728045 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4910069e00 0x7f49100b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:38.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.275+0000 7f49154bb700 1 --2- 172.21.15.39:0/3430728045 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49101588d0 0x7f49100cf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:38.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.275+0000 7f4907fff700 1 -- 172.21.15.39:0/3430728045 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49101588d0 msgr2=0x7f49100cf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:38.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.275+0000 7f4907fff700 1 --2- 172.21.15.39:0/3430728045 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49101588d0 0x7f49100cf4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:38.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.275+0000 7f4907fff700 1 -- 172.21.15.39:0/3430728045 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4910069e00 msgr2=0x7f49100b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:38.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.275+0000 7f4907fff700 1 --2- 172.21.15.39:0/3430728045 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4910069e00 0x7f49100b2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:38.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.275+0000 7f4907fff700 1 -- 172.21.15.39:0/3430728045 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49000094b0 con 0x7f491015c640 2023-11-28T11:58:38.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.279+0000 7f4907fff700 1 --2- 172.21.15.39:0/3430728045 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f491015c640 0x7f491014f670 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f49000090b0 tx=0x7f4900004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:38.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.279+0000 7f49057fa700 1 -- 172.21.15.39:0/3430728045 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4900004450 con 0x7f491015c640 2023-11-28T11:58:38.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.279+0000 7f49057fa700 1 -- 172.21.15.39:0/3430728045 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f490001f070 con 0x7f491015c640 2023-11-28T11:58:38.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.279+0000 7f49057fa700 1 -- 172.21.15.39:0/3430728045 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4900003900 con 0x7f491015c640 2023-11-28T11:58:38.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.279+0000 7f4915cbc700 1 -- 172.21.15.39:0/3430728045 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4910072010 con 0x7f491015c640 2023-11-28T11:58:38.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.279+0000 7f4915cbc700 1 -- 172.21.15.39:0/3430728045 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f491015ca10 con 0x7f491015c640 2023-11-28T11:58:38.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.279+0000 7f4915cbc700 1 -- 172.21.15.39:0/3430728045 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f491006c830 con 0x7f491015c640 2023-11-28T11:58:38.284 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.283+0000 7f49057fa700 1 -- 172.21.15.39:0/3430728045 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f490000f050 con 0x7f491015c640 2023-11-28T11:58:38.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.283+0000 7f49057fa700 1 --2- 172.21.15.39:0/3430728045 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f48fc064ee0 0x7f48fc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:38.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.283+0000 7f49057fa700 1 -- 172.21.15.39:0/3430728045 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f4900021070 con 0x7f491015c640 2023-11-28T11:58:38.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.283+0000 7f4914cba700 1 --2- 172.21.15.39:0/3430728045 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f48fc064ee0 0x7f48fc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:38.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.283+0000 7f4914cba700 1 --2- 172.21.15.39:0/3430728045 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f48fc064ee0 0x7f48fc067390 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f490c0012e0 tx=0x7f490c001a30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:38.293 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.291+0000 7f49057fa700 1 -- 172.21.15.39:0/3430728045 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4900051600 con 0x7f491015c640 2023-11-28T11:58:38.507 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.503+0000 7f4915cbc700 1 -- 172.21.15.39:0/3430728045 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f49100cf1e0 con 0x7f491015c640 2023-11-28T11:58:38.509 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.507+0000 7f49057fa700 1 -- 172.21.15.39:0/3430728045 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4654 (secure 0 0 0) 0x7f49100cf1e0 con 0x7f491015c640 2023-11-28T11:58:38.509 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:58:38.509 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/3875562914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3875562914},{"type":"v1","addr":"172.21.15.184:6836","nonce":3875562914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5295,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/4053840838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":4053840838},{"type":"v1","addr":"172.21.15.39:6833","nonce":4053840838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5304,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2819411287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2819411287},{"type":"v1","addr":"172.21.15.39:6835","nonce":2819411287}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:58:03.228365+0000","modified":"2023-11-28T11:58:06.252058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5317},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5317":{"gid":5317,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.184:6837/2775071992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":2775071992},{"type":"v1","addr":"172.21.15.184:6837","nonce":2775071992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T11:58:38.511 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.507+0000 7f4915cbc700 1 -- 172.21.15.39:0/3430728045 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f48fc064ee0 msgr2=0x7f48fc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:38.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.507+0000 7f4915cbc700 1 --2- 172.21.15.39:0/3430728045 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f48fc064ee0 0x7f48fc067390 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f490c0012e0 tx=0x7f490c001a30 comp rx=0 tx=0).stop 2023-11-28T11:58:38.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.507+0000 7f4915cbc700 1 -- 172.21.15.39:0/3430728045 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f491015c640 msgr2=0x7f491014f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:38.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.507+0000 7f4915cbc700 1 --2- 172.21.15.39:0/3430728045 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f491015c640 0x7f491014f670 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f49000090b0 tx=0x7f4900004770 comp rx=0 tx=0).stop 2023-11-28T11:58:38.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.511+0000 7f4915cbc700 1 -- 172.21.15.39:0/3430728045 shutdown_connections 2023-11-28T11:58:38.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.511+0000 7f4915cbc700 1 --2- 172.21.15.39:0/3430728045 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49101588d0 0x7f49100cf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:38.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.511+0000 7f4915cbc700 1 --2- 172.21.15.39:0/3430728045 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f491015c640 0x7f491014f670 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:38.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.511+0000 7f4915cbc700 1 --2- 172.21.15.39:0/3430728045 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f48fc064ee0 0x7f48fc067390 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:38.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.511+0000 7f4915cbc700 1 --2- 172.21.15.39:0/3430728045 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4910069e00 0x7f49100b2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:38.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.511+0000 7f4915cbc700 1 -- 172.21.15.39:0/3430728045 >> 172.21.15.39:0/3430728045 conn(0x7f49100b6520 msgr2=0x7f49100b3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:38.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.511+0000 7f4915cbc700 1 -- 172.21.15.39:0/3430728045 shutdown_connections 2023-11-28T11:58:38.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.511+0000 7f4915cbc700 1 -- 172.21.15.39:0/3430728045 wait complete. 2023-11-28T11:58:38.516 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 16 2023-11-28T11:58:38.533 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:58:38.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.707+0000 7f0719f18700 1 Processor -- start 2023-11-28T11:58:38.711 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.707+0000 7f0719f18700 1 -- start start 2023-11-28T11:58:38.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.707+0000 7f0719f18700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f071415c640 0x7f07140d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:38.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.707+0000 7f0719f18700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f0714071aa0 0x7f071406d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:38.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.707+0000 7f0719f18700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0714069e00 0x7f071406a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:38.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.707+0000 7f0719f18700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f071406cef0 con 0x7f071415c640 2023-11-28T11:58:38.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.707+0000 7f0719f18700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f071406a7c0 con 0x7f0714071aa0 2023-11-28T11:58:38.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.707+0000 7f0719f18700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f071406c600 con 0x7f0714069e00 2023-11-28T11:58:38.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.711+0000 7f0718f16700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f071415c640 0x7f07140d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:38.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.711+0000 7f0718f16700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f071415c640 0x7f07140d31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55598/0 (socket says 172.21.15.39:55598) 2023-11-28T11:58:38.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.711+0000 7f0713fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f0714071aa0 0x7f071406d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:38.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.711+0000 7f0718f16700 1 -- 172.21.15.39:0/1179902103 learned_addr learned my addr 172.21.15.39:0/1179902103 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:38.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.711+0000 7f0719717700 1 --2- 172.21.15.39:0/1179902103 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0714069e00 0x7f071406a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:38.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.711+0000 7f0718f16700 1 -- 172.21.15.39:0/1179902103 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0714069e00 msgr2=0x7f071406a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:38.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.711+0000 7f0718f16700 1 --2- 172.21.15.39:0/1179902103 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0714069e00 0x7f071406a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:38.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.711+0000 7f0718f16700 1 -- 172.21.15.39:0/1179902103 >> v2:172.21.15.184:3300/0 conn(0x7f0714071aa0 msgr2=0x7f071406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:38.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.711+0000 7f0718f16700 1 --2- 172.21.15.39:0/1179902103 >> v2:172.21.15.184:3300/0 conn(0x7f0714071aa0 0x7f071406d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:38.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.711+0000 7f0718f16700 1 -- 172.21.15.39:0/1179902103 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07140722f0 con 0x7f071415c640 2023-11-28T11:58:38.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.711+0000 7f0718f16700 1 --2- 172.21.15.39:0/1179902103 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f071415c640 0x7f07140d31e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0714070e70 tx=0x7f0708009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5846d33bc292247e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:38.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.711+0000 7f07137fe700 1 -- 172.21.15.39:0/1179902103 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0708011830 con 0x7f071415c640 2023-11-28T11:58:38.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.711+0000 7f07137fe700 1 -- 172.21.15.39:0/1179902103 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0708011990 con 0x7f071415c640 2023-11-28T11:58:38.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.711+0000 7f07137fe700 1 -- 172.21.15.39:0/1179902103 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0708011d20 con 0x7f071415c640 2023-11-28T11:58:38.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.711+0000 7f0719f18700 1 -- 172.21.15.39:0/1179902103 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f071415c640 msgr2=0x7f07140d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:38.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.711+0000 7f0719f18700 1 --2- 172.21.15.39:0/1179902103 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f071415c640 0x7f07140d31e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0714070e70 tx=0x7f0708009bf0 comp rx=0 tx=0).stop 2023-11-28T11:58:38.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.711+0000 7f0719f18700 1 -- 172.21.15.39:0/1179902103 shutdown_connections 2023-11-28T11:58:38.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.711+0000 7f0719f18700 1 --2- 172.21.15.39:0/1179902103 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0714069e00 0x7f071406a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:38.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.711+0000 7f0719f18700 1 --2- 172.21.15.39:0/1179902103 >> v2:172.21.15.184:3300/0 conn(0x7f0714071aa0 0x7f071406d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:38.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.711+0000 7f0719f18700 1 --2- 172.21.15.39:0/1179902103 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f071415c640 0x7f07140d31e0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:38.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.711+0000 7f0719f18700 1 -- 172.21.15.39:0/1179902103 >> 172.21.15.39:0/1179902103 conn(0x7f07140b6520 msgr2=0x7f0714071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:38.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.711+0000 7f0719f18700 1 -- 172.21.15.39:0/1179902103 shutdown_connections 2023-11-28T11:58:38.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.711+0000 7f0719f18700 1 -- 172.21.15.39:0/1179902103 wait complete. 2023-11-28T11:58:38.718 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.715+0000 7f0719f18700 1 Processor -- start 2023-11-28T11:58:38.718 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.715+0000 7f0719f18700 1 -- start start 2023-11-28T11:58:38.720 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.715+0000 7f0719f18700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0714069e00 0x7f07140cc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:38.720 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.715+0000 7f0719f18700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0714071aa0 0x7f07140b38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:38.720 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.715+0000 7f0719f18700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f071415c640 0x7f071409bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:38.720 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.715+0000 7f0719f18700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07140cb4b0 con 0x7f0714069e00 2023-11-28T11:58:38.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.715+0000 7f0719f18700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07140cb790 con 0x7f0714071aa0 2023-11-28T11:58:38.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.715+0000 7f0719f18700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07140cba70 con 0x7f071415c640 2023-11-28T11:58:38.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.719+0000 7f0718f16700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0714069e00 0x7f07140cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:38.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.719+0000 7f0718f16700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0714069e00 0x7f07140cc550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55608/0 (socket says 172.21.15.39:55608) 2023-11-28T11:58:38.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.719+0000 7f0718f16700 1 -- 172.21.15.39:0/2495978050 learned_addr learned my addr 172.21.15.39:0/2495978050 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:38.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.719+0000 7f0713fff700 1 --2- 172.21.15.39:0/2495978050 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0714071aa0 0x7f07140b38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:38.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.719+0000 7f0719717700 1 --2- 172.21.15.39:0/2495978050 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f071415c640 0x7f071409bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:38.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.719+0000 7f0718f16700 1 -- 172.21.15.39:0/2495978050 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f071415c640 msgr2=0x7f071409bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:38.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.719+0000 7f0718f16700 1 --2- 172.21.15.39:0/2495978050 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f071415c640 0x7f071409bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:38.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.719+0000 7f0718f16700 1 -- 172.21.15.39:0/2495978050 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0714071aa0 msgr2=0x7f07140b38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:38.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.719+0000 7f0718f16700 1 --2- 172.21.15.39:0/2495978050 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0714071aa0 0x7f07140b38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:38.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.719+0000 7f0718f16700 1 -- 172.21.15.39:0/2495978050 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0708009570 con 0x7f0714069e00 2023-11-28T11:58:38.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.719+0000 7f0719717700 1 --2- 172.21.15.39:0/2495978050 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f071415c640 0x7f071409bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:58:38.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.719+0000 7f0713fff700 1 --2- 172.21.15.39:0/2495978050 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0714071aa0 0x7f07140b38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:58:38.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.719+0000 7f0718f16700 1 --2- 172.21.15.39:0/2495978050 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0714069e00 0x7f07140cc550 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f0708009860 tx=0x7f0708004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:38.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.719+0000 7f07117fa700 1 -- 172.21.15.39:0/2495978050 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0708004450 con 0x7f0714069e00 2023-11-28T11:58:38.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.719+0000 7f07117fa700 1 -- 172.21.15.39:0/2495978050 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f070801f070 con 0x7f0714069e00 2023-11-28T11:58:38.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.719+0000 7f0719f18700 1 -- 172.21.15.39:0/2495978050 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0714072010 con 0x7f0714069e00 2023-11-28T11:58:38.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.719+0000 7f07117fa700 1 -- 172.21.15.39:0/2495978050 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0708003900 con 0x7f0714069e00 2023-11-28T11:58:38.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.719+0000 7f0719f18700 1 -- 172.21.15.39:0/2495978050 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f071415ca10 con 0x7f0714069e00 2023-11-28T11:58:38.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.719+0000 7f0719f18700 1 -- 172.21.15.39:0/2495978050 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f071406c830 con 0x7f0714069e00 2023-11-28T11:58:38.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.723+0000 7f07117fa700 1 -- 172.21.15.39:0/2495978050 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f070800f050 con 0x7f0714069e00 2023-11-28T11:58:38.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.723+0000 7f07117fa700 1 --2- 172.21.15.39:0/2495978050 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f06f8064ee0 0x7f06f8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:38.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.723+0000 7f07117fa700 1 -- 172.21.15.39:0/2495978050 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f0708021070 con 0x7f0714069e00 2023-11-28T11:58:38.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.723+0000 7f0713fff700 1 --2- 172.21.15.39:0/2495978050 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f06f8064ee0 0x7f06f8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:38.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.727+0000 7f0713fff700 1 --2- 172.21.15.39:0/2495978050 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f06f8064ee0 0x7f06f8067390 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0714158780 tx=0x7f0700008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:38.737 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.735+0000 7f07117fa700 1 -- 172.21.15.39:0/2495978050 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0708051690 con 0x7f0714069e00 2023-11-28T11:58:38.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.907+0000 7f0719f18700 1 -- 172.21.15.39:0/2495978050 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f071406fa80 con 0x7f0714069e00 2023-11-28T11:58:38.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.911+0000 7f07117fa700 1 -- 172.21.15.39:0/2495978050 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+18183 (secure 0 0 0) 0x7f0708054cb0 con 0x7f0714069e00 2023-11-28T11:58:38.915 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:58:38.915 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":46,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:58:22.793502+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:58:01.523189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-28T11:58:02.259575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.f","mappings":[{"from":0,"to":5}]},{"pgid":"7.12","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:58:38.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.915+0000 7f0719f18700 1 -- 172.21.15.39:0/2495978050 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f06f8064ee0 msgr2=0x7f06f8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:38.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.915+0000 7f0719f18700 1 --2- 172.21.15.39:0/2495978050 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f06f8064ee0 0x7f06f8067390 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0714158780 tx=0x7f0700008040 comp rx=0 tx=0).stop 2023-11-28T11:58:38.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.915+0000 7f0719f18700 1 -- 172.21.15.39:0/2495978050 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0714069e00 msgr2=0x7f07140cc550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:38.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.915+0000 7f0719f18700 1 --2- 172.21.15.39:0/2495978050 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0714069e00 0x7f07140cc550 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f0708009860 tx=0x7f0708004770 comp rx=0 tx=0).stop 2023-11-28T11:58:38.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.915+0000 7f0719f18700 1 -- 172.21.15.39:0/2495978050 shutdown_connections 2023-11-28T11:58:38.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.915+0000 7f0719f18700 1 --2- 172.21.15.39:0/2495978050 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f071415c640 0x7f071409bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:38.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.915+0000 7f0719f18700 1 --2- 172.21.15.39:0/2495978050 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f06f8064ee0 0x7f06f8067390 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:38.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.915+0000 7f0719f18700 1 --2- 172.21.15.39:0/2495978050 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0714071aa0 0x7f07140b38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:38.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.915+0000 7f0719f18700 1 --2- 172.21.15.39:0/2495978050 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0714069e00 0x7f07140cc550 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:38.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.915+0000 7f0719f18700 1 -- 172.21.15.39:0/2495978050 >> 172.21.15.39:0/2495978050 conn(0x7f07140b6520 msgr2=0x7f07140d12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:38.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.915+0000 7f0719f18700 1 -- 172.21.15.39:0/2495978050 shutdown_connections 2023-11-28T11:58:38.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:38.915+0000 7f0719f18700 1 -- 172.21.15.39:0/2495978050 wait complete. 2023-11-28T11:58:38.942 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T11:58:39.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.123+0000 7f585520a700 1 Processor -- start 2023-11-28T11:58:39.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.123+0000 7f585520a700 1 -- start start 2023-11-28T11:58:39.127 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.123+0000 7f585520a700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f585015a480 0x7f58500cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:39.127 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.123+0000 7f585520a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5850069d60 0x7f585006a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:39.127 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.123+0000 7f585520a700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f585015a850 con 0x7f58500c8d10 2023-11-28T11:58:39.127 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.123+0000 7f585520a700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58500ce060 con 0x7f585015a480 2023-11-28T11:58:39.127 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.123+0000 7f585520a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58500ce300 con 0x7f5850069d60 2023-11-28T11:58:39.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.123+0000 7f584ed9d700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f585015a480 0x7f58500cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:39.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.123+0000 7f584ed9d700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f585015a480 0x7f58500cc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55610/0 (socket says 172.21.15.39:55610) 2023-11-28T11:58:39.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.123+0000 7f584ed9d700 1 -- 172.21.15.39:0/1287761988 learned_addr learned my addr 172.21.15.39:0/1287761988 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:39.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.123+0000 7f584f59e700 1 --2- 172.21.15.39:0/1287761988 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5850069d60 0x7f585006a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:39.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.127+0000 7f584ed9d700 1 -- 172.21.15.39:0/1287761988 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5850069d60 msgr2=0x7f585006a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:39.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.127+0000 7f584ed9d700 1 --2- 172.21.15.39:0/1287761988 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5850069d60 0x7f585006a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:39.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.127+0000 7f584ed9d700 1 -- 172.21.15.39:0/1287761988 >> v1:172.21.15.184:6789/0 conn(0x7f58500c8d10 legacy=0x7f58500cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:39.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.127+0000 7f584ed9d700 1 -- 172.21.15.39:0/1287761988 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58500cada0 con 0x7f585015a480 2023-11-28T11:58:39.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.127+0000 7f584ed9d700 1 --2- 172.21.15.39:0/1287761988 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f585015a480 0x7f58500cc290 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5840009e50 tx=0x7f584000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b03df229a4d5fe77 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:39.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.127+0000 7f584e59c700 1 -- 172.21.15.39:0/1287761988 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584000e070 con 0x7f585015a480 2023-11-28T11:58:39.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.127+0000 7f584e59c700 1 -- 172.21.15.39:0/1287761988 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584000b9c0 con 0x7f585015a480 2023-11-28T11:58:39.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.127+0000 7f584e59c700 1 -- 172.21.15.39:0/1287761988 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584000bd70 con 0x7f585015a480 2023-11-28T11:58:39.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.127+0000 7f585520a700 1 -- 172.21.15.39:0/1287761988 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f585015a480 msgr2=0x7f58500cc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:39.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.127+0000 7f585520a700 1 --2- 172.21.15.39:0/1287761988 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f585015a480 0x7f58500cc290 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5840009e50 tx=0x7f584000b330 comp rx=0 tx=0).stop 2023-11-28T11:58:39.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.127+0000 7f585520a700 1 -- 172.21.15.39:0/1287761988 shutdown_connections 2023-11-28T11:58:39.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.127+0000 7f585520a700 1 --2- 172.21.15.39:0/1287761988 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5850069d60 0x7f585006a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:39.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.127+0000 7f585520a700 1 --2- 172.21.15.39:0/1287761988 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f585015a480 0x7f58500cc290 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:39.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.127+0000 7f585520a700 1 -- 172.21.15.39:0/1287761988 >> 172.21.15.39:0/1287761988 conn(0x7f58500cf350 msgr2=0x7f58500b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:39.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.127+0000 7f585520a700 1 -- 172.21.15.39:0/1287761988 shutdown_connections 2023-11-28T11:58:39.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.127+0000 7f585520a700 1 -- 172.21.15.39:0/1287761988 wait complete. 2023-11-28T11:58:39.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.131+0000 7f585520a700 1 Processor -- start 2023-11-28T11:58:39.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.131+0000 7f585520a700 1 -- start start 2023-11-28T11:58:39.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.135+0000 7f585520a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5850069d60 0x7f5850151b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:39.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.135+0000 7f585520a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58500c8d10 0x7f58500ac2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:39.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.135+0000 7f585520a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f585015a480 0x7f58500c63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:39.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.135+0000 7f585520a700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585006d590 con 0x7f58500c8d10 2023-11-28T11:58:39.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.135+0000 7f585520a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58501f2380 con 0x7f5850069d60 2023-11-28T11:58:39.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.135+0000 7f585520a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585006ca10 con 0x7f585015a480 2023-11-28T11:58:39.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.135+0000 7f5847fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58500c8d10 0x7f58500ac2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:39.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.135+0000 7f5847fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58500c8d10 0x7f58500ac2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55614/0 (socket says 172.21.15.39:55614) 2023-11-28T11:58:39.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.135+0000 7f5847fff700 1 -- 172.21.15.39:0/638239215 learned_addr learned my addr 172.21.15.39:0/638239215 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:39.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.135+0000 7f584f59e700 1 --2- 172.21.15.39:0/638239215 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f585015a480 0x7f58500c63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:39.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.135+0000 7f584ed9d700 1 --2- 172.21.15.39:0/638239215 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5850069d60 0x7f5850151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:39.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.135+0000 7f5847fff700 1 -- 172.21.15.39:0/638239215 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f585015a480 msgr2=0x7f58500c63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:39.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.135+0000 7f5847fff700 1 --2- 172.21.15.39:0/638239215 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f585015a480 0x7f58500c63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:39.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.135+0000 7f5847fff700 1 -- 172.21.15.39:0/638239215 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5850069d60 msgr2=0x7f5850151b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:39.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.135+0000 7f5847fff700 1 --2- 172.21.15.39:0/638239215 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5850069d60 0x7f5850151b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:39.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.135+0000 7f5847fff700 1 -- 172.21.15.39:0/638239215 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5840009b30 con 0x7f58500c8d10 2023-11-28T11:58:39.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.135+0000 7f5847fff700 1 --2- 172.21.15.39:0/638239215 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58500c8d10 0x7f58500ac2c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f583800c530 tx=0x7f583800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:39.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.135+0000 7f58477fe700 1 -- 172.21.15.39:0/638239215 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583800cea0 con 0x7f58500c8d10 2023-11-28T11:58:39.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.135+0000 7f58477fe700 1 -- 172.21.15.39:0/638239215 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58380052d0 con 0x7f58500c8d10 2023-11-28T11:58:39.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.135+0000 7f585520a700 1 -- 172.21.15.39:0/638239215 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58500add50 con 0x7f58500c8d10 2023-11-28T11:58:39.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.135+0000 7f58477fe700 1 -- 172.21.15.39:0/638239215 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58380036a0 con 0x7f58500c8d10 2023-11-28T11:58:39.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.135+0000 7f585520a700 1 -- 172.21.15.39:0/638239215 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58500caa30 con 0x7f58500c8d10 2023-11-28T11:58:39.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.139+0000 7f585520a700 1 -- 172.21.15.39:0/638239215 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58500ca6e0 con 0x7f58500c8d10 2023-11-28T11:58:39.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.139+0000 7f58477fe700 1 -- 172.21.15.39:0/638239215 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5838019030 con 0x7f58500c8d10 2023-11-28T11:58:39.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.143+0000 7f58477fe700 1 --2- 172.21.15.39:0/638239215 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5830064ee0 0x7f5830067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:39.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.143+0000 7f58477fe700 1 -- 172.21.15.39:0/638239215 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f58380812c0 con 0x7f58500c8d10 2023-11-28T11:58:39.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.143+0000 7f584ed9d700 1 --2- 172.21.15.39:0/638239215 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5830064ee0 0x7f5830067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:39.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.143+0000 7f584ed9d700 1 --2- 172.21.15.39:0/638239215 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5830064ee0 0x7f5830067390 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f584000b370 tx=0x7f5840009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:39.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.147+0000 7f58477fe700 1 -- 172.21.15.39:0/638239215 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f583804f1f0 con 0x7f58500c8d10 2023-11-28T11:58:39.358 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.355+0000 7f585520a700 1 -- 172.21.15.39:0/638239215 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f58501f2550 con 0x7f58500c8d10 2023-11-28T11:58:39.916 INFO:tasks.ceph.mon.a.smithi039.stderr:2023-11-28T11:58:39.911+0000 7ff4e35f9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T11:58:39.931 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.927+0000 7f58477fe700 1 -- 172.21.15.39:0/638239215 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7f58501f2550 con 0x7f58500c8d10 2023-11-28T11:58:39.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.931+0000 7f585520a700 1 -- 172.21.15.39:0/638239215 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5830064ee0 msgr2=0x7f5830067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:39.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.931+0000 7f585520a700 1 --2- 172.21.15.39:0/638239215 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5830064ee0 0x7f5830067390 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f584000b370 tx=0x7f5840009000 comp rx=0 tx=0).stop 2023-11-28T11:58:39.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.931+0000 7f585520a700 1 -- 172.21.15.39:0/638239215 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58500c8d10 msgr2=0x7f58500ac2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:39.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.931+0000 7f585520a700 1 --2- 172.21.15.39:0/638239215 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58500c8d10 0x7f58500ac2c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f583800c530 tx=0x7f583800c840 comp rx=0 tx=0).stop 2023-11-28T11:58:39.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.931+0000 7f585520a700 1 -- 172.21.15.39:0/638239215 shutdown_connections 2023-11-28T11:58:39.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.931+0000 7f585520a700 1 --2- 172.21.15.39:0/638239215 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f585015a480 0x7f58500c63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:39.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.931+0000 7f585520a700 1 --2- 172.21.15.39:0/638239215 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f58500c8d10 0x7f58500ac2c0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:39.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.931+0000 7f585520a700 1 --2- 172.21.15.39:0/638239215 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5830064ee0 0x7f5830067390 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:39.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.931+0000 7f585520a700 1 --2- 172.21.15.39:0/638239215 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5850069d60 0x7f5850151b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:39.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.931+0000 7f585520a700 1 -- 172.21.15.39:0/638239215 >> 172.21.15.39:0/638239215 conn(0x7f58500cf350 msgr2=0x7f58500b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:39.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.931+0000 7f585520a700 1 -- 172.21.15.39:0/638239215 shutdown_connections 2023-11-28T11:58:39.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:39.931+0000 7f585520a700 1 -- 172.21.15.39:0/638239215 wait complete. 2023-11-28T11:58:39.938 INFO:teuthology.orchestra.run.smithi039.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T11:58:39.953 INFO:tasks.ceph.mds.d.smithi184.stderr: -6431> 2023-11-28T11:58:05.700+0000 7fc6523e1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T11:58:39.960 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-28T11:58:40.016 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2023-11-28T11:58:40.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.151+0000 7f25b12fb700 1 Processor -- start 2023-11-28T11:58:40.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.151+0000 7f25b12fb700 1 -- start start 2023-11-28T11:58:40.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.151+0000 7f25b12fb700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f25ac158840 0x7f25ac0ad9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:40.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.151+0000 7f25b12fb700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f25ac070790 0x7f25ac06a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:40.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.151+0000 7f25b12fb700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25ac069bf0 con 0x7f25ac15c3b0 2023-11-28T11:58:40.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.151+0000 7f25b12fb700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25ac15c890 con 0x7f25ac158840 2023-11-28T11:58:40.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.151+0000 7f25b12fb700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25ac15cb70 con 0x7f25ac070790 2023-11-28T11:58:40.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.155+0000 7f25a3fff700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f25ac15c3b0 0x7f25ac070080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42402/0 (socket says 172.21.15.39:42402) 2023-11-28T11:58:40.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.155+0000 7f25a3fff700 1 -- 172.21.15.39:0/562532603 learned_addr learned my addr 172.21.15.39:0/562532603 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:58:40.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.155+0000 7f25abfff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f25ac158840 0x7f25ac0ad9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:40.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.155+0000 7f25b0afa700 1 --2- 172.21.15.39:0/562532603 >> v2:172.21.15.184:3300/0 conn(0x7f25ac070790 0x7f25ac06a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:40.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.155+0000 7f25abfff700 1 -- 172.21.15.39:0/562532603 >> v2:172.21.15.184:3300/0 conn(0x7f25ac070790 msgr2=0x7f25ac06a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:40.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.155+0000 7f25ab7fe700 1 -- 172.21.15.39:0/562532603 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1762472440 0 0) 0x7f25ac069bf0 con 0x7f25ac15c3b0 2023-11-28T11:58:40.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.155+0000 7f25abfff700 1 --2- 172.21.15.39:0/562532603 >> v2:172.21.15.184:3300/0 conn(0x7f25ac070790 0x7f25ac06a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:40.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.155+0000 7f25abfff700 1 -- 172.21.15.39:0/562532603 >> v1:172.21.15.39:6789/0 conn(0x7f25ac15c3b0 legacy=0x7f25ac070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:40.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.155+0000 7f25abfff700 1 -- 172.21.15.39:0/562532603 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25ac15ce50 con 0x7f25ac158840 2023-11-28T11:58:40.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.155+0000 7f25abfff700 1 --2- 172.21.15.39:0/562532603 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25ac158840 0x7f25ac0ad9f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f25ac0c57b0 tx=0x7f259c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff38d10259648a27 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:40.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.155+0000 7f25ab7fe700 1 -- 172.21.15.39:0/562532603 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c00f940 con 0x7f25ac158840 2023-11-28T11:58:40.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.155+0000 7f25ab7fe700 1 -- 172.21.15.39:0/562532603 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259c00faa0 con 0x7f25ac158840 2023-11-28T11:58:40.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.155+0000 7f25ab7fe700 1 -- 172.21.15.39:0/562532603 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c00fe30 con 0x7f25ac158840 2023-11-28T11:58:40.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.155+0000 7f25b12fb700 1 -- 172.21.15.39:0/562532603 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25ac158840 msgr2=0x7f25ac0ad9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:40.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.155+0000 7f25b12fb700 1 --2- 172.21.15.39:0/562532603 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25ac158840 0x7f25ac0ad9f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f25ac0c57b0 tx=0x7f259c009b30 comp rx=0 tx=0).stop 2023-11-28T11:58:40.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.155+0000 7f25b12fb700 1 -- 172.21.15.39:0/562532603 shutdown_connections 2023-11-28T11:58:40.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.155+0000 7f25b12fb700 1 --2- 172.21.15.39:0/562532603 >> v2:172.21.15.184:3300/0 conn(0x7f25ac070790 0x7f25ac06a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:40.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.155+0000 7f25b12fb700 1 --2- 172.21.15.39:0/562532603 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25ac158840 0x7f25ac0ad9f0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:40.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.155+0000 7f25b12fb700 1 -- 172.21.15.39:0/562532603 >> 172.21.15.39:0/562532603 conn(0x7f25ac0b0f80 msgr2=0x7f25ac0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:40.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.159+0000 7f25b12fb700 1 -- 172.21.15.39:0/562532603 shutdown_connections 2023-11-28T11:58:40.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.159+0000 7f25b12fb700 1 -- 172.21.15.39:0/562532603 wait complete. 2023-11-28T11:58:40.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.159+0000 7f25b12fb700 1 Processor -- start 2023-11-28T11:58:40.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.159+0000 7f25b12fb700 1 -- start start 2023-11-28T11:58:40.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.159+0000 7f25b12fb700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25ac070790 0x7f25ac152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:40.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.159+0000 7f25b12fb700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25ac158840 0x7f25ac157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:40.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.159+0000 7f25b12fb700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25ac15c3b0 0x7f25ac157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:40.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.159+0000 7f25b12fb700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25ac155580 con 0x7f25ac070790 2023-11-28T11:58:40.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.159+0000 7f25b12fb700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25ac0c2f60 con 0x7f25ac158840 2023-11-28T11:58:40.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.159+0000 7f25b12fb700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25ac0c3240 con 0x7f25ac15c3b0 2023-11-28T11:58:40.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.163+0000 7f25abfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25ac070790 0x7f25ac152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:40.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.163+0000 7f25abfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25ac070790 0x7f25ac152ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55640/0 (socket says 172.21.15.39:55640) 2023-11-28T11:58:40.170 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.163+0000 7f25abfff700 1 -- 172.21.15.39:0/336191161 learned_addr learned my addr 172.21.15.39:0/336191161 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:40.170 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.163+0000 7f25a3fff700 1 --2- 172.21.15.39:0/336191161 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25ac158840 0x7f25ac157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:40.170 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.163+0000 7f25b0afa700 1 --2- 172.21.15.39:0/336191161 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25ac15c3b0 0x7f25ac157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:40.170 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.163+0000 7f25abfff700 1 -- 172.21.15.39:0/336191161 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25ac15c3b0 msgr2=0x7f25ac157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:40.170 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.163+0000 7f25abfff700 1 --2- 172.21.15.39:0/336191161 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25ac15c3b0 0x7f25ac157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:40.170 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.163+0000 7f25abfff700 1 -- 172.21.15.39:0/336191161 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25ac158840 msgr2=0x7f25ac157230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:40.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.163+0000 7f25abfff700 1 --2- 172.21.15.39:0/336191161 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25ac158840 0x7f25ac157230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:40.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.163+0000 7f25abfff700 1 -- 172.21.15.39:0/336191161 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f259c0094b0 con 0x7f25ac070790 2023-11-28T11:58:40.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.163+0000 7f25abfff700 1 --2- 172.21.15.39:0/336191161 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25ac070790 0x7f25ac152ee0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f259c0090b0 tx=0x7f259c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:40.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.163+0000 7f25a97fa700 1 -- 172.21.15.39:0/336191161 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c0038d0 con 0x7f25ac070790 2023-11-28T11:58:40.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.163+0000 7f25a97fa700 1 -- 172.21.15.39:0/336191161 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259c003a30 con 0x7f25ac070790 2023-11-28T11:58:40.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.163+0000 7f25a97fa700 1 -- 172.21.15.39:0/336191161 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c003dc0 con 0x7f25ac070790 2023-11-28T11:58:40.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.163+0000 7f25b12fb700 1 -- 172.21.15.39:0/336191161 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25ac158c10 con 0x7f25ac070790 2023-11-28T11:58:40.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.163+0000 7f25b12fb700 1 -- 172.21.15.39:0/336191161 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25ac15d130 con 0x7f25ac070790 2023-11-28T11:58:40.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.163+0000 7f25b12fb700 1 -- 172.21.15.39:0/336191161 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25ac0adf30 con 0x7f25ac070790 2023-11-28T11:58:40.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.167+0000 7f25a97fa700 1 -- 172.21.15.39:0/336191161 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f259c021450 con 0x7f25ac070790 2023-11-28T11:58:40.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.167+0000 7f25a97fa700 1 --2- 172.21.15.39:0/336191161 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f258c064ee0 0x7f258c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:40.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.167+0000 7f25a97fa700 1 -- 172.21.15.39:0/336191161 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6526+0+0 (secure 0 0 0) 0x7f259c013070 con 0x7f25ac070790 2023-11-28T11:58:40.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.167+0000 7f25a3fff700 1 --2- 172.21.15.39:0/336191161 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f258c064ee0 0x7f258c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:40.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.171+0000 7f25a3fff700 1 --2- 172.21.15.39:0/336191161 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f258c064ee0 0x7f258c067390 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f25ac0b4900 tx=0x7f2594007e00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:40.177 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.175+0000 7f25a97fa700 1 -- 172.21.15.39:0/336191161 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f259c053e40 con 0x7f25ac070790 2023-11-28T11:58:40.387 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.383+0000 7f25b12fb700 1 -- 172.21.15.39:0/336191161 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f25ac073cb0 con 0x7f25ac070790 2023-11-28T11:58:40.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.931+0000 7f25a97fa700 1 -- 172.21.15.39:0/336191161 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7f259c057460 con 0x7f25ac070790 2023-11-28T11:58:40.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.935+0000 7f25b12fb700 1 -- 172.21.15.39:0/336191161 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f258c064ee0 msgr2=0x7f258c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:40.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.935+0000 7f25b12fb700 1 --2- 172.21.15.39:0/336191161 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f258c064ee0 0x7f258c067390 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f25ac0b4900 tx=0x7f2594007e00 comp rx=0 tx=0).stop 2023-11-28T11:58:40.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.935+0000 7f25b12fb700 1 -- 172.21.15.39:0/336191161 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25ac070790 msgr2=0x7f25ac152ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:40.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.935+0000 7f25b12fb700 1 --2- 172.21.15.39:0/336191161 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25ac070790 0x7f25ac152ee0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f259c0090b0 tx=0x7f259c004770 comp rx=0 tx=0).stop 2023-11-28T11:58:40.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.935+0000 7f25b12fb700 1 -- 172.21.15.39:0/336191161 shutdown_connections 2023-11-28T11:58:40.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.935+0000 7f25b12fb700 1 --2- 172.21.15.39:0/336191161 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25ac15c3b0 0x7f25ac157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:40.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.935+0000 7f25b12fb700 1 --2- 172.21.15.39:0/336191161 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f258c064ee0 0x7f258c067390 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:40.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.935+0000 7f25b12fb700 1 --2- 172.21.15.39:0/336191161 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25ac158840 0x7f25ac157230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:40.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.935+0000 7f25b12fb700 1 --2- 172.21.15.39:0/336191161 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25ac070790 0x7f25ac152ee0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:40.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.935+0000 7f25b12fb700 1 -- 172.21.15.39:0/336191161 >> 172.21.15.39:0/336191161 conn(0x7f25ac0b0f80 msgr2=0x7f25ac0c9910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:40.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.935+0000 7f25b12fb700 1 -- 172.21.15.39:0/336191161 shutdown_connections 2023-11-28T11:58:40.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:40.935+0000 7f25b12fb700 1 -- 172.21.15.39:0/336191161 wait complete. 2023-11-28T11:58:40.962 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-28T11:58:41.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.147+0000 7f75c1445700 1 Processor -- start 2023-11-28T11:58:41.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.147+0000 7f75c1445700 1 -- start start 2023-11-28T11:58:41.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.147+0000 7f75c1445700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75bc0b1ab0 0x7f75bc0d3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:41.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.147+0000 7f75c1445700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f75bc0b1e80 0x7f75bc0cff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:41.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.147+0000 7f75c1445700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75bc1610b0 con 0x7f75bc071db0 2023-11-28T11:58:41.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.147+0000 7f75c1445700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75bc0c63c0 con 0x7f75bc0b1e80 2023-11-28T11:58:41.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.147+0000 7f75c1445700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc0c5e00 con 0x7f75bc0b1ab0 2023-11-28T11:58:41.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.151+0000 7f75b3fff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f75bc0b1e80 0x7f75bc0cff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:41.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.151+0000 7f75b3fff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f75bc0b1e80 0x7f75bc0cff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55654/0 (socket says 172.21.15.39:55654) 2023-11-28T11:58:41.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.151+0000 7f75b3fff700 1 -- 172.21.15.39:0/724801315 learned_addr learned my addr 172.21.15.39:0/724801315 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:41.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.151+0000 7f75c0c44700 1 --1- 172.21.15.39:0/724801315 >> v1:172.21.15.39:6789/0 conn(0x7f75bc071db0 0x7f75bc069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42416/0 (socket says 172.21.15.39:42416) 2023-11-28T11:58:41.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.151+0000 7f75bbfff700 1 --2- 172.21.15.39:0/724801315 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75bc0b1ab0 0x7f75bc0d3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:41.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.151+0000 7f75b3fff700 1 -- 172.21.15.39:0/724801315 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75bc0b1ab0 msgr2=0x7f75bc0d3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:41.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.151+0000 7f75b3fff700 1 --2- 172.21.15.39:0/724801315 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75bc0b1ab0 0x7f75bc0d3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:41.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.151+0000 7f75b3fff700 1 -- 172.21.15.39:0/724801315 >> v1:172.21.15.39:6789/0 conn(0x7f75bc071db0 legacy=0x7f75bc069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:41.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.151+0000 7f75bb7fe700 1 -- 172.21.15.39:0/724801315 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 261063475 0 0) 0x7f75bc1610b0 con 0x7f75bc071db0 2023-11-28T11:58:41.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.151+0000 7f75b3fff700 1 -- 172.21.15.39:0/724801315 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75bc0c60e0 con 0x7f75bc0b1e80 2023-11-28T11:58:41.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.151+0000 7f75bbfff700 1 --2- 172.21.15.39:0/724801315 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75bc0b1ab0 0x7f75bc0d3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:58:41.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.151+0000 7f75b3fff700 1 --2- 172.21.15.39:0/724801315 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f75bc0b1e80 0x7f75bc0cff00 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f75a4009910 tx=0x7f75a4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=333e5903b7937f05 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:41.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.151+0000 7f75bb7fe700 1 -- 172.21.15.39:0/724801315 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a400ba60 con 0x7f75bc0b1e80 2023-11-28T11:58:41.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.151+0000 7f75bb7fe700 1 -- 172.21.15.39:0/724801315 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a400bbc0 con 0x7f75bc0b1e80 2023-11-28T11:58:41.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.151+0000 7f75bb7fe700 1 -- 172.21.15.39:0/724801315 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a4009e60 con 0x7f75bc0b1e80 2023-11-28T11:58:41.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.151+0000 7f75c1445700 1 -- 172.21.15.39:0/724801315 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f75bc0b1e80 msgr2=0x7f75bc0cff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:41.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.151+0000 7f75c1445700 1 --2- 172.21.15.39:0/724801315 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f75bc0b1e80 0x7f75bc0cff00 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f75a4009910 tx=0x7f75a4009c20 comp rx=0 tx=0).stop 2023-11-28T11:58:41.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.151+0000 7f75c1445700 1 -- 172.21.15.39:0/724801315 shutdown_connections 2023-11-28T11:58:41.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.151+0000 7f75c1445700 1 --2- 172.21.15.39:0/724801315 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f75bc0b1e80 0x7f75bc0cff00 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:41.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.151+0000 7f75c1445700 1 --2- 172.21.15.39:0/724801315 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75bc0b1ab0 0x7f75bc0d3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:41.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.151+0000 7f75c1445700 1 -- 172.21.15.39:0/724801315 >> 172.21.15.39:0/724801315 conn(0x7f75bc0b65b0 msgr2=0x7f75bc071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:41.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.155+0000 7f75c1445700 1 -- 172.21.15.39:0/724801315 shutdown_connections 2023-11-28T11:58:41.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.155+0000 7f75c1445700 1 -- 172.21.15.39:0/724801315 wait complete. 2023-11-28T11:58:41.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.155+0000 7f75c1445700 1 Processor -- start 2023-11-28T11:58:41.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.155+0000 7f75c1445700 1 -- start start 2023-11-28T11:58:41.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.159+0000 7f75c1445700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75bc071db0 0x7f75bc15bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:41.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.159+0000 7f75c1445700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75bc0b1ab0 0x7f75bc0b4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:41.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.159+0000 7f75c1445700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f75bc0b1e80 0x7f75bc0b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:41.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.159+0000 7f75c1445700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc0c68c0 con 0x7f75bc0b1e80 2023-11-28T11:58:41.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.159+0000 7f75c1445700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc0b24c0 con 0x7f75bc0b1ab0 2023-11-28T11:58:41.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.159+0000 7f75c1445700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc15db60 con 0x7f75bc071db0 2023-11-28T11:58:41.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.159+0000 7f75c0c44700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f75bc0b1e80 0x7f75bc0b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:41.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.159+0000 7f75c0c44700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f75bc0b1e80 0x7f75bc0b4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55658/0 (socket says 172.21.15.39:55658) 2023-11-28T11:58:41.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.159+0000 7f75c0c44700 1 -- 172.21.15.39:0/3466740497 learned_addr learned my addr 172.21.15.39:0/3466740497 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:41.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.159+0000 7f75bbfff700 1 --2- 172.21.15.39:0/3466740497 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75bc071db0 0x7f75bc15bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:41.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.159+0000 7f75b3fff700 1 --2- 172.21.15.39:0/3466740497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75bc0b1ab0 0x7f75bc0b4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:41.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.159+0000 7f75c0c44700 1 -- 172.21.15.39:0/3466740497 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75bc071db0 msgr2=0x7f75bc15bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:41.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.159+0000 7f75c0c44700 1 --2- 172.21.15.39:0/3466740497 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75bc071db0 0x7f75bc15bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:41.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.159+0000 7f75c0c44700 1 -- 172.21.15.39:0/3466740497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75bc0b1ab0 msgr2=0x7f75bc0b4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:41.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.159+0000 7f75c0c44700 1 --2- 172.21.15.39:0/3466740497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75bc0b1ab0 0x7f75bc0b4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:41.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.159+0000 7f75c0c44700 1 -- 172.21.15.39:0/3466740497 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a4009570 con 0x7f75bc0b1e80 2023-11-28T11:58:41.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.159+0000 7f75c0c44700 1 --2- 172.21.15.39:0/3466740497 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f75bc0b1e80 0x7f75bc0b4c70 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f75b4002230 tx=0x7f75b400cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:41.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.159+0000 7f75b97fa700 1 -- 172.21.15.39:0/3466740497 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b400aac0 con 0x7f75bc0b1e80 2023-11-28T11:58:41.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.159+0000 7f75b97fa700 1 -- 172.21.15.39:0/3466740497 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b400ac40 con 0x7f75bc0b1e80 2023-11-28T11:58:41.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.159+0000 7f75b97fa700 1 -- 172.21.15.39:0/3466740497 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b40070d0 con 0x7f75bc0b1e80 2023-11-28T11:58:41.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.159+0000 7f75c1445700 1 -- 172.21.15.39:0/3466740497 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75bc0cf700 con 0x7f75bc0b1e80 2023-11-28T11:58:41.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.163+0000 7f75c1445700 1 -- 172.21.15.39:0/3466740497 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75bc0cf420 con 0x7f75bc0b1e80 2023-11-28T11:58:41.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.163+0000 7f75c1445700 1 -- 172.21.15.39:0/3466740497 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75bc0cf9e0 con 0x7f75bc0b1e80 2023-11-28T11:58:41.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.163+0000 7f75b97fa700 1 -- 172.21.15.39:0/3466740497 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f75b4010070 con 0x7f75bc0b1e80 2023-11-28T11:58:41.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.167+0000 7f75b97fa700 1 --2- 172.21.15.39:0/3466740497 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f759c064f10 0x7f759c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:41.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.167+0000 7f75b97fa700 1 -- 172.21.15.39:0/3466740497 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6526+0+0 (secure 0 0 0) 0x7f75b40818d0 con 0x7f75bc0b1e80 2023-11-28T11:58:41.170 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.167+0000 7f75bbfff700 1 --2- 172.21.15.39:0/3466740497 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f759c064f10 0x7f759c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:41.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.167+0000 7f75bbfff700 1 --2- 172.21.15.39:0/3466740497 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f759c064f10 0x7f759c0673c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f75bc15c540 tx=0x7f75ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:41.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.171+0000 7f75b97fa700 1 -- 172.21.15.39:0/3466740497 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f75b404f8a0 con 0x7f75bc0b1e80 2023-11-28T11:58:41.350 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:41.347+0000 7f75c1445700 1 -- 172.21.15.39:0/3466740497 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f75bc073cb0 con 0x7f75bc0b1e80 2023-11-28T11:58:42.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.043+0000 7f75b97fa700 1 -- 172.21.15.39:0/3466740497 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v48) v1 ==== 181+0+0 (secure 0 0 0) 0x7f75b4052ec0 con 0x7f75bc0b1e80 2023-11-28T11:58:42.050 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.047+0000 7f75c1445700 1 -- 172.21.15.39:0/3466740497 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f759c064f10 msgr2=0x7f759c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:42.050 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.047+0000 7f75c1445700 1 --2- 172.21.15.39:0/3466740497 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f759c064f10 0x7f759c0673c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f75bc15c540 tx=0x7f75ac008040 comp rx=0 tx=0).stop 2023-11-28T11:58:42.050 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.047+0000 7f75c1445700 1 -- 172.21.15.39:0/3466740497 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f75bc0b1e80 msgr2=0x7f75bc0b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:42.050 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.047+0000 7f75c1445700 1 --2- 172.21.15.39:0/3466740497 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f75bc0b1e80 0x7f75bc0b4c70 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f75b4002230 tx=0x7f75b400cf50 comp rx=0 tx=0).stop 2023-11-28T11:58:42.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.047+0000 7f75c1445700 1 -- 172.21.15.39:0/3466740497 shutdown_connections 2023-11-28T11:58:42.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.047+0000 7f75c1445700 1 --2- 172.21.15.39:0/3466740497 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f75bc0b1e80 0x7f75bc0b4c70 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:42.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.047+0000 7f75c1445700 1 --2- 172.21.15.39:0/3466740497 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f759c064f10 0x7f759c0673c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:42.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.047+0000 7f75c1445700 1 --2- 172.21.15.39:0/3466740497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75bc0b1ab0 0x7f75bc0b4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:42.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.047+0000 7f75c1445700 1 --2- 172.21.15.39:0/3466740497 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75bc071db0 0x7f75bc15bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:42.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.047+0000 7f75c1445700 1 -- 172.21.15.39:0/3466740497 >> 172.21.15.39:0/3466740497 conn(0x7f75bc0b65b0 msgr2=0x7f75bc15cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:42.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.047+0000 7f75c1445700 1 -- 172.21.15.39:0/3466740497 shutdown_connections 2023-11-28T11:58:42.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.047+0000 7f75c1445700 1 -- 172.21.15.39:0/3466740497 wait complete. 2023-11-28T11:58:42.054 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_metadata' removed 2023-11-28T11:58:42.074 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-28T11:58:42.263 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.259+0000 7f1881799700 1 Processor -- start 2023-11-28T11:58:42.263 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.259+0000 7f1881799700 1 -- start start 2023-11-28T11:58:42.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.263+0000 7f1881799700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f187c15c6e0 0x7f187c071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:42.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.263+0000 7f1881799700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f187c06a510 0x7f187c06c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:42.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.263+0000 7f1881799700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f187c15cab0 con 0x7f187c071fe0 2023-11-28T11:58:42.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.263+0000 7f1881799700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f187c0d2800 con 0x7f187c15c6e0 2023-11-28T11:58:42.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.263+0000 7f1881799700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f187c0702d0 con 0x7f187c06a510 2023-11-28T11:58:42.267 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.263+0000 7f187a7fc700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f187c071fe0 0x7f187c069e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42418/0 (socket says 172.21.15.39:42418) 2023-11-28T11:58:42.267 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.263+0000 7f187a7fc700 1 -- 172.21.15.39:0/3589214138 learned_addr learned my addr 172.21.15.39:0/3589214138 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:58:42.267 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.263+0000 7f187affd700 1 --2- 172.21.15.39:0/3589214138 >> v2:172.21.15.184:3300/0 conn(0x7f187c15c6e0 0x7f187c071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:42.267 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.263+0000 7f187b7fe700 1 --2- 172.21.15.39:0/3589214138 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f187c06a510 0x7f187c06c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:42.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.263+0000 7f1879ffb700 1 -- 172.21.15.39:0/3589214138 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2039154136 0 0) 0x7f187c15cab0 con 0x7f187c071fe0 2023-11-28T11:58:42.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.263+0000 7f187affd700 1 -- 172.21.15.39:0/3589214138 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f187c06a510 msgr2=0x7f187c06c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:42.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.263+0000 7f187affd700 1 --2- 172.21.15.39:0/3589214138 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f187c06a510 0x7f187c06c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:42.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.263+0000 7f187affd700 1 -- 172.21.15.39:0/3589214138 >> v1:172.21.15.39:6789/0 conn(0x7f187c071fe0 legacy=0x7f187c069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:42.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.263+0000 7f187affd700 1 -- 172.21.15.39:0/3589214138 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f187c0d2a10 con 0x7f187c15c6e0 2023-11-28T11:58:42.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.267+0000 7f187affd700 1 --2- 172.21.15.39:0/3589214138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f187c15c6e0 0x7f187c071aa0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f186c009850 tx=0x7f186c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68b559ef91734161 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:42.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.267+0000 7f1879ffb700 1 -- 172.21.15.39:0/3589214138 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c011830 con 0x7f187c15c6e0 2023-11-28T11:58:42.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.267+0000 7f1879ffb700 1 -- 172.21.15.39:0/3589214138 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186c011990 con 0x7f187c15c6e0 2023-11-28T11:58:42.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.267+0000 7f1879ffb700 1 -- 172.21.15.39:0/3589214138 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c011d40 con 0x7f187c15c6e0 2023-11-28T11:58:42.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.267+0000 7f1881799700 1 -- 172.21.15.39:0/3589214138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f187c15c6e0 msgr2=0x7f187c071aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:42.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.267+0000 7f1881799700 1 --2- 172.21.15.39:0/3589214138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f187c15c6e0 0x7f187c071aa0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f186c009850 tx=0x7f186c009b60 comp rx=0 tx=0).stop 2023-11-28T11:58:42.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.267+0000 7f1881799700 1 -- 172.21.15.39:0/3589214138 shutdown_connections 2023-11-28T11:58:42.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.267+0000 7f1881799700 1 --2- 172.21.15.39:0/3589214138 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f187c06a510 0x7f187c06c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:42.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.267+0000 7f1881799700 1 --2- 172.21.15.39:0/3589214138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f187c15c6e0 0x7f187c071aa0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:42.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.267+0000 7f1881799700 1 -- 172.21.15.39:0/3589214138 >> 172.21.15.39:0/3589214138 conn(0x7f187c0b65b0 msgr2=0x7f187c071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:42.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.267+0000 7f1881799700 1 -- 172.21.15.39:0/3589214138 shutdown_connections 2023-11-28T11:58:42.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.267+0000 7f1881799700 1 -- 172.21.15.39:0/3589214138 wait complete. 2023-11-28T11:58:42.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.271+0000 7f1881799700 1 Processor -- start 2023-11-28T11:58:42.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.271+0000 7f1881799700 1 -- start start 2023-11-28T11:58:42.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.271+0000 7f1881799700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f187c06a510 0x7f187c09bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:42.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.271+0000 7f1881799700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f187c071fe0 0x7f187c071930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:42.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.271+0000 7f1881799700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f187c15c6e0 0x7f187c0c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:42.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.271+0000 7f1881799700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187c0b5070 con 0x7f187c06a510 2023-11-28T11:58:42.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.271+0000 7f1881799700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187c1e6500 con 0x7f187c15c6e0 2023-11-28T11:58:42.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.271+0000 7f1881799700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f187c1e6a50 con 0x7f187c071fe0 2023-11-28T11:58:42.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.271+0000 7f187affd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f187c06a510 0x7f187c09bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:42.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.271+0000 7f187affd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f187c06a510 0x7f187c09bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55660/0 (socket says 172.21.15.39:55660) 2023-11-28T11:58:42.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.271+0000 7f187affd700 1 -- 172.21.15.39:0/1367574538 learned_addr learned my addr 172.21.15.39:0/1367574538 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:42.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.271+0000 7f187b7fe700 1 --2- 172.21.15.39:0/1367574538 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f187c15c6e0 0x7f187c0c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:42.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.271+0000 7f187a7fc700 1 --2- 172.21.15.39:0/1367574538 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f187c071fe0 0x7f187c071930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:42.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.275+0000 7f187affd700 1 -- 172.21.15.39:0/1367574538 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f187c071fe0 msgr2=0x7f187c071930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:42.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.275+0000 7f187affd700 1 --2- 172.21.15.39:0/1367574538 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f187c071fe0 0x7f187c071930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:42.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.275+0000 7f187affd700 1 -- 172.21.15.39:0/1367574538 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f187c15c6e0 msgr2=0x7f187c0c88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:42.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.275+0000 7f187affd700 1 --2- 172.21.15.39:0/1367574538 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f187c15c6e0 0x7f187c0c88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:42.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.275+0000 7f187affd700 1 -- 172.21.15.39:0/1367574538 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186c0094b0 con 0x7f187c06a510 2023-11-28T11:58:42.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.275+0000 7f187b7fe700 1 --2- 172.21.15.39:0/1367574538 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f187c15c6e0 0x7f187c0c88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:58:42.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.275+0000 7f187affd700 1 --2- 172.21.15.39:0/1367574538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f187c06a510 0x7f187c09bef0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f186c000c00 tx=0x7f186c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:42.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.275+0000 7f18637fe700 1 -- 172.21.15.39:0/1367574538 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c01a990 con 0x7f187c06a510 2023-11-28T11:58:42.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.275+0000 7f18637fe700 1 -- 172.21.15.39:0/1367574538 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186c01f070 con 0x7f187c06a510 2023-11-28T11:58:42.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.275+0000 7f1881799700 1 -- 172.21.15.39:0/1367574538 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f187c0d2fd0 con 0x7f187c06a510 2023-11-28T11:58:42.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.275+0000 7f18637fe700 1 -- 172.21.15.39:0/1367574538 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c01ad30 con 0x7f187c06a510 2023-11-28T11:58:42.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.275+0000 7f1881799700 1 -- 172.21.15.39:0/1367574538 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f187c0d2cf0 con 0x7f187c06a510 2023-11-28T11:58:42.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.275+0000 7f1881799700 1 -- 172.21.15.39:0/1367574538 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f187c0d32b0 con 0x7f187c06a510 2023-11-28T11:58:42.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.279+0000 7f18637fe700 1 -- 172.21.15.39:0/1367574538 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f186c00f050 con 0x7f187c06a510 2023-11-28T11:58:42.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.279+0000 7f18637fe700 1 --2- 172.21.15.39:0/1367574538 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1868064f10 0x7f18680673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:42.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.279+0000 7f18637fe700 1 -- 172.21.15.39:0/1367574538 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6088+0+0 (secure 0 0 0) 0x7f186c083080 con 0x7f187c06a510 2023-11-28T11:58:42.284 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.283+0000 7f187a7fc700 1 --2- 172.21.15.39:0/1367574538 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1868064f10 0x7f18680673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:42.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.283+0000 7f187a7fc700 1 --2- 172.21.15.39:0/1367574538 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1868064f10 0x7f18680673c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f187c0a0940 tx=0x7f1870007e00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:42.289 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.287+0000 7f18637fe700 1 -- 172.21.15.39:0/1367574538 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f186c0b3400 con 0x7f187c06a510 2023-11-28T11:58:42.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:42.459+0000 7f1881799700 1 -- 172.21.15.39:0/1367574538 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f187c073cb0 con 0x7f187c06a510 2023-11-28T11:58:43.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.063+0000 7f18637fe700 1 -- 172.21.15.39:0/1367574538 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v49) v1 ==== 169+0+0 (secure 0 0 0) 0x7f186c051110 con 0x7f187c06a510 2023-11-28T11:58:43.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.067+0000 7f1881799700 1 -- 172.21.15.39:0/1367574538 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1868064f10 msgr2=0x7f18680673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:43.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.071+0000 7f1881799700 1 --2- 172.21.15.39:0/1367574538 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1868064f10 0x7f18680673c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f187c0a0940 tx=0x7f1870007e00 comp rx=0 tx=0).stop 2023-11-28T11:58:43.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.071+0000 7f1881799700 1 -- 172.21.15.39:0/1367574538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f187c06a510 msgr2=0x7f187c09bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:43.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.071+0000 7f1881799700 1 --2- 172.21.15.39:0/1367574538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f187c06a510 0x7f187c09bef0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f186c000c00 tx=0x7f186c004770 comp rx=0 tx=0).stop 2023-11-28T11:58:43.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.071+0000 7f1881799700 1 -- 172.21.15.39:0/1367574538 shutdown_connections 2023-11-28T11:58:43.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.071+0000 7f1881799700 1 --2- 172.21.15.39:0/1367574538 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1868064f10 0x7f18680673c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:43.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.071+0000 7f1881799700 1 --2- 172.21.15.39:0/1367574538 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f187c15c6e0 0x7f187c0c88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:43.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.071+0000 7f1881799700 1 --2- 172.21.15.39:0/1367574538 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f187c071fe0 0x7f187c071930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:43.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.071+0000 7f1881799700 1 --2- 172.21.15.39:0/1367574538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f187c06a510 0x7f187c09bef0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:43.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.071+0000 7f1881799700 1 -- 172.21.15.39:0/1367574538 >> 172.21.15.39:0/1367574538 conn(0x7f187c0b65b0 msgr2=0x7f187c1e28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:43.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.071+0000 7f1881799700 1 -- 172.21.15.39:0/1367574538 shutdown_connections 2023-11-28T11:58:43.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.071+0000 7f1881799700 1 -- 172.21.15.39:0/1367574538 wait complete. 2023-11-28T11:58:43.077 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_data' removed 2023-11-28T11:58:43.097 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-28T11:58:43.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.283+0000 7f80d759e700 1 Processor -- start 2023-11-28T11:58:43.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.283+0000 7f80d759e700 1 -- start start 2023-11-28T11:58:43.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.283+0000 7f80d759e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f80d815c890 0x7f80d80cedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:43.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.283+0000 7f80d759e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f80d80cfbd0 0x7f80d806ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:43.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.283+0000 7f80d759e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d806b680 con 0x7f80d806b240 2023-11-28T11:58:43.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.283+0000 7f80d759e700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d80cfa40 con 0x7f80d80cfbd0 2023-11-28T11:58:43.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.283+0000 7f80d759e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d815cc60 con 0x7f80d815c890 2023-11-28T11:58:43.289 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.287+0000 7f80d5d9b700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f80d80cfbd0 0x7f80d806ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:43.289 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.287+0000 7f80d5d9b700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f80d80cfbd0 0x7f80d806ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55662/0 (socket says 172.21.15.39:55662) 2023-11-28T11:58:43.289 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.287+0000 7f80d5d9b700 1 -- 172.21.15.39:0/1195047460 learned_addr learned my addr 172.21.15.39:0/1195047460 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:43.289 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.287+0000 7f80d659c700 1 --2- 172.21.15.39:0/1195047460 >> v2:172.21.15.184:3300/0 conn(0x7f80d815c890 0x7f80d80cedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:43.290 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.287+0000 7f80d5d9b700 1 -- 172.21.15.39:0/1195047460 >> v2:172.21.15.184:3300/0 conn(0x7f80d815c890 msgr2=0x7f80d80cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:43.290 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.287+0000 7f80d5d9b700 1 --2- 172.21.15.39:0/1195047460 >> v2:172.21.15.184:3300/0 conn(0x7f80d815c890 0x7f80d80cedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:43.290 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.287+0000 7f80d5d9b700 1 -- 172.21.15.39:0/1195047460 >> v1:172.21.15.184:6789/0 conn(0x7f80d806b240 legacy=0x7f80d8160370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:43.290 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.287+0000 7f80d5d9b700 1 -- 172.21.15.39:0/1195047460 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d80cf480 con 0x7f80d80cfbd0 2023-11-28T11:58:43.290 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.287+0000 7f80d5d9b700 1 --2- 172.21.15.39:0/1195047460 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80d80cfbd0 0x7f80d806ad00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f80d8072e10 tx=0x7f80cc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a02f7488965f0ca server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:43.290 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.287+0000 7f80d559a700 1 -- 172.21.15.39:0/1195047460 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc011830 con 0x7f80d80cfbd0 2023-11-28T11:58:43.291 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.287+0000 7f80d559a700 1 -- 172.21.15.39:0/1195047460 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80cc011990 con 0x7f80d80cfbd0 2023-11-28T11:58:43.291 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.287+0000 7f80d559a700 1 -- 172.21.15.39:0/1195047460 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc011d20 con 0x7f80d80cfbd0 2023-11-28T11:58:43.291 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.287+0000 7f80d759e700 1 -- 172.21.15.39:0/1195047460 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80d80cfbd0 msgr2=0x7f80d806ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:43.291 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.287+0000 7f80d759e700 1 --2- 172.21.15.39:0/1195047460 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80d80cfbd0 0x7f80d806ad00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f80d8072e10 tx=0x7f80cc009bf0 comp rx=0 tx=0).stop 2023-11-28T11:58:43.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.287+0000 7f80d759e700 1 -- 172.21.15.39:0/1195047460 shutdown_connections 2023-11-28T11:58:43.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.287+0000 7f80d759e700 1 --2- 172.21.15.39:0/1195047460 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80d80cfbd0 0x7f80d806ad00 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:43.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.287+0000 7f80d759e700 1 --2- 172.21.15.39:0/1195047460 >> v2:172.21.15.184:3300/0 conn(0x7f80d815c890 0x7f80d80cedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:43.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.287+0000 7f80d759e700 1 -- 172.21.15.39:0/1195047460 >> 172.21.15.39:0/1195047460 conn(0x7f80d8099af0 msgr2=0x7f80d80d07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:43.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.291+0000 7f80d759e700 1 -- 172.21.15.39:0/1195047460 shutdown_connections 2023-11-28T11:58:43.293 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.291+0000 7f80d759e700 1 -- 172.21.15.39:0/1195047460 wait complete. 2023-11-28T11:58:43.295 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.291+0000 7f80d759e700 1 Processor -- start 2023-11-28T11:58:43.295 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.291+0000 7f80d759e700 1 -- start start 2023-11-28T11:58:43.297 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.295+0000 7f80d759e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80d806b240 0x7f80d81f18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:43.297 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.295+0000 7f80d759e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80d80cfbd0 0x7f80d80c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:43.297 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.295+0000 7f80d759e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80d815c890 0x7f80d80c5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:43.297 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.295+0000 7f80d759e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d80cadb0 con 0x7f80d815c890 2023-11-28T11:58:43.297 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.295+0000 7f80d759e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d815a280 con 0x7f80d80cfbd0 2023-11-28T11:58:43.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.295+0000 7f80d759e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d815a560 con 0x7f80d806b240 2023-11-28T11:58:43.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.295+0000 7f80d6d9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80d815c890 0x7f80d80c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:43.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.295+0000 7f80d6d9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80d815c890 0x7f80d80c5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55666/0 (socket says 172.21.15.39:55666) 2023-11-28T11:58:43.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.295+0000 7f80d6d9d700 1 -- 172.21.15.39:0/3211782694 learned_addr learned my addr 172.21.15.39:0/3211782694 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:43.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.295+0000 7f80d5d9b700 1 --2- 172.21.15.39:0/3211782694 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80d80cfbd0 0x7f80d80c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:43.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.295+0000 7f80d659c700 1 --2- 172.21.15.39:0/3211782694 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80d806b240 0x7f80d81f18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:43.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.295+0000 7f80d6d9d700 1 -- 172.21.15.39:0/3211782694 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80d806b240 msgr2=0x7f80d81f18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:43.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.295+0000 7f80d6d9d700 1 --2- 172.21.15.39:0/3211782694 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80d806b240 0x7f80d81f18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:43.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.295+0000 7f80d6d9d700 1 -- 172.21.15.39:0/3211782694 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80d80cfbd0 msgr2=0x7f80d80c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:43.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.295+0000 7f80d6d9d700 1 --2- 172.21.15.39:0/3211782694 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80d80cfbd0 0x7f80d80c4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:43.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.295+0000 7f80d6d9d700 1 -- 172.21.15.39:0/3211782694 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80cc009570 con 0x7f80d815c890 2023-11-28T11:58:43.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.295+0000 7f80d6d9d700 1 --2- 172.21.15.39:0/3211782694 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80d815c890 0x7f80d80c5050 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f80d000cb50 tx=0x7f80d000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:43.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.295+0000 7f80c6ffd700 1 -- 172.21.15.39:0/3211782694 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d0003c20 con 0x7f80d815c890 2023-11-28T11:58:43.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.295+0000 7f80c6ffd700 1 -- 172.21.15.39:0/3211782694 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d0003d80 con 0x7f80d815c890 2023-11-28T11:58:43.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.295+0000 7f80c6ffd700 1 -- 172.21.15.39:0/3211782694 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d000aa20 con 0x7f80d815c890 2023-11-28T11:58:43.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.295+0000 7f80d759e700 1 -- 172.21.15.39:0/3211782694 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80d80b3790 con 0x7f80d815c890 2023-11-28T11:58:43.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.299+0000 7f80d759e700 1 -- 172.21.15.39:0/3211782694 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80d80cf760 con 0x7f80d815c890 2023-11-28T11:58:43.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.299+0000 7f80d759e700 1 -- 172.21.15.39:0/3211782694 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80d80b3a70 con 0x7f80d815c890 2023-11-28T11:58:43.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.299+0000 7f80c6ffd700 1 -- 172.21.15.39:0/3211782694 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f80d0010050 con 0x7f80d815c890 2023-11-28T11:58:43.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.303+0000 7f80c6ffd700 1 --2- 172.21.15.39:0/3211782694 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f80b8064f10 0x7f80b80673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:43.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.303+0000 7f80c6ffd700 1 -- 172.21.15.39:0/3211782694 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f80d0081ba0 con 0x7f80d815c890 2023-11-28T11:58:43.306 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.303+0000 7f80d659c700 1 --2- 172.21.15.39:0/3211782694 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f80b8064f10 0x7f80b80673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:43.307 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.303+0000 7f80d659c700 1 --2- 172.21.15.39:0/3211782694 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f80b8064f10 0x7f80b80673c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f80c8009b40 tx=0x7f80c80091c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:43.309 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.307+0000 7f80c6ffd700 1 -- 172.21.15.39:0/3211782694 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f80d004fec0 con 0x7f80d815c890 2023-11-28T11:58:43.489 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.487+0000 7f80d759e700 1 -- 172.21.15.39:0/3211782694 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f80d8073cb0 con 0x7f80d815c890 2023-11-28T11:58:43.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.495+0000 7f80c6ffd700 1 -- 172.21.15.39:0/3211782694 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f80d00534e0 con 0x7f80d815c890 2023-11-28T11:58:43.503 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.499+0000 7f80d759e700 1 -- 172.21.15.39:0/3211782694 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f80b8064f10 msgr2=0x7f80b80673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:43.503 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.499+0000 7f80d759e700 1 --2- 172.21.15.39:0/3211782694 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f80b8064f10 0x7f80b80673c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f80c8009b40 tx=0x7f80c80091c0 comp rx=0 tx=0).stop 2023-11-28T11:58:43.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.499+0000 7f80d759e700 1 -- 172.21.15.39:0/3211782694 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80d815c890 msgr2=0x7f80d80c5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:43.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.499+0000 7f80d759e700 1 --2- 172.21.15.39:0/3211782694 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80d815c890 0x7f80d80c5050 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f80d000cb50 tx=0x7f80d000ce60 comp rx=0 tx=0).stop 2023-11-28T11:58:43.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.499+0000 7f80d759e700 1 -- 172.21.15.39:0/3211782694 shutdown_connections 2023-11-28T11:58:43.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.499+0000 7f80d759e700 1 --2- 172.21.15.39:0/3211782694 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80d815c890 0x7f80d80c5050 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:43.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.499+0000 7f80d759e700 1 --2- 172.21.15.39:0/3211782694 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f80b8064f10 0x7f80b80673c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:43.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.499+0000 7f80d759e700 1 --2- 172.21.15.39:0/3211782694 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80d80cfbd0 0x7f80d80c4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:43.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.499+0000 7f80d759e700 1 --2- 172.21.15.39:0/3211782694 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80d806b240 0x7f80d81f18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:43.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.499+0000 7f80d759e700 1 -- 172.21.15.39:0/3211782694 >> 172.21.15.39:0/3211782694 conn(0x7f80d8099af0 msgr2=0x7f80d80cd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:43.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.499+0000 7f80d759e700 1 -- 172.21.15.39:0/3211782694 shutdown_connections 2023-11-28T11:58:43.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.499+0000 7f80d759e700 1 -- 172.21.15.39:0/3211782694 wait complete. 2023-11-28T11:58:43.525 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2023-11-28T11:58:43.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.699+0000 7f2a7c824700 1 Processor -- start 2023-11-28T11:58:43.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.703+0000 7f2a7c824700 1 -- start start 2023-11-28T11:58:43.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.703+0000 7f2a7c824700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f2a78070790 0x7f2a781670c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:43.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.703+0000 7f2a7c824700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a780d24d0 con 0x7f2a780ced50 2023-11-28T11:58:43.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.703+0000 7f2a7c824700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a780d27b0 con 0x7f2a7806afc0 2023-11-28T11:58:43.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.703+0000 7f2a7c824700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a7806b440 con 0x7f2a78070790 2023-11-28T11:58:43.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.703+0000 7f2a7759e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f2a78070790 0x7f2a781670c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:43.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.703+0000 7f2a7759e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f2a78070790 0x7f2a781670c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55676/0 (socket says 172.21.15.39:55676) 2023-11-28T11:58:43.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.703+0000 7f2a76d9d700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f2a780ced50 0x7f2a78160770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42428/0 (socket says 172.21.15.39:42428) 2023-11-28T11:58:43.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.703+0000 7f2a7759e700 1 -- 172.21.15.39:0/3345411897 learned_addr learned my addr 172.21.15.39:0/3345411897 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:43.709 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.707+0000 7f2a7759e700 1 -- 172.21.15.39:0/3345411897 >> v1:172.21.15.184:6789/0 conn(0x7f2a7806afc0 legacy=0x7f2a78070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:43.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.707+0000 7f2a7759e700 1 -- 172.21.15.39:0/3345411897 >> v1:172.21.15.39:6789/0 conn(0x7f2a780ced50 legacy=0x7f2a78160770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:43.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.707+0000 7f2a7759e700 1 -- 172.21.15.39:0/3345411897 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a780d08d0 con 0x7f2a78070790 2023-11-28T11:58:43.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.707+0000 7f2a75d9b700 1 -- 172.21.15.39:0/3345411897 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1526754099 0 0) 0x7f2a780d24d0 con 0x7f2a780ced50 2023-11-28T11:58:43.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.707+0000 7f2a7759e700 1 --2- 172.21.15.39:0/3345411897 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a78070790 0x7f2a781670c0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f2a70009e50 tx=0x7f2a7000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27802a6880c06786 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:43.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.707+0000 7f2a75d9b700 1 -- 172.21.15.39:0/3345411897 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7000e070 con 0x7f2a78070790 2023-11-28T11:58:43.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.707+0000 7f2a75d9b700 1 -- 172.21.15.39:0/3345411897 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7000b9c0 con 0x7f2a78070790 2023-11-28T11:58:43.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.707+0000 7f2a75d9b700 1 -- 172.21.15.39:0/3345411897 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7000bd70 con 0x7f2a78070790 2023-11-28T11:58:43.711 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.707+0000 7f2a7c824700 1 -- 172.21.15.39:0/3345411897 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a78070790 msgr2=0x7f2a781670c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:43.711 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.707+0000 7f2a7c824700 1 --2- 172.21.15.39:0/3345411897 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a78070790 0x7f2a781670c0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f2a70009e50 tx=0x7f2a7000b330 comp rx=0 tx=0).stop 2023-11-28T11:58:43.711 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.707+0000 7f2a7c824700 1 -- 172.21.15.39:0/3345411897 shutdown_connections 2023-11-28T11:58:43.711 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.707+0000 7f2a7c824700 1 --2- 172.21.15.39:0/3345411897 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a78070790 0x7f2a781670c0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:43.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.707+0000 7f2a7c824700 1 -- 172.21.15.39:0/3345411897 >> 172.21.15.39:0/3345411897 conn(0x7f2a780b53a0 msgr2=0x7f2a780d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:43.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.707+0000 7f2a7c824700 1 -- 172.21.15.39:0/3345411897 shutdown_connections 2023-11-28T11:58:43.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.707+0000 7f2a7c824700 1 -- 172.21.15.39:0/3345411897 wait complete. 2023-11-28T11:58:43.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.711+0000 7f2a7c824700 1 Processor -- start 2023-11-28T11:58:43.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.711+0000 7f2a7c824700 1 -- start start 2023-11-28T11:58:43.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.711+0000 7f2a7c824700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a7806afc0 0x7f2a780c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:43.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.711+0000 7f2a7c824700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a78070790 0x7f2a781525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:43.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.711+0000 7f2a7c824700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a780ced50 0x7f2a780c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:43.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.711+0000 7f2a7c824700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a780c6f60 con 0x7f2a78070790 2023-11-28T11:58:43.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.711+0000 7f2a7c824700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a780ca530 con 0x7f2a7806afc0 2023-11-28T11:58:43.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.711+0000 7f2a7c824700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a780ca810 con 0x7f2a780ced50 2023-11-28T11:58:43.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.711+0000 7f2a7659c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a78070790 0x7f2a781525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:43.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.711+0000 7f2a7659c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a78070790 0x7f2a781525d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55690/0 (socket says 172.21.15.39:55690) 2023-11-28T11:58:43.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.711+0000 7f2a7659c700 1 -- 172.21.15.39:0/2712142435 learned_addr learned my addr 172.21.15.39:0/2712142435 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:43.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.711+0000 7f2a76d9d700 1 --2- 172.21.15.39:0/2712142435 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a7806afc0 0x7f2a780c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:43.717 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.711+0000 7f2a7759e700 1 --2- 172.21.15.39:0/2712142435 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a780ced50 0x7f2a780c9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:43.717 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.711+0000 7f2a7659c700 1 -- 172.21.15.39:0/2712142435 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a780ced50 msgr2=0x7f2a780c9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:43.717 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.711+0000 7f2a7659c700 1 --2- 172.21.15.39:0/2712142435 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a780ced50 0x7f2a780c9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:43.717 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.711+0000 7f2a7659c700 1 -- 172.21.15.39:0/2712142435 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a7806afc0 msgr2=0x7f2a780c6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:43.717 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.711+0000 7f2a7659c700 1 --2- 172.21.15.39:0/2712142435 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a7806afc0 0x7f2a780c6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:43.717 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.711+0000 7f2a7659c700 1 -- 172.21.15.39:0/2712142435 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a70009b30 con 0x7f2a78070790 2023-11-28T11:58:43.717 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.711+0000 7f2a7659c700 1 --2- 172.21.15.39:0/2712142435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a78070790 0x7f2a781525d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c00c500 tx=0x7f2a6c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:43.718 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.711+0000 7f2a5f7fe700 1 -- 172.21.15.39:0/2712142435 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c0052d0 con 0x7f2a78070790 2023-11-28T11:58:43.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.711+0000 7f2a5f7fe700 1 -- 172.21.15.39:0/2712142435 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a6c005430 con 0x7f2a78070790 2023-11-28T11:58:43.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.711+0000 7f2a5f7fe700 1 -- 172.21.15.39:0/2712142435 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c0055a0 con 0x7f2a78070790 2023-11-28T11:58:43.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.711+0000 7f2a7c824700 1 -- 172.21.15.39:0/2712142435 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a780cf120 con 0x7f2a78070790 2023-11-28T11:58:43.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.715+0000 7f2a7c824700 1 -- 172.21.15.39:0/2712142435 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a780d0bb0 con 0x7f2a78070790 2023-11-28T11:58:43.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.715+0000 7f2a7c824700 1 -- 172.21.15.39:0/2712142435 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a780cd1b0 con 0x7f2a78070790 2023-11-28T11:58:43.720 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.715+0000 7f2a5f7fe700 1 -- 172.21.15.39:0/2712142435 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2a6c019030 con 0x7f2a78070790 2023-11-28T11:58:43.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.719+0000 7f2a5f7fe700 1 --2- 172.21.15.39:0/2712142435 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2a64064ee0 0x7f2a64067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:43.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.719+0000 7f2a5f7fe700 1 -- 172.21.15.39:0/2712142435 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f2a6c080ee0 con 0x7f2a78070790 2023-11-28T11:58:43.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.719+0000 7f2a76d9d700 1 --2- 172.21.15.39:0/2712142435 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2a64064ee0 0x7f2a64067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:43.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.719+0000 7f2a76d9d700 1 --2- 172.21.15.39:0/2712142435 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2a64064ee0 0x7f2a64067390 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2a68000f60 tx=0x7f2a68004a70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:43.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.723+0000 7f2a5f7fe700 1 -- 172.21.15.39:0/2712142435 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2a6c04f240 con 0x7f2a78070790 2023-11-28T11:58:43.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:43.963+0000 7f2a7c824700 1 -- 172.21.15.39:0/2712142435 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) v1 -- 0x7f2a78073cb0 con 0x7f2a78070790 2023-11-28T11:58:44.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.059+0000 7f2a5f7fe700 1 -- 172.21.15.39:0/2712142435 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v138) v1 ==== 142+0+0 (secure 0 0 0) 0x7f2a6c056e60 con 0x7f2a78070790 2023-11-28T11:58:44.064 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.059+0000 7f2a7c824700 1 -- 172.21.15.39:0/2712142435 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2a64064ee0 msgr2=0x7f2a64067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:44.065 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.059+0000 7f2a7c824700 1 --2- 172.21.15.39:0/2712142435 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2a64064ee0 0x7f2a64067390 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2a68000f60 tx=0x7f2a68004a70 comp rx=0 tx=0).stop 2023-11-28T11:58:44.065 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.059+0000 7f2a7c824700 1 -- 172.21.15.39:0/2712142435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a78070790 msgr2=0x7f2a781525d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:44.065 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.059+0000 7f2a7c824700 1 --2- 172.21.15.39:0/2712142435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a78070790 0x7f2a781525d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c00c500 tx=0x7f2a6c00c810 comp rx=0 tx=0).stop 2023-11-28T11:58:44.065 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.063+0000 7f2a7c824700 1 -- 172.21.15.39:0/2712142435 shutdown_connections 2023-11-28T11:58:44.065 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.063+0000 7f2a7c824700 1 --2- 172.21.15.39:0/2712142435 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a780ced50 0x7f2a780c9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:44.065 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.063+0000 7f2a7c824700 1 --2- 172.21.15.39:0/2712142435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a78070790 0x7f2a781525d0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:44.065 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.063+0000 7f2a7c824700 1 --2- 172.21.15.39:0/2712142435 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2a64064ee0 0x7f2a64067390 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:44.065 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.063+0000 7f2a7c824700 1 --2- 172.21.15.39:0/2712142435 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a7806afc0 0x7f2a780c6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:44.065 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.063+0000 7f2a7c824700 1 -- 172.21.15.39:0/2712142435 >> 172.21.15.39:0/2712142435 conn(0x7f2a780b53a0 msgr2=0x7f2a78070080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:44.065 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.063+0000 7f2a7c824700 1 -- 172.21.15.39:0/2712142435 shutdown_connections 2023-11-28T11:58:44.065 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.063+0000 7f2a7c824700 1 -- 172.21.15.39:0/2712142435 wait complete. 2023-11-28T11:58:44.088 INFO:tasks.cephfs_test_runner:test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2023-11-28T11:58:44.088 INFO:tasks.cephfs_test_runner:Starting test: test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) That the MDS can repair an inodes backtrace in the data pool 2023-11-28T11:58:44.088 INFO:tasks.cephfs_test_runner:test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-28T11:58:44.088 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2023-11-28T11:58:44.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.267+0000 7fc095e98700 1 Processor -- start 2023-11-28T11:58:44.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.267+0000 7fc095e98700 1 -- start start 2023-11-28T11:58:44.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.271+0000 7fc095e98700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc09015c640 0x7fc0900d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:44.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.271+0000 7fc095e98700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc090071aa0 0x7fc09006d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:44.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.271+0000 7fc095e98700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc09006c600 con 0x7fc090069e00 2023-11-28T11:58:44.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.271+0000 7fc095e98700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc09006cef0 con 0x7fc09015c640 2023-11-28T11:58:44.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.271+0000 7fc095e98700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0900722f0 con 0x7fc090071aa0 2023-11-28T11:58:44.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.271+0000 7fc094e96700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc09015c640 0x7fc0900d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:44.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.271+0000 7fc094e96700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc09015c640 0x7fc0900d31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55696/0 (socket says 172.21.15.39:55696) 2023-11-28T11:58:44.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.271+0000 7fc094e96700 1 -- 172.21.15.39:0/1884691674 learned_addr learned my addr 172.21.15.39:0/1884691674 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:44.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.271+0000 7fc087fff700 1 --2- 172.21.15.39:0/1884691674 >> v2:172.21.15.184:3300/0 conn(0x7fc090071aa0 0x7fc09006d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:44.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.271+0000 7fc094e96700 1 -- 172.21.15.39:0/1884691674 >> v2:172.21.15.184:3300/0 conn(0x7fc090071aa0 msgr2=0x7fc09006d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:44.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.271+0000 7fc094e96700 1 --2- 172.21.15.39:0/1884691674 >> v2:172.21.15.184:3300/0 conn(0x7fc090071aa0 0x7fc09006d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:44.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.271+0000 7fc094e96700 1 -- 172.21.15.39:0/1884691674 >> v1:172.21.15.184:6789/0 conn(0x7fc090069e00 legacy=0x7fc0900d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:44.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.271+0000 7fc094e96700 1 -- 172.21.15.39:0/1884691674 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09015ca10 con 0x7fc09015c640 2023-11-28T11:58:44.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.271+0000 7fc087fff700 1 --2- 172.21.15.39:0/1884691674 >> v2:172.21.15.184:3300/0 conn(0x7fc090071aa0 0x7fc09006d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:58:44.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.271+0000 7fc094e96700 1 --2- 172.21.15.39:0/1884691674 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc09015c640 0x7fc0900d31e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fc090070e70 tx=0x7fc08c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7881e6b14ec44f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:44.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.271+0000 7fc0877fe700 1 -- 172.21.15.39:0/1884691674 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c004230 con 0x7fc09015c640 2023-11-28T11:58:44.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.275+0000 7fc0877fe700 1 -- 172.21.15.39:0/1884691674 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08c004390 con 0x7fc09015c640 2023-11-28T11:58:44.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.275+0000 7fc0877fe700 1 -- 172.21.15.39:0/1884691674 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c0036c0 con 0x7fc09015c640 2023-11-28T11:58:44.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.275+0000 7fc095e98700 1 -- 172.21.15.39:0/1884691674 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc09015c640 msgr2=0x7fc0900d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:44.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.275+0000 7fc095e98700 1 --2- 172.21.15.39:0/1884691674 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc09015c640 0x7fc0900d31e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fc090070e70 tx=0x7fc08c009bf0 comp rx=0 tx=0).stop 2023-11-28T11:58:44.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.275+0000 7fc095e98700 1 -- 172.21.15.39:0/1884691674 shutdown_connections 2023-11-28T11:58:44.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.275+0000 7fc095e98700 1 --2- 172.21.15.39:0/1884691674 >> v2:172.21.15.184:3300/0 conn(0x7fc090071aa0 0x7fc09006d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:44.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.275+0000 7fc095e98700 1 --2- 172.21.15.39:0/1884691674 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc09015c640 0x7fc0900d31e0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:44.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.275+0000 7fc095e98700 1 -- 172.21.15.39:0/1884691674 >> 172.21.15.39:0/1884691674 conn(0x7fc0900b6520 msgr2=0x7fc090071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:44.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.275+0000 7fc095e98700 1 -- 172.21.15.39:0/1884691674 shutdown_connections 2023-11-28T11:58:44.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.275+0000 7fc095e98700 1 -- 172.21.15.39:0/1884691674 wait complete. 2023-11-28T11:58:44.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.279+0000 7fc095e98700 1 Processor -- start 2023-11-28T11:58:44.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.279+0000 7fc095e98700 1 -- start start 2023-11-28T11:58:44.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.279+0000 7fc095e98700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc090069e00 0x7fc0900cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:44.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.279+0000 7fc095e98700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc090071aa0 0x7fc090159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:44.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.279+0000 7fc095e98700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc09015c640 0x7fc09015a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:44.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.279+0000 7fc095e98700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0900cfad0 con 0x7fc090069e00 2023-11-28T11:58:44.289 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.279+0000 7fc095e98700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0900ce460 con 0x7fc090071aa0 2023-11-28T11:58:44.289 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.279+0000 7fc095e98700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0900ceec0 con 0x7fc09015c640 2023-11-28T11:58:44.290 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.279+0000 7fc094e96700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc090069e00 0x7fc0900cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:44.290 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.279+0000 7fc094e96700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc090069e00 0x7fc0900cd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55700/0 (socket says 172.21.15.39:55700) 2023-11-28T11:58:44.290 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.279+0000 7fc094e96700 1 -- 172.21.15.39:0/2704558055 learned_addr learned my addr 172.21.15.39:0/2704558055 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:44.290 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.279+0000 7fc087fff700 1 --2- 172.21.15.39:0/2704558055 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc090071aa0 0x7fc090159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:44.290 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.279+0000 7fc095697700 1 --2- 172.21.15.39:0/2704558055 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc09015c640 0x7fc09015a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:44.290 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.279+0000 7fc094e96700 1 -- 172.21.15.39:0/2704558055 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc09015c640 msgr2=0x7fc09015a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:44.290 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.279+0000 7fc094e96700 1 --2- 172.21.15.39:0/2704558055 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc09015c640 0x7fc09015a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:44.290 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.279+0000 7fc094e96700 1 -- 172.21.15.39:0/2704558055 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc090071aa0 msgr2=0x7fc090159bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:44.290 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.279+0000 7fc094e96700 1 --2- 172.21.15.39:0/2704558055 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc090071aa0 0x7fc090159bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:44.290 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.279+0000 7fc094e96700 1 -- 172.21.15.39:0/2704558055 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08c009570 con 0x7fc090069e00 2023-11-28T11:58:44.290 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.279+0000 7fc087fff700 1 --2- 172.21.15.39:0/2704558055 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc090071aa0 0x7fc090159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:58:44.291 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.279+0000 7fc095697700 1 --2- 172.21.15.39:0/2704558055 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc09015c640 0x7fc09015a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:58:44.291 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.283+0000 7fc094e96700 1 --2- 172.21.15.39:0/2704558055 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc090069e00 0x7fc0900cd7c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fc08c004000 tx=0x7fc08c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:44.291 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.283+0000 7fc0857fa700 1 -- 172.21.15.39:0/2704558055 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c003e60 con 0x7fc090069e00 2023-11-28T11:58:44.291 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.283+0000 7fc0857fa700 1 -- 172.21.15.39:0/2704558055 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08c01f070 con 0x7fc090069e00 2023-11-28T11:58:44.291 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.283+0000 7fc095e98700 1 -- 172.21.15.39:0/2704558055 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc09006c830 con 0x7fc090069e00 2023-11-28T11:58:44.291 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.283+0000 7fc0857fa700 1 -- 172.21.15.39:0/2704558055 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c00b880 con 0x7fc090069e00 2023-11-28T11:58:44.291 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.283+0000 7fc095e98700 1 -- 172.21.15.39:0/2704558055 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc090072010 con 0x7fc090069e00 2023-11-28T11:58:44.291 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.283+0000 7fc095e98700 1 -- 172.21.15.39:0/2704558055 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc09006cb10 con 0x7fc090069e00 2023-11-28T11:58:44.291 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.287+0000 7fc0857fa700 1 -- 172.21.15.39:0/2704558055 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc08c02a020 con 0x7fc090069e00 2023-11-28T11:58:44.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.287+0000 7fc0857fa700 1 --2- 172.21.15.39:0/2704558055 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc07c064ee0 0x7fc07c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:44.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.287+0000 7fc0857fa700 1 -- 172.21.15.39:0/2704558055 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fc08c0835a0 con 0x7fc090069e00 2023-11-28T11:58:44.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.287+0000 7fc087fff700 1 --2- 172.21.15.39:0/2704558055 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc07c064ee0 0x7fc07c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:44.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.287+0000 7fc087fff700 1 --2- 172.21.15.39:0/2704558055 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc07c064ee0 0x7fc07c067390 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc0900d09c0 tx=0x7fc080008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:44.296 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.295+0000 7fc0857fa700 1 -- 172.21.15.39:0/2704558055 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc08c0519c0 con 0x7fc090069e00 2023-11-28T11:58:44.534 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:44.531+0000 7fc095e98700 1 -- 172.21.15.39:0/2704558055 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) v1 -- 0x7fc09006cb10 con 0x7fc090069e00 2023-11-28T11:58:45.075 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.071+0000 7fc0857fa700 1 -- 172.21.15.39:0/2704558055 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v139) v1 ==== 152+0+0 (secure 0 0 0) 0x7fc08c054fe0 con 0x7fc090069e00 2023-11-28T11:58:45.078 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.075+0000 7fc095e98700 1 -- 172.21.15.39:0/2704558055 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc07c064ee0 msgr2=0x7fc07c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:45.078 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.075+0000 7fc095e98700 1 --2- 172.21.15.39:0/2704558055 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc07c064ee0 0x7fc07c067390 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc0900d09c0 tx=0x7fc080008040 comp rx=0 tx=0).stop 2023-11-28T11:58:45.078 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.075+0000 7fc095e98700 1 -- 172.21.15.39:0/2704558055 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc090069e00 msgr2=0x7fc0900cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:45.078 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.075+0000 7fc095e98700 1 --2- 172.21.15.39:0/2704558055 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc090069e00 0x7fc0900cd7c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fc08c004000 tx=0x7fc08c004770 comp rx=0 tx=0).stop 2023-11-28T11:58:45.079 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.075+0000 7fc095e98700 1 -- 172.21.15.39:0/2704558055 shutdown_connections 2023-11-28T11:58:45.079 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.075+0000 7fc095e98700 1 --2- 172.21.15.39:0/2704558055 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc09015c640 0x7fc09015a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:45.079 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.075+0000 7fc095e98700 1 --2- 172.21.15.39:0/2704558055 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc07c064ee0 0x7fc07c067390 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:45.079 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.075+0000 7fc095e98700 1 --2- 172.21.15.39:0/2704558055 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc090071aa0 0x7fc090159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:45.079 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.075+0000 7fc095e98700 1 --2- 172.21.15.39:0/2704558055 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc090069e00 0x7fc0900cd7c0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:45.080 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.075+0000 7fc095e98700 1 -- 172.21.15.39:0/2704558055 >> 172.21.15.39:0/2704558055 conn(0x7fc0900b6520 msgr2=0x7fc0900b35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:45.080 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.075+0000 7fc095e98700 1 -- 172.21.15.39:0/2704558055 shutdown_connections 2023-11-28T11:58:45.080 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.075+0000 7fc095e98700 1 -- 172.21.15.39:0/2704558055 wait complete. 2023-11-28T11:58:45.106 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-28T11:58:45.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.299+0000 7f0fc7fff700 1 Processor -- start 2023-11-28T11:58:45.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.299+0000 7f0fc7fff700 1 -- start start 2023-11-28T11:58:45.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.303+0000 7f0fc7fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f0fc815c310 0x7f0fc80d1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:45.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.303+0000 7f0fc7fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fc80707d0 0x7f0fc8069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:45.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.303+0000 7f0fc7fff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fc80cd080 con 0x7f0fc806b830 2023-11-28T11:58:45.306 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.303+0000 7f0fc7fff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc806d240 con 0x7f0fc815c310 2023-11-28T11:58:45.306 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.303+0000 7f0fc7fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc80d21a0 con 0x7f0fc80707d0 2023-11-28T11:58:45.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.303+0000 7f0fc77fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fc80707d0 0x7f0fc8069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:45.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.303+0000 7f0fc6ffd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f0fc815c310 0x7f0fc80d1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:45.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.303+0000 7f0fc67fc700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f0fc806b830 0x7f0fc80700c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:55328/0 (socket says 172.21.15.39:55328) 2023-11-28T11:58:45.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.303+0000 7f0fc67fc700 1 -- 172.21.15.39:0/1979198540 learned_addr learned my addr 172.21.15.39:0/1979198540 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:58:45.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.303+0000 7f0fc6ffd700 1 -- 172.21.15.39:0/1979198540 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fc80707d0 msgr2=0x7f0fc8069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:45.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.303+0000 7f0fc6ffd700 1 --2- 172.21.15.39:0/1979198540 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fc80707d0 0x7f0fc8069bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:45.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.303+0000 7f0fc6ffd700 1 -- 172.21.15.39:0/1979198540 >> v1:172.21.15.184:6789/0 conn(0x7f0fc806b830 legacy=0x7f0fc80700c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:45.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.303+0000 7f0fc6ffd700 1 -- 172.21.15.39:0/1979198540 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc80d1900 con 0x7f0fc815c310 2023-11-28T11:58:45.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.303+0000 7f0fc77fe700 1 --2- 172.21.15.39:0/1979198540 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fc80707d0 0x7f0fc8069bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:58:45.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.303+0000 7f0fc5ffb700 1 -- 172.21.15.39:0/1979198540 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1993991875 0 0) 0x7f0fc80cd080 con 0x7f0fc806b830 2023-11-28T11:58:45.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.307+0000 7f0fc6ffd700 1 --2- 172.21.15.39:0/1979198540 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fc815c310 0x7f0fc80d1310 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8009850 tx=0x7f0fb8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b186b3cb3ef3de9d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:45.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.307+0000 7f0fc5ffb700 1 -- 172.21.15.39:0/1979198540 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb8011830 con 0x7f0fc815c310 2023-11-28T11:58:45.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.307+0000 7f0fc5ffb700 1 -- 172.21.15.39:0/1979198540 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb8011990 con 0x7f0fc815c310 2023-11-28T11:58:45.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.307+0000 7f0fc5ffb700 1 -- 172.21.15.39:0/1979198540 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb8011d40 con 0x7f0fc815c310 2023-11-28T11:58:45.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.307+0000 7f0fc7fff700 1 -- 172.21.15.39:0/1979198540 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fc815c310 msgr2=0x7f0fc80d1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:45.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.307+0000 7f0fc7fff700 1 --2- 172.21.15.39:0/1979198540 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fc815c310 0x7f0fc80d1310 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8009850 tx=0x7f0fb8009b60 comp rx=0 tx=0).stop 2023-11-28T11:58:45.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.307+0000 7f0fc7fff700 1 -- 172.21.15.39:0/1979198540 shutdown_connections 2023-11-28T11:58:45.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.307+0000 7f0fc7fff700 1 --2- 172.21.15.39:0/1979198540 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fc80707d0 0x7f0fc8069bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:45.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.307+0000 7f0fc7fff700 1 --2- 172.21.15.39:0/1979198540 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fc815c310 0x7f0fc80d1310 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:45.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.307+0000 7f0fc7fff700 1 -- 172.21.15.39:0/1979198540 >> 172.21.15.39:0/1979198540 conn(0x7f0fc80d0140 msgr2=0x7f0fc80d2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:45.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.307+0000 7f0fc7fff700 1 -- 172.21.15.39:0/1979198540 shutdown_connections 2023-11-28T11:58:45.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.307+0000 7f0fc7fff700 1 -- 172.21.15.39:0/1979198540 wait complete. 2023-11-28T11:58:45.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.311+0000 7f0fc7fff700 1 Processor -- start 2023-11-28T11:58:45.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.311+0000 7f0fc7fff700 1 -- start start 2023-11-28T11:58:45.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.311+0000 7f0fc7fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fc806b830 0x7f0fc80b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:45.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.311+0000 7f0fc7fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fc80707d0 0x7f0fc80c6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:45.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.311+0000 7f0fc7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0fc815c310 0x7f0fc80c6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:45.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.311+0000 7f0fc7fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc80b7d60 con 0x7f0fc815c310 2023-11-28T11:58:45.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.311+0000 7f0fc7fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc81f5a70 con 0x7f0fc806b830 2023-11-28T11:58:45.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.311+0000 7f0fc7fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc80b8530 con 0x7f0fc80707d0 2023-11-28T11:58:45.315 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.311+0000 7f0fc77fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0fc815c310 0x7f0fc80c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:45.315 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.311+0000 7f0fc77fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0fc815c310 0x7f0fc80c6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55714/0 (socket says 172.21.15.39:55714) 2023-11-28T11:58:45.315 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.311+0000 7f0fc77fe700 1 -- 172.21.15.39:0/2085222570 learned_addr learned my addr 172.21.15.39:0/2085222570 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:45.315 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.311+0000 7f0fc67fc700 1 --2- 172.21.15.39:0/2085222570 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fc80707d0 0x7f0fc80c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:45.315 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.311+0000 7f0fc6ffd700 1 --2- 172.21.15.39:0/2085222570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fc806b830 0x7f0fc80b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:45.316 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.311+0000 7f0fc77fe700 1 -- 172.21.15.39:0/2085222570 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fc80707d0 msgr2=0x7f0fc80c6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:45.316 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.311+0000 7f0fc77fe700 1 --2- 172.21.15.39:0/2085222570 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fc80707d0 0x7f0fc80c6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:45.316 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.311+0000 7f0fc77fe700 1 -- 172.21.15.39:0/2085222570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fc806b830 msgr2=0x7f0fc80b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:45.316 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.311+0000 7f0fc77fe700 1 --2- 172.21.15.39:0/2085222570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fc806b830 0x7f0fc80b42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:45.316 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.311+0000 7f0fc77fe700 1 -- 172.21.15.39:0/2085222570 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc0009a70 con 0x7f0fc815c310 2023-11-28T11:58:45.316 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.311+0000 7f0fc77fe700 1 --2- 172.21.15.39:0/2085222570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0fc815c310 0x7f0fc80c6aa0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0009e00 tx=0x7f0fc000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:45.317 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.315+0000 7f0faffff700 1 -- 172.21.15.39:0/2085222570 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc000ca90 con 0x7f0fc815c310 2023-11-28T11:58:45.317 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.315+0000 7f0faffff700 1 -- 172.21.15.39:0/2085222570 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc000f040 con 0x7f0fc815c310 2023-11-28T11:58:45.317 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.315+0000 7f0fc7fff700 1 -- 172.21.15.39:0/2085222570 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fb80094b0 con 0x7f0fc815c310 2023-11-28T11:58:45.317 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.315+0000 7f0faffff700 1 -- 172.21.15.39:0/2085222570 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc000ce50 con 0x7f0fc815c310 2023-11-28T11:58:45.317 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.315+0000 7f0fc7fff700 1 -- 172.21.15.39:0/2085222570 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc806d450 con 0x7f0fc815c310 2023-11-28T11:58:45.319 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.315+0000 7f0fc7fff700 1 -- 172.21.15.39:0/2085222570 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fc815c6e0 con 0x7f0fc815c310 2023-11-28T11:58:45.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.315+0000 7f0faffff700 1 -- 172.21.15.39:0/2085222570 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0fc0014480 con 0x7f0fc815c310 2023-11-28T11:58:45.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.319+0000 7f0faffff700 1 --2- 172.21.15.39:0/2085222570 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0fb4064ee0 0x7f0fb4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:45.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.319+0000 7f0faffff700 1 -- 172.21.15.39:0/2085222570 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f0fc00824d0 con 0x7f0fc815c310 2023-11-28T11:58:45.322 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.319+0000 7f0fc6ffd700 1 --2- 172.21.15.39:0/2085222570 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0fb4064ee0 0x7f0fb4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:45.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.319+0000 7f0fc6ffd700 1 --2- 172.21.15.39:0/2085222570 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0fb4064ee0 0x7f0fb4067390 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0fb80090b0 tx=0x7f0fb8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:45.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.323+0000 7f0faffff700 1 -- 172.21.15.39:0/2085222570 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0fc0050700 con 0x7f0fc815c310 2023-11-28T11:58:45.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.495+0000 7f0fc7fff700 1 -- 172.21.15.39:0/2085222570 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0fc806d730 con 0x7f0fc815c310 2023-11-28T11:58:45.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.503+0000 7f0faffff700 1 -- 172.21.15.39:0/2085222570 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0fc0053d20 con 0x7f0fc815c310 2023-11-28T11:58:45.509 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.507+0000 7f0fc7fff700 1 -- 172.21.15.39:0/2085222570 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0fb4064ee0 msgr2=0x7f0fb4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:45.509 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.507+0000 7f0fc7fff700 1 --2- 172.21.15.39:0/2085222570 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0fb4064ee0 0x7f0fb4067390 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0fb80090b0 tx=0x7f0fb8008030 comp rx=0 tx=0).stop 2023-11-28T11:58:45.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.507+0000 7f0fc7fff700 1 -- 172.21.15.39:0/2085222570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0fc815c310 msgr2=0x7f0fc80c6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:45.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.507+0000 7f0fc7fff700 1 --2- 172.21.15.39:0/2085222570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0fc815c310 0x7f0fc80c6aa0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0009e00 tx=0x7f0fc000c3a0 comp rx=0 tx=0).stop 2023-11-28T11:58:45.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.507+0000 7f0fc7fff700 1 -- 172.21.15.39:0/2085222570 shutdown_connections 2023-11-28T11:58:45.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.507+0000 7f0fc7fff700 1 --2- 172.21.15.39:0/2085222570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0fc815c310 0x7f0fc80c6aa0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:45.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.507+0000 7f0fc7fff700 1 --2- 172.21.15.39:0/2085222570 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fc80707d0 0x7f0fc80c6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:45.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.507+0000 7f0fc7fff700 1 --2- 172.21.15.39:0/2085222570 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0fb4064ee0 0x7f0fb4067390 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:45.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.507+0000 7f0fc7fff700 1 --2- 172.21.15.39:0/2085222570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fc806b830 0x7f0fc80b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:45.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.507+0000 7f0fc7fff700 1 -- 172.21.15.39:0/2085222570 >> 172.21.15.39:0/2085222570 conn(0x7f0fc80d0140 msgr2=0x7f0fc815f260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:45.514 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.507+0000 7f0fc7fff700 1 -- 172.21.15.39:0/2085222570 shutdown_connections 2023-11-28T11:58:45.514 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.507+0000 7f0fc7fff700 1 -- 172.21.15.39:0/2085222570 wait complete. 2023-11-28T11:58:45.532 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T11:58:45.532 DEBUG:teuthology.orchestra.run.smithi039:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T11:58:45.574 DEBUG:teuthology.orchestra.run.smithi184:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T11:58:45.616 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T11:58:45.617 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:58:45.617 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:58:45.638 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352324k,nr_inodes=4088081,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6229 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T11:58:45.638 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:58:45.638 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:58:45.677 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352324k,nr_inodes=4088081,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9254 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T11:58:45.678 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:58:45.678 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:58:45.700 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352324k,nr_inodes=4088081,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6229 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T11:58:45.700 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:58:45.700 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:58:45.744 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352324k,nr_inodes=4088081,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9254 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T11:58:45.745 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-28T11:58:45.745 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:58:45.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.919+0000 7f9a07ccf700 1 Processor -- start 2023-11-28T11:58:45.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.919+0000 7f9a07ccf700 1 -- start start 2023-11-28T11:58:45.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.923+0000 7f9a07ccf700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9a000c8d10 0x7f9a000cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:45.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.923+0000 7f9a07ccf700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a00069d60 0x7f9a0006a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:45.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.923+0000 7f9a07ccf700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a0015a850 con 0x7f9a0015a480 2023-11-28T11:58:45.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.923+0000 7f9a07ccf700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a000ce060 con 0x7f9a000c8d10 2023-11-28T11:58:45.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.923+0000 7f9a07ccf700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a000ce300 con 0x7f9a00069d60 2023-11-28T11:58:45.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.923+0000 7f9a0526a700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9a000c8d10 0x7f9a000cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:45.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.923+0000 7f9a05a6b700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f9a0015a480 0x7f9a000cc290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:55340/0 (socket says 172.21.15.39:55340) 2023-11-28T11:58:45.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.923+0000 7f9a0526a700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9a000c8d10 0x7f9a000cc9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55716/0 (socket says 172.21.15.39:55716) 2023-11-28T11:58:45.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.923+0000 7f9a0526a700 1 -- 172.21.15.39:0/181133599 learned_addr learned my addr 172.21.15.39:0/181133599 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:45.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.923+0000 7f9a0626c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a00069d60 0x7f9a0006a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:45.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.923+0000 7f9a0526a700 1 -- 172.21.15.39:0/181133599 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a00069d60 msgr2=0x7f9a0006a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:45.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.923+0000 7f9a0526a700 1 --2- 172.21.15.39:0/181133599 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a00069d60 0x7f9a0006a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:45.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.923+0000 7f9a0526a700 1 -- 172.21.15.39:0/181133599 >> v1:172.21.15.184:6789/0 conn(0x7f9a0015a480 legacy=0x7f9a000cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:45.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.923+0000 7f9a0526a700 1 -- 172.21.15.39:0/181133599 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a000cada0 con 0x7f9a000c8d10 2023-11-28T11:58:45.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.923+0000 7f9a0526a700 1 --2- 172.21.15.39:0/181133599 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9a000c8d10 0x7f9a000cc9a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f99f0009910 tx=0x7f99f0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c59e181386084b55 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:45.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.927+0000 7f9a04a69700 1 -- 172.21.15.39:0/181133599 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f0011830 con 0x7f9a000c8d10 2023-11-28T11:58:45.929 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.927+0000 7f9a04a69700 1 -- 172.21.15.39:0/181133599 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f0011990 con 0x7f9a000c8d10 2023-11-28T11:58:45.929 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.927+0000 7f9a04a69700 1 -- 172.21.15.39:0/181133599 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f0011d40 con 0x7f9a000c8d10 2023-11-28T11:58:45.929 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.927+0000 7f9a07ccf700 1 -- 172.21.15.39:0/181133599 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9a000c8d10 msgr2=0x7f9a000cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:45.929 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.927+0000 7f9a07ccf700 1 --2- 172.21.15.39:0/181133599 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9a000c8d10 0x7f9a000cc9a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f99f0009910 tx=0x7f99f0009c20 comp rx=0 tx=0).stop 2023-11-28T11:58:45.930 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.927+0000 7f9a07ccf700 1 -- 172.21.15.39:0/181133599 shutdown_connections 2023-11-28T11:58:45.930 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.927+0000 7f9a07ccf700 1 --2- 172.21.15.39:0/181133599 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a00069d60 0x7f9a0006a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:45.930 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.927+0000 7f9a07ccf700 1 --2- 172.21.15.39:0/181133599 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9a000c8d10 0x7f9a000cc9a0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:45.930 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.927+0000 7f9a07ccf700 1 -- 172.21.15.39:0/181133599 >> 172.21.15.39:0/181133599 conn(0x7f9a000cf350 msgr2=0x7f9a000b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:45.930 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.927+0000 7f9a07ccf700 1 -- 172.21.15.39:0/181133599 shutdown_connections 2023-11-28T11:58:45.930 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.927+0000 7f9a07ccf700 1 -- 172.21.15.39:0/181133599 wait complete. 2023-11-28T11:58:45.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.931+0000 7f9a07ccf700 1 Processor -- start 2023-11-28T11:58:45.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.931+0000 7f9a07ccf700 1 -- start start 2023-11-28T11:58:45.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.931+0000 7f9a07ccf700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a00069d60 0x7f9a00150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:45.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.931+0000 7f9a07ccf700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a000c8d10 0x7f9a0015b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:45.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.931+0000 7f9a07ccf700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9a0015a480 0x7f9a000b3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:45.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.931+0000 7f9a07ccf700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a000c6860 con 0x7f9a0015a480 2023-11-28T11:58:45.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.931+0000 7f9a07ccf700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0015c7c0 con 0x7f9a000c8d10 2023-11-28T11:58:45.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.931+0000 7f9a07ccf700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0015bc40 con 0x7f9a00069d60 2023-11-28T11:58:45.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.931+0000 7f9a0626c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9a0015a480 0x7f9a000b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:45.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.931+0000 7f9a0626c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9a0015a480 0x7f9a000b3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55722/0 (socket says 172.21.15.39:55722) 2023-11-28T11:58:45.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.931+0000 7f9a0626c700 1 -- 172.21.15.39:0/3553471995 learned_addr learned my addr 172.21.15.39:0/3553471995 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:45.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.931+0000 7f9a05a6b700 1 --2- 172.21.15.39:0/3553471995 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a00069d60 0x7f9a00150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:45.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.931+0000 7f9a0526a700 1 --2- 172.21.15.39:0/3553471995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a000c8d10 0x7f9a0015b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:45.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.931+0000 7f9a0626c700 1 -- 172.21.15.39:0/3553471995 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a00069d60 msgr2=0x7f9a00150b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:45.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.931+0000 7f9a0626c700 1 --2- 172.21.15.39:0/3553471995 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a00069d60 0x7f9a00150b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:45.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.931+0000 7f9a0626c700 1 -- 172.21.15.39:0/3553471995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a000c8d10 msgr2=0x7f9a0015b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:45.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.931+0000 7f9a0626c700 1 --2- 172.21.15.39:0/3553471995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a000c8d10 0x7f9a0015b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:45.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.931+0000 7f9a0626c700 1 -- 172.21.15.39:0/3553471995 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f0009570 con 0x7f9a0015a480 2023-11-28T11:58:45.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.931+0000 7f9a0526a700 1 --2- 172.21.15.39:0/3553471995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a000c8d10 0x7f9a0015b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:58:45.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.931+0000 7f9a0626c700 1 --2- 172.21.15.39:0/3553471995 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9a0015a480 0x7f9a000b3200 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f99f800efc0 tx=0x7f99f800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:45.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.935+0000 7f99f67fc700 1 -- 172.21.15.39:0/3553471995 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f800cb80 con 0x7f9a0015a480 2023-11-28T11:58:45.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.935+0000 7f99f67fc700 1 -- 172.21.15.39:0/3553471995 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f800f040 con 0x7f9a0015a480 2023-11-28T11:58:45.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.935+0000 7f99f67fc700 1 -- 172.21.15.39:0/3553471995 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f8014480 con 0x7f9a0015a480 2023-11-28T11:58:45.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.935+0000 7f9a07ccf700 1 -- 172.21.15.39:0/3553471995 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a000add50 con 0x7f9a0015a480 2023-11-28T11:58:45.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.935+0000 7f9a07ccf700 1 -- 172.21.15.39:0/3553471995 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a000caa30 con 0x7f9a0015a480 2023-11-28T11:58:45.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.935+0000 7f9a07ccf700 1 -- 172.21.15.39:0/3553471995 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a000ca6e0 con 0x7f9a0015a480 2023-11-28T11:58:45.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.935+0000 7f99f67fc700 1 -- 172.21.15.39:0/3553471995 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f99f80145e0 con 0x7f9a0015a480 2023-11-28T11:58:45.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.939+0000 7f99f67fc700 1 --2- 172.21.15.39:0/3553471995 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f99e4064f10 0x7f99e40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:45.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.939+0000 7f99f67fc700 1 -- 172.21.15.39:0/3553471995 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f99f8082660 con 0x7f9a0015a480 2023-11-28T11:58:45.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.939+0000 7f9a05a6b700 1 --2- 172.21.15.39:0/3553471995 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f99e4064f10 0x7f99e40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:45.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.939+0000 7f9a05a6b700 1 --2- 172.21.15.39:0/3553471995 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f99e4064f10 0x7f99e40673c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f99fc000f60 tx=0x7f99fc007ef0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:45.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:45.943+0000 7f99f67fc700 1 -- 172.21.15.39:0/3553471995 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f99f8050930 con 0x7f9a0015a480 2023-11-28T11:58:46.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.155+0000 7f9a07ccf700 1 -- 172.21.15.39:0/3553471995 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a000c69a0 con 0x7f9a0015a480 2023-11-28T11:58:46.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.159+0000 7f99f67fc700 1 -- 172.21.15.39:0/3553471995 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f99f8018de0 con 0x7f9a0015a480 2023-11-28T11:58:46.161 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:58:46.161 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/3875562914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3875562914},{"type":"v1","addr":"172.21.15.184:6836","nonce":3875562914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5295,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/4053840838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":4053840838},{"type":"v1","addr":"172.21.15.39:6833","nonce":4053840838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5304,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2819411287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2819411287},{"type":"v1","addr":"172.21.15.39:6835","nonce":2819411287}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5737,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/3204767004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3204767004},{"type":"v1","addr":"172.21.15.184:6837","nonce":3204767004}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[]} 2023-11-28T11:58:46.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.159+0000 7f9a07ccf700 1 -- 172.21.15.39:0/3553471995 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f99e4064f10 msgr2=0x7f99e40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:46.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.159+0000 7f9a07ccf700 1 --2- 172.21.15.39:0/3553471995 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f99e4064f10 0x7f99e40673c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f99fc000f60 tx=0x7f99fc007ef0 comp rx=0 tx=0).stop 2023-11-28T11:58:46.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.159+0000 7f9a07ccf700 1 -- 172.21.15.39:0/3553471995 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9a0015a480 msgr2=0x7f9a000b3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:46.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.159+0000 7f9a07ccf700 1 --2- 172.21.15.39:0/3553471995 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9a0015a480 0x7f9a000b3200 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f99f800efc0 tx=0x7f99f800c0c0 comp rx=0 tx=0).stop 2023-11-28T11:58:46.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.159+0000 7f9a07ccf700 1 -- 172.21.15.39:0/3553471995 shutdown_connections 2023-11-28T11:58:46.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.159+0000 7f9a07ccf700 1 --2- 172.21.15.39:0/3553471995 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9a0015a480 0x7f9a000b3200 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:46.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.159+0000 7f9a07ccf700 1 --2- 172.21.15.39:0/3553471995 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f99e4064f10 0x7f99e40673c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:46.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.159+0000 7f9a07ccf700 1 --2- 172.21.15.39:0/3553471995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a000c8d10 0x7f9a0015b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:46.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.159+0000 7f9a07ccf700 1 --2- 172.21.15.39:0/3553471995 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a00069d60 0x7f9a00150b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:46.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.159+0000 7f9a07ccf700 1 -- 172.21.15.39:0/3553471995 >> 172.21.15.39:0/3553471995 conn(0x7f9a000cf350 msgr2=0x7f9a000aba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:46.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.159+0000 7f9a07ccf700 1 -- 172.21.15.39:0/3553471995 shutdown_connections 2023-11-28T11:58:46.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.159+0000 7f9a07ccf700 1 -- 172.21.15.39:0/3553471995 wait complete. 2023-11-28T11:58:46.167 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 18 2023-11-28T11:58:46.183 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T11:58:46.183 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-28T11:58:46.183 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-28T11:58:46.183 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:58:46.184 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T11:58:46.184 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-28T11:58:46.184 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-28T11:58:46.184 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:58:46.185 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T11:58:46.185 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-28T11:58:46.185 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-28T11:58:46.185 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:58:46.185 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-28T11:58:46.186 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-28T11:58:46.186 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-28T11:58:46.186 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:58:46.206 INFO:tasks.ceph.mds.a:Stopped 2023-11-28T11:58:46.206 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T11:58:46.208 INFO:tasks.ceph.mds.c:Stopped 2023-11-28T11:58:46.208 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T11:58:46.209 INFO:tasks.ceph.mds.d:Stopped 2023-11-28T11:58:46.209 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-28T11:58:46.210 INFO:tasks.ceph.mds.b:Stopped 2023-11-28T11:58:46.210 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T11:58:46.258 INFO:tasks.ceph.mds.a:Started 2023-11-28T11:58:46.259 DEBUG:teuthology.parallel:result is None 2023-11-28T11:58:46.259 INFO:tasks.ceph.mds.d:Started 2023-11-28T11:58:46.259 DEBUG:teuthology.parallel:result is None 2023-11-28T11:58:46.264 INFO:tasks.ceph.mds.c:Started 2023-11-28T11:58:46.265 DEBUG:teuthology.parallel:result is None 2023-11-28T11:58:46.265 INFO:tasks.ceph.mds.b:Started 2023-11-28T11:58:46.265 DEBUG:teuthology.parallel:result is None 2023-11-28T11:58:46.266 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-28T11:58:46.384 INFO:tasks.ceph.mds.c.smithi039.stdout:starting mds.c at 2023-11-28T11:58:46.385 INFO:tasks.ceph.mds.a.smithi039.stdout:starting mds.a at 2023-11-28T11:58:46.387 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2023-11-28T11:58:46.396 INFO:tasks.ceph.mds.b.smithi184.stdout:starting mds.b at 2023-11-28T11:58:46.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.439+0000 7fab8d3e6700 1 Processor -- start 2023-11-28T11:58:46.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.439+0000 7fab8d3e6700 1 -- start start 2023-11-28T11:58:46.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.443+0000 7fab8d3e6700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fab88069f90 0x7fab8806a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:46.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.443+0000 7fab8d3e6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab8806ead0 0x7fab8806c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:46.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.443+0000 7fab8d3e6700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fab8815a1b0 0x7fab8815a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:46.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.443+0000 7fab8d3e6700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab880ca300 con 0x7fab8815a1b0 2023-11-28T11:58:46.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.443+0000 7fab8d3e6700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab8806a8a0 con 0x7fab88069f90 2023-11-28T11:58:46.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.443+0000 7fab8d3e6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8806f010 con 0x7fab8806ead0 2023-11-28T11:58:46.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.443+0000 7fab877fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fab8815a1b0 0x7fab8815a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:46.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.443+0000 7fab867fc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab8806ead0 0x7fab8806c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:46.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.443+0000 7fab86ffd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fab88069f90 0x7fab8806a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:46.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.443+0000 7fab877fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fab8815a1b0 0x7fab8815a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55760/0 (socket says 172.21.15.39:55760) 2023-11-28T11:58:46.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.443+0000 7fab877fe700 1 -- 172.21.15.39:0/2403327437 learned_addr learned my addr 172.21.15.39:0/2403327437 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:46.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.447+0000 7fab877fe700 1 -- 172.21.15.39:0/2403327437 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab8806ead0 msgr2=0x7fab8806c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:46.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.447+0000 7fab877fe700 1 --2- 172.21.15.39:0/2403327437 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab8806ead0 0x7fab8806c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:46.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.447+0000 7fab877fe700 1 -- 172.21.15.39:0/2403327437 >> v2:172.21.15.184:3300/0 conn(0x7fab88069f90 msgr2=0x7fab8806a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:46.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.447+0000 7fab877fe700 1 --2- 172.21.15.39:0/2403327437 >> v2:172.21.15.184:3300/0 conn(0x7fab88069f90 0x7fab8806a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:46.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.447+0000 7fab877fe700 1 -- 172.21.15.39:0/2403327437 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8806f2f0 con 0x7fab8815a1b0 2023-11-28T11:58:46.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.447+0000 7fab877fe700 1 --2- 172.21.15.39:0/2403327437 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab8815a1b0 0x7fab8815a610 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fab880cf520 tx=0x7fab8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a275e9294c6814af server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:46.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.447+0000 7fab85ffb700 1 -- 172.21.15.39:0/2403327437 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8000e070 con 0x7fab8815a1b0 2023-11-28T11:58:46.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.447+0000 7fab85ffb700 1 -- 172.21.15.39:0/2403327437 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8000b910 con 0x7fab8815a1b0 2023-11-28T11:58:46.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.447+0000 7fab85ffb700 1 -- 172.21.15.39:0/2403327437 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8000bcc0 con 0x7fab8815a1b0 2023-11-28T11:58:46.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.447+0000 7fab8d3e6700 1 -- 172.21.15.39:0/2403327437 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab8815a1b0 msgr2=0x7fab8815a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:46.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.447+0000 7fab8d3e6700 1 --2- 172.21.15.39:0/2403327437 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab8815a1b0 0x7fab8815a610 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fab880cf520 tx=0x7fab8000b330 comp rx=0 tx=0).stop 2023-11-28T11:58:46.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.447+0000 7fab8d3e6700 1 -- 172.21.15.39:0/2403327437 shutdown_connections 2023-11-28T11:58:46.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.447+0000 7fab8d3e6700 1 --2- 172.21.15.39:0/2403327437 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab8806ead0 0x7fab8806c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:46.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.447+0000 7fab8d3e6700 1 --2- 172.21.15.39:0/2403327437 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab8815a1b0 0x7fab8815a610 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:46.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.447+0000 7fab8d3e6700 1 --2- 172.21.15.39:0/2403327437 >> v2:172.21.15.184:3300/0 conn(0x7fab88069f90 0x7fab8806a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:46.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.447+0000 7fab8d3e6700 1 -- 172.21.15.39:0/2403327437 >> 172.21.15.39:0/2403327437 conn(0x7fab880d03b0 msgr2=0x7fab880cc1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:46.452 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.447+0000 7fab8d3e6700 1 -- 172.21.15.39:0/2403327437 shutdown_connections 2023-11-28T11:58:46.452 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.447+0000 7fab8d3e6700 1 -- 172.21.15.39:0/2403327437 wait complete. 2023-11-28T11:58:46.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.451+0000 7fab8d3e6700 1 Processor -- start 2023-11-28T11:58:46.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.451+0000 7fab8d3e6700 1 -- start start 2023-11-28T11:58:46.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.451+0000 7fab8d3e6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab88069f90 0x7fab880ac1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:46.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.451+0000 7fab8d3e6700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab8806ead0 0x7fab880c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:46.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.451+0000 7fab8d3e6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab8815a1b0 0x7fab881557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:46.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.451+0000 7fab8d3e6700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab880af030 con 0x7fab8806ead0 2023-11-28T11:58:46.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.451+0000 7fab8d3e6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab880af310 con 0x7fab88069f90 2023-11-28T11:58:46.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.451+0000 7fab8d3e6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab880af5f0 con 0x7fab8815a1b0 2023-11-28T11:58:46.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.451+0000 7fab867fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab8806ead0 0x7fab880c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:46.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.451+0000 7fab867fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab8806ead0 0x7fab880c5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55762/0 (socket says 172.21.15.39:55762) 2023-11-28T11:58:46.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.451+0000 7fab867fc700 1 -- 172.21.15.39:0/3455424575 learned_addr learned my addr 172.21.15.39:0/3455424575 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:46.457 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.451+0000 7fab877fe700 1 --2- 172.21.15.39:0/3455424575 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab8815a1b0 0x7fab881557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:46.457 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.451+0000 7fab86ffd700 1 --2- 172.21.15.39:0/3455424575 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab88069f90 0x7fab880ac1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:46.457 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.451+0000 7fab867fc700 1 -- 172.21.15.39:0/3455424575 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab8815a1b0 msgr2=0x7fab881557f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:46.457 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.451+0000 7fab867fc700 1 --2- 172.21.15.39:0/3455424575 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab8815a1b0 0x7fab881557f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:46.457 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.451+0000 7fab867fc700 1 -- 172.21.15.39:0/3455424575 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab88069f90 msgr2=0x7fab880ac1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:46.457 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.451+0000 7fab867fc700 1 --2- 172.21.15.39:0/3455424575 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab88069f90 0x7fab880ac1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:46.457 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.451+0000 7fab867fc700 1 -- 172.21.15.39:0/3455424575 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab80009b30 con 0x7fab8806ead0 2023-11-28T11:58:46.457 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.451+0000 7fab877fe700 1 --2- 172.21.15.39:0/3455424575 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab8815a1b0 0x7fab881557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:58:46.457 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.451+0000 7fab867fc700 1 --2- 172.21.15.39:0/3455424575 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab8806ead0 0x7fab880c5810 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fab7c009fd0 tx=0x7fab7c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:46.457 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.455+0000 7fab6f7fe700 1 -- 172.21.15.39:0/3455424575 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c0095a0 con 0x7fab8806ead0 2023-11-28T11:58:46.457 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.455+0000 7fab6f7fe700 1 -- 172.21.15.39:0/3455424575 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab7c013680 con 0x7fab8806ead0 2023-11-28T11:58:46.458 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.455+0000 7fab6f7fe700 1 -- 172.21.15.39:0/3455424575 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c013a10 con 0x7fab8806ead0 2023-11-28T11:58:46.458 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.455+0000 7fab8d3e6700 1 -- 172.21.15.39:0/3455424575 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab8806f8b0 con 0x7fab8806ead0 2023-11-28T11:58:46.458 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.455+0000 7fab8d3e6700 1 -- 172.21.15.39:0/3455424575 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab8806f5d0 con 0x7fab8806ead0 2023-11-28T11:58:46.458 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.455+0000 7fab8d3e6700 1 -- 172.21.15.39:0/3455424575 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab8806c760 con 0x7fab8806ead0 2023-11-28T11:58:46.459 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.455+0000 7fab6f7fe700 1 -- 172.21.15.39:0/3455424575 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fab7c019030 con 0x7fab8806ead0 2023-11-28T11:58:46.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.459+0000 7fab6f7fe700 1 --2- 172.21.15.39:0/3455424575 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fab74064f10 0x7fab740673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:46.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.459+0000 7fab6f7fe700 1 -- 172.21.15.39:0/3455424575 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fab7c081b80 con 0x7fab8806ead0 2023-11-28T11:58:46.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.459+0000 7fab86ffd700 1 --2- 172.21.15.39:0/3455424575 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fab74064f10 0x7fab740673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:46.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.459+0000 7fab86ffd700 1 --2- 172.21.15.39:0/3455424575 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fab74064f10 0x7fab740673c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fab78009a60 tx=0x7fab78008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:46.465 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.463+0000 7fab6f7fe700 1 -- 172.21.15.39:0/3455424575 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fab7c04fe10 con 0x7fab8806ead0 2023-11-28T11:58:46.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:46.647+0000 7fab8d3e6700 1 -- 172.21.15.39:0/3455424575 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fab88073cb0 con 0x7fab8806ead0 2023-11-28T11:58:47.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.443+0000 7fab6f7fe700 1 -- 172.21.15.39:0/3455424575 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v54) v1 ==== 97+0+0 (secure 0 0 0) 0x7fab7c053430 con 0x7fab8806ead0 2023-11-28T11:58:47.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.447+0000 7fab8d3e6700 1 -- 172.21.15.39:0/3455424575 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fab74064f10 msgr2=0x7fab740673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:47.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.447+0000 7fab8d3e6700 1 --2- 172.21.15.39:0/3455424575 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fab74064f10 0x7fab740673c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fab78009a60 tx=0x7fab78008040 comp rx=0 tx=0).stop 2023-11-28T11:58:47.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.447+0000 7fab8d3e6700 1 -- 172.21.15.39:0/3455424575 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab8806ead0 msgr2=0x7fab880c5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:47.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.447+0000 7fab8d3e6700 1 --2- 172.21.15.39:0/3455424575 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab8806ead0 0x7fab880c5810 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fab7c009fd0 tx=0x7fab7c00ebd0 comp rx=0 tx=0).stop 2023-11-28T11:58:47.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.447+0000 7fab8d3e6700 1 -- 172.21.15.39:0/3455424575 shutdown_connections 2023-11-28T11:58:47.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.447+0000 7fab8d3e6700 1 --2- 172.21.15.39:0/3455424575 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab8815a1b0 0x7fab881557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:47.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.447+0000 7fab8d3e6700 1 --2- 172.21.15.39:0/3455424575 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab8806ead0 0x7fab880c5810 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:47.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.447+0000 7fab8d3e6700 1 --2- 172.21.15.39:0/3455424575 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fab74064f10 0x7fab740673c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:47.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.447+0000 7fab8d3e6700 1 --2- 172.21.15.39:0/3455424575 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab88069f90 0x7fab880ac1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:47.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.447+0000 7fab8d3e6700 1 -- 172.21.15.39:0/3455424575 >> 172.21.15.39:0/3455424575 conn(0x7fab880d03b0 msgr2=0x7fab881587b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:47.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.447+0000 7fab8d3e6700 1 -- 172.21.15.39:0/3455424575 shutdown_connections 2023-11-28T11:58:47.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.447+0000 7fab8d3e6700 1 -- 172.21.15.39:0/3455424575 wait complete. 2023-11-28T11:58:47.451 INFO:teuthology.orchestra.run.smithi039.stderr: removed all blocklist entries 2023-11-28T11:58:47.475 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-28T11:58:47.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.659+0000 7fb5f28aa700 1 Processor -- start 2023-11-28T11:58:47.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.659+0000 7fb5f28aa700 1 -- start start 2023-11-28T11:58:47.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.663+0000 7fb5f28aa700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb5ec156790 0x7fb5ec0cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:47.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.663+0000 7fb5f28aa700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5ec156b60 0x7fb5ec0ce000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:47.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.663+0000 7fb5f28aa700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5ec06b0d0 con 0x7fb5ec15fea0 2023-11-28T11:58:47.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.663+0000 7fb5f28aa700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5ec0ce540 con 0x7fb5ec156790 2023-11-28T11:58:47.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.663+0000 7fb5f28aa700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec06b560 con 0x7fb5ec156b60 2023-11-28T11:58:47.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.663+0000 7fb5ebfff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb5ec156790 0x7fb5ec0cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:47.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.663+0000 7fb5ebfff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb5ec156790 0x7fb5ec0cc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55768/0 (socket says 172.21.15.39:55768) 2023-11-28T11:58:47.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.663+0000 7fb5ebfff700 1 -- 172.21.15.39:0/145300523 learned_addr learned my addr 172.21.15.39:0/145300523 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:47.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.663+0000 7fb5e3fff700 1 --2- 172.21.15.39:0/145300523 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5ec156b60 0x7fb5ec0ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:47.668 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.663+0000 7fb5ebfff700 1 -- 172.21.15.39:0/145300523 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5ec156b60 msgr2=0x7fb5ec0ce000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:47.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.663+0000 7fb5ebfff700 1 --2- 172.21.15.39:0/145300523 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5ec156b60 0x7fb5ec0ce000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:47.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.663+0000 7fb5ebfff700 1 -- 172.21.15.39:0/145300523 >> v1:172.21.15.184:6789/0 conn(0x7fb5ec15fea0 legacy=0x7fb5ec15c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:47.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.663+0000 7fb5ebfff700 1 -- 172.21.15.39:0/145300523 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ec0cc990 con 0x7fb5ec156790 2023-11-28T11:58:47.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.663+0000 7fb5ebfff700 1 --2- 172.21.15.39:0/145300523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5ec156790 0x7fb5ec0cc290 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc009910 tx=0x7fb5dc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b7b2f23babbccb8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:47.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.667+0000 7fb5eb7fe700 1 -- 172.21.15.39:0/145300523 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc011830 con 0x7fb5ec156790 2023-11-28T11:58:47.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.667+0000 7fb5eb7fe700 1 -- 172.21.15.39:0/145300523 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5dc011990 con 0x7fb5ec156790 2023-11-28T11:58:47.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.667+0000 7fb5eb7fe700 1 -- 172.21.15.39:0/145300523 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc011d40 con 0x7fb5ec156790 2023-11-28T11:58:47.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.667+0000 7fb5f28aa700 1 -- 172.21.15.39:0/145300523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5ec156790 msgr2=0x7fb5ec0cc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:47.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.667+0000 7fb5f28aa700 1 --2- 172.21.15.39:0/145300523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5ec156790 0x7fb5ec0cc290 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc009910 tx=0x7fb5dc009c20 comp rx=0 tx=0).stop 2023-11-28T11:58:47.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.667+0000 7fb5f28aa700 1 -- 172.21.15.39:0/145300523 shutdown_connections 2023-11-28T11:58:47.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.667+0000 7fb5f28aa700 1 --2- 172.21.15.39:0/145300523 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5ec156b60 0x7fb5ec0ce000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:47.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.667+0000 7fb5f28aa700 1 --2- 172.21.15.39:0/145300523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5ec156790 0x7fb5ec0cc290 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:47.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.667+0000 7fb5f28aa700 1 -- 172.21.15.39:0/145300523 >> 172.21.15.39:0/145300523 conn(0x7fb5ec0cf350 msgr2=0x7fb5ec0b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:47.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.667+0000 7fb5f28aa700 1 -- 172.21.15.39:0/145300523 shutdown_connections 2023-11-28T11:58:47.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.667+0000 7fb5f28aa700 1 -- 172.21.15.39:0/145300523 wait complete. 2023-11-28T11:58:47.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.671+0000 7fb5f28aa700 1 Processor -- start 2023-11-28T11:58:47.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.671+0000 7fb5f28aa700 1 -- start start 2023-11-28T11:58:47.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.671+0000 7fb5f28aa700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5ec156790 0x7fb5ec1e6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:47.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.671+0000 7fb5f28aa700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5ec156b60 0x7fb5ec1517f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:47.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.671+0000 7fb5f28aa700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5ec15fea0 0x7fb5ec151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:47.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.671+0000 7fb5f28aa700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec0b2710 con 0x7fb5ec156b60 2023-11-28T11:58:47.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.671+0000 7fb5f28aa700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec0c3600 con 0x7fb5ec15fea0 2023-11-28T11:58:47.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.671+0000 7fb5f28aa700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec0c3320 con 0x7fb5ec156790 2023-11-28T11:58:47.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.671+0000 7fb5e3fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5ec156b60 0x7fb5ec1517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:47.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.671+0000 7fb5e3fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5ec156b60 0x7fb5ec1517f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55774/0 (socket says 172.21.15.39:55774) 2023-11-28T11:58:47.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.671+0000 7fb5e3fff700 1 -- 172.21.15.39:0/2496325198 learned_addr learned my addr 172.21.15.39:0/2496325198 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:47.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.671+0000 7fb5ebfff700 1 --2- 172.21.15.39:0/2496325198 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5ec156790 0x7fb5ec1e6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:47.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.671+0000 7fb5f0e47700 1 --2- 172.21.15.39:0/2496325198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5ec15fea0 0x7fb5ec151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:47.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.671+0000 7fb5e3fff700 1 -- 172.21.15.39:0/2496325198 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5ec156790 msgr2=0x7fb5ec1e6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:47.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.671+0000 7fb5e3fff700 1 --2- 172.21.15.39:0/2496325198 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5ec156790 0x7fb5ec1e6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:47.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.671+0000 7fb5e3fff700 1 -- 172.21.15.39:0/2496325198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5ec15fea0 msgr2=0x7fb5ec151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:47.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.671+0000 7fb5e3fff700 1 --2- 172.21.15.39:0/2496325198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5ec15fea0 0x7fb5ec151d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:47.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.671+0000 7fb5e3fff700 1 -- 172.21.15.39:0/2496325198 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5dc009570 con 0x7fb5ec156b60 2023-11-28T11:58:47.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.675+0000 7fb5e3fff700 1 --2- 172.21.15.39:0/2496325198 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5ec156b60 0x7fb5ec1517f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb5d400e9d0 tx=0x7fb5d400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:47.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.675+0000 7fb5e97fa700 1 -- 172.21.15.39:0/2496325198 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4009720 con 0x7fb5ec156b60 2023-11-28T11:58:47.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.675+0000 7fb5e97fa700 1 -- 172.21.15.39:0/2496325198 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d400c7f0 con 0x7fb5ec156b60 2023-11-28T11:58:47.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.675+0000 7fb5e97fa700 1 -- 172.21.15.39:0/2496325198 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d400cb60 con 0x7fb5ec156b60 2023-11-28T11:58:47.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.675+0000 7fb5f28aa700 1 -- 172.21.15.39:0/2496325198 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5ec06aa80 con 0x7fb5ec156b60 2023-11-28T11:58:47.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.675+0000 7fb5f28aa700 1 -- 172.21.15.39:0/2496325198 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5ec06a7a0 con 0x7fb5ec156b60 2023-11-28T11:58:47.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.675+0000 7fb5f28aa700 1 -- 172.21.15.39:0/2496325198 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5ec06ad60 con 0x7fb5ec156b60 2023-11-28T11:58:47.679 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.675+0000 7fb5e97fa700 1 -- 172.21.15.39:0/2496325198 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb5d4019030 con 0x7fb5ec156b60 2023-11-28T11:58:47.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.679+0000 7fb5e97fa700 1 --2- 172.21.15.39:0/2496325198 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb5cc064ee0 0x7fb5cc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:47.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.679+0000 7fb5e97fa700 1 -- 172.21.15.39:0/2496325198 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fb5d4081b70 con 0x7fb5ec156b60 2023-11-28T11:58:47.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.679+0000 7fb5ebfff700 1 --2- 172.21.15.39:0/2496325198 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb5cc064ee0 0x7fb5cc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:47.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.679+0000 7fb5ebfff700 1 --2- 172.21.15.39:0/2496325198 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb5cc064ee0 0x7fb5cc067390 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc000c00 tx=0x7fb5dc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:47.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.683+0000 7fb5e97fa700 1 -- 172.21.15.39:0/2496325198 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb5d404ff20 con 0x7fb5ec156b60 2023-11-28T11:58:47.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.923+0000 7fb5f28aa700 1 -- 172.21.15.39:0/2496325198 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb5ec0726c0 con 0x7fb5ec156b60 2023-11-28T11:58:47.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.923+0000 7fb5e97fa700 1 -- 172.21.15.39:0/2496325198 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+5298 (secure 0 0 0) 0x7fb5d4053540 con 0x7fb5ec156b60 2023-11-28T11:58:47.928 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:58:47.928 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2023-11-28T11:58:47.928 INFO:teuthology.orchestra.run.smithi039.stdout: "auth_dump": [ 2023-11-28T11:58:47.929 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:58:47.929 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mds.a", 2023-11-28T11:58:47.929 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQA01WVlQyBbKxAAY5bRNsaX8hfv1p9qFxGk7A==", 2023-11-28T11:58:47.929 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:58:47.929 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2023-11-28T11:58:47.929 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow *", 2023-11-28T11:58:47.929 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow *", 2023-11-28T11:58:47.929 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:58:47.929 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:58:47.929 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:58:47.929 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:58:47.929 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mds.b", 2023-11-28T11:58:47.929 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQA11WVlZB1uAxAAzd+69PaNzatkv+qGZhwEng==", 2023-11-28T11:58:47.930 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:58:47.930 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2023-11-28T11:58:47.930 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow *", 2023-11-28T11:58:47.930 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow *", 2023-11-28T11:58:47.930 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:58:47.930 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:58:47.930 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:58:47.930 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:58:47.930 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mds.c", 2023-11-28T11:58:47.930 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQA01WVltd/PNhAARPTeQ/ls/8rykZx5Nqpdaw==", 2023-11-28T11:58:47.930 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:58:47.931 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2023-11-28T11:58:47.931 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow *", 2023-11-28T11:58:47.931 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow *", 2023-11-28T11:58:47.931 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:58:47.931 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:58:47.931 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:58:47.931 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:58:47.931 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mds.d", 2023-11-28T11:58:47.931 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQA11WVl3BKfDhAABJE0cb9fBNb7Sy9gC8wS7w==", 2023-11-28T11:58:47.931 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:58:47.931 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2023-11-28T11:58:47.931 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow *", 2023-11-28T11:58:47.931 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow *", 2023-11-28T11:58:47.932 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:58:47.932 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:58:47.932 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:58:47.932 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:58:47.932 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.0", 2023-11-28T11:58:47.932 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQA81WVlStbVERAAQPnXIt45pPKg99io3w4nHA==", 2023-11-28T11:58:47.932 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:58:47.932 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2023-11-28T11:58:47.932 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2023-11-28T11:58:47.932 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:58:47.932 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:58:47.932 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:58:47.933 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:58:47.933 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.1", 2023-11-28T11:58:47.933 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQA/1WVlrdM7IxAA2g0ZCNubjLlQMt1fSQxrFQ==", 2023-11-28T11:58:47.933 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:58:47.933 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2023-11-28T11:58:47.933 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2023-11-28T11:58:47.933 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:58:47.933 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:58:47.933 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:58:47.933 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:58:47.934 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.2", 2023-11-28T11:58:47.934 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQBC1WVlg3ITMhAAm9eJaDLqZDJ0cZGrMdcAdQ==", 2023-11-28T11:58:47.934 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:58:47.934 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2023-11-28T11:58:47.934 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2023-11-28T11:58:47.934 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:58:47.934 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:58:47.934 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:58:47.934 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:58:47.934 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.3", 2023-11-28T11:58:47.934 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQBG1WVliM+vBhAAGP25Wh7MAPte/DgAH0t2sg==", 2023-11-28T11:58:47.935 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:58:47.935 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2023-11-28T11:58:47.935 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2023-11-28T11:58:47.935 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:58:47.935 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:58:47.935 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:58:47.935 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:58:47.935 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.4", 2023-11-28T11:58:47.935 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQBM1WVlFgQ0HxAAoisaw/l1WjPkX6ndrRC9zw==", 2023-11-28T11:58:47.935 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:58:47.935 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2023-11-28T11:58:47.935 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2023-11-28T11:58:47.936 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:58:47.936 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:58:47.936 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:58:47.936 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:58:47.936 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.5", 2023-11-28T11:58:47.936 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQBQ1WVlIGsdARAAFGnkOWG4A4wMr68uP8c73A==", 2023-11-28T11:58:47.936 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:58:47.937 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2023-11-28T11:58:47.937 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2023-11-28T11:58:47.937 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:58:47.941 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:58:47.941 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:58:47.941 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:58:47.941 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.6", 2023-11-28T11:58:47.941 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQBT1WVl7WokEBAAARrh+05BXBzm8tJPplREMg==", 2023-11-28T11:58:47.941 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:58:47.942 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2023-11-28T11:58:47.942 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2023-11-28T11:58:47.942 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:58:47.942 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:58:47.942 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:58:47.942 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:58:47.942 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.7", 2023-11-28T11:58:47.942 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQBW1WVl/yFiHhAAzxVK7EGFHEK0oEyqjaJ8uQ==", 2023-11-28T11:58:47.942 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:58:47.942 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2023-11-28T11:58:47.942 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2023-11-28T11:58:47.943 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:58:47.943 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:58:47.943 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:58:47.943 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:58:47.943 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.0", 2023-11-28T11:58:47.943 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQA11WVlc1G2FRAAQ7OTgUCsPgSquiptDBs73Q==", 2023-11-28T11:58:47.943 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:58:47.943 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2023-11-28T11:58:47.943 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow r", 2023-11-28T11:58:47.943 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow rw pool=cephfs_data" 2023-11-28T11:58:47.943 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:58:47.943 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:58:47.943 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:58:47.944 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.1", 2023-11-28T11:58:47.944 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQA11WVlrvFzIhAAgF6N85WgJkyxjS5R19vj2A==", 2023-11-28T11:58:47.944 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:58:47.944 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2023-11-28T11:58:47.944 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow r", 2023-11-28T11:58:47.944 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow rw", 2023-11-28T11:58:47.944 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow rwx" 2023-11-28T11:58:47.944 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:58:47.944 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:58:47.944 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:58:47.944 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.2", 2023-11-28T11:58:47.944 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQA11WVlWm/8GxAAXdoSzGMMGGRpddGUgipXaw==", 2023-11-28T11:58:47.944 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:58:47.945 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2023-11-28T11:58:47.945 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow r", 2023-11-28T11:58:47.945 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow rw", 2023-11-28T11:58:47.945 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow rwx" 2023-11-28T11:58:47.945 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:58:47.945 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:58:47.945 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:58:47.945 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.3", 2023-11-28T11:58:47.945 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQA11WVlhyZcKBAARWiULAwCFB1cHeFUgPlYKQ==", 2023-11-28T11:58:47.945 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:58:47.945 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2023-11-28T11:58:47.945 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow r", 2023-11-28T11:58:47.946 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow rw", 2023-11-28T11:58:47.946 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow rwx" 2023-11-28T11:58:47.946 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:58:47.946 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:58:47.946 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:58:47.946 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.admin", 2023-11-28T11:58:47.946 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQA01WVl0bEeARAAf2Z53D+fRxlgR+ySp2GojQ==", 2023-11-28T11:58:47.946 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:58:47.946 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow *", 2023-11-28T11:58:47.947 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow *", 2023-11-28T11:58:47.947 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow *", 2023-11-28T11:58:47.947 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:58:47.947 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:58:47.947 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:58:47.947 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:58:47.947 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mgr.x", 2023-11-28T11:58:47.947 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQA01WVlZ2c8JBAAZIy0cQXW2ZvyFXfMMhU66g==", 2023-11-28T11:58:47.947 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:58:47.947 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow *", 2023-11-28T11:58:47.947 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile mgr", 2023-11-28T11:58:47.947 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:58:47.948 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:58:47.948 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:58:47.948 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:58:47.948 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mgr.y", 2023-11-28T11:58:47.948 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQA01WVl2MuIHRAAJcRCzINF6RaIyQSyE4VLgQ==", 2023-11-28T11:58:47.948 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:58:47.948 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow *", 2023-11-28T11:58:47.948 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile mgr", 2023-11-28T11:58:47.948 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:58:47.948 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:58:47.948 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:58:47.948 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2023-11-28T11:58:47.949 INFO:teuthology.orchestra.run.smithi039.stdout:} 2023-11-28T11:58:47.949 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.931+0000 7fb5f28aa700 1 -- 172.21.15.39:0/2496325198 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb5cc064ee0 msgr2=0x7fb5cc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:47.950 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.931+0000 7fb5f28aa700 1 --2- 172.21.15.39:0/2496325198 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb5cc064ee0 0x7fb5cc067390 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc000c00 tx=0x7fb5dc008030 comp rx=0 tx=0).stop 2023-11-28T11:58:47.950 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.931+0000 7fb5f28aa700 1 -- 172.21.15.39:0/2496325198 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5ec156b60 msgr2=0x7fb5ec1517f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:47.950 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.931+0000 7fb5f28aa700 1 --2- 172.21.15.39:0/2496325198 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5ec156b60 0x7fb5ec1517f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb5d400e9d0 tx=0x7fb5d400ece0 comp rx=0 tx=0).stop 2023-11-28T11:58:47.950 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.931+0000 7fb5f28aa700 1 -- 172.21.15.39:0/2496325198 shutdown_connections 2023-11-28T11:58:47.950 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.931+0000 7fb5f28aa700 1 --2- 172.21.15.39:0/2496325198 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb5cc064ee0 0x7fb5cc067390 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:47.950 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.931+0000 7fb5f28aa700 1 --2- 172.21.15.39:0/2496325198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5ec15fea0 0x7fb5ec151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:47.950 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.931+0000 7fb5f28aa700 1 --2- 172.21.15.39:0/2496325198 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5ec156b60 0x7fb5ec1517f0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:47.950 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.931+0000 7fb5f28aa700 1 --2- 172.21.15.39:0/2496325198 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5ec156790 0x7fb5ec1e6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:47.950 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.931+0000 7fb5f28aa700 1 -- 172.21.15.39:0/2496325198 >> 172.21.15.39:0/2496325198 conn(0x7fb5ec0cf350 msgr2=0x7fb5ec15e960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:47.950 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.931+0000 7fb5f28aa700 1 -- 172.21.15.39:0/2496325198 shutdown_connections 2023-11-28T11:58:47.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:47.931+0000 7fb5f28aa700 1 -- 172.21.15.39:0/2496325198 wait complete. 2023-11-28T11:58:47.956 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:58:48.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.135+0000 7f1265faa700 1 Processor -- start 2023-11-28T11:58:48.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.135+0000 7f1265faa700 1 -- start start 2023-11-28T11:58:48.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.139+0000 7f1265faa700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f12601534a0 0x7f126015d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:48.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.139+0000 7f1265faa700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1260160920 0x7f12600b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:48.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.139+0000 7f1265faa700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f12600b6030 0x7f1260070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:48.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.139+0000 7f1265faa700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f126015d080 con 0x7f12601534a0 2023-11-28T11:58:48.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.139+0000 7f1265faa700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1260153870 con 0x7f12600b6030 2023-11-28T11:58:48.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.139+0000 7f1265faa700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12600b6450 con 0x7f1260160920 2023-11-28T11:58:48.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.139+0000 7f125f7fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f12601534a0 0x7f126015d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:48.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.139+0000 7f125effd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1260160920 0x7f12600b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:48.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.139+0000 7f125f7fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f12601534a0 0x7f126015d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43654/0 (socket says 172.21.15.39:43654) 2023-11-28T11:58:48.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.139+0000 7f125f7fe700 1 -- 172.21.15.39:0/119335449 learned_addr learned my addr 172.21.15.39:0/119335449 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:48.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.139+0000 7f125ffff700 1 --2- 172.21.15.39:0/119335449 >> v2:172.21.15.184:3300/0 conn(0x7f12600b6030 0x7f1260070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:48.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.139+0000 7f125effd700 1 -- 172.21.15.39:0/119335449 >> v2:172.21.15.184:3300/0 conn(0x7f12600b6030 msgr2=0x7f1260070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:48.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.139+0000 7f125effd700 1 --2- 172.21.15.39:0/119335449 >> v2:172.21.15.184:3300/0 conn(0x7f12600b6030 0x7f1260070630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:48.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.139+0000 7f125effd700 1 -- 172.21.15.39:0/119335449 >> v2:172.21.15.39:3300/0 conn(0x7f12601534a0 msgr2=0x7f126015d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:48.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.139+0000 7f125effd700 1 --2- 172.21.15.39:0/119335449 >> v2:172.21.15.39:3300/0 conn(0x7f12601534a0 0x7f126015d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:48.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.139+0000 7f125effd700 1 -- 172.21.15.39:0/119335449 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12600b53c0 con 0x7f1260160920 2023-11-28T11:58:48.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.139+0000 7f125f7fe700 1 --2- 172.21.15.39:0/119335449 >> v2:172.21.15.39:3300/0 conn(0x7f12601534a0 0x7f126015d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:58:48.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.139+0000 7f125effd700 1 --2- 172.21.15.39:0/119335449 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1260160920 0x7f12600b5af0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f12600d0790 tx=0x7f1254009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d746582739751f3a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:48.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.139+0000 7f125e7fc700 1 -- 172.21.15.39:0/119335449 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1254011830 con 0x7f1260160920 2023-11-28T11:58:48.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.139+0000 7f125e7fc700 1 -- 172.21.15.39:0/119335449 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1254011990 con 0x7f1260160920 2023-11-28T11:58:48.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.139+0000 7f125e7fc700 1 -- 172.21.15.39:0/119335449 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1254011d20 con 0x7f1260160920 2023-11-28T11:58:48.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.139+0000 7f1265faa700 1 -- 172.21.15.39:0/119335449 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1260160920 msgr2=0x7f12600b5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:48.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.139+0000 7f1265faa700 1 --2- 172.21.15.39:0/119335449 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1260160920 0x7f12600b5af0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f12600d0790 tx=0x7f1254009b30 comp rx=0 tx=0).stop 2023-11-28T11:58:48.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.143+0000 7f1265faa700 1 -- 172.21.15.39:0/119335449 shutdown_connections 2023-11-28T11:58:48.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.143+0000 7f1265faa700 1 --2- 172.21.15.39:0/119335449 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1260160920 0x7f12600b5af0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:48.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.143+0000 7f1265faa700 1 --2- 172.21.15.39:0/119335449 >> v2:172.21.15.184:3300/0 conn(0x7f12600b6030 0x7f1260070630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:48.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.143+0000 7f1265faa700 1 --2- 172.21.15.39:0/119335449 >> v2:172.21.15.39:3300/0 conn(0x7f12601534a0 0x7f126015d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:48.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.143+0000 7f1265faa700 1 -- 172.21.15.39:0/119335449 >> 172.21.15.39:0/119335449 conn(0x7f126006bfc0 msgr2=0x7f126006c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:48.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.143+0000 7f1265faa700 1 -- 172.21.15.39:0/119335449 shutdown_connections 2023-11-28T11:58:48.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.143+0000 7f1265faa700 1 -- 172.21.15.39:0/119335449 wait complete. 2023-11-28T11:58:48.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.143+0000 7f1265faa700 1 Processor -- start 2023-11-28T11:58:48.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.143+0000 7f1265faa700 1 -- start start 2023-11-28T11:58:48.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.147+0000 7f1265faa700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12600b6030 0x7f126014c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:48.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.147+0000 7f1265faa700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f12601534a0 0x7f126014df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:48.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.147+0000 7f1265faa700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1260160920 0x7f12601560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:48.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.147+0000 7f1265faa700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126014e8f0 con 0x7f1260160920 2023-11-28T11:58:48.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.147+0000 7f1265faa700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126014ebd0 con 0x7f12601534a0 2023-11-28T11:58:48.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.147+0000 7f1265faa700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126014eeb0 con 0x7f12600b6030 2023-11-28T11:58:48.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.147+0000 7f125ffff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1260160920 0x7f12601560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:48.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.147+0000 7f125ffff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1260160920 0x7f12601560f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43656/0 (socket says 172.21.15.39:43656) 2023-11-28T11:58:48.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.147+0000 7f125ffff700 1 -- 172.21.15.39:0/1219909808 learned_addr learned my addr 172.21.15.39:0/1219909808 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:48.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.147+0000 7f125f7fe700 1 --2- 172.21.15.39:0/1219909808 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12600b6030 0x7f126014c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:48.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.147+0000 7f125effd700 1 --2- 172.21.15.39:0/1219909808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f12601534a0 0x7f126014df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:48.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.147+0000 7f125ffff700 1 -- 172.21.15.39:0/1219909808 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12600b6030 msgr2=0x7f126014c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:48.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.147+0000 7f125ffff700 1 --2- 172.21.15.39:0/1219909808 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12600b6030 0x7f126014c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:48.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.147+0000 7f125ffff700 1 -- 172.21.15.39:0/1219909808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f12601534a0 msgr2=0x7f126014df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:48.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.147+0000 7f125ffff700 1 --2- 172.21.15.39:0/1219909808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f12601534a0 0x7f126014df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:48.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.147+0000 7f125ffff700 1 -- 172.21.15.39:0/1219909808 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1250009570 con 0x7f1260160920 2023-11-28T11:58:48.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.147+0000 7f125ffff700 1 --2- 172.21.15.39:0/1219909808 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1260160920 0x7f12601560f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f125800efc0 tx=0x7f125800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:48.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.147+0000 7f1247fff700 1 -- 172.21.15.39:0/1219909808 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125800cad0 con 0x7f1260160920 2023-11-28T11:58:48.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.147+0000 7f1247fff700 1 -- 172.21.15.39:0/1219909808 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125800f040 con 0x7f1260160920 2023-11-28T11:58:48.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.147+0000 7f1265faa700 1 -- 172.21.15.39:0/1219909808 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12540094b0 con 0x7f1260160920 2023-11-28T11:58:48.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.147+0000 7f1247fff700 1 -- 172.21.15.39:0/1219909808 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125800ce70 con 0x7f1260160920 2023-11-28T11:58:48.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.147+0000 7f1265faa700 1 -- 172.21.15.39:0/1219909808 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f126015ca30 con 0x7f1260160920 2023-11-28T11:58:48.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.151+0000 7f1265faa700 1 -- 172.21.15.39:0/1219909808 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12600b56a0 con 0x7f1260160920 2023-11-28T11:58:48.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.151+0000 7f1247fff700 1 -- 172.21.15.39:0/1219909808 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1258014480 con 0x7f1260160920 2023-11-28T11:58:48.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.155+0000 7f1247fff700 1 --2- 172.21.15.39:0/1219909808 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f124c064f10 0x7f124c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:48.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.155+0000 7f1247fff700 1 -- 172.21.15.39:0/1219909808 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f1258082520 con 0x7f1260160920 2023-11-28T11:58:48.158 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.155+0000 7f125f7fe700 1 --2- 172.21.15.39:0/1219909808 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f124c064f10 0x7f124c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:48.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.155+0000 7f125f7fe700 1 --2- 172.21.15.39:0/1219909808 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f124c064f10 0x7f124c0673c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1250006d50 tx=0x7f12500092e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:48.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.159+0000 7f1247fff700 1 -- 172.21.15.39:0/1219909808 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1258050870 con 0x7f1260160920 2023-11-28T11:58:48.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.331+0000 7f1265faa700 1 -- 172.21.15.39:0/1219909808 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f126014f990 con 0x7f1260160920 2023-11-28T11:58:48.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.335+0000 7f1247fff700 1 -- 172.21.15.39:0/1219909808 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+14376 (secure 0 0 0) 0x7f1258053e90 con 0x7f1260160920 2023-11-28T11:58:48.338 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:58:48.338 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":54,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:58:47.424607+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:58:48.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.339+0000 7f1265faa700 1 -- 172.21.15.39:0/1219909808 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f124c064f10 msgr2=0x7f124c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:48.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.339+0000 7f1265faa700 1 --2- 172.21.15.39:0/1219909808 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f124c064f10 0x7f124c0673c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1250006d50 tx=0x7f12500092e0 comp rx=0 tx=0).stop 2023-11-28T11:58:48.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.339+0000 7f1265faa700 1 -- 172.21.15.39:0/1219909808 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1260160920 msgr2=0x7f12601560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:48.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.339+0000 7f1265faa700 1 --2- 172.21.15.39:0/1219909808 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1260160920 0x7f12601560f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f125800efc0 tx=0x7f125800c0c0 comp rx=0 tx=0).stop 2023-11-28T11:58:48.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.339+0000 7f1265faa700 1 -- 172.21.15.39:0/1219909808 shutdown_connections 2023-11-28T11:58:48.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.339+0000 7f1265faa700 1 --2- 172.21.15.39:0/1219909808 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1260160920 0x7f12601560f0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:48.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.339+0000 7f1265faa700 1 --2- 172.21.15.39:0/1219909808 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f124c064f10 0x7f124c0673c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:48.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.339+0000 7f1265faa700 1 --2- 172.21.15.39:0/1219909808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f12601534a0 0x7f126014df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:48.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.339+0000 7f1265faa700 1 --2- 172.21.15.39:0/1219909808 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12600b6030 0x7f126014c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:48.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.339+0000 7f1265faa700 1 -- 172.21.15.39:0/1219909808 >> 172.21.15.39:0/1219909808 conn(0x7f126006bfc0 msgr2=0x7f12600d0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:48.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.339+0000 7f1265faa700 1 -- 172.21.15.39:0/1219909808 shutdown_connections 2023-11-28T11:58:48.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.339+0000 7f1265faa700 1 -- 172.21.15.39:0/1219909808 wait complete. 2023-11-28T11:58:48.364 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:56:26.631457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:56:33.242202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:58:48.365 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:58:48.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.555+0000 7f5b6e3ef700 1 Processor -- start 2023-11-28T11:58:48.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.555+0000 7f5b6e3ef700 1 -- start start 2023-11-28T11:58:48.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.559+0000 7f5b6e3ef700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5b6815e190 0x7f5b680cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:48.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.559+0000 7f5b6e3ef700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5b6806ff10 0x7f5b68070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:48.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.559+0000 7f5b6e3ef700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b680708b0 con 0x7f5b68161560 2023-11-28T11:58:48.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.559+0000 7f5b6e3ef700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b6815e560 con 0x7f5b6806ff10 2023-11-28T11:58:48.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.559+0000 7f5b6e3ef700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b6806be80 con 0x7f5b6815e190 2023-11-28T11:58:48.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.559+0000 7f5b6dbee700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5b6806ff10 0x7f5b68070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:48.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.559+0000 7f5b6dbee700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5b6806ff10 0x7f5b68070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43668/0 (socket says 172.21.15.39:43668) 2023-11-28T11:58:48.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.559+0000 7f5b6dbee700 1 -- 172.21.15.39:0/1054530878 learned_addr learned my addr 172.21.15.39:0/1054530878 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:48.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.559+0000 7f5b6d3ed700 1 --2- 172.21.15.39:0/1054530878 >> v2:172.21.15.184:3300/0 conn(0x7f5b6815e190 0x7f5b680cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:48.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.559+0000 7f5b6dbee700 1 -- 172.21.15.39:0/1054530878 >> v2:172.21.15.184:3300/0 conn(0x7f5b6815e190 msgr2=0x7f5b680cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:48.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.559+0000 7f5b6dbee700 1 --2- 172.21.15.39:0/1054530878 >> v2:172.21.15.184:3300/0 conn(0x7f5b6815e190 0x7f5b680cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:48.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.559+0000 7f5b6dbee700 1 -- 172.21.15.39:0/1054530878 >> v1:172.21.15.39:6789/0 conn(0x7f5b68161560 legacy=0x7f5b68069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:48.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.559+0000 7f5b6dbee700 1 -- 172.21.15.39:0/1054530878 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b680ce330 con 0x7f5b6806ff10 2023-11-28T11:58:48.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.559+0000 7f5b6dbee700 1 --2- 172.21.15.39:0/1054530878 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b6806ff10 0x7f5b68070370 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f5b680cb9b0 tx=0x7f5b6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3adc227da9493219 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:48.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.559+0000 7f5b5ffff700 1 -- 172.21.15.39:0/1054530878 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6000e070 con 0x7f5b6806ff10 2023-11-28T11:58:48.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.559+0000 7f5b5ffff700 1 -- 172.21.15.39:0/1054530878 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6000b9c0 con 0x7f5b6806ff10 2023-11-28T11:58:48.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.559+0000 7f5b5ffff700 1 -- 172.21.15.39:0/1054530878 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6000bd70 con 0x7f5b6806ff10 2023-11-28T11:58:48.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.559+0000 7f5b6e3ef700 1 -- 172.21.15.39:0/1054530878 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b6806ff10 msgr2=0x7f5b68070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:48.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.559+0000 7f5b6e3ef700 1 --2- 172.21.15.39:0/1054530878 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b6806ff10 0x7f5b68070370 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f5b680cb9b0 tx=0x7f5b6000b330 comp rx=0 tx=0).stop 2023-11-28T11:58:48.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.559+0000 7f5b6e3ef700 1 -- 172.21.15.39:0/1054530878 shutdown_connections 2023-11-28T11:58:48.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.559+0000 7f5b6e3ef700 1 --2- 172.21.15.39:0/1054530878 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b6806ff10 0x7f5b68070370 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:48.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.563+0000 7f5b6e3ef700 1 --2- 172.21.15.39:0/1054530878 >> v2:172.21.15.184:3300/0 conn(0x7f5b6815e190 0x7f5b680cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:48.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.563+0000 7f5b6e3ef700 1 -- 172.21.15.39:0/1054530878 >> 172.21.15.39:0/1054530878 conn(0x7f5b680cf280 msgr2=0x7f5b680cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:48.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.563+0000 7f5b6e3ef700 1 -- 172.21.15.39:0/1054530878 shutdown_connections 2023-11-28T11:58:48.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.563+0000 7f5b6e3ef700 1 -- 172.21.15.39:0/1054530878 wait complete. 2023-11-28T11:58:48.568 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.567+0000 7f5b6e3ef700 1 Processor -- start 2023-11-28T11:58:48.569 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.567+0000 7f5b6e3ef700 1 -- start start 2023-11-28T11:58:48.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.567+0000 7f5b6e3ef700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b6806ff10 0x7f5b68162ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:48.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.567+0000 7f5b6e3ef700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b6815e190 0x7f5b68153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:48.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.567+0000 7f5b6e3ef700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b68161560 0x7f5b68162350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:48.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.567+0000 7f5b6e3ef700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b68163b20 con 0x7f5b68161560 2023-11-28T11:58:48.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.567+0000 7f5b6e3ef700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b68162890 con 0x7f5b6806ff10 2023-11-28T11:58:48.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.567+0000 7f5b6e3ef700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b68154d00 con 0x7f5b6815e190 2023-11-28T11:58:48.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.567+0000 7f5b6dbee700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b68161560 0x7f5b68162350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:48.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.567+0000 7f5b6dbee700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b68161560 0x7f5b68162350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43672/0 (socket says 172.21.15.39:43672) 2023-11-28T11:58:48.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.567+0000 7f5b6dbee700 1 -- 172.21.15.39:0/600754382 learned_addr learned my addr 172.21.15.39:0/600754382 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:48.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.567+0000 7f5b6d3ed700 1 --2- 172.21.15.39:0/600754382 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b6806ff10 0x7f5b68162ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:48.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.567+0000 7f5b6cbec700 1 --2- 172.21.15.39:0/600754382 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b6815e190 0x7f5b68153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:48.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.567+0000 7f5b6dbee700 1 -- 172.21.15.39:0/600754382 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b6815e190 msgr2=0x7f5b68153eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:48.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.567+0000 7f5b6dbee700 1 --2- 172.21.15.39:0/600754382 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b6815e190 0x7f5b68153eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:48.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.567+0000 7f5b6dbee700 1 -- 172.21.15.39:0/600754382 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b6806ff10 msgr2=0x7f5b68162ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:48.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.567+0000 7f5b6dbee700 1 --2- 172.21.15.39:0/600754382 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b6806ff10 0x7f5b68162ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:48.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.567+0000 7f5b6dbee700 1 -- 172.21.15.39:0/600754382 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b60009b30 con 0x7f5b68161560 2023-11-28T11:58:48.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.567+0000 7f5b6cbec700 1 --2- 172.21.15.39:0/600754382 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b6815e190 0x7f5b68153eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:58:48.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.571+0000 7f5b6dbee700 1 --2- 172.21.15.39:0/600754382 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b68161560 0x7f5b68162350 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f5b680717e0 tx=0x7f5b60004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:48.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.571+0000 7f5b5dffb700 1 -- 172.21.15.39:0/600754382 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b60004930 con 0x7f5b68161560 2023-11-28T11:58:48.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.571+0000 7f5b5dffb700 1 -- 172.21.15.39:0/600754382 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b600099b0 con 0x7f5b68161560 2023-11-28T11:58:48.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.571+0000 7f5b5dffb700 1 -- 172.21.15.39:0/600754382 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6001b670 con 0x7f5b68161560 2023-11-28T11:58:48.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.571+0000 7f5b6e3ef700 1 -- 172.21.15.39:0/600754382 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b680afc70 con 0x7f5b68161560 2023-11-28T11:58:48.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.571+0000 7f5b6e3ef700 1 -- 172.21.15.39:0/600754382 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b680af990 con 0x7f5b68161560 2023-11-28T11:58:48.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.571+0000 7f5b6e3ef700 1 -- 172.21.15.39:0/600754382 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b680aff50 con 0x7f5b68161560 2023-11-28T11:58:48.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.575+0000 7f5b5dffb700 1 -- 172.21.15.39:0/600754382 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5b6002b070 con 0x7f5b68161560 2023-11-28T11:58:48.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.575+0000 7f5b5dffb700 1 --2- 172.21.15.39:0/600754382 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5b4c064ee0 0x7f5b4c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:48.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.575+0000 7f5b5dffb700 1 -- 172.21.15.39:0/600754382 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f5b60083550 con 0x7f5b68161560 2023-11-28T11:58:48.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.575+0000 7f5b6d3ed700 1 --2- 172.21.15.39:0/600754382 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5b4c064ee0 0x7f5b4c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:48.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.579+0000 7f5b6d3ed700 1 --2- 172.21.15.39:0/600754382 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5b4c064ee0 0x7f5b4c067390 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5b681f94f0 tx=0x7f5b64008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:48.586 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.583+0000 7f5b5dffb700 1 -- 172.21.15.39:0/600754382 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5b60051810 con 0x7f5b68161560 2023-11-28T11:58:48.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.755+0000 7f5b6e3ef700 1 -- 172.21.15.39:0/600754382 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5b68073d20 con 0x7f5b68161560 2023-11-28T11:58:48.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.759+0000 7f5b5dffb700 1 -- 172.21.15.39:0/600754382 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5b60054e30 con 0x7f5b68161560 2023-11-28T11:58:48.761 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-11-28T11:58:48.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.763+0000 7f5b6e3ef700 1 -- 172.21.15.39:0/600754382 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5b4c064ee0 msgr2=0x7f5b4c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:48.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.763+0000 7f5b6e3ef700 1 --2- 172.21.15.39:0/600754382 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5b4c064ee0 0x7f5b4c067390 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5b681f94f0 tx=0x7f5b64008040 comp rx=0 tx=0).stop 2023-11-28T11:58:48.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.763+0000 7f5b6e3ef700 1 -- 172.21.15.39:0/600754382 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b68161560 msgr2=0x7f5b68162350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:48.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.763+0000 7f5b6e3ef700 1 --2- 172.21.15.39:0/600754382 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b68161560 0x7f5b68162350 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f5b680717e0 tx=0x7f5b60004af0 comp rx=0 tx=0).stop 2023-11-28T11:58:48.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.763+0000 7f5b6e3ef700 1 -- 172.21.15.39:0/600754382 shutdown_connections 2023-11-28T11:58:48.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.763+0000 7f5b6e3ef700 1 --2- 172.21.15.39:0/600754382 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b68161560 0x7f5b68162350 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:48.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.763+0000 7f5b6e3ef700 1 --2- 172.21.15.39:0/600754382 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b6815e190 0x7f5b68153eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:48.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.763+0000 7f5b6e3ef700 1 --2- 172.21.15.39:0/600754382 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5b4c064ee0 0x7f5b4c067390 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:48.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.763+0000 7f5b6e3ef700 1 --2- 172.21.15.39:0/600754382 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b6806ff10 0x7f5b68162ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:48.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.763+0000 7f5b6e3ef700 1 -- 172.21.15.39:0/600754382 >> 172.21.15.39:0/600754382 conn(0x7f5b680cf280 msgr2=0x7f5b6806caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:48.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.763+0000 7f5b6e3ef700 1 -- 172.21.15.39:0/600754382 shutdown_connections 2023-11-28T11:58:48.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.763+0000 7f5b6e3ef700 1 -- 172.21.15.39:0/600754382 wait complete. 2023-11-28T11:58:48.790 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:58:48.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.979+0000 7f39de30e700 1 Processor -- start 2023-11-28T11:58:48.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.979+0000 7f39de30e700 1 -- start start 2023-11-28T11:58:48.984 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.979+0000 7f39de30e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f39d80c8c90 0x7f39d815a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:48.984 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.979+0000 7f39de30e700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39d8070600 con 0x7f39d8159f10 2023-11-28T11:58:48.984 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.979+0000 7f39de30e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39d80c9090 con 0x7f39d8070a90 2023-11-28T11:58:48.984 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.979+0000 7f39de30e700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39d80afcc0 con 0x7f39d80c8c90 2023-11-28T11:58:48.984 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.983+0000 7f39dd30c700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f39d8159f10 0x7f39d815a2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42330/0 (socket says 172.21.15.39:42330) 2023-11-28T11:58:48.984 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.983+0000 7f39dd30c700 1 -- 172.21.15.39:0/4148698701 learned_addr learned my addr 172.21.15.39:0/4148698701 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:58:48.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.983+0000 7f39ddb0d700 1 --2- 172.21.15.39:0/4148698701 >> v2:172.21.15.39:3300/0 conn(0x7f39d80c8c90 0x7f39d815a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:48.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.983+0000 7f39cffff700 1 -- 172.21.15.39:0/4148698701 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2958200153 0 0) 0x7f39d8070600 con 0x7f39d8159f10 2023-11-28T11:58:48.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.983+0000 7f39cffff700 1 -- 172.21.15.39:0/4148698701 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39c40035d0 con 0x7f39d8159f10 2023-11-28T11:58:48.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.983+0000 7f39cffff700 1 -- 172.21.15.39:0/4148698701 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 575938765 0 0) 0x7f39d80c9090 con 0x7f39d8070a90 2023-11-28T11:58:48.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.983+0000 7f39cffff700 1 -- 172.21.15.39:0/4148698701 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39d8070600 con 0x7f39d8070a90 2023-11-28T11:58:48.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.983+0000 7f39ddb0d700 1 -- 172.21.15.39:0/4148698701 >> v1:172.21.15.184:6789/0 conn(0x7f39d8070a90 legacy=0x7f39d806be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:48.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.983+0000 7f39ddb0d700 1 -- 172.21.15.39:0/4148698701 >> v1:172.21.15.39:6789/0 conn(0x7f39d8159f10 legacy=0x7f39d815a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:48.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.983+0000 7f39ddb0d700 1 -- 172.21.15.39:0/4148698701 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d806ffb0 con 0x7f39d80c8c90 2023-11-28T11:58:48.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.983+0000 7f39ddb0d700 1 --2- 172.21.15.39:0/4148698701 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39d80c8c90 0x7f39d815a9f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f39d0009d90 tx=0x7f39d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a5aaa15233e97d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:48.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.983+0000 7f39cffff700 1 -- 172.21.15.39:0/4148698701 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d000e070 con 0x7f39d80c8c90 2023-11-28T11:58:48.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.983+0000 7f39cffff700 1 -- 172.21.15.39:0/4148698701 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d000bb20 con 0x7f39d80c8c90 2023-11-28T11:58:48.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.983+0000 7f39cffff700 1 -- 172.21.15.39:0/4148698701 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d0012430 con 0x7f39d80c8c90 2023-11-28T11:58:48.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.983+0000 7f39de30e700 1 -- 172.21.15.39:0/4148698701 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39d80c8c90 msgr2=0x7f39d815a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:48.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.983+0000 7f39de30e700 1 --2- 172.21.15.39:0/4148698701 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39d80c8c90 0x7f39d815a9f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f39d0009d90 tx=0x7f39d000b330 comp rx=0 tx=0).stop 2023-11-28T11:58:48.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.983+0000 7f39de30e700 1 -- 172.21.15.39:0/4148698701 shutdown_connections 2023-11-28T11:58:48.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.983+0000 7f39de30e700 1 --2- 172.21.15.39:0/4148698701 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39d80c8c90 0x7f39d815a9f0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:48.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.983+0000 7f39de30e700 1 -- 172.21.15.39:0/4148698701 >> 172.21.15.39:0/4148698701 conn(0x7f39d80cf280 msgr2=0x7f39d80cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:48.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.987+0000 7f39de30e700 1 -- 172.21.15.39:0/4148698701 shutdown_connections 2023-11-28T11:58:48.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.987+0000 7f39de30e700 1 -- 172.21.15.39:0/4148698701 wait complete. 2023-11-28T11:58:48.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.987+0000 7f39de30e700 1 Processor -- start 2023-11-28T11:58:48.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.987+0000 7f39de30e700 1 -- start start 2023-11-28T11:58:48.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.991+0000 7f39de30e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39d8070a90 0x7f39d80b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:48.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.991+0000 7f39de30e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39d80c8c90 0x7f39d80c5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:48.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.991+0000 7f39de30e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39d8159f10 0x7f39d80b2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:48.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.991+0000 7f39de30e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d80c7e90 con 0x7f39d8159f10 2023-11-28T11:58:48.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.991+0000 7f39de30e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d80c5b70 con 0x7f39d80c8c90 2023-11-28T11:58:48.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.991+0000 7f39de30e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d81f11e0 con 0x7f39d8070a90 2023-11-28T11:58:48.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.991+0000 7f39ddb0d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39d8159f10 0x7f39d80b2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:48.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.991+0000 7f39ddb0d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39d8159f10 0x7f39d80b2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43702/0 (socket says 172.21.15.39:43702) 2023-11-28T11:58:48.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.991+0000 7f39ddb0d700 1 -- 172.21.15.39:0/2942017300 learned_addr learned my addr 172.21.15.39:0/2942017300 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:48.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.991+0000 7f39dd30c700 1 --2- 172.21.15.39:0/2942017300 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39d8070a90 0x7f39d80b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:48.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.991+0000 7f39dcb0b700 1 --2- 172.21.15.39:0/2942017300 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39d80c8c90 0x7f39d80c5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:48.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.991+0000 7f39ddb0d700 1 -- 172.21.15.39:0/2942017300 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39d8070a90 msgr2=0x7f39d80b3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:48.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.991+0000 7f39ddb0d700 1 --2- 172.21.15.39:0/2942017300 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39d8070a90 0x7f39d80b3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:48.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.991+0000 7f39ddb0d700 1 -- 172.21.15.39:0/2942017300 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39d80c8c90 msgr2=0x7f39d80c5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:48.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.991+0000 7f39ddb0d700 1 --2- 172.21.15.39:0/2942017300 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39d80c8c90 0x7f39d80c5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:48.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.991+0000 7f39ddb0d700 1 -- 172.21.15.39:0/2942017300 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d0009a70 con 0x7f39d8159f10 2023-11-28T11:58:48.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.991+0000 7f39dd30c700 1 --2- 172.21.15.39:0/2942017300 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39d8070a90 0x7f39d80b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:58:48.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.991+0000 7f39ddb0d700 1 --2- 172.21.15.39:0/2942017300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39d8159f10 0x7f39d80b2c70 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f39d80717e0 tx=0x7f39d0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:48.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.991+0000 7f39cdffb700 1 -- 172.21.15.39:0/2942017300 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d001b810 con 0x7f39d8159f10 2023-11-28T11:58:48.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.991+0000 7f39de30e700 1 -- 172.21.15.39:0/2942017300 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d80affa0 con 0x7f39d8159f10 2023-11-28T11:58:48.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.991+0000 7f39cdffb700 1 -- 172.21.15.39:0/2942017300 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d0020070 con 0x7f39d8159f10 2023-11-28T11:58:48.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.991+0000 7f39cdffb700 1 -- 172.21.15.39:0/2942017300 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d001bbb0 con 0x7f39d8159f10 2023-11-28T11:58:48.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.991+0000 7f39de30e700 1 -- 172.21.15.39:0/2942017300 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d8070290 con 0x7f39d8159f10 2023-11-28T11:58:48.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.995+0000 7f39de30e700 1 -- 172.21.15.39:0/2942017300 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39d806b300 con 0x7f39d8159f10 2023-11-28T11:58:48.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.995+0000 7f39cdffb700 1 -- 172.21.15.39:0/2942017300 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f39d002e070 con 0x7f39d8159f10 2023-11-28T11:58:48.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.995+0000 7f39cdffb700 1 --2- 172.21.15.39:0/2942017300 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f39bc064f10 0x7f39bc0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:48.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.995+0000 7f39cdffb700 1 -- 172.21.15.39:0/2942017300 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f39d0022070 con 0x7f39d8159f10 2023-11-28T11:58:48.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.995+0000 7f39dd30c700 1 --2- 172.21.15.39:0/2942017300 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f39bc064f10 0x7f39bc0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:49.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:48.999+0000 7f39dd30c700 1 --2- 172.21.15.39:0/2942017300 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f39bc064f10 0x7f39bc0673c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f39d4000f60 tx=0x7f39d4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:49.005 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.003+0000 7f39cdffb700 1 -- 172.21.15.39:0/2942017300 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f39d0052060 con 0x7f39d8159f10 2023-11-28T11:58:49.181 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.179+0000 7f39de30e700 1 -- 172.21.15.39:0/2942017300 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f39d806cf30 con 0x7f39d8159f10 2023-11-28T11:58:49.182 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.179+0000 7f39cdffb700 1 -- 172.21.15.39:0/2942017300 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v54) v1 ==== 92+0+10 (secure 0 0 0) 0x7f39d002c0a0 con 0x7f39d8159f10 2023-11-28T11:58:49.182 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-11-28T11:58:49.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.183+0000 7f39de30e700 1 -- 172.21.15.39:0/2942017300 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f39bc064f10 msgr2=0x7f39bc0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:49.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.183+0000 7f39de30e700 1 --2- 172.21.15.39:0/2942017300 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f39bc064f10 0x7f39bc0673c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f39d4000f60 tx=0x7f39d4009040 comp rx=0 tx=0).stop 2023-11-28T11:58:49.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.183+0000 7f39de30e700 1 -- 172.21.15.39:0/2942017300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39d8159f10 msgr2=0x7f39d80b2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:49.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.183+0000 7f39de30e700 1 --2- 172.21.15.39:0/2942017300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39d8159f10 0x7f39d80b2c70 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f39d80717e0 tx=0x7f39d0004af0 comp rx=0 tx=0).stop 2023-11-28T11:58:49.186 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.183+0000 7f39de30e700 1 -- 172.21.15.39:0/2942017300 shutdown_connections 2023-11-28T11:58:49.186 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.183+0000 7f39de30e700 1 --2- 172.21.15.39:0/2942017300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39d8159f10 0x7f39d80b2c70 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:49.186 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.183+0000 7f39de30e700 1 --2- 172.21.15.39:0/2942017300 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f39bc064f10 0x7f39bc0673c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:49.186 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.183+0000 7f39de30e700 1 --2- 172.21.15.39:0/2942017300 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39d80c8c90 0x7f39d80c5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:49.186 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.183+0000 7f39de30e700 1 --2- 172.21.15.39:0/2942017300 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39d8070a90 0x7f39d80b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:49.186 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.183+0000 7f39de30e700 1 -- 172.21.15.39:0/2942017300 >> 172.21.15.39:0/2942017300 conn(0x7f39d80cf280 msgr2=0x7f39d80ca4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:49.186 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.183+0000 7f39de30e700 1 -- 172.21.15.39:0/2942017300 shutdown_connections 2023-11-28T11:58:49.186 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.183+0000 7f39de30e700 1 -- 172.21.15.39:0/2942017300 wait complete. 2023-11-28T11:58:49.207 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T11:58:49.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.387+0000 7fe72d7b8700 1 Processor -- start 2023-11-28T11:58:49.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.387+0000 7fe72d7b8700 1 -- start start 2023-11-28T11:58:49.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.391+0000 7fe72d7b8700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe72815a480 0x7fe7280cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:49.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.391+0000 7fe72d7b8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7280c8d10 0x7fe7280cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:49.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.391+0000 7fe72d7b8700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe72815a850 con 0x7fe7280ccd10 2023-11-28T11:58:49.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.391+0000 7fe72d7b8700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7280ce060 con 0x7fe72815a480 2023-11-28T11:58:49.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.391+0000 7fe72d7b8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7280ce300 con 0x7fe7280c8d10 2023-11-28T11:58:49.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.391+0000 7fe726ffd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe72815a480 0x7fe7280cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:49.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.391+0000 7fe7267fc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7280c8d10 0x7fe7280cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:49.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.391+0000 7fe726ffd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe72815a480 0x7fe7280cc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:35520/0 (socket says 172.21.15.39:35520) 2023-11-28T11:58:49.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.391+0000 7fe726ffd700 1 -- 172.21.15.39:0/2792611257 learned_addr learned my addr 172.21.15.39:0/2792611257 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:49.397 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.391+0000 7fe726ffd700 1 -- 172.21.15.39:0/2792611257 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7280c8d10 msgr2=0x7fe7280cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:49.397 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.391+0000 7fe726ffd700 1 --2- 172.21.15.39:0/2792611257 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7280c8d10 0x7fe7280cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:49.397 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.391+0000 7fe726ffd700 1 -- 172.21.15.39:0/2792611257 >> v1:172.21.15.39:6789/0 conn(0x7fe7280ccd10 legacy=0x7fe72815dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:49.397 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.391+0000 7fe726ffd700 1 -- 172.21.15.39:0/2792611257 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7280cada0 con 0x7fe72815a480 2023-11-28T11:58:49.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.395+0000 7fe726ffd700 1 --2- 172.21.15.39:0/2792611257 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe72815a480 0x7fe7280cc290 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe718009910 tx=0x7fe718009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5abb0e3b725bf35d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:49.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.395+0000 7fe725ffb700 1 -- 172.21.15.39:0/2792611257 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe718011830 con 0x7fe72815a480 2023-11-28T11:58:49.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.395+0000 7fe725ffb700 1 -- 172.21.15.39:0/2792611257 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe718011990 con 0x7fe72815a480 2023-11-28T11:58:49.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.395+0000 7fe725ffb700 1 -- 172.21.15.39:0/2792611257 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe718011d40 con 0x7fe72815a480 2023-11-28T11:58:49.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.395+0000 7fe72d7b8700 1 -- 172.21.15.39:0/2792611257 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe72815a480 msgr2=0x7fe7280cc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:49.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.395+0000 7fe72d7b8700 1 --2- 172.21.15.39:0/2792611257 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe72815a480 0x7fe7280cc290 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe718009910 tx=0x7fe718009c20 comp rx=0 tx=0).stop 2023-11-28T11:58:49.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.395+0000 7fe72d7b8700 1 -- 172.21.15.39:0/2792611257 shutdown_connections 2023-11-28T11:58:49.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.395+0000 7fe72d7b8700 1 --2- 172.21.15.39:0/2792611257 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7280c8d10 0x7fe7280cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:49.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.395+0000 7fe72d7b8700 1 --2- 172.21.15.39:0/2792611257 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe72815a480 0x7fe7280cc290 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:49.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.395+0000 7fe72d7b8700 1 -- 172.21.15.39:0/2792611257 >> 172.21.15.39:0/2792611257 conn(0x7fe7280cf350 msgr2=0x7fe7280b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:49.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.395+0000 7fe72d7b8700 1 -- 172.21.15.39:0/2792611257 shutdown_connections 2023-11-28T11:58:49.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.395+0000 7fe72d7b8700 1 -- 172.21.15.39:0/2792611257 wait complete. 2023-11-28T11:58:49.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.399+0000 7fe72d7b8700 1 Processor -- start 2023-11-28T11:58:49.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.399+0000 7fe72d7b8700 1 -- start start 2023-11-28T11:58:49.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.399+0000 7fe72d7b8700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe7280c8d10 0x7fe7280b23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:49.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.399+0000 7fe72d7b8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7280ccd10 0x7fe72814f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:49.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.399+0000 7fe72d7b8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe72815a480 0x7fe72806a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:49.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.399+0000 7fe72d7b8700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7280b2f40 con 0x7fe7280c8d10 2023-11-28T11:58:49.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.399+0000 7fe72d7b8700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7280b3da0 con 0x7fe7280ccd10 2023-11-28T11:58:49.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.399+0000 7fe72d7b8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe72814fc60 con 0x7fe72815a480 2023-11-28T11:58:49.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.399+0000 7fe726ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe7280c8d10 0x7fe7280b23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:49.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.399+0000 7fe726ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe7280c8d10 0x7fe7280b23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43704/0 (socket says 172.21.15.39:43704) 2023-11-28T11:58:49.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.399+0000 7fe726ffd700 1 -- 172.21.15.39:0/117915154 learned_addr learned my addr 172.21.15.39:0/117915154 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:49.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.399+0000 7fe7267fc700 1 --2- 172.21.15.39:0/117915154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7280ccd10 0x7fe72814f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:49.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.399+0000 7fe7277fe700 1 --2- 172.21.15.39:0/117915154 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe72815a480 0x7fe72806a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:49.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.399+0000 7fe726ffd700 1 -- 172.21.15.39:0/117915154 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe72815a480 msgr2=0x7fe72806a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:49.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.399+0000 7fe726ffd700 1 --2- 172.21.15.39:0/117915154 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe72815a480 0x7fe72806a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:49.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.399+0000 7fe726ffd700 1 -- 172.21.15.39:0/117915154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7280ccd10 msgr2=0x7fe72814f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:49.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.399+0000 7fe726ffd700 1 --2- 172.21.15.39:0/117915154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7280ccd10 0x7fe72814f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:49.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.399+0000 7fe726ffd700 1 -- 172.21.15.39:0/117915154 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe718009570 con 0x7fe7280c8d10 2023-11-28T11:58:49.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.399+0000 7fe726ffd700 1 --2- 172.21.15.39:0/117915154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe7280c8d10 0x7fe7280b23e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe72806b9d0 tx=0x7fe718004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:49.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.403+0000 7fe70f7fe700 1 -- 172.21.15.39:0/117915154 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe718004610 con 0x7fe7280c8d10 2023-11-28T11:58:49.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.403+0000 7fe70f7fe700 1 -- 172.21.15.39:0/117915154 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7180036c0 con 0x7fe7280c8d10 2023-11-28T11:58:49.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.403+0000 7fe70f7fe700 1 -- 172.21.15.39:0/117915154 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe718003a50 con 0x7fe7280c8d10 2023-11-28T11:58:49.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.403+0000 7fe72d7b8700 1 -- 172.21.15.39:0/117915154 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7280add50 con 0x7fe7280c8d10 2023-11-28T11:58:49.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.403+0000 7fe72d7b8700 1 -- 172.21.15.39:0/117915154 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7280caa30 con 0x7fe7280c8d10 2023-11-28T11:58:49.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.403+0000 7fe72d7b8700 1 -- 172.21.15.39:0/117915154 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7280ca6e0 con 0x7fe7280c8d10 2023-11-28T11:58:49.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.407+0000 7fe70f7fe700 1 -- 172.21.15.39:0/117915154 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe71802d070 con 0x7fe7280c8d10 2023-11-28T11:58:49.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.407+0000 7fe70f7fe700 1 --2- 172.21.15.39:0/117915154 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe714064ee0 0x7fe714067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:49.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.407+0000 7fe70f7fe700 1 -- 172.21.15.39:0/117915154 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fe718021030 con 0x7fe7280c8d10 2023-11-28T11:58:49.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.407+0000 7fe7267fc700 1 --2- 172.21.15.39:0/117915154 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe714064ee0 0x7fe714067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:49.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.407+0000 7fe7267fc700 1 --2- 172.21.15.39:0/117915154 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe714064ee0 0x7fe714067390 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe72806cb90 tx=0x7fe71c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:49.415 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.411+0000 7fe70f7fe700 1 -- 172.21.15.39:0/117915154 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe718051710 con 0x7fe7280c8d10 2023-11-28T11:58:49.596 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.595+0000 7fe72d7b8700 1 -- 172.21.15.39:0/117915154 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe7280726c0 con 0x7fe7280c8d10 2023-11-28T11:58:49.597 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.595+0000 7fe70f7fe700 1 -- 172.21.15.39:0/117915154 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v54) v1 ==== 84+0+126 (secure 0 0 0) 0x7fe71802b090 con 0x7fe7280c8d10 2023-11-28T11:58:49.598 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:58:49.598 INFO:teuthology.orchestra.run.smithi039.stdout:[ 2023-11-28T11:58:49.598 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:58:49.598 INFO:teuthology.orchestra.run.smithi039.stdout: "poolnum": 1, 2023-11-28T11:58:49.598 INFO:teuthology.orchestra.run.smithi039.stdout: "poolname": ".mgr" 2023-11-28T11:58:49.598 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:58:49.599 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:58:49.599 INFO:teuthology.orchestra.run.smithi039.stdout: "poolnum": 2, 2023-11-28T11:58:49.599 INFO:teuthology.orchestra.run.smithi039.stdout: "poolname": "rbd" 2023-11-28T11:58:49.599 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:58:49.599 INFO:teuthology.orchestra.run.smithi039.stdout:] 2023-11-28T11:58:49.600 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.595+0000 7fe72d7b8700 1 -- 172.21.15.39:0/117915154 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe714064ee0 msgr2=0x7fe714067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:49.601 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.595+0000 7fe72d7b8700 1 --2- 172.21.15.39:0/117915154 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe714064ee0 0x7fe714067390 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe72806cb90 tx=0x7fe71c008040 comp rx=0 tx=0).stop 2023-11-28T11:58:49.601 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.595+0000 7fe72d7b8700 1 -- 172.21.15.39:0/117915154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe7280c8d10 msgr2=0x7fe7280b23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:49.601 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.595+0000 7fe72d7b8700 1 --2- 172.21.15.39:0/117915154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe7280c8d10 0x7fe7280b23e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe72806b9d0 tx=0x7fe718004770 comp rx=0 tx=0).stop 2023-11-28T11:58:49.601 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.595+0000 7fe72d7b8700 1 -- 172.21.15.39:0/117915154 shutdown_connections 2023-11-28T11:58:49.601 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.599+0000 7fe72d7b8700 1 --2- 172.21.15.39:0/117915154 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe72815a480 0x7fe72806a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:49.601 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.599+0000 7fe72d7b8700 1 --2- 172.21.15.39:0/117915154 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe714064ee0 0x7fe714067390 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:49.601 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.599+0000 7fe72d7b8700 1 --2- 172.21.15.39:0/117915154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7280ccd10 0x7fe72814f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:49.601 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.599+0000 7fe72d7b8700 1 --2- 172.21.15.39:0/117915154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe7280c8d10 0x7fe7280b23e0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:49.601 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.599+0000 7fe72d7b8700 1 -- 172.21.15.39:0/117915154 >> 172.21.15.39:0/117915154 conn(0x7fe7280cf350 msgr2=0x7fe7280af930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:49.601 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.599+0000 7fe72d7b8700 1 -- 172.21.15.39:0/117915154 shutdown_connections 2023-11-28T11:58:49.601 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.599+0000 7fe72d7b8700 1 -- 172.21.15.39:0/117915154 wait complete. 2023-11-28T11:58:49.627 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T11:58:49.627 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T11:58:49.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.811+0000 7f2f1f045700 1 Processor -- start 2023-11-28T11:58:49.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.811+0000 7f2f1f045700 1 -- start start 2023-11-28T11:58:49.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.811+0000 7f2f1f045700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2f180cb640 0x7f2f180ad6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:49.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.811+0000 7f2f1f045700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f2f180ab510 0x7f2f180ab970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:49.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.811+0000 7f2f1f045700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f180c9460 con 0x7f2f18159150 2023-11-28T11:58:49.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.815+0000 7f2f1f045700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f180c8c00 con 0x7f2f180ab510 2023-11-28T11:58:49.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.815+0000 7f2f1f045700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f180adc00 con 0x7f2f180cb640 2023-11-28T11:58:49.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.815+0000 7f2f1e844700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f2f180ab510 0x7f2f180ab970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:49.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.815+0000 7f2f1e043700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f2f18159150 0x7f2f180caf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42352/0 (socket says 172.21.15.39:42352) 2023-11-28T11:58:49.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.815+0000 7f2f1e043700 1 -- 172.21.15.39:0/1312433593 learned_addr learned my addr 172.21.15.39:0/1312433593 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:58:49.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.815+0000 7f2f1d842700 1 --2- 172.21.15.39:0/1312433593 >> v2:172.21.15.184:3300/0 conn(0x7f2f180cb640 0x7f2f180ad6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:49.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.815+0000 7f2f1e844700 1 -- 172.21.15.39:0/1312433593 >> v2:172.21.15.184:3300/0 conn(0x7f2f180cb640 msgr2=0x7f2f180ad6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:49.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.815+0000 7f2f1e844700 1 --2- 172.21.15.39:0/1312433593 >> v2:172.21.15.184:3300/0 conn(0x7f2f180cb640 0x7f2f180ad6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:49.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.815+0000 7f2f1e844700 1 -- 172.21.15.39:0/1312433593 >> v1:172.21.15.39:6789/0 conn(0x7f2f18159150 legacy=0x7f2f180caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:49.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.815+0000 7f2f1e844700 1 -- 172.21.15.39:0/1312433593 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f1806a9c0 con 0x7f2f180ab510 2023-11-28T11:58:49.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.815+0000 7f2f1d041700 1 -- 172.21.15.39:0/1312433593 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2857488287 0 0) 0x7f2f180c9460 con 0x7f2f18159150 2023-11-28T11:58:49.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.815+0000 7f2f1e844700 1 --2- 172.21.15.39:0/1312433593 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f180ab510 0x7f2f180ab970 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f2f1809c530 tx=0x7f2f1000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64cbd5b171474972 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:49.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.815+0000 7f2f1d041700 1 -- 172.21.15.39:0/1312433593 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1000e070 con 0x7f2f180ab510 2023-11-28T11:58:49.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.815+0000 7f2f1d041700 1 -- 172.21.15.39:0/1312433593 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1000bb20 con 0x7f2f180ab510 2023-11-28T11:58:49.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.815+0000 7f2f1d041700 1 -- 172.21.15.39:0/1312433593 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f10012430 con 0x7f2f180ab510 2023-11-28T11:58:49.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.815+0000 7f2f1f045700 1 -- 172.21.15.39:0/1312433593 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f180ab510 msgr2=0x7f2f180ab970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:49.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.815+0000 7f2f1f045700 1 --2- 172.21.15.39:0/1312433593 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f180ab510 0x7f2f180ab970 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f2f1809c530 tx=0x7f2f1000b330 comp rx=0 tx=0).stop 2023-11-28T11:58:49.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.819+0000 7f2f1f045700 1 -- 172.21.15.39:0/1312433593 shutdown_connections 2023-11-28T11:58:49.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.819+0000 7f2f1f045700 1 --2- 172.21.15.39:0/1312433593 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f180ab510 0x7f2f180ab970 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:49.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.819+0000 7f2f1f045700 1 --2- 172.21.15.39:0/1312433593 >> v2:172.21.15.184:3300/0 conn(0x7f2f180cb640 0x7f2f180ad6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:49.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.819+0000 7f2f1f045700 1 -- 172.21.15.39:0/1312433593 >> 172.21.15.39:0/1312433593 conn(0x7f2f180ce5b0 msgr2=0x7f2f180ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:49.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.819+0000 7f2f1f045700 1 -- 172.21.15.39:0/1312433593 shutdown_connections 2023-11-28T11:58:49.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.819+0000 7f2f1f045700 1 -- 172.21.15.39:0/1312433593 wait complete. 2023-11-28T11:58:49.824 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.819+0000 7f2f1f045700 1 Processor -- start 2023-11-28T11:58:49.825 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.823+0000 7f2f1f045700 1 -- start start 2023-11-28T11:58:49.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.823+0000 7f2f1f045700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f180ab510 0x7f2f180adff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:49.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.823+0000 7f2f1f045700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f180cb640 0x7f2f181f9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:49.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.823+0000 7f2f1f045700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f18159150 0x7f2f181f9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:49.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.823+0000 7f2f1f045700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f180714d0 con 0x7f2f18159150 2023-11-28T11:58:49.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.823+0000 7f2f1f045700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f18071f90 con 0x7f2f180cb640 2023-11-28T11:58:49.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.823+0000 7f2f1f045700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f180ae530 con 0x7f2f180ab510 2023-11-28T11:58:49.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.823+0000 7f2f1e844700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f18159150 0x7f2f181f9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:49.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.823+0000 7f2f1e844700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f18159150 0x7f2f181f9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43716/0 (socket says 172.21.15.39:43716) 2023-11-28T11:58:49.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.823+0000 7f2f1e844700 1 -- 172.21.15.39:0/686927619 learned_addr learned my addr 172.21.15.39:0/686927619 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:49.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.823+0000 7f2f1e043700 1 --2- 172.21.15.39:0/686927619 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f180ab510 0x7f2f180adff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:49.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.823+0000 7f2f1d842700 1 --2- 172.21.15.39:0/686927619 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f180cb640 0x7f2f181f9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:49.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.823+0000 7f2f1e844700 1 -- 172.21.15.39:0/686927619 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f180ab510 msgr2=0x7f2f180adff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:49.829 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.823+0000 7f2f1e844700 1 --2- 172.21.15.39:0/686927619 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f180ab510 0x7f2f180adff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:49.829 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.823+0000 7f2f1e844700 1 -- 172.21.15.39:0/686927619 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f180cb640 msgr2=0x7f2f181f9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:49.829 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.823+0000 7f2f1e844700 1 --2- 172.21.15.39:0/686927619 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f180cb640 0x7f2f181f9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:49.829 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.823+0000 7f2f1e844700 1 -- 172.21.15.39:0/686927619 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f10009a70 con 0x7f2f18159150 2023-11-28T11:58:49.829 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.823+0000 7f2f1d842700 1 --2- 172.21.15.39:0/686927619 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f180cb640 0x7f2f181f9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:58:49.829 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.823+0000 7f2f1e844700 1 --2- 172.21.15.39:0/686927619 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f18159150 0x7f2f181f9c80 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f2f1806e240 tx=0x7f2f10004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:49.830 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.827+0000 7f2f0effd700 1 -- 172.21.15.39:0/686927619 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f10012430 con 0x7f2f18159150 2023-11-28T11:58:49.830 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.827+0000 7f2f0effd700 1 -- 172.21.15.39:0/686927619 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f10020070 con 0x7f2f18159150 2023-11-28T11:58:49.830 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.827+0000 7f2f1f045700 1 -- 172.21.15.39:0/686927619 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f180c90f0 con 0x7f2f18159150 2023-11-28T11:58:49.830 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.827+0000 7f2f0effd700 1 -- 172.21.15.39:0/686927619 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f10004280 con 0x7f2f18159150 2023-11-28T11:58:49.830 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.827+0000 7f2f1f045700 1 -- 172.21.15.39:0/686927619 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f180c8e10 con 0x7f2f18159150 2023-11-28T11:58:49.831 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.827+0000 7f2f1f045700 1 -- 172.21.15.39:0/686927619 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f1806b5e0 con 0x7f2f18159150 2023-11-28T11:58:49.832 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.831+0000 7f2f0effd700 1 -- 172.21.15.39:0/686927619 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2f1002e070 con 0x7f2f18159150 2023-11-28T11:58:49.834 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.831+0000 7f2f0effd700 1 --2- 172.21.15.39:0/686927619 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2efc064ee0 0x7f2efc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:49.834 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.831+0000 7f2f0effd700 1 -- 172.21.15.39:0/686927619 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f2f10022070 con 0x7f2f18159150 2023-11-28T11:58:49.834 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.831+0000 7f2f1e043700 1 --2- 172.21.15.39:0/686927619 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2efc064ee0 0x7f2efc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:49.835 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.831+0000 7f2f1e043700 1 --2- 172.21.15.39:0/686927619 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2efc064ee0 0x7f2efc067390 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2f14004920 tx=0x7f2f14008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:49.842 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:49.839+0000 7f2f0effd700 1 -- 172.21.15.39:0/686927619 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2f10051cd0 con 0x7f2f18159150 2023-11-28T11:58:50.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.015+0000 7f2f1f045700 1 -- 172.21.15.39:0/686927619 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2f18071610 con 0x7f2f18159150 2023-11-28T11:58:50.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.139+0000 7f2f0effd700 1 -- 172.21.15.39:0/686927619 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v55) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2f18071610 con 0x7f2f18159150 2023-11-28T11:58:50.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.143+0000 7f2f1f045700 1 -- 172.21.15.39:0/686927619 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2efc064ee0 msgr2=0x7f2efc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:50.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.143+0000 7f2f1f045700 1 --2- 172.21.15.39:0/686927619 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2efc064ee0 0x7f2efc067390 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2f14004920 tx=0x7f2f14008040 comp rx=0 tx=0).stop 2023-11-28T11:58:50.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.143+0000 7f2f1f045700 1 -- 172.21.15.39:0/686927619 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f18159150 msgr2=0x7f2f181f9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:50.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.143+0000 7f2f1f045700 1 --2- 172.21.15.39:0/686927619 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f18159150 0x7f2f181f9c80 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f2f1806e240 tx=0x7f2f10004af0 comp rx=0 tx=0).stop 2023-11-28T11:58:50.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.143+0000 7f2f1f045700 1 -- 172.21.15.39:0/686927619 shutdown_connections 2023-11-28T11:58:50.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.143+0000 7f2f1f045700 1 --2- 172.21.15.39:0/686927619 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f18159150 0x7f2f181f9c80 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:50.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.143+0000 7f2f1f045700 1 --2- 172.21.15.39:0/686927619 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2efc064ee0 0x7f2efc067390 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:50.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.143+0000 7f2f1f045700 1 --2- 172.21.15.39:0/686927619 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f180cb640 0x7f2f181f9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:50.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.143+0000 7f2f1f045700 1 --2- 172.21.15.39:0/686927619 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f180ab510 0x7f2f180adff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:50.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.143+0000 7f2f1f045700 1 -- 172.21.15.39:0/686927619 >> 172.21.15.39:0/686927619 conn(0x7f2f180ce5b0 msgr2=0x7f2f180ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:50.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.143+0000 7f2f1f045700 1 -- 172.21.15.39:0/686927619 shutdown_connections 2023-11-28T11:58:50.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.143+0000 7f2f1f045700 1 -- 172.21.15.39:0/686927619 wait complete. 2023-11-28T11:58:50.150 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_metadata' created 2023-11-28T11:58:50.169 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T11:58:50.352 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.347+0000 7f60f9aa7700 1 Processor -- start 2023-11-28T11:58:50.352 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.347+0000 7f60f9aa7700 1 -- start start 2023-11-28T11:58:50.353 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.351+0000 7f60f9aa7700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f60f406a300 0x7f60f40ce260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:50.353 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.351+0000 7f60f9aa7700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60f406aa50 con 0x7f60f40b2260 2023-11-28T11:58:50.353 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.351+0000 7f60f9aa7700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60f40b57e0 con 0x7f60f40b5410 2023-11-28T11:58:50.354 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.351+0000 7f60f9aa7700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60f415cb00 con 0x7f60f406a300 2023-11-28T11:58:50.354 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.351+0000 7f60f3fff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f60f406a300 0x7f60f40ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:50.355 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.351+0000 7f60f3fff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f60f406a300 0x7f60f40ce260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43726/0 (socket says 172.21.15.39:43726) 2023-11-28T11:58:50.355 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.351+0000 7f60f3fff700 1 -- 172.21.15.39:0/3264480034 learned_addr learned my addr 172.21.15.39:0/3264480034 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:50.355 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.351+0000 7f60f3fff700 1 -- 172.21.15.39:0/3264480034 >> v1:172.21.15.184:6789/0 conn(0x7f60f40b5410 legacy=0x7f60f406ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:50.355 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.351+0000 7f60f3fff700 1 -- 172.21.15.39:0/3264480034 >> v1:172.21.15.39:6789/0 conn(0x7f60f40b2260 legacy=0x7f60f4069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:50.355 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.351+0000 7f60f3fff700 1 -- 172.21.15.39:0/3264480034 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f40ce8e0 con 0x7f60f406a300 2023-11-28T11:58:50.355 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.351+0000 7f60f27fc700 1 -- 172.21.15.39:0/3264480034 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3918026891 0 0) 0x7f60f406aa50 con 0x7f60f40b2260 2023-11-28T11:58:50.356 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.351+0000 7f60f3fff700 1 --2- 172.21.15.39:0/3264480034 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60f406a300 0x7f60f40ce260 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f60ec009e50 tx=0x7f60ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a19f4d853cbec82 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:50.356 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.351+0000 7f60f27fc700 1 -- 172.21.15.39:0/3264480034 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec00e070 con 0x7f60f406a300 2023-11-28T11:58:50.356 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.351+0000 7f60f27fc700 1 -- 172.21.15.39:0/3264480034 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ec00b9c0 con 0x7f60f406a300 2023-11-28T11:58:50.356 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.351+0000 7f60f27fc700 1 -- 172.21.15.39:0/3264480034 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec00bd70 con 0x7f60f406a300 2023-11-28T11:58:50.356 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.355+0000 7f60f9aa7700 1 -- 172.21.15.39:0/3264480034 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60f406a300 msgr2=0x7f60f40ce260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:50.357 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.355+0000 7f60f9aa7700 1 --2- 172.21.15.39:0/3264480034 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60f406a300 0x7f60f40ce260 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f60ec009e50 tx=0x7f60ec00b330 comp rx=0 tx=0).stop 2023-11-28T11:58:50.357 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.355+0000 7f60f9aa7700 1 -- 172.21.15.39:0/3264480034 shutdown_connections 2023-11-28T11:58:50.357 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.355+0000 7f60f9aa7700 1 --2- 172.21.15.39:0/3264480034 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60f406a300 0x7f60f40ce260 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:50.357 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.355+0000 7f60f9aa7700 1 -- 172.21.15.39:0/3264480034 >> 172.21.15.39:0/3264480034 conn(0x7f60f40d3990 msgr2=0x7f60f40cf780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:50.357 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.355+0000 7f60f9aa7700 1 -- 172.21.15.39:0/3264480034 shutdown_connections 2023-11-28T11:58:50.357 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.355+0000 7f60f9aa7700 1 -- 172.21.15.39:0/3264480034 wait complete. 2023-11-28T11:58:50.358 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.355+0000 7f60f9aa7700 1 Processor -- start 2023-11-28T11:58:50.359 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.355+0000 7f60f9aa7700 1 -- start start 2023-11-28T11:58:50.360 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.359+0000 7f60f9aa7700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f60f406a300 0x7f60f4150630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:50.360 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.359+0000 7f60f9aa7700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60f40b2260 0x7f60f41f56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:50.361 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.359+0000 7f60f9aa7700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60f40b5410 0x7f60f4156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:50.361 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.359+0000 7f60f9aa7700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f4156bc0 con 0x7f60f40b2260 2023-11-28T11:58:50.361 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.359+0000 7f60f9aa7700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f41f5fd0 con 0x7f60f406a300 2023-11-28T11:58:50.361 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.359+0000 7f60f9aa7700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f41f62b0 con 0x7f60f40b5410 2023-11-28T11:58:50.362 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.359+0000 7f60f2ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60f40b2260 0x7f60f41f56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:50.362 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.359+0000 7f60f2ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60f40b2260 0x7f60f41f56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43736/0 (socket says 172.21.15.39:43736) 2023-11-28T11:58:50.363 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.359+0000 7f60f2ffd700 1 -- 172.21.15.39:0/1718283003 learned_addr learned my addr 172.21.15.39:0/1718283003 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:50.363 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.359+0000 7f60f37fe700 1 --2- 172.21.15.39:0/1718283003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f60f406a300 0x7f60f4150630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:50.363 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.359+0000 7f60f3fff700 1 --2- 172.21.15.39:0/1718283003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60f40b5410 0x7f60f4156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:50.363 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.359+0000 7f60f2ffd700 1 -- 172.21.15.39:0/1718283003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60f40b5410 msgr2=0x7f60f4156fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:50.363 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.359+0000 7f60f2ffd700 1 --2- 172.21.15.39:0/1718283003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60f40b5410 0x7f60f4156fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:50.363 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.359+0000 7f60f2ffd700 1 -- 172.21.15.39:0/1718283003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f60f406a300 msgr2=0x7f60f4150630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:50.363 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.359+0000 7f60f2ffd700 1 --2- 172.21.15.39:0/1718283003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f60f406a300 0x7f60f4150630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:50.363 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.359+0000 7f60f2ffd700 1 -- 172.21.15.39:0/1718283003 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ec009b30 con 0x7f60f40b2260 2023-11-28T11:58:50.363 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.359+0000 7f60f2ffd700 1 --2- 172.21.15.39:0/1718283003 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60f40b2260 0x7f60f41f56d0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f60e800c520 tx=0x7f60e800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:50.363 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.359+0000 7f60dbfff700 1 -- 172.21.15.39:0/1718283003 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e80054e0 con 0x7f60f40b2260 2023-11-28T11:58:50.363 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.359+0000 7f60dbfff700 1 -- 172.21.15.39:0/1718283003 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e80036a0 con 0x7f60f40b2260 2023-11-28T11:58:50.363 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.359+0000 7f60f9aa7700 1 -- 172.21.15.39:0/1718283003 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f406c320 con 0x7f60f40b2260 2023-11-28T11:58:50.364 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.359+0000 7f60dbfff700 1 -- 172.21.15.39:0/1718283003 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e8003a10 con 0x7f60f40b2260 2023-11-28T11:58:50.364 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.359+0000 7f60f9aa7700 1 -- 172.21.15.39:0/1718283003 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f406c040 con 0x7f60f40b2260 2023-11-28T11:58:50.364 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.359+0000 7f60f9aa7700 1 -- 172.21.15.39:0/1718283003 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f406c600 con 0x7f60f40b2260 2023-11-28T11:58:50.366 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.363+0000 7f60dbfff700 1 -- 172.21.15.39:0/1718283003 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f60e8019030 con 0x7f60f40b2260 2023-11-28T11:58:50.368 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.363+0000 7f60dbfff700 1 --2- 172.21.15.39:0/1718283003 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f60e0064ee0 0x7f60e0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:50.368 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.367+0000 7f60dbfff700 1 -- 172.21.15.39:0/1718283003 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f60e8081630 con 0x7f60f40b2260 2023-11-28T11:58:50.368 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.367+0000 7f60f37fe700 1 --2- 172.21.15.39:0/1718283003 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f60e0064ee0 0x7f60e0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:50.369 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.367+0000 7f60f37fe700 1 --2- 172.21.15.39:0/1718283003 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f60e0064ee0 0x7f60e0067390 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f60e4000f60 tx=0x7f60e4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:50.370 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.367+0000 7f60dbfff700 1 -- 172.21.15.39:0/1718283003 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f60e804f8b0 con 0x7f60f40b2260 2023-11-28T11:58:50.544 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:50.539+0000 7f60f9aa7700 1 -- 172.21.15.39:0/1718283003 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f60f40726c0 con 0x7f60f40b2260 2023-11-28T11:58:51.170 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.167+0000 7f60dbfff700 1 -- 172.21.15.39:0/1718283003 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v56) v1 ==== 170+0+0 (secure 0 0 0) 0x7f60e8052ed0 con 0x7f60f40b2260 2023-11-28T11:58:51.176 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.175+0000 7f60f9aa7700 1 -- 172.21.15.39:0/1718283003 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f60e0064ee0 msgr2=0x7f60e0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:51.176 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.175+0000 7f60f9aa7700 1 --2- 172.21.15.39:0/1718283003 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f60e0064ee0 0x7f60e0067390 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f60e4000f60 tx=0x7f60e4009040 comp rx=0 tx=0).stop 2023-11-28T11:58:51.176 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.175+0000 7f60f9aa7700 1 -- 172.21.15.39:0/1718283003 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60f40b2260 msgr2=0x7f60f41f56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:51.177 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.175+0000 7f60f9aa7700 1 --2- 172.21.15.39:0/1718283003 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60f40b2260 0x7f60f41f56d0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f60e800c520 tx=0x7f60e800c8e0 comp rx=0 tx=0).stop 2023-11-28T11:58:51.179 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.175+0000 7f60f9aa7700 1 -- 172.21.15.39:0/1718283003 shutdown_connections 2023-11-28T11:58:51.179 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.175+0000 7f60f9aa7700 1 --2- 172.21.15.39:0/1718283003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60f40b5410 0x7f60f4156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:51.179 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.175+0000 7f60f9aa7700 1 --2- 172.21.15.39:0/1718283003 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60f40b2260 0x7f60f41f56d0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:51.179 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.175+0000 7f60f9aa7700 1 --2- 172.21.15.39:0/1718283003 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f60e0064ee0 0x7f60e0067390 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:51.179 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.175+0000 7f60f9aa7700 1 --2- 172.21.15.39:0/1718283003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f60f406a300 0x7f60f4150630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:51.179 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.175+0000 7f60f9aa7700 1 -- 172.21.15.39:0/1718283003 >> 172.21.15.39:0/1718283003 conn(0x7f60f40d3990 msgr2=0x7f60f40d2450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:51.180 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.179+0000 7f60f9aa7700 1 -- 172.21.15.39:0/1718283003 shutdown_connections 2023-11-28T11:58:51.182 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.179+0000 7f60f9aa7700 1 -- 172.21.15.39:0/1718283003 wait complete. 2023-11-28T11:58:51.187 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_data' created 2023-11-28T11:58:51.211 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T11:58:51.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.391+0000 7fbb54f97700 1 Processor -- start 2023-11-28T11:58:51.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.391+0000 7fbb54f97700 1 -- start start 2023-11-28T11:58:51.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.395+0000 7fbb54f97700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb50159f10 0x7fbb50070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:51.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.395+0000 7fbb54f97700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbb500c8c90 0x7fbb5006b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:51.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.395+0000 7fbb54f97700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb50070600 con 0x7fbb5015a2e0 2023-11-28T11:58:51.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.395+0000 7fbb54f97700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb500c9100 con 0x7fbb500c8c90 2023-11-28T11:58:51.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.395+0000 7fbb54f97700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5006b840 con 0x7fbb50159f10 2023-11-28T11:58:51.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.395+0000 7fbb46ffd700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbb500c8c90 0x7fbb5006b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:51.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.395+0000 7fbb4f7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb50159f10 0x7fbb50070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:51.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.395+0000 7fbb4ffff700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fbb5015a2e0 0x7fbb5015a720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42368/0 (socket says 172.21.15.39:42368) 2023-11-28T11:58:51.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.395+0000 7fbb4ffff700 1 -- 172.21.15.39:0/1526285961 learned_addr learned my addr 172.21.15.39:0/1526285961 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:58:51.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.395+0000 7fbb4f7fe700 1 -- 172.21.15.39:0/1526285961 >> v2:172.21.15.39:3300/0 conn(0x7fbb500c8c90 msgr2=0x7fbb5006b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:51.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.395+0000 7fbb4f7fe700 1 --2- 172.21.15.39:0/1526285961 >> v2:172.21.15.39:3300/0 conn(0x7fbb500c8c90 0x7fbb5006b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:51.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.395+0000 7fbb4f7fe700 1 -- 172.21.15.39:0/1526285961 >> v1:172.21.15.39:6789/0 conn(0x7fbb5015a2e0 legacy=0x7fbb5015a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:51.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.395+0000 7fbb4f7fe700 1 -- 172.21.15.39:0/1526285961 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb5015ae30 con 0x7fbb50159f10 2023-11-28T11:58:51.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.395+0000 7fbb46ffd700 1 --2- 172.21.15.39:0/1526285961 >> v2:172.21.15.39:3300/0 conn(0x7fbb500c8c90 0x7fbb5006b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:58:51.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.395+0000 7fbb4f7fe700 1 --2- 172.21.15.39:0/1526285961 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb50159f10 0x7fbb50070a90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbb40009850 tx=0x7fbb40009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16409d817f4a384 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:51.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.399+0000 7fbb4effd700 1 -- 172.21.15.39:0/1526285961 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb40011830 con 0x7fbb50159f10 2023-11-28T11:58:51.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.399+0000 7fbb4effd700 1 -- 172.21.15.39:0/1526285961 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb40011990 con 0x7fbb50159f10 2023-11-28T11:58:51.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.399+0000 7fbb4effd700 1 -- 172.21.15.39:0/1526285961 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb40011d40 con 0x7fbb50159f10 2023-11-28T11:58:51.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.399+0000 7fbb54f97700 1 -- 172.21.15.39:0/1526285961 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb50159f10 msgr2=0x7fbb50070a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:51.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.399+0000 7fbb54f97700 1 --2- 172.21.15.39:0/1526285961 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb50159f10 0x7fbb50070a90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbb40009850 tx=0x7fbb40009b60 comp rx=0 tx=0).stop 2023-11-28T11:58:51.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.399+0000 7fbb54f97700 1 -- 172.21.15.39:0/1526285961 shutdown_connections 2023-11-28T11:58:51.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.399+0000 7fbb54f97700 1 --2- 172.21.15.39:0/1526285961 >> v2:172.21.15.39:3300/0 conn(0x7fbb500c8c90 0x7fbb5006b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:51.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.399+0000 7fbb54f97700 1 --2- 172.21.15.39:0/1526285961 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb50159f10 0x7fbb50070a90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:51.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.399+0000 7fbb54f97700 1 -- 172.21.15.39:0/1526285961 >> 172.21.15.39:0/1526285961 conn(0x7fbb500cf280 msgr2=0x7fbb500cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:51.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.399+0000 7fbb54f97700 1 -- 172.21.15.39:0/1526285961 shutdown_connections 2023-11-28T11:58:51.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.399+0000 7fbb54f97700 1 -- 172.21.15.39:0/1526285961 wait complete. 2023-11-28T11:58:51.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.403+0000 7fbb54f97700 1 Processor -- start 2023-11-28T11:58:51.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.403+0000 7fbb54f97700 1 -- start start 2023-11-28T11:58:51.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.403+0000 7fbb54f97700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb500c8c90 0x7fbb5014ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:51.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.403+0000 7fbb54f97700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb50159f10 0x7fbb501f18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:51.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.403+0000 7fbb54f97700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb5015a2e0 0x7fbb50154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:51.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.403+0000 7fbb54f97700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb500b37b0 con 0x7fbb50159f10 2023-11-28T11:58:51.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.403+0000 7fbb54f97700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb500b3480 con 0x7fbb5015a2e0 2023-11-28T11:58:51.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.403+0000 7fbb54f97700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb501f1e00 con 0x7fbb500c8c90 2023-11-28T11:58:51.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.407+0000 7fbb46ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb50159f10 0x7fbb501f18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:51.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.407+0000 7fbb4f7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb500c8c90 0x7fbb5014ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:51.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.407+0000 7fbb46ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb50159f10 0x7fbb501f18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43750/0 (socket says 172.21.15.39:43750) 2023-11-28T11:58:51.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.407+0000 7fbb4ffff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb5015a2e0 0x7fbb50154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:51.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.407+0000 7fbb46ffd700 1 -- 172.21.15.39:0/1695500591 learned_addr learned my addr 172.21.15.39:0/1695500591 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:51.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.407+0000 7fbb46ffd700 1 -- 172.21.15.39:0/1695500591 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb500c8c90 msgr2=0x7fbb5014ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:51.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.407+0000 7fbb46ffd700 1 --2- 172.21.15.39:0/1695500591 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb500c8c90 0x7fbb5014ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:51.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.407+0000 7fbb46ffd700 1 -- 172.21.15.39:0/1695500591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb5015a2e0 msgr2=0x7fbb50154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:51.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.407+0000 7fbb46ffd700 1 --2- 172.21.15.39:0/1695500591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb5015a2e0 0x7fbb50154e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:51.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.407+0000 7fbb46ffd700 1 -- 172.21.15.39:0/1695500591 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb380094b0 con 0x7fbb50159f10 2023-11-28T11:58:51.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.407+0000 7fbb4f7fe700 1 --2- 172.21.15.39:0/1695500591 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb500c8c90 0x7fbb5014ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:58:51.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.407+0000 7fbb46ffd700 1 --2- 172.21.15.39:0/1695500591 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb50159f10 0x7fbb501f18c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fbb3800ebe0 tx=0x7fbb3800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:51.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.407+0000 7fbb4cff9700 1 -- 172.21.15.39:0/1695500591 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3800c7f0 con 0x7fbb50159f10 2023-11-28T11:58:51.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.407+0000 7fbb4cff9700 1 -- 172.21.15.39:0/1695500591 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb3800c950 con 0x7fbb50159f10 2023-11-28T11:58:51.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.407+0000 7fbb4cff9700 1 -- 172.21.15.39:0/1695500591 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3800cce0 con 0x7fbb50159f10 2023-11-28T11:58:51.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.407+0000 7fbb54f97700 1 -- 172.21.15.39:0/1695500591 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb400094b0 con 0x7fbb50159f10 2023-11-28T11:58:51.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.407+0000 7fbb54f97700 1 -- 172.21.15.39:0/1695500591 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb5006ffb0 con 0x7fbb50159f10 2023-11-28T11:58:51.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.407+0000 7fbb54f97700 1 -- 172.21.15.39:0/1695500591 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb500afcc0 con 0x7fbb50159f10 2023-11-28T11:58:51.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.411+0000 7fbb4cff9700 1 -- 172.21.15.39:0/1695500591 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbb38019030 con 0x7fbb50159f10 2023-11-28T11:58:51.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.411+0000 7fbb4cff9700 1 --2- 172.21.15.39:0/1695500591 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fbb30064ee0 0x7fbb30067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:51.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.415+0000 7fbb4cff9700 1 -- 172.21.15.39:0/1695500591 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6282+0+0 (secure 0 0 0) 0x7fbb38081fb0 con 0x7fbb50159f10 2023-11-28T11:58:51.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.415+0000 7fbb4f7fe700 1 --2- 172.21.15.39:0/1695500591 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fbb30064ee0 0x7fbb30067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:51.418 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.415+0000 7fbb4f7fe700 1 --2- 172.21.15.39:0/1695500591 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fbb30064ee0 0x7fbb30067390 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbb400090b0 tx=0x7fbb40008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:51.423 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.419+0000 7fbb4cff9700 1 -- 172.21.15.39:0/1695500591 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbb3804ff00 con 0x7fbb50159f10 2023-11-28T11:58:51.634 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.631+0000 7fbb54f97700 1 -- 172.21.15.39:0/1695500591 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fbb5006cf30 con 0x7fbb50159f10 2023-11-28T11:58:51.646 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.643+0000 7fbb4cff9700 1 -- 172.21.15.39:0/1695500591 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v20) v1 ==== 172+0+0 (secure 0 0 0) 0x7fbb38053520 con 0x7fbb50159f10 2023-11-28T11:58:51.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.651+0000 7fbb54f97700 1 -- 172.21.15.39:0/1695500591 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fbb30064ee0 msgr2=0x7fbb30067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:51.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.651+0000 7fbb54f97700 1 --2- 172.21.15.39:0/1695500591 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fbb30064ee0 0x7fbb30067390 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbb400090b0 tx=0x7fbb40008030 comp rx=0 tx=0).stop 2023-11-28T11:58:51.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.651+0000 7fbb54f97700 1 -- 172.21.15.39:0/1695500591 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb50159f10 msgr2=0x7fbb501f18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:51.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.651+0000 7fbb54f97700 1 --2- 172.21.15.39:0/1695500591 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb50159f10 0x7fbb501f18c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fbb3800ebe0 tx=0x7fbb3800eef0 comp rx=0 tx=0).stop 2023-11-28T11:58:51.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.651+0000 7fbb54f97700 1 -- 172.21.15.39:0/1695500591 shutdown_connections 2023-11-28T11:58:51.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.651+0000 7fbb54f97700 1 --2- 172.21.15.39:0/1695500591 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fbb30064ee0 0x7fbb30067390 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:51.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.651+0000 7fbb54f97700 1 --2- 172.21.15.39:0/1695500591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb5015a2e0 0x7fbb50154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:51.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.651+0000 7fbb54f97700 1 --2- 172.21.15.39:0/1695500591 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb50159f10 0x7fbb501f18c0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:51.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.651+0000 7fbb54f97700 1 --2- 172.21.15.39:0/1695500591 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb500c8c90 0x7fbb5014ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:51.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.651+0000 7fbb54f97700 1 -- 172.21.15.39:0/1695500591 >> 172.21.15.39:0/1695500591 conn(0x7fbb500cf280 msgr2=0x7fbb500cb900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:51.656 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.651+0000 7fbb54f97700 1 -- 172.21.15.39:0/1695500591 shutdown_connections 2023-11-28T11:58:51.656 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.651+0000 7fbb54f97700 1 -- 172.21.15.39:0/1695500591 wait complete. 2023-11-28T11:58:51.665 INFO:teuthology.orchestra.run.smithi039.stderr:new fs with metadata pool 8 and data pool 9 2023-11-28T11:58:51.691 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:58:51.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.855+0000 7f390e46f700 1 Processor -- start 2023-11-28T11:58:51.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.855+0000 7f390e46f700 1 -- start start 2023-11-28T11:58:51.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.859+0000 7f390e46f700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f39080cdeb0 0x7f3908070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:51.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.859+0000 7f390e46f700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39080709d0 con 0x7f390815c1a0 2023-11-28T11:58:51.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.859+0000 7f390e46f700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39080adf90 con 0x7f39080705c0 2023-11-28T11:58:51.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.859+0000 7f390e46f700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3908069bf0 con 0x7f39080cdeb0 2023-11-28T11:58:51.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.859+0000 7f390cc6c700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f39080cdeb0 0x7f3908070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:51.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.859+0000 7f390d46d700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f390815c1a0 0x7f390806c8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42376/0 (socket says 172.21.15.39:42376) 2023-11-28T11:58:51.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.859+0000 7f390d46d700 1 -- 172.21.15.39:0/2800545195 learned_addr learned my addr 172.21.15.39:0/2800545195 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:58:51.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.859+0000 7f390cc6c700 1 -- 172.21.15.39:0/2800545195 >> v1:172.21.15.184:6789/0 conn(0x7f39080705c0 legacy=0x7f390806a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:51.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.859+0000 7f390cc6c700 1 -- 172.21.15.39:0/2800545195 >> v1:172.21.15.39:6789/0 conn(0x7f390815c1a0 legacy=0x7f390806c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:51.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.859+0000 7f390cc6c700 1 -- 172.21.15.39:0/2800545195 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39080ce370 con 0x7f39080cdeb0 2023-11-28T11:58:51.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.859+0000 7f390cc6c700 1 --2- 172.21.15.39:0/2800545195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39080cdeb0 0x7f3908070080 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f38f8009850 tx=0x7f38f8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46d77aa43e0caeab server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:51.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.859+0000 7f38fffff700 1 -- 172.21.15.39:0/2800545195 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f8004230 con 0x7f39080cdeb0 2023-11-28T11:58:51.865 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.859+0000 7f38fffff700 1 -- 172.21.15.39:0/2800545195 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f8004390 con 0x7f39080cdeb0 2023-11-28T11:58:51.865 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.859+0000 7f38fffff700 1 -- 172.21.15.39:0/2800545195 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f80036c0 con 0x7f39080cdeb0 2023-11-28T11:58:51.865 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.863+0000 7f390e46f700 1 -- 172.21.15.39:0/2800545195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39080cdeb0 msgr2=0x7f3908070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:51.865 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.863+0000 7f390e46f700 1 --2- 172.21.15.39:0/2800545195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39080cdeb0 0x7f3908070080 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f38f8009850 tx=0x7f38f8009b60 comp rx=0 tx=0).stop 2023-11-28T11:58:51.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.863+0000 7f390e46f700 1 -- 172.21.15.39:0/2800545195 shutdown_connections 2023-11-28T11:58:51.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.863+0000 7f390e46f700 1 --2- 172.21.15.39:0/2800545195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39080cdeb0 0x7f3908070080 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:51.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.863+0000 7f390e46f700 1 -- 172.21.15.39:0/2800545195 >> 172.21.15.39:0/2800545195 conn(0x7f39080b0f80 msgr2=0x7f39080ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:51.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.863+0000 7f390e46f700 1 -- 172.21.15.39:0/2800545195 shutdown_connections 2023-11-28T11:58:51.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.863+0000 7f390e46f700 1 -- 172.21.15.39:0/2800545195 wait complete. 2023-11-28T11:58:51.867 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.863+0000 7f390e46f700 1 Processor -- start 2023-11-28T11:58:51.868 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.863+0000 7f390e46f700 1 -- start start 2023-11-28T11:58:51.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.867+0000 7f390e46f700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39080705c0 0x7f3908156f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:51.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.867+0000 7f390e46f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39080cdeb0 0x7f390815eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:51.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.867+0000 7f390e46f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f390815c1a0 0x7f3908157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:51.870 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.867+0000 7f390e46f700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390815e250 con 0x7f39080705c0 2023-11-28T11:58:51.870 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.867+0000 7f390e46f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39080af860 con 0x7f390815c1a0 2023-11-28T11:58:51.870 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.867+0000 7f390e46f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39080afb40 con 0x7f39080cdeb0 2023-11-28T11:58:51.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.867+0000 7f390d46d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39080705c0 0x7f3908156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:51.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.867+0000 7f390d46d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39080705c0 0x7f3908156f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43762/0 (socket says 172.21.15.39:43762) 2023-11-28T11:58:51.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.867+0000 7f390d46d700 1 -- 172.21.15.39:0/3699127070 learned_addr learned my addr 172.21.15.39:0/3699127070 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:51.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.867+0000 7f390cc6c700 1 --2- 172.21.15.39:0/3699127070 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39080cdeb0 0x7f390815eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:51.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.867+0000 7f390dc6e700 1 --2- 172.21.15.39:0/3699127070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f390815c1a0 0x7f3908157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:51.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.867+0000 7f390d46d700 1 -- 172.21.15.39:0/3699127070 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39080cdeb0 msgr2=0x7f390815eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:51.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.867+0000 7f390d46d700 1 --2- 172.21.15.39:0/3699127070 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39080cdeb0 0x7f390815eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:51.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.867+0000 7f390d46d700 1 -- 172.21.15.39:0/3699127070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f390815c1a0 msgr2=0x7f3908157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:51.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.867+0000 7f390d46d700 1 --2- 172.21.15.39:0/3699127070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f390815c1a0 0x7f3908157590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:51.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.867+0000 7f390d46d700 1 -- 172.21.15.39:0/3699127070 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f80094b0 con 0x7f39080705c0 2023-11-28T11:58:51.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.867+0000 7f390dc6e700 1 --2- 172.21.15.39:0/3699127070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f390815c1a0 0x7f3908157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:58:51.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.867+0000 7f390d46d700 1 --2- 172.21.15.39:0/3699127070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39080705c0 0x7f3908156f00 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f390400c500 tx=0x7f390400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:51.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.867+0000 7f38fdffb700 1 -- 172.21.15.39:0/3699127070 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3904005d90 con 0x7f39080705c0 2023-11-28T11:58:51.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.867+0000 7f38fdffb700 1 -- 172.21.15.39:0/3699127070 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39040070d0 con 0x7f39080705c0 2023-11-28T11:58:51.873 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.867+0000 7f38fdffb700 1 -- 172.21.15.39:0/3699127070 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3904007460 con 0x7f39080705c0 2023-11-28T11:58:51.873 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.867+0000 7f390e46f700 1 -- 172.21.15.39:0/3699127070 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39080cc780 con 0x7f39080705c0 2023-11-28T11:58:51.873 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.871+0000 7f390e46f700 1 -- 172.21.15.39:0/3699127070 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39080cc4a0 con 0x7f39080705c0 2023-11-28T11:58:51.874 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.871+0000 7f390e46f700 1 -- 172.21.15.39:0/3699127070 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f390815c570 con 0x7f39080705c0 2023-11-28T11:58:51.875 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.871+0000 7f38fdffb700 1 -- 172.21.15.39:0/3699127070 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3904019030 con 0x7f39080705c0 2023-11-28T11:58:51.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.875+0000 7f38fdffb700 1 --2- 172.21.15.39:0/3699127070 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f38ec064ee0 0x7f38ec067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:51.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.875+0000 7f38fdffb700 1 -- 172.21.15.39:0/3699127070 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f39040813f0 con 0x7f39080705c0 2023-11-28T11:58:51.878 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.875+0000 7f390cc6c700 1 --2- 172.21.15.39:0/3699127070 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f38ec064ee0 0x7f38ec067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:51.879 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.875+0000 7f390cc6c700 1 --2- 172.21.15.39:0/3699127070 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f38ec064ee0 0x7f38ec067390 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f38f8009850 tx=0x7f38f8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:51.883 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:51.879+0000 7f38fdffb700 1 -- 172.21.15.39:0/3699127070 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f390404f360 con 0x7f39080705c0 2023-11-28T11:58:52.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.055+0000 7f390e46f700 1 -- 172.21.15.39:0/3699127070 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3908073cb0 con 0x7f39080705c0 2023-11-28T11:58:52.062 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.059+0000 7f38fdffb700 1 -- 172.21.15.39:0/3699127070 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+18097 (secure 0 0 0) 0x7f3904052980 con 0x7f39080705c0 2023-11-28T11:58:52.063 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:58:52.063 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":57,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:58:51.634329+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:58:50.082546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-28T11:58:50.610241+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:58:52.066 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.063+0000 7f390e46f700 1 -- 172.21.15.39:0/3699127070 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f38ec064ee0 msgr2=0x7f38ec067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:52.066 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.063+0000 7f390e46f700 1 --2- 172.21.15.39:0/3699127070 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f38ec064ee0 0x7f38ec067390 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f38f8009850 tx=0x7f38f8008030 comp rx=0 tx=0).stop 2023-11-28T11:58:52.066 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.063+0000 7f390e46f700 1 -- 172.21.15.39:0/3699127070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39080705c0 msgr2=0x7f3908156f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:52.066 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.063+0000 7f390e46f700 1 --2- 172.21.15.39:0/3699127070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39080705c0 0x7f3908156f00 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f390400c500 tx=0x7f390400c810 comp rx=0 tx=0).stop 2023-11-28T11:58:52.066 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.063+0000 7f390e46f700 1 -- 172.21.15.39:0/3699127070 shutdown_connections 2023-11-28T11:58:52.066 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.063+0000 7f390e46f700 1 --2- 172.21.15.39:0/3699127070 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f38ec064ee0 0x7f38ec067390 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:52.067 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.063+0000 7f390e46f700 1 --2- 172.21.15.39:0/3699127070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f390815c1a0 0x7f3908157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:52.067 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.063+0000 7f390e46f700 1 --2- 172.21.15.39:0/3699127070 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39080cdeb0 0x7f390815eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:52.067 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.063+0000 7f390e46f700 1 --2- 172.21.15.39:0/3699127070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39080705c0 0x7f3908156f00 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:52.067 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.063+0000 7f390e46f700 1 -- 172.21.15.39:0/3699127070 >> 172.21.15.39:0/3699127070 conn(0x7f39080b0f80 msgr2=0x7f3908069eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:52.067 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.063+0000 7f390e46f700 1 -- 172.21.15.39:0/3699127070 shutdown_connections 2023-11-28T11:58:52.067 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.063+0000 7f390e46f700 1 -- 172.21.15.39:0/3699127070 wait complete. 2023-11-28T11:58:52.088 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:58:52.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.267+0000 7f8eb4924700 1 Processor -- start 2023-11-28T11:58:52.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.267+0000 7f8eb4924700 1 -- start start 2023-11-28T11:58:52.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.267+0000 7f8eb4924700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f8eb0160710 0x7f8eb00cc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:52.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.267+0000 7f8eb4924700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f8eb0070790 0x7f8eb0164250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:52.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.267+0000 7f8eb4924700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eb00ad6c0 con 0x7f8eb00cc860 2023-11-28T11:58:52.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.267+0000 7f8eb4924700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eb006b1c0 con 0x7f8eb0160710 2023-11-28T11:58:52.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.267+0000 7f8eb4924700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eb00adc60 con 0x7f8eb0070790 2023-11-28T11:58:52.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.267+0000 7f8eaf7fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f8eb0160710 0x7f8eb00cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:52.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.267+0000 7f8eaf7fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f8eb0160710 0x7f8eb00cc320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43768/0 (socket says 172.21.15.39:43768) 2023-11-28T11:58:52.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.267+0000 7f8eaf7fe700 1 -- 172.21.15.39:0/4273572234 learned_addr learned my addr 172.21.15.39:0/4273572234 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:52.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.267+0000 7f8eaffff700 1 --2- 172.21.15.39:0/4273572234 >> v2:172.21.15.184:3300/0 conn(0x7f8eb0070790 0x7f8eb0164250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:52.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.267+0000 7f8eaf7fe700 1 -- 172.21.15.39:0/4273572234 >> v2:172.21.15.184:3300/0 conn(0x7f8eb0070790 msgr2=0x7f8eb0164250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:52.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.267+0000 7f8eaf7fe700 1 --2- 172.21.15.39:0/4273572234 >> v2:172.21.15.184:3300/0 conn(0x7f8eb0070790 0x7f8eb0164250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:52.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.271+0000 7f8eaf7fe700 1 -- 172.21.15.39:0/4273572234 >> v1:172.21.15.184:6789/0 conn(0x7f8eb00cc860 legacy=0x7f8eb0070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:52.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.271+0000 7f8eaf7fe700 1 -- 172.21.15.39:0/4273572234 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb006b3d0 con 0x7f8eb0160710 2023-11-28T11:58:52.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.271+0000 7f8eaffff700 1 --2- 172.21.15.39:0/4273572234 >> v2:172.21.15.184:3300/0 conn(0x7f8eb0070790 0x7f8eb0164250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:58:52.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.271+0000 7f8eaf7fe700 1 --2- 172.21.15.39:0/4273572234 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8eb0160710 0x7f8eb00cc320 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00cdbb0 tx=0x7f8ea0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62149acce52d1176 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:52.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.271+0000 7f8eaeffd700 1 -- 172.21.15.39:0/4273572234 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea000b8a0 con 0x7f8eb0160710 2023-11-28T11:58:52.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.271+0000 7f8eaeffd700 1 -- 172.21.15.39:0/4273572234 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea000ba00 con 0x7f8eb0160710 2023-11-28T11:58:52.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.271+0000 7f8eaeffd700 1 -- 172.21.15.39:0/4273572234 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea000bd90 con 0x7f8eb0160710 2023-11-28T11:58:52.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.271+0000 7f8eb4924700 1 -- 172.21.15.39:0/4273572234 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8eb0160710 msgr2=0x7f8eb00cc320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:52.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.271+0000 7f8eb4924700 1 --2- 172.21.15.39:0/4273572234 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8eb0160710 0x7f8eb00cc320 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00cdbb0 tx=0x7f8ea0009bf0 comp rx=0 tx=0).stop 2023-11-28T11:58:52.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.271+0000 7f8eb4924700 1 -- 172.21.15.39:0/4273572234 shutdown_connections 2023-11-28T11:58:52.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.271+0000 7f8eb4924700 1 --2- 172.21.15.39:0/4273572234 >> v2:172.21.15.184:3300/0 conn(0x7f8eb0070790 0x7f8eb0164250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:52.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.271+0000 7f8eb4924700 1 --2- 172.21.15.39:0/4273572234 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8eb0160710 0x7f8eb00cc320 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:52.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.271+0000 7f8eb4924700 1 -- 172.21.15.39:0/4273572234 >> 172.21.15.39:0/4273572234 conn(0x7f8eb00b0f80 msgr2=0x7f8eb00ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:52.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.271+0000 7f8eb4924700 1 -- 172.21.15.39:0/4273572234 shutdown_connections 2023-11-28T11:58:52.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.271+0000 7f8eb4924700 1 -- 172.21.15.39:0/4273572234 wait complete. 2023-11-28T11:58:52.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.275+0000 7f8eb4924700 1 Processor -- start 2023-11-28T11:58:52.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.275+0000 7f8eb4924700 1 -- start start 2023-11-28T11:58:52.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.275+0000 7f8eb4924700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8eb0070790 0x7f8eb015ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:52.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.275+0000 7f8eb4924700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8eb00cc860 0x7f8eb0159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:52.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.275+0000 7f8eb4924700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8eb0160710 0x7f8eb01f92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:52.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.275+0000 7f8eb4924700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb015d6f0 con 0x7f8eb00cc860 2023-11-28T11:58:52.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.275+0000 7f8eb4924700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb00b1640 con 0x7f8eb0070790 2023-11-28T11:58:52.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.275+0000 7f8eb4924700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb00b1920 con 0x7f8eb0160710 2023-11-28T11:58:52.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.275+0000 7f8ea6ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8eb00cc860 0x7f8eb0159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:52.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.275+0000 7f8ea6ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8eb00cc860 0x7f8eb0159a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43772/0 (socket says 172.21.15.39:43772) 2023-11-28T11:58:52.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.275+0000 7f8ea6ffd700 1 -- 172.21.15.39:0/990501282 learned_addr learned my addr 172.21.15.39:0/990501282 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:52.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.275+0000 7f8eaf7fe700 1 --2- 172.21.15.39:0/990501282 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8eb0070790 0x7f8eb015ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:52.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.275+0000 7f8eaffff700 1 --2- 172.21.15.39:0/990501282 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8eb0160710 0x7f8eb01f92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:52.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.279+0000 7f8ea6ffd700 1 -- 172.21.15.39:0/990501282 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8eb0160710 msgr2=0x7f8eb01f92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:52.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.279+0000 7f8ea6ffd700 1 --2- 172.21.15.39:0/990501282 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8eb0160710 0x7f8eb01f92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:52.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.279+0000 7f8ea6ffd700 1 -- 172.21.15.39:0/990501282 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8eb0070790 msgr2=0x7f8eb015ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:52.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.279+0000 7f8ea6ffd700 1 --2- 172.21.15.39:0/990501282 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8eb0070790 0x7f8eb015ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:52.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.279+0000 7f8ea6ffd700 1 -- 172.21.15.39:0/990501282 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea0009570 con 0x7f8eb00cc860 2023-11-28T11:58:52.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.279+0000 7f8ea6ffd700 1 --2- 172.21.15.39:0/990501282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8eb00cc860 0x7f8eb0159a20 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800c500 tx=0x7f8e9800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:52.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.279+0000 7f8eacff9700 1 -- 172.21.15.39:0/990501282 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e980052d0 con 0x7f8eb00cc860 2023-11-28T11:58:52.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.279+0000 7f8eacff9700 1 -- 172.21.15.39:0/990501282 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e98005430 con 0x7f8eb00cc860 2023-11-28T11:58:52.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.279+0000 7f8eb4924700 1 -- 172.21.15.39:0/990501282 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb00ad8f0 con 0x7f8eb00cc860 2023-11-28T11:58:52.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.279+0000 7f8eacff9700 1 -- 172.21.15.39:0/990501282 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e980055a0 con 0x7f8eb00cc860 2023-11-28T11:58:52.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.279+0000 7f8eb4924700 1 -- 172.21.15.39:0/990501282 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb006b6b0 con 0x7f8eb00cc860 2023-11-28T11:58:52.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.279+0000 7f8eb4924700 1 -- 172.21.15.39:0/990501282 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eb0160ae0 con 0x7f8eb00cc860 2023-11-28T11:58:52.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.283+0000 7f8eacff9700 1 -- 172.21.15.39:0/990501282 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8e98010050 con 0x7f8eb00cc860 2023-11-28T11:58:52.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.283+0000 7f8eacff9700 1 --2- 172.21.15.39:0/990501282 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8e90064ee0 0x7f8e90067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:52.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.283+0000 7f8eacff9700 1 -- 172.21.15.39:0/990501282 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8e98081180 con 0x7f8eb00cc860 2023-11-28T11:58:52.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.287+0000 7f8eaf7fe700 1 --2- 172.21.15.39:0/990501282 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8e90064ee0 0x7f8e90067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:52.290 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.287+0000 7f8eaf7fe700 1 --2- 172.21.15.39:0/990501282 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8e90064ee0 0x7f8e90067390 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0000c00 tx=0x7f8ea0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:52.294 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.291+0000 7f8eacff9700 1 -- 172.21.15.39:0/990501282 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8e98049400 con 0x7f8eb00cc860 2023-11-28T11:58:52.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.467+0000 7f8eb4924700 1 -- 172.21.15.39:0/990501282 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8eb0073cb0 con 0x7f8eb00cc860 2023-11-28T11:58:52.474 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.471+0000 7f8eacff9700 1 -- 172.21.15.39:0/990501282 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+18097 (secure 0 0 0) 0x7f8e9804f090 con 0x7f8eb00cc860 2023-11-28T11:58:52.474 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:58:52.475 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":57,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:58:51.634329+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:58:50.082546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-28T11:58:50.610241+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:58:52.478 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.475+0000 7f8eb4924700 1 -- 172.21.15.39:0/990501282 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8e90064ee0 msgr2=0x7f8e90067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:52.478 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.475+0000 7f8eb4924700 1 --2- 172.21.15.39:0/990501282 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8e90064ee0 0x7f8e90067390 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0000c00 tx=0x7f8ea0008030 comp rx=0 tx=0).stop 2023-11-28T11:58:52.478 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.475+0000 7f8eb4924700 1 -- 172.21.15.39:0/990501282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8eb00cc860 msgr2=0x7f8eb0159a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:52.478 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.475+0000 7f8eb4924700 1 --2- 172.21.15.39:0/990501282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8eb00cc860 0x7f8eb0159a20 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800c500 tx=0x7f8e9800c810 comp rx=0 tx=0).stop 2023-11-28T11:58:52.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.475+0000 7f8eb4924700 1 -- 172.21.15.39:0/990501282 shutdown_connections 2023-11-28T11:58:52.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.475+0000 7f8eb4924700 1 --2- 172.21.15.39:0/990501282 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8eb0160710 0x7f8eb01f92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:52.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.475+0000 7f8eb4924700 1 --2- 172.21.15.39:0/990501282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8eb00cc860 0x7f8eb0159a20 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:52.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.475+0000 7f8eb4924700 1 --2- 172.21.15.39:0/990501282 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8e90064ee0 0x7f8e90067390 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:52.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.475+0000 7f8eb4924700 1 --2- 172.21.15.39:0/990501282 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8eb0070790 0x7f8eb015ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:52.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.475+0000 7f8eb4924700 1 -- 172.21.15.39:0/990501282 >> 172.21.15.39:0/990501282 conn(0x7f8eb00b0f80 msgr2=0x7f8eb00af120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:52.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.475+0000 7f8eb4924700 1 -- 172.21.15.39:0/990501282 shutdown_connections 2023-11-28T11:58:52.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.475+0000 7f8eb4924700 1 -- 172.21.15.39:0/990501282 wait complete. 2023-11-28T11:58:52.500 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T11:58:52.689 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.687+0000 7f5f4b261700 1 Processor -- start 2023-11-28T11:58:52.689 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.687+0000 7f5f4b261700 1 -- start start 2023-11-28T11:58:52.692 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.687+0000 7f5f4b261700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f44070620 0x7f5f440b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:52.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.687+0000 7f5f4b261700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5f44069bf0 0x7f5f4406a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:52.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.687+0000 7f5f4b261700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f4415c520 con 0x7f5f4415c150 2023-11-28T11:58:52.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.691+0000 7f5f4b261700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f440b4240 con 0x7f5f44069bf0 2023-11-28T11:58:52.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.691+0000 7f5f4b261700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4406cc50 con 0x7f5f44070620 2023-11-28T11:58:52.694 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.691+0000 7f5f49a5e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f44070620 0x7f5f440b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:52.695 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.691+0000 7f5f4a25f700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f5f4415c150 0x7f5f4406ff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:48374/0 (socket says 172.21.15.39:48374) 2023-11-28T11:58:52.695 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.691+0000 7f5f4a25f700 1 -- 172.21.15.39:0/4181321636 learned_addr learned my addr 172.21.15.39:0/4181321636 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:58:52.695 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.691+0000 7f5f4aa60700 1 --2- 172.21.15.39:0/4181321636 >> v2:172.21.15.184:3300/0 conn(0x7f5f44069bf0 0x7f5f4406a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:52.695 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.691+0000 7f5f49a5e700 1 -- 172.21.15.39:0/4181321636 >> v2:172.21.15.184:3300/0 conn(0x7f5f44069bf0 msgr2=0x7f5f4406a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:52.695 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.691+0000 7f5f49a5e700 1 --2- 172.21.15.39:0/4181321636 >> v2:172.21.15.184:3300/0 conn(0x7f5f44069bf0 0x7f5f4406a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:52.695 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.691+0000 7f5f49a5e700 1 -- 172.21.15.39:0/4181321636 >> v1:172.21.15.184:6789/0 conn(0x7f5f4415c150 legacy=0x7f5f4406ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:52.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.691+0000 7f5f49a5e700 1 -- 172.21.15.39:0/4181321636 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f440d2450 con 0x7f5f44070620 2023-11-28T11:58:52.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.691+0000 7f5f4aa60700 1 --2- 172.21.15.39:0/4181321636 >> v2:172.21.15.184:3300/0 conn(0x7f5f44069bf0 0x7f5f4406a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:58:52.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.691+0000 7f5f49a5e700 1 --2- 172.21.15.39:0/4181321636 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f44070620 0x7f5f440b3d00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5f34009840 tx=0x7f5f34009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3594a5de8e00c45 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:52.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.691+0000 7f5f4925d700 1 -- 172.21.15.39:0/4181321636 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f34005e50 con 0x7f5f44070620 2023-11-28T11:58:52.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.691+0000 7f5f4925d700 1 -- 172.21.15.39:0/4181321636 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f34006030 con 0x7f5f44070620 2023-11-28T11:58:52.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.691+0000 7f5f4925d700 1 -- 172.21.15.39:0/4181321636 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f340063c0 con 0x7f5f44070620 2023-11-28T11:58:52.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.695+0000 7f5f4b261700 1 -- 172.21.15.39:0/4181321636 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f44070620 msgr2=0x7f5f440b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:52.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.695+0000 7f5f4b261700 1 --2- 172.21.15.39:0/4181321636 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f44070620 0x7f5f440b3d00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5f34009840 tx=0x7f5f34009b50 comp rx=0 tx=0).stop 2023-11-28T11:58:52.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.695+0000 7f5f4b261700 1 -- 172.21.15.39:0/4181321636 shutdown_connections 2023-11-28T11:58:52.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.695+0000 7f5f4b261700 1 --2- 172.21.15.39:0/4181321636 >> v2:172.21.15.184:3300/0 conn(0x7f5f44069bf0 0x7f5f4406a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:52.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.695+0000 7f5f4b261700 1 --2- 172.21.15.39:0/4181321636 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f44070620 0x7f5f440b3d00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:52.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.695+0000 7f5f4b261700 1 -- 172.21.15.39:0/4181321636 >> 172.21.15.39:0/4181321636 conn(0x7f5f440d3680 msgr2=0x7f5f440cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:52.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.695+0000 7f5f4b261700 1 -- 172.21.15.39:0/4181321636 shutdown_connections 2023-11-28T11:58:52.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.695+0000 7f5f4b261700 1 -- 172.21.15.39:0/4181321636 wait complete. 2023-11-28T11:58:52.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.695+0000 7f5f4b261700 1 Processor -- start 2023-11-28T11:58:52.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.695+0000 7f5f4b261700 1 -- start start 2023-11-28T11:58:52.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.699+0000 7f5f4b261700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f44069bf0 0x7f5f44142520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:52.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.699+0000 7f5f4b261700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f44070620 0x7f5f44158de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:52.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.699+0000 7f5f4b261700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f4415c150 0x7f5f44159320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:52.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.699+0000 7f5f4b261700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f44142a60 con 0x7f5f44070620 2023-11-28T11:58:52.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.699+0000 7f5f4b261700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f440c91d0 con 0x7f5f4415c150 2023-11-28T11:58:52.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.699+0000 7f5f4b261700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4415a5d0 con 0x7f5f44069bf0 2023-11-28T11:58:52.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.699+0000 7f5f49a5e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f44070620 0x7f5f44158de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:52.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.699+0000 7f5f49a5e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f44070620 0x7f5f44158de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43774/0 (socket says 172.21.15.39:43774) 2023-11-28T11:58:52.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.699+0000 7f5f49a5e700 1 -- 172.21.15.39:0/1463738158 learned_addr learned my addr 172.21.15.39:0/1463738158 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:52.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.699+0000 7f5f4a25f700 1 --2- 172.21.15.39:0/1463738158 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f44069bf0 0x7f5f44142520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:52.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.699+0000 7f5f4aa60700 1 --2- 172.21.15.39:0/1463738158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f4415c150 0x7f5f44159320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:52.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.699+0000 7f5f49a5e700 1 -- 172.21.15.39:0/1463738158 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f44069bf0 msgr2=0x7f5f44142520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:52.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.699+0000 7f5f49a5e700 1 --2- 172.21.15.39:0/1463738158 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f44069bf0 0x7f5f44142520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:52.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.699+0000 7f5f49a5e700 1 -- 172.21.15.39:0/1463738158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f4415c150 msgr2=0x7f5f44159320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:52.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.699+0000 7f5f49a5e700 1 --2- 172.21.15.39:0/1463738158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f4415c150 0x7f5f44159320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:52.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.699+0000 7f5f49a5e700 1 -- 172.21.15.39:0/1463738158 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3c009a70 con 0x7f5f44070620 2023-11-28T11:58:52.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.699+0000 7f5f4aa60700 1 --2- 172.21.15.39:0/1463738158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f4415c150 0x7f5f44159320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:58:52.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.699+0000 7f5f49a5e700 1 --2- 172.21.15.39:0/1463738158 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f44070620 0x7f5f44158de0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f5f34009b90 tx=0x7f5f34004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:52.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.699+0000 7f5f3affd700 1 -- 172.21.15.39:0/1463738158 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f34003ad0 con 0x7f5f44070620 2023-11-28T11:58:52.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.699+0000 7f5f3affd700 1 -- 172.21.15.39:0/1463738158 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f34003c50 con 0x7f5f44070620 2023-11-28T11:58:52.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.699+0000 7f5f4b261700 1 -- 172.21.15.39:0/1463738158 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f34009450 con 0x7f5f44070620 2023-11-28T11:58:52.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.699+0000 7f5f3affd700 1 -- 172.21.15.39:0/1463738158 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f340045e0 con 0x7f5f44070620 2023-11-28T11:58:52.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.699+0000 7f5f4b261700 1 -- 172.21.15.39:0/1463738158 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f440d05e0 con 0x7f5f44070620 2023-11-28T11:58:52.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.703+0000 7f5f4b261700 1 -- 172.21.15.39:0/1463738158 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f440d2730 con 0x7f5f44070620 2023-11-28T11:58:52.709 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.703+0000 7f5f3affd700 1 -- 172.21.15.39:0/1463738158 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5f3400f050 con 0x7f5f44070620 2023-11-28T11:58:52.709 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.707+0000 7f5f3affd700 1 --2- 172.21.15.39:0/1463738158 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5f28064ee0 0x7f5f28067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:52.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.707+0000 7f5f3affd700 1 -- 172.21.15.39:0/1463738158 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f5f34083ae0 con 0x7f5f44070620 2023-11-28T11:58:52.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.707+0000 7f5f4a25f700 1 --2- 172.21.15.39:0/1463738158 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5f28064ee0 0x7f5f28067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:52.711 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.707+0000 7f5f4a25f700 1 --2- 172.21.15.39:0/1463738158 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5f28064ee0 0x7f5f28067390 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5f40005930 tx=0x7f5f40009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:52.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.711+0000 7f5f3affd700 1 -- 172.21.15.39:0/1463738158 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5f34051a50 con 0x7f5f44070620 2023-11-28T11:58:52.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:52.923+0000 7f5f4b261700 1 -- 172.21.15.39:0/1463738158 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5f440d2140 con 0x7f5f44070620 2023-11-28T11:58:53.664 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.659+0000 7f5f3affd700 1 -- 172.21.15.39:0/1463738158 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v23) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5f3402a0b0 con 0x7f5f44070620 2023-11-28T11:58:53.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.667+0000 7f5f4b261700 1 -- 172.21.15.39:0/1463738158 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5f28064ee0 msgr2=0x7f5f28067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:53.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.667+0000 7f5f4b261700 1 --2- 172.21.15.39:0/1463738158 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5f28064ee0 0x7f5f28067390 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5f40005930 tx=0x7f5f40009040 comp rx=0 tx=0).stop 2023-11-28T11:58:53.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.667+0000 7f5f4b261700 1 -- 172.21.15.39:0/1463738158 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f44070620 msgr2=0x7f5f44158de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:53.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.667+0000 7f5f4b261700 1 --2- 172.21.15.39:0/1463738158 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f44070620 0x7f5f44158de0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f5f34009b90 tx=0x7f5f34004770 comp rx=0 tx=0).stop 2023-11-28T11:58:53.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.667+0000 7f5f4b261700 1 -- 172.21.15.39:0/1463738158 shutdown_connections 2023-11-28T11:58:53.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.667+0000 7f5f4b261700 1 --2- 172.21.15.39:0/1463738158 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5f28064ee0 0x7f5f28067390 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:53.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.667+0000 7f5f4b261700 1 --2- 172.21.15.39:0/1463738158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f4415c150 0x7f5f44159320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:53.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.667+0000 7f5f4b261700 1 --2- 172.21.15.39:0/1463738158 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f44070620 0x7f5f44158de0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:53.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.667+0000 7f5f4b261700 1 --2- 172.21.15.39:0/1463738158 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f44069bf0 0x7f5f44142520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:53.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.667+0000 7f5f4b261700 1 -- 172.21.15.39:0/1463738158 >> 172.21.15.39:0/1463738158 conn(0x7f5f440d3680 msgr2=0x7f5f4406a050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:53.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.667+0000 7f5f4b261700 1 -- 172.21.15.39:0/1463738158 shutdown_connections 2023-11-28T11:58:53.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.667+0000 7f5f4b261700 1 -- 172.21.15.39:0/1463738158 wait complete. 2023-11-28T11:58:53.694 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T11:58:53.694 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T11:58:53.883 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.879+0000 7f4a34a4c700 1 Processor -- start 2023-11-28T11:58:53.884 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.879+0000 7f4a34a4c700 1 -- start start 2023-11-28T11:58:53.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.883+0000 7f4a34a4c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4a300cd250 0x7f4a300cc770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:53.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.883+0000 7f4a34a4c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f4a300cd620 0x7f4a3006ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:53.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.883+0000 7f4a34a4c700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a3006b7c0 con 0x7f4a3006b240 2023-11-28T11:58:53.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.883+0000 7f4a34a4c700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a300cb9b0 con 0x7f4a300cd620 2023-11-28T11:58:53.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.883+0000 7f4a34a4c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a300cbc90 con 0x7f4a300cd250 2023-11-28T11:58:53.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.883+0000 7f4a2f7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4a300cd250 0x7f4a300cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:53.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.883+0000 7f4a2f7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4a300cd250 0x7f4a300cc770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:34188/0 (socket says 172.21.15.39:34188) 2023-11-28T11:58:53.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.883+0000 7f4a2f7fe700 1 -- 172.21.15.39:0/3406364975 learned_addr learned my addr 172.21.15.39:0/3406364975 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:53.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.883+0000 7f4a2effd700 1 --2- 172.21.15.39:0/3406364975 >> v2:172.21.15.184:3300/0 conn(0x7f4a300cd620 0x7f4a3006ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:53.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.887+0000 7f4a2effd700 1 -- 172.21.15.39:0/3406364975 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4a300cd250 msgr2=0x7f4a300cc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:53.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.887+0000 7f4a2effd700 1 --2- 172.21.15.39:0/3406364975 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4a300cd250 0x7f4a300cc770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:53.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.887+0000 7f4a2effd700 1 -- 172.21.15.39:0/3406364975 >> v1:172.21.15.184:6789/0 conn(0x7f4a3006b240 legacy=0x7f4a300ad490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:53.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.887+0000 7f4a2effd700 1 -- 172.21.15.39:0/3406364975 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a300cbf70 con 0x7f4a300cd620 2023-11-28T11:58:53.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.887+0000 7f4a2effd700 1 --2- 172.21.15.39:0/3406364975 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a300cd620 0x7f4a3006ad00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4a24009880 tx=0x7f4a24009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=498be51cd8af21c6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:53.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.887+0000 7f4a2e7fc700 1 -- 172.21.15.39:0/3406364975 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a24011830 con 0x7f4a300cd620 2023-11-28T11:58:53.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.887+0000 7f4a2e7fc700 1 -- 172.21.15.39:0/3406364975 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a24011990 con 0x7f4a300cd620 2023-11-28T11:58:53.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.887+0000 7f4a2e7fc700 1 -- 172.21.15.39:0/3406364975 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a24011d20 con 0x7f4a300cd620 2023-11-28T11:58:53.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.887+0000 7f4a34a4c700 1 -- 172.21.15.39:0/3406364975 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a300cd620 msgr2=0x7f4a3006ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:53.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.887+0000 7f4a34a4c700 1 --2- 172.21.15.39:0/3406364975 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a300cd620 0x7f4a3006ad00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4a24009880 tx=0x7f4a24009b90 comp rx=0 tx=0).stop 2023-11-28T11:58:53.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.887+0000 7f4a34a4c700 1 -- 172.21.15.39:0/3406364975 shutdown_connections 2023-11-28T11:58:53.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.887+0000 7f4a34a4c700 1 --2- 172.21.15.39:0/3406364975 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a300cd620 0x7f4a3006ad00 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:53.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.887+0000 7f4a34a4c700 1 --2- 172.21.15.39:0/3406364975 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4a300cd250 0x7f4a300cc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:53.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.887+0000 7f4a34a4c700 1 -- 172.21.15.39:0/3406364975 >> 172.21.15.39:0/3406364975 conn(0x7f4a3006a510 msgr2=0x7f4a30099ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:53.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.887+0000 7f4a34a4c700 1 -- 172.21.15.39:0/3406364975 shutdown_connections 2023-11-28T11:58:53.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.887+0000 7f4a34a4c700 1 -- 172.21.15.39:0/3406364975 wait complete. 2023-11-28T11:58:53.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.891+0000 7f4a34a4c700 1 Processor -- start 2023-11-28T11:58:53.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.891+0000 7f4a34a4c700 1 -- start start 2023-11-28T11:58:53.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.895+0000 7f4a34a4c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4a3006b240 0x7f4a300c7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:53.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.895+0000 7f4a34a4c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a300cd250 0x7f4a301f52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:53.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.895+0000 7f4a34a4c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4a300cd620 0x7f4a301f5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:53.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.895+0000 7f4a34a4c700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a300c6ca0 con 0x7f4a300cd620 2023-11-28T11:58:53.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.895+0000 7f4a34a4c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a300c6090 con 0x7f4a300cd250 2023-11-28T11:58:53.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.895+0000 7f4a34a4c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a300c6370 con 0x7f4a3006b240 2023-11-28T11:58:53.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.895+0000 7f4a2ffff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4a300cd620 0x7f4a301f5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:53.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.895+0000 7f4a2f7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4a3006b240 0x7f4a300c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:53.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.895+0000 7f4a2effd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a300cd250 0x7f4a301f52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:53.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.895+0000 7f4a2ffff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4a300cd620 0x7f4a301f5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43776/0 (socket says 172.21.15.39:43776) 2023-11-28T11:58:53.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.895+0000 7f4a2ffff700 1 -- 172.21.15.39:0/246255111 learned_addr learned my addr 172.21.15.39:0/246255111 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:53.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.895+0000 7f4a2ffff700 1 -- 172.21.15.39:0/246255111 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4a3006b240 msgr2=0x7f4a300c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:53.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.895+0000 7f4a2ffff700 1 --2- 172.21.15.39:0/246255111 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4a3006b240 0x7f4a300c7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:53.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.895+0000 7f4a2ffff700 1 -- 172.21.15.39:0/246255111 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a300cd250 msgr2=0x7f4a301f52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:53.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.895+0000 7f4a2ffff700 1 --2- 172.21.15.39:0/246255111 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a300cd250 0x7f4a301f52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:53.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.895+0000 7f4a2ffff700 1 -- 172.21.15.39:0/246255111 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a240094b0 con 0x7f4a300cd620 2023-11-28T11:58:53.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.895+0000 7f4a2effd700 1 --2- 172.21.15.39:0/246255111 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a300cd250 0x7f4a301f52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:58:53.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.895+0000 7f4a2ffff700 1 --2- 172.21.15.39:0/246255111 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4a300cd620 0x7f4a301f5810 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4a2800cb50 tx=0x7f4a2800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:53.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.895+0000 7f4a17fff700 1 -- 172.21.15.39:0/246255111 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a28003c20 con 0x7f4a300cd620 2023-11-28T11:58:53.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.895+0000 7f4a17fff700 1 -- 172.21.15.39:0/246255111 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a28003d80 con 0x7f4a300cd620 2023-11-28T11:58:53.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.895+0000 7f4a34a4c700 1 -- 172.21.15.39:0/246255111 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a300c7550 con 0x7f4a300cd620 2023-11-28T11:58:53.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.895+0000 7f4a17fff700 1 -- 172.21.15.39:0/246255111 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2800aa20 con 0x7f4a300cd620 2023-11-28T11:58:53.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.899+0000 7f4a34a4c700 1 -- 172.21.15.39:0/246255111 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a300cc250 con 0x7f4a300cd620 2023-11-28T11:58:53.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.899+0000 7f4a34a4c700 1 -- 172.21.15.39:0/246255111 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a300cda70 con 0x7f4a300cd620 2023-11-28T11:58:53.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.903+0000 7f4a17fff700 1 -- 172.21.15.39:0/246255111 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4a28010050 con 0x7f4a300cd620 2023-11-28T11:58:53.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.903+0000 7f4a17fff700 1 --2- 172.21.15.39:0/246255111 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4a1c064ee0 0x7f4a1c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:53.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.903+0000 7f4a17fff700 1 -- 172.21.15.39:0/246255111 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4a28081f60 con 0x7f4a300cd620 2023-11-28T11:58:53.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.903+0000 7f4a2f7fe700 1 --2- 172.21.15.39:0/246255111 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4a1c064ee0 0x7f4a1c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:53.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.907+0000 7f4a2f7fe700 1 --2- 172.21.15.39:0/246255111 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4a1c064ee0 0x7f4a1c067390 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4a20009b50 tx=0x7f4a200092e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:53.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:53.911+0000 7f4a17fff700 1 -- 172.21.15.39:0/246255111 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4a2804fed0 con 0x7f4a300cd620 2023-11-28T11:58:54.123 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.119+0000 7f4a34a4c700 1 -- 172.21.15.39:0/246255111 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4a300c6de0 con 0x7f4a300cd620 2023-11-28T11:58:54.720 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.715+0000 7f4a17fff700 1 -- 172.21.15.39:0/246255111 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4a300c6de0 con 0x7f4a300cd620 2023-11-28T11:58:54.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.723+0000 7f4a34a4c700 1 -- 172.21.15.39:0/246255111 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4a1c064ee0 msgr2=0x7f4a1c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:54.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.723+0000 7f4a34a4c700 1 --2- 172.21.15.39:0/246255111 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4a1c064ee0 0x7f4a1c067390 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4a20009b50 tx=0x7f4a200092e0 comp rx=0 tx=0).stop 2023-11-28T11:58:54.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.723+0000 7f4a34a4c700 1 -- 172.21.15.39:0/246255111 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4a300cd620 msgr2=0x7f4a301f5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:54.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.723+0000 7f4a34a4c700 1 --2- 172.21.15.39:0/246255111 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4a300cd620 0x7f4a301f5810 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4a2800cb50 tx=0x7f4a2800ce60 comp rx=0 tx=0).stop 2023-11-28T11:58:54.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.723+0000 7f4a34a4c700 1 -- 172.21.15.39:0/246255111 shutdown_connections 2023-11-28T11:58:54.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.723+0000 7f4a34a4c700 1 --2- 172.21.15.39:0/246255111 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4a300cd620 0x7f4a301f5810 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:54.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.723+0000 7f4a34a4c700 1 --2- 172.21.15.39:0/246255111 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4a1c064ee0 0x7f4a1c067390 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:54.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.723+0000 7f4a34a4c700 1 --2- 172.21.15.39:0/246255111 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a300cd250 0x7f4a301f52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:54.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.723+0000 7f4a34a4c700 1 --2- 172.21.15.39:0/246255111 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4a3006b240 0x7f4a300c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:54.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.723+0000 7f4a34a4c700 1 -- 172.21.15.39:0/246255111 >> 172.21.15.39:0/246255111 conn(0x7f4a3006a510 msgr2=0x7f4a300cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:54.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.723+0000 7f4a34a4c700 1 -- 172.21.15.39:0/246255111 shutdown_connections 2023-11-28T11:58:54.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.723+0000 7f4a34a4c700 1 -- 172.21.15.39:0/246255111 wait complete. 2023-11-28T11:58:54.748 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T11:58:54.749 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:58:54.950 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.947+0000 7f60ed430700 1 Processor -- start 2023-11-28T11:58:54.950 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.947+0000 7f60ed430700 1 -- start start 2023-11-28T11:58:54.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.947+0000 7f60ed430700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f60e815a1a0 0x7f60e80b5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:54.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.947+0000 7f60ed430700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f60e80b4120 0x7f60e80cb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:54.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.947+0000 7f60ed430700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e815dd10 con 0x7f60e80b5dc0 2023-11-28T11:58:54.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.947+0000 7f60ed430700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e815e990 con 0x7f60e815a1a0 2023-11-28T11:58:54.952 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.947+0000 7f60ed430700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e815dff0 con 0x7f60e80b4120 2023-11-28T11:58:54.952 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.947+0000 7f60e6ffd700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f60e815a1a0 0x7f60e80b5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:54.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.947+0000 7f60e6ffd700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f60e815a1a0 0x7f60e80b5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43780/0 (socket says 172.21.15.39:43780) 2023-11-28T11:58:54.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.947+0000 7f60e6ffd700 1 -- 172.21.15.39:0/2075671737 learned_addr learned my addr 172.21.15.39:0/2075671737 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:54.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.951+0000 7f60e7fff700 1 --2- 172.21.15.39:0/2075671737 >> v2:172.21.15.184:3300/0 conn(0x7f60e80b4120 0x7f60e80cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:54.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.951+0000 7f60e6ffd700 1 -- 172.21.15.39:0/2075671737 >> v2:172.21.15.184:3300/0 conn(0x7f60e80b4120 msgr2=0x7f60e80cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:54.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.951+0000 7f60e6ffd700 1 --2- 172.21.15.39:0/2075671737 >> v2:172.21.15.184:3300/0 conn(0x7f60e80b4120 0x7f60e80cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:54.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.951+0000 7f60e6ffd700 1 -- 172.21.15.39:0/2075671737 >> v1:172.21.15.184:6789/0 conn(0x7f60e80b5dc0 legacy=0x7f60e80b3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:54.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.951+0000 7f60e6ffd700 1 -- 172.21.15.39:0/2075671737 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e815e2d0 con 0x7f60e815a1a0 2023-11-28T11:58:54.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.951+0000 7f60e6ffd700 1 --2- 172.21.15.39:0/2075671737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60e815a1a0 0x7f60e80b5880 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f60e80ca840 tx=0x7f60d8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee14b073e84a23e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:54.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.951+0000 7f60e5ffb700 1 -- 172.21.15.39:0/2075671737 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d800b8a0 con 0x7f60e815a1a0 2023-11-28T11:58:54.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.951+0000 7f60e5ffb700 1 -- 172.21.15.39:0/2075671737 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d800ba00 con 0x7f60e815a1a0 2023-11-28T11:58:54.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.951+0000 7f60e5ffb700 1 -- 172.21.15.39:0/2075671737 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d800bd90 con 0x7f60e815a1a0 2023-11-28T11:58:54.955 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.951+0000 7f60ed430700 1 -- 172.21.15.39:0/2075671737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60e815a1a0 msgr2=0x7f60e80b5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:54.955 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.951+0000 7f60ed430700 1 --2- 172.21.15.39:0/2075671737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60e815a1a0 0x7f60e80b5880 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f60e80ca840 tx=0x7f60d8009bf0 comp rx=0 tx=0).stop 2023-11-28T11:58:54.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.951+0000 7f60ed430700 1 -- 172.21.15.39:0/2075671737 shutdown_connections 2023-11-28T11:58:54.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.951+0000 7f60ed430700 1 --2- 172.21.15.39:0/2075671737 >> v2:172.21.15.184:3300/0 conn(0x7f60e80b4120 0x7f60e80cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:54.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.951+0000 7f60ed430700 1 --2- 172.21.15.39:0/2075671737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60e815a1a0 0x7f60e80b5880 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:54.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.951+0000 7f60ed430700 1 -- 172.21.15.39:0/2075671737 >> 172.21.15.39:0/2075671737 conn(0x7f60e80ccb30 msgr2=0x7f60e80ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:54.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.951+0000 7f60ed430700 1 -- 172.21.15.39:0/2075671737 shutdown_connections 2023-11-28T11:58:54.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.951+0000 7f60ed430700 1 -- 172.21.15.39:0/2075671737 wait complete. 2023-11-28T11:58:54.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.955+0000 7f60ed430700 1 Processor -- start 2023-11-28T11:58:54.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.955+0000 7f60ed430700 1 -- start start 2023-11-28T11:58:54.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.959+0000 7f60ed430700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f60e80b4120 0x7f60e80c7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:54.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.959+0000 7f60ed430700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60e80b5dc0 0x7f60e814a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:54.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.959+0000 7f60ed430700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60e815a1a0 0x7f60e806c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:54.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.959+0000 7f60ed430700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e814abc0 con 0x7f60e815a1a0 2023-11-28T11:58:54.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.959+0000 7f60ed430700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e806c860 con 0x7f60e80b4120 2023-11-28T11:58:54.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.959+0000 7f60ed430700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e80cf4f0 con 0x7f60e80b5dc0 2023-11-28T11:58:54.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.959+0000 7f60e7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60e815a1a0 0x7f60e806c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:54.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.959+0000 7f60e7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60e815a1a0 0x7f60e806c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43792/0 (socket says 172.21.15.39:43792) 2023-11-28T11:58:54.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.959+0000 7f60e7fff700 1 -- 172.21.15.39:0/682410217 learned_addr learned my addr 172.21.15.39:0/682410217 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:54.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.959+0000 7f60e67fc700 1 --2- 172.21.15.39:0/682410217 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60e80b5dc0 0x7f60e814a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:54.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.959+0000 7f60e6ffd700 1 --2- 172.21.15.39:0/682410217 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f60e80b4120 0x7f60e80c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:54.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.959+0000 7f60e7fff700 1 -- 172.21.15.39:0/682410217 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60e80b5dc0 msgr2=0x7f60e814a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:54.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.959+0000 7f60e7fff700 1 --2- 172.21.15.39:0/682410217 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60e80b5dc0 0x7f60e814a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:54.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.959+0000 7f60e7fff700 1 -- 172.21.15.39:0/682410217 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f60e80b4120 msgr2=0x7f60e80c7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:54.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.959+0000 7f60e7fff700 1 --2- 172.21.15.39:0/682410217 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f60e80b4120 0x7f60e80c7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:54.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.959+0000 7f60e7fff700 1 -- 172.21.15.39:0/682410217 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d8009570 con 0x7f60e815a1a0 2023-11-28T11:58:54.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.959+0000 7f60e7fff700 1 --2- 172.21.15.39:0/682410217 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60e815a1a0 0x7f60e806c320 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f60e0009fd0 tx=0x7f60e000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:54.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.959+0000 7f60cf7fe700 1 -- 172.21.15.39:0/682410217 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e0007ea0 con 0x7f60e815a1a0 2023-11-28T11:58:54.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.959+0000 7f60cf7fe700 1 -- 172.21.15.39:0/682410217 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e000ecd0 con 0x7f60e815a1a0 2023-11-28T11:58:54.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.959+0000 7f60cf7fe700 1 -- 172.21.15.39:0/682410217 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e0014660 con 0x7f60e815a1a0 2023-11-28T11:58:54.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.959+0000 7f60ed430700 1 -- 172.21.15.39:0/682410217 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e8069bf0 con 0x7f60e815a1a0 2023-11-28T11:58:54.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.959+0000 7f60ed430700 1 -- 172.21.15.39:0/682410217 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e815e5b0 con 0x7f60e815a1a0 2023-11-28T11:58:54.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.963+0000 7f60ed430700 1 -- 172.21.15.39:0/682410217 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e80b33d0 con 0x7f60e815a1a0 2023-11-28T11:58:54.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.963+0000 7f60cf7fe700 1 -- 172.21.15.39:0/682410217 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f60e0012050 con 0x7f60e815a1a0 2023-11-28T11:58:54.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.963+0000 7f60cf7fe700 1 --2- 172.21.15.39:0/682410217 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f60d4064ee0 0x7f60d4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:54.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.967+0000 7f60cf7fe700 1 -- 172.21.15.39:0/682410217 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f60e00824d0 con 0x7f60e815a1a0 2023-11-28T11:58:54.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.967+0000 7f60e6ffd700 1 --2- 172.21.15.39:0/682410217 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f60d4064ee0 0x7f60d4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:54.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.967+0000 7f60e6ffd700 1 --2- 172.21.15.39:0/682410217 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f60d4064ee0 0x7f60d4067390 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f60d8000c00 tx=0x7f60d8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:54.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:54.967+0000 7f60cf7fe700 1 -- 172.21.15.39:0/682410217 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f60e0050440 con 0x7f60e815a1a0 2023-11-28T11:58:55.183 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.179+0000 7f60ed430700 1 -- 172.21.15.39:0/682410217 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60e80c99c0 con 0x7f60e815a1a0 2023-11-28T11:58:55.184 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.179+0000 7f60cf7fe700 1 -- 172.21.15.39:0/682410217 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4648 (secure 0 0 0) 0x7f60e0053a60 con 0x7f60e815a1a0 2023-11-28T11:58:55.184 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:58:55.184 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5775,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3453450609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3453450609},{"type":"v1","addr":"172.21.15.39:6833","nonce":3453450609}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/697075022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":697075022},{"type":"v1","addr":"172.21.15.39:6835","nonce":697075022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5806,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1819593136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1819593136},{"type":"v1","addr":"172.21.15.184:6835","nonce":1819593136}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:58:51.635140+0000","modified":"2023-11-28T11:58:54.706764+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5809},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5809":{"gid":5809,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/367294936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":367294936},{"type":"v1","addr":"172.21.15.184:6837","nonce":367294936}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T11:58:55.187 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.183+0000 7f60ed430700 1 -- 172.21.15.39:0/682410217 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f60d4064ee0 msgr2=0x7f60d4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:55.187 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.183+0000 7f60ed430700 1 --2- 172.21.15.39:0/682410217 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f60d4064ee0 0x7f60d4067390 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f60d8000c00 tx=0x7f60d8008030 comp rx=0 tx=0).stop 2023-11-28T11:58:55.187 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.183+0000 7f60ed430700 1 -- 172.21.15.39:0/682410217 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60e815a1a0 msgr2=0x7f60e806c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:55.187 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.183+0000 7f60ed430700 1 --2- 172.21.15.39:0/682410217 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60e815a1a0 0x7f60e806c320 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f60e0009fd0 tx=0x7f60e000e3c0 comp rx=0 tx=0).stop 2023-11-28T11:58:55.187 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.183+0000 7f60ed430700 1 -- 172.21.15.39:0/682410217 shutdown_connections 2023-11-28T11:58:55.187 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.183+0000 7f60ed430700 1 --2- 172.21.15.39:0/682410217 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60e815a1a0 0x7f60e806c320 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:55.187 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.183+0000 7f60ed430700 1 --2- 172.21.15.39:0/682410217 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60e80b5dc0 0x7f60e814a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:55.188 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.183+0000 7f60ed430700 1 --2- 172.21.15.39:0/682410217 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f60d4064ee0 0x7f60d4067390 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:55.188 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.183+0000 7f60ed430700 1 --2- 172.21.15.39:0/682410217 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f60e80b4120 0x7f60e80c7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:55.188 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.183+0000 7f60ed430700 1 -- 172.21.15.39:0/682410217 >> 172.21.15.39:0/682410217 conn(0x7f60e80ccb30 msgr2=0x7f60e80b1840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:55.188 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.183+0000 7f60ed430700 1 -- 172.21.15.39:0/682410217 shutdown_connections 2023-11-28T11:58:55.188 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.183+0000 7f60ed430700 1 -- 172.21.15.39:0/682410217 wait complete. 2023-11-28T11:58:55.190 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 24 2023-11-28T11:58:55.208 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:58:55.378 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.375+0000 7f0fe8eab700 1 Processor -- start 2023-11-28T11:58:55.379 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.375+0000 7f0fe8eab700 1 -- start start 2023-11-28T11:58:55.381 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.379+0000 7f0fe8eab700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fe4071aa0 0x7f0fe406d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:55.382 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.379+0000 7f0fe8eab700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f0fe4069e00 0x7f0fe406a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:55.382 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.379+0000 7f0fe8eab700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fe406c600 con 0x7f0fe415c640 2023-11-28T11:58:55.382 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.379+0000 7f0fe8eab700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fe406cef0 con 0x7f0fe4069e00 2023-11-28T11:58:55.382 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.379+0000 7f0fe8eab700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe40d38f0 con 0x7f0fe4071aa0 2023-11-28T11:58:55.383 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.379+0000 7f0fe37fe700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f0fe415c640 0x7f0fe40d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42382/0 (socket says 172.21.15.39:42382) 2023-11-28T11:58:55.383 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.379+0000 7f0fe37fe700 1 -- 172.21.15.39:0/1588734692 learned_addr learned my addr 172.21.15.39:0/1588734692 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:58:55.383 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.379+0000 7f0fe2ffd700 1 --2- 172.21.15.39:0/1588734692 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fe4071aa0 0x7f0fe406d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:55.383 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.379+0000 7f0fe3fff700 1 --2- 172.21.15.39:0/1588734692 >> v2:172.21.15.184:3300/0 conn(0x7f0fe4069e00 0x7f0fe406a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:55.383 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.379+0000 7f0fe27fc700 1 -- 172.21.15.39:0/1588734692 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1406023439 0 0) 0x7f0fe406c600 con 0x7f0fe415c640 2023-11-28T11:58:55.383 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.379+0000 7f0fe27fc700 1 -- 172.21.15.39:0/1588734692 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fcc0035d0 con 0x7f0fe415c640 2023-11-28T11:58:55.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.379+0000 7f0fe2ffd700 1 -- 172.21.15.39:0/1588734692 >> v2:172.21.15.184:3300/0 conn(0x7f0fe4069e00 msgr2=0x7f0fe406a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:55.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.379+0000 7f0fe2ffd700 1 --2- 172.21.15.39:0/1588734692 >> v2:172.21.15.184:3300/0 conn(0x7f0fe4069e00 0x7f0fe406a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:55.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.379+0000 7f0fe2ffd700 1 -- 172.21.15.39:0/1588734692 >> v1:172.21.15.39:6789/0 conn(0x7f0fe415c640 legacy=0x7f0fe40d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:55.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.379+0000 7f0fe2ffd700 1 -- 172.21.15.39:0/1588734692 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe40722f0 con 0x7f0fe4071aa0 2023-11-28T11:58:55.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.379+0000 7f0fe2ffd700 1 --2- 172.21.15.39:0/1588734692 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fe4071aa0 0x7f0fe406d310 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0fd8009850 tx=0x7f0fd8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2c8aa595d2fcef3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:55.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.383+0000 7f0fe27fc700 1 -- 172.21.15.39:0/1588734692 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd8011830 con 0x7f0fe4071aa0 2023-11-28T11:58:55.385 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.383+0000 7f0fe27fc700 1 -- 172.21.15.39:0/1588734692 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd8011990 con 0x7f0fe4071aa0 2023-11-28T11:58:55.385 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.383+0000 7f0fe27fc700 1 -- 172.21.15.39:0/1588734692 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd8011d40 con 0x7f0fe4071aa0 2023-11-28T11:58:55.386 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.383+0000 7f0fe8eab700 1 -- 172.21.15.39:0/1588734692 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fe4071aa0 msgr2=0x7f0fe406d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:55.386 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.383+0000 7f0fe8eab700 1 --2- 172.21.15.39:0/1588734692 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fe4071aa0 0x7f0fe406d310 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0fd8009850 tx=0x7f0fd8009b60 comp rx=0 tx=0).stop 2023-11-28T11:58:55.386 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.383+0000 7f0fe8eab700 1 -- 172.21.15.39:0/1588734692 shutdown_connections 2023-11-28T11:58:55.386 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.383+0000 7f0fe8eab700 1 --2- 172.21.15.39:0/1588734692 >> v2:172.21.15.184:3300/0 conn(0x7f0fe4069e00 0x7f0fe406a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:55.386 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.383+0000 7f0fe8eab700 1 --2- 172.21.15.39:0/1588734692 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fe4071aa0 0x7f0fe406d310 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:55.386 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.383+0000 7f0fe8eab700 1 -- 172.21.15.39:0/1588734692 >> 172.21.15.39:0/1588734692 conn(0x7f0fe40b6520 msgr2=0x7f0fe4071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:55.386 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.383+0000 7f0fe8eab700 1 -- 172.21.15.39:0/1588734692 shutdown_connections 2023-11-28T11:58:55.386 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.383+0000 7f0fe8eab700 1 -- 172.21.15.39:0/1588734692 wait complete. 2023-11-28T11:58:55.387 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.383+0000 7f0fe8eab700 1 Processor -- start 2023-11-28T11:58:55.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.383+0000 7f0fe8eab700 1 -- start start 2023-11-28T11:58:55.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.387+0000 7f0fe8eab700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0fe4069e00 0x7f0fe40c6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:55.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.387+0000 7f0fe8eab700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fe4071aa0 0x7f0fe40c7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:55.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.387+0000 7f0fe8eab700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fe415c640 0x7f0fe415e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:55.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.387+0000 7f0fe8eab700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe415e390 con 0x7f0fe4069e00 2023-11-28T11:58:55.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.387+0000 7f0fe8eab700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe415dac0 con 0x7f0fe415c640 2023-11-28T11:58:55.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.387+0000 7f0fe8eab700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe415cd20 con 0x7f0fe4071aa0 2023-11-28T11:58:55.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.387+0000 7f0fe37fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0fe4069e00 0x7f0fe40c6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:55.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.387+0000 7f0fe37fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0fe4069e00 0x7f0fe40c6e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43794/0 (socket says 172.21.15.39:43794) 2023-11-28T11:58:55.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.387+0000 7f0fe37fe700 1 -- 172.21.15.39:0/590630288 learned_addr learned my addr 172.21.15.39:0/590630288 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:55.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.387+0000 7f0fe2ffd700 1 --2- 172.21.15.39:0/590630288 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fe4071aa0 0x7f0fe40c7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:55.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.387+0000 7f0fe3fff700 1 --2- 172.21.15.39:0/590630288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fe415c640 0x7f0fe415e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:55.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.387+0000 7f0fe37fe700 1 -- 172.21.15.39:0/590630288 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fe4071aa0 msgr2=0x7f0fe40c7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:55.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.387+0000 7f0fe37fe700 1 --2- 172.21.15.39:0/590630288 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fe4071aa0 0x7f0fe40c7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:55.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.387+0000 7f0fe37fe700 1 -- 172.21.15.39:0/590630288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fe415c640 msgr2=0x7f0fe415e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:55.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.387+0000 7f0fe37fe700 1 --2- 172.21.15.39:0/590630288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fe415c640 0x7f0fe415e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:55.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.387+0000 7f0fe37fe700 1 -- 172.21.15.39:0/590630288 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd80094b0 con 0x7f0fe4069e00 2023-11-28T11:58:55.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.387+0000 7f0fe3fff700 1 --2- 172.21.15.39:0/590630288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fe415c640 0x7f0fe415e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:58:55.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.387+0000 7f0fe37fe700 1 --2- 172.21.15.39:0/590630288 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0fe4069e00 0x7f0fe40c6e40 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f0fd400c700 tx=0x7f0fd400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:55.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.387+0000 7f0fcbfff700 1 -- 172.21.15.39:0/590630288 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd4005d90 con 0x7f0fe4069e00 2023-11-28T11:58:55.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.387+0000 7f0fcbfff700 1 -- 172.21.15.39:0/590630288 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd40070d0 con 0x7f0fe4069e00 2023-11-28T11:58:55.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.387+0000 7f0fe8eab700 1 -- 172.21.15.39:0/590630288 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fe4072010 con 0x7f0fe4069e00 2023-11-28T11:58:55.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.387+0000 7f0fcbfff700 1 -- 172.21.15.39:0/590630288 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd4007480 con 0x7f0fe4069e00 2023-11-28T11:58:55.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.387+0000 7f0fe8eab700 1 -- 172.21.15.39:0/590630288 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fe415ca10 con 0x7f0fe4069e00 2023-11-28T11:58:55.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.391+0000 7f0fe8eab700 1 -- 172.21.15.39:0/590630288 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fe406c830 con 0x7f0fe4069e00 2023-11-28T11:58:55.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.391+0000 7f0fcbfff700 1 -- 172.21.15.39:0/590630288 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0fd4019030 con 0x7f0fe4069e00 2023-11-28T11:58:55.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.391+0000 7f0fcbfff700 1 --2- 172.21.15.39:0/590630288 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0fd0064ee0 0x7f0fd0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:55.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.391+0000 7f0fcbfff700 1 -- 172.21.15.39:0/590630288 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0fd40814b0 con 0x7f0fe4069e00 2023-11-28T11:58:55.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.395+0000 7f0fe2ffd700 1 --2- 172.21.15.39:0/590630288 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0fd0064ee0 0x7f0fd0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:55.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.395+0000 7f0fe2ffd700 1 --2- 172.21.15.39:0/590630288 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0fd0064ee0 0x7f0fd0067390 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0fd80090b0 tx=0x7f0fd801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:55.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.399+0000 7f0fcbfff700 1 -- 172.21.15.39:0/590630288 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0fd404f420 con 0x7f0fe4069e00 2023-11-28T11:58:55.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.579+0000 7f0fe8eab700 1 -- 172.21.15.39:0/590630288 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0fe40d27b0 con 0x7f0fe4069e00 2023-11-28T11:58:55.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.579+0000 7f0fcbfff700 1 -- 172.21.15.39:0/590630288 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+18084 (secure 0 0 0) 0x7f0fd4052a40 con 0x7f0fe4069e00 2023-11-28T11:58:55.584 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:58:55.584 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":58,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:58:52.640486+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:58:50.082546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-28T11:58:50.610241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:58:55.587 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.583+0000 7f0fe8eab700 1 -- 172.21.15.39:0/590630288 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0fd0064ee0 msgr2=0x7f0fd0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:55.587 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.583+0000 7f0fe8eab700 1 --2- 172.21.15.39:0/590630288 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0fd0064ee0 0x7f0fd0067390 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0fd80090b0 tx=0x7f0fd801c040 comp rx=0 tx=0).stop 2023-11-28T11:58:55.587 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.583+0000 7f0fe8eab700 1 -- 172.21.15.39:0/590630288 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0fe4069e00 msgr2=0x7f0fe40c6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:55.587 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.583+0000 7f0fe8eab700 1 --2- 172.21.15.39:0/590630288 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0fe4069e00 0x7f0fe40c6e40 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f0fd400c700 tx=0x7f0fd400ca10 comp rx=0 tx=0).stop 2023-11-28T11:58:55.588 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.583+0000 7f0fe8eab700 1 -- 172.21.15.39:0/590630288 shutdown_connections 2023-11-28T11:58:55.588 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.583+0000 7f0fe8eab700 1 --2- 172.21.15.39:0/590630288 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0fd0064ee0 0x7f0fd0067390 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:55.588 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.583+0000 7f0fe8eab700 1 --2- 172.21.15.39:0/590630288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fe415c640 0x7f0fe415e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:55.588 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.583+0000 7f0fe8eab700 1 --2- 172.21.15.39:0/590630288 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fe4071aa0 0x7f0fe40c7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:55.588 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.583+0000 7f0fe8eab700 1 --2- 172.21.15.39:0/590630288 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0fe4069e00 0x7f0fe40c6e40 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:55.588 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.583+0000 7f0fe8eab700 1 -- 172.21.15.39:0/590630288 >> 172.21.15.39:0/590630288 conn(0x7f0fe40b6520 msgr2=0x7f0fe40d1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:55.588 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.583+0000 7f0fe8eab700 1 -- 172.21.15.39:0/590630288 shutdown_connections 2023-11-28T11:58:55.588 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.583+0000 7f0fe8eab700 1 -- 172.21.15.39:0/590630288 wait complete. 2023-11-28T11:58:55.610 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T11:58:55.610 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:58:55.782 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.779+0000 7ff14661e700 1 Processor -- start 2023-11-28T11:58:55.782 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.779+0000 7ff14661e700 1 -- start start 2023-11-28T11:58:55.785 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.783+0000 7ff14661e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1400c8d10 0x7ff1400cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:55.786 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.783+0000 7ff14661e700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff14015a850 con 0x7ff14015a480 2023-11-28T11:58:55.786 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.783+0000 7ff14661e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1400cada0 con 0x7ff140069d60 2023-11-28T11:58:55.786 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.783+0000 7ff14661e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1400ce060 con 0x7ff1400c8d10 2023-11-28T11:58:55.786 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.783+0000 7ff13ffff700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7ff14015a480 0x7ff1400cc290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42384/0 (socket says 172.21.15.39:42384) 2023-11-28T11:58:55.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.783+0000 7ff13ffff700 1 -- 172.21.15.39:0/3406999906 learned_addr learned my addr 172.21.15.39:0/3406999906 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:58:55.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.783+0000 7ff1377fe700 1 --2- 172.21.15.39:0/3406999906 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1400c8d10 0x7ff1400cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:55.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.783+0000 7ff13f7fe700 1 -- 172.21.15.39:0/3406999906 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2119031039 0 0) 0x7ff14015a850 con 0x7ff14015a480 2023-11-28T11:58:55.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.783+0000 7ff13f7fe700 1 -- 172.21.15.39:0/3406999906 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff12c0035d0 con 0x7ff14015a480 2023-11-28T11:58:55.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.783+0000 7ff1377fe700 1 -- 172.21.15.39:0/3406999906 >> v1:172.21.15.184:6789/0 conn(0x7ff140069d60 legacy=0x7ff14006a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:55.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.783+0000 7ff1377fe700 1 -- 172.21.15.39:0/3406999906 >> v1:172.21.15.39:6789/0 conn(0x7ff14015a480 legacy=0x7ff1400cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:55.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.783+0000 7ff1377fe700 1 -- 172.21.15.39:0/3406999906 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1400ce300 con 0x7ff1400c8d10 2023-11-28T11:58:55.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.787+0000 7ff1377fe700 1 --2- 172.21.15.39:0/3406999906 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1400c8d10 0x7ff1400cc9a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff128009880 tx=0x7ff128009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22d0b2e15bdd7f0c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:55.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.787+0000 7ff13f7fe700 1 -- 172.21.15.39:0/3406999906 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff128011830 con 0x7ff1400c8d10 2023-11-28T11:58:55.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.787+0000 7ff13f7fe700 1 -- 172.21.15.39:0/3406999906 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff128011990 con 0x7ff1400c8d10 2023-11-28T11:58:55.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.787+0000 7ff13f7fe700 1 -- 172.21.15.39:0/3406999906 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff128011d20 con 0x7ff1400c8d10 2023-11-28T11:58:55.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.787+0000 7ff14661e700 1 -- 172.21.15.39:0/3406999906 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1400c8d10 msgr2=0x7ff1400cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:55.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.787+0000 7ff14661e700 1 --2- 172.21.15.39:0/3406999906 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1400c8d10 0x7ff1400cc9a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff128009880 tx=0x7ff128009b90 comp rx=0 tx=0).stop 2023-11-28T11:58:55.791 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.787+0000 7ff14661e700 1 -- 172.21.15.39:0/3406999906 shutdown_connections 2023-11-28T11:58:55.791 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.787+0000 7ff14661e700 1 --2- 172.21.15.39:0/3406999906 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1400c8d10 0x7ff1400cc9a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:55.791 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.787+0000 7ff14661e700 1 -- 172.21.15.39:0/3406999906 >> 172.21.15.39:0/3406999906 conn(0x7ff1400cf350 msgr2=0x7ff1400b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:55.791 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.787+0000 7ff14661e700 1 -- 172.21.15.39:0/3406999906 shutdown_connections 2023-11-28T11:58:55.791 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.787+0000 7ff14661e700 1 -- 172.21.15.39:0/3406999906 wait complete. 2023-11-28T11:58:55.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.791+0000 7ff14661e700 1 Processor -- start 2023-11-28T11:58:55.794 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.791+0000 7ff14661e700 1 -- start start 2023-11-28T11:58:55.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.791+0000 7ff14661e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff140069d60 0x7ff1401f18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:55.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.791+0000 7ff14661e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1400c8d10 0x7ff14015c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:55.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.791+0000 7ff14661e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff14015a480 0x7ff1400ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:55.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.791+0000 7ff14661e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff140154460 con 0x7ff140069d60 2023-11-28T11:58:55.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.791+0000 7ff14661e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1400b2920 con 0x7ff1400c8d10 2023-11-28T11:58:55.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.791+0000 7ff14661e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1400b2c00 con 0x7ff14015a480 2023-11-28T11:58:55.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.795+0000 7ff13ffff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff140069d60 0x7ff1401f18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:55.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.795+0000 7ff13ffff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff140069d60 0x7ff1401f18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43798/0 (socket says 172.21.15.39:43798) 2023-11-28T11:58:55.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.795+0000 7ff13ffff700 1 -- 172.21.15.39:0/1437002930 learned_addr learned my addr 172.21.15.39:0/1437002930 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:55.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.795+0000 7ff1377fe700 1 --2- 172.21.15.39:0/1437002930 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1400c8d10 0x7ff14015c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:55.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.795+0000 7ff144bbb700 1 --2- 172.21.15.39:0/1437002930 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff14015a480 0x7ff1400ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:55.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.795+0000 7ff13ffff700 1 -- 172.21.15.39:0/1437002930 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff14015a480 msgr2=0x7ff1400ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:55.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.795+0000 7ff13ffff700 1 --2- 172.21.15.39:0/1437002930 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff14015a480 0x7ff1400ccce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:55.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.795+0000 7ff13ffff700 1 -- 172.21.15.39:0/1437002930 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1400c8d10 msgr2=0x7ff14015c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:55.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.795+0000 7ff13ffff700 1 --2- 172.21.15.39:0/1437002930 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1400c8d10 0x7ff14015c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:55.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.795+0000 7ff13ffff700 1 -- 172.21.15.39:0/1437002930 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1280094b0 con 0x7ff140069d60 2023-11-28T11:58:55.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.795+0000 7ff13ffff700 1 --2- 172.21.15.39:0/1437002930 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff140069d60 0x7ff1401f18a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff13000cbc0 tx=0x7ff13000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:55.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.795+0000 7ff13d7fa700 1 -- 172.21.15.39:0/1437002930 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13000a770 con 0x7ff140069d60 2023-11-28T11:58:55.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.795+0000 7ff13d7fa700 1 -- 172.21.15.39:0/1437002930 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13000a8d0 con 0x7ff140069d60 2023-11-28T11:58:55.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.795+0000 7ff13d7fa700 1 -- 172.21.15.39:0/1437002930 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13000ac60 con 0x7ff140069d60 2023-11-28T11:58:55.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.795+0000 7ff14661e700 1 -- 172.21.15.39:0/1437002930 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1400add50 con 0x7ff140069d60 2023-11-28T11:58:55.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.795+0000 7ff14661e700 1 -- 172.21.15.39:0/1437002930 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1400caa30 con 0x7ff140069d60 2023-11-28T11:58:55.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.799+0000 7ff14661e700 1 -- 172.21.15.39:0/1437002930 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1400ca6e0 con 0x7ff140069d60 2023-11-28T11:58:55.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.799+0000 7ff13d7fa700 1 -- 172.21.15.39:0/1437002930 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff130019030 con 0x7ff140069d60 2023-11-28T11:58:55.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.803+0000 7ff13d7fa700 1 --2- 172.21.15.39:0/1437002930 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff120064ee0 0x7ff120067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:55.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.803+0000 7ff13d7fa700 1 -- 172.21.15.39:0/1437002930 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff1300819c0 con 0x7ff140069d60 2023-11-28T11:58:55.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.803+0000 7ff1377fe700 1 --2- 172.21.15.39:0/1437002930 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff120064ee0 0x7ff120067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:55.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.803+0000 7ff1377fe700 1 --2- 172.21.15.39:0/1437002930 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff120064ee0 0x7ff120067390 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff128000c00 tx=0x7ff12801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:55.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.807+0000 7ff13d7fa700 1 -- 172.21.15.39:0/1437002930 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff13004f930 con 0x7ff140069d60 2023-11-28T11:58:55.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.979+0000 7ff14661e700 1 -- 172.21.15.39:0/1437002930 --> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff1400b2d70 con 0x7ff120064ee0 2023-11-28T11:58:56.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:55.999+0000 7ff13d7fa700 1 -- 172.21.15.39:0/1437002930 <== mgr.4104 v2:172.21.15.184:6832/36166 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303928 (secure 0 0 0) 0x7ff1400b2d70 con 0x7ff120064ee0 2023-11-28T11:58:56.010 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:58:56.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.007+0000 7ff14661e700 1 -- 172.21.15.39:0/1437002930 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff120064ee0 msgr2=0x7ff120067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:56.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.007+0000 7ff14661e700 1 --2- 172.21.15.39:0/1437002930 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff120064ee0 0x7ff120067390 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff128000c00 tx=0x7ff12801c040 comp rx=0 tx=0).stop 2023-11-28T11:58:56.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.007+0000 7ff14661e700 1 -- 172.21.15.39:0/1437002930 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff140069d60 msgr2=0x7ff1401f18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:56.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.007+0000 7ff14661e700 1 --2- 172.21.15.39:0/1437002930 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff140069d60 0x7ff1401f18a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff13000cbc0 tx=0x7ff13000cbf0 comp rx=0 tx=0).stop 2023-11-28T11:58:56.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.007+0000 7ff14661e700 1 -- 172.21.15.39:0/1437002930 shutdown_connections 2023-11-28T11:58:56.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.007+0000 7ff14661e700 1 --2- 172.21.15.39:0/1437002930 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff14015a480 0x7ff1400ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:56.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.007+0000 7ff14661e700 1 --2- 172.21.15.39:0/1437002930 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff120064ee0 0x7ff120067390 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:56.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.007+0000 7ff14661e700 1 --2- 172.21.15.39:0/1437002930 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1400c8d10 0x7ff14015c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:56.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.007+0000 7ff14661e700 1 --2- 172.21.15.39:0/1437002930 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff140069d60 0x7ff1401f18a0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:56.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.007+0000 7ff14661e700 1 -- 172.21.15.39:0/1437002930 >> 172.21.15.39:0/1437002930 conn(0x7ff1400cf350 msgr2=0x7ff14015de70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:56.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.007+0000 7ff14661e700 1 -- 172.21.15.39:0/1437002930 shutdown_connections 2023-11-28T11:58:56.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.007+0000 7ff14661e700 1 -- 172.21.15.39:0/1437002930 wait complete. 2023-11-28T11:58:56.016 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2023-11-28T11:58:56.034 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":126,"stamp":"2023-11-28T11:58:54.598816+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590458,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":175,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":178,"acting":178,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":44,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":79248,"kb_used_data":6224,"kb_used_omap":0,"kb_used_meta":72960,"kb_avail":754895472,"statfs":{"total":773094113280,"available":773012963328,"internally_reserved":0,"allocated":6373376,"data_stored":3534633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":74711040},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":90,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.460036"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:51.137570+0000","last_change":"2023-11-28T11:58:51.137570+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.137570+0000","last_undegraded":"2023-11-28T11:58:51.137570+0000","last_fullsized":"2023-11-28T11:58:51.137570+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.180906+0000","last_change":"2023-11-28T11:58:51.180906+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.180906+0000","last_undegraded":"2023-11-28T11:58:51.180906+0000","last_fullsized":"2023-11-28T11:58:51.180906+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:47:10.246224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.662021+0000","last_change":"2023-11-28T11:58:51.662021+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.662021+0000","last_undegraded":"2023-11-28T11:58:51.662021+0000","last_fullsized":"2023-11-28T11:58:51.662021+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:53:49.319201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.656796+0000","last_change":"2023-11-28T11:58:51.656796+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.656796+0000","last_undegraded":"2023-11-28T11:58:51.656796+0000","last_fullsized":"2023-11-28T11:58:51.656796+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:37:13.495875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:51.137570+0000","last_change":"2023-11-28T11:58:51.137570+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.137570+0000","last_undegraded":"2023-11-28T11:58:51.137570+0000","last_fullsized":"2023-11-28T11:58:51.137570+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:51.137570+0000","last_change":"2023-11-28T11:58:51.137570+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.137570+0000","last_undegraded":"2023-11-28T11:58:51.137570+0000","last_fullsized":"2023-11-28T11:58:51.137570+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.167375+0000","last_change":"2023-11-28T11:58:51.167375+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.167375+0000","last_undegraded":"2023-11-28T11:58:51.167375+0000","last_fullsized":"2023-11-28T11:58:51.167375+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:23:30.095986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.181470+0000","last_change":"2023-11-28T11:58:51.181470+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.181470+0000","last_undegraded":"2023-11-28T11:58:51.181470+0000","last_fullsized":"2023-11-28T11:58:51.181470+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:04:34.153300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.166525+0000","last_change":"2023-11-28T11:58:51.166525+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.166525+0000","last_undegraded":"2023-11-28T11:58:51.166525+0000","last_fullsized":"2023-11-28T11:58:51.166525+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:37:13.495875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.176434+0000","last_change":"2023-11-28T11:58:51.176434+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.176434+0000","last_undegraded":"2023-11-28T11:58:51.176434+0000","last_fullsized":"2023-11-28T11:58:51.176434+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:04:56.514139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.176265+0000","last_change":"2023-11-28T11:58:51.176265+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.176265+0000","last_undegraded":"2023-11-28T11:58:51.176265+0000","last_fullsized":"2023-11-28T11:58:51.176265+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:22.086240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.657117+0000","last_change":"2023-11-28T11:58:51.657117+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.657117+0000","last_undegraded":"2023-11-28T11:58:51.657117+0000","last_fullsized":"2023-11-28T11:58:51.657117+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:05:25.321914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.649448+0000","last_change":"2023-11-28T11:58:51.649448+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.649448+0000","last_undegraded":"2023-11-28T11:58:51.649448+0000","last_fullsized":"2023-11-28T11:58:51.649448+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:47:19.620359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":["6","0"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.167346+0000","last_change":"2023-11-28T11:58:51.167346+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.167346+0000","last_undegraded":"2023-11-28T11:58:51.167346+0000","last_fullsized":"2023-11-28T11:58:51.167346+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:20:26.402257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.166897+0000","last_change":"2023-11-28T11:58:51.166897+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.166897+0000","last_undegraded":"2023-11-28T11:58:51.166897+0000","last_fullsized":"2023-11-28T11:58:51.166897+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:31:57.919489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:51.137570+0000","last_change":"2023-11-28T11:58:51.137570+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.137570+0000","last_undegraded":"2023-11-28T11:58:51.137570+0000","last_fullsized":"2023-11-28T11:58:51.137570+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.180775+0000","last_change":"2023-11-28T11:58:51.180775+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.180775+0000","last_undegraded":"2023-11-28T11:58:51.180775+0000","last_fullsized":"2023-11-28T11:58:51.180775+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:21:34.475958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.660726+0000","last_change":"2023-11-28T11:58:51.660726+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.660726+0000","last_undegraded":"2023-11-28T11:58:51.660726+0000","last_fullsized":"2023-11-28T11:58:51.660726+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:05:25.321914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":["7","0"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:51.137570+0000","last_change":"2023-11-28T11:58:51.137570+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.137570+0000","last_undegraded":"2023-11-28T11:58:51.137570+0000","last_fullsized":"2023-11-28T11:58:51.137570+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.177158+0000","last_change":"2023-11-28T11:58:51.177158+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.177158+0000","last_undegraded":"2023-11-28T11:58:51.177158+0000","last_fullsized":"2023-11-28T11:58:51.177158+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:23:19.193646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.659009+0000","last_change":"2023-11-28T11:58:51.659009+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.659009+0000","last_undegraded":"2023-11-28T11:58:51.659009+0000","last_fullsized":"2023-11-28T11:58:51.659009+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:28:12.186813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.177078+0000","last_change":"2023-11-28T11:58:51.177078+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.177078+0000","last_undegraded":"2023-11-28T11:58:51.177078+0000","last_fullsized":"2023-11-28T11:58:51.177078+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:48:03.508051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.659105+0000","last_change":"2023-11-28T11:58:51.659105+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.659105+0000","last_undegraded":"2023-11-28T11:58:51.659105+0000","last_fullsized":"2023-11-28T11:58:51.659105+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:36:20.149308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.648893+0000","last_change":"2023-11-28T11:58:51.648893+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.648893+0000","last_undegraded":"2023-11-28T11:58:51.648893+0000","last_fullsized":"2023-11-28T11:58:51.648893+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:22.086240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":["6","0"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:51.137570+0000","last_change":"2023-11-28T11:58:51.137570+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.137570+0000","last_undegraded":"2023-11-28T11:58:51.137570+0000","last_fullsized":"2023-11-28T11:58:51.137570+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.656897+0000","last_change":"2023-11-28T11:58:51.656897+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.656897+0000","last_undegraded":"2023-11-28T11:58:51.656897+0000","last_fullsized":"2023-11-28T11:58:51.656897+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:03:49.327209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":["5","4"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:51.137570+0000","last_change":"2023-11-28T11:58:51.137570+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.137570+0000","last_undegraded":"2023-11-28T11:58:51.137570+0000","last_fullsized":"2023-11-28T11:58:51.137570+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:51.137570+0000","last_change":"2023-11-28T11:58:51.137570+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.137570+0000","last_undegraded":"2023-11-28T11:58:51.137570+0000","last_fullsized":"2023-11-28T11:58:51.137570+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.172715+0000","last_change":"2023-11-28T11:58:51.172715+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.172715+0000","last_undegraded":"2023-11-28T11:58:51.172715+0000","last_fullsized":"2023-11-28T11:58:51.172715+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:42:12.056606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.659077+0000","last_change":"2023-11-28T11:58:51.659077+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.659077+0000","last_undegraded":"2023-11-28T11:58:51.659077+0000","last_fullsized":"2023-11-28T11:58:51.659077+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:37:13.495875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:51.137570+0000","last_change":"2023-11-28T11:58:51.137570+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.137570+0000","last_undegraded":"2023-11-28T11:58:51.137570+0000","last_fullsized":"2023-11-28T11:58:51.137570+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:51.137570+0000","last_change":"2023-11-28T11:58:51.137570+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.137570+0000","last_undegraded":"2023-11-28T11:58:51.137570+0000","last_fullsized":"2023-11-28T11:58:51.137570+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:51.137570+0000","last_change":"2023-11-28T11:58:51.137570+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.137570+0000","last_undegraded":"2023-11-28T11:58:51.137570+0000","last_fullsized":"2023-11-28T11:58:51.137570+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2023-11-28T11:58:50.151179+0000","last_change":"2023-11-28T11:58:50.151179+0000","last_active":"2023-11-28T11:58:50.115927+0000","last_peered":"2023-11-28T11:58:50.115927+0000","last_clean":"2023-11-28T11:58:50.115927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:50.151179+0000","last_undegraded":"2023-11-28T11:58:50.151179+0000","last_fullsized":"2023-11-28T11:58:50.151179+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:53:15.246374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.175693+0000","last_change":"2023-11-28T11:58:51.175693+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.175693+0000","last_undegraded":"2023-11-28T11:58:51.175693+0000","last_fullsized":"2023-11-28T11:58:51.175693+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:36:59.737858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.190539+0000","last_change":"2023-11-28T11:58:51.177136+0000","last_active":"2023-11-28T11:58:51.190539+0000","last_peered":"2023-11-28T11:58:51.190539+0000","last_clean":"2023-11-28T11:58:51.190539+0000","last_became_active":"2023-11-28T11:58:51.176824+0000","last_became_peered":"2023-11-28T11:58:51.176824+0000","last_unstale":"2023-11-28T11:58:51.190539+0000","last_undegraded":"2023-11-28T11:58:51.190539+0000","last_fullsized":"2023-11-28T11:58:51.190539+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:32:18.747280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:51.137570+0000","last_change":"2023-11-28T11:58:51.137570+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.137570+0000","last_undegraded":"2023-11-28T11:58:51.137570+0000","last_fullsized":"2023-11-28T11:58:51.137570+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2023-11-28T11:58:50.152421+0000","last_change":"2023-11-28T11:58:50.152421+0000","last_active":"2023-11-28T11:58:50.115927+0000","last_peered":"2023-11-28T11:58:50.115927+0000","last_clean":"2023-11-28T11:58:50.115927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:50.152421+0000","last_undegraded":"2023-11-28T11:58:50.152421+0000","last_fullsized":"2023-11-28T11:58:50.152421+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:16:05.197854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:51.137570+0000","last_change":"2023-11-28T11:58:51.137570+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.137570+0000","last_undegraded":"2023-11-28T11:58:51.137570+0000","last_fullsized":"2023-11-28T11:58:51.137570+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.183323+0000","last_change":"2023-11-28T11:58:51.179001+0000","last_active":"2023-11-28T11:58:51.183323+0000","last_peered":"2023-11-28T11:58:51.183323+0000","last_clean":"2023-11-28T11:58:51.183323+0000","last_became_active":"2023-11-28T11:58:51.178671+0000","last_became_peered":"2023-11-28T11:58:51.178671+0000","last_unstale":"2023-11-28T11:58:51.183323+0000","last_undegraded":"2023-11-28T11:58:51.183323+0000","last_fullsized":"2023-11-28T11:58:51.183323+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:48:41.050307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.172305+0000","last_change":"2023-11-28T11:58:51.172305+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.172305+0000","last_undegraded":"2023-11-28T11:58:51.172305+0000","last_fullsized":"2023-11-28T11:58:51.172305+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:31:00.537286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.193474+0000","last_change":"2023-11-28T11:58:51.192459+0000","last_active":"2023-11-28T11:58:51.193474+0000","last_peered":"2023-11-28T11:58:51.193474+0000","last_clean":"2023-11-28T11:58:51.193474+0000","last_became_active":"2023-11-28T11:58:51.192125+0000","last_became_peered":"2023-11-28T11:58:51.192125+0000","last_unstale":"2023-11-28T11:58:51.193474+0000","last_undegraded":"2023-11-28T11:58:51.193474+0000","last_fullsized":"2023-11-28T11:58:51.193474+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:25:16.499893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.172180+0000","last_change":"2023-11-28T11:58:51.172180+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.172180+0000","last_undegraded":"2023-11-28T11:58:51.172180+0000","last_fullsized":"2023-11-28T11:58:51.172180+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:21:32.139383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2023-11-28T11:58:50.149018+0000","last_change":"2023-11-28T11:58:50.149018+0000","last_active":"2023-11-28T11:58:50.115927+0000","last_peered":"2023-11-28T11:58:50.115927+0000","last_clean":"2023-11-28T11:58:50.115927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:50.149018+0000","last_undegraded":"2023-11-28T11:58:50.149018+0000","last_fullsized":"2023-11-28T11:58:50.149018+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:08:06.627993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.648861+0000","last_change":"2023-11-28T11:58:51.648861+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.648861+0000","last_undegraded":"2023-11-28T11:58:51.648861+0000","last_fullsized":"2023-11-28T11:58:51.648861+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:04:56.514139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":["6","7"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.180871+0000","last_change":"2023-11-28T11:58:51.176988+0000","last_active":"2023-11-28T11:58:51.180871+0000","last_peered":"2023-11-28T11:58:51.180871+0000","last_clean":"2023-11-28T11:58:51.180871+0000","last_became_active":"2023-11-28T11:58:51.176713+0000","last_became_peered":"2023-11-28T11:58:51.176713+0000","last_unstale":"2023-11-28T11:58:51.180871+0000","last_undegraded":"2023-11-28T11:58:51.180871+0000","last_fullsized":"2023-11-28T11:58:51.180871+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:27:32.752868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.172332+0000","last_change":"2023-11-28T11:58:51.172332+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.172332+0000","last_undegraded":"2023-11-28T11:58:51.172332+0000","last_fullsized":"2023-11-28T11:58:51.172332+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:12:51.007363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.185539+0000","last_change":"2023-11-28T11:58:51.184233+0000","last_active":"2023-11-28T11:58:51.185539+0000","last_peered":"2023-11-28T11:58:51.185539+0000","last_clean":"2023-11-28T11:58:51.185539+0000","last_became_active":"2023-11-28T11:58:51.183942+0000","last_became_peered":"2023-11-28T11:58:51.183942+0000","last_unstale":"2023-11-28T11:58:51.185539+0000","last_undegraded":"2023-11-28T11:58:51.185539+0000","last_fullsized":"2023-11-28T11:58:51.185539+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:36:19.127665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.166354+0000","last_change":"2023-11-28T11:58:51.166354+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.166354+0000","last_undegraded":"2023-11-28T11:58:51.166354+0000","last_fullsized":"2023-11-28T11:58:51.166354+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:16:01.044656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.661726+0000","last_change":"2023-11-28T11:58:51.176310+0000","last_active":"2023-11-28T11:58:51.661726+0000","last_peered":"2023-11-28T11:58:51.661726+0000","last_clean":"2023-11-28T11:58:51.661726+0000","last_became_active":"2023-11-28T11:58:51.176047+0000","last_became_peered":"2023-11-28T11:58:51.176047+0000","last_unstale":"2023-11-28T11:58:51.661726+0000","last_undegraded":"2023-11-28T11:58:51.661726+0000","last_fullsized":"2023-11-28T11:58:51.661726+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:47:18.598716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.661507+0000","last_change":"2023-11-28T11:58:51.661507+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.661507+0000","last_undegraded":"2023-11-28T11:58:51.661507+0000","last_fullsized":"2023-11-28T11:58:51.661507+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:23.788694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.196955+0000","last_change":"2023-11-28T11:58:51.194390+0000","last_active":"2023-11-28T11:58:51.196955+0000","last_peered":"2023-11-28T11:58:51.196955+0000","last_clean":"2023-11-28T11:58:51.196955+0000","last_became_active":"2023-11-28T11:58:51.193968+0000","last_became_peered":"2023-11-28T11:58:51.193968+0000","last_unstale":"2023-11-28T11:58:51.196955+0000","last_undegraded":"2023-11-28T11:58:51.196955+0000","last_fullsized":"2023-11-28T11:58:51.196955+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:05:24.300271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.178014+0000","last_change":"2023-11-28T11:58:51.178014+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.178014+0000","last_undegraded":"2023-11-28T11:58:51.178014+0000","last_fullsized":"2023-11-28T11:58:51.178014+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:14:29.875840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"57'3","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.663582+0000","last_change":"2023-11-28T11:58:51.170686+0000","last_active":"2023-11-28T11:58:51.663582+0000","last_peered":"2023-11-28T11:58:51.663582+0000","last_clean":"2023-11-28T11:58:51.663582+0000","last_became_active":"2023-11-28T11:58:51.170416+0000","last_became_peered":"2023-11-28T11:58:51.170416+0000","last_unstale":"2023-11-28T11:58:51.663582+0000","last_undegraded":"2023-11-28T11:58:51.663582+0000","last_fullsized":"2023-11-28T11:58:51.663582+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:21.064597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.664974+0000","last_change":"2023-11-28T11:58:51.664974+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.664974+0000","last_undegraded":"2023-11-28T11:58:51.664974+0000","last_fullsized":"2023-11-28T11:58:51.664974+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:03:49.327209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.184215+0000","last_change":"2023-11-28T11:58:51.182690+0000","last_active":"2023-11-28T11:58:51.184215+0000","last_peered":"2023-11-28T11:58:51.184215+0000","last_clean":"2023-11-28T11:58:51.184215+0000","last_became_active":"2023-11-28T11:58:51.182414+0000","last_became_peered":"2023-11-28T11:58:51.182414+0000","last_unstale":"2023-11-28T11:58:51.184215+0000","last_undegraded":"2023-11-28T11:58:51.184215+0000","last_fullsized":"2023-11-28T11:58:51.184215+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:28:11.165170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.656296+0000","last_change":"2023-11-28T11:58:51.656296+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.656296+0000","last_undegraded":"2023-11-28T11:58:51.656296+0000","last_fullsized":"2023-11-28T11:58:51.656296+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:17:04.728611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.196119+0000","last_change":"2023-11-28T11:58:51.192204+0000","last_active":"2023-11-28T11:58:51.196119+0000","last_peered":"2023-11-28T11:58:51.196119+0000","last_clean":"2023-11-28T11:58:51.196119+0000","last_became_active":"2023-11-28T11:58:51.191886+0000","last_became_peered":"2023-11-28T11:58:51.191886+0000","last_unstale":"2023-11-28T11:58:51.196119+0000","last_undegraded":"2023-11-28T11:58:51.196119+0000","last_fullsized":"2023-11-28T11:58:51.196119+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:22.767051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.659384+0000","last_change":"2023-11-28T11:58:51.659384+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.659384+0000","last_undegraded":"2023-11-28T11:58:51.659384+0000","last_fullsized":"2023-11-28T11:58:51.659384+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:52.015075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.651612+0000","last_change":"2023-11-28T11:58:51.174956+0000","last_active":"2023-11-28T11:58:51.651612+0000","last_peered":"2023-11-28T11:58:51.651612+0000","last_clean":"2023-11-28T11:58:51.651612+0000","last_became_active":"2023-11-28T11:58:51.174655+0000","last_became_peered":"2023-11-28T11:58:51.174655+0000","last_unstale":"2023-11-28T11:58:51.651612+0000","last_undegraded":"2023-11-28T11:58:51.651612+0000","last_fullsized":"2023-11-28T11:58:51.651612+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:34:31.055864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.166710+0000","last_change":"2023-11-28T11:58:51.166710+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.166710+0000","last_undegraded":"2023-11-28T11:58:51.166710+0000","last_fullsized":"2023-11-28T11:58:51.166710+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:43:18.872444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.183356+0000","last_change":"2023-11-28T11:58:51.179067+0000","last_active":"2023-11-28T11:58:51.183356+0000","last_peered":"2023-11-28T11:58:51.183356+0000","last_clean":"2023-11-28T11:58:51.183356+0000","last_became_active":"2023-11-28T11:58:51.178790+0000","last_became_peered":"2023-11-28T11:58:51.178790+0000","last_unstale":"2023-11-28T11:58:51.183356+0000","last_undegraded":"2023-11-28T11:58:51.183356+0000","last_fullsized":"2023-11-28T11:58:51.183356+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:34.431609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.660022+0000","last_change":"2023-11-28T11:58:51.660022+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.660022+0000","last_undegraded":"2023-11-28T11:58:51.660022+0000","last_fullsized":"2023-11-28T11:58:51.660022+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:25:17.521536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"57'8","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.659390+0000","last_change":"2023-11-28T11:58:51.173895+0000","last_active":"2023-11-28T11:58:51.659390+0000","last_peered":"2023-11-28T11:58:51.659390+0000","last_clean":"2023-11-28T11:58:51.659390+0000","last_became_active":"2023-11-28T11:58:51.173611+0000","last_became_peered":"2023-11-28T11:58:51.173611+0000","last_unstale":"2023-11-28T11:58:51.659390+0000","last_undegraded":"2023-11-28T11:58:51.659390+0000","last_fullsized":"2023-11-28T11:58:51.659390+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:04:55.492496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.656545+0000","last_change":"2023-11-28T11:58:51.656545+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.656545+0000","last_undegraded":"2023-11-28T11:58:51.656545+0000","last_fullsized":"2023-11-28T11:58:51.656545+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:23:30.095986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.195185+0000","last_change":"2023-11-28T11:58:51.190105+0000","last_active":"2023-11-28T11:58:51.195185+0000","last_peered":"2023-11-28T11:58:51.195185+0000","last_clean":"2023-11-28T11:58:51.195185+0000","last_became_active":"2023-11-28T11:58:51.189836+0000","last_became_peered":"2023-11-28T11:58:51.189836+0000","last_unstale":"2023-11-28T11:58:51.195185+0000","last_undegraded":"2023-11-28T11:58:51.195185+0000","last_fullsized":"2023-11-28T11:58:51.195185+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:54:49.735542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.656711+0000","last_change":"2023-11-28T11:58:51.656711+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.656711+0000","last_undegraded":"2023-11-28T11:58:51.656711+0000","last_fullsized":"2023-11-28T11:58:51.656711+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:23.788694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2023-11-28T11:58:50.151197+0000","last_change":"2023-11-28T11:58:50.151197+0000","last_active":"2023-11-28T11:58:50.115927+0000","last_peered":"2023-11-28T11:58:50.115927+0000","last_clean":"2023-11-28T11:58:50.115927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:50.151197+0000","last_undegraded":"2023-11-28T11:58:50.151197+0000","last_fullsized":"2023-11-28T11:58:50.151197+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:44:16.839236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.177495+0000","last_change":"2023-11-28T11:58:51.177495+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.177495+0000","last_undegraded":"2023-11-28T11:58:51.177495+0000","last_fullsized":"2023-11-28T11:58:51.177495+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:47:19.620359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.651613+0000","last_change":"2023-11-28T11:58:51.174876+0000","last_active":"2023-11-28T11:58:51.651613+0000","last_peered":"2023-11-28T11:58:51.651613+0000","last_clean":"2023-11-28T11:58:51.651613+0000","last_became_active":"2023-11-28T11:58:51.174567+0000","last_became_peered":"2023-11-28T11:58:51.174567+0000","last_unstale":"2023-11-28T11:58:51.651613+0000","last_undegraded":"2023-11-28T11:58:51.651613+0000","last_fullsized":"2023-11-28T11:58:51.651613+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:09:52.803813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:51.137570+0000","last_change":"2023-11-28T11:58:51.137570+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.137570+0000","last_undegraded":"2023-11-28T11:58:51.137570+0000","last_fullsized":"2023-11-28T11:58:51.137570+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.185067+0000","last_change":"2023-11-28T11:58:51.182292+0000","last_active":"2023-11-28T11:58:51.185067+0000","last_peered":"2023-11-28T11:58:51.185067+0000","last_clean":"2023-11-28T11:58:51.185067+0000","last_became_active":"2023-11-28T11:58:51.182019+0000","last_became_peered":"2023-11-28T11:58:51.182019+0000","last_unstale":"2023-11-28T11:58:51.185067+0000","last_undegraded":"2023-11-28T11:58:51.185067+0000","last_fullsized":"2023-11-28T11:58:51.185067+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:46:05.485633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.171366+0000","last_change":"2023-11-28T11:58:51.171366+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.171366+0000","last_undegraded":"2023-11-28T11:58:51.171366+0000","last_fullsized":"2023-11-28T11:58:51.171366+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:22:28.860678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.187472+0000","last_change":"2023-11-28T11:58:51.183963+0000","last_active":"2023-11-28T11:58:51.187472+0000","last_peered":"2023-11-28T11:58:51.187472+0000","last_clean":"2023-11-28T11:58:51.187472+0000","last_became_active":"2023-11-28T11:58:51.183704+0000","last_became_peered":"2023-11-28T11:58:51.183704+0000","last_unstale":"2023-11-28T11:58:51.187472+0000","last_undegraded":"2023-11-28T11:58:51.187472+0000","last_fullsized":"2023-11-28T11:58:51.187472+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:48:13.492030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.660689+0000","last_change":"2023-11-28T11:58:51.660689+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.660689+0000","last_undegraded":"2023-11-28T11:58:51.660689+0000","last_fullsized":"2023-11-28T11:58:51.660689+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:51:09.793929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.180661+0000","last_change":"2023-11-28T11:58:51.176569+0000","last_active":"2023-11-28T11:58:51.180661+0000","last_peered":"2023-11-28T11:58:51.180661+0000","last_clean":"2023-11-28T11:58:51.180661+0000","last_became_active":"2023-11-28T11:58:51.176264+0000","last_became_peered":"2023-11-28T11:58:51.176264+0000","last_unstale":"2023-11-28T11:58:51.180661+0000","last_undegraded":"2023-11-28T11:58:51.180661+0000","last_fullsized":"2023-11-28T11:58:51.180661+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:51:08.772287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.175011+0000","last_change":"2023-11-28T11:58:51.175011+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.175011+0000","last_undegraded":"2023-11-28T11:58:51.175011+0000","last_fullsized":"2023-11-28T11:58:51.175011+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:47:15.134857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.184089+0000","last_change":"2023-11-28T11:58:51.180506+0000","last_active":"2023-11-28T11:58:51.184089+0000","last_peered":"2023-11-28T11:58:51.184089+0000","last_clean":"2023-11-28T11:58:51.184089+0000","last_became_active":"2023-11-28T11:58:51.180220+0000","last_became_peered":"2023-11-28T11:58:51.180220+0000","last_unstale":"2023-11-28T11:58:51.184089+0000","last_undegraded":"2023-11-28T11:58:51.184089+0000","last_fullsized":"2023-11-28T11:58:51.184089+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:24:42.388320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.171492+0000","last_change":"2023-11-28T11:58:51.171492+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.171492+0000","last_undegraded":"2023-11-28T11:58:51.171492+0000","last_fullsized":"2023-11-28T11:58:51.171492+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:34.496313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.195427+0000","last_change":"2023-11-28T11:58:51.182985+0000","last_active":"2023-11-28T11:58:51.195427+0000","last_peered":"2023-11-28T11:58:51.195427+0000","last_clean":"2023-11-28T11:58:51.195427+0000","last_became_active":"2023-11-28T11:58:51.182503+0000","last_became_peered":"2023-11-28T11:58:51.182503+0000","last_unstale":"2023-11-28T11:58:51.195427+0000","last_undegraded":"2023-11-28T11:58:51.195427+0000","last_fullsized":"2023-11-28T11:58:51.195427+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:17:03.706968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.175238+0000","last_change":"2023-11-28T11:58:51.175238+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.175238+0000","last_undegraded":"2023-11-28T11:58:51.175238+0000","last_fullsized":"2023-11-28T11:58:51.175238+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:24:09.557069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.183273+0000","last_change":"2023-11-28T11:58:51.178370+0000","last_active":"2023-11-28T11:58:51.183273+0000","last_peered":"2023-11-28T11:58:51.183273+0000","last_clean":"2023-11-28T11:58:51.183273+0000","last_became_active":"2023-11-28T11:58:51.178104+0000","last_became_peered":"2023-11-28T11:58:51.178104+0000","last_unstale":"2023-11-28T11:58:51.183273+0000","last_undegraded":"2023-11-28T11:58:51.183273+0000","last_fullsized":"2023-11-28T11:58:51.183273+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:46:22.305988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.170774+0000","last_change":"2023-11-28T11:56:34.384408+0000","last_active":"2023-11-28T11:58:51.170774+0000","last_peered":"2023-11-28T11:58:51.170774+0000","last_clean":"2023-11-28T11:58:51.170774+0000","last_became_active":"2023-11-28T11:56:34.384036+0000","last_became_peered":"2023-11-28T11:56:34.384036+0000","last_unstale":"2023-11-28T11:58:51.170774+0000","last_undegraded":"2023-11-28T11:58:51.170774+0000","last_fullsized":"2023-11-28T11:58:51.170774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:58:55.003786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.663363+0000","last_change":"2023-11-28T11:58:51.663363+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.663363+0000","last_undegraded":"2023-11-28T11:58:51.663363+0000","last_fullsized":"2023-11-28T11:58:51.663363+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:32:19.768923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2023-11-28T11:58:50.149567+0000","last_change":"2023-11-28T11:58:50.149567+0000","last_active":"2023-11-28T11:58:50.115927+0000","last_peered":"2023-11-28T11:58:50.115927+0000","last_clean":"2023-11-28T11:58:50.115927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:50.149567+0000","last_undegraded":"2023-11-28T11:58:50.149567+0000","last_fullsized":"2023-11-28T11:58:50.149567+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:09:32.828501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":40,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-28T11:58:50.141350+0000","last_change":"2023-11-28T11:56:34.384088+0000","last_active":"2023-11-28T11:58:50.141350+0000","last_peered":"2023-11-28T11:58:50.141350+0000","last_clean":"2023-11-28T11:58:50.141350+0000","last_became_active":"2023-11-28T11:56:34.383631+0000","last_became_peered":"2023-11-28T11:56:34.383631+0000","last_unstale":"2023-11-28T11:58:50.141350+0000","last_undegraded":"2023-11-28T11:58:50.141350+0000","last_fullsized":"2023-11-28T11:58:50.141350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:15:42.772333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.661133+0000","last_change":"2023-11-28T11:58:51.661133+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.661133+0000","last_undegraded":"2023-11-28T11:58:51.661133+0000","last_fullsized":"2023-11-28T11:58:51.661133+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:17:04.728611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.196084+0000","last_change":"2023-11-28T11:58:51.191624+0000","last_active":"2023-11-28T11:58:51.196084+0000","last_peered":"2023-11-28T11:58:51.196084+0000","last_clean":"2023-11-28T11:58:51.196084+0000","last_became_active":"2023-11-28T11:58:51.191317+0000","last_became_peered":"2023-11-28T11:58:51.191317+0000","last_unstale":"2023-11-28T11:58:51.196084+0000","last_undegraded":"2023-11-28T11:58:51.196084+0000","last_fullsized":"2023-11-28T11:58:51.196084+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:03:48.305566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.161577+0000","last_change":"2023-11-28T11:56:34.386399+0000","last_active":"2023-11-28T11:58:51.161577+0000","last_peered":"2023-11-28T11:58:51.161577+0000","last_clean":"2023-11-28T11:58:51.161577+0000","last_became_active":"2023-11-28T11:56:34.385994+0000","last_became_peered":"2023-11-28T11:56:34.385994+0000","last_unstale":"2023-11-28T11:58:51.161577+0000","last_undegraded":"2023-11-28T11:58:51.161577+0000","last_fullsized":"2023-11-28T11:58:51.161577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:58:02.172295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.657774+0000","last_change":"2023-11-28T11:58:51.657774+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.657774+0000","last_undegraded":"2023-11-28T11:58:51.657774+0000","last_fullsized":"2023-11-28T11:58:51.657774+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:53:49.319201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2023-11-28T11:58:50.151689+0000","last_change":"2023-11-28T11:58:50.151689+0000","last_active":"2023-11-28T11:58:50.115927+0000","last_peered":"2023-11-28T11:58:50.115927+0000","last_clean":"2023-11-28T11:58:50.115927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:50.151689+0000","last_undegraded":"2023-11-28T11:58:50.151689+0000","last_fullsized":"2023-11-28T11:58:50.151689+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:58:54.026123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-28T11:58:50.141350+0000","last_change":"2023-11-28T11:56:34.384999+0000","last_active":"2023-11-28T11:58:50.141350+0000","last_peered":"2023-11-28T11:58:50.141350+0000","last_clean":"2023-11-28T11:58:50.141350+0000","last_became_active":"2023-11-28T11:56:34.384531+0000","last_became_peered":"2023-11-28T11:56:34.384531+0000","last_unstale":"2023-11-28T11:58:50.141350+0000","last_undegraded":"2023-11-28T11:58:50.141350+0000","last_fullsized":"2023-11-28T11:58:50.141350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:09:50.083366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:51.137570+0000","last_change":"2023-11-28T11:58:51.137570+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.137570+0000","last_undegraded":"2023-11-28T11:58:51.137570+0000","last_fullsized":"2023-11-28T11:58:51.137570+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.185057+0000","last_change":"2023-11-28T11:58:51.181802+0000","last_active":"2023-11-28T11:58:51.185057+0000","last_peered":"2023-11-28T11:58:51.185057+0000","last_clean":"2023-11-28T11:58:51.185057+0000","last_became_active":"2023-11-28T11:58:51.181421+0000","last_became_peered":"2023-11-28T11:58:51.181421+0000","last_unstale":"2023-11-28T11:58:51.185057+0000","last_undegraded":"2023-11-28T11:58:51.185057+0000","last_fullsized":"2023-11-28T11:58:51.185057+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:50:43.770799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":39,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-28T11:58:50.146427+0000","last_change":"2023-11-28T11:56:34.389076+0000","last_active":"2023-11-28T11:58:50.146427+0000","last_peered":"2023-11-28T11:58:50.146427+0000","last_clean":"2023-11-28T11:58:50.146427+0000","last_became_active":"2023-11-28T11:56:34.388689+0000","last_became_peered":"2023-11-28T11:56:34.388689+0000","last_unstale":"2023-11-28T11:58:50.146427+0000","last_undegraded":"2023-11-28T11:58:50.146427+0000","last_fullsized":"2023-11-28T11:58:50.146427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:20.936349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.656818+0000","last_change":"2023-11-28T11:58:51.656818+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.656818+0000","last_undegraded":"2023-11-28T11:58:51.656818+0000","last_fullsized":"2023-11-28T11:58:51.656818+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:52.015075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.190652+0000","last_change":"2023-11-28T11:58:51.180873+0000","last_active":"2023-11-28T11:58:51.190652+0000","last_peered":"2023-11-28T11:58:51.190652+0000","last_clean":"2023-11-28T11:58:51.190652+0000","last_became_active":"2023-11-28T11:58:51.180551+0000","last_became_peered":"2023-11-28T11:58:51.180551+0000","last_unstale":"2023-11-28T11:58:51.190652+0000","last_undegraded":"2023-11-28T11:58:51.190652+0000","last_fullsized":"2023-11-28T11:58:51.190652+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:50.993432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T11:58:47.698410+0000","last_change":"2023-11-28T11:56:34.486178+0000","last_active":"2023-11-28T11:58:47.698410+0000","last_peered":"2023-11-28T11:58:47.698410+0000","last_clean":"2023-11-28T11:58:47.698410+0000","last_became_active":"2023-11-28T11:56:34.485702+0000","last_became_peered":"2023-11-28T11:56:34.485702+0000","last_unstale":"2023-11-28T11:58:47.698410+0000","last_undegraded":"2023-11-28T11:58:47.698410+0000","last_fullsized":"2023-11-28T11:58:47.698410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:06.323407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:51.137570+0000","last_change":"2023-11-28T11:58:51.137570+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.137570+0000","last_undegraded":"2023-11-28T11:58:51.137570+0000","last_fullsized":"2023-11-28T11:58:51.137570+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.195316+0000","last_change":"2023-11-28T11:58:51.193563+0000","last_active":"2023-11-28T11:58:51.195316+0000","last_peered":"2023-11-28T11:58:51.195316+0000","last_clean":"2023-11-28T11:58:51.195316+0000","last_became_active":"2023-11-28T11:58:51.193283+0000","last_became_peered":"2023-11-28T11:58:51.193283+0000","last_unstale":"2023-11-28T11:58:51.195316+0000","last_undegraded":"2023-11-28T11:58:51.195316+0000","last_fullsized":"2023-11-28T11:58:51.195316+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:36:54.633765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.160635+0000","last_change":"2023-11-28T11:56:34.387293+0000","last_active":"2023-11-28T11:58:51.160635+0000","last_peered":"2023-11-28T11:58:51.160635+0000","last_clean":"2023-11-28T11:58:51.160635+0000","last_became_active":"2023-11-28T11:56:34.386976+0000","last_became_peered":"2023-11-28T11:56:34.386976+0000","last_unstale":"2023-11-28T11:58:51.160635+0000","last_undegraded":"2023-11-28T11:58:51.160635+0000","last_fullsized":"2023-11-28T11:58:51.160635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:32.704729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.171808+0000","last_change":"2023-11-28T11:58:51.171808+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.171808+0000","last_undegraded":"2023-11-28T11:58:51.171808+0000","last_fullsized":"2023-11-28T11:58:51.171808+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:05:51.844750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.651886+0000","last_change":"2023-11-28T11:58:51.174291+0000","last_active":"2023-11-28T11:58:51.651886+0000","last_peered":"2023-11-28T11:58:51.651886+0000","last_clean":"2023-11-28T11:58:51.651886+0000","last_became_active":"2023-11-28T11:58:51.173714+0000","last_became_peered":"2023-11-28T11:58:51.173714+0000","last_unstale":"2023-11-28T11:58:51.651886+0000","last_undegraded":"2023-11-28T11:58:51.651886+0000","last_fullsized":"2023-11-28T11:58:51.651886+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:31:55.668938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":39,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-28T11:58:50.146409+0000","last_change":"2023-11-28T11:56:34.389222+0000","last_active":"2023-11-28T11:58:50.146409+0000","last_peered":"2023-11-28T11:58:50.146409+0000","last_clean":"2023-11-28T11:58:50.146409+0000","last_became_active":"2023-11-28T11:56:34.388671+0000","last_became_peered":"2023-11-28T11:56:34.388671+0000","last_unstale":"2023-11-28T11:58:50.146409+0000","last_undegraded":"2023-11-28T11:58:50.146409+0000","last_fullsized":"2023-11-28T11:58:50.146409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:32.704729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":194,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.160754+0000","last_change":"2023-11-28T11:56:28.472008+0000","last_active":"2023-11-28T11:58:51.160754+0000","last_peered":"2023-11-28T11:58:51.160754+0000","last_clean":"2023-11-28T11:58:51.160754+0000","last_became_active":"2023-11-28T11:56:28.469273+0000","last_became_peered":"2023-11-28T11:56:28.469273+0000","last_unstale":"2023-11-28T11:58:51.160754+0000","last_undegraded":"2023-11-28T11:58:51.160754+0000","last_fullsized":"2023-11-28T11:58:51.160754+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:27.291192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:27.291192+0000","last_clean_scrub_stamp":"2023-11-28T11:56:27.291192+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:14:48.860420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":90,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509472,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14352,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":13120,"kb_avail":94357488,"statfs":{"total":96636764160,"available":96622067712,"internally_reserved":0,"allocated":1253376,"data_stored":890680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13434880},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.0780000000000001,"15min":1.093},"min":{"1min":0.63,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.357,"5min":1.468,"15min":1.468},"last":1.327},{"interface":"front","average":{"1min":1.083,"5min":1.079,"15min":1.0780000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.4830000000000001,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.98599999999999999}]},{"osd":1,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1879999999999999,"15min":1.202},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.339,"5min":1.71,"15min":1.71},"last":1.236},{"interface":"front","average":{"1min":1.141,"5min":1.1739999999999999,"15min":1.1799999999999999},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.4410000000000001,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.879}]},{"osd":2,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1779999999999999,"15min":1.1859999999999999},"min":{"1min":0.83299999999999996,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.409,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.127},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2669999999999999,"15min":1.28},"min":{"1min":0.78400000000000003,"5min":0.749,"15min":0.749},"max":{"1min":1.5209999999999999,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.181}]},{"osd":3,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.302,"15min":1.3160000000000001},"min":{"1min":0.872,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.5249999999999999,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.345,"15min":1.357},"min":{"1min":1.0169999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.5980000000000001,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.1080000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.272,"15min":1.3029999999999999},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.5609999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.143,"5min":1.3129999999999999,"15min":1.341},"min":{"1min":0.80800000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.4350000000000001,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":0.95199999999999996}]},{"osd":5,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.409,"15min":1.4390000000000001},"min":{"1min":0.876,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.595,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.202,"5min":1.369,"15min":1.397},"min":{"1min":0.96899999999999997,"5min":0.872,"15min":0.872},"max":{"1min":1.454,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":1.252}]},{"osd":6,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.532,"15min":1.5600000000000001},"min":{"1min":1.075,"5min":1.075,"15min":1.075},"max":{"1min":1.633,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.165},{"interface":"front","average":{"1min":1.278,"5min":1.431,"15min":1.4570000000000001},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.53,"5min":2.468,"15min":2.468},"last":1.367}]}]},{"osd":6,"up_from":15,"seq":64424509472,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9164,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362676,"statfs":{"total":96636764160,"available":96627380224,"internally_reserved":0,"allocated":659456,"data_stored":300312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":0.997,"15min":0.99099999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.716,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.101,"5min":1.1870000000000001,"15min":1.2010000000000001},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.5569999999999999,"5min":2.347,"15min":2.347},"last":0.98499999999999999}]},{"osd":1,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.175,"15min":1.1759999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.5249999999999999,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.284},{"interface":"front","average":{"1min":1.117,"5min":1.165,"15min":1.173},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4239999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":1.3220000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.224,"15min":1.25},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4830000000000001,"5min":3.9620000000000002,"15min":3.9620000000000002},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1679999999999999,"15min":1.169},"min":{"1min":0.91200000000000003,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.3759999999999999,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.94299999999999995}]},{"osd":3,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2689999999999999,"15min":1.264},"min":{"1min":0.96699999999999997,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.258,"5min":1.27,"15min":1.272},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.645,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.1100000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.2230000000000001,"15min":1.238},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.4490000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.286,"5min":1.4510000000000001,"15min":1.4790000000000001},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.7250000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.3520000000000001}]},{"osd":5,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.2589999999999999,"15min":1.2769999999999999},"min":{"1min":0.93500000000000005,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.4730000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.266,"15min":1.278},"min":{"1min":0.84399999999999997,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.0209999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.3340000000000001,"15min":1.3400000000000001},"min":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.244},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3540000000000001,"15min":1.3580000000000001},"min":{"1min":1.0349999999999999,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":1.8939999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.155}]}]},{"osd":5,"up_from":15,"seq":64424509472,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9024,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362816,"statfs":{"total":96636764160,"available":96627523584,"internally_reserved":0,"allocated":647168,"data_stored":293372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0820000000000001,"15min":1.0880000000000001},"min":{"1min":0.76400000000000001,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.365,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.109,"5min":1.085,"15min":1.081},"min":{"1min":0.72899999999999998,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.552,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.1910000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:58:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1439999999999999,"15min":1.1499999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.72,"5min":1.843,"15min":1.843},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.069,"5min":1.085,"15min":1.0880000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.331}]},{"osd":2,"last update":"Tue Nov 28 11:58:33 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.163,"15min":1.165},"min":{"1min":0.83899999999999997,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.4630000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.296},{"interface":"front","average":{"1min":1.196,"5min":1.2,"15min":1.2},"min":{"1min":0.82999999999999996,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.05}]},{"osd":3,"last update":"Tue Nov 28 11:58:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.2609999999999999,"15min":1.276},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.5880000000000001,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.258,"5min":1.3759999999999999,"15min":1.3959999999999999},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.623,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.2509999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:58:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.206,"15min":1.22},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.54,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.2310000000000001,"15min":1.2350000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.5209999999999999,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.4650000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:58:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.276,"15min":1.278},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.349},{"interface":"front","average":{"1min":1.28,"5min":1.2849999999999999,"15min":1.286},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":1.675,"5min":1.704,"15min":1.704},"last":1.224}]},{"osd":7,"last update":"Tue Nov 28 11:58:33 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.359,"15min":1.365},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.7030000000000001,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.383},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.468,"15min":1.4790000000000001},"min":{"1min":1.002,"5min":1.002,"15min":1.002},"max":{"1min":1.78,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.171}]}]},{"osd":4,"up_from":15,"seq":64424509472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9216,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362624,"statfs":{"total":96636764160,"available":96627326976,"internally_reserved":0,"allocated":647168,"data_stored":293372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.113,"15min":1.111},"min":{"1min":0.67400000000000004,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.474,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.105,"5min":1.153,"15min":1.161},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.78,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.099}]},{"osd":1,"last update":"Tue Nov 28 11:58:32 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.1899999999999999,"15min":1.214},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.351,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.107,"5min":1.1910000000000001,"15min":1.2050000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.502,"5min":2.8860000000000001,"15min":2.8860000000000001},"last":1.147}]},{"osd":2,"last update":"Tue Nov 28 11:58:32 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.228,"15min":1.2450000000000001},"min":{"1min":0.72299999999999998,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.6020000000000001,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.05},{"interface":"front","average":{"1min":1.24,"5min":1.391,"15min":1.4159999999999999},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.6379999999999999,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":1.3580000000000001}]},{"osd":3,"last update":"Tue Nov 28 11:58:32 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.3080000000000001,"15min":1.325},"min":{"1min":0.76500000000000001,"5min":0.746,"15min":0.746},"max":{"1min":1.8320000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.399},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.367,"15min":1.377},"min":{"1min":0.99299999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.5700000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.3029999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:58:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.409,"15min":1.446},"min":{"1min":0.85599999999999998,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.5680000000000001,"5min":2.972,"15min":2.972},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.335,"15min":1.3660000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.4470000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.222}]},{"osd":6,"last update":"Tue Nov 28 11:58:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.3839999999999999,"15min":1.4139999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.7509999999999999,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.248},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.5289999999999999,"15min":1.5549999999999999},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":1.804,"5min":3.133,"15min":3.133},"last":1.468}]},{"osd":7,"last update":"Tue Nov 28 11:58:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.494,"15min":1.53},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.7110000000000001,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.319},{"interface":"front","average":{"1min":1.373,"5min":1.5649999999999999,"15min":1.597},"min":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"max":{"1min":1.7230000000000001,"5min":2.198,"15min":2.198},"last":1.4399999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509472,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9152,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362688,"statfs":{"total":96636764160,"available":96627392512,"internally_reserved":0,"allocated":647168,"data_stored":293372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.53500000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.2689999999999999,"5min":1.478,"15min":1.478},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.63200000000000001,"5min":0.37,"15min":0.37},"max":{"1min":1.349,"5min":2.177,"15min":2.177},"last":0.69899999999999995}]},{"osd":1,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.85599999999999998,"15min":0.86199999999999999},"min":{"1min":0.50600000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.087,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.056,"15min":1.0640000000000001},"min":{"1min":0.72899999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3280000000000001,"5min":1.968,"15min":1.968},"last":0.92000000000000004}]},{"osd":2,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.1279999999999999,"15min":1.1459999999999999},"min":{"1min":0.71799999999999997,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.413,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.194,"15min":1.2150000000000001},"min":{"1min":0.85799999999999998,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.423,"5min":2.093,"15min":2.093},"last":1.369}]},{"osd":4,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.171,"15min":1.177},"min":{"1min":0.85299999999999998,"5min":0.75,"15min":0.75},"max":{"1min":1.5469999999999999,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.325,"15min":1.343},"min":{"1min":1.032,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.514,"5min":2.8439999999999999,"15min":2.8439999999999999},"last":1.0449999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.3480000000000001,"15min":1.367},"min":{"1min":1.0089999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.4450000000000001,"5min":2.9670000000000001,"15min":2.9670000000000001},"last":0.995},{"interface":"front","average":{"1min":1.29,"5min":1.431,"15min":1.4550000000000001},"min":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"max":{"1min":1.736,"5min":3.7429999999999999,"15min":3.7429999999999999},"last":1.167}]},{"osd":6,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.3460000000000001,"15min":1.355},"min":{"1min":0.91500000000000004,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.907,"5min":2.323,"15min":2.323},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.4350000000000001,"15min":1.4530000000000001},"min":{"1min":1.1930000000000001,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.506,"5min":2.927,"15min":2.927},"last":1.337}]},{"osd":7,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4970000000000001,"15min":1.5109999999999999},"min":{"1min":1.1399999999999999,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.8440000000000001,"5min":3.5030000000000001,"15min":3.5030000000000001},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.377,"5min":1.468,"15min":1.4830000000000001},"min":{"1min":1.0980000000000001,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":1.778,"5min":2.6320000000000001,"15min":2.6320000000000001},"last":1.1279999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509472,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9100,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362740,"statfs":{"total":96636764160,"available":96627445760,"internally_reserved":0,"allocated":659456,"data_stored":300312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.92800000000000005,"15min":0.94599999999999995},"min":{"1min":0.61099999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.1160000000000001,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.014,"5min":1.006,"15min":1.0049999999999999},"min":{"1min":0.44400000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.6100000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":1.0940000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.087,"15min":1.089},"min":{"1min":0.57599999999999996,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.49,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.1020000000000001,"15min":1.105},"min":{"1min":0.67200000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.6899999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.151}]},{"osd":3,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.202,"15min":1.208},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.6180000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.877},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.1519999999999999,"15min":1.177},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.734,"5min":1.8,"15min":1.8},"last":0.81799999999999995}]},{"osd":4,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.3660000000000001,"15min":1.3759999999999999},"min":{"1min":0.95099999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.8109999999999999,"5min":3.411,"15min":3.411},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.331,"15min":1.349},"min":{"1min":0.90600000000000003,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.9039999999999999,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":1.361}]},{"osd":5,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.417,"15min":1.4350000000000001},"min":{"1min":0.91100000000000003,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.0129999999999999,"5min":3.6869999999999998,"15min":3.6869999999999998},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.3169999999999999,"15min":1.3300000000000001},"min":{"1min":0.91800000000000004,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.5269999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.2210000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.444,"15min":1.462},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.0569999999999999,"5min":3.5379999999999998,"15min":3.5379999999999998},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.472,"15min":1.498},"min":{"1min":1.1359999999999999,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.673,"5min":2.5739999999999998,"15min":2.5739999999999998},"last":1.706}]},{"osd":7,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.464,"15min":1.4810000000000001},"min":{"1min":1.1080000000000001,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.7410000000000001,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.494},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.5029999999999999,"15min":1.5229999999999999},"min":{"1min":0.86799999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.8680000000000001,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.514}]}]},{"osd":2,"up_from":14,"seq":60129542176,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9012,"kb_used_data":620,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362828,"statfs":{"total":96636764160,"available":96627535872,"internally_reserved":0,"allocated":634880,"data_stored":286882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:25 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.85799999999999998,"15min":0.86799999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.093,"5min":1.722,"15min":1.722},"last":1.147},{"interface":"front","average":{"1min":0.95099999999999996,"5min":1,"15min":1.008},"min":{"1min":0.63900000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.9850000000000001,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":0.90800000000000003}]},{"osd":1,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":1.018,"15min":1.03},"min":{"1min":0.56200000000000006,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.286,"5min":1.754,"15min":1.754},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.93000000000000005,"15min":0.93999999999999995},"min":{"1min":0.56599999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1850000000000001,"5min":1.484,"15min":1.484},"last":0.63100000000000001}]},{"osd":3,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.123,"15min":1.133},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.526,"5min":2.048,"15min":2.048},"last":1.169},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.28,"15min":1.2929999999999999},"min":{"1min":0.78900000000000003,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.583,"5min":2.617,"15min":2.617},"last":1.2130000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.3620000000000001,"15min":1.385},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.6919999999999999,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":1.093},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.2470000000000001,"15min":1.2549999999999999},"min":{"1min":0.85899999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.4930000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":0.879}]},{"osd":5,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.335,"15min":1.351},"min":{"1min":1.032,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.623,"5min":2.738,"15min":2.738},"last":1.056},{"interface":"front","average":{"1min":1.272,"5min":1.514,"15min":1.554},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.7230000000000001,"5min":4.0309999999999997,"15min":4.0309999999999997},"last":1.0289999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.583,"15min":1.611},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.9299999999999999,"5min":4.2240000000000002,"15min":4.2240000000000002},"last":1.121},{"interface":"front","average":{"1min":1.335,"5min":1.5169999999999999,"15min":1.5469999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.7709999999999999,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":1.258}]},{"osd":7,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.4379999999999999,"15min":1.4570000000000001},"min":{"1min":1.056,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.6359999999999999,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.6399999999999999,"15min":1.669},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.8799999999999999,"5min":4.3570000000000002,"15min":4.3570000000000002},"last":1.234}]}]},{"osd":0,"up_from":14,"seq":60129542176,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10228,"kb_used_data":1196,"kb_used_omap":0,"kb_used_meta":9024,"kb_avail":94361612,"statfs":{"total":96636764160,"available":96626290688,"internally_reserved":0,"allocated":1224704,"data_stored":876331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9240576},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.86899999999999999,"15min":0.878},"min":{"1min":0.52700000000000002,"5min":0.439,"15min":0.439},"max":{"1min":1.1359999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.997,"15min":1.0109999999999999},"min":{"1min":0.64500000000000002,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.4079999999999999,"5min":1.7,"15min":1.7},"last":1.046}]},{"osd":2,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.042,"15min":1.052},"min":{"1min":0.61599999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.282,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.92200000000000004,"15min":0.92400000000000004},"min":{"1min":0.61199999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.67200000000000004}]},{"osd":3,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.0640000000000001,"15min":1.0760000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.218,"5min":1.238,"15min":1.2410000000000001},"min":{"1min":0.80200000000000005,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.8089999999999999,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.85199999999999998}]},{"osd":4,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.3300000000000001,"15min":1.3440000000000001},"min":{"1min":0.89200000000000002,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.8100000000000001,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.234,"5min":1.377,"15min":1.401},"min":{"1min":0.86799999999999999,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.758,"5min":3.1629999999999998,"15min":3.1629999999999998},"last":0.79400000000000004}]},{"osd":5,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.361,"15min":1.363},"min":{"1min":0.871,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":2.1739999999999999,"5min":2.23,"15min":2.23},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.298,"5min":1.4019999999999999,"15min":1.4199999999999999},"min":{"1min":0.89500000000000002,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.845,"5min":2.266,"15min":2.266},"last":0.97199999999999998}]},{"osd":6,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.498,"15min":1.516},"min":{"1min":0.93300000000000005,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.9490000000000001,"5min":2.4060000000000001,"15min":2.4060000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.4830000000000001,"15min":1.5},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.7969999999999999,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":0.92000000000000004}]},{"osd":7,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.5109999999999999,"15min":1.5209999999999999},"min":{"1min":1.1439999999999999,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":2.0600000000000001,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.554,"15min":1.573},"min":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":2.3029999999999999,"5min":2.6040000000000001,"15min":2.6040000000000001},"last":1.171}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:58:56.040 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:58:56.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.263+0000 7fe23359e700 1 Processor -- start 2023-11-28T11:58:56.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.263+0000 7fe23359e700 1 -- start start 2023-11-28T11:58:56.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.267+0000 7fe23359e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe23415c640 0x7fe2340d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:56.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.267+0000 7fe23359e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe234069e00 0x7fe23406a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:56.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.267+0000 7fe23359e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe23406c600 con 0x7fe234071aa0 2023-11-28T11:58:56.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.267+0000 7fe23359e700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe23406cef0 con 0x7fe23415c640 2023-11-28T11:58:56.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.267+0000 7fe23359e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe23406a7c0 con 0x7fe234069e00 2023-11-28T11:58:56.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.267+0000 7fe23259c700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe23415c640 0x7fe2340d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:56.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.267+0000 7fe23259c700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe23415c640 0x7fe2340d31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43800/0 (socket says 172.21.15.39:43800) 2023-11-28T11:58:56.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.267+0000 7fe23259c700 1 -- 172.21.15.39:0/558643530 learned_addr learned my addr 172.21.15.39:0/558643530 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:56.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.267+0000 7fe232d9d700 1 --2- 172.21.15.39:0/558643530 >> v2:172.21.15.184:3300/0 conn(0x7fe234069e00 0x7fe23406a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:56.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.267+0000 7fe23259c700 1 -- 172.21.15.39:0/558643530 >> v2:172.21.15.184:3300/0 conn(0x7fe234069e00 msgr2=0x7fe23406a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:56.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.267+0000 7fe23259c700 1 --2- 172.21.15.39:0/558643530 >> v2:172.21.15.184:3300/0 conn(0x7fe234069e00 0x7fe23406a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:56.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.267+0000 7fe23259c700 1 -- 172.21.15.39:0/558643530 >> v1:172.21.15.184:6789/0 conn(0x7fe234071aa0 legacy=0x7fe23406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:56.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.267+0000 7fe23259c700 1 -- 172.21.15.39:0/558643530 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2340722f0 con 0x7fe23415c640 2023-11-28T11:58:56.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.267+0000 7fe23259c700 1 --2- 172.21.15.39:0/558643530 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe23415c640 0x7fe2340d31e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fe23406ed60 tx=0x7fe224009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=331e766a5d677205 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:56.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.267+0000 7fe23159a700 1 -- 172.21.15.39:0/558643530 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe224004230 con 0x7fe23415c640 2023-11-28T11:58:56.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.267+0000 7fe23159a700 1 -- 172.21.15.39:0/558643530 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe224004390 con 0x7fe23415c640 2023-11-28T11:58:56.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.267+0000 7fe23159a700 1 -- 172.21.15.39:0/558643530 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2240036c0 con 0x7fe23415c640 2023-11-28T11:58:56.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.267+0000 7fe23359e700 1 -- 172.21.15.39:0/558643530 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe23415c640 msgr2=0x7fe2340d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:56.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.267+0000 7fe23359e700 1 --2- 172.21.15.39:0/558643530 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe23415c640 0x7fe2340d31e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fe23406ed60 tx=0x7fe224009bf0 comp rx=0 tx=0).stop 2023-11-28T11:58:56.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.271+0000 7fe23359e700 1 -- 172.21.15.39:0/558643530 shutdown_connections 2023-11-28T11:58:56.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.271+0000 7fe23359e700 1 --2- 172.21.15.39:0/558643530 >> v2:172.21.15.184:3300/0 conn(0x7fe234069e00 0x7fe23406a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:56.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.271+0000 7fe23359e700 1 --2- 172.21.15.39:0/558643530 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe23415c640 0x7fe2340d31e0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:56.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.271+0000 7fe23359e700 1 -- 172.21.15.39:0/558643530 >> 172.21.15.39:0/558643530 conn(0x7fe2340b6520 msgr2=0x7fe234071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:56.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.271+0000 7fe23359e700 1 -- 172.21.15.39:0/558643530 shutdown_connections 2023-11-28T11:58:56.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.271+0000 7fe23359e700 1 -- 172.21.15.39:0/558643530 wait complete. 2023-11-28T11:58:56.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.275+0000 7fe23359e700 1 Processor -- start 2023-11-28T11:58:56.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.275+0000 7fe23359e700 1 -- start start 2023-11-28T11:58:56.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.275+0000 7fe23359e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe234069e00 0x7fe2341f4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:56.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.275+0000 7fe23359e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe234071aa0 0x7fe23409c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:56.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.275+0000 7fe23359e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe23415c640 0x7fe23409ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:56.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.275+0000 7fe23359e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2340cf830 con 0x7fe234069e00 2023-11-28T11:58:56.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.275+0000 7fe23359e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23409e8f0 con 0x7fe234071aa0 2023-11-28T11:58:56.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.275+0000 7fe23359e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2340cec20 con 0x7fe23415c640 2023-11-28T11:58:56.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.275+0000 7fe23259c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe234069e00 0x7fe2341f4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:56.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.275+0000 7fe23259c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe234069e00 0x7fe2341f4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43806/0 (socket says 172.21.15.39:43806) 2023-11-28T11:58:56.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.275+0000 7fe23259c700 1 -- 172.21.15.39:0/1406497693 learned_addr learned my addr 172.21.15.39:0/1406497693 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:56.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.275+0000 7fe231d9b700 1 --2- 172.21.15.39:0/1406497693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe234071aa0 0x7fe23409c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:56.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.275+0000 7fe232d9d700 1 --2- 172.21.15.39:0/1406497693 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe23415c640 0x7fe23409ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:56.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.275+0000 7fe23259c700 1 -- 172.21.15.39:0/1406497693 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe23415c640 msgr2=0x7fe23409ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:56.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.275+0000 7fe23259c700 1 --2- 172.21.15.39:0/1406497693 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe23415c640 0x7fe23409ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:56.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.275+0000 7fe23259c700 1 -- 172.21.15.39:0/1406497693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe234071aa0 msgr2=0x7fe23409c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:56.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.275+0000 7fe23259c700 1 --2- 172.21.15.39:0/1406497693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe234071aa0 0x7fe23409c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:56.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.275+0000 7fe23259c700 1 -- 172.21.15.39:0/1406497693 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe224009570 con 0x7fe234069e00 2023-11-28T11:58:56.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.275+0000 7fe232d9d700 1 --2- 172.21.15.39:0/1406497693 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe23415c640 0x7fe23409ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:58:56.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.275+0000 7fe231d9b700 1 --2- 172.21.15.39:0/1406497693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe234071aa0 0x7fe23409c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:58:56.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.275+0000 7fe23259c700 1 --2- 172.21.15.39:0/1406497693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe234069e00 0x7fe2341f4810 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fe224004000 tx=0x7fe224004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:56.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.279+0000 7fe222ffd700 1 -- 172.21.15.39:0/1406497693 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2240036e0 con 0x7fe234069e00 2023-11-28T11:58:56.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.279+0000 7fe222ffd700 1 -- 172.21.15.39:0/1406497693 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe22401f070 con 0x7fe234069e00 2023-11-28T11:58:56.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.279+0000 7fe222ffd700 1 -- 172.21.15.39:0/1406497693 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22400b880 con 0x7fe234069e00 2023-11-28T11:58:56.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.279+0000 7fe23359e700 1 -- 172.21.15.39:0/1406497693 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe23415ca10 con 0x7fe234069e00 2023-11-28T11:58:56.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.279+0000 7fe23359e700 1 -- 172.21.15.39:0/1406497693 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe23406da20 con 0x7fe234069e00 2023-11-28T11:58:56.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.279+0000 7fe23359e700 1 -- 172.21.15.39:0/1406497693 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe234072010 con 0x7fe234069e00 2023-11-28T11:58:56.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.279+0000 7fe222ffd700 1 -- 172.21.15.39:0/1406497693 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe22402a020 con 0x7fe234069e00 2023-11-28T11:58:56.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.283+0000 7fe222ffd700 1 --2- 172.21.15.39:0/1406497693 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe214064ee0 0x7fe214067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:56.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.283+0000 7fe222ffd700 1 -- 172.21.15.39:0/1406497693 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe224083900 con 0x7fe234069e00 2023-11-28T11:58:56.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.283+0000 7fe231d9b700 1 --2- 172.21.15.39:0/1406497693 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe214064ee0 0x7fe214067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:56.289 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.283+0000 7fe231d9b700 1 --2- 172.21.15.39:0/1406497693 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe214064ee0 0x7fe214067390 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe2340c86a0 tx=0x7fe228008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:56.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.291+0000 7fe222ffd700 1 -- 172.21.15.39:0/1406497693 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe224051870 con 0x7fe234069e00 2023-11-28T11:58:56.465 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.463+0000 7fe23359e700 1 -- 172.21.15.39:0/1406497693 --> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe234072010 con 0x7fe214064ee0 2023-11-28T11:58:56.480 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.475+0000 7fe222ffd700 1 -- 172.21.15.39:0/1406497693 <== mgr.4104 v2:172.21.15.184:6832/36166 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303928 (secure 0 0 0) 0x7fe234072010 con 0x7fe214064ee0 2023-11-28T11:58:56.485 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:58:56.489 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.487+0000 7fe23359e700 1 -- 172.21.15.39:0/1406497693 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe214064ee0 msgr2=0x7fe214067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:56.490 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.487+0000 7fe23359e700 1 --2- 172.21.15.39:0/1406497693 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe214064ee0 0x7fe214067390 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe2340c86a0 tx=0x7fe228008040 comp rx=0 tx=0).stop 2023-11-28T11:58:56.490 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.487+0000 7fe23359e700 1 -- 172.21.15.39:0/1406497693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe234069e00 msgr2=0x7fe2341f4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:56.490 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.487+0000 7fe23359e700 1 --2- 172.21.15.39:0/1406497693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe234069e00 0x7fe2341f4810 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fe224004000 tx=0x7fe224004770 comp rx=0 tx=0).stop 2023-11-28T11:58:56.490 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.487+0000 7fe23359e700 1 -- 172.21.15.39:0/1406497693 shutdown_connections 2023-11-28T11:58:56.490 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.487+0000 7fe23359e700 1 --2- 172.21.15.39:0/1406497693 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe23415c640 0x7fe23409ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:56.490 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.487+0000 7fe23359e700 1 --2- 172.21.15.39:0/1406497693 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe214064ee0 0x7fe214067390 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:56.490 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.487+0000 7fe23359e700 1 --2- 172.21.15.39:0/1406497693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe234071aa0 0x7fe23409c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:56.490 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.487+0000 7fe23359e700 1 --2- 172.21.15.39:0/1406497693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe234069e00 0x7fe2341f4810 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:56.490 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.487+0000 7fe23359e700 1 -- 172.21.15.39:0/1406497693 >> 172.21.15.39:0/1406497693 conn(0x7fe2340b6520 msgr2=0x7fe2340d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:56.490 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.487+0000 7fe23359e700 1 -- 172.21.15.39:0/1406497693 shutdown_connections 2023-11-28T11:58:56.490 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.487+0000 7fe23359e700 1 -- 172.21.15.39:0/1406497693 wait complete. 2023-11-28T11:58:56.492 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2023-11-28T11:58:56.512 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":126,"stamp":"2023-11-28T11:58:54.598816+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590458,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":175,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":178,"acting":178,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":44,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":79248,"kb_used_data":6224,"kb_used_omap":0,"kb_used_meta":72960,"kb_avail":754895472,"statfs":{"total":773094113280,"available":773012963328,"internally_reserved":0,"allocated":6373376,"data_stored":3534633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":74711040},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":90,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.460036"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:51.137570+0000","last_change":"2023-11-28T11:58:51.137570+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.137570+0000","last_undegraded":"2023-11-28T11:58:51.137570+0000","last_fullsized":"2023-11-28T11:58:51.137570+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.180906+0000","last_change":"2023-11-28T11:58:51.180906+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.180906+0000","last_undegraded":"2023-11-28T11:58:51.180906+0000","last_fullsized":"2023-11-28T11:58:51.180906+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:47:10.246224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.662021+0000","last_change":"2023-11-28T11:58:51.662021+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.662021+0000","last_undegraded":"2023-11-28T11:58:51.662021+0000","last_fullsized":"2023-11-28T11:58:51.662021+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:53:49.319201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.656796+0000","last_change":"2023-11-28T11:58:51.656796+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.656796+0000","last_undegraded":"2023-11-28T11:58:51.656796+0000","last_fullsized":"2023-11-28T11:58:51.656796+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:37:13.495875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:51.137570+0000","last_change":"2023-11-28T11:58:51.137570+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.137570+0000","last_undegraded":"2023-11-28T11:58:51.137570+0000","last_fullsized":"2023-11-28T11:58:51.137570+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:51.137570+0000","last_change":"2023-11-28T11:58:51.137570+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.137570+0000","last_undegraded":"2023-11-28T11:58:51.137570+0000","last_fullsized":"2023-11-28T11:58:51.137570+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.167375+0000","last_change":"2023-11-28T11:58:51.167375+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.167375+0000","last_undegraded":"2023-11-28T11:58:51.167375+0000","last_fullsized":"2023-11-28T11:58:51.167375+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:23:30.095986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.181470+0000","last_change":"2023-11-28T11:58:51.181470+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.181470+0000","last_undegraded":"2023-11-28T11:58:51.181470+0000","last_fullsized":"2023-11-28T11:58:51.181470+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:04:34.153300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.166525+0000","last_change":"2023-11-28T11:58:51.166525+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.166525+0000","last_undegraded":"2023-11-28T11:58:51.166525+0000","last_fullsized":"2023-11-28T11:58:51.166525+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:37:13.495875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.176434+0000","last_change":"2023-11-28T11:58:51.176434+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.176434+0000","last_undegraded":"2023-11-28T11:58:51.176434+0000","last_fullsized":"2023-11-28T11:58:51.176434+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:04:56.514139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.176265+0000","last_change":"2023-11-28T11:58:51.176265+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.176265+0000","last_undegraded":"2023-11-28T11:58:51.176265+0000","last_fullsized":"2023-11-28T11:58:51.176265+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:22.086240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.657117+0000","last_change":"2023-11-28T11:58:51.657117+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.657117+0000","last_undegraded":"2023-11-28T11:58:51.657117+0000","last_fullsized":"2023-11-28T11:58:51.657117+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:05:25.321914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.649448+0000","last_change":"2023-11-28T11:58:51.649448+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.649448+0000","last_undegraded":"2023-11-28T11:58:51.649448+0000","last_fullsized":"2023-11-28T11:58:51.649448+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:47:19.620359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":["6","0"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.167346+0000","last_change":"2023-11-28T11:58:51.167346+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.167346+0000","last_undegraded":"2023-11-28T11:58:51.167346+0000","last_fullsized":"2023-11-28T11:58:51.167346+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:20:26.402257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.166897+0000","last_change":"2023-11-28T11:58:51.166897+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.166897+0000","last_undegraded":"2023-11-28T11:58:51.166897+0000","last_fullsized":"2023-11-28T11:58:51.166897+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:31:57.919489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:51.137570+0000","last_change":"2023-11-28T11:58:51.137570+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.137570+0000","last_undegraded":"2023-11-28T11:58:51.137570+0000","last_fullsized":"2023-11-28T11:58:51.137570+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.180775+0000","last_change":"2023-11-28T11:58:51.180775+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.180775+0000","last_undegraded":"2023-11-28T11:58:51.180775+0000","last_fullsized":"2023-11-28T11:58:51.180775+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:21:34.475958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.660726+0000","last_change":"2023-11-28T11:58:51.660726+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.660726+0000","last_undegraded":"2023-11-28T11:58:51.660726+0000","last_fullsized":"2023-11-28T11:58:51.660726+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:05:25.321914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":["7","0"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:51.137570+0000","last_change":"2023-11-28T11:58:51.137570+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.137570+0000","last_undegraded":"2023-11-28T11:58:51.137570+0000","last_fullsized":"2023-11-28T11:58:51.137570+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.177158+0000","last_change":"2023-11-28T11:58:51.177158+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.177158+0000","last_undegraded":"2023-11-28T11:58:51.177158+0000","last_fullsized":"2023-11-28T11:58:51.177158+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:23:19.193646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.659009+0000","last_change":"2023-11-28T11:58:51.659009+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.659009+0000","last_undegraded":"2023-11-28T11:58:51.659009+0000","last_fullsized":"2023-11-28T11:58:51.659009+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:28:12.186813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.177078+0000","last_change":"2023-11-28T11:58:51.177078+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.177078+0000","last_undegraded":"2023-11-28T11:58:51.177078+0000","last_fullsized":"2023-11-28T11:58:51.177078+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:48:03.508051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.659105+0000","last_change":"2023-11-28T11:58:51.659105+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.659105+0000","last_undegraded":"2023-11-28T11:58:51.659105+0000","last_fullsized":"2023-11-28T11:58:51.659105+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:36:20.149308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.648893+0000","last_change":"2023-11-28T11:58:51.648893+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.648893+0000","last_undegraded":"2023-11-28T11:58:51.648893+0000","last_fullsized":"2023-11-28T11:58:51.648893+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:22.086240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":["6","0"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:51.137570+0000","last_change":"2023-11-28T11:58:51.137570+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.137570+0000","last_undegraded":"2023-11-28T11:58:51.137570+0000","last_fullsized":"2023-11-28T11:58:51.137570+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.656897+0000","last_change":"2023-11-28T11:58:51.656897+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.656897+0000","last_undegraded":"2023-11-28T11:58:51.656897+0000","last_fullsized":"2023-11-28T11:58:51.656897+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:03:49.327209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":["5","4"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:51.137570+0000","last_change":"2023-11-28T11:58:51.137570+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.137570+0000","last_undegraded":"2023-11-28T11:58:51.137570+0000","last_fullsized":"2023-11-28T11:58:51.137570+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:51.137570+0000","last_change":"2023-11-28T11:58:51.137570+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.137570+0000","last_undegraded":"2023-11-28T11:58:51.137570+0000","last_fullsized":"2023-11-28T11:58:51.137570+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.172715+0000","last_change":"2023-11-28T11:58:51.172715+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.172715+0000","last_undegraded":"2023-11-28T11:58:51.172715+0000","last_fullsized":"2023-11-28T11:58:51.172715+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:42:12.056606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.659077+0000","last_change":"2023-11-28T11:58:51.659077+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.659077+0000","last_undegraded":"2023-11-28T11:58:51.659077+0000","last_fullsized":"2023-11-28T11:58:51.659077+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:37:13.495875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:51.137570+0000","last_change":"2023-11-28T11:58:51.137570+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.137570+0000","last_undegraded":"2023-11-28T11:58:51.137570+0000","last_fullsized":"2023-11-28T11:58:51.137570+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:51.137570+0000","last_change":"2023-11-28T11:58:51.137570+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.137570+0000","last_undegraded":"2023-11-28T11:58:51.137570+0000","last_fullsized":"2023-11-28T11:58:51.137570+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:51.137570+0000","last_change":"2023-11-28T11:58:51.137570+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.137570+0000","last_undegraded":"2023-11-28T11:58:51.137570+0000","last_fullsized":"2023-11-28T11:58:51.137570+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2023-11-28T11:58:50.151179+0000","last_change":"2023-11-28T11:58:50.151179+0000","last_active":"2023-11-28T11:58:50.115927+0000","last_peered":"2023-11-28T11:58:50.115927+0000","last_clean":"2023-11-28T11:58:50.115927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:50.151179+0000","last_undegraded":"2023-11-28T11:58:50.151179+0000","last_fullsized":"2023-11-28T11:58:50.151179+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:53:15.246374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.175693+0000","last_change":"2023-11-28T11:58:51.175693+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.175693+0000","last_undegraded":"2023-11-28T11:58:51.175693+0000","last_fullsized":"2023-11-28T11:58:51.175693+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:36:59.737858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.190539+0000","last_change":"2023-11-28T11:58:51.177136+0000","last_active":"2023-11-28T11:58:51.190539+0000","last_peered":"2023-11-28T11:58:51.190539+0000","last_clean":"2023-11-28T11:58:51.190539+0000","last_became_active":"2023-11-28T11:58:51.176824+0000","last_became_peered":"2023-11-28T11:58:51.176824+0000","last_unstale":"2023-11-28T11:58:51.190539+0000","last_undegraded":"2023-11-28T11:58:51.190539+0000","last_fullsized":"2023-11-28T11:58:51.190539+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:32:18.747280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:51.137570+0000","last_change":"2023-11-28T11:58:51.137570+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.137570+0000","last_undegraded":"2023-11-28T11:58:51.137570+0000","last_fullsized":"2023-11-28T11:58:51.137570+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2023-11-28T11:58:50.152421+0000","last_change":"2023-11-28T11:58:50.152421+0000","last_active":"2023-11-28T11:58:50.115927+0000","last_peered":"2023-11-28T11:58:50.115927+0000","last_clean":"2023-11-28T11:58:50.115927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:50.152421+0000","last_undegraded":"2023-11-28T11:58:50.152421+0000","last_fullsized":"2023-11-28T11:58:50.152421+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:16:05.197854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:51.137570+0000","last_change":"2023-11-28T11:58:51.137570+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.137570+0000","last_undegraded":"2023-11-28T11:58:51.137570+0000","last_fullsized":"2023-11-28T11:58:51.137570+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.183323+0000","last_change":"2023-11-28T11:58:51.179001+0000","last_active":"2023-11-28T11:58:51.183323+0000","last_peered":"2023-11-28T11:58:51.183323+0000","last_clean":"2023-11-28T11:58:51.183323+0000","last_became_active":"2023-11-28T11:58:51.178671+0000","last_became_peered":"2023-11-28T11:58:51.178671+0000","last_unstale":"2023-11-28T11:58:51.183323+0000","last_undegraded":"2023-11-28T11:58:51.183323+0000","last_fullsized":"2023-11-28T11:58:51.183323+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:48:41.050307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.172305+0000","last_change":"2023-11-28T11:58:51.172305+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.172305+0000","last_undegraded":"2023-11-28T11:58:51.172305+0000","last_fullsized":"2023-11-28T11:58:51.172305+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:31:00.537286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.193474+0000","last_change":"2023-11-28T11:58:51.192459+0000","last_active":"2023-11-28T11:58:51.193474+0000","last_peered":"2023-11-28T11:58:51.193474+0000","last_clean":"2023-11-28T11:58:51.193474+0000","last_became_active":"2023-11-28T11:58:51.192125+0000","last_became_peered":"2023-11-28T11:58:51.192125+0000","last_unstale":"2023-11-28T11:58:51.193474+0000","last_undegraded":"2023-11-28T11:58:51.193474+0000","last_fullsized":"2023-11-28T11:58:51.193474+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:25:16.499893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.172180+0000","last_change":"2023-11-28T11:58:51.172180+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.172180+0000","last_undegraded":"2023-11-28T11:58:51.172180+0000","last_fullsized":"2023-11-28T11:58:51.172180+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:21:32.139383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2023-11-28T11:58:50.149018+0000","last_change":"2023-11-28T11:58:50.149018+0000","last_active":"2023-11-28T11:58:50.115927+0000","last_peered":"2023-11-28T11:58:50.115927+0000","last_clean":"2023-11-28T11:58:50.115927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:50.149018+0000","last_undegraded":"2023-11-28T11:58:50.149018+0000","last_fullsized":"2023-11-28T11:58:50.149018+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:08:06.627993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.648861+0000","last_change":"2023-11-28T11:58:51.648861+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.648861+0000","last_undegraded":"2023-11-28T11:58:51.648861+0000","last_fullsized":"2023-11-28T11:58:51.648861+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:04:56.514139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":["6","7"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.180871+0000","last_change":"2023-11-28T11:58:51.176988+0000","last_active":"2023-11-28T11:58:51.180871+0000","last_peered":"2023-11-28T11:58:51.180871+0000","last_clean":"2023-11-28T11:58:51.180871+0000","last_became_active":"2023-11-28T11:58:51.176713+0000","last_became_peered":"2023-11-28T11:58:51.176713+0000","last_unstale":"2023-11-28T11:58:51.180871+0000","last_undegraded":"2023-11-28T11:58:51.180871+0000","last_fullsized":"2023-11-28T11:58:51.180871+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:27:32.752868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.172332+0000","last_change":"2023-11-28T11:58:51.172332+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.172332+0000","last_undegraded":"2023-11-28T11:58:51.172332+0000","last_fullsized":"2023-11-28T11:58:51.172332+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:12:51.007363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.185539+0000","last_change":"2023-11-28T11:58:51.184233+0000","last_active":"2023-11-28T11:58:51.185539+0000","last_peered":"2023-11-28T11:58:51.185539+0000","last_clean":"2023-11-28T11:58:51.185539+0000","last_became_active":"2023-11-28T11:58:51.183942+0000","last_became_peered":"2023-11-28T11:58:51.183942+0000","last_unstale":"2023-11-28T11:58:51.185539+0000","last_undegraded":"2023-11-28T11:58:51.185539+0000","last_fullsized":"2023-11-28T11:58:51.185539+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:36:19.127665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.166354+0000","last_change":"2023-11-28T11:58:51.166354+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.166354+0000","last_undegraded":"2023-11-28T11:58:51.166354+0000","last_fullsized":"2023-11-28T11:58:51.166354+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:16:01.044656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.661726+0000","last_change":"2023-11-28T11:58:51.176310+0000","last_active":"2023-11-28T11:58:51.661726+0000","last_peered":"2023-11-28T11:58:51.661726+0000","last_clean":"2023-11-28T11:58:51.661726+0000","last_became_active":"2023-11-28T11:58:51.176047+0000","last_became_peered":"2023-11-28T11:58:51.176047+0000","last_unstale":"2023-11-28T11:58:51.661726+0000","last_undegraded":"2023-11-28T11:58:51.661726+0000","last_fullsized":"2023-11-28T11:58:51.661726+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:47:18.598716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.661507+0000","last_change":"2023-11-28T11:58:51.661507+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.661507+0000","last_undegraded":"2023-11-28T11:58:51.661507+0000","last_fullsized":"2023-11-28T11:58:51.661507+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:23.788694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.196955+0000","last_change":"2023-11-28T11:58:51.194390+0000","last_active":"2023-11-28T11:58:51.196955+0000","last_peered":"2023-11-28T11:58:51.196955+0000","last_clean":"2023-11-28T11:58:51.196955+0000","last_became_active":"2023-11-28T11:58:51.193968+0000","last_became_peered":"2023-11-28T11:58:51.193968+0000","last_unstale":"2023-11-28T11:58:51.196955+0000","last_undegraded":"2023-11-28T11:58:51.196955+0000","last_fullsized":"2023-11-28T11:58:51.196955+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:05:24.300271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.178014+0000","last_change":"2023-11-28T11:58:51.178014+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.178014+0000","last_undegraded":"2023-11-28T11:58:51.178014+0000","last_fullsized":"2023-11-28T11:58:51.178014+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:14:29.875840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"57'3","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.663582+0000","last_change":"2023-11-28T11:58:51.170686+0000","last_active":"2023-11-28T11:58:51.663582+0000","last_peered":"2023-11-28T11:58:51.663582+0000","last_clean":"2023-11-28T11:58:51.663582+0000","last_became_active":"2023-11-28T11:58:51.170416+0000","last_became_peered":"2023-11-28T11:58:51.170416+0000","last_unstale":"2023-11-28T11:58:51.663582+0000","last_undegraded":"2023-11-28T11:58:51.663582+0000","last_fullsized":"2023-11-28T11:58:51.663582+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:21.064597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.664974+0000","last_change":"2023-11-28T11:58:51.664974+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.664974+0000","last_undegraded":"2023-11-28T11:58:51.664974+0000","last_fullsized":"2023-11-28T11:58:51.664974+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:03:49.327209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.184215+0000","last_change":"2023-11-28T11:58:51.182690+0000","last_active":"2023-11-28T11:58:51.184215+0000","last_peered":"2023-11-28T11:58:51.184215+0000","last_clean":"2023-11-28T11:58:51.184215+0000","last_became_active":"2023-11-28T11:58:51.182414+0000","last_became_peered":"2023-11-28T11:58:51.182414+0000","last_unstale":"2023-11-28T11:58:51.184215+0000","last_undegraded":"2023-11-28T11:58:51.184215+0000","last_fullsized":"2023-11-28T11:58:51.184215+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:28:11.165170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.656296+0000","last_change":"2023-11-28T11:58:51.656296+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.656296+0000","last_undegraded":"2023-11-28T11:58:51.656296+0000","last_fullsized":"2023-11-28T11:58:51.656296+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:17:04.728611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.196119+0000","last_change":"2023-11-28T11:58:51.192204+0000","last_active":"2023-11-28T11:58:51.196119+0000","last_peered":"2023-11-28T11:58:51.196119+0000","last_clean":"2023-11-28T11:58:51.196119+0000","last_became_active":"2023-11-28T11:58:51.191886+0000","last_became_peered":"2023-11-28T11:58:51.191886+0000","last_unstale":"2023-11-28T11:58:51.196119+0000","last_undegraded":"2023-11-28T11:58:51.196119+0000","last_fullsized":"2023-11-28T11:58:51.196119+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:22.767051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.659384+0000","last_change":"2023-11-28T11:58:51.659384+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.659384+0000","last_undegraded":"2023-11-28T11:58:51.659384+0000","last_fullsized":"2023-11-28T11:58:51.659384+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:52.015075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.651612+0000","last_change":"2023-11-28T11:58:51.174956+0000","last_active":"2023-11-28T11:58:51.651612+0000","last_peered":"2023-11-28T11:58:51.651612+0000","last_clean":"2023-11-28T11:58:51.651612+0000","last_became_active":"2023-11-28T11:58:51.174655+0000","last_became_peered":"2023-11-28T11:58:51.174655+0000","last_unstale":"2023-11-28T11:58:51.651612+0000","last_undegraded":"2023-11-28T11:58:51.651612+0000","last_fullsized":"2023-11-28T11:58:51.651612+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:34:31.055864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.166710+0000","last_change":"2023-11-28T11:58:51.166710+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.166710+0000","last_undegraded":"2023-11-28T11:58:51.166710+0000","last_fullsized":"2023-11-28T11:58:51.166710+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:43:18.872444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.183356+0000","last_change":"2023-11-28T11:58:51.179067+0000","last_active":"2023-11-28T11:58:51.183356+0000","last_peered":"2023-11-28T11:58:51.183356+0000","last_clean":"2023-11-28T11:58:51.183356+0000","last_became_active":"2023-11-28T11:58:51.178790+0000","last_became_peered":"2023-11-28T11:58:51.178790+0000","last_unstale":"2023-11-28T11:58:51.183356+0000","last_undegraded":"2023-11-28T11:58:51.183356+0000","last_fullsized":"2023-11-28T11:58:51.183356+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:34.431609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.660022+0000","last_change":"2023-11-28T11:58:51.660022+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.660022+0000","last_undegraded":"2023-11-28T11:58:51.660022+0000","last_fullsized":"2023-11-28T11:58:51.660022+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:25:17.521536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"57'8","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.659390+0000","last_change":"2023-11-28T11:58:51.173895+0000","last_active":"2023-11-28T11:58:51.659390+0000","last_peered":"2023-11-28T11:58:51.659390+0000","last_clean":"2023-11-28T11:58:51.659390+0000","last_became_active":"2023-11-28T11:58:51.173611+0000","last_became_peered":"2023-11-28T11:58:51.173611+0000","last_unstale":"2023-11-28T11:58:51.659390+0000","last_undegraded":"2023-11-28T11:58:51.659390+0000","last_fullsized":"2023-11-28T11:58:51.659390+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:04:55.492496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.656545+0000","last_change":"2023-11-28T11:58:51.656545+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.656545+0000","last_undegraded":"2023-11-28T11:58:51.656545+0000","last_fullsized":"2023-11-28T11:58:51.656545+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:23:30.095986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.195185+0000","last_change":"2023-11-28T11:58:51.190105+0000","last_active":"2023-11-28T11:58:51.195185+0000","last_peered":"2023-11-28T11:58:51.195185+0000","last_clean":"2023-11-28T11:58:51.195185+0000","last_became_active":"2023-11-28T11:58:51.189836+0000","last_became_peered":"2023-11-28T11:58:51.189836+0000","last_unstale":"2023-11-28T11:58:51.195185+0000","last_undegraded":"2023-11-28T11:58:51.195185+0000","last_fullsized":"2023-11-28T11:58:51.195185+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:54:49.735542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.656711+0000","last_change":"2023-11-28T11:58:51.656711+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.656711+0000","last_undegraded":"2023-11-28T11:58:51.656711+0000","last_fullsized":"2023-11-28T11:58:51.656711+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:23.788694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2023-11-28T11:58:50.151197+0000","last_change":"2023-11-28T11:58:50.151197+0000","last_active":"2023-11-28T11:58:50.115927+0000","last_peered":"2023-11-28T11:58:50.115927+0000","last_clean":"2023-11-28T11:58:50.115927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:50.151197+0000","last_undegraded":"2023-11-28T11:58:50.151197+0000","last_fullsized":"2023-11-28T11:58:50.151197+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:44:16.839236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.177495+0000","last_change":"2023-11-28T11:58:51.177495+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.177495+0000","last_undegraded":"2023-11-28T11:58:51.177495+0000","last_fullsized":"2023-11-28T11:58:51.177495+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:47:19.620359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.651613+0000","last_change":"2023-11-28T11:58:51.174876+0000","last_active":"2023-11-28T11:58:51.651613+0000","last_peered":"2023-11-28T11:58:51.651613+0000","last_clean":"2023-11-28T11:58:51.651613+0000","last_became_active":"2023-11-28T11:58:51.174567+0000","last_became_peered":"2023-11-28T11:58:51.174567+0000","last_unstale":"2023-11-28T11:58:51.651613+0000","last_undegraded":"2023-11-28T11:58:51.651613+0000","last_fullsized":"2023-11-28T11:58:51.651613+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:09:52.803813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:51.137570+0000","last_change":"2023-11-28T11:58:51.137570+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.137570+0000","last_undegraded":"2023-11-28T11:58:51.137570+0000","last_fullsized":"2023-11-28T11:58:51.137570+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.185067+0000","last_change":"2023-11-28T11:58:51.182292+0000","last_active":"2023-11-28T11:58:51.185067+0000","last_peered":"2023-11-28T11:58:51.185067+0000","last_clean":"2023-11-28T11:58:51.185067+0000","last_became_active":"2023-11-28T11:58:51.182019+0000","last_became_peered":"2023-11-28T11:58:51.182019+0000","last_unstale":"2023-11-28T11:58:51.185067+0000","last_undegraded":"2023-11-28T11:58:51.185067+0000","last_fullsized":"2023-11-28T11:58:51.185067+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:46:05.485633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.171366+0000","last_change":"2023-11-28T11:58:51.171366+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.171366+0000","last_undegraded":"2023-11-28T11:58:51.171366+0000","last_fullsized":"2023-11-28T11:58:51.171366+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:22:28.860678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.187472+0000","last_change":"2023-11-28T11:58:51.183963+0000","last_active":"2023-11-28T11:58:51.187472+0000","last_peered":"2023-11-28T11:58:51.187472+0000","last_clean":"2023-11-28T11:58:51.187472+0000","last_became_active":"2023-11-28T11:58:51.183704+0000","last_became_peered":"2023-11-28T11:58:51.183704+0000","last_unstale":"2023-11-28T11:58:51.187472+0000","last_undegraded":"2023-11-28T11:58:51.187472+0000","last_fullsized":"2023-11-28T11:58:51.187472+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:48:13.492030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.660689+0000","last_change":"2023-11-28T11:58:51.660689+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.660689+0000","last_undegraded":"2023-11-28T11:58:51.660689+0000","last_fullsized":"2023-11-28T11:58:51.660689+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:51:09.793929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.180661+0000","last_change":"2023-11-28T11:58:51.176569+0000","last_active":"2023-11-28T11:58:51.180661+0000","last_peered":"2023-11-28T11:58:51.180661+0000","last_clean":"2023-11-28T11:58:51.180661+0000","last_became_active":"2023-11-28T11:58:51.176264+0000","last_became_peered":"2023-11-28T11:58:51.176264+0000","last_unstale":"2023-11-28T11:58:51.180661+0000","last_undegraded":"2023-11-28T11:58:51.180661+0000","last_fullsized":"2023-11-28T11:58:51.180661+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:51:08.772287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.175011+0000","last_change":"2023-11-28T11:58:51.175011+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.175011+0000","last_undegraded":"2023-11-28T11:58:51.175011+0000","last_fullsized":"2023-11-28T11:58:51.175011+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:47:15.134857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.184089+0000","last_change":"2023-11-28T11:58:51.180506+0000","last_active":"2023-11-28T11:58:51.184089+0000","last_peered":"2023-11-28T11:58:51.184089+0000","last_clean":"2023-11-28T11:58:51.184089+0000","last_became_active":"2023-11-28T11:58:51.180220+0000","last_became_peered":"2023-11-28T11:58:51.180220+0000","last_unstale":"2023-11-28T11:58:51.184089+0000","last_undegraded":"2023-11-28T11:58:51.184089+0000","last_fullsized":"2023-11-28T11:58:51.184089+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:24:42.388320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.171492+0000","last_change":"2023-11-28T11:58:51.171492+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.171492+0000","last_undegraded":"2023-11-28T11:58:51.171492+0000","last_fullsized":"2023-11-28T11:58:51.171492+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:34.496313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.195427+0000","last_change":"2023-11-28T11:58:51.182985+0000","last_active":"2023-11-28T11:58:51.195427+0000","last_peered":"2023-11-28T11:58:51.195427+0000","last_clean":"2023-11-28T11:58:51.195427+0000","last_became_active":"2023-11-28T11:58:51.182503+0000","last_became_peered":"2023-11-28T11:58:51.182503+0000","last_unstale":"2023-11-28T11:58:51.195427+0000","last_undegraded":"2023-11-28T11:58:51.195427+0000","last_fullsized":"2023-11-28T11:58:51.195427+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:17:03.706968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.175238+0000","last_change":"2023-11-28T11:58:51.175238+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.175238+0000","last_undegraded":"2023-11-28T11:58:51.175238+0000","last_fullsized":"2023-11-28T11:58:51.175238+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:24:09.557069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.183273+0000","last_change":"2023-11-28T11:58:51.178370+0000","last_active":"2023-11-28T11:58:51.183273+0000","last_peered":"2023-11-28T11:58:51.183273+0000","last_clean":"2023-11-28T11:58:51.183273+0000","last_became_active":"2023-11-28T11:58:51.178104+0000","last_became_peered":"2023-11-28T11:58:51.178104+0000","last_unstale":"2023-11-28T11:58:51.183273+0000","last_undegraded":"2023-11-28T11:58:51.183273+0000","last_fullsized":"2023-11-28T11:58:51.183273+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:46:22.305988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.170774+0000","last_change":"2023-11-28T11:56:34.384408+0000","last_active":"2023-11-28T11:58:51.170774+0000","last_peered":"2023-11-28T11:58:51.170774+0000","last_clean":"2023-11-28T11:58:51.170774+0000","last_became_active":"2023-11-28T11:56:34.384036+0000","last_became_peered":"2023-11-28T11:56:34.384036+0000","last_unstale":"2023-11-28T11:58:51.170774+0000","last_undegraded":"2023-11-28T11:58:51.170774+0000","last_fullsized":"2023-11-28T11:58:51.170774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:58:55.003786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.663363+0000","last_change":"2023-11-28T11:58:51.663363+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.663363+0000","last_undegraded":"2023-11-28T11:58:51.663363+0000","last_fullsized":"2023-11-28T11:58:51.663363+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:32:19.768923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2023-11-28T11:58:50.149567+0000","last_change":"2023-11-28T11:58:50.149567+0000","last_active":"2023-11-28T11:58:50.115927+0000","last_peered":"2023-11-28T11:58:50.115927+0000","last_clean":"2023-11-28T11:58:50.115927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:50.149567+0000","last_undegraded":"2023-11-28T11:58:50.149567+0000","last_fullsized":"2023-11-28T11:58:50.149567+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:09:32.828501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":40,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-28T11:58:50.141350+0000","last_change":"2023-11-28T11:56:34.384088+0000","last_active":"2023-11-28T11:58:50.141350+0000","last_peered":"2023-11-28T11:58:50.141350+0000","last_clean":"2023-11-28T11:58:50.141350+0000","last_became_active":"2023-11-28T11:56:34.383631+0000","last_became_peered":"2023-11-28T11:56:34.383631+0000","last_unstale":"2023-11-28T11:58:50.141350+0000","last_undegraded":"2023-11-28T11:58:50.141350+0000","last_fullsized":"2023-11-28T11:58:50.141350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:15:42.772333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.661133+0000","last_change":"2023-11-28T11:58:51.661133+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.661133+0000","last_undegraded":"2023-11-28T11:58:51.661133+0000","last_fullsized":"2023-11-28T11:58:51.661133+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:17:04.728611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.196084+0000","last_change":"2023-11-28T11:58:51.191624+0000","last_active":"2023-11-28T11:58:51.196084+0000","last_peered":"2023-11-28T11:58:51.196084+0000","last_clean":"2023-11-28T11:58:51.196084+0000","last_became_active":"2023-11-28T11:58:51.191317+0000","last_became_peered":"2023-11-28T11:58:51.191317+0000","last_unstale":"2023-11-28T11:58:51.196084+0000","last_undegraded":"2023-11-28T11:58:51.196084+0000","last_fullsized":"2023-11-28T11:58:51.196084+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:03:48.305566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.161577+0000","last_change":"2023-11-28T11:56:34.386399+0000","last_active":"2023-11-28T11:58:51.161577+0000","last_peered":"2023-11-28T11:58:51.161577+0000","last_clean":"2023-11-28T11:58:51.161577+0000","last_became_active":"2023-11-28T11:56:34.385994+0000","last_became_peered":"2023-11-28T11:56:34.385994+0000","last_unstale":"2023-11-28T11:58:51.161577+0000","last_undegraded":"2023-11-28T11:58:51.161577+0000","last_fullsized":"2023-11-28T11:58:51.161577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:58:02.172295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.657774+0000","last_change":"2023-11-28T11:58:51.657774+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.657774+0000","last_undegraded":"2023-11-28T11:58:51.657774+0000","last_fullsized":"2023-11-28T11:58:51.657774+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:53:49.319201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2023-11-28T11:58:50.151689+0000","last_change":"2023-11-28T11:58:50.151689+0000","last_active":"2023-11-28T11:58:50.115927+0000","last_peered":"2023-11-28T11:58:50.115927+0000","last_clean":"2023-11-28T11:58:50.115927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:50.151689+0000","last_undegraded":"2023-11-28T11:58:50.151689+0000","last_fullsized":"2023-11-28T11:58:50.151689+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:58:54.026123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-28T11:58:50.141350+0000","last_change":"2023-11-28T11:56:34.384999+0000","last_active":"2023-11-28T11:58:50.141350+0000","last_peered":"2023-11-28T11:58:50.141350+0000","last_clean":"2023-11-28T11:58:50.141350+0000","last_became_active":"2023-11-28T11:56:34.384531+0000","last_became_peered":"2023-11-28T11:56:34.384531+0000","last_unstale":"2023-11-28T11:58:50.141350+0000","last_undegraded":"2023-11-28T11:58:50.141350+0000","last_fullsized":"2023-11-28T11:58:50.141350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:09:50.083366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:51.137570+0000","last_change":"2023-11-28T11:58:51.137570+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.137570+0000","last_undegraded":"2023-11-28T11:58:51.137570+0000","last_fullsized":"2023-11-28T11:58:51.137570+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.185057+0000","last_change":"2023-11-28T11:58:51.181802+0000","last_active":"2023-11-28T11:58:51.185057+0000","last_peered":"2023-11-28T11:58:51.185057+0000","last_clean":"2023-11-28T11:58:51.185057+0000","last_became_active":"2023-11-28T11:58:51.181421+0000","last_became_peered":"2023-11-28T11:58:51.181421+0000","last_unstale":"2023-11-28T11:58:51.185057+0000","last_undegraded":"2023-11-28T11:58:51.185057+0000","last_fullsized":"2023-11-28T11:58:51.185057+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:50:43.770799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":39,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-28T11:58:50.146427+0000","last_change":"2023-11-28T11:56:34.389076+0000","last_active":"2023-11-28T11:58:50.146427+0000","last_peered":"2023-11-28T11:58:50.146427+0000","last_clean":"2023-11-28T11:58:50.146427+0000","last_became_active":"2023-11-28T11:56:34.388689+0000","last_became_peered":"2023-11-28T11:56:34.388689+0000","last_unstale":"2023-11-28T11:58:50.146427+0000","last_undegraded":"2023-11-28T11:58:50.146427+0000","last_fullsized":"2023-11-28T11:58:50.146427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:20.936349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.656818+0000","last_change":"2023-11-28T11:58:51.656818+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.656818+0000","last_undegraded":"2023-11-28T11:58:51.656818+0000","last_fullsized":"2023-11-28T11:58:51.656818+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:52.015075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.190652+0000","last_change":"2023-11-28T11:58:51.180873+0000","last_active":"2023-11-28T11:58:51.190652+0000","last_peered":"2023-11-28T11:58:51.190652+0000","last_clean":"2023-11-28T11:58:51.190652+0000","last_became_active":"2023-11-28T11:58:51.180551+0000","last_became_peered":"2023-11-28T11:58:51.180551+0000","last_unstale":"2023-11-28T11:58:51.190652+0000","last_undegraded":"2023-11-28T11:58:51.190652+0000","last_fullsized":"2023-11-28T11:58:51.190652+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:50.993432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T11:58:47.698410+0000","last_change":"2023-11-28T11:56:34.486178+0000","last_active":"2023-11-28T11:58:47.698410+0000","last_peered":"2023-11-28T11:58:47.698410+0000","last_clean":"2023-11-28T11:58:47.698410+0000","last_became_active":"2023-11-28T11:56:34.485702+0000","last_became_peered":"2023-11-28T11:56:34.485702+0000","last_unstale":"2023-11-28T11:58:47.698410+0000","last_undegraded":"2023-11-28T11:58:47.698410+0000","last_fullsized":"2023-11-28T11:58:47.698410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:06.323407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:58:51.137570+0000","last_change":"2023-11-28T11:58:51.137570+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.137570+0000","last_undegraded":"2023-11-28T11:58:51.137570+0000","last_fullsized":"2023-11-28T11:58:51.137570+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.195316+0000","last_change":"2023-11-28T11:58:51.193563+0000","last_active":"2023-11-28T11:58:51.195316+0000","last_peered":"2023-11-28T11:58:51.195316+0000","last_clean":"2023-11-28T11:58:51.195316+0000","last_became_active":"2023-11-28T11:58:51.193283+0000","last_became_peered":"2023-11-28T11:58:51.193283+0000","last_unstale":"2023-11-28T11:58:51.195316+0000","last_undegraded":"2023-11-28T11:58:51.195316+0000","last_fullsized":"2023-11-28T11:58:51.195316+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:36:54.633765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.160635+0000","last_change":"2023-11-28T11:56:34.387293+0000","last_active":"2023-11-28T11:58:51.160635+0000","last_peered":"2023-11-28T11:58:51.160635+0000","last_clean":"2023-11-28T11:58:51.160635+0000","last_became_active":"2023-11-28T11:56:34.386976+0000","last_became_peered":"2023-11-28T11:56:34.386976+0000","last_unstale":"2023-11-28T11:58:51.160635+0000","last_undegraded":"2023-11-28T11:58:51.160635+0000","last_fullsized":"2023-11-28T11:58:51.160635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:32.704729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.171808+0000","last_change":"2023-11-28T11:58:51.171808+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.171808+0000","last_undegraded":"2023-11-28T11:58:51.171808+0000","last_fullsized":"2023-11-28T11:58:51.171808+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:05:51.844750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.651886+0000","last_change":"2023-11-28T11:58:51.174291+0000","last_active":"2023-11-28T11:58:51.651886+0000","last_peered":"2023-11-28T11:58:51.651886+0000","last_clean":"2023-11-28T11:58:51.651886+0000","last_became_active":"2023-11-28T11:58:51.173714+0000","last_became_peered":"2023-11-28T11:58:51.173714+0000","last_unstale":"2023-11-28T11:58:51.651886+0000","last_undegraded":"2023-11-28T11:58:51.651886+0000","last_fullsized":"2023-11-28T11:58:51.651886+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:31:55.668938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":39,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-28T11:58:50.146409+0000","last_change":"2023-11-28T11:56:34.389222+0000","last_active":"2023-11-28T11:58:50.146409+0000","last_peered":"2023-11-28T11:58:50.146409+0000","last_clean":"2023-11-28T11:58:50.146409+0000","last_became_active":"2023-11-28T11:56:34.388671+0000","last_became_peered":"2023-11-28T11:56:34.388671+0000","last_unstale":"2023-11-28T11:58:50.146409+0000","last_undegraded":"2023-11-28T11:58:50.146409+0000","last_fullsized":"2023-11-28T11:58:50.146409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:32.704729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":194,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.160754+0000","last_change":"2023-11-28T11:56:28.472008+0000","last_active":"2023-11-28T11:58:51.160754+0000","last_peered":"2023-11-28T11:58:51.160754+0000","last_clean":"2023-11-28T11:58:51.160754+0000","last_became_active":"2023-11-28T11:56:28.469273+0000","last_became_peered":"2023-11-28T11:56:28.469273+0000","last_unstale":"2023-11-28T11:58:51.160754+0000","last_undegraded":"2023-11-28T11:58:51.160754+0000","last_fullsized":"2023-11-28T11:58:51.160754+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:27.291192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:27.291192+0000","last_clean_scrub_stamp":"2023-11-28T11:56:27.291192+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:14:48.860420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":90,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509472,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14352,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":13120,"kb_avail":94357488,"statfs":{"total":96636764160,"available":96622067712,"internally_reserved":0,"allocated":1253376,"data_stored":890680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13434880},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.0780000000000001,"15min":1.093},"min":{"1min":0.63,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.357,"5min":1.468,"15min":1.468},"last":1.327},{"interface":"front","average":{"1min":1.083,"5min":1.079,"15min":1.0780000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.4830000000000001,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.98599999999999999}]},{"osd":1,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1879999999999999,"15min":1.202},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.339,"5min":1.71,"15min":1.71},"last":1.236},{"interface":"front","average":{"1min":1.141,"5min":1.1739999999999999,"15min":1.1799999999999999},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.4410000000000001,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.879}]},{"osd":2,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1779999999999999,"15min":1.1859999999999999},"min":{"1min":0.83299999999999996,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.409,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.127},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2669999999999999,"15min":1.28},"min":{"1min":0.78400000000000003,"5min":0.749,"15min":0.749},"max":{"1min":1.5209999999999999,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.181}]},{"osd":3,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.302,"15min":1.3160000000000001},"min":{"1min":0.872,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.5249999999999999,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.345,"15min":1.357},"min":{"1min":1.0169999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.5980000000000001,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.1080000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.272,"15min":1.3029999999999999},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.5609999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.143,"5min":1.3129999999999999,"15min":1.341},"min":{"1min":0.80800000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.4350000000000001,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":0.95199999999999996}]},{"osd":5,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.409,"15min":1.4390000000000001},"min":{"1min":0.876,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.595,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.202,"5min":1.369,"15min":1.397},"min":{"1min":0.96899999999999997,"5min":0.872,"15min":0.872},"max":{"1min":1.454,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":1.252}]},{"osd":6,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.532,"15min":1.5600000000000001},"min":{"1min":1.075,"5min":1.075,"15min":1.075},"max":{"1min":1.633,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.165},{"interface":"front","average":{"1min":1.278,"5min":1.431,"15min":1.4570000000000001},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.53,"5min":2.468,"15min":2.468},"last":1.367}]}]},{"osd":6,"up_from":15,"seq":64424509472,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9164,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362676,"statfs":{"total":96636764160,"available":96627380224,"internally_reserved":0,"allocated":659456,"data_stored":300312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":0.997,"15min":0.99099999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.716,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.101,"5min":1.1870000000000001,"15min":1.2010000000000001},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.5569999999999999,"5min":2.347,"15min":2.347},"last":0.98499999999999999}]},{"osd":1,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.175,"15min":1.1759999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.5249999999999999,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.284},{"interface":"front","average":{"1min":1.117,"5min":1.165,"15min":1.173},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4239999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":1.3220000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.224,"15min":1.25},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4830000000000001,"5min":3.9620000000000002,"15min":3.9620000000000002},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1679999999999999,"15min":1.169},"min":{"1min":0.91200000000000003,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.3759999999999999,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.94299999999999995}]},{"osd":3,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2689999999999999,"15min":1.264},"min":{"1min":0.96699999999999997,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.258,"5min":1.27,"15min":1.272},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.645,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.1100000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.2230000000000001,"15min":1.238},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.4490000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.286,"5min":1.4510000000000001,"15min":1.4790000000000001},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.7250000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.3520000000000001}]},{"osd":5,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.2589999999999999,"15min":1.2769999999999999},"min":{"1min":0.93500000000000005,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.4730000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.266,"15min":1.278},"min":{"1min":0.84399999999999997,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.0209999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.3340000000000001,"15min":1.3400000000000001},"min":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.244},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3540000000000001,"15min":1.3580000000000001},"min":{"1min":1.0349999999999999,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":1.8939999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.155}]}]},{"osd":5,"up_from":15,"seq":64424509472,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9024,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362816,"statfs":{"total":96636764160,"available":96627523584,"internally_reserved":0,"allocated":647168,"data_stored":293372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0820000000000001,"15min":1.0880000000000001},"min":{"1min":0.76400000000000001,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.365,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.109,"5min":1.085,"15min":1.081},"min":{"1min":0.72899999999999998,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.552,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.1910000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:58:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1439999999999999,"15min":1.1499999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.72,"5min":1.843,"15min":1.843},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.069,"5min":1.085,"15min":1.0880000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.331}]},{"osd":2,"last update":"Tue Nov 28 11:58:33 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.163,"15min":1.165},"min":{"1min":0.83899999999999997,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.4630000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.296},{"interface":"front","average":{"1min":1.196,"5min":1.2,"15min":1.2},"min":{"1min":0.82999999999999996,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.05}]},{"osd":3,"last update":"Tue Nov 28 11:58:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.2609999999999999,"15min":1.276},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.5880000000000001,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.258,"5min":1.3759999999999999,"15min":1.3959999999999999},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.623,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.2509999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:58:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.206,"15min":1.22},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.54,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.2310000000000001,"15min":1.2350000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.5209999999999999,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.4650000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:58:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.276,"15min":1.278},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.349},{"interface":"front","average":{"1min":1.28,"5min":1.2849999999999999,"15min":1.286},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":1.675,"5min":1.704,"15min":1.704},"last":1.224}]},{"osd":7,"last update":"Tue Nov 28 11:58:33 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.359,"15min":1.365},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.7030000000000001,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.383},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.468,"15min":1.4790000000000001},"min":{"1min":1.002,"5min":1.002,"15min":1.002},"max":{"1min":1.78,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.171}]}]},{"osd":4,"up_from":15,"seq":64424509472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9216,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362624,"statfs":{"total":96636764160,"available":96627326976,"internally_reserved":0,"allocated":647168,"data_stored":293372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.113,"15min":1.111},"min":{"1min":0.67400000000000004,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.474,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.105,"5min":1.153,"15min":1.161},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.78,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.099}]},{"osd":1,"last update":"Tue Nov 28 11:58:32 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.1899999999999999,"15min":1.214},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.351,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.107,"5min":1.1910000000000001,"15min":1.2050000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.502,"5min":2.8860000000000001,"15min":2.8860000000000001},"last":1.147}]},{"osd":2,"last update":"Tue Nov 28 11:58:32 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.228,"15min":1.2450000000000001},"min":{"1min":0.72299999999999998,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.6020000000000001,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.05},{"interface":"front","average":{"1min":1.24,"5min":1.391,"15min":1.4159999999999999},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.6379999999999999,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":1.3580000000000001}]},{"osd":3,"last update":"Tue Nov 28 11:58:32 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.3080000000000001,"15min":1.325},"min":{"1min":0.76500000000000001,"5min":0.746,"15min":0.746},"max":{"1min":1.8320000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.399},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.367,"15min":1.377},"min":{"1min":0.99299999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.5700000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.3029999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:58:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.409,"15min":1.446},"min":{"1min":0.85599999999999998,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.5680000000000001,"5min":2.972,"15min":2.972},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.335,"15min":1.3660000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.4470000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.222}]},{"osd":6,"last update":"Tue Nov 28 11:58:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.3839999999999999,"15min":1.4139999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.7509999999999999,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.248},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.5289999999999999,"15min":1.5549999999999999},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":1.804,"5min":3.133,"15min":3.133},"last":1.468}]},{"osd":7,"last update":"Tue Nov 28 11:58:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.494,"15min":1.53},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.7110000000000001,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.319},{"interface":"front","average":{"1min":1.373,"5min":1.5649999999999999,"15min":1.597},"min":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"max":{"1min":1.7230000000000001,"5min":2.198,"15min":2.198},"last":1.4399999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509472,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9152,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362688,"statfs":{"total":96636764160,"available":96627392512,"internally_reserved":0,"allocated":647168,"data_stored":293372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.53500000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.2689999999999999,"5min":1.478,"15min":1.478},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.63200000000000001,"5min":0.37,"15min":0.37},"max":{"1min":1.349,"5min":2.177,"15min":2.177},"last":0.69899999999999995}]},{"osd":1,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.85599999999999998,"15min":0.86199999999999999},"min":{"1min":0.50600000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.087,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.056,"15min":1.0640000000000001},"min":{"1min":0.72899999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3280000000000001,"5min":1.968,"15min":1.968},"last":0.92000000000000004}]},{"osd":2,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.1279999999999999,"15min":1.1459999999999999},"min":{"1min":0.71799999999999997,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.413,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.194,"15min":1.2150000000000001},"min":{"1min":0.85799999999999998,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.423,"5min":2.093,"15min":2.093},"last":1.369}]},{"osd":4,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.171,"15min":1.177},"min":{"1min":0.85299999999999998,"5min":0.75,"15min":0.75},"max":{"1min":1.5469999999999999,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.325,"15min":1.343},"min":{"1min":1.032,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.514,"5min":2.8439999999999999,"15min":2.8439999999999999},"last":1.0449999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.3480000000000001,"15min":1.367},"min":{"1min":1.0089999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.4450000000000001,"5min":2.9670000000000001,"15min":2.9670000000000001},"last":0.995},{"interface":"front","average":{"1min":1.29,"5min":1.431,"15min":1.4550000000000001},"min":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"max":{"1min":1.736,"5min":3.7429999999999999,"15min":3.7429999999999999},"last":1.167}]},{"osd":6,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.3460000000000001,"15min":1.355},"min":{"1min":0.91500000000000004,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.907,"5min":2.323,"15min":2.323},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.4350000000000001,"15min":1.4530000000000001},"min":{"1min":1.1930000000000001,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.506,"5min":2.927,"15min":2.927},"last":1.337}]},{"osd":7,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4970000000000001,"15min":1.5109999999999999},"min":{"1min":1.1399999999999999,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.8440000000000001,"5min":3.5030000000000001,"15min":3.5030000000000001},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.377,"5min":1.468,"15min":1.4830000000000001},"min":{"1min":1.0980000000000001,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":1.778,"5min":2.6320000000000001,"15min":2.6320000000000001},"last":1.1279999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509472,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9100,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362740,"statfs":{"total":96636764160,"available":96627445760,"internally_reserved":0,"allocated":659456,"data_stored":300312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.92800000000000005,"15min":0.94599999999999995},"min":{"1min":0.61099999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.1160000000000001,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.014,"5min":1.006,"15min":1.0049999999999999},"min":{"1min":0.44400000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.6100000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":1.0940000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.087,"15min":1.089},"min":{"1min":0.57599999999999996,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.49,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.1020000000000001,"15min":1.105},"min":{"1min":0.67200000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.6899999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.151}]},{"osd":3,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.202,"15min":1.208},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.6180000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.877},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.1519999999999999,"15min":1.177},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.734,"5min":1.8,"15min":1.8},"last":0.81799999999999995}]},{"osd":4,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.3660000000000001,"15min":1.3759999999999999},"min":{"1min":0.95099999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.8109999999999999,"5min":3.411,"15min":3.411},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.331,"15min":1.349},"min":{"1min":0.90600000000000003,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.9039999999999999,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":1.361}]},{"osd":5,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.417,"15min":1.4350000000000001},"min":{"1min":0.91100000000000003,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.0129999999999999,"5min":3.6869999999999998,"15min":3.6869999999999998},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.3169999999999999,"15min":1.3300000000000001},"min":{"1min":0.91800000000000004,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.5269999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.2210000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.444,"15min":1.462},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.0569999999999999,"5min":3.5379999999999998,"15min":3.5379999999999998},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.472,"15min":1.498},"min":{"1min":1.1359999999999999,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.673,"5min":2.5739999999999998,"15min":2.5739999999999998},"last":1.706}]},{"osd":7,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.464,"15min":1.4810000000000001},"min":{"1min":1.1080000000000001,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.7410000000000001,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.494},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.5029999999999999,"15min":1.5229999999999999},"min":{"1min":0.86799999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.8680000000000001,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.514}]}]},{"osd":2,"up_from":14,"seq":60129542176,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9012,"kb_used_data":620,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362828,"statfs":{"total":96636764160,"available":96627535872,"internally_reserved":0,"allocated":634880,"data_stored":286882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:25 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.85799999999999998,"15min":0.86799999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.093,"5min":1.722,"15min":1.722},"last":1.147},{"interface":"front","average":{"1min":0.95099999999999996,"5min":1,"15min":1.008},"min":{"1min":0.63900000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.9850000000000001,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":0.90800000000000003}]},{"osd":1,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":1.018,"15min":1.03},"min":{"1min":0.56200000000000006,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.286,"5min":1.754,"15min":1.754},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.93000000000000005,"15min":0.93999999999999995},"min":{"1min":0.56599999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1850000000000001,"5min":1.484,"15min":1.484},"last":0.63100000000000001}]},{"osd":3,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.123,"15min":1.133},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.526,"5min":2.048,"15min":2.048},"last":1.169},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.28,"15min":1.2929999999999999},"min":{"1min":0.78900000000000003,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.583,"5min":2.617,"15min":2.617},"last":1.2130000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.3620000000000001,"15min":1.385},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.6919999999999999,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":1.093},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.2470000000000001,"15min":1.2549999999999999},"min":{"1min":0.85899999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.4930000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":0.879}]},{"osd":5,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.335,"15min":1.351},"min":{"1min":1.032,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.623,"5min":2.738,"15min":2.738},"last":1.056},{"interface":"front","average":{"1min":1.272,"5min":1.514,"15min":1.554},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.7230000000000001,"5min":4.0309999999999997,"15min":4.0309999999999997},"last":1.0289999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.583,"15min":1.611},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.9299999999999999,"5min":4.2240000000000002,"15min":4.2240000000000002},"last":1.121},{"interface":"front","average":{"1min":1.335,"5min":1.5169999999999999,"15min":1.5469999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.7709999999999999,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":1.258}]},{"osd":7,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.4379999999999999,"15min":1.4570000000000001},"min":{"1min":1.056,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.6359999999999999,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.6399999999999999,"15min":1.669},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.8799999999999999,"5min":4.3570000000000002,"15min":4.3570000000000002},"last":1.234}]}]},{"osd":0,"up_from":14,"seq":60129542176,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10228,"kb_used_data":1196,"kb_used_omap":0,"kb_used_meta":9024,"kb_avail":94361612,"statfs":{"total":96636764160,"available":96626290688,"internally_reserved":0,"allocated":1224704,"data_stored":876331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9240576},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.86899999999999999,"15min":0.878},"min":{"1min":0.52700000000000002,"5min":0.439,"15min":0.439},"max":{"1min":1.1359999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.997,"15min":1.0109999999999999},"min":{"1min":0.64500000000000002,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.4079999999999999,"5min":1.7,"15min":1.7},"last":1.046}]},{"osd":2,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.042,"15min":1.052},"min":{"1min":0.61599999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.282,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.92200000000000004,"15min":0.92400000000000004},"min":{"1min":0.61199999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.67200000000000004}]},{"osd":3,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.0640000000000001,"15min":1.0760000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.218,"5min":1.238,"15min":1.2410000000000001},"min":{"1min":0.80200000000000005,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.8089999999999999,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.85199999999999998}]},{"osd":4,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.3300000000000001,"15min":1.3440000000000001},"min":{"1min":0.89200000000000002,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.8100000000000001,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.234,"5min":1.377,"15min":1.401},"min":{"1min":0.86799999999999999,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.758,"5min":3.1629999999999998,"15min":3.1629999999999998},"last":0.79400000000000004}]},{"osd":5,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.361,"15min":1.363},"min":{"1min":0.871,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":2.1739999999999999,"5min":2.23,"15min":2.23},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.298,"5min":1.4019999999999999,"15min":1.4199999999999999},"min":{"1min":0.89500000000000002,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.845,"5min":2.266,"15min":2.266},"last":0.97199999999999998}]},{"osd":6,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.498,"15min":1.516},"min":{"1min":0.93300000000000005,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.9490000000000001,"5min":2.4060000000000001,"15min":2.4060000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.4830000000000001,"15min":1.5},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.7969999999999999,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":0.92000000000000004}]},{"osd":7,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.5109999999999999,"15min":1.5209999999999999},"min":{"1min":1.1439999999999999,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":2.0600000000000001,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.554,"15min":1.573},"min":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":2.3029999999999999,"5min":2.6040000000000001,"15min":2.6040000000000001},"last":1.171}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:58:56.518 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:58:56.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.731+0000 7f2880bb1700 1 Processor -- start 2023-11-28T11:58:56.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.731+0000 7f2880bb1700 1 -- start start 2023-11-28T11:58:56.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.735+0000 7f2880bb1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f287c156790 0x7f287c0cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:56.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.735+0000 7f2880bb1700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f287c156b60 0x7f287c0ce000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:56.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.735+0000 7f2880bb1700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f287c15fea0 0x7f287c160320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:56.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.735+0000 7f2880bb1700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f287c160860 con 0x7f287c15fea0 2023-11-28T11:58:56.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.735+0000 7f2880bb1700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f287c0ce540 con 0x7f287c156b60 2023-11-28T11:58:56.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.735+0000 7f2880bb1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287c06b0d0 con 0x7f287c156790 2023-11-28T11:58:56.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.735+0000 7f287ad9d700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f287c15fea0 0x7f287c160320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:56.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.735+0000 7f287a59c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f287c156790 0x7f287c0cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:56.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.735+0000 7f2879d9b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f287c156b60 0x7f287c0ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:56.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.735+0000 7f287a59c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f287c156790 0x7f287c0cc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:34262/0 (socket says 172.21.15.39:34262) 2023-11-28T11:58:56.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.735+0000 7f287a59c700 1 -- 172.21.15.39:0/694690995 learned_addr learned my addr 172.21.15.39:0/694690995 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:56.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.735+0000 7f2879d9b700 1 -- 172.21.15.39:0/694690995 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f287c156790 msgr2=0x7f287c0cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:56.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.735+0000 7f2879d9b700 1 --2- 172.21.15.39:0/694690995 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f287c156790 0x7f287c0cc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:56.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.735+0000 7f2879d9b700 1 -- 172.21.15.39:0/694690995 >> v2:172.21.15.39:3300/0 conn(0x7f287c15fea0 msgr2=0x7f287c160320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:56.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.735+0000 7f2879d9b700 1 --2- 172.21.15.39:0/694690995 >> v2:172.21.15.39:3300/0 conn(0x7f287c15fea0 0x7f287c160320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:56.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.735+0000 7f2879d9b700 1 -- 172.21.15.39:0/694690995 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287c06b560 con 0x7f287c156b60 2023-11-28T11:58:56.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.739+0000 7f2879d9b700 1 --2- 172.21.15.39:0/694690995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f287c156b60 0x7f287c0ce000 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f287c06b970 tx=0x7f2870009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fe2ea0e155edf1e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:56.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.739+0000 7f287959a700 1 -- 172.21.15.39:0/694690995 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2870011830 con 0x7f287c156b60 2023-11-28T11:58:56.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.739+0000 7f287959a700 1 -- 172.21.15.39:0/694690995 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2870011990 con 0x7f287c156b60 2023-11-28T11:58:56.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.739+0000 7f287959a700 1 -- 172.21.15.39:0/694690995 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2870011d20 con 0x7f287c156b60 2023-11-28T11:58:56.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.739+0000 7f2880bb1700 1 -- 172.21.15.39:0/694690995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f287c156b60 msgr2=0x7f287c0ce000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:56.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.739+0000 7f2880bb1700 1 --2- 172.21.15.39:0/694690995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f287c156b60 0x7f287c0ce000 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f287c06b970 tx=0x7f2870009b30 comp rx=0 tx=0).stop 2023-11-28T11:58:56.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.739+0000 7f2880bb1700 1 -- 172.21.15.39:0/694690995 shutdown_connections 2023-11-28T11:58:56.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.739+0000 7f2880bb1700 1 --2- 172.21.15.39:0/694690995 >> v2:172.21.15.39:3300/0 conn(0x7f287c15fea0 0x7f287c160320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:56.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.739+0000 7f2880bb1700 1 --2- 172.21.15.39:0/694690995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f287c156b60 0x7f287c0ce000 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:56.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.739+0000 7f2880bb1700 1 --2- 172.21.15.39:0/694690995 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f287c156790 0x7f287c0cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:56.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.739+0000 7f2880bb1700 1 -- 172.21.15.39:0/694690995 >> 172.21.15.39:0/694690995 conn(0x7f287c0cf350 msgr2=0x7f287c0b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:56.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.739+0000 7f2880bb1700 1 -- 172.21.15.39:0/694690995 shutdown_connections 2023-11-28T11:58:56.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.739+0000 7f2880bb1700 1 -- 172.21.15.39:0/694690995 wait complete. 2023-11-28T11:58:56.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.743+0000 7f2880bb1700 1 Processor -- start 2023-11-28T11:58:56.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.743+0000 7f2880bb1700 1 -- start start 2023-11-28T11:58:56.747 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.743+0000 7f2880bb1700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f287c156790 0x7f287c147950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:56.747 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.743+0000 7f2880bb1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f287c156b60 0x7f287c1f50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:56.747 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.743+0000 7f2880bb1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f287c15fea0 0x7f287c0ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:56.747 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.743+0000 7f2880bb1700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c0b1900 con 0x7f287c156790 2023-11-28T11:58:56.747 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.743+0000 7f2880bb1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c1f5f90 con 0x7f287c156b60 2023-11-28T11:58:56.747 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.743+0000 7f2880bb1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287c1f59d0 con 0x7f287c15fea0 2023-11-28T11:58:56.747 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.743+0000 7f287a59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f287c156790 0x7f287c147950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:56.747 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.743+0000 7f287a59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f287c156790 0x7f287c147950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43830/0 (socket says 172.21.15.39:43830) 2023-11-28T11:58:56.748 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.743+0000 7f287a59c700 1 -- 172.21.15.39:0/1126330921 learned_addr learned my addr 172.21.15.39:0/1126330921 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:56.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.743+0000 7f2879d9b700 1 --2- 172.21.15.39:0/1126330921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f287c156b60 0x7f287c1f50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:56.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.743+0000 7f287ad9d700 1 --2- 172.21.15.39:0/1126330921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f287c15fea0 0x7f287c0ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:56.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.743+0000 7f287a59c700 1 -- 172.21.15.39:0/1126330921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f287c15fea0 msgr2=0x7f287c0ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:56.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.743+0000 7f287a59c700 1 --2- 172.21.15.39:0/1126330921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f287c15fea0 0x7f287c0ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:56.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.743+0000 7f287a59c700 1 -- 172.21.15.39:0/1126330921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f287c156b60 msgr2=0x7f287c1f50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:56.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.743+0000 7f287a59c700 1 --2- 172.21.15.39:0/1126330921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f287c156b60 0x7f287c1f50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:56.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.743+0000 7f287a59c700 1 -- 172.21.15.39:0/1126330921 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28700094b0 con 0x7f287c156790 2023-11-28T11:58:56.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.743+0000 7f287ad9d700 1 --2- 172.21.15.39:0/1126330921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f287c15fea0 0x7f287c0ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:58:56.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.747+0000 7f287a59c700 1 --2- 172.21.15.39:0/1126330921 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f287c156790 0x7f287c147950 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f286c00e8b0 tx=0x7f286c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:56.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.747+0000 7f286affd700 1 -- 172.21.15.39:0/1126330921 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c00eeb0 con 0x7f287c156790 2023-11-28T11:58:56.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.747+0000 7f286affd700 1 -- 172.21.15.39:0/1126330921 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286c00c850 con 0x7f287c156790 2023-11-28T11:58:56.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.747+0000 7f2880bb1700 1 -- 172.21.15.39:0/1126330921 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f287c06a7a0 con 0x7f287c156790 2023-11-28T11:58:56.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.747+0000 7f286affd700 1 -- 172.21.15.39:0/1126330921 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c00cbc0 con 0x7f287c156790 2023-11-28T11:58:56.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.747+0000 7f2880bb1700 1 -- 172.21.15.39:0/1126330921 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f287c0cc990 con 0x7f287c156790 2023-11-28T11:58:56.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.747+0000 7f2880bb1700 1 -- 172.21.15.39:0/1126330921 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f287c06aa80 con 0x7f287c156790 2023-11-28T11:58:56.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.751+0000 7f286affd700 1 -- 172.21.15.39:0/1126330921 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f286c023070 con 0x7f287c156790 2023-11-28T11:58:56.754 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.751+0000 7f286affd700 1 --2- 172.21.15.39:0/1126330921 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f285c064ee0 0x7f285c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:56.754 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.751+0000 7f286affd700 1 -- 172.21.15.39:0/1126330921 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f286c082300 con 0x7f287c156790 2023-11-28T11:58:56.754 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.751+0000 7f2879d9b700 1 --2- 172.21.15.39:0/1126330921 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f285c064ee0 0x7f285c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:56.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.751+0000 7f2879d9b700 1 --2- 172.21.15.39:0/1126330921 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f285c064ee0 0x7f285c067390 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2870000c00 tx=0x7f2870008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:56.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.755+0000 7f286affd700 1 -- 172.21.15.39:0/1126330921 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f286c050210 con 0x7f287c156790 2023-11-28T11:58:56.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.931+0000 7f2880bb1700 1 -- 172.21.15.39:0/1126330921 --> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f287c0b1a40 con 0x7f285c064ee0 2023-11-28T11:58:56.950 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.947+0000 7f286affd700 1 -- 172.21.15.39:0/1126330921 <== mgr.4104 v2:172.21.15.184:6832/36166 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306730 (secure 0 0 0) 0x7f2870011b80 con 0x7f285c064ee0 2023-11-28T11:58:56.954 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:58:56.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.955+0000 7f2880bb1700 1 -- 172.21.15.39:0/1126330921 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f285c064ee0 msgr2=0x7f285c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:56.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.959+0000 7f2880bb1700 1 --2- 172.21.15.39:0/1126330921 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f285c064ee0 0x7f285c067390 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2870000c00 tx=0x7f2870008030 comp rx=0 tx=0).stop 2023-11-28T11:58:56.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.959+0000 7f2880bb1700 1 -- 172.21.15.39:0/1126330921 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f287c156790 msgr2=0x7f287c147950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:56.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.959+0000 7f2880bb1700 1 --2- 172.21.15.39:0/1126330921 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f287c156790 0x7f287c147950 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f286c00e8b0 tx=0x7f286c00ec70 comp rx=0 tx=0).stop 2023-11-28T11:58:56.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.959+0000 7f2880bb1700 1 -- 172.21.15.39:0/1126330921 shutdown_connections 2023-11-28T11:58:56.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.959+0000 7f2880bb1700 1 --2- 172.21.15.39:0/1126330921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f287c15fea0 0x7f287c0ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:56.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.959+0000 7f2880bb1700 1 --2- 172.21.15.39:0/1126330921 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f285c064ee0 0x7f285c067390 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:56.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.959+0000 7f2880bb1700 1 --2- 172.21.15.39:0/1126330921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f287c156b60 0x7f287c1f50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:56.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.959+0000 7f2880bb1700 1 --2- 172.21.15.39:0/1126330921 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f287c156790 0x7f287c147950 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:56.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.959+0000 7f2880bb1700 1 -- 172.21.15.39:0/1126330921 >> 172.21.15.39:0/1126330921 conn(0x7f287c0cf350 msgr2=0x7f287c06cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:56.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.959+0000 7f2880bb1700 1 -- 172.21.15.39:0/1126330921 shutdown_connections 2023-11-28T11:58:56.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:56.959+0000 7f2880bb1700 1 -- 172.21.15.39:0/1126330921 wait complete. 2023-11-28T11:58:56.963 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2023-11-28T11:58:56.981 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2023-11-28T11:58:56.599431+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591024,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":185,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":89,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":79688,"kb_used_data":6344,"kb_used_omap":0,"kb_used_meta":73280,"kb_avail":754895032,"statfs":{"total":773094113280,"available":773012512768,"internally_reserved":0,"allocated":6496256,"data_stored":3592505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":75038720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":656,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002186"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:52.660808+0000","last_change":"2023-11-28T11:58:51.667755+0000","last_active":"2023-11-28T11:58:52.660808+0000","last_peered":"2023-11-28T11:58:52.660808+0000","last_clean":"2023-11-28T11:58:52.660808+0000","last_became_active":"2023-11-28T11:58:51.667513+0000","last_became_peered":"2023-11-28T11:58:51.667513+0000","last_unstale":"2023-11-28T11:58:52.660808+0000","last_undegraded":"2023-11-28T11:58:52.660808+0000","last_fullsized":"2023-11-28T11:58:52.660808+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:39:53.174032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.180906+0000","last_change":"2023-11-28T11:58:51.180906+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.180906+0000","last_undegraded":"2023-11-28T11:58:51.180906+0000","last_fullsized":"2023-11-28T11:58:51.180906+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:47:10.246224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.662021+0000","last_change":"2023-11-28T11:58:51.662021+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.662021+0000","last_undegraded":"2023-11-28T11:58:51.662021+0000","last_fullsized":"2023-11-28T11:58:51.662021+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:53:49.319201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.656796+0000","last_change":"2023-11-28T11:58:51.656796+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.656796+0000","last_undegraded":"2023-11-28T11:58:51.656796+0000","last_fullsized":"2023-11-28T11:58:51.656796+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:37:13.495875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:52.660267+0000","last_change":"2023-11-28T11:58:51.673108+0000","last_active":"2023-11-28T11:58:52.660267+0000","last_peered":"2023-11-28T11:58:52.660267+0000","last_clean":"2023-11-28T11:58:52.660267+0000","last_became_active":"2023-11-28T11:58:51.671231+0000","last_became_peered":"2023-11-28T11:58:51.671231+0000","last_unstale":"2023-11-28T11:58:52.660267+0000","last_undegraded":"2023-11-28T11:58:52.660267+0000","last_fullsized":"2023-11-28T11:58:52.660267+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:07:32.065825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:53.159544+0000","last_change":"2023-11-28T11:58:51.665930+0000","last_active":"2023-11-28T11:58:53.159544+0000","last_peered":"2023-11-28T11:58:53.159544+0000","last_clean":"2023-11-28T11:58:53.159544+0000","last_became_active":"2023-11-28T11:58:51.665680+0000","last_became_peered":"2023-11-28T11:58:51.665680+0000","last_unstale":"2023-11-28T11:58:53.159544+0000","last_undegraded":"2023-11-28T11:58:53.159544+0000","last_fullsized":"2023-11-28T11:58:53.159544+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:04:14.466873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.167375+0000","last_change":"2023-11-28T11:58:51.167375+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.167375+0000","last_undegraded":"2023-11-28T11:58:51.167375+0000","last_fullsized":"2023-11-28T11:58:51.167375+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:23:30.095986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.181470+0000","last_change":"2023-11-28T11:58:51.181470+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.181470+0000","last_undegraded":"2023-11-28T11:58:51.181470+0000","last_fullsized":"2023-11-28T11:58:51.181470+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:04:34.153300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.166525+0000","last_change":"2023-11-28T11:58:51.166525+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.166525+0000","last_undegraded":"2023-11-28T11:58:51.166525+0000","last_fullsized":"2023-11-28T11:58:51.166525+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:37:13.495875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.176434+0000","last_change":"2023-11-28T11:58:51.176434+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.176434+0000","last_undegraded":"2023-11-28T11:58:51.176434+0000","last_fullsized":"2023-11-28T11:58:51.176434+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:04:56.514139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.176265+0000","last_change":"2023-11-28T11:58:51.176265+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.176265+0000","last_undegraded":"2023-11-28T11:58:51.176265+0000","last_fullsized":"2023-11-28T11:58:51.176265+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:22.086240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.657117+0000","last_change":"2023-11-28T11:58:51.657117+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.657117+0000","last_undegraded":"2023-11-28T11:58:51.657117+0000","last_fullsized":"2023-11-28T11:58:51.657117+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:05:25.321914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.649448+0000","last_change":"2023-11-28T11:58:51.649448+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.649448+0000","last_undegraded":"2023-11-28T11:58:51.649448+0000","last_fullsized":"2023-11-28T11:58:51.649448+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:47:19.620359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":["6","0"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.167346+0000","last_change":"2023-11-28T11:58:51.167346+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.167346+0000","last_undegraded":"2023-11-28T11:58:51.167346+0000","last_fullsized":"2023-11-28T11:58:51.167346+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:20:26.402257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.166897+0000","last_change":"2023-11-28T11:58:51.166897+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.166897+0000","last_undegraded":"2023-11-28T11:58:51.166897+0000","last_fullsized":"2023-11-28T11:58:51.166897+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:31:57.919489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:53.159390+0000","last_change":"2023-11-28T11:58:51.657821+0000","last_active":"2023-11-28T11:58:53.159390+0000","last_peered":"2023-11-28T11:58:53.159390+0000","last_clean":"2023-11-28T11:58:53.159390+0000","last_became_active":"2023-11-28T11:58:51.657561+0000","last_became_peered":"2023-11-28T11:58:51.657561+0000","last_unstale":"2023-11-28T11:58:53.159390+0000","last_undegraded":"2023-11-28T11:58:53.159390+0000","last_fullsized":"2023-11-28T11:58:53.159390+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:43:55.215996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.180775+0000","last_change":"2023-11-28T11:58:51.180775+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.180775+0000","last_undegraded":"2023-11-28T11:58:51.180775+0000","last_fullsized":"2023-11-28T11:58:51.180775+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:21:34.475958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.660726+0000","last_change":"2023-11-28T11:58:51.660726+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.660726+0000","last_undegraded":"2023-11-28T11:58:51.660726+0000","last_fullsized":"2023-11-28T11:58:51.660726+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:05:25.321914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":["7","0"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:52.660438+0000","last_change":"2023-11-28T11:58:51.668558+0000","last_active":"2023-11-28T11:58:52.660438+0000","last_peered":"2023-11-28T11:58:52.660438+0000","last_clean":"2023-11-28T11:58:52.660438+0000","last_became_active":"2023-11-28T11:58:51.668252+0000","last_became_peered":"2023-11-28T11:58:51.668252+0000","last_unstale":"2023-11-28T11:58:52.660438+0000","last_undegraded":"2023-11-28T11:58:52.660438+0000","last_fullsized":"2023-11-28T11:58:52.660438+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:04:19.289140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.177158+0000","last_change":"2023-11-28T11:58:51.177158+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.177158+0000","last_undegraded":"2023-11-28T11:58:51.177158+0000","last_fullsized":"2023-11-28T11:58:51.177158+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:23:19.193646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.659009+0000","last_change":"2023-11-28T11:58:51.659009+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.659009+0000","last_undegraded":"2023-11-28T11:58:51.659009+0000","last_fullsized":"2023-11-28T11:58:51.659009+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:28:12.186813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.177078+0000","last_change":"2023-11-28T11:58:51.177078+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.177078+0000","last_undegraded":"2023-11-28T11:58:51.177078+0000","last_fullsized":"2023-11-28T11:58:51.177078+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:48:03.508051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.659105+0000","last_change":"2023-11-28T11:58:51.659105+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.659105+0000","last_undegraded":"2023-11-28T11:58:51.659105+0000","last_fullsized":"2023-11-28T11:58:51.659105+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:36:20.149308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.648893+0000","last_change":"2023-11-28T11:58:51.648893+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.648893+0000","last_undegraded":"2023-11-28T11:58:51.648893+0000","last_fullsized":"2023-11-28T11:58:51.648893+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:22.086240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":["6","0"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:52.660798+0000","last_change":"2023-11-28T11:58:51.678822+0000","last_active":"2023-11-28T11:58:52.660798+0000","last_peered":"2023-11-28T11:58:52.660798+0000","last_clean":"2023-11-28T11:58:52.660798+0000","last_became_active":"2023-11-28T11:58:51.678250+0000","last_became_peered":"2023-11-28T11:58:51.678250+0000","last_unstale":"2023-11-28T11:58:52.660798+0000","last_undegraded":"2023-11-28T11:58:52.660798+0000","last_fullsized":"2023-11-28T11:58:52.660798+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:00:20.015581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.656897+0000","last_change":"2023-11-28T11:58:51.656897+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.656897+0000","last_undegraded":"2023-11-28T11:58:51.656897+0000","last_fullsized":"2023-11-28T11:58:51.656897+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:03:49.327209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":["5","4"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:53.160441+0000","last_change":"2023-11-28T11:58:51.662109+0000","last_active":"2023-11-28T11:58:53.160441+0000","last_peered":"2023-11-28T11:58:53.160441+0000","last_clean":"2023-11-28T11:58:53.160441+0000","last_became_active":"2023-11-28T11:58:51.658574+0000","last_became_peered":"2023-11-28T11:58:51.658574+0000","last_unstale":"2023-11-28T11:58:53.160441+0000","last_undegraded":"2023-11-28T11:58:53.160441+0000","last_fullsized":"2023-11-28T11:58:53.160441+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:08:13.836696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:52.660478+0000","last_change":"2023-11-28T11:58:51.672130+0000","last_active":"2023-11-28T11:58:52.660478+0000","last_peered":"2023-11-28T11:58:52.660478+0000","last_clean":"2023-11-28T11:58:52.660478+0000","last_became_active":"2023-11-28T11:58:51.671137+0000","last_became_peered":"2023-11-28T11:58:51.671137+0000","last_unstale":"2023-11-28T11:58:52.660478+0000","last_undegraded":"2023-11-28T11:58:52.660478+0000","last_fullsized":"2023-11-28T11:58:52.660478+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:12:05.660571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.172715+0000","last_change":"2023-11-28T11:58:51.172715+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.172715+0000","last_undegraded":"2023-11-28T11:58:51.172715+0000","last_fullsized":"2023-11-28T11:58:51.172715+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:42:12.056606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.659077+0000","last_change":"2023-11-28T11:58:51.659077+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.659077+0000","last_undegraded":"2023-11-28T11:58:51.659077+0000","last_fullsized":"2023-11-28T11:58:51.659077+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:37:13.495875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:52.660018+0000","last_change":"2023-11-28T11:58:51.669901+0000","last_active":"2023-11-28T11:58:52.660018+0000","last_peered":"2023-11-28T11:58:52.660018+0000","last_clean":"2023-11-28T11:58:52.660018+0000","last_became_active":"2023-11-28T11:58:51.669260+0000","last_became_peered":"2023-11-28T11:58:51.669260+0000","last_unstale":"2023-11-28T11:58:52.660018+0000","last_undegraded":"2023-11-28T11:58:52.660018+0000","last_fullsized":"2023-11-28T11:58:52.660018+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:54:31.914532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:53.159462+0000","last_change":"2023-11-28T11:58:51.671474+0000","last_active":"2023-11-28T11:58:53.159462+0000","last_peered":"2023-11-28T11:58:53.159462+0000","last_clean":"2023-11-28T11:58:53.159462+0000","last_became_active":"2023-11-28T11:58:51.670978+0000","last_became_peered":"2023-11-28T11:58:51.670978+0000","last_unstale":"2023-11-28T11:58:53.159462+0000","last_undegraded":"2023-11-28T11:58:53.159462+0000","last_fullsized":"2023-11-28T11:58:53.159462+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:03:19.954423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:53.161425+0000","last_change":"2023-11-28T11:58:51.672350+0000","last_active":"2023-11-28T11:58:53.161425+0000","last_peered":"2023-11-28T11:58:53.161425+0000","last_clean":"2023-11-28T11:58:53.161425+0000","last_became_active":"2023-11-28T11:58:51.672065+0000","last_became_peered":"2023-11-28T11:58:51.672065+0000","last_unstale":"2023-11-28T11:58:53.161425+0000","last_undegraded":"2023-11-28T11:58:53.161425+0000","last_fullsized":"2023-11-28T11:58:53.161425+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:51:14.342111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"57'4","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.680245+0000","last_change":"2023-11-28T11:58:51.187075+0000","last_active":"2023-11-28T11:58:51.680245+0000","last_peered":"2023-11-28T11:58:51.680245+0000","last_clean":"2023-11-28T11:58:51.680245+0000","last_became_active":"2023-11-28T11:58:51.186745+0000","last_became_peered":"2023-11-28T11:58:51.186745+0000","last_unstale":"2023-11-28T11:58:51.680245+0000","last_undegraded":"2023-11-28T11:58:51.680245+0000","last_fullsized":"2023-11-28T11:58:51.680245+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:53:15.246374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.175693+0000","last_change":"2023-11-28T11:58:51.175693+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.175693+0000","last_undegraded":"2023-11-28T11:58:51.175693+0000","last_fullsized":"2023-11-28T11:58:51.175693+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:36:59.737858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.190539+0000","last_change":"2023-11-28T11:58:51.177136+0000","last_active":"2023-11-28T11:58:51.190539+0000","last_peered":"2023-11-28T11:58:51.190539+0000","last_clean":"2023-11-28T11:58:51.190539+0000","last_became_active":"2023-11-28T11:58:51.176824+0000","last_became_peered":"2023-11-28T11:58:51.176824+0000","last_unstale":"2023-11-28T11:58:51.190539+0000","last_undegraded":"2023-11-28T11:58:51.190539+0000","last_fullsized":"2023-11-28T11:58:51.190539+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:32:18.747280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:53.160565+0000","last_change":"2023-11-28T11:58:51.662526+0000","last_active":"2023-11-28T11:58:53.160565+0000","last_peered":"2023-11-28T11:58:53.160565+0000","last_clean":"2023-11-28T11:58:53.160565+0000","last_became_active":"2023-11-28T11:58:51.662293+0000","last_became_peered":"2023-11-28T11:58:51.662293+0000","last_unstale":"2023-11-28T11:58:53.160565+0000","last_undegraded":"2023-11-28T11:58:53.160565+0000","last_fullsized":"2023-11-28T11:58:53.160565+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:52:06.479074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"57'2","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.682862+0000","last_change":"2023-11-28T11:58:51.187837+0000","last_active":"2023-11-28T11:58:51.682862+0000","last_peered":"2023-11-28T11:58:51.682862+0000","last_clean":"2023-11-28T11:58:51.682862+0000","last_became_active":"2023-11-28T11:58:51.187147+0000","last_became_peered":"2023-11-28T11:58:51.187147+0000","last_unstale":"2023-11-28T11:58:51.682862+0000","last_undegraded":"2023-11-28T11:58:51.682862+0000","last_fullsized":"2023-11-28T11:58:51.682862+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:16:05.197854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:53.161235+0000","last_change":"2023-11-28T11:58:51.678151+0000","last_active":"2023-11-28T11:58:53.161235+0000","last_peered":"2023-11-28T11:58:53.161235+0000","last_clean":"2023-11-28T11:58:53.161235+0000","last_became_active":"2023-11-28T11:58:51.677796+0000","last_became_peered":"2023-11-28T11:58:51.677796+0000","last_unstale":"2023-11-28T11:58:53.161235+0000","last_undegraded":"2023-11-28T11:58:53.161235+0000","last_fullsized":"2023-11-28T11:58:53.161235+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:57:14.978843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.183323+0000","last_change":"2023-11-28T11:58:51.179001+0000","last_active":"2023-11-28T11:58:51.183323+0000","last_peered":"2023-11-28T11:58:51.183323+0000","last_clean":"2023-11-28T11:58:51.183323+0000","last_became_active":"2023-11-28T11:58:51.178671+0000","last_became_peered":"2023-11-28T11:58:51.178671+0000","last_unstale":"2023-11-28T11:58:51.183323+0000","last_undegraded":"2023-11-28T11:58:51.183323+0000","last_fullsized":"2023-11-28T11:58:51.183323+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:48:41.050307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.172305+0000","last_change":"2023-11-28T11:58:51.172305+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.172305+0000","last_undegraded":"2023-11-28T11:58:51.172305+0000","last_fullsized":"2023-11-28T11:58:51.172305+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:31:00.537286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.193474+0000","last_change":"2023-11-28T11:58:51.192459+0000","last_active":"2023-11-28T11:58:51.193474+0000","last_peered":"2023-11-28T11:58:51.193474+0000","last_clean":"2023-11-28T11:58:51.193474+0000","last_became_active":"2023-11-28T11:58:51.192125+0000","last_became_peered":"2023-11-28T11:58:51.192125+0000","last_unstale":"2023-11-28T11:58:51.193474+0000","last_undegraded":"2023-11-28T11:58:51.193474+0000","last_fullsized":"2023-11-28T11:58:51.193474+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:25:16.499893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.172180+0000","last_change":"2023-11-28T11:58:51.172180+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.172180+0000","last_undegraded":"2023-11-28T11:58:51.172180+0000","last_fullsized":"2023-11-28T11:58:51.172180+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:21:32.139383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"57'1","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.674380+0000","last_change":"2023-11-28T11:58:51.184709+0000","last_active":"2023-11-28T11:58:51.674380+0000","last_peered":"2023-11-28T11:58:51.674380+0000","last_clean":"2023-11-28T11:58:51.674380+0000","last_became_active":"2023-11-28T11:58:51.183903+0000","last_became_peered":"2023-11-28T11:58:51.183903+0000","last_unstale":"2023-11-28T11:58:51.674380+0000","last_undegraded":"2023-11-28T11:58:51.674380+0000","last_fullsized":"2023-11-28T11:58:51.674380+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:08:06.627993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.648861+0000","last_change":"2023-11-28T11:58:51.648861+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.648861+0000","last_undegraded":"2023-11-28T11:58:51.648861+0000","last_fullsized":"2023-11-28T11:58:51.648861+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:04:56.514139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":["6","7"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.180871+0000","last_change":"2023-11-28T11:58:51.176988+0000","last_active":"2023-11-28T11:58:51.180871+0000","last_peered":"2023-11-28T11:58:51.180871+0000","last_clean":"2023-11-28T11:58:51.180871+0000","last_became_active":"2023-11-28T11:58:51.176713+0000","last_became_peered":"2023-11-28T11:58:51.176713+0000","last_unstale":"2023-11-28T11:58:51.180871+0000","last_undegraded":"2023-11-28T11:58:51.180871+0000","last_fullsized":"2023-11-28T11:58:51.180871+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:27:32.752868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.172332+0000","last_change":"2023-11-28T11:58:51.172332+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.172332+0000","last_undegraded":"2023-11-28T11:58:51.172332+0000","last_fullsized":"2023-11-28T11:58:51.172332+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:12:51.007363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.185539+0000","last_change":"2023-11-28T11:58:51.184233+0000","last_active":"2023-11-28T11:58:51.185539+0000","last_peered":"2023-11-28T11:58:51.185539+0000","last_clean":"2023-11-28T11:58:51.185539+0000","last_became_active":"2023-11-28T11:58:51.183942+0000","last_became_peered":"2023-11-28T11:58:51.183942+0000","last_unstale":"2023-11-28T11:58:51.185539+0000","last_undegraded":"2023-11-28T11:58:51.185539+0000","last_fullsized":"2023-11-28T11:58:51.185539+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:36:19.127665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.166354+0000","last_change":"2023-11-28T11:58:51.166354+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.166354+0000","last_undegraded":"2023-11-28T11:58:51.166354+0000","last_fullsized":"2023-11-28T11:58:51.166354+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:16:01.044656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.661726+0000","last_change":"2023-11-28T11:58:51.176310+0000","last_active":"2023-11-28T11:58:51.661726+0000","last_peered":"2023-11-28T11:58:51.661726+0000","last_clean":"2023-11-28T11:58:51.661726+0000","last_became_active":"2023-11-28T11:58:51.176047+0000","last_became_peered":"2023-11-28T11:58:51.176047+0000","last_unstale":"2023-11-28T11:58:51.661726+0000","last_undegraded":"2023-11-28T11:58:51.661726+0000","last_fullsized":"2023-11-28T11:58:51.661726+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:47:18.598716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.661507+0000","last_change":"2023-11-28T11:58:51.661507+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.661507+0000","last_undegraded":"2023-11-28T11:58:51.661507+0000","last_fullsized":"2023-11-28T11:58:51.661507+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:23.788694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.196955+0000","last_change":"2023-11-28T11:58:51.194390+0000","last_active":"2023-11-28T11:58:51.196955+0000","last_peered":"2023-11-28T11:58:51.196955+0000","last_clean":"2023-11-28T11:58:51.196955+0000","last_became_active":"2023-11-28T11:58:51.193968+0000","last_became_peered":"2023-11-28T11:58:51.193968+0000","last_unstale":"2023-11-28T11:58:51.196955+0000","last_undegraded":"2023-11-28T11:58:51.196955+0000","last_fullsized":"2023-11-28T11:58:51.196955+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:05:24.300271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.178014+0000","last_change":"2023-11-28T11:58:51.178014+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.178014+0000","last_undegraded":"2023-11-28T11:58:51.178014+0000","last_fullsized":"2023-11-28T11:58:51.178014+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:14:29.875840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"57'3","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.663582+0000","last_change":"2023-11-28T11:58:51.170686+0000","last_active":"2023-11-28T11:58:51.663582+0000","last_peered":"2023-11-28T11:58:51.663582+0000","last_clean":"2023-11-28T11:58:51.663582+0000","last_became_active":"2023-11-28T11:58:51.170416+0000","last_became_peered":"2023-11-28T11:58:51.170416+0000","last_unstale":"2023-11-28T11:58:51.663582+0000","last_undegraded":"2023-11-28T11:58:51.663582+0000","last_fullsized":"2023-11-28T11:58:51.663582+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:21.064597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.664974+0000","last_change":"2023-11-28T11:58:51.664974+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.664974+0000","last_undegraded":"2023-11-28T11:58:51.664974+0000","last_fullsized":"2023-11-28T11:58:51.664974+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:03:49.327209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.184215+0000","last_change":"2023-11-28T11:58:51.182690+0000","last_active":"2023-11-28T11:58:51.184215+0000","last_peered":"2023-11-28T11:58:51.184215+0000","last_clean":"2023-11-28T11:58:51.184215+0000","last_became_active":"2023-11-28T11:58:51.182414+0000","last_became_peered":"2023-11-28T11:58:51.182414+0000","last_unstale":"2023-11-28T11:58:51.184215+0000","last_undegraded":"2023-11-28T11:58:51.184215+0000","last_fullsized":"2023-11-28T11:58:51.184215+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:28:11.165170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.656296+0000","last_change":"2023-11-28T11:58:51.656296+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.656296+0000","last_undegraded":"2023-11-28T11:58:51.656296+0000","last_fullsized":"2023-11-28T11:58:51.656296+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:17:04.728611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.196119+0000","last_change":"2023-11-28T11:58:51.192204+0000","last_active":"2023-11-28T11:58:51.196119+0000","last_peered":"2023-11-28T11:58:51.196119+0000","last_clean":"2023-11-28T11:58:51.196119+0000","last_became_active":"2023-11-28T11:58:51.191886+0000","last_became_peered":"2023-11-28T11:58:51.191886+0000","last_unstale":"2023-11-28T11:58:51.196119+0000","last_undegraded":"2023-11-28T11:58:51.196119+0000","last_fullsized":"2023-11-28T11:58:51.196119+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:22.767051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.659384+0000","last_change":"2023-11-28T11:58:51.659384+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.659384+0000","last_undegraded":"2023-11-28T11:58:51.659384+0000","last_fullsized":"2023-11-28T11:58:51.659384+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:52.015075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.651612+0000","last_change":"2023-11-28T11:58:51.174956+0000","last_active":"2023-11-28T11:58:51.651612+0000","last_peered":"2023-11-28T11:58:51.651612+0000","last_clean":"2023-11-28T11:58:51.651612+0000","last_became_active":"2023-11-28T11:58:51.174655+0000","last_became_peered":"2023-11-28T11:58:51.174655+0000","last_unstale":"2023-11-28T11:58:51.651612+0000","last_undegraded":"2023-11-28T11:58:51.651612+0000","last_fullsized":"2023-11-28T11:58:51.651612+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:34:31.055864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.166710+0000","last_change":"2023-11-28T11:58:51.166710+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.166710+0000","last_undegraded":"2023-11-28T11:58:51.166710+0000","last_fullsized":"2023-11-28T11:58:51.166710+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:43:18.872444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.183356+0000","last_change":"2023-11-28T11:58:51.179067+0000","last_active":"2023-11-28T11:58:51.183356+0000","last_peered":"2023-11-28T11:58:51.183356+0000","last_clean":"2023-11-28T11:58:51.183356+0000","last_became_active":"2023-11-28T11:58:51.178790+0000","last_became_peered":"2023-11-28T11:58:51.178790+0000","last_unstale":"2023-11-28T11:58:51.183356+0000","last_undegraded":"2023-11-28T11:58:51.183356+0000","last_fullsized":"2023-11-28T11:58:51.183356+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:34.431609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.660022+0000","last_change":"2023-11-28T11:58:51.660022+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.660022+0000","last_undegraded":"2023-11-28T11:58:51.660022+0000","last_fullsized":"2023-11-28T11:58:51.660022+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:25:17.521536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"57'8","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.659390+0000","last_change":"2023-11-28T11:58:51.173895+0000","last_active":"2023-11-28T11:58:51.659390+0000","last_peered":"2023-11-28T11:58:51.659390+0000","last_clean":"2023-11-28T11:58:51.659390+0000","last_became_active":"2023-11-28T11:58:51.173611+0000","last_became_peered":"2023-11-28T11:58:51.173611+0000","last_unstale":"2023-11-28T11:58:51.659390+0000","last_undegraded":"2023-11-28T11:58:51.659390+0000","last_fullsized":"2023-11-28T11:58:51.659390+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:04:55.492496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.656545+0000","last_change":"2023-11-28T11:58:51.656545+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.656545+0000","last_undegraded":"2023-11-28T11:58:51.656545+0000","last_fullsized":"2023-11-28T11:58:51.656545+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:23:30.095986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.195185+0000","last_change":"2023-11-28T11:58:51.190105+0000","last_active":"2023-11-28T11:58:51.195185+0000","last_peered":"2023-11-28T11:58:51.195185+0000","last_clean":"2023-11-28T11:58:51.195185+0000","last_became_active":"2023-11-28T11:58:51.189836+0000","last_became_peered":"2023-11-28T11:58:51.189836+0000","last_unstale":"2023-11-28T11:58:51.195185+0000","last_undegraded":"2023-11-28T11:58:51.195185+0000","last_fullsized":"2023-11-28T11:58:51.195185+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:54:49.735542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.656711+0000","last_change":"2023-11-28T11:58:51.656711+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.656711+0000","last_undegraded":"2023-11-28T11:58:51.656711+0000","last_fullsized":"2023-11-28T11:58:51.656711+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:23.788694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.646467+0000","last_change":"2023-11-28T11:58:51.179702+0000","last_active":"2023-11-28T11:58:51.646467+0000","last_peered":"2023-11-28T11:58:51.646467+0000","last_clean":"2023-11-28T11:58:51.646467+0000","last_became_active":"2023-11-28T11:58:51.179426+0000","last_became_peered":"2023-11-28T11:58:51.179426+0000","last_unstale":"2023-11-28T11:58:51.646467+0000","last_undegraded":"2023-11-28T11:58:51.646467+0000","last_fullsized":"2023-11-28T11:58:51.646467+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:44:16.839236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.177495+0000","last_change":"2023-11-28T11:58:51.177495+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.177495+0000","last_undegraded":"2023-11-28T11:58:51.177495+0000","last_fullsized":"2023-11-28T11:58:51.177495+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:47:19.620359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.651613+0000","last_change":"2023-11-28T11:58:51.174876+0000","last_active":"2023-11-28T11:58:51.651613+0000","last_peered":"2023-11-28T11:58:51.651613+0000","last_clean":"2023-11-28T11:58:51.651613+0000","last_became_active":"2023-11-28T11:58:51.174567+0000","last_became_peered":"2023-11-28T11:58:51.174567+0000","last_unstale":"2023-11-28T11:58:51.651613+0000","last_undegraded":"2023-11-28T11:58:51.651613+0000","last_fullsized":"2023-11-28T11:58:51.651613+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:09:52.803813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:53.160782+0000","last_change":"2023-11-28T11:58:51.677710+0000","last_active":"2023-11-28T11:58:53.160782+0000","last_peered":"2023-11-28T11:58:53.160782+0000","last_clean":"2023-11-28T11:58:53.160782+0000","last_became_active":"2023-11-28T11:58:51.677389+0000","last_became_peered":"2023-11-28T11:58:51.677389+0000","last_unstale":"2023-11-28T11:58:53.160782+0000","last_undegraded":"2023-11-28T11:58:53.160782+0000","last_fullsized":"2023-11-28T11:58:53.160782+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:54:32.327688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.185067+0000","last_change":"2023-11-28T11:58:51.182292+0000","last_active":"2023-11-28T11:58:51.185067+0000","last_peered":"2023-11-28T11:58:51.185067+0000","last_clean":"2023-11-28T11:58:51.185067+0000","last_became_active":"2023-11-28T11:58:51.182019+0000","last_became_peered":"2023-11-28T11:58:51.182019+0000","last_unstale":"2023-11-28T11:58:51.185067+0000","last_undegraded":"2023-11-28T11:58:51.185067+0000","last_fullsized":"2023-11-28T11:58:51.185067+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:46:05.485633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.171366+0000","last_change":"2023-11-28T11:58:51.171366+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.171366+0000","last_undegraded":"2023-11-28T11:58:51.171366+0000","last_fullsized":"2023-11-28T11:58:51.171366+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:22:28.860678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.187472+0000","last_change":"2023-11-28T11:58:51.183963+0000","last_active":"2023-11-28T11:58:51.187472+0000","last_peered":"2023-11-28T11:58:51.187472+0000","last_clean":"2023-11-28T11:58:51.187472+0000","last_became_active":"2023-11-28T11:58:51.183704+0000","last_became_peered":"2023-11-28T11:58:51.183704+0000","last_unstale":"2023-11-28T11:58:51.187472+0000","last_undegraded":"2023-11-28T11:58:51.187472+0000","last_fullsized":"2023-11-28T11:58:51.187472+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:48:13.492030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.660689+0000","last_change":"2023-11-28T11:58:51.660689+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.660689+0000","last_undegraded":"2023-11-28T11:58:51.660689+0000","last_fullsized":"2023-11-28T11:58:51.660689+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:51:09.793929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.180661+0000","last_change":"2023-11-28T11:58:51.176569+0000","last_active":"2023-11-28T11:58:51.180661+0000","last_peered":"2023-11-28T11:58:51.180661+0000","last_clean":"2023-11-28T11:58:51.180661+0000","last_became_active":"2023-11-28T11:58:51.176264+0000","last_became_peered":"2023-11-28T11:58:51.176264+0000","last_unstale":"2023-11-28T11:58:51.180661+0000","last_undegraded":"2023-11-28T11:58:51.180661+0000","last_fullsized":"2023-11-28T11:58:51.180661+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:51:08.772287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.175011+0000","last_change":"2023-11-28T11:58:51.175011+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.175011+0000","last_undegraded":"2023-11-28T11:58:51.175011+0000","last_fullsized":"2023-11-28T11:58:51.175011+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:47:15.134857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.184089+0000","last_change":"2023-11-28T11:58:51.180506+0000","last_active":"2023-11-28T11:58:51.184089+0000","last_peered":"2023-11-28T11:58:51.184089+0000","last_clean":"2023-11-28T11:58:51.184089+0000","last_became_active":"2023-11-28T11:58:51.180220+0000","last_became_peered":"2023-11-28T11:58:51.180220+0000","last_unstale":"2023-11-28T11:58:51.184089+0000","last_undegraded":"2023-11-28T11:58:51.184089+0000","last_fullsized":"2023-11-28T11:58:51.184089+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:24:42.388320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.171492+0000","last_change":"2023-11-28T11:58:51.171492+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.171492+0000","last_undegraded":"2023-11-28T11:58:51.171492+0000","last_fullsized":"2023-11-28T11:58:51.171492+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:34.496313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.195427+0000","last_change":"2023-11-28T11:58:51.182985+0000","last_active":"2023-11-28T11:58:51.195427+0000","last_peered":"2023-11-28T11:58:51.195427+0000","last_clean":"2023-11-28T11:58:51.195427+0000","last_became_active":"2023-11-28T11:58:51.182503+0000","last_became_peered":"2023-11-28T11:58:51.182503+0000","last_unstale":"2023-11-28T11:58:51.195427+0000","last_undegraded":"2023-11-28T11:58:51.195427+0000","last_fullsized":"2023-11-28T11:58:51.195427+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:17:03.706968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.175238+0000","last_change":"2023-11-28T11:58:51.175238+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.175238+0000","last_undegraded":"2023-11-28T11:58:51.175238+0000","last_fullsized":"2023-11-28T11:58:51.175238+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:24:09.557069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.183273+0000","last_change":"2023-11-28T11:58:51.178370+0000","last_active":"2023-11-28T11:58:51.183273+0000","last_peered":"2023-11-28T11:58:51.183273+0000","last_clean":"2023-11-28T11:58:51.183273+0000","last_became_active":"2023-11-28T11:58:51.178104+0000","last_became_peered":"2023-11-28T11:58:51.178104+0000","last_unstale":"2023-11-28T11:58:51.183273+0000","last_undegraded":"2023-11-28T11:58:51.183273+0000","last_fullsized":"2023-11-28T11:58:51.183273+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:46:22.305988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.170774+0000","last_change":"2023-11-28T11:56:34.384408+0000","last_active":"2023-11-28T11:58:51.170774+0000","last_peered":"2023-11-28T11:58:51.170774+0000","last_clean":"2023-11-28T11:58:51.170774+0000","last_became_active":"2023-11-28T11:56:34.384036+0000","last_became_peered":"2023-11-28T11:56:34.384036+0000","last_unstale":"2023-11-28T11:58:51.170774+0000","last_undegraded":"2023-11-28T11:58:51.170774+0000","last_fullsized":"2023-11-28T11:58:51.170774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:58:55.003786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.663363+0000","last_change":"2023-11-28T11:58:51.663363+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.663363+0000","last_undegraded":"2023-11-28T11:58:51.663363+0000","last_fullsized":"2023-11-28T11:58:51.663363+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:32:19.768923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.647192+0000","last_change":"2023-11-28T11:58:51.191417+0000","last_active":"2023-11-28T11:58:51.647192+0000","last_peered":"2023-11-28T11:58:51.647192+0000","last_clean":"2023-11-28T11:58:51.647192+0000","last_became_active":"2023-11-28T11:58:51.191143+0000","last_became_peered":"2023-11-28T11:58:51.191143+0000","last_unstale":"2023-11-28T11:58:51.647192+0000","last_undegraded":"2023-11-28T11:58:51.647192+0000","last_fullsized":"2023-11-28T11:58:51.647192+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:09:32.828501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":40,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-28T11:58:50.141350+0000","last_change":"2023-11-28T11:56:34.384088+0000","last_active":"2023-11-28T11:58:50.141350+0000","last_peered":"2023-11-28T11:58:50.141350+0000","last_clean":"2023-11-28T11:58:50.141350+0000","last_became_active":"2023-11-28T11:56:34.383631+0000","last_became_peered":"2023-11-28T11:56:34.383631+0000","last_unstale":"2023-11-28T11:58:50.141350+0000","last_undegraded":"2023-11-28T11:58:50.141350+0000","last_fullsized":"2023-11-28T11:58:50.141350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:15:42.772333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.661133+0000","last_change":"2023-11-28T11:58:51.661133+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.661133+0000","last_undegraded":"2023-11-28T11:58:51.661133+0000","last_fullsized":"2023-11-28T11:58:51.661133+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:17:04.728611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.196084+0000","last_change":"2023-11-28T11:58:51.191624+0000","last_active":"2023-11-28T11:58:51.196084+0000","last_peered":"2023-11-28T11:58:51.196084+0000","last_clean":"2023-11-28T11:58:51.196084+0000","last_became_active":"2023-11-28T11:58:51.191317+0000","last_became_peered":"2023-11-28T11:58:51.191317+0000","last_unstale":"2023-11-28T11:58:51.196084+0000","last_undegraded":"2023-11-28T11:58:51.196084+0000","last_fullsized":"2023-11-28T11:58:51.196084+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:03:48.305566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.161577+0000","last_change":"2023-11-28T11:56:34.386399+0000","last_active":"2023-11-28T11:58:51.161577+0000","last_peered":"2023-11-28T11:58:51.161577+0000","last_clean":"2023-11-28T11:58:51.161577+0000","last_became_active":"2023-11-28T11:56:34.385994+0000","last_became_peered":"2023-11-28T11:56:34.385994+0000","last_unstale":"2023-11-28T11:58:51.161577+0000","last_undegraded":"2023-11-28T11:58:51.161577+0000","last_fullsized":"2023-11-28T11:58:51.161577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:58:02.172295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.657774+0000","last_change":"2023-11-28T11:58:51.657774+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.657774+0000","last_undegraded":"2023-11-28T11:58:51.657774+0000","last_fullsized":"2023-11-28T11:58:51.657774+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:53:49.319201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"57'2","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.669921+0000","last_change":"2023-11-28T11:58:51.195566+0000","last_active":"2023-11-28T11:58:51.669921+0000","last_peered":"2023-11-28T11:58:51.669921+0000","last_clean":"2023-11-28T11:58:51.669921+0000","last_became_active":"2023-11-28T11:58:51.195183+0000","last_became_peered":"2023-11-28T11:58:51.195183+0000","last_unstale":"2023-11-28T11:58:51.669921+0000","last_undegraded":"2023-11-28T11:58:51.669921+0000","last_fullsized":"2023-11-28T11:58:51.669921+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:58:54.026123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-28T11:58:50.141350+0000","last_change":"2023-11-28T11:56:34.384999+0000","last_active":"2023-11-28T11:58:50.141350+0000","last_peered":"2023-11-28T11:58:50.141350+0000","last_clean":"2023-11-28T11:58:50.141350+0000","last_became_active":"2023-11-28T11:56:34.384531+0000","last_became_peered":"2023-11-28T11:56:34.384531+0000","last_unstale":"2023-11-28T11:58:50.141350+0000","last_undegraded":"2023-11-28T11:58:50.141350+0000","last_fullsized":"2023-11-28T11:58:50.141350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:09:50.083366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:53.159756+0000","last_change":"2023-11-28T11:58:51.672003+0000","last_active":"2023-11-28T11:58:53.159756+0000","last_peered":"2023-11-28T11:58:53.159756+0000","last_clean":"2023-11-28T11:58:53.159756+0000","last_became_active":"2023-11-28T11:58:51.671750+0000","last_became_peered":"2023-11-28T11:58:51.671750+0000","last_unstale":"2023-11-28T11:58:53.159756+0000","last_undegraded":"2023-11-28T11:58:53.159756+0000","last_fullsized":"2023-11-28T11:58:53.159756+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:17.015788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.185057+0000","last_change":"2023-11-28T11:58:51.181802+0000","last_active":"2023-11-28T11:58:51.185057+0000","last_peered":"2023-11-28T11:58:51.185057+0000","last_clean":"2023-11-28T11:58:51.185057+0000","last_became_active":"2023-11-28T11:58:51.181421+0000","last_became_peered":"2023-11-28T11:58:51.181421+0000","last_unstale":"2023-11-28T11:58:51.185057+0000","last_undegraded":"2023-11-28T11:58:51.185057+0000","last_fullsized":"2023-11-28T11:58:51.185057+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:50:43.770799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":39,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-28T11:58:50.146427+0000","last_change":"2023-11-28T11:56:34.389076+0000","last_active":"2023-11-28T11:58:50.146427+0000","last_peered":"2023-11-28T11:58:50.146427+0000","last_clean":"2023-11-28T11:58:50.146427+0000","last_became_active":"2023-11-28T11:56:34.388689+0000","last_became_peered":"2023-11-28T11:56:34.388689+0000","last_unstale":"2023-11-28T11:58:50.146427+0000","last_undegraded":"2023-11-28T11:58:50.146427+0000","last_fullsized":"2023-11-28T11:58:50.146427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:20.936349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.656818+0000","last_change":"2023-11-28T11:58:51.656818+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.656818+0000","last_undegraded":"2023-11-28T11:58:51.656818+0000","last_fullsized":"2023-11-28T11:58:51.656818+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:52.015075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.190652+0000","last_change":"2023-11-28T11:58:51.180873+0000","last_active":"2023-11-28T11:58:51.190652+0000","last_peered":"2023-11-28T11:58:51.190652+0000","last_clean":"2023-11-28T11:58:51.190652+0000","last_became_active":"2023-11-28T11:58:51.180551+0000","last_became_peered":"2023-11-28T11:58:51.180551+0000","last_unstale":"2023-11-28T11:58:51.190652+0000","last_undegraded":"2023-11-28T11:58:51.190652+0000","last_fullsized":"2023-11-28T11:58:51.190652+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:50.993432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.654885+0000","last_change":"2023-11-28T11:56:34.486178+0000","last_active":"2023-11-28T11:58:51.654885+0000","last_peered":"2023-11-28T11:58:51.654885+0000","last_clean":"2023-11-28T11:58:51.654885+0000","last_became_active":"2023-11-28T11:56:34.485702+0000","last_became_peered":"2023-11-28T11:56:34.485702+0000","last_unstale":"2023-11-28T11:58:51.654885+0000","last_undegraded":"2023-11-28T11:58:51.654885+0000","last_fullsized":"2023-11-28T11:58:51.654885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:06.323407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:53.160302+0000","last_change":"2023-11-28T11:58:51.659567+0000","last_active":"2023-11-28T11:58:53.160302+0000","last_peered":"2023-11-28T11:58:53.160302+0000","last_clean":"2023-11-28T11:58:53.160302+0000","last_became_active":"2023-11-28T11:58:51.659303+0000","last_became_peered":"2023-11-28T11:58:51.659303+0000","last_unstale":"2023-11-28T11:58:53.160302+0000","last_undegraded":"2023-11-28T11:58:53.160302+0000","last_fullsized":"2023-11-28T11:58:53.160302+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:00:36.435208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.195316+0000","last_change":"2023-11-28T11:58:51.193563+0000","last_active":"2023-11-28T11:58:51.195316+0000","last_peered":"2023-11-28T11:58:51.195316+0000","last_clean":"2023-11-28T11:58:51.195316+0000","last_became_active":"2023-11-28T11:58:51.193283+0000","last_became_peered":"2023-11-28T11:58:51.193283+0000","last_unstale":"2023-11-28T11:58:51.195316+0000","last_undegraded":"2023-11-28T11:58:51.195316+0000","last_fullsized":"2023-11-28T11:58:51.195316+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:36:54.633765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.160635+0000","last_change":"2023-11-28T11:56:34.387293+0000","last_active":"2023-11-28T11:58:51.160635+0000","last_peered":"2023-11-28T11:58:51.160635+0000","last_clean":"2023-11-28T11:58:51.160635+0000","last_became_active":"2023-11-28T11:56:34.386976+0000","last_became_peered":"2023-11-28T11:56:34.386976+0000","last_unstale":"2023-11-28T11:58:51.160635+0000","last_undegraded":"2023-11-28T11:58:51.160635+0000","last_fullsized":"2023-11-28T11:58:51.160635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:32.704729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.171808+0000","last_change":"2023-11-28T11:58:51.171808+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.171808+0000","last_undegraded":"2023-11-28T11:58:51.171808+0000","last_fullsized":"2023-11-28T11:58:51.171808+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:05:51.844750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.651886+0000","last_change":"2023-11-28T11:58:51.174291+0000","last_active":"2023-11-28T11:58:51.651886+0000","last_peered":"2023-11-28T11:58:51.651886+0000","last_clean":"2023-11-28T11:58:51.651886+0000","last_became_active":"2023-11-28T11:58:51.173714+0000","last_became_peered":"2023-11-28T11:58:51.173714+0000","last_unstale":"2023-11-28T11:58:51.651886+0000","last_undegraded":"2023-11-28T11:58:51.651886+0000","last_fullsized":"2023-11-28T11:58:51.651886+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:31:55.668938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":39,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-28T11:58:50.146409+0000","last_change":"2023-11-28T11:56:34.389222+0000","last_active":"2023-11-28T11:58:50.146409+0000","last_peered":"2023-11-28T11:58:50.146409+0000","last_clean":"2023-11-28T11:58:50.146409+0000","last_became_active":"2023-11-28T11:56:34.388671+0000","last_became_peered":"2023-11-28T11:56:34.388671+0000","last_unstale":"2023-11-28T11:58:50.146409+0000","last_undegraded":"2023-11-28T11:58:50.146409+0000","last_fullsized":"2023-11-28T11:58:50.146409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:32.704729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":194,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.160754+0000","last_change":"2023-11-28T11:56:28.472008+0000","last_active":"2023-11-28T11:58:51.160754+0000","last_peered":"2023-11-28T11:58:51.160754+0000","last_clean":"2023-11-28T11:58:51.160754+0000","last_became_active":"2023-11-28T11:56:28.469273+0000","last_became_peered":"2023-11-28T11:56:28.469273+0000","last_unstale":"2023-11-28T11:58:51.160754+0000","last_undegraded":"2023-11-28T11:58:51.160754+0000","last_fullsized":"2023-11-28T11:58:51.160754+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:27.291192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:27.291192+0000","last_clean_scrub_stamp":"2023-11-28T11:56:27.291192+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:14:48.860420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":656,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509472,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14352,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":13120,"kb_avail":94357488,"statfs":{"total":96636764160,"available":96622067712,"internally_reserved":0,"allocated":1253376,"data_stored":890680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13434880},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.0780000000000001,"15min":1.093},"min":{"1min":0.63,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.357,"5min":1.468,"15min":1.468},"last":1.327},{"interface":"front","average":{"1min":1.083,"5min":1.079,"15min":1.0780000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.4830000000000001,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.98599999999999999}]},{"osd":1,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1879999999999999,"15min":1.202},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.339,"5min":1.71,"15min":1.71},"last":1.236},{"interface":"front","average":{"1min":1.141,"5min":1.1739999999999999,"15min":1.1799999999999999},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.4410000000000001,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.879}]},{"osd":2,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1779999999999999,"15min":1.1859999999999999},"min":{"1min":0.83299999999999996,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.409,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.127},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2669999999999999,"15min":1.28},"min":{"1min":0.78400000000000003,"5min":0.749,"15min":0.749},"max":{"1min":1.5209999999999999,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.181}]},{"osd":3,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.302,"15min":1.3160000000000001},"min":{"1min":0.872,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.5249999999999999,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.345,"15min":1.357},"min":{"1min":1.0169999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.5980000000000001,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.1080000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.272,"15min":1.3029999999999999},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.5609999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.143,"5min":1.3129999999999999,"15min":1.341},"min":{"1min":0.80800000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.4350000000000001,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":0.95199999999999996}]},{"osd":5,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.409,"15min":1.4390000000000001},"min":{"1min":0.876,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.595,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.202,"5min":1.369,"15min":1.397},"min":{"1min":0.96899999999999997,"5min":0.872,"15min":0.872},"max":{"1min":1.454,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":1.252}]},{"osd":6,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.532,"15min":1.5600000000000001},"min":{"1min":1.075,"5min":1.075,"15min":1.075},"max":{"1min":1.633,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.165},{"interface":"front","average":{"1min":1.278,"5min":1.431,"15min":1.4570000000000001},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.53,"5min":2.468,"15min":2.468},"last":1.367}]}]},{"osd":6,"up_from":15,"seq":64424509472,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9164,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362676,"statfs":{"total":96636764160,"available":96627380224,"internally_reserved":0,"allocated":659456,"data_stored":300312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":0.997,"15min":0.99099999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.716,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.101,"5min":1.1870000000000001,"15min":1.2010000000000001},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.5569999999999999,"5min":2.347,"15min":2.347},"last":0.98499999999999999}]},{"osd":1,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.175,"15min":1.1759999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.5249999999999999,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.284},{"interface":"front","average":{"1min":1.117,"5min":1.165,"15min":1.173},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4239999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":1.3220000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.224,"15min":1.25},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4830000000000001,"5min":3.9620000000000002,"15min":3.9620000000000002},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1679999999999999,"15min":1.169},"min":{"1min":0.91200000000000003,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.3759999999999999,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.94299999999999995}]},{"osd":3,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2689999999999999,"15min":1.264},"min":{"1min":0.96699999999999997,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.258,"5min":1.27,"15min":1.272},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.645,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.1100000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.2230000000000001,"15min":1.238},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.4490000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.286,"5min":1.4510000000000001,"15min":1.4790000000000001},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.7250000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.3520000000000001}]},{"osd":5,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.2589999999999999,"15min":1.2769999999999999},"min":{"1min":0.93500000000000005,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.4730000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.266,"15min":1.278},"min":{"1min":0.84399999999999997,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.0209999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.3340000000000001,"15min":1.3400000000000001},"min":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.244},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3540000000000001,"15min":1.3580000000000001},"min":{"1min":1.0349999999999999,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":1.8939999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.155}]}]},{"osd":5,"up_from":15,"seq":64424509472,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9024,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362816,"statfs":{"total":96636764160,"available":96627523584,"internally_reserved":0,"allocated":647168,"data_stored":293372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0820000000000001,"15min":1.0880000000000001},"min":{"1min":0.76400000000000001,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.365,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.109,"5min":1.085,"15min":1.081},"min":{"1min":0.72899999999999998,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.552,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.1910000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:58:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1439999999999999,"15min":1.1499999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.72,"5min":1.843,"15min":1.843},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.069,"5min":1.085,"15min":1.0880000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.331}]},{"osd":2,"last update":"Tue Nov 28 11:58:33 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.163,"15min":1.165},"min":{"1min":0.83899999999999997,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.4630000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.296},{"interface":"front","average":{"1min":1.196,"5min":1.2,"15min":1.2},"min":{"1min":0.82999999999999996,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.05}]},{"osd":3,"last update":"Tue Nov 28 11:58:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.2609999999999999,"15min":1.276},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.5880000000000001,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.258,"5min":1.3759999999999999,"15min":1.3959999999999999},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.623,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.2509999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:58:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.206,"15min":1.22},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.54,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.2310000000000001,"15min":1.2350000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.5209999999999999,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.4650000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:58:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.276,"15min":1.278},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.349},{"interface":"front","average":{"1min":1.28,"5min":1.2849999999999999,"15min":1.286},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":1.675,"5min":1.704,"15min":1.704},"last":1.224}]},{"osd":7,"last update":"Tue Nov 28 11:58:33 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.359,"15min":1.365},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.7030000000000001,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.383},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.468,"15min":1.4790000000000001},"min":{"1min":1.002,"5min":1.002,"15min":1.002},"max":{"1min":1.78,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.171}]}]},{"osd":4,"up_from":15,"seq":64424509472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9216,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362624,"statfs":{"total":96636764160,"available":96627326976,"internally_reserved":0,"allocated":647168,"data_stored":293372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.113,"15min":1.111},"min":{"1min":0.67400000000000004,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.474,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.105,"5min":1.153,"15min":1.161},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.78,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.099}]},{"osd":1,"last update":"Tue Nov 28 11:58:32 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.1899999999999999,"15min":1.214},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.351,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.107,"5min":1.1910000000000001,"15min":1.2050000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.502,"5min":2.8860000000000001,"15min":2.8860000000000001},"last":1.147}]},{"osd":2,"last update":"Tue Nov 28 11:58:32 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.228,"15min":1.2450000000000001},"min":{"1min":0.72299999999999998,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.6020000000000001,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.05},{"interface":"front","average":{"1min":1.24,"5min":1.391,"15min":1.4159999999999999},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.6379999999999999,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":1.3580000000000001}]},{"osd":3,"last update":"Tue Nov 28 11:58:32 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.3080000000000001,"15min":1.325},"min":{"1min":0.76500000000000001,"5min":0.746,"15min":0.746},"max":{"1min":1.8320000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.399},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.367,"15min":1.377},"min":{"1min":0.99299999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.5700000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.3029999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:58:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.409,"15min":1.446},"min":{"1min":0.85599999999999998,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.5680000000000001,"5min":2.972,"15min":2.972},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.335,"15min":1.3660000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.4470000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.222}]},{"osd":6,"last update":"Tue Nov 28 11:58:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.3839999999999999,"15min":1.4139999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.7509999999999999,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.248},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.5289999999999999,"15min":1.5549999999999999},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":1.804,"5min":3.133,"15min":3.133},"last":1.468}]},{"osd":7,"last update":"Tue Nov 28 11:58:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.494,"15min":1.53},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.7110000000000001,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.319},{"interface":"front","average":{"1min":1.373,"5min":1.5649999999999999,"15min":1.597},"min":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"max":{"1min":1.7230000000000001,"5min":2.198,"15min":2.198},"last":1.4399999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509472,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9152,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362688,"statfs":{"total":96636764160,"available":96627392512,"internally_reserved":0,"allocated":647168,"data_stored":293372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.53500000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.2689999999999999,"5min":1.478,"15min":1.478},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.63200000000000001,"5min":0.37,"15min":0.37},"max":{"1min":1.349,"5min":2.177,"15min":2.177},"last":0.69899999999999995}]},{"osd":1,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.85599999999999998,"15min":0.86199999999999999},"min":{"1min":0.50600000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.087,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.056,"15min":1.0640000000000001},"min":{"1min":0.72899999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3280000000000001,"5min":1.968,"15min":1.968},"last":0.92000000000000004}]},{"osd":2,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.1279999999999999,"15min":1.1459999999999999},"min":{"1min":0.71799999999999997,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.413,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.194,"15min":1.2150000000000001},"min":{"1min":0.85799999999999998,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.423,"5min":2.093,"15min":2.093},"last":1.369}]},{"osd":4,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.171,"15min":1.177},"min":{"1min":0.85299999999999998,"5min":0.75,"15min":0.75},"max":{"1min":1.5469999999999999,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.325,"15min":1.343},"min":{"1min":1.032,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.514,"5min":2.8439999999999999,"15min":2.8439999999999999},"last":1.0449999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.3480000000000001,"15min":1.367},"min":{"1min":1.0089999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.4450000000000001,"5min":2.9670000000000001,"15min":2.9670000000000001},"last":0.995},{"interface":"front","average":{"1min":1.29,"5min":1.431,"15min":1.4550000000000001},"min":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"max":{"1min":1.736,"5min":3.7429999999999999,"15min":3.7429999999999999},"last":1.167}]},{"osd":6,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.3460000000000001,"15min":1.355},"min":{"1min":0.91500000000000004,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.907,"5min":2.323,"15min":2.323},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.4350000000000001,"15min":1.4530000000000001},"min":{"1min":1.1930000000000001,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.506,"5min":2.927,"15min":2.927},"last":1.337}]},{"osd":7,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4970000000000001,"15min":1.5109999999999999},"min":{"1min":1.1399999999999999,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.8440000000000001,"5min":3.5030000000000001,"15min":3.5030000000000001},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.377,"5min":1.468,"15min":1.4830000000000001},"min":{"1min":1.0980000000000001,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":1.778,"5min":2.6320000000000001,"15min":2.6320000000000001},"last":1.1279999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509472,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9100,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362740,"statfs":{"total":96636764160,"available":96627445760,"internally_reserved":0,"allocated":659456,"data_stored":300312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.92800000000000005,"15min":0.94599999999999995},"min":{"1min":0.61099999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.1160000000000001,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.014,"5min":1.006,"15min":1.0049999999999999},"min":{"1min":0.44400000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.6100000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":1.0940000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.087,"15min":1.089},"min":{"1min":0.57599999999999996,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.49,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.1020000000000001,"15min":1.105},"min":{"1min":0.67200000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.6899999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.151}]},{"osd":3,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.202,"15min":1.208},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.6180000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.877},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.1519999999999999,"15min":1.177},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.734,"5min":1.8,"15min":1.8},"last":0.81799999999999995}]},{"osd":4,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.3660000000000001,"15min":1.3759999999999999},"min":{"1min":0.95099999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.8109999999999999,"5min":3.411,"15min":3.411},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.331,"15min":1.349},"min":{"1min":0.90600000000000003,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.9039999999999999,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":1.361}]},{"osd":5,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.417,"15min":1.4350000000000001},"min":{"1min":0.91100000000000003,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.0129999999999999,"5min":3.6869999999999998,"15min":3.6869999999999998},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.3169999999999999,"15min":1.3300000000000001},"min":{"1min":0.91800000000000004,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.5269999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.2210000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.444,"15min":1.462},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.0569999999999999,"5min":3.5379999999999998,"15min":3.5379999999999998},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.472,"15min":1.498},"min":{"1min":1.1359999999999999,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.673,"5min":2.5739999999999998,"15min":2.5739999999999998},"last":1.706}]},{"osd":7,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.464,"15min":1.4810000000000001},"min":{"1min":1.1080000000000001,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.7410000000000001,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.494},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.5029999999999999,"15min":1.5229999999999999},"min":{"1min":0.86799999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.8680000000000001,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.514}]}]},{"osd":2,"up_from":14,"seq":60129542177,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9196,"kb_used_data":676,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362644,"statfs":{"total":96636764160,"available":96627347456,"internally_reserved":0,"allocated":692224,"data_stored":314789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:25 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.85799999999999998,"15min":0.86799999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.093,"5min":1.722,"15min":1.722},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.95099999999999996,"5min":1,"15min":1.008},"min":{"1min":0.63900000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.9850000000000001,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":0.79300000000000004}]},{"osd":1,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":1.018,"15min":1.03},"min":{"1min":0.56200000000000006,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.286,"5min":1.754,"15min":1.754},"last":1.246},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.93000000000000005,"15min":0.93999999999999995},"min":{"1min":0.56599999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1850000000000001,"5min":1.484,"15min":1.484},"last":0.627}]},{"osd":3,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.123,"15min":1.133},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.526,"5min":2.048,"15min":2.048},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.28,"15min":1.2929999999999999},"min":{"1min":0.78900000000000003,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.583,"5min":2.617,"15min":2.617},"last":1.079}]},{"osd":4,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.3620000000000001,"15min":1.385},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.6919999999999999,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":1.204},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.2470000000000001,"15min":1.2549999999999999},"min":{"1min":0.85899999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.4930000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":1.0569999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.335,"15min":1.351},"min":{"1min":1.032,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.623,"5min":2.738,"15min":2.738},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.272,"5min":1.514,"15min":1.554},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.7230000000000001,"5min":4.0309999999999997,"15min":4.0309999999999997},"last":1.2669999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.583,"15min":1.611},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.9299999999999999,"5min":4.2240000000000002,"15min":4.2240000000000002},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.335,"5min":1.5169999999999999,"15min":1.5469999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.7709999999999999,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":1.2849999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.4379999999999999,"15min":1.4570000000000001},"min":{"1min":1.056,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.6359999999999999,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.139},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.6399999999999999,"15min":1.669},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.8799999999999999,"5min":4.3570000000000002,"15min":4.3570000000000002},"last":1.327}]}]},{"osd":0,"up_from":14,"seq":60129542177,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10484,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":9216,"kb_avail":94361356,"statfs":{"total":96636764160,"available":96626028544,"internally_reserved":0,"allocated":1290240,"data_stored":906296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9437184},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.86899999999999999,"15min":0.878},"min":{"1min":0.52700000000000002,"5min":0.439,"15min":0.439},"max":{"1min":1.1359999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.997,"15min":1.0109999999999999},"min":{"1min":0.64500000000000002,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.4079999999999999,"5min":1.7,"15min":1.7},"last":0.46400000000000002}]},{"osd":2,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.042,"15min":1.052},"min":{"1min":0.61599999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.282,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.92200000000000004,"15min":0.92400000000000004},"min":{"1min":0.61199999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.59399999999999997}]},{"osd":3,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.0640000000000001,"15min":1.0760000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.218,"5min":1.238,"15min":1.2410000000000001},"min":{"1min":0.80200000000000005,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.8089999999999999,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.0129999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.3300000000000001,"15min":1.3440000000000001},"min":{"1min":0.89200000000000002,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.8100000000000001,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.234,"5min":1.377,"15min":1.401},"min":{"1min":0.86799999999999999,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.758,"5min":3.1629999999999998,"15min":3.1629999999999998},"last":1.1679999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.361,"15min":1.363},"min":{"1min":0.871,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":2.1739999999999999,"5min":2.23,"15min":2.23},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.298,"5min":1.4019999999999999,"15min":1.4199999999999999},"min":{"1min":0.89500000000000002,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.845,"5min":2.266,"15min":2.266},"last":1.27}]},{"osd":6,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.498,"15min":1.516},"min":{"1min":0.93300000000000005,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.9490000000000001,"5min":2.4060000000000001,"15min":2.4060000000000001},"last":1.073},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.4830000000000001,"15min":1.5},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.7969999999999999,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":1.389}]},{"osd":7,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.5109999999999999,"15min":1.5209999999999999},"min":{"1min":1.1439999999999999,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":2.0600000000000001,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.21},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.554,"15min":1.573},"min":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":2.3029999999999999,"5min":2.6040000000000001,"15min":2.6040000000000001},"last":1.2390000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:58:56.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3e is not active+clean 2023-11-28T11:58:56.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-11-28T11:58:51.180906+0000', 'last_change': '2023-11-28T11:58:51.180906+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.180906+0000', 'last_undegraded': '2023-11-28T11:58:51.180906+0000', 'last_fullsized': '2023-11-28T11:58:51.180906+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T14:47:10.246224+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T11:58:56.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3d is not active+clean 2023-11-28T11:58:56.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 57, 'state': 'creating+activating', 'last_fresh': '2023-11-28T11:58:51.662021+0000', 'last_change': '2023-11-28T11:58:51.662021+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.662021+0000', 'last_undegraded': '2023-11-28T11:58:51.662021+0000', 'last_fullsized': '2023-11-28T11:58:51.662021+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T17:53:49.319201+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': ['7', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T11:58:56.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3c is not active+clean 2023-11-28T11:58:56.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 57, 'state': 'creating+activating', 'last_fresh': '2023-11-28T11:58:51.656796+0000', 'last_change': '2023-11-28T11:58:51.656796+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.656796+0000', 'last_undegraded': '2023-11-28T11:58:51.656796+0000', 'last_fullsized': '2023-11-28T11:58:51.656796+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T17:37:13.495875+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': ['5', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T11:58:56.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.39 is not active+clean 2023-11-28T11:58:56.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-11-28T11:58:51.167375+0000', 'last_change': '2023-11-28T11:58:51.167375+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.167375+0000', 'last_undegraded': '2023-11-28T11:58:51.167375+0000', 'last_fullsized': '2023-11-28T11:58:51.167375+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T23:23:30.095986+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T11:58:56.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.38 is not active+clean 2023-11-28T11:58:56.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-11-28T11:58:51.181470+0000', 'last_change': '2023-11-28T11:58:51.181470+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.181470+0000', 'last_undegraded': '2023-11-28T11:58:51.181470+0000', 'last_fullsized': '2023-11-28T11:58:51.181470+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T13:04:34.153300+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T11:58:56.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.37 is not active+clean 2023-11-28T11:58:56.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-11-28T11:58:51.166525+0000', 'last_change': '2023-11-28T11:58:51.166525+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.166525+0000', 'last_undegraded': '2023-11-28T11:58:51.166525+0000', 'last_fullsized': '2023-11-28T11:58:51.166525+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T17:37:13.495875+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T11:58:56.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.36 is not active+clean 2023-11-28T11:58:56.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-11-28T11:58:51.176434+0000', 'last_change': '2023-11-28T11:58:51.176434+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.176434+0000', 'last_undegraded': '2023-11-28T11:58:51.176434+0000', 'last_fullsized': '2023-11-28T11:58:51.176434+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T21:04:56.514139+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T11:58:56.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.35 is not active+clean 2023-11-28T11:58:56.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-11-28T11:58:51.176265+0000', 'last_change': '2023-11-28T11:58:51.176265+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.176265+0000', 'last_undegraded': '2023-11-28T11:58:51.176265+0000', 'last_fullsized': '2023-11-28T11:58:51.176265+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T19:51:22.086240+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T11:58:56.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.34 is not active+clean 2023-11-28T11:58:56.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 57, 'state': 'creating+activating', 'last_fresh': '2023-11-28T11:58:51.657117+0000', 'last_change': '2023-11-28T11:58:51.657117+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.657117+0000', 'last_undegraded': '2023-11-28T11:58:51.657117+0000', 'last_fullsized': '2023-11-28T11:58:51.657117+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T12:05:25.321914+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': ['5', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T11:58:56.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.33 is not active+clean 2023-11-28T11:58:56.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 57, 'state': 'creating+activating', 'last_fresh': '2023-11-28T11:58:51.649448+0000', 'last_change': '2023-11-28T11:58:51.649448+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.649448+0000', 'last_undegraded': '2023-11-28T11:58:51.649448+0000', 'last_fullsized': '2023-11-28T11:58:51.649448+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T23:47:19.620359+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': ['6', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T11:58:56.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.32 is not active+clean 2023-11-28T11:58:56.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-11-28T11:58:51.167346+0000', 'last_change': '2023-11-28T11:58:51.167346+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.167346+0000', 'last_undegraded': '2023-11-28T11:58:51.167346+0000', 'last_fullsized': '2023-11-28T11:58:51.167346+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T14:20:26.402257+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T11:58:56.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.31 is not active+clean 2023-11-28T11:58:56.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-11-28T11:58:51.166897+0000', 'last_change': '2023-11-28T11:58:51.166897+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.166897+0000', 'last_undegraded': '2023-11-28T11:58:51.166897+0000', 'last_fullsized': '2023-11-28T11:58:51.166897+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T14:31:57.919489+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T11:58:56.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2f is not active+clean 2023-11-28T11:58:56.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-11-28T11:58:51.180775+0000', 'last_change': '2023-11-28T11:58:51.180775+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.180775+0000', 'last_undegraded': '2023-11-28T11:58:51.180775+0000', 'last_fullsized': '2023-11-28T11:58:51.180775+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T14:21:34.475958+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T11:58:56.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2e is not active+clean 2023-11-28T11:58:56.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 57, 'state': 'creating+activating', 'last_fresh': '2023-11-28T11:58:51.660726+0000', 'last_change': '2023-11-28T11:58:51.660726+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.660726+0000', 'last_undegraded': '2023-11-28T11:58:51.660726+0000', 'last_fullsized': '2023-11-28T11:58:51.660726+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T12:05:25.321914+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': ['7', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T11:58:56.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2c is not active+clean 2023-11-28T11:58:56.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-11-28T11:58:51.177158+0000', 'last_change': '2023-11-28T11:58:51.177158+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.177158+0000', 'last_undegraded': '2023-11-28T11:58:51.177158+0000', 'last_fullsized': '2023-11-28T11:58:51.177158+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T20:23:19.193646+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T11:58:56.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2b is not active+clean 2023-11-28T11:58:56.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 57, 'state': 'creating+activating', 'last_fresh': '2023-11-28T11:58:51.659009+0000', 'last_change': '2023-11-28T11:58:51.659009+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.659009+0000', 'last_undegraded': '2023-11-28T11:58:51.659009+0000', 'last_fullsized': '2023-11-28T11:58:51.659009+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T16:28:12.186813+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': ['7', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T11:58:56.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2a is not active+clean 2023-11-28T11:58:56.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-11-28T11:58:51.177078+0000', 'last_change': '2023-11-28T11:58:51.177078+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.177078+0000', 'last_undegraded': '2023-11-28T11:58:51.177078+0000', 'last_fullsized': '2023-11-28T11:58:51.177078+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T23:48:03.508051+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T11:58:56.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.29 is not active+clean 2023-11-28T11:58:56.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 57, 'state': 'creating+activating', 'last_fresh': '2023-11-28T11:58:51.659105+0000', 'last_change': '2023-11-28T11:58:51.659105+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.659105+0000', 'last_undegraded': '2023-11-28T11:58:51.659105+0000', 'last_fullsized': '2023-11-28T11:58:51.659105+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T14:36:20.149308+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': ['7', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T11:58:56.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.28 is not active+clean 2023-11-28T11:58:56.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 57, 'state': 'creating+activating', 'last_fresh': '2023-11-28T11:58:51.648893+0000', 'last_change': '2023-11-28T11:58:51.648893+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.648893+0000', 'last_undegraded': '2023-11-28T11:58:51.648893+0000', 'last_fullsized': '2023-11-28T11:58:51.648893+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T19:51:22.086240+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': ['6', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T11:58:56.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.26 is not active+clean 2023-11-28T11:58:56.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 57, 'state': 'creating+activating', 'last_fresh': '2023-11-28T11:58:51.656897+0000', 'last_change': '2023-11-28T11:58:51.656897+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.656897+0000', 'last_undegraded': '2023-11-28T11:58:51.656897+0000', 'last_fullsized': '2023-11-28T11:58:51.656897+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T20:03:49.327209+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': ['5', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T11:58:56.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.23 is not active+clean 2023-11-28T11:58:56.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-11-28T11:58:51.172715+0000', 'last_change': '2023-11-28T11:58:51.172715+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.172715+0000', 'last_undegraded': '2023-11-28T11:58:51.172715+0000', 'last_fullsized': '2023-11-28T11:58:51.172715+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T18:42:12.056606+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T11:58:56.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.22 is not active+clean 2023-11-28T11:58:56.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 57, 'state': 'creating+activating', 'last_fresh': '2023-11-28T11:58:51.659077+0000', 'last_change': '2023-11-28T11:58:51.659077+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.659077+0000', 'last_undegraded': '2023-11-28T11:58:51.659077+0000', 'last_fullsized': '2023-11-28T11:58:51.659077+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T17:37:13.495875+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': ['7', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T11:58:56.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1f is not active+clean 2023-11-28T11:58:56.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-11-28T11:58:51.175693+0000', 'last_change': '2023-11-28T11:58:51.175693+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.175693+0000', 'last_undegraded': '2023-11-28T11:58:51.175693+0000', 'last_fullsized': '2023-11-28T11:58:51.175693+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T20:36:59.737858+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T11:58:56.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1a is not active+clean 2023-11-28T11:58:56.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-11-28T11:58:51.172305+0000', 'last_change': '2023-11-28T11:58:51.172305+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.172305+0000', 'last_undegraded': '2023-11-28T11:58:51.172305+0000', 'last_fullsized': '2023-11-28T11:58:51.172305+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T17:31:00.537286+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T11:58:56.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1b is not active+clean 2023-11-28T11:58:56.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-11-28T11:58:51.172180+0000', 'last_change': '2023-11-28T11:58:51.172180+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.172180+0000', 'last_undegraded': '2023-11-28T11:58:51.172180+0000', 'last_fullsized': '2023-11-28T11:58:51.172180+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T17:21:32.139383+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T11:58:56.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.18 is not active+clean 2023-11-28T11:58:56.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 57, 'state': 'creating+activating', 'last_fresh': '2023-11-28T11:58:51.648861+0000', 'last_change': '2023-11-28T11:58:51.648861+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.648861+0000', 'last_undegraded': '2023-11-28T11:58:51.648861+0000', 'last_fullsized': '2023-11-28T11:58:51.648861+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T21:04:56.514139+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': ['6', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T11:58:56.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.19 is not active+clean 2023-11-28T11:58:56.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-11-28T11:58:51.172332+0000', 'last_change': '2023-11-28T11:58:51.172332+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.172332+0000', 'last_undegraded': '2023-11-28T11:58:51.172332+0000', 'last_fullsized': '2023-11-28T11:58:51.172332+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T14:12:51.007363+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T11:58:56.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.16 is not active+clean 2023-11-28T11:58:56.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-11-28T11:58:51.166354+0000', 'last_change': '2023-11-28T11:58:51.166354+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.166354+0000', 'last_undegraded': '2023-11-28T11:58:51.166354+0000', 'last_fullsized': '2023-11-28T11:58:51.166354+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T19:16:01.044656+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T11:58:56.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.17 is not active+clean 2023-11-28T11:58:56.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 57, 'state': 'creating+activating', 'last_fresh': '2023-11-28T11:58:51.661507+0000', 'last_change': '2023-11-28T11:58:51.661507+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.661507+0000', 'last_undegraded': '2023-11-28T11:58:51.661507+0000', 'last_fullsized': '2023-11-28T11:58:51.661507+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T23:41:23.788694+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': ['7', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T11:58:56.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.14 is not active+clean 2023-11-28T11:58:56.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-11-28T11:58:51.178014+0000', 'last_change': '2023-11-28T11:58:51.178014+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.178014+0000', 'last_undegraded': '2023-11-28T11:58:51.178014+0000', 'last_fullsized': '2023-11-28T11:58:51.178014+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T18:14:29.875840+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T11:58:56.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.15 is not active+clean 2023-11-28T11:58:56.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 57, 'state': 'creating+activating', 'last_fresh': '2023-11-28T11:58:51.664974+0000', 'last_change': '2023-11-28T11:58:51.664974+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.664974+0000', 'last_undegraded': '2023-11-28T11:58:51.664974+0000', 'last_fullsized': '2023-11-28T11:58:51.664974+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T20:03:49.327209+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': ['7', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T11:58:56.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.12 is not active+clean 2023-11-28T11:58:56.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 57, 'state': 'creating+activating', 'last_fresh': '2023-11-28T11:58:51.656296+0000', 'last_change': '2023-11-28T11:58:51.656296+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.656296+0000', 'last_undegraded': '2023-11-28T11:58:51.656296+0000', 'last_fullsized': '2023-11-28T11:58:51.656296+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T18:17:04.728611+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': ['5', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T11:58:56.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.13 is not active+clean 2023-11-28T11:58:56.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 57, 'state': 'creating+activating', 'last_fresh': '2023-11-28T11:58:51.659384+0000', 'last_change': '2023-11-28T11:58:51.659384+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.659384+0000', 'last_undegraded': '2023-11-28T11:58:51.659384+0000', 'last_fullsized': '2023-11-28T11:58:51.659384+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T14:14:52.015075+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': ['7', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T11:58:56.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.10 is not active+clean 2023-11-28T11:58:56.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-11-28T11:58:51.166710+0000', 'last_change': '2023-11-28T11:58:51.166710+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.166710+0000', 'last_undegraded': '2023-11-28T11:58:51.166710+0000', 'last_fullsized': '2023-11-28T11:58:51.166710+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T14:43:18.872444+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T11:58:56.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.11 is not active+clean 2023-11-28T11:58:56.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 57, 'state': 'creating+activating', 'last_fresh': '2023-11-28T11:58:51.660022+0000', 'last_change': '2023-11-28T11:58:51.660022+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.660022+0000', 'last_undegraded': '2023-11-28T11:58:51.660022+0000', 'last_fullsized': '2023-11-28T11:58:51.660022+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T16:25:17.521536+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': ['7', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T11:58:56.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2023-11-28T11:58:56.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 57, 'state': 'creating+activating', 'last_fresh': '2023-11-28T11:58:51.656545+0000', 'last_change': '2023-11-28T11:58:51.656545+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.656545+0000', 'last_undegraded': '2023-11-28T11:58:51.656545+0000', 'last_fullsized': '2023-11-28T11:58:51.656545+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T23:23:30.095986+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': ['5', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T11:58:56.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.7 is not active+clean 2023-11-28T11:58:56.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 57, 'state': 'creating+activating', 'last_fresh': '2023-11-28T11:58:51.656711+0000', 'last_change': '2023-11-28T11:58:51.656711+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.656711+0000', 'last_undegraded': '2023-11-28T11:58:51.656711+0000', 'last_fullsized': '2023-11-28T11:58:51.656711+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T23:41:23.788694+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': ['5', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T11:58:56.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.4 is not active+clean 2023-11-28T11:58:56.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-11-28T11:58:51.177495+0000', 'last_change': '2023-11-28T11:58:51.177495+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.177495+0000', 'last_undegraded': '2023-11-28T11:58:51.177495+0000', 'last_fullsized': '2023-11-28T11:58:51.177495+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T23:47:19.620359+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T11:58:56.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2 is not active+clean 2023-11-28T11:58:56.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-11-28T11:58:51.171366+0000', 'last_change': '2023-11-28T11:58:51.171366+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.171366+0000', 'last_undegraded': '2023-11-28T11:58:51.171366+0000', 'last_fullsized': '2023-11-28T11:58:51.171366+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T19:22:28.860678+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T11:58:56.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3 is not active+clean 2023-11-28T11:58:56.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 57, 'state': 'creating+activating', 'last_fresh': '2023-11-28T11:58:51.660689+0000', 'last_change': '2023-11-28T11:58:51.660689+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.660689+0000', 'last_undegraded': '2023-11-28T11:58:51.660689+0000', 'last_fullsized': '2023-11-28T11:58:51.660689+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T14:51:09.793929+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': ['7', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T11:58:56.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.0 is not active+clean 2023-11-28T11:58:56.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-11-28T11:58:51.175011+0000', 'last_change': '2023-11-28T11:58:51.175011+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.175011+0000', 'last_undegraded': '2023-11-28T11:58:51.175011+0000', 'last_fullsized': '2023-11-28T11:58:51.175011+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T17:47:15.134857+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T11:58:56.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1 is not active+clean 2023-11-28T11:58:56.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-11-28T11:58:51.171492+0000', 'last_change': '2023-11-28T11:58:51.171492+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.171492+0000', 'last_undegraded': '2023-11-28T11:58:51.171492+0000', 'last_fullsized': '2023-11-28T11:58:51.171492+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T21:10:34.496313+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T11:58:56.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.c is not active+clean 2023-11-28T11:58:56.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-11-28T11:58:51.175238+0000', 'last_change': '2023-11-28T11:58:51.175238+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.175238+0000', 'last_undegraded': '2023-11-28T11:58:51.175238+0000', 'last_fullsized': '2023-11-28T11:58:51.175238+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T16:24:09.557069+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T11:58:56.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.d is not active+clean 2023-11-28T11:58:56.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 57, 'state': 'creating+activating', 'last_fresh': '2023-11-28T11:58:51.663363+0000', 'last_change': '2023-11-28T11:58:51.663363+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.663363+0000', 'last_undegraded': '2023-11-28T11:58:51.663363+0000', 'last_fullsized': '2023-11-28T11:58:51.663363+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T17:32:19.768923+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': ['7', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T11:58:56.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.e is not active+clean 2023-11-28T11:58:56.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 57, 'state': 'creating+activating', 'last_fresh': '2023-11-28T11:58:51.661133+0000', 'last_change': '2023-11-28T11:58:51.661133+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.661133+0000', 'last_undegraded': '2023-11-28T11:58:51.661133+0000', 'last_fullsized': '2023-11-28T11:58:51.661133+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T18:17:04.728611+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': ['7', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T11:58:56.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.f is not active+clean 2023-11-28T11:58:56.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 57, 'state': 'creating+activating', 'last_fresh': '2023-11-28T11:58:51.657774+0000', 'last_change': '2023-11-28T11:58:51.657774+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.657774+0000', 'last_undegraded': '2023-11-28T11:58:51.657774+0000', 'last_fullsized': '2023-11-28T11:58:51.657774+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T17:53:49.319201+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': ['5', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T11:58:56.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.a is not active+clean 2023-11-28T11:58:56.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 57, 'state': 'creating+activating', 'last_fresh': '2023-11-28T11:58:51.656818+0000', 'last_change': '2023-11-28T11:58:51.656818+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.656818+0000', 'last_undegraded': '2023-11-28T11:58:51.656818+0000', 'last_fullsized': '2023-11-28T11:58:51.656818+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T14:14:52.015075+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': ['5', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T11:58:56.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.8 is not active+clean 2023-11-28T11:58:56.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-11-28T11:58:51.171808+0000', 'last_change': '2023-11-28T11:58:51.171808+0000', 'last_active': '2023-11-28T11:58:51.137570+0000', 'last_peered': '2023-11-28T11:58:51.137570+0000', 'last_clean': '2023-11-28T11:58:51.137570+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:58:51.171808+0000', 'last_undegraded': '2023-11-28T11:58:51.171808+0000', 'last_fullsized': '2023-11-28T11:58:51.171808+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'last_clean_scrub_stamp': '2023-11-28T11:58:51.137570+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T20:05:51.844750+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T11:58:56.997 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-28T11:58:57.095 INFO:tasks.ceph.mds.b.smithi184.stderr:2023-11-28T11:58:57.091+0000 7fc0706a1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T11:58:57.207 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.203+0000 7f4e7759e700 1 Processor -- start 2023-11-28T11:58:57.207 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.203+0000 7f4e7759e700 1 -- start start 2023-11-28T11:58:57.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.207+0000 7f4e7759e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4e780c1d50 0x7f4e780b36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:57.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.207+0000 7f4e7759e700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e78069bf0 con 0x7f4e7806b240 2023-11-28T11:58:57.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.207+0000 7f4e7759e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e780b3c00 con 0x7f4e780ca8e0 2023-11-28T11:58:57.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.207+0000 7f4e7759e700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e78069e40 con 0x7f4e780c1d50 2023-11-28T11:58:57.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.207+0000 7f4e6dd9b700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4e780c1d50 0x7f4e780b36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:57.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.207+0000 7f4e76d9d700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f4e7806b240 0x7f4e780cb0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42398/0 (socket says 172.21.15.39:42398) 2023-11-28T11:58:57.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.207+0000 7f4e76d9d700 1 -- 172.21.15.39:0/1260382245 learned_addr learned my addr 172.21.15.39:0/1260382245 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:58:57.212 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.207+0000 7f4e75d9b700 1 -- 172.21.15.39:0/1260382245 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3201074440 0 0) 0x7f4e78069bf0 con 0x7f4e7806b240 2023-11-28T11:58:57.212 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.207+0000 7f4e75d9b700 1 -- 172.21.15.39:0/1260382245 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e640035d0 con 0x7f4e7806b240 2023-11-28T11:58:57.212 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.207+0000 7f4e75d9b700 1 -- 172.21.15.39:0/1260382245 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4028359315 0 0) 0x7f4e780b3c00 con 0x7f4e780ca8e0 2023-11-28T11:58:57.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.207+0000 7f4e6dd9b700 1 -- 172.21.15.39:0/1260382245 >> v1:172.21.15.184:6789/0 conn(0x7f4e780ca8e0 legacy=0x7f4e780c1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:57.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.207+0000 7f4e6dd9b700 1 -- 172.21.15.39:0/1260382245 >> v1:172.21.15.39:6789/0 conn(0x7f4e7806b240 legacy=0x7f4e780cb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:57.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.207+0000 7f4e6dd9b700 1 -- 172.21.15.39:0/1260382245 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e7806a120 con 0x7f4e780c1d50 2023-11-28T11:58:57.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.211+0000 7f4e6dd9b700 1 --2- 172.21.15.39:0/1260382245 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e780c1d50 0x7f4e780b36c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4e60009850 tx=0x7f4e60009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c619bb066e27bf12 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:57.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.211+0000 7f4e75d9b700 1 -- 172.21.15.39:0/1260382245 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e60011830 con 0x7f4e780c1d50 2023-11-28T11:58:57.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.211+0000 7f4e75d9b700 1 -- 172.21.15.39:0/1260382245 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e60011990 con 0x7f4e780c1d50 2023-11-28T11:58:57.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.211+0000 7f4e75d9b700 1 -- 172.21.15.39:0/1260382245 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e60011d40 con 0x7f4e780c1d50 2023-11-28T11:58:57.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.211+0000 7f4e7759e700 1 -- 172.21.15.39:0/1260382245 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e780c1d50 msgr2=0x7f4e780b36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:57.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.211+0000 7f4e7759e700 1 --2- 172.21.15.39:0/1260382245 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e780c1d50 0x7f4e780b36c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4e60009850 tx=0x7f4e60009b60 comp rx=0 tx=0).stop 2023-11-28T11:58:57.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.211+0000 7f4e7759e700 1 -- 172.21.15.39:0/1260382245 shutdown_connections 2023-11-28T11:58:57.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.211+0000 7f4e7759e700 1 --2- 172.21.15.39:0/1260382245 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e780c1d50 0x7f4e780b36c0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:57.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.211+0000 7f4e7759e700 1 -- 172.21.15.39:0/1260382245 >> 172.21.15.39:0/1260382245 conn(0x7f4e780ce670 msgr2=0x7f4e780cea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:57.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.211+0000 7f4e7759e700 1 -- 172.21.15.39:0/1260382245 shutdown_connections 2023-11-28T11:58:57.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.211+0000 7f4e7759e700 1 -- 172.21.15.39:0/1260382245 wait complete. 2023-11-28T11:58:57.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.215+0000 7f4e7759e700 1 Processor -- start 2023-11-28T11:58:57.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.215+0000 7f4e7759e700 1 -- start start 2023-11-28T11:58:57.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.215+0000 7f4e7759e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e7806b240 0x7f4e781609b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:57.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.215+0000 7f4e7759e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e780c1d50 0x7f4e780c40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:57.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.215+0000 7f4e7759e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e780ca8e0 0x7f4e780ae2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:57.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.215+0000 7f4e7759e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e780c57e0 con 0x7f4e780c1d50 2023-11-28T11:58:57.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.215+0000 7f4e7759e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e780c5ac0 con 0x7f4e780ca8e0 2023-11-28T11:58:57.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.215+0000 7f4e7759e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e780c5da0 con 0x7f4e7806b240 2023-11-28T11:58:57.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.215+0000 7f4e6dd9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e780c1d50 0x7f4e780c40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:57.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.215+0000 7f4e6dd9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e780c1d50 0x7f4e780c40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43854/0 (socket says 172.21.15.39:43854) 2023-11-28T11:58:57.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.215+0000 7f4e6dd9b700 1 -- 172.21.15.39:0/1645125142 learned_addr learned my addr 172.21.15.39:0/1645125142 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:57.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.215+0000 7f4e76d9d700 1 --2- 172.21.15.39:0/1645125142 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e780ca8e0 0x7f4e780ae2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:57.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.215+0000 7f4e7659c700 1 --2- 172.21.15.39:0/1645125142 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e7806b240 0x7f4e781609b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:57.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.215+0000 7f4e6dd9b700 1 -- 172.21.15.39:0/1645125142 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e7806b240 msgr2=0x7f4e781609b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:57.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.215+0000 7f4e6dd9b700 1 --2- 172.21.15.39:0/1645125142 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e7806b240 0x7f4e781609b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:57.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.215+0000 7f4e6dd9b700 1 -- 172.21.15.39:0/1645125142 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e780ca8e0 msgr2=0x7f4e780ae2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:57.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.215+0000 7f4e6dd9b700 1 --2- 172.21.15.39:0/1645125142 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e780ca8e0 0x7f4e780ae2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:57.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.215+0000 7f4e6dd9b700 1 -- 172.21.15.39:0/1645125142 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e600094b0 con 0x7f4e780c1d50 2023-11-28T11:58:57.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.215+0000 7f4e6dd9b700 1 --2- 172.21.15.39:0/1645125142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e780c1d50 0x7f4e780c40d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4e60013000 tx=0x7f4e60004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:57.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.215+0000 7f4e6f7fe700 1 -- 172.21.15.39:0/1645125142 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6001a990 con 0x7f4e780c1d50 2023-11-28T11:58:57.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.215+0000 7f4e6f7fe700 1 -- 172.21.15.39:0/1645125142 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e6001f070 con 0x7f4e780c1d50 2023-11-28T11:58:57.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.219+0000 7f4e7759e700 1 -- 172.21.15.39:0/1645125142 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e7806a6e0 con 0x7f4e780c1d50 2023-11-28T11:58:57.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.219+0000 7f4e6f7fe700 1 -- 172.21.15.39:0/1645125142 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6001ad50 con 0x7f4e780c1d50 2023-11-28T11:58:57.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.219+0000 7f4e7759e700 1 -- 172.21.15.39:0/1645125142 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e7806a400 con 0x7f4e780c1d50 2023-11-28T11:58:57.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.219+0000 7f4e7759e700 1 -- 172.21.15.39:0/1645125142 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e7806a9c0 con 0x7f4e780c1d50 2023-11-28T11:58:57.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.219+0000 7f4e6f7fe700 1 -- 172.21.15.39:0/1645125142 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4e6000f050 con 0x7f4e780c1d50 2023-11-28T11:58:57.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.223+0000 7f4e6f7fe700 1 --2- 172.21.15.39:0/1645125142 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4e58064ee0 0x7f4e58067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:57.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.223+0000 7f4e6f7fe700 1 -- 172.21.15.39:0/1645125142 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4e60082f80 con 0x7f4e780c1d50 2023-11-28T11:58:57.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.223+0000 7f4e7659c700 1 --2- 172.21.15.39:0/1645125142 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4e58064ee0 0x7f4e58067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:57.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.223+0000 7f4e7659c700 1 --2- 172.21.15.39:0/1645125142 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4e58064ee0 0x7f4e58067390 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4e680012e0 tx=0x7f4e68009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:57.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.227+0000 7f4e6f7fe700 1 -- 172.21.15.39:0/1645125142 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4e60050fe0 con 0x7f4e780c1d50 2023-11-28T11:58:57.473 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.471+0000 7f4e7759e700 1 -- 172.21.15.39:0/1645125142 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f4e78073cb0 con 0x7f4e780c1d50 2023-11-28T11:58:57.474 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.471+0000 7f4e6f7fe700 1 -- 172.21.15.39:0/1645125142 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1564 (secure 0 0 0) 0x7f4e60021630 con 0x7f4e780c1d50 2023-11-28T11:58:57.474 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:58:57.475 INFO:teuthology.orchestra.run.smithi039.stdout:{"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":163,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":58,"num_osds":8,"num_up_osds":8,"osd_up_since":1701172586,"num_in_osds":8,"osd_in_since":1701172576,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":57},{"state_name":"creating+peering","count":25},{"state_name":"creating+activating","count":23}],"num_pgs":105,"num_pools":4,"num_objects":12,"data_bytes":591024,"bytes_used":81600512,"bytes_avail":773012512768,"bytes_total":773094113280,"inactive_pgs_ratio":0.45714285969734192,"write_bytes_sec":341,"read_op_per_sec":0,"write_op_per_sec":4},"fsmap":{"epoch":24,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"b","status":"up:active","gid":5809}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2023-11-28T11:58:40.594056+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-28T11:58:57.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.475+0000 7f4e7759e700 1 -- 172.21.15.39:0/1645125142 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4e58064ee0 msgr2=0x7f4e58067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:57.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.475+0000 7f4e7759e700 1 --2- 172.21.15.39:0/1645125142 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4e58064ee0 0x7f4e58067390 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4e680012e0 tx=0x7f4e68009040 comp rx=0 tx=0).stop 2023-11-28T11:58:57.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.475+0000 7f4e7759e700 1 -- 172.21.15.39:0/1645125142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e780c1d50 msgr2=0x7f4e780c40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:57.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.475+0000 7f4e7759e700 1 --2- 172.21.15.39:0/1645125142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e780c1d50 0x7f4e780c40d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4e60013000 tx=0x7f4e60004770 comp rx=0 tx=0).stop 2023-11-28T11:58:57.480 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.475+0000 7f4e7759e700 1 -- 172.21.15.39:0/1645125142 shutdown_connections 2023-11-28T11:58:57.480 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.475+0000 7f4e7759e700 1 --2- 172.21.15.39:0/1645125142 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4e58064ee0 0x7f4e58067390 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:57.480 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.475+0000 7f4e7759e700 1 --2- 172.21.15.39:0/1645125142 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e780ca8e0 0x7f4e780ae2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:57.480 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.475+0000 7f4e7759e700 1 --2- 172.21.15.39:0/1645125142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e780c1d50 0x7f4e780c40d0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:57.480 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.475+0000 7f4e7759e700 1 --2- 172.21.15.39:0/1645125142 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e7806b240 0x7f4e781609b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:57.480 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.475+0000 7f4e7759e700 1 -- 172.21.15.39:0/1645125142 >> 172.21.15.39:0/1645125142 conn(0x7f4e780ce670 msgr2=0x7f4e780c1640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:57.480 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.475+0000 7f4e7759e700 1 -- 172.21.15.39:0/1645125142 shutdown_connections 2023-11-28T11:58:57.480 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.475+0000 7f4e7759e700 1 -- 172.21.15.39:0/1645125142 wait complete. 2023-11-28T11:58:57.504 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-28T11:58:57.504 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:58:57.680 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.675+0000 7f152f59e700 1 Processor -- start 2023-11-28T11:58:57.680 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.675+0000 7f152f59e700 1 -- start start 2023-11-28T11:58:57.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.679+0000 7f152f59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1530070790 0x7f1530167110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:57.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.679+0000 7f152f59e700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15300adf90 con 0x7f153015c1a0 2023-11-28T11:58:57.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.679+0000 7f152f59e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15300ce370 con 0x7f15300cdeb0 2023-11-28T11:58:57.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.679+0000 7f152f59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1530069bf0 con 0x7f1530070790 2023-11-28T11:58:57.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.679+0000 7f152e59c700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f153015c1a0 0x7f153006c8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42410/0 (socket says 172.21.15.39:42410) 2023-11-28T11:58:57.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.679+0000 7f152e59c700 1 -- 172.21.15.39:0/891317815 learned_addr learned my addr 172.21.15.39:0/891317815 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:58:57.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.679+0000 7f152ed9d700 1 --2- 172.21.15.39:0/891317815 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1530070790 0x7f1530167110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:57.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.679+0000 7f152dd9b700 1 -- 172.21.15.39:0/891317815 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2661075314 0 0) 0x7f15300adf90 con 0x7f153015c1a0 2023-11-28T11:58:57.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.679+0000 7f152dd9b700 1 -- 172.21.15.39:0/891317815 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f151c0035d0 con 0x7f153015c1a0 2023-11-28T11:58:57.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.679+0000 7f152dd9b700 1 -- 172.21.15.39:0/891317815 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1699530723 0 0) 0x7f151c0035d0 con 0x7f153015c1a0 2023-11-28T11:58:57.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.679+0000 7f152dd9b700 1 -- 172.21.15.39:0/891317815 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1530070790 msgr2=0x7f1530167110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:57.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.679+0000 7f152dd9b700 1 --2- 172.21.15.39:0/891317815 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1530070790 0x7f1530167110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:57.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.679+0000 7f152dd9b700 1 -- 172.21.15.39:0/891317815 >> v1:172.21.15.184:6789/0 conn(0x7f15300cdeb0 legacy=0x7f1530070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:57.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.679+0000 7f152dd9b700 1 -- 172.21.15.39:0/891317815 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15300cc4a0 con 0x7f153015c1a0 2023-11-28T11:58:57.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.679+0000 7f152dd9b700 1 -- 172.21.15.39:0/891317815 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4013383302 0 0) 0x7f1520001690 con 0x7f153015c1a0 2023-11-28T11:58:57.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.679+0000 7f152dd9b700 1 -- 172.21.15.39:0/891317815 >> v1:172.21.15.39:6789/0 conn(0x7f153015c1a0 legacy=0x7f153006c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:57.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.679+0000 7f152dd9b700 1 --2- 172.21.15.39:0/891317815 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1530070790 0x7f151c003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:57.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.679+0000 7f152dd9b700 1 --2- 172.21.15.39:0/891317815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f151c004080 0x7f151c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:57.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.679+0000 7f152dd9b700 1 --2- 172.21.15.39:0/891317815 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f151c004db0 0x7f151c005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:57.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.679+0000 7f152dd9b700 1 -- 172.21.15.39:0/891317815 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1530069bf0 con 0x7f151c004db0 2023-11-28T11:58:57.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.679+0000 7f152dd9b700 1 -- 172.21.15.39:0/891317815 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151c00bc40 con 0x7f151c004080 2023-11-28T11:58:57.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.679+0000 7f152dd9b700 1 -- 172.21.15.39:0/891317815 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f151c00be00 con 0x7f1530070790 2023-11-28T11:58:57.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.679+0000 7f152ed9d700 1 --2- 172.21.15.39:0/891317815 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f151c004db0 0x7f151c005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:57.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.679+0000 7f1525d9b700 1 --2- 172.21.15.39:0/891317815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f151c004080 0x7f151c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:57.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.679+0000 7f152e59c700 1 --2- 172.21.15.39:0/891317815 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1530070790 0x7f151c003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:57.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.683+0000 7f1525d9b700 1 -- 172.21.15.39:0/891317815 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1530070790 msgr2=0x7f151c003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:57.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.683+0000 7f1525d9b700 1 --2- 172.21.15.39:0/891317815 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1530070790 0x7f151c003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:57.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.683+0000 7f1525d9b700 1 -- 172.21.15.39:0/891317815 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f151c004db0 msgr2=0x7f151c005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:57.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.683+0000 7f1525d9b700 1 --2- 172.21.15.39:0/891317815 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f151c004db0 0x7f151c005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:57.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.683+0000 7f1525d9b700 1 -- 172.21.15.39:0/891317815 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f151c0035d0 con 0x7f151c004080 2023-11-28T11:58:57.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.683+0000 7f1525d9b700 1 --2- 172.21.15.39:0/891317815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f151c004080 0x7f151c004870 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f15300ce2a0 tx=0x7f151c0058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bdad56f887a1ef4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:57.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.683+0000 7f152dd9b700 1 -- 172.21.15.39:0/891317815 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15180052d0 con 0x7f151c004080 2023-11-28T11:58:57.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.683+0000 7f152dd9b700 1 -- 172.21.15.39:0/891317815 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1518005430 con 0x7f151c004080 2023-11-28T11:58:57.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.683+0000 7f152dd9b700 1 -- 172.21.15.39:0/891317815 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15180055a0 con 0x7f151c004080 2023-11-28T11:58:57.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.683+0000 7f152f59e700 1 -- 172.21.15.39:0/891317815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f151c004080 msgr2=0x7f151c004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:57.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.683+0000 7f152f59e700 1 --2- 172.21.15.39:0/891317815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f151c004080 0x7f151c004870 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f15300ce2a0 tx=0x7f151c0058a0 comp rx=0 tx=0).stop 2023-11-28T11:58:57.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.683+0000 7f152ed9d700 1 -- 172.21.15.39:0/891317815 reap_dead start 2023-11-28T11:58:57.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.683+0000 7f152f59e700 1 -- 172.21.15.39:0/891317815 shutdown_connections 2023-11-28T11:58:57.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.683+0000 7f152f59e700 1 -- 172.21.15.39:0/891317815 >> 172.21.15.39:0/891317815 conn(0x7f15300b0f80 msgr2=0x7f15300ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:57.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.683+0000 7f152f59e700 1 -- 172.21.15.39:0/891317815 shutdown_connections 2023-11-28T11:58:57.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.683+0000 7f152f59e700 1 -- 172.21.15.39:0/891317815 wait complete. 2023-11-28T11:58:57.690 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.687+0000 7f152f59e700 1 Processor -- start 2023-11-28T11:58:57.690 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.687+0000 7f152f59e700 1 -- start start 2023-11-28T11:58:57.692 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.687+0000 7f152f59e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f151c004080 0x7f1530157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:57.692 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.687+0000 7f152f59e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15300b3170 0x7f15300b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:57.692 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.687+0000 7f152f59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15300b3d80 0x7f15300b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:57.692 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.687+0000 7f152f59e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15300b4730 con 0x7f151c004080 2023-11-28T11:58:57.692 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.687+0000 7f152f59e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153015d680 con 0x7f15300b3170 2023-11-28T11:58:57.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.687+0000 7f152f59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f153015ca70 con 0x7f15300b3d80 2023-11-28T11:58:57.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.691+0000 7f152e59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f151c004080 0x7f1530157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:57.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.691+0000 7f152e59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f151c004080 0x7f1530157d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43878/0 (socket says 172.21.15.39:43878) 2023-11-28T11:58:57.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.691+0000 7f152e59c700 1 -- 172.21.15.39:0/2202550927 learned_addr learned my addr 172.21.15.39:0/2202550927 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:58:57.694 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.691+0000 7f1525d9b700 1 --2- 172.21.15.39:0/2202550927 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15300b3170 0x7f15300b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:57.694 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.691+0000 7f152ed9d700 1 --2- 172.21.15.39:0/2202550927 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15300b3d80 0x7f15300b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:57.694 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.691+0000 7f152e59c700 1 -- 172.21.15.39:0/2202550927 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15300b3d80 msgr2=0x7f15300b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:57.694 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.691+0000 7f152e59c700 1 --2- 172.21.15.39:0/2202550927 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15300b3d80 0x7f15300b41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:57.694 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.691+0000 7f152e59c700 1 -- 172.21.15.39:0/2202550927 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15300b3170 msgr2=0x7f15300b35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:57.694 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.691+0000 7f152e59c700 1 --2- 172.21.15.39:0/2202550927 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15300b3170 0x7f15300b35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:57.694 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.691+0000 7f152e59c700 1 -- 172.21.15.39:0/2202550927 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f153015c570 con 0x7f151c004080 2023-11-28T11:58:57.694 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.691+0000 7f152ed9d700 1 --2- 172.21.15.39:0/2202550927 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15300b3d80 0x7f15300b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:58:57.694 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.691+0000 7f152e59c700 1 --2- 172.21.15.39:0/2202550927 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f151c004080 0x7f1530157d80 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f152000eaf0 tx=0x7f152000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:57.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.691+0000 7f15277fe700 1 -- 172.21.15.39:0/2202550927 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1520005e20 con 0x7f151c004080 2023-11-28T11:58:57.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.691+0000 7f15277fe700 1 -- 172.21.15.39:0/2202550927 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f152000c780 con 0x7f151c004080 2023-11-28T11:58:57.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.691+0000 7f152f59e700 1 -- 172.21.15.39:0/2202550927 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15300cc780 con 0x7f151c004080 2023-11-28T11:58:57.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.691+0000 7f15277fe700 1 -- 172.21.15.39:0/2202550927 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152000cb30 con 0x7f151c004080 2023-11-28T11:58:57.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.691+0000 7f152f59e700 1 -- 172.21.15.39:0/2202550927 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f153006b020 con 0x7f151c004080 2023-11-28T11:58:57.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.691+0000 7f152f59e700 1 -- 172.21.15.39:0/2202550927 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1530073cb0 con 0x7f151c004080 2023-11-28T11:58:57.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.695+0000 7f15277fe700 1 -- 172.21.15.39:0/2202550927 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f152000cc90 con 0x7f151c004080 2023-11-28T11:58:57.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.695+0000 7f15277fe700 1 --2- 172.21.15.39:0/2202550927 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1510064f10 0x7f15100673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:57.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.695+0000 7f15277fe700 1 -- 172.21.15.39:0/2202550927 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1520081e70 con 0x7f151c004080 2023-11-28T11:58:57.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.695+0000 7f1525d9b700 1 --2- 172.21.15.39:0/2202550927 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1510064f10 0x7f15100673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:57.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.699+0000 7f1525d9b700 1 --2- 172.21.15.39:0/2202550927 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1510064f10 0x7f15100673c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f15300c88b0 tx=0x7f1518009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:57.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.703+0000 7f15277fe700 1 -- 172.21.15.39:0/2202550927 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f152004ff30 con 0x7f151c004080 2023-11-28T11:58:57.879 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.875+0000 7f152f59e700 1 -- 172.21.15.39:0/2202550927 --> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f153015d7c0 con 0x7f1510064f10 2023-11-28T11:58:57.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.895+0000 7f15277fe700 1 -- 172.21.15.39:0/2202550927 <== mgr.4104 v2:172.21.15.184:6832/36166 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306730 (secure 0 0 0) 0x7f1518023070 con 0x7f1510064f10 2023-11-28T11:58:57.901 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:58:57.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.903+0000 7f152f59e700 1 -- 172.21.15.39:0/2202550927 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1510064f10 msgr2=0x7f15100673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:57.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.903+0000 7f152f59e700 1 --2- 172.21.15.39:0/2202550927 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1510064f10 0x7f15100673c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f15300c88b0 tx=0x7f1518009030 comp rx=0 tx=0).stop 2023-11-28T11:58:57.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.903+0000 7f152f59e700 1 -- 172.21.15.39:0/2202550927 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f151c004080 msgr2=0x7f1530157d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:57.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.903+0000 7f152f59e700 1 --2- 172.21.15.39:0/2202550927 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f151c004080 0x7f1530157d80 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f152000eaf0 tx=0x7f152000ee00 comp rx=0 tx=0).stop 2023-11-28T11:58:57.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.903+0000 7f152f59e700 1 -- 172.21.15.39:0/2202550927 shutdown_connections 2023-11-28T11:58:57.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.903+0000 7f152f59e700 1 --2- 172.21.15.39:0/2202550927 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15300b3d80 0x7f15300b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:57.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.903+0000 7f152f59e700 1 --2- 172.21.15.39:0/2202550927 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1510064f10 0x7f15100673c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:57.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.903+0000 7f152f59e700 1 --2- 172.21.15.39:0/2202550927 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15300b3170 0x7f15300b35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:57.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.903+0000 7f152f59e700 1 --2- 172.21.15.39:0/2202550927 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f151c004080 0x7f1530157d80 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:57.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.903+0000 7f152f59e700 1 -- 172.21.15.39:0/2202550927 >> 172.21.15.39:0/2202550927 conn(0x7f15300b0f80 msgr2=0x7f153006c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:57.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.903+0000 7f152f59e700 1 -- 172.21.15.39:0/2202550927 shutdown_connections 2023-11-28T11:58:57.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:58:57.903+0000 7f152f59e700 1 -- 172.21.15.39:0/2202550927 wait complete. 2023-11-28T11:58:57.909 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2023-11-28T11:58:57.930 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2023-11-28T11:58:56.599431+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591024,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":185,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":89,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":79688,"kb_used_data":6344,"kb_used_omap":0,"kb_used_meta":73280,"kb_avail":754895032,"statfs":{"total":773094113280,"available":773012512768,"internally_reserved":0,"allocated":6496256,"data_stored":3592505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":75038720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":656,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002186"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:52.660808+0000","last_change":"2023-11-28T11:58:51.667755+0000","last_active":"2023-11-28T11:58:52.660808+0000","last_peered":"2023-11-28T11:58:52.660808+0000","last_clean":"2023-11-28T11:58:52.660808+0000","last_became_active":"2023-11-28T11:58:51.667513+0000","last_became_peered":"2023-11-28T11:58:51.667513+0000","last_unstale":"2023-11-28T11:58:52.660808+0000","last_undegraded":"2023-11-28T11:58:52.660808+0000","last_fullsized":"2023-11-28T11:58:52.660808+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:39:53.174032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.180906+0000","last_change":"2023-11-28T11:58:51.180906+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.180906+0000","last_undegraded":"2023-11-28T11:58:51.180906+0000","last_fullsized":"2023-11-28T11:58:51.180906+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:47:10.246224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.662021+0000","last_change":"2023-11-28T11:58:51.662021+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.662021+0000","last_undegraded":"2023-11-28T11:58:51.662021+0000","last_fullsized":"2023-11-28T11:58:51.662021+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:53:49.319201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.656796+0000","last_change":"2023-11-28T11:58:51.656796+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.656796+0000","last_undegraded":"2023-11-28T11:58:51.656796+0000","last_fullsized":"2023-11-28T11:58:51.656796+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:37:13.495875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:52.660267+0000","last_change":"2023-11-28T11:58:51.673108+0000","last_active":"2023-11-28T11:58:52.660267+0000","last_peered":"2023-11-28T11:58:52.660267+0000","last_clean":"2023-11-28T11:58:52.660267+0000","last_became_active":"2023-11-28T11:58:51.671231+0000","last_became_peered":"2023-11-28T11:58:51.671231+0000","last_unstale":"2023-11-28T11:58:52.660267+0000","last_undegraded":"2023-11-28T11:58:52.660267+0000","last_fullsized":"2023-11-28T11:58:52.660267+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:07:32.065825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:53.159544+0000","last_change":"2023-11-28T11:58:51.665930+0000","last_active":"2023-11-28T11:58:53.159544+0000","last_peered":"2023-11-28T11:58:53.159544+0000","last_clean":"2023-11-28T11:58:53.159544+0000","last_became_active":"2023-11-28T11:58:51.665680+0000","last_became_peered":"2023-11-28T11:58:51.665680+0000","last_unstale":"2023-11-28T11:58:53.159544+0000","last_undegraded":"2023-11-28T11:58:53.159544+0000","last_fullsized":"2023-11-28T11:58:53.159544+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:04:14.466873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.167375+0000","last_change":"2023-11-28T11:58:51.167375+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.167375+0000","last_undegraded":"2023-11-28T11:58:51.167375+0000","last_fullsized":"2023-11-28T11:58:51.167375+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:23:30.095986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.181470+0000","last_change":"2023-11-28T11:58:51.181470+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.181470+0000","last_undegraded":"2023-11-28T11:58:51.181470+0000","last_fullsized":"2023-11-28T11:58:51.181470+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:04:34.153300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.166525+0000","last_change":"2023-11-28T11:58:51.166525+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.166525+0000","last_undegraded":"2023-11-28T11:58:51.166525+0000","last_fullsized":"2023-11-28T11:58:51.166525+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:37:13.495875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.176434+0000","last_change":"2023-11-28T11:58:51.176434+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.176434+0000","last_undegraded":"2023-11-28T11:58:51.176434+0000","last_fullsized":"2023-11-28T11:58:51.176434+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:04:56.514139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.176265+0000","last_change":"2023-11-28T11:58:51.176265+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.176265+0000","last_undegraded":"2023-11-28T11:58:51.176265+0000","last_fullsized":"2023-11-28T11:58:51.176265+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:22.086240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.657117+0000","last_change":"2023-11-28T11:58:51.657117+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.657117+0000","last_undegraded":"2023-11-28T11:58:51.657117+0000","last_fullsized":"2023-11-28T11:58:51.657117+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:05:25.321914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.649448+0000","last_change":"2023-11-28T11:58:51.649448+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.649448+0000","last_undegraded":"2023-11-28T11:58:51.649448+0000","last_fullsized":"2023-11-28T11:58:51.649448+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:47:19.620359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":["6","0"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.167346+0000","last_change":"2023-11-28T11:58:51.167346+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.167346+0000","last_undegraded":"2023-11-28T11:58:51.167346+0000","last_fullsized":"2023-11-28T11:58:51.167346+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:20:26.402257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.166897+0000","last_change":"2023-11-28T11:58:51.166897+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.166897+0000","last_undegraded":"2023-11-28T11:58:51.166897+0000","last_fullsized":"2023-11-28T11:58:51.166897+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:31:57.919489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:53.159390+0000","last_change":"2023-11-28T11:58:51.657821+0000","last_active":"2023-11-28T11:58:53.159390+0000","last_peered":"2023-11-28T11:58:53.159390+0000","last_clean":"2023-11-28T11:58:53.159390+0000","last_became_active":"2023-11-28T11:58:51.657561+0000","last_became_peered":"2023-11-28T11:58:51.657561+0000","last_unstale":"2023-11-28T11:58:53.159390+0000","last_undegraded":"2023-11-28T11:58:53.159390+0000","last_fullsized":"2023-11-28T11:58:53.159390+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:43:55.215996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.180775+0000","last_change":"2023-11-28T11:58:51.180775+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.180775+0000","last_undegraded":"2023-11-28T11:58:51.180775+0000","last_fullsized":"2023-11-28T11:58:51.180775+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:21:34.475958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.660726+0000","last_change":"2023-11-28T11:58:51.660726+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.660726+0000","last_undegraded":"2023-11-28T11:58:51.660726+0000","last_fullsized":"2023-11-28T11:58:51.660726+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:05:25.321914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":["7","0"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:52.660438+0000","last_change":"2023-11-28T11:58:51.668558+0000","last_active":"2023-11-28T11:58:52.660438+0000","last_peered":"2023-11-28T11:58:52.660438+0000","last_clean":"2023-11-28T11:58:52.660438+0000","last_became_active":"2023-11-28T11:58:51.668252+0000","last_became_peered":"2023-11-28T11:58:51.668252+0000","last_unstale":"2023-11-28T11:58:52.660438+0000","last_undegraded":"2023-11-28T11:58:52.660438+0000","last_fullsized":"2023-11-28T11:58:52.660438+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:04:19.289140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.177158+0000","last_change":"2023-11-28T11:58:51.177158+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.177158+0000","last_undegraded":"2023-11-28T11:58:51.177158+0000","last_fullsized":"2023-11-28T11:58:51.177158+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:23:19.193646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.659009+0000","last_change":"2023-11-28T11:58:51.659009+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.659009+0000","last_undegraded":"2023-11-28T11:58:51.659009+0000","last_fullsized":"2023-11-28T11:58:51.659009+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:28:12.186813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.177078+0000","last_change":"2023-11-28T11:58:51.177078+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.177078+0000","last_undegraded":"2023-11-28T11:58:51.177078+0000","last_fullsized":"2023-11-28T11:58:51.177078+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:48:03.508051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.659105+0000","last_change":"2023-11-28T11:58:51.659105+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.659105+0000","last_undegraded":"2023-11-28T11:58:51.659105+0000","last_fullsized":"2023-11-28T11:58:51.659105+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:36:20.149308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.648893+0000","last_change":"2023-11-28T11:58:51.648893+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.648893+0000","last_undegraded":"2023-11-28T11:58:51.648893+0000","last_fullsized":"2023-11-28T11:58:51.648893+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:22.086240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":["6","0"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:52.660798+0000","last_change":"2023-11-28T11:58:51.678822+0000","last_active":"2023-11-28T11:58:52.660798+0000","last_peered":"2023-11-28T11:58:52.660798+0000","last_clean":"2023-11-28T11:58:52.660798+0000","last_became_active":"2023-11-28T11:58:51.678250+0000","last_became_peered":"2023-11-28T11:58:51.678250+0000","last_unstale":"2023-11-28T11:58:52.660798+0000","last_undegraded":"2023-11-28T11:58:52.660798+0000","last_fullsized":"2023-11-28T11:58:52.660798+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:00:20.015581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.656897+0000","last_change":"2023-11-28T11:58:51.656897+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.656897+0000","last_undegraded":"2023-11-28T11:58:51.656897+0000","last_fullsized":"2023-11-28T11:58:51.656897+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:03:49.327209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":["5","4"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:53.160441+0000","last_change":"2023-11-28T11:58:51.662109+0000","last_active":"2023-11-28T11:58:53.160441+0000","last_peered":"2023-11-28T11:58:53.160441+0000","last_clean":"2023-11-28T11:58:53.160441+0000","last_became_active":"2023-11-28T11:58:51.658574+0000","last_became_peered":"2023-11-28T11:58:51.658574+0000","last_unstale":"2023-11-28T11:58:53.160441+0000","last_undegraded":"2023-11-28T11:58:53.160441+0000","last_fullsized":"2023-11-28T11:58:53.160441+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:08:13.836696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:52.660478+0000","last_change":"2023-11-28T11:58:51.672130+0000","last_active":"2023-11-28T11:58:52.660478+0000","last_peered":"2023-11-28T11:58:52.660478+0000","last_clean":"2023-11-28T11:58:52.660478+0000","last_became_active":"2023-11-28T11:58:51.671137+0000","last_became_peered":"2023-11-28T11:58:51.671137+0000","last_unstale":"2023-11-28T11:58:52.660478+0000","last_undegraded":"2023-11-28T11:58:52.660478+0000","last_fullsized":"2023-11-28T11:58:52.660478+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:12:05.660571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.172715+0000","last_change":"2023-11-28T11:58:51.172715+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.172715+0000","last_undegraded":"2023-11-28T11:58:51.172715+0000","last_fullsized":"2023-11-28T11:58:51.172715+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:42:12.056606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.659077+0000","last_change":"2023-11-28T11:58:51.659077+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.659077+0000","last_undegraded":"2023-11-28T11:58:51.659077+0000","last_fullsized":"2023-11-28T11:58:51.659077+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:37:13.495875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:52.660018+0000","last_change":"2023-11-28T11:58:51.669901+0000","last_active":"2023-11-28T11:58:52.660018+0000","last_peered":"2023-11-28T11:58:52.660018+0000","last_clean":"2023-11-28T11:58:52.660018+0000","last_became_active":"2023-11-28T11:58:51.669260+0000","last_became_peered":"2023-11-28T11:58:51.669260+0000","last_unstale":"2023-11-28T11:58:52.660018+0000","last_undegraded":"2023-11-28T11:58:52.660018+0000","last_fullsized":"2023-11-28T11:58:52.660018+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:54:31.914532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:53.159462+0000","last_change":"2023-11-28T11:58:51.671474+0000","last_active":"2023-11-28T11:58:53.159462+0000","last_peered":"2023-11-28T11:58:53.159462+0000","last_clean":"2023-11-28T11:58:53.159462+0000","last_became_active":"2023-11-28T11:58:51.670978+0000","last_became_peered":"2023-11-28T11:58:51.670978+0000","last_unstale":"2023-11-28T11:58:53.159462+0000","last_undegraded":"2023-11-28T11:58:53.159462+0000","last_fullsized":"2023-11-28T11:58:53.159462+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:03:19.954423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:53.161425+0000","last_change":"2023-11-28T11:58:51.672350+0000","last_active":"2023-11-28T11:58:53.161425+0000","last_peered":"2023-11-28T11:58:53.161425+0000","last_clean":"2023-11-28T11:58:53.161425+0000","last_became_active":"2023-11-28T11:58:51.672065+0000","last_became_peered":"2023-11-28T11:58:51.672065+0000","last_unstale":"2023-11-28T11:58:53.161425+0000","last_undegraded":"2023-11-28T11:58:53.161425+0000","last_fullsized":"2023-11-28T11:58:53.161425+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:51:14.342111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"57'4","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.680245+0000","last_change":"2023-11-28T11:58:51.187075+0000","last_active":"2023-11-28T11:58:51.680245+0000","last_peered":"2023-11-28T11:58:51.680245+0000","last_clean":"2023-11-28T11:58:51.680245+0000","last_became_active":"2023-11-28T11:58:51.186745+0000","last_became_peered":"2023-11-28T11:58:51.186745+0000","last_unstale":"2023-11-28T11:58:51.680245+0000","last_undegraded":"2023-11-28T11:58:51.680245+0000","last_fullsized":"2023-11-28T11:58:51.680245+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:53:15.246374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.175693+0000","last_change":"2023-11-28T11:58:51.175693+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.175693+0000","last_undegraded":"2023-11-28T11:58:51.175693+0000","last_fullsized":"2023-11-28T11:58:51.175693+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:36:59.737858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.190539+0000","last_change":"2023-11-28T11:58:51.177136+0000","last_active":"2023-11-28T11:58:51.190539+0000","last_peered":"2023-11-28T11:58:51.190539+0000","last_clean":"2023-11-28T11:58:51.190539+0000","last_became_active":"2023-11-28T11:58:51.176824+0000","last_became_peered":"2023-11-28T11:58:51.176824+0000","last_unstale":"2023-11-28T11:58:51.190539+0000","last_undegraded":"2023-11-28T11:58:51.190539+0000","last_fullsized":"2023-11-28T11:58:51.190539+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:32:18.747280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:53.160565+0000","last_change":"2023-11-28T11:58:51.662526+0000","last_active":"2023-11-28T11:58:53.160565+0000","last_peered":"2023-11-28T11:58:53.160565+0000","last_clean":"2023-11-28T11:58:53.160565+0000","last_became_active":"2023-11-28T11:58:51.662293+0000","last_became_peered":"2023-11-28T11:58:51.662293+0000","last_unstale":"2023-11-28T11:58:53.160565+0000","last_undegraded":"2023-11-28T11:58:53.160565+0000","last_fullsized":"2023-11-28T11:58:53.160565+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:52:06.479074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"57'2","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.682862+0000","last_change":"2023-11-28T11:58:51.187837+0000","last_active":"2023-11-28T11:58:51.682862+0000","last_peered":"2023-11-28T11:58:51.682862+0000","last_clean":"2023-11-28T11:58:51.682862+0000","last_became_active":"2023-11-28T11:58:51.187147+0000","last_became_peered":"2023-11-28T11:58:51.187147+0000","last_unstale":"2023-11-28T11:58:51.682862+0000","last_undegraded":"2023-11-28T11:58:51.682862+0000","last_fullsized":"2023-11-28T11:58:51.682862+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:16:05.197854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:53.161235+0000","last_change":"2023-11-28T11:58:51.678151+0000","last_active":"2023-11-28T11:58:53.161235+0000","last_peered":"2023-11-28T11:58:53.161235+0000","last_clean":"2023-11-28T11:58:53.161235+0000","last_became_active":"2023-11-28T11:58:51.677796+0000","last_became_peered":"2023-11-28T11:58:51.677796+0000","last_unstale":"2023-11-28T11:58:53.161235+0000","last_undegraded":"2023-11-28T11:58:53.161235+0000","last_fullsized":"2023-11-28T11:58:53.161235+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:57:14.978843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.183323+0000","last_change":"2023-11-28T11:58:51.179001+0000","last_active":"2023-11-28T11:58:51.183323+0000","last_peered":"2023-11-28T11:58:51.183323+0000","last_clean":"2023-11-28T11:58:51.183323+0000","last_became_active":"2023-11-28T11:58:51.178671+0000","last_became_peered":"2023-11-28T11:58:51.178671+0000","last_unstale":"2023-11-28T11:58:51.183323+0000","last_undegraded":"2023-11-28T11:58:51.183323+0000","last_fullsized":"2023-11-28T11:58:51.183323+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:48:41.050307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.172305+0000","last_change":"2023-11-28T11:58:51.172305+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.172305+0000","last_undegraded":"2023-11-28T11:58:51.172305+0000","last_fullsized":"2023-11-28T11:58:51.172305+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:31:00.537286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.193474+0000","last_change":"2023-11-28T11:58:51.192459+0000","last_active":"2023-11-28T11:58:51.193474+0000","last_peered":"2023-11-28T11:58:51.193474+0000","last_clean":"2023-11-28T11:58:51.193474+0000","last_became_active":"2023-11-28T11:58:51.192125+0000","last_became_peered":"2023-11-28T11:58:51.192125+0000","last_unstale":"2023-11-28T11:58:51.193474+0000","last_undegraded":"2023-11-28T11:58:51.193474+0000","last_fullsized":"2023-11-28T11:58:51.193474+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:25:16.499893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.172180+0000","last_change":"2023-11-28T11:58:51.172180+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.172180+0000","last_undegraded":"2023-11-28T11:58:51.172180+0000","last_fullsized":"2023-11-28T11:58:51.172180+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:21:32.139383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"57'1","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.674380+0000","last_change":"2023-11-28T11:58:51.184709+0000","last_active":"2023-11-28T11:58:51.674380+0000","last_peered":"2023-11-28T11:58:51.674380+0000","last_clean":"2023-11-28T11:58:51.674380+0000","last_became_active":"2023-11-28T11:58:51.183903+0000","last_became_peered":"2023-11-28T11:58:51.183903+0000","last_unstale":"2023-11-28T11:58:51.674380+0000","last_undegraded":"2023-11-28T11:58:51.674380+0000","last_fullsized":"2023-11-28T11:58:51.674380+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:08:06.627993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.648861+0000","last_change":"2023-11-28T11:58:51.648861+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.648861+0000","last_undegraded":"2023-11-28T11:58:51.648861+0000","last_fullsized":"2023-11-28T11:58:51.648861+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:04:56.514139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":["6","7"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.180871+0000","last_change":"2023-11-28T11:58:51.176988+0000","last_active":"2023-11-28T11:58:51.180871+0000","last_peered":"2023-11-28T11:58:51.180871+0000","last_clean":"2023-11-28T11:58:51.180871+0000","last_became_active":"2023-11-28T11:58:51.176713+0000","last_became_peered":"2023-11-28T11:58:51.176713+0000","last_unstale":"2023-11-28T11:58:51.180871+0000","last_undegraded":"2023-11-28T11:58:51.180871+0000","last_fullsized":"2023-11-28T11:58:51.180871+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:27:32.752868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.172332+0000","last_change":"2023-11-28T11:58:51.172332+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.172332+0000","last_undegraded":"2023-11-28T11:58:51.172332+0000","last_fullsized":"2023-11-28T11:58:51.172332+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:12:51.007363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.185539+0000","last_change":"2023-11-28T11:58:51.184233+0000","last_active":"2023-11-28T11:58:51.185539+0000","last_peered":"2023-11-28T11:58:51.185539+0000","last_clean":"2023-11-28T11:58:51.185539+0000","last_became_active":"2023-11-28T11:58:51.183942+0000","last_became_peered":"2023-11-28T11:58:51.183942+0000","last_unstale":"2023-11-28T11:58:51.185539+0000","last_undegraded":"2023-11-28T11:58:51.185539+0000","last_fullsized":"2023-11-28T11:58:51.185539+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:36:19.127665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.166354+0000","last_change":"2023-11-28T11:58:51.166354+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.166354+0000","last_undegraded":"2023-11-28T11:58:51.166354+0000","last_fullsized":"2023-11-28T11:58:51.166354+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:16:01.044656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.661726+0000","last_change":"2023-11-28T11:58:51.176310+0000","last_active":"2023-11-28T11:58:51.661726+0000","last_peered":"2023-11-28T11:58:51.661726+0000","last_clean":"2023-11-28T11:58:51.661726+0000","last_became_active":"2023-11-28T11:58:51.176047+0000","last_became_peered":"2023-11-28T11:58:51.176047+0000","last_unstale":"2023-11-28T11:58:51.661726+0000","last_undegraded":"2023-11-28T11:58:51.661726+0000","last_fullsized":"2023-11-28T11:58:51.661726+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:47:18.598716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.661507+0000","last_change":"2023-11-28T11:58:51.661507+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.661507+0000","last_undegraded":"2023-11-28T11:58:51.661507+0000","last_fullsized":"2023-11-28T11:58:51.661507+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:23.788694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.196955+0000","last_change":"2023-11-28T11:58:51.194390+0000","last_active":"2023-11-28T11:58:51.196955+0000","last_peered":"2023-11-28T11:58:51.196955+0000","last_clean":"2023-11-28T11:58:51.196955+0000","last_became_active":"2023-11-28T11:58:51.193968+0000","last_became_peered":"2023-11-28T11:58:51.193968+0000","last_unstale":"2023-11-28T11:58:51.196955+0000","last_undegraded":"2023-11-28T11:58:51.196955+0000","last_fullsized":"2023-11-28T11:58:51.196955+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:05:24.300271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.178014+0000","last_change":"2023-11-28T11:58:51.178014+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.178014+0000","last_undegraded":"2023-11-28T11:58:51.178014+0000","last_fullsized":"2023-11-28T11:58:51.178014+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:14:29.875840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"57'3","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.663582+0000","last_change":"2023-11-28T11:58:51.170686+0000","last_active":"2023-11-28T11:58:51.663582+0000","last_peered":"2023-11-28T11:58:51.663582+0000","last_clean":"2023-11-28T11:58:51.663582+0000","last_became_active":"2023-11-28T11:58:51.170416+0000","last_became_peered":"2023-11-28T11:58:51.170416+0000","last_unstale":"2023-11-28T11:58:51.663582+0000","last_undegraded":"2023-11-28T11:58:51.663582+0000","last_fullsized":"2023-11-28T11:58:51.663582+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:21.064597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.664974+0000","last_change":"2023-11-28T11:58:51.664974+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.664974+0000","last_undegraded":"2023-11-28T11:58:51.664974+0000","last_fullsized":"2023-11-28T11:58:51.664974+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:03:49.327209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.184215+0000","last_change":"2023-11-28T11:58:51.182690+0000","last_active":"2023-11-28T11:58:51.184215+0000","last_peered":"2023-11-28T11:58:51.184215+0000","last_clean":"2023-11-28T11:58:51.184215+0000","last_became_active":"2023-11-28T11:58:51.182414+0000","last_became_peered":"2023-11-28T11:58:51.182414+0000","last_unstale":"2023-11-28T11:58:51.184215+0000","last_undegraded":"2023-11-28T11:58:51.184215+0000","last_fullsized":"2023-11-28T11:58:51.184215+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:28:11.165170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.656296+0000","last_change":"2023-11-28T11:58:51.656296+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.656296+0000","last_undegraded":"2023-11-28T11:58:51.656296+0000","last_fullsized":"2023-11-28T11:58:51.656296+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:17:04.728611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.196119+0000","last_change":"2023-11-28T11:58:51.192204+0000","last_active":"2023-11-28T11:58:51.196119+0000","last_peered":"2023-11-28T11:58:51.196119+0000","last_clean":"2023-11-28T11:58:51.196119+0000","last_became_active":"2023-11-28T11:58:51.191886+0000","last_became_peered":"2023-11-28T11:58:51.191886+0000","last_unstale":"2023-11-28T11:58:51.196119+0000","last_undegraded":"2023-11-28T11:58:51.196119+0000","last_fullsized":"2023-11-28T11:58:51.196119+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:22.767051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.659384+0000","last_change":"2023-11-28T11:58:51.659384+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.659384+0000","last_undegraded":"2023-11-28T11:58:51.659384+0000","last_fullsized":"2023-11-28T11:58:51.659384+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:52.015075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.651612+0000","last_change":"2023-11-28T11:58:51.174956+0000","last_active":"2023-11-28T11:58:51.651612+0000","last_peered":"2023-11-28T11:58:51.651612+0000","last_clean":"2023-11-28T11:58:51.651612+0000","last_became_active":"2023-11-28T11:58:51.174655+0000","last_became_peered":"2023-11-28T11:58:51.174655+0000","last_unstale":"2023-11-28T11:58:51.651612+0000","last_undegraded":"2023-11-28T11:58:51.651612+0000","last_fullsized":"2023-11-28T11:58:51.651612+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:34:31.055864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.166710+0000","last_change":"2023-11-28T11:58:51.166710+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.166710+0000","last_undegraded":"2023-11-28T11:58:51.166710+0000","last_fullsized":"2023-11-28T11:58:51.166710+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:43:18.872444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.183356+0000","last_change":"2023-11-28T11:58:51.179067+0000","last_active":"2023-11-28T11:58:51.183356+0000","last_peered":"2023-11-28T11:58:51.183356+0000","last_clean":"2023-11-28T11:58:51.183356+0000","last_became_active":"2023-11-28T11:58:51.178790+0000","last_became_peered":"2023-11-28T11:58:51.178790+0000","last_unstale":"2023-11-28T11:58:51.183356+0000","last_undegraded":"2023-11-28T11:58:51.183356+0000","last_fullsized":"2023-11-28T11:58:51.183356+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:34.431609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.660022+0000","last_change":"2023-11-28T11:58:51.660022+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.660022+0000","last_undegraded":"2023-11-28T11:58:51.660022+0000","last_fullsized":"2023-11-28T11:58:51.660022+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:25:17.521536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"57'8","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.659390+0000","last_change":"2023-11-28T11:58:51.173895+0000","last_active":"2023-11-28T11:58:51.659390+0000","last_peered":"2023-11-28T11:58:51.659390+0000","last_clean":"2023-11-28T11:58:51.659390+0000","last_became_active":"2023-11-28T11:58:51.173611+0000","last_became_peered":"2023-11-28T11:58:51.173611+0000","last_unstale":"2023-11-28T11:58:51.659390+0000","last_undegraded":"2023-11-28T11:58:51.659390+0000","last_fullsized":"2023-11-28T11:58:51.659390+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:04:55.492496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.656545+0000","last_change":"2023-11-28T11:58:51.656545+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.656545+0000","last_undegraded":"2023-11-28T11:58:51.656545+0000","last_fullsized":"2023-11-28T11:58:51.656545+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:23:30.095986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.195185+0000","last_change":"2023-11-28T11:58:51.190105+0000","last_active":"2023-11-28T11:58:51.195185+0000","last_peered":"2023-11-28T11:58:51.195185+0000","last_clean":"2023-11-28T11:58:51.195185+0000","last_became_active":"2023-11-28T11:58:51.189836+0000","last_became_peered":"2023-11-28T11:58:51.189836+0000","last_unstale":"2023-11-28T11:58:51.195185+0000","last_undegraded":"2023-11-28T11:58:51.195185+0000","last_fullsized":"2023-11-28T11:58:51.195185+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:54:49.735542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.656711+0000","last_change":"2023-11-28T11:58:51.656711+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.656711+0000","last_undegraded":"2023-11-28T11:58:51.656711+0000","last_fullsized":"2023-11-28T11:58:51.656711+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:23.788694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.646467+0000","last_change":"2023-11-28T11:58:51.179702+0000","last_active":"2023-11-28T11:58:51.646467+0000","last_peered":"2023-11-28T11:58:51.646467+0000","last_clean":"2023-11-28T11:58:51.646467+0000","last_became_active":"2023-11-28T11:58:51.179426+0000","last_became_peered":"2023-11-28T11:58:51.179426+0000","last_unstale":"2023-11-28T11:58:51.646467+0000","last_undegraded":"2023-11-28T11:58:51.646467+0000","last_fullsized":"2023-11-28T11:58:51.646467+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:44:16.839236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.177495+0000","last_change":"2023-11-28T11:58:51.177495+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.177495+0000","last_undegraded":"2023-11-28T11:58:51.177495+0000","last_fullsized":"2023-11-28T11:58:51.177495+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:47:19.620359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.651613+0000","last_change":"2023-11-28T11:58:51.174876+0000","last_active":"2023-11-28T11:58:51.651613+0000","last_peered":"2023-11-28T11:58:51.651613+0000","last_clean":"2023-11-28T11:58:51.651613+0000","last_became_active":"2023-11-28T11:58:51.174567+0000","last_became_peered":"2023-11-28T11:58:51.174567+0000","last_unstale":"2023-11-28T11:58:51.651613+0000","last_undegraded":"2023-11-28T11:58:51.651613+0000","last_fullsized":"2023-11-28T11:58:51.651613+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:09:52.803813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:53.160782+0000","last_change":"2023-11-28T11:58:51.677710+0000","last_active":"2023-11-28T11:58:53.160782+0000","last_peered":"2023-11-28T11:58:53.160782+0000","last_clean":"2023-11-28T11:58:53.160782+0000","last_became_active":"2023-11-28T11:58:51.677389+0000","last_became_peered":"2023-11-28T11:58:51.677389+0000","last_unstale":"2023-11-28T11:58:53.160782+0000","last_undegraded":"2023-11-28T11:58:53.160782+0000","last_fullsized":"2023-11-28T11:58:53.160782+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:54:32.327688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.185067+0000","last_change":"2023-11-28T11:58:51.182292+0000","last_active":"2023-11-28T11:58:51.185067+0000","last_peered":"2023-11-28T11:58:51.185067+0000","last_clean":"2023-11-28T11:58:51.185067+0000","last_became_active":"2023-11-28T11:58:51.182019+0000","last_became_peered":"2023-11-28T11:58:51.182019+0000","last_unstale":"2023-11-28T11:58:51.185067+0000","last_undegraded":"2023-11-28T11:58:51.185067+0000","last_fullsized":"2023-11-28T11:58:51.185067+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:46:05.485633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.171366+0000","last_change":"2023-11-28T11:58:51.171366+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.171366+0000","last_undegraded":"2023-11-28T11:58:51.171366+0000","last_fullsized":"2023-11-28T11:58:51.171366+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:22:28.860678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.187472+0000","last_change":"2023-11-28T11:58:51.183963+0000","last_active":"2023-11-28T11:58:51.187472+0000","last_peered":"2023-11-28T11:58:51.187472+0000","last_clean":"2023-11-28T11:58:51.187472+0000","last_became_active":"2023-11-28T11:58:51.183704+0000","last_became_peered":"2023-11-28T11:58:51.183704+0000","last_unstale":"2023-11-28T11:58:51.187472+0000","last_undegraded":"2023-11-28T11:58:51.187472+0000","last_fullsized":"2023-11-28T11:58:51.187472+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:48:13.492030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.660689+0000","last_change":"2023-11-28T11:58:51.660689+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.660689+0000","last_undegraded":"2023-11-28T11:58:51.660689+0000","last_fullsized":"2023-11-28T11:58:51.660689+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:51:09.793929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.180661+0000","last_change":"2023-11-28T11:58:51.176569+0000","last_active":"2023-11-28T11:58:51.180661+0000","last_peered":"2023-11-28T11:58:51.180661+0000","last_clean":"2023-11-28T11:58:51.180661+0000","last_became_active":"2023-11-28T11:58:51.176264+0000","last_became_peered":"2023-11-28T11:58:51.176264+0000","last_unstale":"2023-11-28T11:58:51.180661+0000","last_undegraded":"2023-11-28T11:58:51.180661+0000","last_fullsized":"2023-11-28T11:58:51.180661+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:51:08.772287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.175011+0000","last_change":"2023-11-28T11:58:51.175011+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.175011+0000","last_undegraded":"2023-11-28T11:58:51.175011+0000","last_fullsized":"2023-11-28T11:58:51.175011+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:47:15.134857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.184089+0000","last_change":"2023-11-28T11:58:51.180506+0000","last_active":"2023-11-28T11:58:51.184089+0000","last_peered":"2023-11-28T11:58:51.184089+0000","last_clean":"2023-11-28T11:58:51.184089+0000","last_became_active":"2023-11-28T11:58:51.180220+0000","last_became_peered":"2023-11-28T11:58:51.180220+0000","last_unstale":"2023-11-28T11:58:51.184089+0000","last_undegraded":"2023-11-28T11:58:51.184089+0000","last_fullsized":"2023-11-28T11:58:51.184089+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:24:42.388320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.171492+0000","last_change":"2023-11-28T11:58:51.171492+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.171492+0000","last_undegraded":"2023-11-28T11:58:51.171492+0000","last_fullsized":"2023-11-28T11:58:51.171492+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:34.496313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.195427+0000","last_change":"2023-11-28T11:58:51.182985+0000","last_active":"2023-11-28T11:58:51.195427+0000","last_peered":"2023-11-28T11:58:51.195427+0000","last_clean":"2023-11-28T11:58:51.195427+0000","last_became_active":"2023-11-28T11:58:51.182503+0000","last_became_peered":"2023-11-28T11:58:51.182503+0000","last_unstale":"2023-11-28T11:58:51.195427+0000","last_undegraded":"2023-11-28T11:58:51.195427+0000","last_fullsized":"2023-11-28T11:58:51.195427+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:17:03.706968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.175238+0000","last_change":"2023-11-28T11:58:51.175238+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.175238+0000","last_undegraded":"2023-11-28T11:58:51.175238+0000","last_fullsized":"2023-11-28T11:58:51.175238+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:24:09.557069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.183273+0000","last_change":"2023-11-28T11:58:51.178370+0000","last_active":"2023-11-28T11:58:51.183273+0000","last_peered":"2023-11-28T11:58:51.183273+0000","last_clean":"2023-11-28T11:58:51.183273+0000","last_became_active":"2023-11-28T11:58:51.178104+0000","last_became_peered":"2023-11-28T11:58:51.178104+0000","last_unstale":"2023-11-28T11:58:51.183273+0000","last_undegraded":"2023-11-28T11:58:51.183273+0000","last_fullsized":"2023-11-28T11:58:51.183273+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:46:22.305988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.170774+0000","last_change":"2023-11-28T11:56:34.384408+0000","last_active":"2023-11-28T11:58:51.170774+0000","last_peered":"2023-11-28T11:58:51.170774+0000","last_clean":"2023-11-28T11:58:51.170774+0000","last_became_active":"2023-11-28T11:56:34.384036+0000","last_became_peered":"2023-11-28T11:56:34.384036+0000","last_unstale":"2023-11-28T11:58:51.170774+0000","last_undegraded":"2023-11-28T11:58:51.170774+0000","last_fullsized":"2023-11-28T11:58:51.170774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:58:55.003786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.663363+0000","last_change":"2023-11-28T11:58:51.663363+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.663363+0000","last_undegraded":"2023-11-28T11:58:51.663363+0000","last_fullsized":"2023-11-28T11:58:51.663363+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:32:19.768923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.647192+0000","last_change":"2023-11-28T11:58:51.191417+0000","last_active":"2023-11-28T11:58:51.647192+0000","last_peered":"2023-11-28T11:58:51.647192+0000","last_clean":"2023-11-28T11:58:51.647192+0000","last_became_active":"2023-11-28T11:58:51.191143+0000","last_became_peered":"2023-11-28T11:58:51.191143+0000","last_unstale":"2023-11-28T11:58:51.647192+0000","last_undegraded":"2023-11-28T11:58:51.647192+0000","last_fullsized":"2023-11-28T11:58:51.647192+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:09:32.828501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":40,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-28T11:58:50.141350+0000","last_change":"2023-11-28T11:56:34.384088+0000","last_active":"2023-11-28T11:58:50.141350+0000","last_peered":"2023-11-28T11:58:50.141350+0000","last_clean":"2023-11-28T11:58:50.141350+0000","last_became_active":"2023-11-28T11:56:34.383631+0000","last_became_peered":"2023-11-28T11:56:34.383631+0000","last_unstale":"2023-11-28T11:58:50.141350+0000","last_undegraded":"2023-11-28T11:58:50.141350+0000","last_fullsized":"2023-11-28T11:58:50.141350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:15:42.772333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.661133+0000","last_change":"2023-11-28T11:58:51.661133+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.661133+0000","last_undegraded":"2023-11-28T11:58:51.661133+0000","last_fullsized":"2023-11-28T11:58:51.661133+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:17:04.728611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.196084+0000","last_change":"2023-11-28T11:58:51.191624+0000","last_active":"2023-11-28T11:58:51.196084+0000","last_peered":"2023-11-28T11:58:51.196084+0000","last_clean":"2023-11-28T11:58:51.196084+0000","last_became_active":"2023-11-28T11:58:51.191317+0000","last_became_peered":"2023-11-28T11:58:51.191317+0000","last_unstale":"2023-11-28T11:58:51.196084+0000","last_undegraded":"2023-11-28T11:58:51.196084+0000","last_fullsized":"2023-11-28T11:58:51.196084+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:03:48.305566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.161577+0000","last_change":"2023-11-28T11:56:34.386399+0000","last_active":"2023-11-28T11:58:51.161577+0000","last_peered":"2023-11-28T11:58:51.161577+0000","last_clean":"2023-11-28T11:58:51.161577+0000","last_became_active":"2023-11-28T11:56:34.385994+0000","last_became_peered":"2023-11-28T11:56:34.385994+0000","last_unstale":"2023-11-28T11:58:51.161577+0000","last_undegraded":"2023-11-28T11:58:51.161577+0000","last_fullsized":"2023-11-28T11:58:51.161577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:58:02.172295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.657774+0000","last_change":"2023-11-28T11:58:51.657774+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.657774+0000","last_undegraded":"2023-11-28T11:58:51.657774+0000","last_fullsized":"2023-11-28T11:58:51.657774+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:53:49.319201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"57'2","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.669921+0000","last_change":"2023-11-28T11:58:51.195566+0000","last_active":"2023-11-28T11:58:51.669921+0000","last_peered":"2023-11-28T11:58:51.669921+0000","last_clean":"2023-11-28T11:58:51.669921+0000","last_became_active":"2023-11-28T11:58:51.195183+0000","last_became_peered":"2023-11-28T11:58:51.195183+0000","last_unstale":"2023-11-28T11:58:51.669921+0000","last_undegraded":"2023-11-28T11:58:51.669921+0000","last_fullsized":"2023-11-28T11:58:51.669921+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:58:54.026123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-28T11:58:50.141350+0000","last_change":"2023-11-28T11:56:34.384999+0000","last_active":"2023-11-28T11:58:50.141350+0000","last_peered":"2023-11-28T11:58:50.141350+0000","last_clean":"2023-11-28T11:58:50.141350+0000","last_became_active":"2023-11-28T11:56:34.384531+0000","last_became_peered":"2023-11-28T11:56:34.384531+0000","last_unstale":"2023-11-28T11:58:50.141350+0000","last_undegraded":"2023-11-28T11:58:50.141350+0000","last_fullsized":"2023-11-28T11:58:50.141350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:09:50.083366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:53.159756+0000","last_change":"2023-11-28T11:58:51.672003+0000","last_active":"2023-11-28T11:58:53.159756+0000","last_peered":"2023-11-28T11:58:53.159756+0000","last_clean":"2023-11-28T11:58:53.159756+0000","last_became_active":"2023-11-28T11:58:51.671750+0000","last_became_peered":"2023-11-28T11:58:51.671750+0000","last_unstale":"2023-11-28T11:58:53.159756+0000","last_undegraded":"2023-11-28T11:58:53.159756+0000","last_fullsized":"2023-11-28T11:58:53.159756+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:17.015788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.185057+0000","last_change":"2023-11-28T11:58:51.181802+0000","last_active":"2023-11-28T11:58:51.185057+0000","last_peered":"2023-11-28T11:58:51.185057+0000","last_clean":"2023-11-28T11:58:51.185057+0000","last_became_active":"2023-11-28T11:58:51.181421+0000","last_became_peered":"2023-11-28T11:58:51.181421+0000","last_unstale":"2023-11-28T11:58:51.185057+0000","last_undegraded":"2023-11-28T11:58:51.185057+0000","last_fullsized":"2023-11-28T11:58:51.185057+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:50:43.770799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":39,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-28T11:58:50.146427+0000","last_change":"2023-11-28T11:56:34.389076+0000","last_active":"2023-11-28T11:58:50.146427+0000","last_peered":"2023-11-28T11:58:50.146427+0000","last_clean":"2023-11-28T11:58:50.146427+0000","last_became_active":"2023-11-28T11:56:34.388689+0000","last_became_peered":"2023-11-28T11:56:34.388689+0000","last_unstale":"2023-11-28T11:58:50.146427+0000","last_undegraded":"2023-11-28T11:58:50.146427+0000","last_fullsized":"2023-11-28T11:58:50.146427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:20.936349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":3,"reported_epoch":57,"state":"creating+activating","last_fresh":"2023-11-28T11:58:51.656818+0000","last_change":"2023-11-28T11:58:51.656818+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.656818+0000","last_undegraded":"2023-11-28T11:58:51.656818+0000","last_fullsized":"2023-11-28T11:58:51.656818+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:52.015075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.190652+0000","last_change":"2023-11-28T11:58:51.180873+0000","last_active":"2023-11-28T11:58:51.190652+0000","last_peered":"2023-11-28T11:58:51.190652+0000","last_clean":"2023-11-28T11:58:51.190652+0000","last_became_active":"2023-11-28T11:58:51.180551+0000","last_became_peered":"2023-11-28T11:58:51.180551+0000","last_unstale":"2023-11-28T11:58:51.190652+0000","last_undegraded":"2023-11-28T11:58:51.190652+0000","last_fullsized":"2023-11-28T11:58:51.190652+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:50.993432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.654885+0000","last_change":"2023-11-28T11:56:34.486178+0000","last_active":"2023-11-28T11:58:51.654885+0000","last_peered":"2023-11-28T11:58:51.654885+0000","last_clean":"2023-11-28T11:58:51.654885+0000","last_became_active":"2023-11-28T11:56:34.485702+0000","last_became_peered":"2023-11-28T11:56:34.485702+0000","last_unstale":"2023-11-28T11:58:51.654885+0000","last_undegraded":"2023-11-28T11:58:51.654885+0000","last_fullsized":"2023-11-28T11:58:51.654885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:06.323407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:53.160302+0000","last_change":"2023-11-28T11:58:51.659567+0000","last_active":"2023-11-28T11:58:53.160302+0000","last_peered":"2023-11-28T11:58:53.160302+0000","last_clean":"2023-11-28T11:58:53.160302+0000","last_became_active":"2023-11-28T11:58:51.659303+0000","last_became_peered":"2023-11-28T11:58:51.659303+0000","last_unstale":"2023-11-28T11:58:53.160302+0000","last_undegraded":"2023-11-28T11:58:53.160302+0000","last_fullsized":"2023-11-28T11:58:53.160302+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:00:36.435208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.195316+0000","last_change":"2023-11-28T11:58:51.193563+0000","last_active":"2023-11-28T11:58:51.195316+0000","last_peered":"2023-11-28T11:58:51.195316+0000","last_clean":"2023-11-28T11:58:51.195316+0000","last_became_active":"2023-11-28T11:58:51.193283+0000","last_became_peered":"2023-11-28T11:58:51.193283+0000","last_unstale":"2023-11-28T11:58:51.195316+0000","last_undegraded":"2023-11-28T11:58:51.195316+0000","last_fullsized":"2023-11-28T11:58:51.195316+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:36:54.633765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.160635+0000","last_change":"2023-11-28T11:56:34.387293+0000","last_active":"2023-11-28T11:58:51.160635+0000","last_peered":"2023-11-28T11:58:51.160635+0000","last_clean":"2023-11-28T11:58:51.160635+0000","last_became_active":"2023-11-28T11:56:34.386976+0000","last_became_peered":"2023-11-28T11:56:34.386976+0000","last_unstale":"2023-11-28T11:58:51.160635+0000","last_undegraded":"2023-11-28T11:58:51.160635+0000","last_fullsized":"2023-11-28T11:58:51.160635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:32.704729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-11-28T11:58:51.171808+0000","last_change":"2023-11-28T11:58:51.171808+0000","last_active":"2023-11-28T11:58:51.137570+0000","last_peered":"2023-11-28T11:58:51.137570+0000","last_clean":"2023-11-28T11:58:51.137570+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:58:51.171808+0000","last_undegraded":"2023-11-28T11:58:51.171808+0000","last_fullsized":"2023-11-28T11:58:51.171808+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:05:51.844750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.651886+0000","last_change":"2023-11-28T11:58:51.174291+0000","last_active":"2023-11-28T11:58:51.651886+0000","last_peered":"2023-11-28T11:58:51.651886+0000","last_clean":"2023-11-28T11:58:51.651886+0000","last_became_active":"2023-11-28T11:58:51.173714+0000","last_became_peered":"2023-11-28T11:58:51.173714+0000","last_unstale":"2023-11-28T11:58:51.651886+0000","last_undegraded":"2023-11-28T11:58:51.651886+0000","last_fullsized":"2023-11-28T11:58:51.651886+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:31:55.668938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":39,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-28T11:58:50.146409+0000","last_change":"2023-11-28T11:56:34.389222+0000","last_active":"2023-11-28T11:58:50.146409+0000","last_peered":"2023-11-28T11:58:50.146409+0000","last_clean":"2023-11-28T11:58:50.146409+0000","last_became_active":"2023-11-28T11:56:34.388671+0000","last_became_peered":"2023-11-28T11:56:34.388671+0000","last_unstale":"2023-11-28T11:58:50.146409+0000","last_undegraded":"2023-11-28T11:58:50.146409+0000","last_fullsized":"2023-11-28T11:58:50.146409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:32.704729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":194,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.160754+0000","last_change":"2023-11-28T11:56:28.472008+0000","last_active":"2023-11-28T11:58:51.160754+0000","last_peered":"2023-11-28T11:58:51.160754+0000","last_clean":"2023-11-28T11:58:51.160754+0000","last_became_active":"2023-11-28T11:56:28.469273+0000","last_became_peered":"2023-11-28T11:56:28.469273+0000","last_unstale":"2023-11-28T11:58:51.160754+0000","last_undegraded":"2023-11-28T11:58:51.160754+0000","last_fullsized":"2023-11-28T11:58:51.160754+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:27.291192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:27.291192+0000","last_clean_scrub_stamp":"2023-11-28T11:56:27.291192+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:14:48.860420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":656,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509472,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14352,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":13120,"kb_avail":94357488,"statfs":{"total":96636764160,"available":96622067712,"internally_reserved":0,"allocated":1253376,"data_stored":890680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13434880},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.0780000000000001,"15min":1.093},"min":{"1min":0.63,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.357,"5min":1.468,"15min":1.468},"last":1.327},{"interface":"front","average":{"1min":1.083,"5min":1.079,"15min":1.0780000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.4830000000000001,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.98599999999999999}]},{"osd":1,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1879999999999999,"15min":1.202},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.339,"5min":1.71,"15min":1.71},"last":1.236},{"interface":"front","average":{"1min":1.141,"5min":1.1739999999999999,"15min":1.1799999999999999},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.4410000000000001,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.879}]},{"osd":2,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1779999999999999,"15min":1.1859999999999999},"min":{"1min":0.83299999999999996,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.409,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.127},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2669999999999999,"15min":1.28},"min":{"1min":0.78400000000000003,"5min":0.749,"15min":0.749},"max":{"1min":1.5209999999999999,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.181}]},{"osd":3,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.302,"15min":1.3160000000000001},"min":{"1min":0.872,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.5249999999999999,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.345,"15min":1.357},"min":{"1min":1.0169999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.5980000000000001,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.1080000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.272,"15min":1.3029999999999999},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.5609999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.143,"5min":1.3129999999999999,"15min":1.341},"min":{"1min":0.80800000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.4350000000000001,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":0.95199999999999996}]},{"osd":5,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.409,"15min":1.4390000000000001},"min":{"1min":0.876,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.595,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.202,"5min":1.369,"15min":1.397},"min":{"1min":0.96899999999999997,"5min":0.872,"15min":0.872},"max":{"1min":1.454,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":1.252}]},{"osd":6,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.532,"15min":1.5600000000000001},"min":{"1min":1.075,"5min":1.075,"15min":1.075},"max":{"1min":1.633,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.165},{"interface":"front","average":{"1min":1.278,"5min":1.431,"15min":1.4570000000000001},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.53,"5min":2.468,"15min":2.468},"last":1.367}]}]},{"osd":6,"up_from":15,"seq":64424509472,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9164,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362676,"statfs":{"total":96636764160,"available":96627380224,"internally_reserved":0,"allocated":659456,"data_stored":300312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":0.997,"15min":0.99099999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.716,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.101,"5min":1.1870000000000001,"15min":1.2010000000000001},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.5569999999999999,"5min":2.347,"15min":2.347},"last":0.98499999999999999}]},{"osd":1,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.175,"15min":1.1759999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.5249999999999999,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.284},{"interface":"front","average":{"1min":1.117,"5min":1.165,"15min":1.173},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4239999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":1.3220000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.224,"15min":1.25},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4830000000000001,"5min":3.9620000000000002,"15min":3.9620000000000002},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1679999999999999,"15min":1.169},"min":{"1min":0.91200000000000003,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.3759999999999999,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.94299999999999995}]},{"osd":3,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2689999999999999,"15min":1.264},"min":{"1min":0.96699999999999997,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.258,"5min":1.27,"15min":1.272},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.645,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.1100000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.2230000000000001,"15min":1.238},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.4490000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.286,"5min":1.4510000000000001,"15min":1.4790000000000001},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.7250000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.3520000000000001}]},{"osd":5,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.2589999999999999,"15min":1.2769999999999999},"min":{"1min":0.93500000000000005,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.4730000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.266,"15min":1.278},"min":{"1min":0.84399999999999997,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.0209999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.3340000000000001,"15min":1.3400000000000001},"min":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.244},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3540000000000001,"15min":1.3580000000000001},"min":{"1min":1.0349999999999999,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":1.8939999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.155}]}]},{"osd":5,"up_from":15,"seq":64424509472,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9024,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362816,"statfs":{"total":96636764160,"available":96627523584,"internally_reserved":0,"allocated":647168,"data_stored":293372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0820000000000001,"15min":1.0880000000000001},"min":{"1min":0.76400000000000001,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.365,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.109,"5min":1.085,"15min":1.081},"min":{"1min":0.72899999999999998,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.552,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.1910000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:58:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1439999999999999,"15min":1.1499999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.72,"5min":1.843,"15min":1.843},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.069,"5min":1.085,"15min":1.0880000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.331}]},{"osd":2,"last update":"Tue Nov 28 11:58:33 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.163,"15min":1.165},"min":{"1min":0.83899999999999997,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.4630000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.296},{"interface":"front","average":{"1min":1.196,"5min":1.2,"15min":1.2},"min":{"1min":0.82999999999999996,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.05}]},{"osd":3,"last update":"Tue Nov 28 11:58:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.2609999999999999,"15min":1.276},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.5880000000000001,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.258,"5min":1.3759999999999999,"15min":1.3959999999999999},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.623,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.2509999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:58:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.206,"15min":1.22},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.54,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.2310000000000001,"15min":1.2350000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.5209999999999999,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.4650000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:58:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.276,"15min":1.278},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.349},{"interface":"front","average":{"1min":1.28,"5min":1.2849999999999999,"15min":1.286},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":1.675,"5min":1.704,"15min":1.704},"last":1.224}]},{"osd":7,"last update":"Tue Nov 28 11:58:33 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.359,"15min":1.365},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.7030000000000001,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.383},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.468,"15min":1.4790000000000001},"min":{"1min":1.002,"5min":1.002,"15min":1.002},"max":{"1min":1.78,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.171}]}]},{"osd":4,"up_from":15,"seq":64424509472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9216,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362624,"statfs":{"total":96636764160,"available":96627326976,"internally_reserved":0,"allocated":647168,"data_stored":293372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.113,"15min":1.111},"min":{"1min":0.67400000000000004,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.474,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.105,"5min":1.153,"15min":1.161},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.78,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.099}]},{"osd":1,"last update":"Tue Nov 28 11:58:32 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.1899999999999999,"15min":1.214},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.351,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.107,"5min":1.1910000000000001,"15min":1.2050000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.502,"5min":2.8860000000000001,"15min":2.8860000000000001},"last":1.147}]},{"osd":2,"last update":"Tue Nov 28 11:58:32 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.228,"15min":1.2450000000000001},"min":{"1min":0.72299999999999998,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.6020000000000001,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.05},{"interface":"front","average":{"1min":1.24,"5min":1.391,"15min":1.4159999999999999},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.6379999999999999,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":1.3580000000000001}]},{"osd":3,"last update":"Tue Nov 28 11:58:32 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.3080000000000001,"15min":1.325},"min":{"1min":0.76500000000000001,"5min":0.746,"15min":0.746},"max":{"1min":1.8320000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.399},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.367,"15min":1.377},"min":{"1min":0.99299999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.5700000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.3029999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:58:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.409,"15min":1.446},"min":{"1min":0.85599999999999998,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.5680000000000001,"5min":2.972,"15min":2.972},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.335,"15min":1.3660000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.4470000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.222}]},{"osd":6,"last update":"Tue Nov 28 11:58:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.3839999999999999,"15min":1.4139999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.7509999999999999,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.248},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.5289999999999999,"15min":1.5549999999999999},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":1.804,"5min":3.133,"15min":3.133},"last":1.468}]},{"osd":7,"last update":"Tue Nov 28 11:58:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.494,"15min":1.53},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.7110000000000001,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.319},{"interface":"front","average":{"1min":1.373,"5min":1.5649999999999999,"15min":1.597},"min":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"max":{"1min":1.7230000000000001,"5min":2.198,"15min":2.198},"last":1.4399999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509472,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9152,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362688,"statfs":{"total":96636764160,"available":96627392512,"internally_reserved":0,"allocated":647168,"data_stored":293372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.53500000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.2689999999999999,"5min":1.478,"15min":1.478},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.63200000000000001,"5min":0.37,"15min":0.37},"max":{"1min":1.349,"5min":2.177,"15min":2.177},"last":0.69899999999999995}]},{"osd":1,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.85599999999999998,"15min":0.86199999999999999},"min":{"1min":0.50600000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.087,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.056,"15min":1.0640000000000001},"min":{"1min":0.72899999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3280000000000001,"5min":1.968,"15min":1.968},"last":0.92000000000000004}]},{"osd":2,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.1279999999999999,"15min":1.1459999999999999},"min":{"1min":0.71799999999999997,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.413,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.194,"15min":1.2150000000000001},"min":{"1min":0.85799999999999998,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.423,"5min":2.093,"15min":2.093},"last":1.369}]},{"osd":4,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.171,"15min":1.177},"min":{"1min":0.85299999999999998,"5min":0.75,"15min":0.75},"max":{"1min":1.5469999999999999,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.325,"15min":1.343},"min":{"1min":1.032,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.514,"5min":2.8439999999999999,"15min":2.8439999999999999},"last":1.0449999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.3480000000000001,"15min":1.367},"min":{"1min":1.0089999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.4450000000000001,"5min":2.9670000000000001,"15min":2.9670000000000001},"last":0.995},{"interface":"front","average":{"1min":1.29,"5min":1.431,"15min":1.4550000000000001},"min":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"max":{"1min":1.736,"5min":3.7429999999999999,"15min":3.7429999999999999},"last":1.167}]},{"osd":6,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.3460000000000001,"15min":1.355},"min":{"1min":0.91500000000000004,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.907,"5min":2.323,"15min":2.323},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.4350000000000001,"15min":1.4530000000000001},"min":{"1min":1.1930000000000001,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.506,"5min":2.927,"15min":2.927},"last":1.337}]},{"osd":7,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4970000000000001,"15min":1.5109999999999999},"min":{"1min":1.1399999999999999,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.8440000000000001,"5min":3.5030000000000001,"15min":3.5030000000000001},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.377,"5min":1.468,"15min":1.4830000000000001},"min":{"1min":1.0980000000000001,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":1.778,"5min":2.6320000000000001,"15min":2.6320000000000001},"last":1.1279999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509472,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9100,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362740,"statfs":{"total":96636764160,"available":96627445760,"internally_reserved":0,"allocated":659456,"data_stored":300312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.92800000000000005,"15min":0.94599999999999995},"min":{"1min":0.61099999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.1160000000000001,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.014,"5min":1.006,"15min":1.0049999999999999},"min":{"1min":0.44400000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.6100000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":1.0940000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.087,"15min":1.089},"min":{"1min":0.57599999999999996,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.49,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.1020000000000001,"15min":1.105},"min":{"1min":0.67200000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.6899999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.151}]},{"osd":3,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.202,"15min":1.208},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.6180000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.877},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.1519999999999999,"15min":1.177},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.734,"5min":1.8,"15min":1.8},"last":0.81799999999999995}]},{"osd":4,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.3660000000000001,"15min":1.3759999999999999},"min":{"1min":0.95099999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.8109999999999999,"5min":3.411,"15min":3.411},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.331,"15min":1.349},"min":{"1min":0.90600000000000003,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.9039999999999999,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":1.361}]},{"osd":5,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.417,"15min":1.4350000000000001},"min":{"1min":0.91100000000000003,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.0129999999999999,"5min":3.6869999999999998,"15min":3.6869999999999998},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.3169999999999999,"15min":1.3300000000000001},"min":{"1min":0.91800000000000004,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.5269999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.2210000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.444,"15min":1.462},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.0569999999999999,"5min":3.5379999999999998,"15min":3.5379999999999998},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.472,"15min":1.498},"min":{"1min":1.1359999999999999,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.673,"5min":2.5739999999999998,"15min":2.5739999999999998},"last":1.706}]},{"osd":7,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.464,"15min":1.4810000000000001},"min":{"1min":1.1080000000000001,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.7410000000000001,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.494},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.5029999999999999,"15min":1.5229999999999999},"min":{"1min":0.86799999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.8680000000000001,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.514}]}]},{"osd":2,"up_from":14,"seq":60129542177,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9196,"kb_used_data":676,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362644,"statfs":{"total":96636764160,"available":96627347456,"internally_reserved":0,"allocated":692224,"data_stored":314789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:25 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.85799999999999998,"15min":0.86799999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.093,"5min":1.722,"15min":1.722},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.95099999999999996,"5min":1,"15min":1.008},"min":{"1min":0.63900000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.9850000000000001,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":0.79300000000000004}]},{"osd":1,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":1.018,"15min":1.03},"min":{"1min":0.56200000000000006,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.286,"5min":1.754,"15min":1.754},"last":1.246},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.93000000000000005,"15min":0.93999999999999995},"min":{"1min":0.56599999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1850000000000001,"5min":1.484,"15min":1.484},"last":0.627}]},{"osd":3,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.123,"15min":1.133},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.526,"5min":2.048,"15min":2.048},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.28,"15min":1.2929999999999999},"min":{"1min":0.78900000000000003,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.583,"5min":2.617,"15min":2.617},"last":1.079}]},{"osd":4,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.3620000000000001,"15min":1.385},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.6919999999999999,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":1.204},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.2470000000000001,"15min":1.2549999999999999},"min":{"1min":0.85899999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.4930000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":1.0569999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.335,"15min":1.351},"min":{"1min":1.032,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.623,"5min":2.738,"15min":2.738},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.272,"5min":1.514,"15min":1.554},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.7230000000000001,"5min":4.0309999999999997,"15min":4.0309999999999997},"last":1.2669999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.583,"15min":1.611},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.9299999999999999,"5min":4.2240000000000002,"15min":4.2240000000000002},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.335,"5min":1.5169999999999999,"15min":1.5469999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.7709999999999999,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":1.2849999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.4379999999999999,"15min":1.4570000000000001},"min":{"1min":1.056,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.6359999999999999,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.139},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.6399999999999999,"15min":1.669},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.8799999999999999,"5min":4.3570000000000002,"15min":4.3570000000000002},"last":1.327}]}]},{"osd":0,"up_from":14,"seq":60129542177,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10484,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":9216,"kb_avail":94361356,"statfs":{"total":96636764160,"available":96626028544,"internally_reserved":0,"allocated":1290240,"data_stored":906296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9437184},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.86899999999999999,"15min":0.878},"min":{"1min":0.52700000000000002,"5min":0.439,"15min":0.439},"max":{"1min":1.1359999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.997,"15min":1.0109999999999999},"min":{"1min":0.64500000000000002,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.4079999999999999,"5min":1.7,"15min":1.7},"last":0.46400000000000002}]},{"osd":2,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.042,"15min":1.052},"min":{"1min":0.61599999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.282,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.92200000000000004,"15min":0.92400000000000004},"min":{"1min":0.61199999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.59399999999999997}]},{"osd":3,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.0640000000000001,"15min":1.0760000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.218,"5min":1.238,"15min":1.2410000000000001},"min":{"1min":0.80200000000000005,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.8089999999999999,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.0129999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.3300000000000001,"15min":1.3440000000000001},"min":{"1min":0.89200000000000002,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.8100000000000001,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.234,"5min":1.377,"15min":1.401},"min":{"1min":0.86799999999999999,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.758,"5min":3.1629999999999998,"15min":3.1629999999999998},"last":1.1679999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.361,"15min":1.363},"min":{"1min":0.871,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":2.1739999999999999,"5min":2.23,"15min":2.23},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.298,"5min":1.4019999999999999,"15min":1.4199999999999999},"min":{"1min":0.89500000000000002,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.845,"5min":2.266,"15min":2.266},"last":1.27}]},{"osd":6,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.498,"15min":1.516},"min":{"1min":0.93300000000000005,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.9490000000000001,"5min":2.4060000000000001,"15min":2.4060000000000001},"last":1.073},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.4830000000000001,"15min":1.5},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.7969999999999999,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":1.389}]},{"osd":7,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.5109999999999999,"15min":1.5209999999999999},"min":{"1min":1.1439999999999999,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":2.0600000000000001,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.21},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.554,"15min":1.573},"min":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":2.3029999999999999,"5min":2.6040000000000001,"15min":2.6040000000000001},"last":1.2390000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:59:00.042 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:59:00.049 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:59:00.936 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:59:01.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.123+0000 7f4e3ea6d700 1 Processor -- start 2023-11-28T11:59:01.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.123+0000 7f4e3ea6d700 1 -- start start 2023-11-28T11:59:01.127 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.123+0000 7f4e3ea6d700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4e38070080 0x7f4e380704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:01.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.123+0000 7f4e3ea6d700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e380ad6c0 con 0x7f4e38160710 2023-11-28T11:59:01.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.123+0000 7f4e3ea6d700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e380adc60 con 0x7f4e38164250 2023-11-28T11:59:01.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.123+0000 7f4e3ea6d700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e3806b1c0 con 0x7f4e38070080 2023-11-28T11:59:01.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.123+0000 7f4e3d26a700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4e38070080 0x7f4e380704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:01.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.127+0000 7f4e3d26a700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4e38070080 0x7f4e380704b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55530/0 (socket says 172.21.15.39:55530) 2023-11-28T11:59:01.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.127+0000 7f4e3d26a700 1 -- 172.21.15.39:0/2226329591 learned_addr learned my addr 172.21.15.39:0/2226329591 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:01.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.127+0000 7f4e3da6b700 1 --1- 172.21.15.39:0/2226329591 >> v1:172.21.15.39:6789/0 conn(0x7f4e38160710 0x7f4e380cc320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:50566/0 (socket says 172.21.15.39:50566) 2023-11-28T11:59:01.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.127+0000 7f4e3d26a700 1 -- 172.21.15.39:0/2226329591 >> v1:172.21.15.184:6789/0 conn(0x7f4e38164250 legacy=0x7f4e381646b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:01.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.127+0000 7f4e3d26a700 1 -- 172.21.15.39:0/2226329591 >> v1:172.21.15.39:6789/0 conn(0x7f4e38160710 legacy=0x7f4e380cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:01.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.127+0000 7f4e3d26a700 1 -- 172.21.15.39:0/2226329591 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e380709f0 con 0x7f4e38070080 2023-11-28T11:59:01.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.127+0000 7f4e3d26a700 1 --2- 172.21.15.39:0/2226329591 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e38070080 0x7f4e380704b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f4e28009910 tx=0x7f4e28009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ad886a3efa5ea5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:01.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.127+0000 7f4e3ca69700 1 -- 172.21.15.39:0/2226329591 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e28004230 con 0x7f4e38070080 2023-11-28T11:59:01.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.127+0000 7f4e3ca69700 1 -- 172.21.15.39:0/2226329591 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e28004390 con 0x7f4e38070080 2023-11-28T11:59:01.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.127+0000 7f4e3ca69700 1 -- 172.21.15.39:0/2226329591 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e28009e60 con 0x7f4e38070080 2023-11-28T11:59:01.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.127+0000 7f4e3ea6d700 1 -- 172.21.15.39:0/2226329591 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e38070080 msgr2=0x7f4e380704b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:01.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.127+0000 7f4e3ea6d700 1 --2- 172.21.15.39:0/2226329591 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e38070080 0x7f4e380704b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f4e28009910 tx=0x7f4e28009c20 comp rx=0 tx=0).stop 2023-11-28T11:59:01.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.127+0000 7f4e3ea6d700 1 -- 172.21.15.39:0/2226329591 shutdown_connections 2023-11-28T11:59:01.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.127+0000 7f4e3ea6d700 1 --2- 172.21.15.39:0/2226329591 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e38070080 0x7f4e380704b0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:01.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.127+0000 7f4e3ea6d700 1 -- 172.21.15.39:0/2226329591 >> 172.21.15.39:0/2226329591 conn(0x7f4e380b0f80 msgr2=0x7f4e380ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:01.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.127+0000 7f4e3ea6d700 1 -- 172.21.15.39:0/2226329591 shutdown_connections 2023-11-28T11:59:01.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.127+0000 7f4e3ea6d700 1 -- 172.21.15.39:0/2226329591 wait complete. 2023-11-28T11:59:01.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.131+0000 7f4e3ea6d700 1 Processor -- start 2023-11-28T11:59:01.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.131+0000 7f4e3ea6d700 1 -- start start 2023-11-28T11:59:01.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.131+0000 7f4e3ea6d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e38070080 0x7f4e38162e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:01.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.131+0000 7f4e3ea6d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e38160710 0x7f4e3815e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:01.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.131+0000 7f4e3ea6d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e38164250 0x7f4e381f7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:01.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.131+0000 7f4e3ea6d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e381f6330 con 0x7f4e38164250 2023-11-28T11:59:01.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.131+0000 7f4e3ea6d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e38163470 con 0x7f4e38070080 2023-11-28T11:59:01.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.131+0000 7f4e3ea6d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e38163750 con 0x7f4e38160710 2023-11-28T11:59:01.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.131+0000 7f4e3d26a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e38160710 0x7f4e3815e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:01.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.131+0000 7f4e3da6b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e38070080 0x7f4e38162e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:01.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.131+0000 7f4e3e26c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e38164250 0x7f4e381f7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:01.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.135+0000 7f4e3d26a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e38160710 0x7f4e3815e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:36832/0 (socket says 172.21.15.39:36832) 2023-11-28T11:59:01.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.135+0000 7f4e3da6b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e38070080 0x7f4e38162e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:41588/0 (socket says 172.21.15.39:41588) 2023-11-28T11:59:01.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.135+0000 7f4e3d26a700 1 -- 172.21.15.39:0/1306170442 learned_addr learned my addr 172.21.15.39:0/1306170442 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:01.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.135+0000 7f4e3e26c700 1 -- 172.21.15.39:0/1306170442 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e38160710 msgr2=0x7f4e3815e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:01.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.135+0000 7f4e3e26c700 1 --2- 172.21.15.39:0/1306170442 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e38160710 0x7f4e3815e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:01.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.135+0000 7f4e3e26c700 1 -- 172.21.15.39:0/1306170442 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e38070080 msgr2=0x7f4e38162e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:01.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.135+0000 7f4e3e26c700 1 --2- 172.21.15.39:0/1306170442 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e38070080 0x7f4e38162e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:01.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.135+0000 7f4e3e26c700 1 -- 172.21.15.39:0/1306170442 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e28009570 con 0x7f4e38164250 2023-11-28T11:59:01.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.135+0000 7f4e3e26c700 1 --2- 172.21.15.39:0/1306170442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e38164250 0x7f4e381f7350 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f4e3000be20 tx=0x7f4e30009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:01.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.135+0000 7f4e2e7fc700 1 -- 172.21.15.39:0/1306170442 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3000cb90 con 0x7f4e38164250 2023-11-28T11:59:01.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.135+0000 7f4e2e7fc700 1 -- 172.21.15.39:0/1306170442 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e3000cd30 con 0x7f4e38164250 2023-11-28T11:59:01.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.135+0000 7f4e3ea6d700 1 -- 172.21.15.39:0/1306170442 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e3806b3d0 con 0x7f4e38164250 2023-11-28T11:59:01.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.135+0000 7f4e2e7fc700 1 -- 172.21.15.39:0/1306170442 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3000cea0 con 0x7f4e38164250 2023-11-28T11:59:01.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.135+0000 7f4e3ea6d700 1 -- 172.21.15.39:0/1306170442 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e380cca30 con 0x7f4e38164250 2023-11-28T11:59:01.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.135+0000 7f4e3ea6d700 1 -- 172.21.15.39:0/1306170442 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e3806b6b0 con 0x7f4e38164250 2023-11-28T11:59:01.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.139+0000 7f4e2e7fc700 1 -- 172.21.15.39:0/1306170442 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4e3001b030 con 0x7f4e38164250 2023-11-28T11:59:01.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.139+0000 7f4e2e7fc700 1 --2- 172.21.15.39:0/1306170442 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4e1c064ee0 0x7f4e1c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:01.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.139+0000 7f4e2e7fc700 1 -- 172.21.15.39:0/1306170442 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4e30081d50 con 0x7f4e38164250 2023-11-28T11:59:01.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.139+0000 7f4e3da6b700 1 --2- 172.21.15.39:0/1306170442 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4e1c064ee0 0x7f4e1c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:01.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.143+0000 7f4e3da6b700 1 --2- 172.21.15.39:0/1306170442 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4e1c064ee0 0x7f4e1c067390 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4e34000f60 tx=0x7f4e34007f30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:01.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.143+0000 7f4e2e7fc700 1 -- 172.21.15.39:0/1306170442 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4e3004c400 con 0x7f4e38164250 2023-11-28T11:59:01.317 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.315+0000 7f4e3ea6d700 1 -- 172.21.15.39:0/1306170442 --> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4e38073cb0 con 0x7f4e1c064ee0 2023-11-28T11:59:01.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.331+0000 7f4e2e7fc700 1 -- 172.21.15.39:0/1306170442 <== mgr.4104 v2:172.21.15.184:6832/36166 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308779 (secure 0 0 0) 0x7f4e38073cb0 con 0x7f4e1c064ee0 2023-11-28T11:59:01.340 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:59:01.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.339+0000 7f4e3ea6d700 1 -- 172.21.15.39:0/1306170442 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4e1c064ee0 msgr2=0x7f4e1c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:01.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.339+0000 7f4e3ea6d700 1 --2- 172.21.15.39:0/1306170442 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4e1c064ee0 0x7f4e1c067390 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4e34000f60 tx=0x7f4e34007f30 comp rx=0 tx=0).stop 2023-11-28T11:59:01.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.339+0000 7f4e3ea6d700 1 -- 172.21.15.39:0/1306170442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e38164250 msgr2=0x7f4e381f7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:01.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.339+0000 7f4e3ea6d700 1 --2- 172.21.15.39:0/1306170442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e38164250 0x7f4e381f7350 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f4e3000be20 tx=0x7f4e30009ed0 comp rx=0 tx=0).stop 2023-11-28T11:59:01.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.339+0000 7f4e3ea6d700 1 -- 172.21.15.39:0/1306170442 shutdown_connections 2023-11-28T11:59:01.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.339+0000 7f4e3ea6d700 1 --2- 172.21.15.39:0/1306170442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e38164250 0x7f4e381f7350 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:01.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.339+0000 7f4e3ea6d700 1 --2- 172.21.15.39:0/1306170442 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e38160710 0x7f4e3815e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:01.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.339+0000 7f4e3ea6d700 1 --2- 172.21.15.39:0/1306170442 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4e1c064ee0 0x7f4e1c067390 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:01.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.339+0000 7f4e3ea6d700 1 --2- 172.21.15.39:0/1306170442 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e38070080 0x7f4e38162e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:01.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.339+0000 7f4e3ea6d700 1 -- 172.21.15.39:0/1306170442 >> 172.21.15.39:0/1306170442 conn(0x7f4e380b0f80 msgr2=0x7f4e38060740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:01.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.339+0000 7f4e3ea6d700 1 -- 172.21.15.39:0/1306170442 shutdown_connections 2023-11-28T11:59:01.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.339+0000 7f4e3ea6d700 1 -- 172.21.15.39:0/1306170442 wait complete. 2023-11-28T11:59:01.346 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2023-11-28T11:59:01.363 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2023-11-28T11:59:00.601340+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":80676,"kb_used_data":6564,"kb_used_omap":0,"kb_used_meta":74048,"kb_avail":754894044,"statfs":{"total":773094113280,"available":773011501056,"internally_reserved":0,"allocated":6721536,"data_stored":3702341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":75825152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.957202"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:52.660808+0000","last_change":"2023-11-28T11:58:51.667755+0000","last_active":"2023-11-28T11:58:52.660808+0000","last_peered":"2023-11-28T11:58:52.660808+0000","last_clean":"2023-11-28T11:58:52.660808+0000","last_became_active":"2023-11-28T11:58:51.667513+0000","last_became_peered":"2023-11-28T11:58:51.667513+0000","last_unstale":"2023-11-28T11:58:52.660808+0000","last_undegraded":"2023-11-28T11:58:52.660808+0000","last_fullsized":"2023-11-28T11:58:52.660808+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:39:53.174032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.681758+0000","last_change":"2023-11-28T11:58:51.677821+0000","last_active":"2023-11-28T11:58:51.681758+0000","last_peered":"2023-11-28T11:58:51.681758+0000","last_clean":"2023-11-28T11:58:51.681758+0000","last_became_active":"2023-11-28T11:58:51.677566+0000","last_became_peered":"2023-11-28T11:58:51.677566+0000","last_unstale":"2023-11-28T11:58:51.681758+0000","last_undegraded":"2023-11-28T11:58:51.681758+0000","last_fullsized":"2023-11-28T11:58:51.681758+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:47:10.246224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.686092+0000","last_change":"2023-11-28T11:58:51.683544+0000","last_active":"2023-11-28T11:58:51.686092+0000","last_peered":"2023-11-28T11:58:51.686092+0000","last_clean":"2023-11-28T11:58:51.686092+0000","last_became_active":"2023-11-28T11:58:51.683052+0000","last_became_peered":"2023-11-28T11:58:51.683052+0000","last_unstale":"2023-11-28T11:58:51.686092+0000","last_undegraded":"2023-11-28T11:58:51.686092+0000","last_fullsized":"2023-11-28T11:58:51.686092+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:53:49.319201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.680069+0000","last_change":"2023-11-28T11:58:51.671010+0000","last_active":"2023-11-28T11:58:51.680069+0000","last_peered":"2023-11-28T11:58:51.680069+0000","last_clean":"2023-11-28T11:58:51.680069+0000","last_became_active":"2023-11-28T11:58:51.670744+0000","last_became_peered":"2023-11-28T11:58:51.670744+0000","last_unstale":"2023-11-28T11:58:51.680069+0000","last_undegraded":"2023-11-28T11:58:51.680069+0000","last_fullsized":"2023-11-28T11:58:51.680069+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:37:13.495875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:52.660267+0000","last_change":"2023-11-28T11:58:51.673108+0000","last_active":"2023-11-28T11:58:52.660267+0000","last_peered":"2023-11-28T11:58:52.660267+0000","last_clean":"2023-11-28T11:58:52.660267+0000","last_became_active":"2023-11-28T11:58:51.671231+0000","last_became_peered":"2023-11-28T11:58:51.671231+0000","last_unstale":"2023-11-28T11:58:52.660267+0000","last_undegraded":"2023-11-28T11:58:52.660267+0000","last_fullsized":"2023-11-28T11:58:52.660267+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:07:32.065825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:53.159544+0000","last_change":"2023-11-28T11:58:51.665930+0000","last_active":"2023-11-28T11:58:53.159544+0000","last_peered":"2023-11-28T11:58:53.159544+0000","last_clean":"2023-11-28T11:58:53.159544+0000","last_became_active":"2023-11-28T11:58:51.665680+0000","last_became_peered":"2023-11-28T11:58:51.665680+0000","last_unstale":"2023-11-28T11:58:53.159544+0000","last_undegraded":"2023-11-28T11:58:53.159544+0000","last_fullsized":"2023-11-28T11:58:53.159544+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:04:14.466873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.694089+0000","last_change":"2023-11-28T11:58:51.689699+0000","last_active":"2023-11-28T11:58:51.694089+0000","last_peered":"2023-11-28T11:58:51.694089+0000","last_clean":"2023-11-28T11:58:51.694089+0000","last_became_active":"2023-11-28T11:58:51.689445+0000","last_became_peered":"2023-11-28T11:58:51.689445+0000","last_unstale":"2023-11-28T11:58:51.694089+0000","last_undegraded":"2023-11-28T11:58:51.694089+0000","last_fullsized":"2023-11-28T11:58:51.694089+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:23:30.095986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.685281+0000","last_change":"2023-11-28T11:58:51.682991+0000","last_active":"2023-11-28T11:58:51.685281+0000","last_peered":"2023-11-28T11:58:51.685281+0000","last_clean":"2023-11-28T11:58:51.685281+0000","last_became_active":"2023-11-28T11:58:51.682745+0000","last_became_peered":"2023-11-28T11:58:51.682745+0000","last_unstale":"2023-11-28T11:58:51.685281+0000","last_undegraded":"2023-11-28T11:58:51.685281+0000","last_fullsized":"2023-11-28T11:58:51.685281+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:04:34.153300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.689310+0000","last_change":"2023-11-28T11:58:51.680670+0000","last_active":"2023-11-28T11:58:51.689310+0000","last_peered":"2023-11-28T11:58:51.689310+0000","last_clean":"2023-11-28T11:58:51.689310+0000","last_became_active":"2023-11-28T11:58:51.680416+0000","last_became_peered":"2023-11-28T11:58:51.680416+0000","last_unstale":"2023-11-28T11:58:51.689310+0000","last_undegraded":"2023-11-28T11:58:51.689310+0000","last_fullsized":"2023-11-28T11:58:51.689310+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:37:13.495875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.678338+0000","last_change":"2023-11-28T11:58:51.667582+0000","last_active":"2023-11-28T11:58:51.678338+0000","last_peered":"2023-11-28T11:58:51.678338+0000","last_clean":"2023-11-28T11:58:51.678338+0000","last_became_active":"2023-11-28T11:58:51.667315+0000","last_became_peered":"2023-11-28T11:58:51.667315+0000","last_unstale":"2023-11-28T11:58:51.678338+0000","last_undegraded":"2023-11-28T11:58:51.678338+0000","last_fullsized":"2023-11-28T11:58:51.678338+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:04:56.514139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.682787+0000","last_change":"2023-11-28T11:58:51.675794+0000","last_active":"2023-11-28T11:58:51.682787+0000","last_peered":"2023-11-28T11:58:51.682787+0000","last_clean":"2023-11-28T11:58:51.682787+0000","last_became_active":"2023-11-28T11:58:51.668467+0000","last_became_peered":"2023-11-28T11:58:51.668467+0000","last_unstale":"2023-11-28T11:58:51.682787+0000","last_undegraded":"2023-11-28T11:58:51.682787+0000","last_fullsized":"2023-11-28T11:58:51.682787+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:22.086240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.686161+0000","last_change":"2023-11-28T11:58:51.684287+0000","last_active":"2023-11-28T11:58:51.686161+0000","last_peered":"2023-11-28T11:58:51.686161+0000","last_clean":"2023-11-28T11:58:51.686161+0000","last_became_active":"2023-11-28T11:58:51.679160+0000","last_became_peered":"2023-11-28T11:58:51.679160+0000","last_unstale":"2023-11-28T11:58:51.686161+0000","last_undegraded":"2023-11-28T11:58:51.686161+0000","last_fullsized":"2023-11-28T11:58:51.686161+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:05:25.321914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.672223+0000","last_change":"2023-11-28T11:58:51.665477+0000","last_active":"2023-11-28T11:58:51.672223+0000","last_peered":"2023-11-28T11:58:51.672223+0000","last_clean":"2023-11-28T11:58:51.672223+0000","last_became_active":"2023-11-28T11:58:51.665164+0000","last_became_peered":"2023-11-28T11:58:51.665164+0000","last_unstale":"2023-11-28T11:58:51.672223+0000","last_undegraded":"2023-11-28T11:58:51.672223+0000","last_fullsized":"2023-11-28T11:58:51.672223+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:47:19.620359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.685227+0000","last_change":"2023-11-28T11:58:51.682190+0000","last_active":"2023-11-28T11:58:51.685227+0000","last_peered":"2023-11-28T11:58:51.685227+0000","last_clean":"2023-11-28T11:58:51.685227+0000","last_became_active":"2023-11-28T11:58:51.681484+0000","last_became_peered":"2023-11-28T11:58:51.681484+0000","last_unstale":"2023-11-28T11:58:51.685227+0000","last_undegraded":"2023-11-28T11:58:51.685227+0000","last_fullsized":"2023-11-28T11:58:51.685227+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:20:26.402257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.691705+0000","last_change":"2023-11-28T11:58:51.688099+0000","last_active":"2023-11-28T11:58:51.691705+0000","last_peered":"2023-11-28T11:58:51.691705+0000","last_clean":"2023-11-28T11:58:51.691705+0000","last_became_active":"2023-11-28T11:58:51.687790+0000","last_became_peered":"2023-11-28T11:58:51.687790+0000","last_unstale":"2023-11-28T11:58:51.691705+0000","last_undegraded":"2023-11-28T11:58:51.691705+0000","last_fullsized":"2023-11-28T11:58:51.691705+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:31:57.919489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:53.159390+0000","last_change":"2023-11-28T11:58:51.657821+0000","last_active":"2023-11-28T11:58:53.159390+0000","last_peered":"2023-11-28T11:58:53.159390+0000","last_clean":"2023-11-28T11:58:53.159390+0000","last_became_active":"2023-11-28T11:58:51.657561+0000","last_became_peered":"2023-11-28T11:58:51.657561+0000","last_unstale":"2023-11-28T11:58:53.159390+0000","last_undegraded":"2023-11-28T11:58:53.159390+0000","last_fullsized":"2023-11-28T11:58:53.159390+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:43:55.215996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.681581+0000","last_change":"2023-11-28T11:58:51.676998+0000","last_active":"2023-11-28T11:58:51.681581+0000","last_peered":"2023-11-28T11:58:51.681581+0000","last_clean":"2023-11-28T11:58:51.681581+0000","last_became_active":"2023-11-28T11:58:51.676695+0000","last_became_peered":"2023-11-28T11:58:51.676695+0000","last_unstale":"2023-11-28T11:58:51.681581+0000","last_undegraded":"2023-11-28T11:58:51.681581+0000","last_fullsized":"2023-11-28T11:58:51.681581+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:21:34.475958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.684709+0000","last_change":"2023-11-28T11:58:51.677428+0000","last_active":"2023-11-28T11:58:51.684709+0000","last_peered":"2023-11-28T11:58:51.684709+0000","last_clean":"2023-11-28T11:58:51.684709+0000","last_became_active":"2023-11-28T11:58:51.677163+0000","last_became_peered":"2023-11-28T11:58:51.677163+0000","last_unstale":"2023-11-28T11:58:51.684709+0000","last_undegraded":"2023-11-28T11:58:51.684709+0000","last_fullsized":"2023-11-28T11:58:51.684709+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:05:25.321914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:52.660438+0000","last_change":"2023-11-28T11:58:51.668558+0000","last_active":"2023-11-28T11:58:52.660438+0000","last_peered":"2023-11-28T11:58:52.660438+0000","last_clean":"2023-11-28T11:58:52.660438+0000","last_became_active":"2023-11-28T11:58:51.668252+0000","last_became_peered":"2023-11-28T11:58:51.668252+0000","last_unstale":"2023-11-28T11:58:52.660438+0000","last_undegraded":"2023-11-28T11:58:52.660438+0000","last_fullsized":"2023-11-28T11:58:52.660438+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:04:19.289140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.672602+0000","last_change":"2023-11-28T11:58:51.666889+0000","last_active":"2023-11-28T11:58:51.672602+0000","last_peered":"2023-11-28T11:58:51.672602+0000","last_clean":"2023-11-28T11:58:51.672602+0000","last_became_active":"2023-11-28T11:58:51.666603+0000","last_became_peered":"2023-11-28T11:58:51.666603+0000","last_unstale":"2023-11-28T11:58:51.672602+0000","last_undegraded":"2023-11-28T11:58:51.672602+0000","last_fullsized":"2023-11-28T11:58:51.672602+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:23:19.193646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.681084+0000","last_change":"2023-11-28T11:58:51.674976+0000","last_active":"2023-11-28T11:58:51.681084+0000","last_peered":"2023-11-28T11:58:51.681084+0000","last_clean":"2023-11-28T11:58:51.681084+0000","last_became_active":"2023-11-28T11:58:51.674650+0000","last_became_peered":"2023-11-28T11:58:51.674650+0000","last_unstale":"2023-11-28T11:58:51.681084+0000","last_undegraded":"2023-11-28T11:58:51.681084+0000","last_fullsized":"2023-11-28T11:58:51.681084+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:28:12.186813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.676216+0000","last_change":"2023-11-28T11:58:51.670809+0000","last_active":"2023-11-28T11:58:51.676216+0000","last_peered":"2023-11-28T11:58:51.676216+0000","last_clean":"2023-11-28T11:58:51.676216+0000","last_became_active":"2023-11-28T11:58:51.670540+0000","last_became_peered":"2023-11-28T11:58:51.670540+0000","last_unstale":"2023-11-28T11:58:51.676216+0000","last_undegraded":"2023-11-28T11:58:51.676216+0000","last_fullsized":"2023-11-28T11:58:51.676216+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:48:03.508051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.680911+0000","last_change":"2023-11-28T11:58:51.676602+0000","last_active":"2023-11-28T11:58:51.680911+0000","last_peered":"2023-11-28T11:58:51.680911+0000","last_clean":"2023-11-28T11:58:51.680911+0000","last_became_active":"2023-11-28T11:58:51.676089+0000","last_became_peered":"2023-11-28T11:58:51.676089+0000","last_unstale":"2023-11-28T11:58:51.680911+0000","last_undegraded":"2023-11-28T11:58:51.680911+0000","last_fullsized":"2023-11-28T11:58:51.680911+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:36:20.149308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.672164+0000","last_change":"2023-11-28T11:58:51.665927+0000","last_active":"2023-11-28T11:58:51.672164+0000","last_peered":"2023-11-28T11:58:51.672164+0000","last_clean":"2023-11-28T11:58:51.672164+0000","last_became_active":"2023-11-28T11:58:51.665588+0000","last_became_peered":"2023-11-28T11:58:51.665588+0000","last_unstale":"2023-11-28T11:58:51.672164+0000","last_undegraded":"2023-11-28T11:58:51.672164+0000","last_fullsized":"2023-11-28T11:58:51.672164+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:22.086240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:52.660798+0000","last_change":"2023-11-28T11:58:51.678822+0000","last_active":"2023-11-28T11:58:52.660798+0000","last_peered":"2023-11-28T11:58:52.660798+0000","last_clean":"2023-11-28T11:58:52.660798+0000","last_became_active":"2023-11-28T11:58:51.678250+0000","last_became_peered":"2023-11-28T11:58:51.678250+0000","last_unstale":"2023-11-28T11:58:52.660798+0000","last_undegraded":"2023-11-28T11:58:52.660798+0000","last_fullsized":"2023-11-28T11:58:52.660798+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:00:20.015581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.696536+0000","last_change":"2023-11-28T11:58:51.692022+0000","last_active":"2023-11-28T11:58:51.696536+0000","last_peered":"2023-11-28T11:58:51.696536+0000","last_clean":"2023-11-28T11:58:51.696536+0000","last_became_active":"2023-11-28T11:58:51.691796+0000","last_became_peered":"2023-11-28T11:58:51.691796+0000","last_unstale":"2023-11-28T11:58:51.696536+0000","last_undegraded":"2023-11-28T11:58:51.696536+0000","last_fullsized":"2023-11-28T11:58:51.696536+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:03:49.327209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:53.160441+0000","last_change":"2023-11-28T11:58:51.662109+0000","last_active":"2023-11-28T11:58:53.160441+0000","last_peered":"2023-11-28T11:58:53.160441+0000","last_clean":"2023-11-28T11:58:53.160441+0000","last_became_active":"2023-11-28T11:58:51.658574+0000","last_became_peered":"2023-11-28T11:58:51.658574+0000","last_unstale":"2023-11-28T11:58:53.160441+0000","last_undegraded":"2023-11-28T11:58:53.160441+0000","last_fullsized":"2023-11-28T11:58:53.160441+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:08:13.836696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:52.660478+0000","last_change":"2023-11-28T11:58:51.672130+0000","last_active":"2023-11-28T11:58:52.660478+0000","last_peered":"2023-11-28T11:58:52.660478+0000","last_clean":"2023-11-28T11:58:52.660478+0000","last_became_active":"2023-11-28T11:58:51.671137+0000","last_became_peered":"2023-11-28T11:58:51.671137+0000","last_unstale":"2023-11-28T11:58:52.660478+0000","last_undegraded":"2023-11-28T11:58:52.660478+0000","last_fullsized":"2023-11-28T11:58:52.660478+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:12:05.660571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.676574+0000","last_change":"2023-11-28T11:58:51.672003+0000","last_active":"2023-11-28T11:58:51.676574+0000","last_peered":"2023-11-28T11:58:51.676574+0000","last_clean":"2023-11-28T11:58:51.676574+0000","last_became_active":"2023-11-28T11:58:51.671746+0000","last_became_peered":"2023-11-28T11:58:51.671746+0000","last_unstale":"2023-11-28T11:58:51.676574+0000","last_undegraded":"2023-11-28T11:58:51.676574+0000","last_fullsized":"2023-11-28T11:58:51.676574+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:42:12.056606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.686124+0000","last_change":"2023-11-28T11:58:51.683502+0000","last_active":"2023-11-28T11:58:51.686124+0000","last_peered":"2023-11-28T11:58:51.686124+0000","last_clean":"2023-11-28T11:58:51.686124+0000","last_became_active":"2023-11-28T11:58:51.683257+0000","last_became_peered":"2023-11-28T11:58:51.683257+0000","last_unstale":"2023-11-28T11:58:51.686124+0000","last_undegraded":"2023-11-28T11:58:51.686124+0000","last_fullsized":"2023-11-28T11:58:51.686124+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:37:13.495875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:52.660018+0000","last_change":"2023-11-28T11:58:51.669901+0000","last_active":"2023-11-28T11:58:52.660018+0000","last_peered":"2023-11-28T11:58:52.660018+0000","last_clean":"2023-11-28T11:58:52.660018+0000","last_became_active":"2023-11-28T11:58:51.669260+0000","last_became_peered":"2023-11-28T11:58:51.669260+0000","last_unstale":"2023-11-28T11:58:52.660018+0000","last_undegraded":"2023-11-28T11:58:52.660018+0000","last_fullsized":"2023-11-28T11:58:52.660018+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:54:31.914532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:53.159462+0000","last_change":"2023-11-28T11:58:51.671474+0000","last_active":"2023-11-28T11:58:53.159462+0000","last_peered":"2023-11-28T11:58:53.159462+0000","last_clean":"2023-11-28T11:58:53.159462+0000","last_became_active":"2023-11-28T11:58:51.670978+0000","last_became_peered":"2023-11-28T11:58:51.670978+0000","last_unstale":"2023-11-28T11:58:53.159462+0000","last_undegraded":"2023-11-28T11:58:53.159462+0000","last_fullsized":"2023-11-28T11:58:53.159462+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:03:19.954423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:53.161425+0000","last_change":"2023-11-28T11:58:51.672350+0000","last_active":"2023-11-28T11:58:53.161425+0000","last_peered":"2023-11-28T11:58:53.161425+0000","last_clean":"2023-11-28T11:58:53.161425+0000","last_became_active":"2023-11-28T11:58:51.672065+0000","last_became_peered":"2023-11-28T11:58:51.672065+0000","last_unstale":"2023-11-28T11:58:53.161425+0000","last_undegraded":"2023-11-28T11:58:53.161425+0000","last_fullsized":"2023-11-28T11:58:53.161425+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:51:14.342111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"57'4","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.680245+0000","last_change":"2023-11-28T11:58:51.187075+0000","last_active":"2023-11-28T11:58:51.680245+0000","last_peered":"2023-11-28T11:58:51.680245+0000","last_clean":"2023-11-28T11:58:51.680245+0000","last_became_active":"2023-11-28T11:58:51.186745+0000","last_became_peered":"2023-11-28T11:58:51.186745+0000","last_unstale":"2023-11-28T11:58:51.680245+0000","last_undegraded":"2023-11-28T11:58:51.680245+0000","last_fullsized":"2023-11-28T11:58:51.680245+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:53:15.246374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.682683+0000","last_change":"2023-11-28T11:58:51.677358+0000","last_active":"2023-11-28T11:58:51.682683+0000","last_peered":"2023-11-28T11:58:51.682683+0000","last_clean":"2023-11-28T11:58:51.682683+0000","last_became_active":"2023-11-28T11:58:51.677101+0000","last_became_peered":"2023-11-28T11:58:51.677101+0000","last_unstale":"2023-11-28T11:58:51.682683+0000","last_undegraded":"2023-11-28T11:58:51.682683+0000","last_fullsized":"2023-11-28T11:58:51.682683+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:36:59.737858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"57'1","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.676602+0000","last_change":"2023-11-28T11:58:51.177136+0000","last_active":"2023-11-28T11:58:51.676602+0000","last_peered":"2023-11-28T11:58:51.676602+0000","last_clean":"2023-11-28T11:58:51.676602+0000","last_became_active":"2023-11-28T11:58:51.176824+0000","last_became_peered":"2023-11-28T11:58:51.176824+0000","last_unstale":"2023-11-28T11:58:51.676602+0000","last_undegraded":"2023-11-28T11:58:51.676602+0000","last_fullsized":"2023-11-28T11:58:51.676602+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:32:18.747280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:53.160565+0000","last_change":"2023-11-28T11:58:51.662526+0000","last_active":"2023-11-28T11:58:53.160565+0000","last_peered":"2023-11-28T11:58:53.160565+0000","last_clean":"2023-11-28T11:58:53.160565+0000","last_became_active":"2023-11-28T11:58:51.662293+0000","last_became_peered":"2023-11-28T11:58:51.662293+0000","last_unstale":"2023-11-28T11:58:53.160565+0000","last_undegraded":"2023-11-28T11:58:53.160565+0000","last_fullsized":"2023-11-28T11:58:53.160565+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:52:06.479074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"57'2","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.682862+0000","last_change":"2023-11-28T11:58:51.187837+0000","last_active":"2023-11-28T11:58:51.682862+0000","last_peered":"2023-11-28T11:58:51.682862+0000","last_clean":"2023-11-28T11:58:51.682862+0000","last_became_active":"2023-11-28T11:58:51.187147+0000","last_became_peered":"2023-11-28T11:58:51.187147+0000","last_unstale":"2023-11-28T11:58:51.682862+0000","last_undegraded":"2023-11-28T11:58:51.682862+0000","last_fullsized":"2023-11-28T11:58:51.682862+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:16:05.197854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:53.161235+0000","last_change":"2023-11-28T11:58:51.678151+0000","last_active":"2023-11-28T11:58:53.161235+0000","last_peered":"2023-11-28T11:58:53.161235+0000","last_clean":"2023-11-28T11:58:53.161235+0000","last_became_active":"2023-11-28T11:58:51.677796+0000","last_became_peered":"2023-11-28T11:58:51.677796+0000","last_unstale":"2023-11-28T11:58:53.161235+0000","last_undegraded":"2023-11-28T11:58:53.161235+0000","last_fullsized":"2023-11-28T11:58:53.161235+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:57:14.978843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"57'2","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.680142+0000","last_change":"2023-11-28T11:58:51.179001+0000","last_active":"2023-11-28T11:58:51.680142+0000","last_peered":"2023-11-28T11:58:51.680142+0000","last_clean":"2023-11-28T11:58:51.680142+0000","last_became_active":"2023-11-28T11:58:51.178671+0000","last_became_peered":"2023-11-28T11:58:51.178671+0000","last_unstale":"2023-11-28T11:58:51.680142+0000","last_undegraded":"2023-11-28T11:58:51.680142+0000","last_fullsized":"2023-11-28T11:58:51.680142+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:48:41.050307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.672557+0000","last_change":"2023-11-28T11:58:51.665375+0000","last_active":"2023-11-28T11:58:51.672557+0000","last_peered":"2023-11-28T11:58:51.672557+0000","last_clean":"2023-11-28T11:58:51.672557+0000","last_became_active":"2023-11-28T11:58:51.665098+0000","last_became_peered":"2023-11-28T11:58:51.665098+0000","last_unstale":"2023-11-28T11:58:51.672557+0000","last_undegraded":"2023-11-28T11:58:51.672557+0000","last_fullsized":"2023-11-28T11:58:51.672557+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:31:00.537286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"57'1","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.686509+0000","last_change":"2023-11-28T11:58:51.192459+0000","last_active":"2023-11-28T11:58:51.686509+0000","last_peered":"2023-11-28T11:58:51.686509+0000","last_clean":"2023-11-28T11:58:51.686509+0000","last_became_active":"2023-11-28T11:58:51.192125+0000","last_became_peered":"2023-11-28T11:58:51.192125+0000","last_unstale":"2023-11-28T11:58:51.686509+0000","last_undegraded":"2023-11-28T11:58:51.686509+0000","last_fullsized":"2023-11-28T11:58:51.686509+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:25:16.499893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.676555+0000","last_change":"2023-11-28T11:58:51.670283+0000","last_active":"2023-11-28T11:58:51.676555+0000","last_peered":"2023-11-28T11:58:51.676555+0000","last_clean":"2023-11-28T11:58:51.676555+0000","last_became_active":"2023-11-28T11:58:51.670012+0000","last_became_peered":"2023-11-28T11:58:51.670012+0000","last_unstale":"2023-11-28T11:58:51.676555+0000","last_undegraded":"2023-11-28T11:58:51.676555+0000","last_fullsized":"2023-11-28T11:58:51.676555+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:21:32.139383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"57'1","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.674380+0000","last_change":"2023-11-28T11:58:51.184709+0000","last_active":"2023-11-28T11:58:51.674380+0000","last_peered":"2023-11-28T11:58:51.674380+0000","last_clean":"2023-11-28T11:58:51.674380+0000","last_became_active":"2023-11-28T11:58:51.183903+0000","last_became_peered":"2023-11-28T11:58:51.183903+0000","last_unstale":"2023-11-28T11:58:51.674380+0000","last_undegraded":"2023-11-28T11:58:51.674380+0000","last_fullsized":"2023-11-28T11:58:51.674380+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:08:06.627993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.672183+0000","last_change":"2023-11-28T11:58:51.667426+0000","last_active":"2023-11-28T11:58:51.672183+0000","last_peered":"2023-11-28T11:58:51.672183+0000","last_clean":"2023-11-28T11:58:51.672183+0000","last_became_active":"2023-11-28T11:58:51.667175+0000","last_became_peered":"2023-11-28T11:58:51.667175+0000","last_unstale":"2023-11-28T11:58:51.672183+0000","last_undegraded":"2023-11-28T11:58:51.672183+0000","last_fullsized":"2023-11-28T11:58:51.672183+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:04:56.514139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.666699+0000","last_change":"2023-11-28T11:58:51.176988+0000","last_active":"2023-11-28T11:58:51.666699+0000","last_peered":"2023-11-28T11:58:51.666699+0000","last_clean":"2023-11-28T11:58:51.666699+0000","last_became_active":"2023-11-28T11:58:51.176713+0000","last_became_peered":"2023-11-28T11:58:51.176713+0000","last_unstale":"2023-11-28T11:58:51.666699+0000","last_undegraded":"2023-11-28T11:58:51.666699+0000","last_fullsized":"2023-11-28T11:58:51.666699+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:27:32.752868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.676173+0000","last_change":"2023-11-28T11:58:51.669037+0000","last_active":"2023-11-28T11:58:51.676173+0000","last_peered":"2023-11-28T11:58:51.676173+0000","last_clean":"2023-11-28T11:58:51.676173+0000","last_became_active":"2023-11-28T11:58:51.668702+0000","last_became_peered":"2023-11-28T11:58:51.668702+0000","last_unstale":"2023-11-28T11:58:51.676173+0000","last_undegraded":"2023-11-28T11:58:51.676173+0000","last_fullsized":"2023-11-28T11:58:51.676173+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:12:51.007363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.663988+0000","last_change":"2023-11-28T11:58:51.184233+0000","last_active":"2023-11-28T11:58:51.663988+0000","last_peered":"2023-11-28T11:58:51.663988+0000","last_clean":"2023-11-28T11:58:51.663988+0000","last_became_active":"2023-11-28T11:58:51.183942+0000","last_became_peered":"2023-11-28T11:58:51.183942+0000","last_unstale":"2023-11-28T11:58:51.663988+0000","last_undegraded":"2023-11-28T11:58:51.663988+0000","last_fullsized":"2023-11-28T11:58:51.663988+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:36:19.127665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.694072+0000","last_change":"2023-11-28T11:58:51.688573+0000","last_active":"2023-11-28T11:58:51.694072+0000","last_peered":"2023-11-28T11:58:51.694072+0000","last_clean":"2023-11-28T11:58:51.694072+0000","last_became_active":"2023-11-28T11:58:51.688262+0000","last_became_peered":"2023-11-28T11:58:51.688262+0000","last_unstale":"2023-11-28T11:58:51.694072+0000","last_undegraded":"2023-11-28T11:58:51.694072+0000","last_fullsized":"2023-11-28T11:58:51.694072+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:16:01.044656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.667116+0000","last_change":"2023-11-28T11:58:51.176310+0000","last_active":"2023-11-28T11:58:51.667116+0000","last_peered":"2023-11-28T11:58:51.667116+0000","last_clean":"2023-11-28T11:58:51.667116+0000","last_became_active":"2023-11-28T11:58:51.176047+0000","last_became_peered":"2023-11-28T11:58:51.176047+0000","last_unstale":"2023-11-28T11:58:51.667116+0000","last_undegraded":"2023-11-28T11:58:51.667116+0000","last_fullsized":"2023-11-28T11:58:51.667116+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:47:18.598716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.684622+0000","last_change":"2023-11-28T11:58:51.678731+0000","last_active":"2023-11-28T11:58:51.684622+0000","last_peered":"2023-11-28T11:58:51.684622+0000","last_clean":"2023-11-28T11:58:51.684622+0000","last_became_active":"2023-11-28T11:58:51.678280+0000","last_became_peered":"2023-11-28T11:58:51.678280+0000","last_unstale":"2023-11-28T11:58:51.684622+0000","last_undegraded":"2023-11-28T11:58:51.684622+0000","last_fullsized":"2023-11-28T11:58:51.684622+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:23.788694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.659965+0000","last_change":"2023-11-28T11:58:51.194390+0000","last_active":"2023-11-28T11:58:51.659965+0000","last_peered":"2023-11-28T11:58:51.659965+0000","last_clean":"2023-11-28T11:58:51.659965+0000","last_became_active":"2023-11-28T11:58:51.193968+0000","last_became_peered":"2023-11-28T11:58:51.193968+0000","last_unstale":"2023-11-28T11:58:51.659965+0000","last_undegraded":"2023-11-28T11:58:51.659965+0000","last_fullsized":"2023-11-28T11:58:51.659965+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:05:24.300271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.688447+0000","last_change":"2023-11-28T11:58:51.686470+0000","last_active":"2023-11-28T11:58:51.688447+0000","last_peered":"2023-11-28T11:58:51.688447+0000","last_clean":"2023-11-28T11:58:51.688447+0000","last_became_active":"2023-11-28T11:58:51.686196+0000","last_became_peered":"2023-11-28T11:58:51.686196+0000","last_unstale":"2023-11-28T11:58:51.688447+0000","last_undegraded":"2023-11-28T11:58:51.688447+0000","last_fullsized":"2023-11-28T11:58:51.688447+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:14:29.875840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"57'3","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.687034+0000","last_change":"2023-11-28T11:58:51.170686+0000","last_active":"2023-11-28T11:58:51.687034+0000","last_peered":"2023-11-28T11:58:51.687034+0000","last_clean":"2023-11-28T11:58:51.687034+0000","last_became_active":"2023-11-28T11:58:51.170416+0000","last_became_peered":"2023-11-28T11:58:51.170416+0000","last_unstale":"2023-11-28T11:58:51.687034+0000","last_undegraded":"2023-11-28T11:58:51.687034+0000","last_fullsized":"2023-11-28T11:58:51.687034+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:21.064597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.686008+0000","last_change":"2023-11-28T11:58:51.681901+0000","last_active":"2023-11-28T11:58:51.686008+0000","last_peered":"2023-11-28T11:58:51.686008+0000","last_clean":"2023-11-28T11:58:51.686008+0000","last_became_active":"2023-11-28T11:58:51.681724+0000","last_became_peered":"2023-11-28T11:58:51.681724+0000","last_unstale":"2023-11-28T11:58:51.686008+0000","last_undegraded":"2023-11-28T11:58:51.686008+0000","last_fullsized":"2023-11-28T11:58:51.686008+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:03:49.327209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"57'6","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.694143+0000","last_change":"2023-11-28T11:58:51.182690+0000","last_active":"2023-11-28T11:58:51.694143+0000","last_peered":"2023-11-28T11:58:51.694143+0000","last_clean":"2023-11-28T11:58:51.694143+0000","last_became_active":"2023-11-28T11:58:51.182414+0000","last_became_peered":"2023-11-28T11:58:51.182414+0000","last_unstale":"2023-11-28T11:58:51.694143+0000","last_undegraded":"2023-11-28T11:58:51.694143+0000","last_fullsized":"2023-11-28T11:58:51.694143+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:28:11.165170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.681571+0000","last_change":"2023-11-28T11:58:51.677490+0000","last_active":"2023-11-28T11:58:51.681571+0000","last_peered":"2023-11-28T11:58:51.681571+0000","last_clean":"2023-11-28T11:58:51.681571+0000","last_became_active":"2023-11-28T11:58:51.677095+0000","last_became_peered":"2023-11-28T11:58:51.677095+0000","last_unstale":"2023-11-28T11:58:51.681571+0000","last_undegraded":"2023-11-28T11:58:51.681571+0000","last_fullsized":"2023-11-28T11:58:51.681571+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:17:04.728611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"57'2","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.674289+0000","last_change":"2023-11-28T11:58:51.192204+0000","last_active":"2023-11-28T11:58:51.674289+0000","last_peered":"2023-11-28T11:58:51.674289+0000","last_clean":"2023-11-28T11:58:51.674289+0000","last_became_active":"2023-11-28T11:58:51.191886+0000","last_became_peered":"2023-11-28T11:58:51.191886+0000","last_unstale":"2023-11-28T11:58:51.674289+0000","last_undegraded":"2023-11-28T11:58:51.674289+0000","last_fullsized":"2023-11-28T11:58:51.674289+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:22.767051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.677525+0000","last_change":"2023-11-28T11:58:51.674179+0000","last_active":"2023-11-28T11:58:51.677525+0000","last_peered":"2023-11-28T11:58:51.677525+0000","last_clean":"2023-11-28T11:58:51.677525+0000","last_became_active":"2023-11-28T11:58:51.673889+0000","last_became_peered":"2023-11-28T11:58:51.673889+0000","last_unstale":"2023-11-28T11:58:51.677525+0000","last_undegraded":"2023-11-28T11:58:51.677525+0000","last_fullsized":"2023-11-28T11:58:51.677525+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:52.015075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.653764+0000","last_change":"2023-11-28T11:58:51.174956+0000","last_active":"2023-11-28T11:58:51.653764+0000","last_peered":"2023-11-28T11:58:51.653764+0000","last_clean":"2023-11-28T11:58:51.653764+0000","last_became_active":"2023-11-28T11:58:51.174655+0000","last_became_peered":"2023-11-28T11:58:51.174655+0000","last_unstale":"2023-11-28T11:58:51.653764+0000","last_undegraded":"2023-11-28T11:58:51.653764+0000","last_fullsized":"2023-11-28T11:58:51.653764+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:34:31.055864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.685257+0000","last_change":"2023-11-28T11:58:51.682639+0000","last_active":"2023-11-28T11:58:51.685257+0000","last_peered":"2023-11-28T11:58:51.685257+0000","last_clean":"2023-11-28T11:58:51.685257+0000","last_became_active":"2023-11-28T11:58:51.682387+0000","last_became_peered":"2023-11-28T11:58:51.682387+0000","last_unstale":"2023-11-28T11:58:51.685257+0000","last_undegraded":"2023-11-28T11:58:51.685257+0000","last_fullsized":"2023-11-28T11:58:51.685257+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:43:18.872444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.667151+0000","last_change":"2023-11-28T11:58:51.179067+0000","last_active":"2023-11-28T11:58:51.667151+0000","last_peered":"2023-11-28T11:58:51.667151+0000","last_clean":"2023-11-28T11:58:51.667151+0000","last_became_active":"2023-11-28T11:58:51.178790+0000","last_became_peered":"2023-11-28T11:58:51.178790+0000","last_unstale":"2023-11-28T11:58:51.667151+0000","last_undegraded":"2023-11-28T11:58:51.667151+0000","last_fullsized":"2023-11-28T11:58:51.667151+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:34.431609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.680928+0000","last_change":"2023-11-28T11:58:51.676669+0000","last_active":"2023-11-28T11:58:51.680928+0000","last_peered":"2023-11-28T11:58:51.680928+0000","last_clean":"2023-11-28T11:58:51.680928+0000","last_became_active":"2023-11-28T11:58:51.676423+0000","last_became_peered":"2023-11-28T11:58:51.676423+0000","last_unstale":"2023-11-28T11:58:51.680928+0000","last_undegraded":"2023-11-28T11:58:51.680928+0000","last_fullsized":"2023-11-28T11:58:51.680928+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:25:17.521536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"57'8","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.676169+0000","last_change":"2023-11-28T11:58:51.173895+0000","last_active":"2023-11-28T11:58:51.676169+0000","last_peered":"2023-11-28T11:58:51.676169+0000","last_clean":"2023-11-28T11:58:51.676169+0000","last_became_active":"2023-11-28T11:58:51.173611+0000","last_became_peered":"2023-11-28T11:58:51.173611+0000","last_unstale":"2023-11-28T11:58:51.676169+0000","last_undegraded":"2023-11-28T11:58:51.676169+0000","last_fullsized":"2023-11-28T11:58:51.676169+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:04:55.492496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.680840+0000","last_change":"2023-11-28T11:58:51.672878+0000","last_active":"2023-11-28T11:58:51.680840+0000","last_peered":"2023-11-28T11:58:51.680840+0000","last_clean":"2023-11-28T11:58:51.680840+0000","last_became_active":"2023-11-28T11:58:51.672536+0000","last_became_peered":"2023-11-28T11:58:51.672536+0000","last_unstale":"2023-11-28T11:58:51.680840+0000","last_undegraded":"2023-11-28T11:58:51.680840+0000","last_fullsized":"2023-11-28T11:58:51.680840+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:23:30.095986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"57'2","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.684133+0000","last_change":"2023-11-28T11:58:51.190105+0000","last_active":"2023-11-28T11:58:51.684133+0000","last_peered":"2023-11-28T11:58:51.684133+0000","last_clean":"2023-11-28T11:58:51.684133+0000","last_became_active":"2023-11-28T11:58:51.189836+0000","last_became_peered":"2023-11-28T11:58:51.189836+0000","last_unstale":"2023-11-28T11:58:51.684133+0000","last_undegraded":"2023-11-28T11:58:51.684133+0000","last_fullsized":"2023-11-28T11:58:51.684133+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:54:49.735542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.684988+0000","last_change":"2023-11-28T11:58:51.680482+0000","last_active":"2023-11-28T11:58:51.684988+0000","last_peered":"2023-11-28T11:58:51.684988+0000","last_clean":"2023-11-28T11:58:51.684988+0000","last_became_active":"2023-11-28T11:58:51.679387+0000","last_became_peered":"2023-11-28T11:58:51.679387+0000","last_unstale":"2023-11-28T11:58:51.684988+0000","last_undegraded":"2023-11-28T11:58:51.684988+0000","last_fullsized":"2023-11-28T11:58:51.684988+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:23.788694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.646467+0000","last_change":"2023-11-28T11:58:51.179702+0000","last_active":"2023-11-28T11:58:51.646467+0000","last_peered":"2023-11-28T11:58:51.646467+0000","last_clean":"2023-11-28T11:58:51.646467+0000","last_became_active":"2023-11-28T11:58:51.179426+0000","last_became_peered":"2023-11-28T11:58:51.179426+0000","last_unstale":"2023-11-28T11:58:51.646467+0000","last_undegraded":"2023-11-28T11:58:51.646467+0000","last_fullsized":"2023-11-28T11:58:51.646467+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:44:16.839236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.688180+0000","last_change":"2023-11-28T11:58:51.684438+0000","last_active":"2023-11-28T11:58:51.688180+0000","last_peered":"2023-11-28T11:58:51.688180+0000","last_clean":"2023-11-28T11:58:51.688180+0000","last_became_active":"2023-11-28T11:58:51.684184+0000","last_became_peered":"2023-11-28T11:58:51.684184+0000","last_unstale":"2023-11-28T11:58:51.688180+0000","last_undegraded":"2023-11-28T11:58:51.688180+0000","last_fullsized":"2023-11-28T11:58:51.688180+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:47:19.620359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.653827+0000","last_change":"2023-11-28T11:58:51.174876+0000","last_active":"2023-11-28T11:58:51.653827+0000","last_peered":"2023-11-28T11:58:51.653827+0000","last_clean":"2023-11-28T11:58:51.653827+0000","last_became_active":"2023-11-28T11:58:51.174567+0000","last_became_peered":"2023-11-28T11:58:51.174567+0000","last_unstale":"2023-11-28T11:58:51.653827+0000","last_undegraded":"2023-11-28T11:58:51.653827+0000","last_fullsized":"2023-11-28T11:58:51.653827+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:09:52.803813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:53.160782+0000","last_change":"2023-11-28T11:58:51.677710+0000","last_active":"2023-11-28T11:58:53.160782+0000","last_peered":"2023-11-28T11:58:53.160782+0000","last_clean":"2023-11-28T11:58:53.160782+0000","last_became_active":"2023-11-28T11:58:51.677389+0000","last_became_peered":"2023-11-28T11:58:51.677389+0000","last_unstale":"2023-11-28T11:58:53.160782+0000","last_undegraded":"2023-11-28T11:58:53.160782+0000","last_fullsized":"2023-11-28T11:58:53.160782+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:54:32.327688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.669428+0000","last_change":"2023-11-28T11:58:51.182292+0000","last_active":"2023-11-28T11:58:51.669428+0000","last_peered":"2023-11-28T11:58:51.669428+0000","last_clean":"2023-11-28T11:58:51.669428+0000","last_became_active":"2023-11-28T11:58:51.182019+0000","last_became_peered":"2023-11-28T11:58:51.182019+0000","last_unstale":"2023-11-28T11:58:51.669428+0000","last_undegraded":"2023-11-28T11:58:51.669428+0000","last_fullsized":"2023-11-28T11:58:51.669428+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:46:05.485633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.685646+0000","last_change":"2023-11-28T11:58:51.682399+0000","last_active":"2023-11-28T11:58:51.685646+0000","last_peered":"2023-11-28T11:58:51.685646+0000","last_clean":"2023-11-28T11:58:51.685646+0000","last_became_active":"2023-11-28T11:58:51.682133+0000","last_became_peered":"2023-11-28T11:58:51.682133+0000","last_unstale":"2023-11-28T11:58:51.685646+0000","last_undegraded":"2023-11-28T11:58:51.685646+0000","last_fullsized":"2023-11-28T11:58:51.685646+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:22:28.860678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.651978+0000","last_change":"2023-11-28T11:58:51.183963+0000","last_active":"2023-11-28T11:58:51.651978+0000","last_peered":"2023-11-28T11:58:51.651978+0000","last_clean":"2023-11-28T11:58:51.651978+0000","last_became_active":"2023-11-28T11:58:51.183704+0000","last_became_peered":"2023-11-28T11:58:51.183704+0000","last_unstale":"2023-11-28T11:58:51.651978+0000","last_undegraded":"2023-11-28T11:58:51.651978+0000","last_fullsized":"2023-11-28T11:58:51.651978+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:48:13.492030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.681103+0000","last_change":"2023-11-28T11:58:51.676191+0000","last_active":"2023-11-28T11:58:51.681103+0000","last_peered":"2023-11-28T11:58:51.681103+0000","last_clean":"2023-11-28T11:58:51.681103+0000","last_became_active":"2023-11-28T11:58:51.676001+0000","last_became_peered":"2023-11-28T11:58:51.676001+0000","last_unstale":"2023-11-28T11:58:51.681103+0000","last_undegraded":"2023-11-28T11:58:51.681103+0000","last_fullsized":"2023-11-28T11:58:51.681103+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:51:09.793929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.665066+0000","last_change":"2023-11-28T11:58:51.176569+0000","last_active":"2023-11-28T11:58:51.665066+0000","last_peered":"2023-11-28T11:58:51.665066+0000","last_clean":"2023-11-28T11:58:51.665066+0000","last_became_active":"2023-11-28T11:58:51.176264+0000","last_became_peered":"2023-11-28T11:58:51.176264+0000","last_unstale":"2023-11-28T11:58:51.665066+0000","last_undegraded":"2023-11-28T11:58:51.665066+0000","last_fullsized":"2023-11-28T11:58:51.665066+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:51:08.772287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.672804+0000","last_change":"2023-11-28T11:58:51.656842+0000","last_active":"2023-11-28T11:58:51.672804+0000","last_peered":"2023-11-28T11:58:51.672804+0000","last_clean":"2023-11-28T11:58:51.672804+0000","last_became_active":"2023-11-28T11:58:51.656554+0000","last_became_peered":"2023-11-28T11:58:51.656554+0000","last_unstale":"2023-11-28T11:58:51.672804+0000","last_undegraded":"2023-11-28T11:58:51.672804+0000","last_fullsized":"2023-11-28T11:58:51.672804+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:47:15.134857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.651256+0000","last_change":"2023-11-28T11:58:51.180506+0000","last_active":"2023-11-28T11:58:51.651256+0000","last_peered":"2023-11-28T11:58:51.651256+0000","last_clean":"2023-11-28T11:58:51.651256+0000","last_became_active":"2023-11-28T11:58:51.180220+0000","last_became_peered":"2023-11-28T11:58:51.180220+0000","last_unstale":"2023-11-28T11:58:51.651256+0000","last_undegraded":"2023-11-28T11:58:51.651256+0000","last_fullsized":"2023-11-28T11:58:51.651256+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:24:42.388320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.676579+0000","last_change":"2023-11-28T11:58:51.670858+0000","last_active":"2023-11-28T11:58:51.676579+0000","last_peered":"2023-11-28T11:58:51.676579+0000","last_clean":"2023-11-28T11:58:51.676579+0000","last_became_active":"2023-11-28T11:58:51.670579+0000","last_became_peered":"2023-11-28T11:58:51.670579+0000","last_unstale":"2023-11-28T11:58:51.676579+0000","last_undegraded":"2023-11-28T11:58:51.676579+0000","last_fullsized":"2023-11-28T11:58:51.676579+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:34.496313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.659691+0000","last_change":"2023-11-28T11:58:51.182985+0000","last_active":"2023-11-28T11:58:51.659691+0000","last_peered":"2023-11-28T11:58:51.659691+0000","last_clean":"2023-11-28T11:58:51.659691+0000","last_became_active":"2023-11-28T11:58:51.182503+0000","last_became_peered":"2023-11-28T11:58:51.182503+0000","last_unstale":"2023-11-28T11:58:51.659691+0000","last_undegraded":"2023-11-28T11:58:51.659691+0000","last_fullsized":"2023-11-28T11:58:51.659691+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:17:03.706968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.686959+0000","last_change":"2023-11-28T11:58:51.684612+0000","last_active":"2023-11-28T11:58:51.686959+0000","last_peered":"2023-11-28T11:58:51.686959+0000","last_clean":"2023-11-28T11:58:51.686959+0000","last_became_active":"2023-11-28T11:58:51.683231+0000","last_became_peered":"2023-11-28T11:58:51.683231+0000","last_unstale":"2023-11-28T11:58:51.686959+0000","last_undegraded":"2023-11-28T11:58:51.686959+0000","last_fullsized":"2023-11-28T11:58:51.686959+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:24:09.557069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"57'1","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.686748+0000","last_change":"2023-11-28T11:58:51.178370+0000","last_active":"2023-11-28T11:58:51.686748+0000","last_peered":"2023-11-28T11:58:51.686748+0000","last_clean":"2023-11-28T11:58:51.686748+0000","last_became_active":"2023-11-28T11:58:51.178104+0000","last_became_peered":"2023-11-28T11:58:51.178104+0000","last_unstale":"2023-11-28T11:58:51.686748+0000","last_undegraded":"2023-11-28T11:58:51.686748+0000","last_fullsized":"2023-11-28T11:58:51.686748+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:46:22.305988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.651755+0000","last_change":"2023-11-28T11:56:34.384408+0000","last_active":"2023-11-28T11:58:51.651755+0000","last_peered":"2023-11-28T11:58:51.651755+0000","last_clean":"2023-11-28T11:58:51.651755+0000","last_became_active":"2023-11-28T11:56:34.384036+0000","last_became_peered":"2023-11-28T11:56:34.384036+0000","last_unstale":"2023-11-28T11:58:51.651755+0000","last_undegraded":"2023-11-28T11:58:51.651755+0000","last_fullsized":"2023-11-28T11:58:51.651755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:58:55.003786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.686028+0000","last_change":"2023-11-28T11:58:51.682343+0000","last_active":"2023-11-28T11:58:51.686028+0000","last_peered":"2023-11-28T11:58:51.686028+0000","last_clean":"2023-11-28T11:58:51.686028+0000","last_became_active":"2023-11-28T11:58:51.682082+0000","last_became_peered":"2023-11-28T11:58:51.682082+0000","last_unstale":"2023-11-28T11:58:51.686028+0000","last_undegraded":"2023-11-28T11:58:51.686028+0000","last_fullsized":"2023-11-28T11:58:51.686028+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:32:19.768923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.647192+0000","last_change":"2023-11-28T11:58:51.191417+0000","last_active":"2023-11-28T11:58:51.647192+0000","last_peered":"2023-11-28T11:58:51.647192+0000","last_clean":"2023-11-28T11:58:51.647192+0000","last_became_active":"2023-11-28T11:58:51.191143+0000","last_became_peered":"2023-11-28T11:58:51.191143+0000","last_unstale":"2023-11-28T11:58:51.647192+0000","last_undegraded":"2023-11-28T11:58:51.647192+0000","last_fullsized":"2023-11-28T11:58:51.647192+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:09:32.828501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.652664+0000","last_change":"2023-11-28T11:56:34.384088+0000","last_active":"2023-11-28T11:58:51.652664+0000","last_peered":"2023-11-28T11:58:51.652664+0000","last_clean":"2023-11-28T11:58:51.652664+0000","last_became_active":"2023-11-28T11:56:34.383631+0000","last_became_peered":"2023-11-28T11:56:34.383631+0000","last_unstale":"2023-11-28T11:58:51.652664+0000","last_undegraded":"2023-11-28T11:58:51.652664+0000","last_fullsized":"2023-11-28T11:58:51.652664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:15:42.772333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.691295+0000","last_change":"2023-11-28T11:58:51.687267+0000","last_active":"2023-11-28T11:58:51.691295+0000","last_peered":"2023-11-28T11:58:51.691295+0000","last_clean":"2023-11-28T11:58:51.691295+0000","last_became_active":"2023-11-28T11:58:51.686986+0000","last_became_peered":"2023-11-28T11:58:51.686986+0000","last_unstale":"2023-11-28T11:58:51.691295+0000","last_undegraded":"2023-11-28T11:58:51.691295+0000","last_fullsized":"2023-11-28T11:58:51.691295+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:17:04.728611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"57'1","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.671316+0000","last_change":"2023-11-28T11:58:51.191624+0000","last_active":"2023-11-28T11:58:51.671316+0000","last_peered":"2023-11-28T11:58:51.671316+0000","last_clean":"2023-11-28T11:58:51.671316+0000","last_became_active":"2023-11-28T11:58:51.191317+0000","last_became_peered":"2023-11-28T11:58:51.191317+0000","last_unstale":"2023-11-28T11:58:51.671316+0000","last_undegraded":"2023-11-28T11:58:51.671316+0000","last_fullsized":"2023-11-28T11:58:51.671316+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:03:48.305566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.663683+0000","last_change":"2023-11-28T11:56:34.386399+0000","last_active":"2023-11-28T11:58:51.663683+0000","last_peered":"2023-11-28T11:58:51.663683+0000","last_clean":"2023-11-28T11:58:51.663683+0000","last_became_active":"2023-11-28T11:56:34.385994+0000","last_became_peered":"2023-11-28T11:56:34.385994+0000","last_unstale":"2023-11-28T11:58:51.663683+0000","last_undegraded":"2023-11-28T11:58:51.663683+0000","last_fullsized":"2023-11-28T11:58:51.663683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:58:02.172295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.686081+0000","last_change":"2023-11-28T11:58:51.681076+0000","last_active":"2023-11-28T11:58:51.686081+0000","last_peered":"2023-11-28T11:58:51.686081+0000","last_clean":"2023-11-28T11:58:51.686081+0000","last_became_active":"2023-11-28T11:58:51.678972+0000","last_became_peered":"2023-11-28T11:58:51.678972+0000","last_unstale":"2023-11-28T11:58:51.686081+0000","last_undegraded":"2023-11-28T11:58:51.686081+0000","last_fullsized":"2023-11-28T11:58:51.686081+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:53:49.319201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"57'2","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.669921+0000","last_change":"2023-11-28T11:58:51.195566+0000","last_active":"2023-11-28T11:58:51.669921+0000","last_peered":"2023-11-28T11:58:51.669921+0000","last_clean":"2023-11-28T11:58:51.669921+0000","last_became_active":"2023-11-28T11:58:51.195183+0000","last_became_peered":"2023-11-28T11:58:51.195183+0000","last_unstale":"2023-11-28T11:58:51.669921+0000","last_undegraded":"2023-11-28T11:58:51.669921+0000","last_fullsized":"2023-11-28T11:58:51.669921+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:58:54.026123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.653001+0000","last_change":"2023-11-28T11:56:34.384999+0000","last_active":"2023-11-28T11:58:51.653001+0000","last_peered":"2023-11-28T11:58:51.653001+0000","last_clean":"2023-11-28T11:58:51.653001+0000","last_became_active":"2023-11-28T11:56:34.384531+0000","last_became_peered":"2023-11-28T11:56:34.384531+0000","last_unstale":"2023-11-28T11:58:51.653001+0000","last_undegraded":"2023-11-28T11:58:51.653001+0000","last_fullsized":"2023-11-28T11:58:51.653001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:09:50.083366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:53.159756+0000","last_change":"2023-11-28T11:58:51.672003+0000","last_active":"2023-11-28T11:58:53.159756+0000","last_peered":"2023-11-28T11:58:53.159756+0000","last_clean":"2023-11-28T11:58:53.159756+0000","last_became_active":"2023-11-28T11:58:51.671750+0000","last_became_peered":"2023-11-28T11:58:51.671750+0000","last_unstale":"2023-11-28T11:58:53.159756+0000","last_undegraded":"2023-11-28T11:58:53.159756+0000","last_fullsized":"2023-11-28T11:58:53.159756+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:17.015788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.666875+0000","last_change":"2023-11-28T11:58:51.181802+0000","last_active":"2023-11-28T11:58:51.666875+0000","last_peered":"2023-11-28T11:58:51.666875+0000","last_clean":"2023-11-28T11:58:51.666875+0000","last_became_active":"2023-11-28T11:58:51.181421+0000","last_became_peered":"2023-11-28T11:58:51.181421+0000","last_unstale":"2023-11-28T11:58:51.666875+0000","last_undegraded":"2023-11-28T11:58:51.666875+0000","last_fullsized":"2023-11-28T11:58:51.666875+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:50:43.770799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.666546+0000","last_change":"2023-11-28T11:56:34.389076+0000","last_active":"2023-11-28T11:58:51.666546+0000","last_peered":"2023-11-28T11:58:51.666546+0000","last_clean":"2023-11-28T11:58:51.666546+0000","last_became_active":"2023-11-28T11:56:34.388689+0000","last_became_peered":"2023-11-28T11:56:34.388689+0000","last_unstale":"2023-11-28T11:58:51.666546+0000","last_undegraded":"2023-11-28T11:58:51.666546+0000","last_fullsized":"2023-11-28T11:58:51.666546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:20.936349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.686102+0000","last_change":"2023-11-28T11:58:51.683273+0000","last_active":"2023-11-28T11:58:51.686102+0000","last_peered":"2023-11-28T11:58:51.686102+0000","last_clean":"2023-11-28T11:58:51.686102+0000","last_became_active":"2023-11-28T11:58:51.682845+0000","last_became_peered":"2023-11-28T11:58:51.682845+0000","last_unstale":"2023-11-28T11:58:51.686102+0000","last_undegraded":"2023-11-28T11:58:51.686102+0000","last_fullsized":"2023-11-28T11:58:51.686102+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:52.015075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"57'2","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.683531+0000","last_change":"2023-11-28T11:58:51.180873+0000","last_active":"2023-11-28T11:58:51.683531+0000","last_peered":"2023-11-28T11:58:51.683531+0000","last_clean":"2023-11-28T11:58:51.683531+0000","last_became_active":"2023-11-28T11:58:51.180551+0000","last_became_peered":"2023-11-28T11:58:51.180551+0000","last_unstale":"2023-11-28T11:58:51.683531+0000","last_undegraded":"2023-11-28T11:58:51.683531+0000","last_fullsized":"2023-11-28T11:58:51.683531+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:50.993432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.654885+0000","last_change":"2023-11-28T11:56:34.486178+0000","last_active":"2023-11-28T11:58:51.654885+0000","last_peered":"2023-11-28T11:58:51.654885+0000","last_clean":"2023-11-28T11:58:51.654885+0000","last_became_active":"2023-11-28T11:56:34.485702+0000","last_became_peered":"2023-11-28T11:56:34.485702+0000","last_unstale":"2023-11-28T11:58:51.654885+0000","last_undegraded":"2023-11-28T11:58:51.654885+0000","last_fullsized":"2023-11-28T11:58:51.654885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:06.323407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T11:58:53.160302+0000","last_change":"2023-11-28T11:58:51.659567+0000","last_active":"2023-11-28T11:58:53.160302+0000","last_peered":"2023-11-28T11:58:53.160302+0000","last_clean":"2023-11-28T11:58:53.160302+0000","last_became_active":"2023-11-28T11:58:51.659303+0000","last_became_peered":"2023-11-28T11:58:51.659303+0000","last_unstale":"2023-11-28T11:58:53.160302+0000","last_undegraded":"2023-11-28T11:58:53.160302+0000","last_fullsized":"2023-11-28T11:58:53.160302+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:00:36.435208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.651423+0000","last_change":"2023-11-28T11:58:51.193563+0000","last_active":"2023-11-28T11:58:51.651423+0000","last_peered":"2023-11-28T11:58:51.651423+0000","last_clean":"2023-11-28T11:58:51.651423+0000","last_became_active":"2023-11-28T11:58:51.193283+0000","last_became_peered":"2023-11-28T11:58:51.193283+0000","last_unstale":"2023-11-28T11:58:51.651423+0000","last_undegraded":"2023-11-28T11:58:51.651423+0000","last_fullsized":"2023-11-28T11:58:51.651423+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:36:54.633765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":42,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.660188+0000","last_change":"2023-11-28T11:56:34.387293+0000","last_active":"2023-11-28T11:58:51.660188+0000","last_peered":"2023-11-28T11:58:51.660188+0000","last_clean":"2023-11-28T11:58:51.660188+0000","last_became_active":"2023-11-28T11:56:34.386976+0000","last_became_peered":"2023-11-28T11:56:34.386976+0000","last_unstale":"2023-11-28T11:58:51.660188+0000","last_undegraded":"2023-11-28T11:58:51.660188+0000","last_fullsized":"2023-11-28T11:58:51.660188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:32.704729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.676255+0000","last_change":"2023-11-28T11:58:51.668369+0000","last_active":"2023-11-28T11:58:51.676255+0000","last_peered":"2023-11-28T11:58:51.676255+0000","last_clean":"2023-11-28T11:58:51.676255+0000","last_became_active":"2023-11-28T11:58:51.668072+0000","last_became_peered":"2023-11-28T11:58:51.668072+0000","last_unstale":"2023-11-28T11:58:51.676255+0000","last_undegraded":"2023-11-28T11:58:51.676255+0000","last_fullsized":"2023-11-28T11:58:51.676255+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:51.137570+0000","last_clean_scrub_stamp":"2023-11-28T11:58:51.137570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:05:51.844750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.653748+0000","last_change":"2023-11-28T11:58:51.174291+0000","last_active":"2023-11-28T11:58:51.653748+0000","last_peered":"2023-11-28T11:58:51.653748+0000","last_clean":"2023-11-28T11:58:51.653748+0000","last_became_active":"2023-11-28T11:58:51.173714+0000","last_became_peered":"2023-11-28T11:58:51.173714+0000","last_unstale":"2023-11-28T11:58:51.653748+0000","last_undegraded":"2023-11-28T11:58:51.653748+0000","last_fullsized":"2023-11-28T11:58:51.653748+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:58:50.115927+0000","last_clean_scrub_stamp":"2023-11-28T11:58:50.115927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:31:55.668938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.669565+0000","last_change":"2023-11-28T11:56:34.389222+0000","last_active":"2023-11-28T11:58:51.669565+0000","last_peered":"2023-11-28T11:58:51.669565+0000","last_clean":"2023-11-28T11:58:51.669565+0000","last_became_active":"2023-11-28T11:56:34.388671+0000","last_became_peered":"2023-11-28T11:56:34.388671+0000","last_unstale":"2023-11-28T11:58:51.669565+0000","last_undegraded":"2023-11-28T11:58:51.669565+0000","last_fullsized":"2023-11-28T11:58:51.669565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:32.704729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":195,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-28T11:58:51.660266+0000","last_change":"2023-11-28T11:56:28.472008+0000","last_active":"2023-11-28T11:58:51.660266+0000","last_peered":"2023-11-28T11:58:51.660266+0000","last_clean":"2023-11-28T11:58:51.660266+0000","last_became_active":"2023-11-28T11:56:28.469273+0000","last_became_peered":"2023-11-28T11:56:28.469273+0000","last_unstale":"2023-11-28T11:58:51.660266+0000","last_undegraded":"2023-11-28T11:58:51.660266+0000","last_fullsized":"2023-11-28T11:58:51.660266+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:27.291192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:27.291192+0000","last_clean_scrub_stamp":"2023-11-28T11:56:27.291192+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:14:48.860420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509473,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14512,"kb_used_data":1256,"kb_used_omap":0,"kb_used_meta":13248,"kb_avail":94357328,"statfs":{"total":96636764160,"available":96621903872,"internally_reserved":0,"allocated":1286144,"data_stored":905261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13565952},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.0780000000000001,"15min":1.093},"min":{"1min":0.63,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.357,"5min":1.468,"15min":1.468},"last":1.29},{"interface":"front","average":{"1min":1.083,"5min":1.079,"15min":1.0780000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.4830000000000001,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.96599999999999997}]},{"osd":1,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1879999999999999,"15min":1.202},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.339,"5min":1.71,"15min":1.71},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.1739999999999999,"15min":1.1799999999999999},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.4410000000000001,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.351}]},{"osd":2,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1779999999999999,"15min":1.1859999999999999},"min":{"1min":0.83299999999999996,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.409,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2669999999999999,"15min":1.28},"min":{"1min":0.78400000000000003,"5min":0.749,"15min":0.749},"max":{"1min":1.5209999999999999,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.82399999999999995}]},{"osd":3,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.302,"15min":1.3160000000000001},"min":{"1min":0.872,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.5249999999999999,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.345,"15min":1.357},"min":{"1min":1.0169999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.5980000000000001,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.4750000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.272,"15min":1.3029999999999999},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.5609999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.143,"5min":1.3129999999999999,"15min":1.341},"min":{"1min":0.80800000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.4350000000000001,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.1160000000000001}]},{"osd":5,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.409,"15min":1.4390000000000001},"min":{"1min":0.876,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.595,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.379},{"interface":"front","average":{"1min":1.202,"5min":1.369,"15min":1.397},"min":{"1min":0.96899999999999997,"5min":0.872,"15min":0.872},"max":{"1min":1.454,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":1.4319999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.532,"15min":1.5600000000000001},"min":{"1min":1.075,"5min":1.075,"15min":1.075},"max":{"1min":1.633,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.516},{"interface":"front","average":{"1min":1.278,"5min":1.431,"15min":1.4570000000000001},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.53,"5min":2.468,"15min":2.468},"last":1.5920000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509473,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9252,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362588,"statfs":{"total":96636764160,"available":96627290112,"internally_reserved":0,"allocated":684032,"data_stored":314733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":0.997,"15min":0.99099999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.716,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.101,"5min":1.1870000000000001,"15min":1.2010000000000001},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.5569999999999999,"5min":2.347,"15min":2.347},"last":1.087}]},{"osd":1,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.175,"15min":1.1759999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.5249999999999999,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.117,"5min":1.165,"15min":1.173},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4239999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":1.1919999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.224,"15min":1.25},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4830000000000001,"5min":3.9620000000000002,"15min":3.9620000000000002},"last":1.343},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1679999999999999,"15min":1.169},"min":{"1min":0.91200000000000003,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.3759999999999999,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":1.2629999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2689999999999999,"15min":1.264},"min":{"1min":0.96699999999999997,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.258,"5min":1.27,"15min":1.272},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.645,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.5209999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.2230000000000001,"15min":1.238},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.4490000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.411},{"interface":"front","average":{"1min":1.286,"5min":1.4510000000000001,"15min":1.4790000000000001},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.7250000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.4350000000000001}]},{"osd":5,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.2589999999999999,"15min":1.2769999999999999},"min":{"1min":0.93500000000000005,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.4730000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.266,"15min":1.278},"min":{"1min":0.84399999999999997,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.4850000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.3340000000000001,"15min":1.3400000000000001},"min":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.6040000000000001},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3540000000000001,"15min":1.3580000000000001},"min":{"1min":1.0349999999999999,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":1.8939999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.55}]}]},{"osd":5,"up_from":15,"seq":64424509473,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9196,"kb_used_data":676,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362644,"statfs":{"total":96636764160,"available":96627347456,"internally_reserved":0,"allocated":692224,"data_stored":315369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0820000000000001,"15min":1.0880000000000001},"min":{"1min":0.76400000000000001,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.365,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.298},{"interface":"front","average":{"1min":1.109,"5min":1.085,"15min":1.081},"min":{"1min":0.72899999999999998,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.552,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.05}]},{"osd":1,"last update":"Tue Nov 28 11:58:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1439999999999999,"15min":1.1499999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.72,"5min":1.843,"15min":1.843},"last":1.48},{"interface":"front","average":{"1min":1.069,"5min":1.085,"15min":1.0880000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.98699999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:58:33 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.163,"15min":1.165},"min":{"1min":0.83899999999999997,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.4630000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.2,"15min":1.2},"min":{"1min":0.82999999999999996,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.1779999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:58:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.2609999999999999,"15min":1.276},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.5880000000000001,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.5649999999999999},{"interface":"front","average":{"1min":1.258,"5min":1.3759999999999999,"15min":1.3959999999999999},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.623,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.4390000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:58:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.206,"15min":1.22},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.54,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.2310000000000001,"15min":1.2350000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.5209999999999999,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.423}]},{"osd":6,"last update":"Tue Nov 28 11:58:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.276,"15min":1.278},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.28,"5min":1.2849999999999999,"15min":1.286},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":1.675,"5min":1.704,"15min":1.704},"last":1.2170000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:58:33 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.359,"15min":1.365},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.7030000000000001,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.468,"15min":1.4790000000000001},"min":{"1min":1.002,"5min":1.002,"15min":1.002},"max":{"1min":1.78,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.379}]}]},{"osd":4,"up_from":15,"seq":64424509473,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9392,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362448,"statfs":{"total":96636764160,"available":96627146752,"internally_reserved":0,"allocated":696320,"data_stored":316281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.113,"15min":1.111},"min":{"1min":0.67400000000000004,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.474,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.032},{"interface":"front","average":{"1min":1.105,"5min":1.153,"15min":1.161},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.78,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.224}]},{"osd":1,"last update":"Tue Nov 28 11:58:32 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.1899999999999999,"15min":1.214},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.351,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.107,"5min":1.1910000000000001,"15min":1.2050000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.502,"5min":2.8860000000000001,"15min":2.8860000000000001},"last":1.2849999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:58:32 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.228,"15min":1.2450000000000001},"min":{"1min":0.72299999999999998,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.6020000000000001,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.24,"5min":1.391,"15min":1.4159999999999999},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.6379999999999999,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":1.4490000000000001}]},{"osd":3,"last update":"Tue Nov 28 11:58:32 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.3080000000000001,"15min":1.325},"min":{"1min":0.76500000000000001,"5min":0.746,"15min":0.746},"max":{"1min":1.8320000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.421},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.367,"15min":1.377},"min":{"1min":0.99299999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.5700000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.472}]},{"osd":5,"last update":"Tue Nov 28 11:58:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.409,"15min":1.446},"min":{"1min":0.85599999999999998,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.5680000000000001,"5min":2.972,"15min":2.972},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.335,"15min":1.3660000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.4470000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.325}]},{"osd":6,"last update":"Tue Nov 28 11:58:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.3839999999999999,"15min":1.4139999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.7509999999999999,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.5289999999999999,"15min":1.5549999999999999},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":1.804,"5min":3.133,"15min":3.133},"last":1.3480000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:58:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.494,"15min":1.53},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.7110000000000001,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.373,"5min":1.5649999999999999,"15min":1.597},"min":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"max":{"1min":1.7230000000000001,"5min":2.198,"15min":2.198},"last":1.5489999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509473,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9388,"kb_used_data":676,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362452,"statfs":{"total":96636764160,"available":96627150848,"internally_reserved":0,"allocated":692224,"data_stored":314789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.53500000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.2689999999999999,"5min":1.478,"15min":1.478},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.63200000000000001,"5min":0.37,"15min":0.37},"max":{"1min":1.349,"5min":2.177,"15min":2.177},"last":0.748}]},{"osd":1,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.85599999999999998,"15min":0.86199999999999999},"min":{"1min":0.50600000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.087,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.056,"15min":1.0640000000000001},"min":{"1min":0.72899999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3280000000000001,"5min":1.968,"15min":1.968},"last":0.91100000000000003}]},{"osd":2,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.1279999999999999,"15min":1.1459999999999999},"min":{"1min":0.71799999999999997,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.413,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.276},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.194,"15min":1.2150000000000001},"min":{"1min":0.85799999999999998,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.423,"5min":2.093,"15min":2.093},"last":1.3140000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.171,"15min":1.177},"min":{"1min":0.85299999999999998,"5min":0.75,"15min":0.75},"max":{"1min":1.5469999999999999,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.325,"15min":1.343},"min":{"1min":1.032,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.514,"5min":2.8439999999999999,"15min":2.8439999999999999},"last":1.3600000000000001}]},{"osd":5,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.3480000000000001,"15min":1.367},"min":{"1min":1.0089999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.4450000000000001,"5min":2.9670000000000001,"15min":2.9670000000000001},"last":1.466},{"interface":"front","average":{"1min":1.29,"5min":1.431,"15min":1.4550000000000001},"min":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"max":{"1min":1.736,"5min":3.7429999999999999,"15min":3.7429999999999999},"last":1.3859999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.3460000000000001,"15min":1.355},"min":{"1min":0.91500000000000004,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.907,"5min":2.323,"15min":2.323},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.4350000000000001,"15min":1.4530000000000001},"min":{"1min":1.1930000000000001,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.506,"5min":2.927,"15min":2.927},"last":1.425}]},{"osd":7,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4970000000000001,"15min":1.5109999999999999},"min":{"1min":1.1399999999999999,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.8440000000000001,"5min":3.5030000000000001,"15min":3.5030000000000001},"last":1.415},{"interface":"front","average":{"1min":1.377,"5min":1.468,"15min":1.4830000000000001},"min":{"1min":1.0980000000000001,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":1.778,"5min":2.6320000000000001,"15min":2.6320000000000001},"last":1.0720000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509473,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9256,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362584,"statfs":{"total":96636764160,"available":96627286016,"internally_reserved":0,"allocated":688128,"data_stored":314823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.92800000000000005,"15min":0.94599999999999995},"min":{"1min":0.61099999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.1160000000000001,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":1.044},{"interface":"front","average":{"1min":1.014,"5min":1.006,"15min":1.0049999999999999},"min":{"1min":0.44400000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.6100000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.94999999999999996}]},{"osd":2,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.087,"15min":1.089},"min":{"1min":0.57599999999999996,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.49,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":1.496},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.1020000000000001,"15min":1.105},"min":{"1min":0.67200000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.6899999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.204}]},{"osd":3,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.202,"15min":1.208},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.6180000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.1519999999999999,"15min":1.177},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.734,"5min":1.8,"15min":1.8},"last":1.2470000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.3660000000000001,"15min":1.3759999999999999},"min":{"1min":0.95099999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.8109999999999999,"5min":3.411,"15min":3.411},"last":1.639},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.331,"15min":1.349},"min":{"1min":0.90600000000000003,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.9039999999999999,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":1.7969999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.417,"15min":1.4350000000000001},"min":{"1min":0.91100000000000003,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.0129999999999999,"5min":3.6869999999999998,"15min":3.6869999999999998},"last":1.9039999999999999},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.3169999999999999,"15min":1.3300000000000001},"min":{"1min":0.91800000000000004,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.5269999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.3799999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.444,"15min":1.462},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.0569999999999999,"5min":3.5379999999999998,"15min":3.5379999999999998},"last":1.8899999999999999},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.472,"15min":1.498},"min":{"1min":1.1359999999999999,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.673,"5min":2.5739999999999998,"15min":2.5739999999999998},"last":2.0259999999999998}]},{"osd":7,"last update":"Tue Nov 28 11:58:29 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.464,"15min":1.4810000000000001},"min":{"1min":1.1080000000000001,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.7410000000000001,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.9490000000000001},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.5029999999999999,"15min":1.5229999999999999},"min":{"1min":0.86799999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.8680000000000001,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.986}]}]},{"osd":2,"up_from":14,"seq":60129542177,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9196,"kb_used_data":676,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362644,"statfs":{"total":96636764160,"available":96627347456,"internally_reserved":0,"allocated":692224,"data_stored":314789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:25 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.85799999999999998,"15min":0.86799999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.093,"5min":1.722,"15min":1.722},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.95099999999999996,"5min":1,"15min":1.008},"min":{"1min":0.63900000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.9850000000000001,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":0.79300000000000004}]},{"osd":1,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":1.018,"15min":1.03},"min":{"1min":0.56200000000000006,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.286,"5min":1.754,"15min":1.754},"last":1.246},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.93000000000000005,"15min":0.93999999999999995},"min":{"1min":0.56599999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1850000000000001,"5min":1.484,"15min":1.484},"last":0.627}]},{"osd":3,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.123,"15min":1.133},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.526,"5min":2.048,"15min":2.048},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.28,"15min":1.2929999999999999},"min":{"1min":0.78900000000000003,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.583,"5min":2.617,"15min":2.617},"last":1.079}]},{"osd":4,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.3620000000000001,"15min":1.385},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.6919999999999999,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":1.204},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.2470000000000001,"15min":1.2549999999999999},"min":{"1min":0.85899999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.4930000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":1.0569999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.335,"15min":1.351},"min":{"1min":1.032,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.623,"5min":2.738,"15min":2.738},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.272,"5min":1.514,"15min":1.554},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.7230000000000001,"5min":4.0309999999999997,"15min":4.0309999999999997},"last":1.2669999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.583,"15min":1.611},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.9299999999999999,"5min":4.2240000000000002,"15min":4.2240000000000002},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.335,"5min":1.5169999999999999,"15min":1.5469999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.7709999999999999,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":1.2849999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:58:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.4379999999999999,"15min":1.4570000000000001},"min":{"1min":1.056,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.6359999999999999,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.139},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.6399999999999999,"15min":1.669},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.8799999999999999,"5min":4.3570000000000002,"15min":4.3570000000000002},"last":1.327}]}]},{"osd":0,"up_from":14,"seq":60129542177,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10484,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":9216,"kb_avail":94361356,"statfs":{"total":96636764160,"available":96626028544,"internally_reserved":0,"allocated":1290240,"data_stored":906296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9437184},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.86899999999999999,"15min":0.878},"min":{"1min":0.52700000000000002,"5min":0.439,"15min":0.439},"max":{"1min":1.1359999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.997,"15min":1.0109999999999999},"min":{"1min":0.64500000000000002,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.4079999999999999,"5min":1.7,"15min":1.7},"last":0.46400000000000002}]},{"osd":2,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.042,"15min":1.052},"min":{"1min":0.61599999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.282,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.92200000000000004,"15min":0.92400000000000004},"min":{"1min":0.61199999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.59399999999999997}]},{"osd":3,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.0640000000000001,"15min":1.0760000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.218,"5min":1.238,"15min":1.2410000000000001},"min":{"1min":0.80200000000000005,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.8089999999999999,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.0129999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.3300000000000001,"15min":1.3440000000000001},"min":{"1min":0.89200000000000002,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.8100000000000001,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.234,"5min":1.377,"15min":1.401},"min":{"1min":0.86799999999999999,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.758,"5min":3.1629999999999998,"15min":3.1629999999999998},"last":1.1679999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.361,"15min":1.363},"min":{"1min":0.871,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":2.1739999999999999,"5min":2.23,"15min":2.23},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.298,"5min":1.4019999999999999,"15min":1.4199999999999999},"min":{"1min":0.89500000000000002,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.845,"5min":2.266,"15min":2.266},"last":1.27}]},{"osd":6,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.498,"15min":1.516},"min":{"1min":0.93300000000000005,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.9490000000000001,"5min":2.4060000000000001,"15min":2.4060000000000001},"last":1.073},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.4830000000000001,"15min":1.5},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.7969999999999999,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":1.389}]},{"osd":7,"last update":"Tue Nov 28 11:58:30 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.5109999999999999,"15min":1.5209999999999999},"min":{"1min":1.1439999999999999,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":2.0600000000000001,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.21},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.554,"15min":1.573},"min":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":2.3029999999999999,"5min":2.6040000000000001,"15min":2.6040000000000001},"last":1.2390000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:59:01.369 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T11:59:01.369 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2023-11-28T11:59:01.596 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.591+0000 7fc117fff700 1 Processor -- start 2023-11-28T11:59:01.597 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.591+0000 7fc117fff700 1 -- start start 2023-11-28T11:59:01.597 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.595+0000 7fc117fff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc11815cfd0 0x7fc1180ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:01.598 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.595+0000 7fc117fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1180cc130 0x7fc118158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:01.598 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.595+0000 7fc117fff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc11815c2a0 con 0x7fc11806ff10 2023-11-28T11:59:01.598 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.595+0000 7fc117fff700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1180cc680 con 0x7fc11815cfd0 2023-11-28T11:59:01.598 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.595+0000 7fc117fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11815c4f0 con 0x7fc1180cc130 2023-11-28T11:59:01.598 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.595+0000 7fc1167fc700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc11815cfd0 0x7fc1180ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:01.598 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.595+0000 7fc116ffd700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fc11806ff10 0x7fc1180702e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:53120/0 (socket says 172.21.15.39:53120) 2023-11-28T11:59:01.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.595+0000 7fc116ffd700 1 -- 172.21.15.39:0/3071374828 learned_addr learned my addr 172.21.15.39:0/3071374828 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:59:01.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.595+0000 7fc1177fe700 1 --2- 172.21.15.39:0/3071374828 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1180cc130 0x7fc118158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:01.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.595+0000 7fc115ffb700 1 -- 172.21.15.39:0/3071374828 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3139713244 0 0) 0x7fc11815c2a0 con 0x7fc11806ff10 2023-11-28T11:59:01.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.595+0000 7fc115ffb700 1 -- 172.21.15.39:0/3071374828 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1000035d0 con 0x7fc11806ff10 2023-11-28T11:59:01.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.595+0000 7fc1167fc700 1 -- 172.21.15.39:0/3071374828 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1180cc130 msgr2=0x7fc118158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:01.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.595+0000 7fc1167fc700 1 --2- 172.21.15.39:0/3071374828 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1180cc130 0x7fc118158ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:01.600 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.595+0000 7fc1167fc700 1 -- 172.21.15.39:0/3071374828 >> v1:172.21.15.184:6789/0 conn(0x7fc11806ff10 legacy=0x7fc1180702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:01.600 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.595+0000 7fc1167fc700 1 -- 172.21.15.39:0/3071374828 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11815c7d0 con 0x7fc11815cfd0 2023-11-28T11:59:01.600 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.595+0000 7fc1167fc700 1 --2- 172.21.15.39:0/3071374828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc11815cfd0 0x7fc1180ccb40 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc10c00a9f0 tx=0x7fc10c00ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f24340f871b9e39 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:01.600 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.599+0000 7fc115ffb700 1 -- 172.21.15.39:0/3071374828 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c00cb70 con 0x7fc11815cfd0 2023-11-28T11:59:01.600 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.599+0000 7fc115ffb700 1 -- 172.21.15.39:0/3071374828 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10c00ae90 con 0x7fc11815cfd0 2023-11-28T11:59:01.601 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.599+0000 7fc115ffb700 1 -- 172.21.15.39:0/3071374828 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c018400 con 0x7fc11815cfd0 2023-11-28T11:59:01.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.599+0000 7fc117fff700 1 -- 172.21.15.39:0/3071374828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc11815cfd0 msgr2=0x7fc1180ccb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:01.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.599+0000 7fc117fff700 1 --2- 172.21.15.39:0/3071374828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc11815cfd0 0x7fc1180ccb40 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc10c00a9f0 tx=0x7fc10c00ad00 comp rx=0 tx=0).stop 2023-11-28T11:59:01.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.599+0000 7fc117fff700 1 -- 172.21.15.39:0/3071374828 shutdown_connections 2023-11-28T11:59:01.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.599+0000 7fc117fff700 1 --2- 172.21.15.39:0/3071374828 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1180cc130 0x7fc118158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:01.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.599+0000 7fc117fff700 1 --2- 172.21.15.39:0/3071374828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc11815cfd0 0x7fc1180ccb40 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:01.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.599+0000 7fc117fff700 1 -- 172.21.15.39:0/3071374828 >> 172.21.15.39:0/3071374828 conn(0x7fc1180cf280 msgr2=0x7fc1180cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:01.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.599+0000 7fc117fff700 1 -- 172.21.15.39:0/3071374828 shutdown_connections 2023-11-28T11:59:01.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.599+0000 7fc117fff700 1 -- 172.21.15.39:0/3071374828 wait complete. 2023-11-28T11:59:01.604 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.599+0000 7fc117fff700 1 Processor -- start 2023-11-28T11:59:01.604 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.603+0000 7fc117fff700 1 -- start start 2023-11-28T11:59:01.608 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.603+0000 7fc117fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc11806ff10 0x7fc1181597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:01.608 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.603+0000 7fc117fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1180cc130 0x7fc118151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:01.608 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.603+0000 7fc117fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc11815cfd0 0x7fc1181f1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:01.608 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.603+0000 7fc117fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11815aac0 con 0x7fc1180cc130 2023-11-28T11:59:01.608 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.603+0000 7fc117fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc118159eb0 con 0x7fc11806ff10 2023-11-28T11:59:01.608 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.603+0000 7fc117fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11815a190 con 0x7fc11815cfd0 2023-11-28T11:59:01.608 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.603+0000 7fc1167fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1180cc130 0x7fc118151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:01.608 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.603+0000 7fc1167fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1180cc130 0x7fc118151ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55556/0 (socket says 172.21.15.39:55556) 2023-11-28T11:59:01.608 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.603+0000 7fc1167fc700 1 -- 172.21.15.39:0/2584319419 learned_addr learned my addr 172.21.15.39:0/2584319419 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:01.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.603+0000 7fc116ffd700 1 --2- 172.21.15.39:0/2584319419 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc11806ff10 0x7fc1181597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:01.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.603+0000 7fc1177fe700 1 --2- 172.21.15.39:0/2584319419 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc11815cfd0 0x7fc1181f1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:01.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.603+0000 7fc1167fc700 1 -- 172.21.15.39:0/2584319419 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc11815cfd0 msgr2=0x7fc1181f1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:01.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.603+0000 7fc1167fc700 1 --2- 172.21.15.39:0/2584319419 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc11815cfd0 0x7fc1181f1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:01.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.603+0000 7fc1167fc700 1 -- 172.21.15.39:0/2584319419 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc11806ff10 msgr2=0x7fc1181597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:01.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.603+0000 7fc1167fc700 1 --2- 172.21.15.39:0/2584319419 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc11806ff10 0x7fc1181597b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:01.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.603+0000 7fc1167fc700 1 -- 172.21.15.39:0/2584319419 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10c00a650 con 0x7fc1180cc130 2023-11-28T11:59:01.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.603+0000 7fc1177fe700 1 --2- 172.21.15.39:0/2584319419 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc11815cfd0 0x7fc1181f1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:01.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.603+0000 7fc1167fc700 1 --2- 172.21.15.39:0/2584319419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1180cc130 0x7fc118151ad0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc10c00ad40 tx=0x7fc10c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:01.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.603+0000 7fc0fffff700 1 -- 172.21.15.39:0/2584319419 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c0038c0 con 0x7fc1180cc130 2023-11-28T11:59:01.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.603+0000 7fc0fffff700 1 -- 172.21.15.39:0/2584319419 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10c003a20 con 0x7fc1180cc130 2023-11-28T11:59:01.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.603+0000 7fc117fff700 1 -- 172.21.15.39:0/2584319419 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1180cd080 con 0x7fc1180cc130 2023-11-28T11:59:01.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.603+0000 7fc0fffff700 1 -- 172.21.15.39:0/2584319419 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c003dd0 con 0x7fc1180cc130 2023-11-28T11:59:01.610 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.607+0000 7fc117fff700 1 -- 172.21.15.39:0/2584319419 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc11815cab0 con 0x7fc1180cc130 2023-11-28T11:59:01.610 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.607+0000 7fc117fff700 1 -- 172.21.15.39:0/2584319419 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1180cb780 con 0x7fc1180cc130 2023-11-28T11:59:01.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.607+0000 7fc0fffff700 1 -- 172.21.15.39:0/2584319419 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc10c00e040 con 0x7fc1180cc130 2023-11-28T11:59:01.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.611+0000 7fc0fffff700 1 --2- 172.21.15.39:0/2584319419 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc104064ee0 0x7fc104067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:01.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.611+0000 7fc0fffff700 1 -- 172.21.15.39:0/2584319419 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc10c0833a0 con 0x7fc1180cc130 2023-11-28T11:59:01.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.611+0000 7fc116ffd700 1 --2- 172.21.15.39:0/2584319419 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc104064ee0 0x7fc104067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:01.615 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.611+0000 7fc116ffd700 1 --2- 172.21.15.39:0/2584319419 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc104064ee0 0x7fc104067390 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc108007fd0 tx=0x7fc108007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:01.620 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.615+0000 7fc0fffff700 1 -- 172.21.15.39:0/2584319419 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc10c051400 con 0x7fc1180cc130 2023-11-28T11:59:01.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.847+0000 7fc117fff700 1 -- 172.21.15.39:0/2584319419 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7fc118073cb0 con 0x7fc1180cc130 2023-11-28T11:59:01.861 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.859+0000 7fc0fffff700 1 -- 172.21.15.39:0/2584319419 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 184+0+0 (secure 0 0 0) 0x7fc10c054a20 con 0x7fc1180cc130 2023-11-28T11:59:01.865 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.863+0000 7fc117fff700 1 -- 172.21.15.39:0/2584319419 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc104064ee0 msgr2=0x7fc104067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:01.865 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.863+0000 7fc117fff700 1 --2- 172.21.15.39:0/2584319419 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc104064ee0 0x7fc104067390 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc108007fd0 tx=0x7fc108007de0 comp rx=0 tx=0).stop 2023-11-28T11:59:01.865 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.863+0000 7fc117fff700 1 -- 172.21.15.39:0/2584319419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1180cc130 msgr2=0x7fc118151ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:01.865 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.863+0000 7fc117fff700 1 --2- 172.21.15.39:0/2584319419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1180cc130 0x7fc118151ad0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc10c00ad40 tx=0x7fc10c004770 comp rx=0 tx=0).stop 2023-11-28T11:59:01.865 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.863+0000 7fc117fff700 1 -- 172.21.15.39:0/2584319419 shutdown_connections 2023-11-28T11:59:01.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.863+0000 7fc117fff700 1 --2- 172.21.15.39:0/2584319419 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc11815cfd0 0x7fc1181f1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:01.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.863+0000 7fc117fff700 1 --2- 172.21.15.39:0/2584319419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1180cc130 0x7fc118151ad0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:01.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.863+0000 7fc117fff700 1 --2- 172.21.15.39:0/2584319419 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc104064ee0 0x7fc104067390 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:01.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.863+0000 7fc117fff700 1 --2- 172.21.15.39:0/2584319419 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc11806ff10 0x7fc1181597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:01.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.863+0000 7fc117fff700 1 -- 172.21.15.39:0/2584319419 >> 172.21.15.39:0/2584319419 conn(0x7fc1180cf280 msgr2=0x7fc11806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:01.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.863+0000 7fc117fff700 1 -- 172.21.15.39:0/2584319419 shutdown_connections 2023-11-28T11:59:01.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:01.863+0000 7fc117fff700 1 -- 172.21.15.39:0/2584319419 wait complete. 2023-11-28T11:59:01.868 INFO:teuthology.orchestra.run.smithi039.stderr:updated caps for client.0 2023-11-28T11:59:01.889 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:59:02.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.071+0000 7fdd1ecaa700 1 Processor -- start 2023-11-28T11:59:02.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.071+0000 7fdd1ecaa700 1 -- start start 2023-11-28T11:59:02.076 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.071+0000 7fdd1ecaa700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd180cdfb0 0x7fdd1806cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:02.076 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.071+0000 7fdd1ecaa700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fdd1806d2f0 0x7fdd1806a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:02.076 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.071+0000 7fdd1ecaa700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd18164080 con 0x7fdd18163cb0 2023-11-28T11:59:02.076 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.071+0000 7fdd1ecaa700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd180cc290 con 0x7fdd1806d2f0 2023-11-28T11:59:02.076 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.071+0000 7fdd1ecaa700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1806d770 con 0x7fdd180cdfb0 2023-11-28T11:59:02.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.075+0000 7fdd1d247700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fdd1806d2f0 0x7fdd1806a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:02.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.075+0000 7fdd1d247700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fdd1806d2f0 0x7fdd1806a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:41596/0 (socket says 172.21.15.39:41596) 2023-11-28T11:59:02.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.075+0000 7fdd1d247700 1 -- 172.21.15.39:0/510260578 learned_addr learned my addr 172.21.15.39:0/510260578 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:02.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.075+0000 7fdd0ffff700 1 --2- 172.21.15.39:0/510260578 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd180cdfb0 0x7fdd1806cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:02.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.075+0000 7fdd1d247700 1 -- 172.21.15.39:0/510260578 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd180cdfb0 msgr2=0x7fdd1806cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:02.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.075+0000 7fdd1d247700 1 --2- 172.21.15.39:0/510260578 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd180cdfb0 0x7fdd1806cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:02.078 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.075+0000 7fdd1d247700 1 -- 172.21.15.39:0/510260578 >> v1:172.21.15.184:6789/0 conn(0x7fdd18163cb0 legacy=0x7fdd18164cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:02.078 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.075+0000 7fdd1d247700 1 -- 172.21.15.39:0/510260578 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd18069bf0 con 0x7fdd1806d2f0 2023-11-28T11:59:02.078 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.075+0000 7fdd1d247700 1 --2- 172.21.15.39:0/510260578 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd1806d2f0 0x7fdd1806a640 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fdd10009940 tx=0x7fdd10009c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9aa6c27589b8c0a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:02.078 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.075+0000 7fdd0f7fe700 1 -- 172.21.15.39:0/510260578 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd10011830 con 0x7fdd1806d2f0 2023-11-28T11:59:02.078 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.075+0000 7fdd0f7fe700 1 -- 172.21.15.39:0/510260578 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd10011990 con 0x7fdd1806d2f0 2023-11-28T11:59:02.079 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.075+0000 7fdd0f7fe700 1 -- 172.21.15.39:0/510260578 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd10011d20 con 0x7fdd1806d2f0 2023-11-28T11:59:02.079 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.075+0000 7fdd1ecaa700 1 -- 172.21.15.39:0/510260578 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd1806d2f0 msgr2=0x7fdd1806a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:02.080 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.075+0000 7fdd1ecaa700 1 --2- 172.21.15.39:0/510260578 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd1806d2f0 0x7fdd1806a640 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fdd10009940 tx=0x7fdd10009c50 comp rx=0 tx=0).stop 2023-11-28T11:59:02.081 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.075+0000 7fdd1ecaa700 1 -- 172.21.15.39:0/510260578 shutdown_connections 2023-11-28T11:59:02.081 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.075+0000 7fdd1ecaa700 1 --2- 172.21.15.39:0/510260578 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd1806d2f0 0x7fdd1806a640 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:02.081 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.075+0000 7fdd1ecaa700 1 --2- 172.21.15.39:0/510260578 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd180cdfb0 0x7fdd1806cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:02.081 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.075+0000 7fdd1ecaa700 1 -- 172.21.15.39:0/510260578 >> 172.21.15.39:0/510260578 conn(0x7fdd180cf350 msgr2=0x7fdd180b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:02.081 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.079+0000 7fdd1ecaa700 1 -- 172.21.15.39:0/510260578 shutdown_connections 2023-11-28T11:59:02.081 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.079+0000 7fdd1ecaa700 1 -- 172.21.15.39:0/510260578 wait complete. 2023-11-28T11:59:02.082 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.079+0000 7fdd1ecaa700 1 Processor -- start 2023-11-28T11:59:02.082 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.079+0000 7fdd1ecaa700 1 -- start start 2023-11-28T11:59:02.085 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.083+0000 7fdd1ecaa700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd1806d2f0 0x7fdd1815bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:02.085 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.083+0000 7fdd1ecaa700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd180cdfb0 0x7fdd180c48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:02.085 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.083+0000 7fdd1ecaa700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd18163cb0 0x7fdd180ae530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:02.085 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.083+0000 7fdd1ecaa700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1815c1e0 con 0x7fdd1806d2f0 2023-11-28T11:59:02.086 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.083+0000 7fdd1ecaa700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd180b2570 con 0x7fdd18163cb0 2023-11-28T11:59:02.086 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.083+0000 7fdd1ecaa700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd180b19f0 con 0x7fdd180cdfb0 2023-11-28T11:59:02.086 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.083+0000 7fdd1ca46700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd1806d2f0 0x7fdd1815bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:02.086 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.083+0000 7fdd1ca46700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd1806d2f0 0x7fdd1815bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55568/0 (socket says 172.21.15.39:55568) 2023-11-28T11:59:02.086 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.083+0000 7fdd1ca46700 1 -- 172.21.15.39:0/1904948279 learned_addr learned my addr 172.21.15.39:0/1904948279 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:02.087 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.083+0000 7fdd0ffff700 1 --2- 172.21.15.39:0/1904948279 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd180cdfb0 0x7fdd180c48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:02.087 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.083+0000 7fdd1d247700 1 --2- 172.21.15.39:0/1904948279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd18163cb0 0x7fdd180ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:02.087 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.083+0000 7fdd1ca46700 1 -- 172.21.15.39:0/1904948279 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd180cdfb0 msgr2=0x7fdd180c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:02.087 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.083+0000 7fdd1ca46700 1 --2- 172.21.15.39:0/1904948279 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd180cdfb0 0x7fdd180c48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:02.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.083+0000 7fdd1ca46700 1 -- 172.21.15.39:0/1904948279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd18163cb0 msgr2=0x7fdd180ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:02.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.083+0000 7fdd1ca46700 1 --2- 172.21.15.39:0/1904948279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd18163cb0 0x7fdd180ae530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:02.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.083+0000 7fdd1ca46700 1 -- 172.21.15.39:0/1904948279 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd10009570 con 0x7fdd1806d2f0 2023-11-28T11:59:02.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.083+0000 7fdd0ffff700 1 --2- 172.21.15.39:0/1904948279 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd180cdfb0 0x7fdd180c48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:02.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.083+0000 7fdd1ca46700 1 --2- 172.21.15.39:0/1904948279 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd1806d2f0 0x7fdd1815bca0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fdd1400cbd0 tx=0x7fdd1400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:02.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.083+0000 7fdd0d7fa700 1 -- 172.21.15.39:0/1904948279 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd14003c20 con 0x7fdd1806d2f0 2023-11-28T11:59:02.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.083+0000 7fdd0d7fa700 1 -- 172.21.15.39:0/1904948279 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd14003d80 con 0x7fdd1806d2f0 2023-11-28T11:59:02.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.083+0000 7fdd1ecaa700 1 -- 172.21.15.39:0/1904948279 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd180cc780 con 0x7fdd1806d2f0 2023-11-28T11:59:02.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.083+0000 7fdd0d7fa700 1 -- 172.21.15.39:0/1904948279 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1400abf0 con 0x7fdd1806d2f0 2023-11-28T11:59:02.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.083+0000 7fdd1ecaa700 1 -- 172.21.15.39:0/1904948279 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd180cc4a0 con 0x7fdd1806d2f0 2023-11-28T11:59:02.089 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.087+0000 7fdd1ecaa700 1 -- 172.21.15.39:0/1904948279 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd18069e40 con 0x7fdd1806d2f0 2023-11-28T11:59:02.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.087+0000 7fdd0d7fa700 1 -- 172.21.15.39:0/1904948279 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdd14010050 con 0x7fdd1806d2f0 2023-11-28T11:59:02.093 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.091+0000 7fdd0d7fa700 1 --2- 172.21.15.39:0/1904948279 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fdd04064ee0 0x7fdd04067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:02.093 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.091+0000 7fdd0d7fa700 1 -- 172.21.15.39:0/1904948279 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fdd14081fe0 con 0x7fdd1806d2f0 2023-11-28T11:59:02.093 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.091+0000 7fdd0ffff700 1 --2- 172.21.15.39:0/1904948279 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fdd04064ee0 0x7fdd04067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:02.094 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.091+0000 7fdd0ffff700 1 --2- 172.21.15.39:0/1904948279 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fdd04064ee0 0x7fdd04067390 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdd180addb0 tx=0x7fdd08008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:02.099 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.095+0000 7fdd0d7fa700 1 -- 172.21.15.39:0/1904948279 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdd1404ff50 con 0x7fdd1806d2f0 2023-11-28T11:59:02.316 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.315+0000 7fdd1ecaa700 1 -- 172.21.15.39:0/1904948279 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdd180b0990 con 0x7fdd1806d2f0 2023-11-28T11:59:02.318 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.315+0000 7fdd0d7fa700 1 -- 172.21.15.39:0/1904948279 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4648 (secure 0 0 0) 0x7fdd14053570 con 0x7fdd1806d2f0 2023-11-28T11:59:02.318 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:59:02.318 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5775,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3453450609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3453450609},{"type":"v1","addr":"172.21.15.39:6833","nonce":3453450609}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/697075022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":697075022},{"type":"v1","addr":"172.21.15.39:6835","nonce":697075022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5806,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1819593136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1819593136},{"type":"v1","addr":"172.21.15.184:6835","nonce":1819593136}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:58:51.635140+0000","modified":"2023-11-28T11:58:54.706764+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5809},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5809":{"gid":5809,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/367294936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":367294936},{"type":"v1","addr":"172.21.15.184:6837","nonce":367294936}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T11:59:02.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.319+0000 7fdd1ecaa700 1 -- 172.21.15.39:0/1904948279 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fdd04064ee0 msgr2=0x7fdd04067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:02.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.319+0000 7fdd1ecaa700 1 --2- 172.21.15.39:0/1904948279 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fdd04064ee0 0x7fdd04067390 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdd180addb0 tx=0x7fdd08008040 comp rx=0 tx=0).stop 2023-11-28T11:59:02.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.319+0000 7fdd1ecaa700 1 -- 172.21.15.39:0/1904948279 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd1806d2f0 msgr2=0x7fdd1815bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:02.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.319+0000 7fdd1ecaa700 1 --2- 172.21.15.39:0/1904948279 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd1806d2f0 0x7fdd1815bca0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fdd1400cbd0 tx=0x7fdd1400cf90 comp rx=0 tx=0).stop 2023-11-28T11:59:02.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.319+0000 7fdd1ecaa700 1 -- 172.21.15.39:0/1904948279 shutdown_connections 2023-11-28T11:59:02.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.319+0000 7fdd1ecaa700 1 --2- 172.21.15.39:0/1904948279 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fdd04064ee0 0x7fdd04067390 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:02.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.319+0000 7fdd1ecaa700 1 --2- 172.21.15.39:0/1904948279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd18163cb0 0x7fdd180ae530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:02.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.319+0000 7fdd1ecaa700 1 --2- 172.21.15.39:0/1904948279 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd180cdfb0 0x7fdd180c48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:02.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.319+0000 7fdd1ecaa700 1 --2- 172.21.15.39:0/1904948279 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd1806d2f0 0x7fdd1815bca0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:02.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.319+0000 7fdd1ecaa700 1 -- 172.21.15.39:0/1904948279 >> 172.21.15.39:0/1904948279 conn(0x7fdd180cf350 msgr2=0x7fdd18162040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:02.324 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.319+0000 7fdd1ecaa700 1 -- 172.21.15.39:0/1904948279 shutdown_connections 2023-11-28T11:59:02.324 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.319+0000 7fdd1ecaa700 1 -- 172.21.15.39:0/1904948279 wait complete. 2023-11-28T11:59:02.324 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 24 2023-11-28T11:59:02.747 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T11:58:51.635140+0000', 'modified': '2023-11-28T11:58:54.706764+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5809}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5809': {'gid': 5809, 'name': 'b', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.184:6837/367294936', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6836', 'nonce': 367294936}, {'type': 'v1', 'addr': '172.21.15.184:6837', 'nonce': 367294936}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T11:59:02.747 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T11:59:02.747 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-28T11:59:02.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.943+0000 7f06eb570700 1 Processor -- start 2023-11-28T11:59:02.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.943+0000 7f06eb570700 1 -- start start 2023-11-28T11:59:02.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.947+0000 7f06eb570700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06e4160710 0x7f06e40cc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:02.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.947+0000 7f06eb570700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06e40ad6c0 con 0x7f06e4070790 2023-11-28T11:59:02.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.947+0000 7f06eb570700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06e40adc60 con 0x7f06e40cc860 2023-11-28T11:59:02.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.947+0000 7f06eb570700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e406b1c0 con 0x7f06e4160710 2023-11-28T11:59:02.952 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.947+0000 7f06ead6f700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f06e4070790 0x7f06e4164250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:50568/0 (socket says 172.21.15.39:50568) 2023-11-28T11:59:02.952 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.947+0000 7f06ead6f700 1 -- 172.21.15.39:0/3250561164 learned_addr learned my addr 172.21.15.39:0/3250561164 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:59:02.952 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.947+0000 7f06ea56e700 1 --2- 172.21.15.39:0/3250561164 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06e4160710 0x7f06e40cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:02.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.951+0000 7f06e956c700 1 -- 172.21.15.39:0/3250561164 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1390043084 0 0) 0x7f06e40ad6c0 con 0x7f06e4070790 2023-11-28T11:59:02.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.951+0000 7f06e956c700 1 -- 172.21.15.39:0/3250561164 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06d00035d0 con 0x7f06e4070790 2023-11-28T11:59:02.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.951+0000 7f06e956c700 1 -- 172.21.15.39:0/3250561164 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2392437292 0 0) 0x7f06e40adc60 con 0x7f06e40cc860 2023-11-28T11:59:02.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.951+0000 7f06ea56e700 1 -- 172.21.15.39:0/3250561164 >> v1:172.21.15.184:6789/0 conn(0x7f06e40cc860 legacy=0x7f06e4070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:02.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.951+0000 7f06ea56e700 1 -- 172.21.15.39:0/3250561164 >> v1:172.21.15.39:6789/0 conn(0x7f06e4070790 legacy=0x7f06e4164250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:02.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.951+0000 7f06ea56e700 1 -- 172.21.15.39:0/3250561164 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e406b3d0 con 0x7f06e4160710 2023-11-28T11:59:02.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.951+0000 7f06ea56e700 1 --2- 172.21.15.39:0/3250561164 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06e4160710 0x7f06e40cc320 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f06e0009880 tx=0x7f06e0009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebd90115384bd320 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:02.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.951+0000 7f06e956c700 1 -- 172.21.15.39:0/3250561164 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e0011830 con 0x7f06e4160710 2023-11-28T11:59:02.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.951+0000 7f06e956c700 1 -- 172.21.15.39:0/3250561164 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e0011990 con 0x7f06e4160710 2023-11-28T11:59:02.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.951+0000 7f06e956c700 1 -- 172.21.15.39:0/3250561164 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e0011d20 con 0x7f06e4160710 2023-11-28T11:59:02.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.951+0000 7f06eb570700 1 -- 172.21.15.39:0/3250561164 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06e4160710 msgr2=0x7f06e40cc320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:02.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.951+0000 7f06eb570700 1 --2- 172.21.15.39:0/3250561164 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06e4160710 0x7f06e40cc320 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f06e0009880 tx=0x7f06e0009b90 comp rx=0 tx=0).stop 2023-11-28T11:59:02.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.951+0000 7f06eb570700 1 -- 172.21.15.39:0/3250561164 shutdown_connections 2023-11-28T11:59:02.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.951+0000 7f06eb570700 1 --2- 172.21.15.39:0/3250561164 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06e4160710 0x7f06e40cc320 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:02.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.951+0000 7f06eb570700 1 -- 172.21.15.39:0/3250561164 >> 172.21.15.39:0/3250561164 conn(0x7f06e40b0f80 msgr2=0x7f06e40ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:02.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.951+0000 7f06eb570700 1 -- 172.21.15.39:0/3250561164 shutdown_connections 2023-11-28T11:59:02.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.951+0000 7f06eb570700 1 -- 172.21.15.39:0/3250561164 wait complete. 2023-11-28T11:59:02.958 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.955+0000 7f06eb570700 1 Processor -- start 2023-11-28T11:59:02.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.955+0000 7f06eb570700 1 -- start start 2023-11-28T11:59:02.960 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.959+0000 7f06eb570700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06e4070790 0x7f06e40b1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:02.960 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.959+0000 7f06eb570700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06e40cc860 0x7f06e415a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:02.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.959+0000 7f06eb570700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06e4160710 0x7f06e415ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:02.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.959+0000 7f06eb570700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e415ada0 con 0x7f06e4160710 2023-11-28T11:59:02.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.959+0000 7f06eb570700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e40b1d20 con 0x7f06e40cc860 2023-11-28T11:59:02.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.959+0000 7f06eb570700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e40b2000 con 0x7f06e4070790 2023-11-28T11:59:02.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.959+0000 7f06ead6f700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06e4160710 0x7f06e415ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:02.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.959+0000 7f06ead6f700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06e4160710 0x7f06e415ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55572/0 (socket says 172.21.15.39:55572) 2023-11-28T11:59:02.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.959+0000 7f06ead6f700 1 -- 172.21.15.39:0/799006244 learned_addr learned my addr 172.21.15.39:0/799006244 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:02.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.959+0000 7f06ea56e700 1 --2- 172.21.15.39:0/799006244 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06e4070790 0x7f06e40b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:02.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.959+0000 7f06e9d6d700 1 --2- 172.21.15.39:0/799006244 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06e40cc860 0x7f06e415a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:02.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.959+0000 7f06ead6f700 1 -- 172.21.15.39:0/799006244 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06e4070790 msgr2=0x7f06e40b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:02.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.959+0000 7f06ead6f700 1 --2- 172.21.15.39:0/799006244 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06e4070790 0x7f06e40b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:02.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.959+0000 7f06ead6f700 1 -- 172.21.15.39:0/799006244 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06e40cc860 msgr2=0x7f06e415a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:02.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.959+0000 7f06ead6f700 1 --2- 172.21.15.39:0/799006244 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06e40cc860 0x7f06e415a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:02.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.959+0000 7f06ead6f700 1 -- 172.21.15.39:0/799006244 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e00094b0 con 0x7f06e4160710 2023-11-28T11:59:02.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.959+0000 7f06ea56e700 1 --2- 172.21.15.39:0/799006244 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06e4070790 0x7f06e40b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:02.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.959+0000 7f06ead6f700 1 --2- 172.21.15.39:0/799006244 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06e4160710 0x7f06e415ec40 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f06dc002230 tx=0x7f06dc00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:02.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.959+0000 7f06daffd700 1 -- 172.21.15.39:0/799006244 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc007480 con 0x7f06e4160710 2023-11-28T11:59:02.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.959+0000 7f06daffd700 1 -- 172.21.15.39:0/799006244 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06dc0075e0 con 0x7f06e4160710 2023-11-28T11:59:02.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.959+0000 7f06eb570700 1 -- 172.21.15.39:0/799006244 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e40ad8f0 con 0x7f06e4160710 2023-11-28T11:59:02.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.959+0000 7f06daffd700 1 -- 172.21.15.39:0/799006244 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc007950 con 0x7f06e4160710 2023-11-28T11:59:02.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.959+0000 7f06eb570700 1 -- 172.21.15.39:0/799006244 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e406b6b0 con 0x7f06e4160710 2023-11-28T11:59:02.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.963+0000 7f06daffd700 1 -- 172.21.15.39:0/799006244 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f06dc019030 con 0x7f06e4160710 2023-11-28T11:59:02.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.967+0000 7f06daffd700 1 --2- 172.21.15.39:0/799006244 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f06c8064ee0 0x7f06c8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:02.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.967+0000 7f06daffd700 1 -- 172.21.15.39:0/799006244 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f06dc081780 con 0x7f06e4160710 2023-11-28T11:59:02.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.967+0000 7f06ea56e700 1 --2- 172.21.15.39:0/799006244 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f06c8064ee0 0x7f06c8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:02.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.967+0000 7f06efa5e740 1 Processor -- start 2023-11-28T11:59:02.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.967+0000 7f06efa5e740 1 -- start start 2023-11-28T11:59:02.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.967+0000 7f06ea56e700 1 --2- 172.21.15.39:0/799006244 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f06c8064ee0 0x7f06c8067390 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f06e00090b0 tx=0x7f06e001c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:02.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.967+0000 7f06efa5e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xb7cae0 0xe2ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:02.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.967+0000 7f06efa5e740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xb7c710 0xe2d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:02.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.967+0000 7f06efa5e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xbc7790 0xe2d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:02.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.967+0000 7f06efa5e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0xcebae0 con 0xb7cae0 2023-11-28T11:59:02.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.967+0000 7f06efa5e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0xd5bbd0 con 0xbc7790 2023-11-28T11:59:02.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.967+0000 7f06efa5e740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0xd54ed0 con 0xb7c710 2023-11-28T11:59:02.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.971+0000 7f06ea56e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xb7cae0 0xe2ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:02.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.971+0000 7f06ea56e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xb7cae0 0xe2ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55588/0 (socket says 172.21.15.39:55588) 2023-11-28T11:59:02.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.971+0000 7f06ea56e700 1 -- 172.21.15.39:0/1200535616 learned_addr learned my addr 172.21.15.39:0/1200535616 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:02.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.971+0000 7f06e9d6d700 1 --2- 172.21.15.39:0/1200535616 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xb7c710 0xe2d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:02.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.971+0000 7f06ead6f700 1 --2- 172.21.15.39:0/1200535616 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xbc7790 0xe2d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:02.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.971+0000 7f06ea56e700 1 -- 172.21.15.39:0/1200535616 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xb7c710 msgr2=0xe2d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:02.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.971+0000 7f06ea56e700 1 --2- 172.21.15.39:0/1200535616 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xb7c710 0xe2d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:02.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.971+0000 7f06ea56e700 1 -- 172.21.15.39:0/1200535616 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xbc7790 msgr2=0xe2d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:02.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.971+0000 7f06ea56e700 1 --2- 172.21.15.39:0/1200535616 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xbc7790 0xe2d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:02.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.971+0000 7f06ea56e700 1 -- 172.21.15.39:0/1200535616 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xd7acc0 con 0xb7cae0 2023-11-28T11:59:02.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.971+0000 7f06ea56e700 1 --2- 172.21.15.39:0/1200535616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xb7cae0 0xe2ce00 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f06e0011cc0 tx=0x7f06e0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a45c8936dcf94309 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:02.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.971+0000 7f06c7fff700 1 -- 172.21.15.39:0/1200535616 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e002a070 con 0xb7cae0 2023-11-28T11:59:02.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.971+0000 7f06c7fff700 1 -- 172.21.15.39:0/1200535616 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e0011cf0 con 0xb7cae0 2023-11-28T11:59:02.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.971+0000 7f06c7fff700 1 -- 172.21.15.39:0/1200535616 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e0025d00 con 0xb7cae0 2023-11-28T11:59:02.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.971+0000 7f06efa5e740 1 -- 172.21.15.39:0/1200535616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xb7cae0 msgr2=0xe2ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:02.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.971+0000 7f06efa5e740 1 --2- 172.21.15.39:0/1200535616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xb7cae0 0xe2ce00 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f06e0011cc0 tx=0x7f06e0009f90 comp rx=0 tx=0).stop 2023-11-28T11:59:02.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.971+0000 7f06efa5e740 1 -- 172.21.15.39:0/1200535616 shutdown_connections 2023-11-28T11:59:02.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.971+0000 7f06efa5e740 1 --2- 172.21.15.39:0/1200535616 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xbc7790 0xe2d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:02.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.971+0000 7f06efa5e740 1 --2- 172.21.15.39:0/1200535616 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xb7c710 0xe2d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:02.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.971+0000 7f06efa5e740 1 --2- 172.21.15.39:0/1200535616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xb7cae0 0xe2ce00 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:02.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.971+0000 7f06efa5e740 1 -- 172.21.15.39:0/1200535616 >> 172.21.15.39:0/1200535616 conn(0xb7ceb0 msgr2=0xe15700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:02.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.971+0000 7f06efa5e740 1 -- 172.21.15.39:0/1200535616 shutdown_connections 2023-11-28T11:59:02.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.971+0000 7f06efa5e740 1 -- 172.21.15.39:0/1200535616 wait complete. 2023-11-28T11:59:02.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.975+0000 7f06efa5e740 1 -- start start 2023-11-28T11:59:02.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.975+0000 7f06efa5e740 1 Processor -- start 2023-11-28T11:59:02.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.975+0000 7f06efa5e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xb7c710 0xe16930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:02.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.975+0000 7f06efa5e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xb7cae0 0xe2a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:02.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.975+0000 7f06efa5e740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xbc7790 0xe03ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:02.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.975+0000 7f06efa5e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0xc01b20 con 0xb7cae0 2023-11-28T11:59:02.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.975+0000 7f06efa5e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0xe08370 con 0xb7c710 2023-11-28T11:59:02.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.975+0000 7f06efa5e740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0xe052e0 con 0xbc7790 2023-11-28T11:59:02.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.975+0000 7f06efa5e740 10 client.0 _ll_register_callbacks cb 0xdb10d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:59:02.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.975+0000 7f06e9d6d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xb7cae0 0xe2a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:02.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.975+0000 7f06e9d6d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xb7cae0 0xe2a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55602/0 (socket says 172.21.15.39:55602) 2023-11-28T11:59:02.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.975+0000 7f06e9d6d700 1 -- 172.21.15.39:0/2483062493 learned_addr learned my addr 172.21.15.39:0/2483062493 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:02.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.975+0000 7f06ea56e700 1 --2- 172.21.15.39:0/2483062493 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xb7c710 0xe16930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:02.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.975+0000 7f06ead6f700 1 --2- 172.21.15.39:0/2483062493 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xbc7790 0xe03ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:02.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.975+0000 7f06e9d6d700 1 -- 172.21.15.39:0/2483062493 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xbc7790 msgr2=0xe03ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:02.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.975+0000 7f06e9d6d700 1 --2- 172.21.15.39:0/2483062493 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xbc7790 0xe03ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:02.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.975+0000 7f06e9d6d700 1 -- 172.21.15.39:0/2483062493 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xb7c710 msgr2=0xe16930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:02.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.975+0000 7f06e9d6d700 1 --2- 172.21.15.39:0/2483062493 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xb7c710 0xe16930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:02.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.975+0000 7f06e9d6d700 1 -- 172.21.15.39:0/2483062493 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e406b3d0 con 0xb7cae0 2023-11-28T11:59:02.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.975+0000 7f06ead6f700 1 --2- 172.21.15.39:0/2483062493 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xbc7790 0xe03ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:02.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.979+0000 7f06e9d6d700 1 --2- 172.21.15.39:0/2483062493 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xb7cae0 0xe2a530 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f06d4012540 tx=0x7f06d4012850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=632b72c7e64cf222 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:02.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.979+0000 7f06c57fa700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-11-28T11:59:02.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.979+0000 7f06c57fa700 1 -- 172.21.15.39:0/2483062493 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d40052e0 con 0xb7cae0 2023-11-28T11:59:02.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.979+0000 7f06c57fa700 1 -- 172.21.15.39:0/2483062493 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f06d4005440 con 0xb7cae0 2023-11-28T11:59:02.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.979+0000 7f06efa5e740 1 -- 172.21.15.39:0/2483062493 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xd4df50 con 0xb7cae0 2023-11-28T11:59:02.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.979+0000 7f06c57fa700 1 -- 172.21.15.39:0/2483062493 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06d40036a0 con 0xb7cae0 2023-11-28T11:59:02.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.979+0000 7f06efa5e740 10 client.5949 fetch_fsmap learned FSMap version 24 2023-11-28T11:59:02.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.979+0000 7f06efa5e740 1 -- 172.21.15.39:0/2483062493 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0xbc89e0 con 0xb7cae0 2023-11-28T11:59:02.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.979+0000 7f06c57fa700 1 -- 172.21.15.39:0/2483062493 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xd4df50 con 0xb7cae0 2023-11-28T11:59:02.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.979+0000 7f06c57fa700 1 -- 172.21.15.39:0/2483062493 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f06d4003800 con 0xb7cae0 2023-11-28T11:59:02.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.979+0000 7f06efa5e740 10 client.5949 fetch_fsmap finished waiting for FSMap version 24 2023-11-28T11:59:02.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.979+0000 7f06efa5e740 10 client.5949 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-28T11:59:02.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.979+0000 7f06efa5e740 20 client.5949 populate_metadata read hostname 'smithi039' 2023-11-28T11:59:02.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.979+0000 7f06efa5e740 1 --2- 172.21.15.39:0/2483062493 >> [v2:172.21.15.184:6836/367294936,v1:172.21.15.184:6837/367294936] conn(0xe039a0 0xe13e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:02.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.979+0000 7f06efa5e740 4 client.5949 mds_command: new command op to 5809 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T11:59:02.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.979+0000 7f06efa5e740 1 -- 172.21.15.39:0/2483062493 --> [v2:172.21.15.184:6836/367294936,v1:172.21.15.184:6837/367294936] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xd4dc70 con 0xe039a0 2023-11-28T11:59:02.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.979+0000 7f06ea56e700 1 --2- 172.21.15.39:0/2483062493 >> [v2:172.21.15.184:6836/367294936,v1:172.21.15.184:6837/367294936] conn(0xe039a0 0xe13e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:02.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.979+0000 7f06ea56e700 1 --2- 172.21.15.39:0/2483062493 >> [v2:172.21.15.184:6836/367294936,v1:172.21.15.184:6837/367294936] conn(0xe039a0 0xe13e00 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=368311fc541823b4 server_cookie=f689d354caff6498 in_seq=0 out_seq=0 2023-11-28T11:59:02.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.979+0000 7f06c57fa700 10 client.5949 ms_handle_connect on v2:172.21.15.184:6836/367294936 2023-11-28T11:59:02.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.983+0000 7f06c57fa700 1 -- 172.21.15.39:0/2483062493 <== mds.0 v2:172.21.15.184:6836/367294936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0xd4dc70 con 0xe039a0 2023-11-28T11:59:02.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.983+0000 7f06c57fa700 10 client.5949 handle_command_reply: tid=0 2023-11-28T11:59:02.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.983+0000 7f06efa5e740 1 client.5949 shutdown 2023-11-28T11:59:02.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.983+0000 7f06efa5e740 1 -- 172.21.15.39:0/2483062493 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xb7cae0 msgr2=0xe2a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:02.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.983+0000 7f06efa5e740 1 --2- 172.21.15.39:0/2483062493 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xb7cae0 0xe2a530 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f06d4012540 tx=0x7f06d4012850 comp rx=0 tx=0).stop 2023-11-28T11:59:02.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.983+0000 7f06efa5e740 1 -- 172.21.15.39:0/2483062493 shutdown_connections 2023-11-28T11:59:02.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.983+0000 7f06efa5e740 1 --2- 172.21.15.39:0/2483062493 >> [v2:172.21.15.184:6836/367294936,v1:172.21.15.184:6837/367294936] conn(0xe039a0 0xe13e00 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:02.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.983+0000 7f06efa5e740 1 --2- 172.21.15.39:0/2483062493 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xbc7790 0xe03ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:02.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.983+0000 7f06efa5e740 1 --2- 172.21.15.39:0/2483062493 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xb7cae0 0xe2a530 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:02.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.983+0000 7f06efa5e740 1 --2- 172.21.15.39:0/2483062493 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xb7c710 0xe16930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:02.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.983+0000 7f06c57fa700 0 client.5949 ms_handle_reset on v2:172.21.15.184:6836/367294936 2023-11-28T11:59:02.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.983+0000 7f06efa5e740 1 -- 172.21.15.39:0/2483062493 >> 172.21.15.39:0/2483062493 conn(0xb7ceb0 msgr2=0xe158e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:02.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.983+0000 7f06efa5e740 1 -- 172.21.15.39:0/2483062493 shutdown_connections 2023-11-28T11:59:02.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.983+0000 7f06efa5e740 1 -- 172.21.15.39:0/2483062493 wait complete. 2023-11-28T11:59:02.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:02.983+0000 7f06efa5e740 20 client.5949 trim_cache size 0 max 16384 2023-11-28T11:59:03.008 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.007+0000 7f06efa5e740 1 Processor -- start 2023-11-28T11:59:03.009 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.007+0000 7f06efa5e740 1 -- start start 2023-11-28T11:59:03.009 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.007+0000 7f06efa5e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xb7c710 0xe14cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:03.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.007+0000 7f06efa5e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xb7cae0 0xe12500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:03.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.007+0000 7f06efa5e740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xbc7790 0xe12a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:03.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.007+0000 7f06efa5e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0xd0aa40 con 0xb7cae0 2023-11-28T11:59:03.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.007+0000 7f06efa5e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0xd05260 con 0xb7c710 2023-11-28T11:59:03.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.007+0000 7f06efa5e740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0xd546e0 con 0xbc7790 2023-11-28T11:59:03.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.007+0000 7f06e9d6d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xb7cae0 0xe12500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:03.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.007+0000 7f06e9d6d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xb7cae0 0xe12500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55604/0 (socket says 172.21.15.39:55604) 2023-11-28T11:59:03.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.007+0000 7f06e9d6d700 1 -- 172.21.15.39:0/3312400753 learned_addr learned my addr 172.21.15.39:0/3312400753 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:03.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.007+0000 7f06ea56e700 1 --2- 172.21.15.39:0/3312400753 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xb7c710 0xe14cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:03.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.007+0000 7f06ead6f700 1 --2- 172.21.15.39:0/3312400753 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xbc7790 0xe12a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:03.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.007+0000 7f06e9d6d700 1 -- 172.21.15.39:0/3312400753 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xbc7790 msgr2=0xe12a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:03.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.007+0000 7f06e9d6d700 1 --2- 172.21.15.39:0/3312400753 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xbc7790 0xe12a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:03.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.007+0000 7f06e9d6d700 1 -- 172.21.15.39:0/3312400753 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xb7c710 msgr2=0xe14cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:03.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.007+0000 7f06e9d6d700 1 --2- 172.21.15.39:0/3312400753 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xb7c710 0xe14cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:03.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.007+0000 7f06e9d6d700 1 -- 172.21.15.39:0/3312400753 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e40b3120 con 0xb7cae0 2023-11-28T11:59:03.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.007+0000 7f06e9d6d700 1 --2- 172.21.15.39:0/3312400753 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xb7cae0 0xe12500 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f06d4001d00 tx=0x7f06d400c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18248275a9507287 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:03.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.007+0000 7f06d8ff9700 1 -- 172.21.15.39:0/3312400753 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d4003d60 con 0xb7cae0 2023-11-28T11:59:03.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.007+0000 7f06d8ff9700 1 -- 172.21.15.39:0/3312400753 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d40052e0 con 0xb7cae0 2023-11-28T11:59:03.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.007+0000 7f06d8ff9700 1 -- 172.21.15.39:0/3312400753 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d40036a0 con 0xb7cae0 2023-11-28T11:59:03.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.011+0000 7f06efa5e740 1 -- 172.21.15.39:0/3312400753 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xb7cae0 msgr2=0xe12500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:03.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.011+0000 7f06efa5e740 1 --2- 172.21.15.39:0/3312400753 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xb7cae0 0xe12500 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f06d4001d00 tx=0x7f06d400c000 comp rx=0 tx=0).stop 2023-11-28T11:59:03.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.011+0000 7f06efa5e740 1 -- 172.21.15.39:0/3312400753 shutdown_connections 2023-11-28T11:59:03.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.011+0000 7f06efa5e740 1 --2- 172.21.15.39:0/3312400753 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xbc7790 0xe12a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:03.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.011+0000 7f06efa5e740 1 --2- 172.21.15.39:0/3312400753 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xb7cae0 0xe12500 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:03.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.011+0000 7f06efa5e740 1 --2- 172.21.15.39:0/3312400753 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xb7c710 0xe14cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:03.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.011+0000 7f06efa5e740 1 -- 172.21.15.39:0/3312400753 >> 172.21.15.39:0/3312400753 conn(0xb7ceb0 msgr2=0xe15800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:03.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.011+0000 7f06efa5e740 1 -- 172.21.15.39:0/3312400753 shutdown_connections 2023-11-28T11:59:03.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.011+0000 7f06efa5e740 1 -- 172.21.15.39:0/3312400753 wait complete. 2023-11-28T11:59:03.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.011+0000 7f06efa5e740 1 -- start start 2023-11-28T11:59:03.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.011+0000 7f06efa5e740 1 Processor -- start 2023-11-28T11:59:03.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.011+0000 7f06efa5e740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xb7c710 0xe90040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:03.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.011+0000 7f06efa5e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xb7cae0 0xe2e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:03.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.011+0000 7f06efa5e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xbc7790 0xe2e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:03.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.011+0000 7f06efa5e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0xe90a90 con 0xb7cae0 2023-11-28T11:59:03.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.011+0000 7f06efa5e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0xe915a0 con 0xbc7790 2023-11-28T11:59:03.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.011+0000 7f06efa5e740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0xde9c90 con 0xb7c710 2023-11-28T11:59:03.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.011+0000 7f06efa5e740 10 client.0 _ll_register_callbacks cb 0xd012d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:59:03.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.011+0000 7f06e9d6d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xb7cae0 0xe2e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:03.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.011+0000 7f06ea56e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xb7c710 0xe90040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:03.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.011+0000 7f06ea56e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xb7c710 0xe90040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:36938/0 (socket says 172.21.15.39:36938) 2023-11-28T11:59:03.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.011+0000 7f06ea56e700 1 -- 172.21.15.39:0/3253083887 learned_addr learned my addr 172.21.15.39:0/3253083887 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:03.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.011+0000 7f06ead6f700 1 --2- 172.21.15.39:0/3253083887 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xbc7790 0xe2e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:03.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.015+0000 7f06e9d6d700 1 -- 172.21.15.39:0/3253083887 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xb7c710 msgr2=0xe90040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:03.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.015+0000 7f06e9d6d700 1 --2- 172.21.15.39:0/3253083887 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xb7c710 0xe90040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:03.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.015+0000 7f06e9d6d700 1 -- 172.21.15.39:0/3253083887 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xbc7790 msgr2=0xe2e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:03.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.015+0000 7f06e9d6d700 1 --2- 172.21.15.39:0/3253083887 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xbc7790 0xe2e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:03.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.015+0000 7f06e9d6d700 1 -- 172.21.15.39:0/3253083887 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xbc89e0 con 0xb7cae0 2023-11-28T11:59:03.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.015+0000 7f06e9d6d700 1 --2- 172.21.15.39:0/3253083887 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xb7cae0 0xe2e040 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0xd53960 tx=0x7f06d4001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda3595627f28a57 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:03.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.015+0000 7f06c57fa700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-11-28T11:59:03.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.015+0000 7f06c57fa700 1 -- 172.21.15.39:0/3253083887 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d4003d60 con 0xb7cae0 2023-11-28T11:59:03.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.015+0000 7f06c57fa700 1 -- 172.21.15.39:0/3253083887 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f06d40036a0 con 0xb7cae0 2023-11-28T11:59:03.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.015+0000 7f06efa5e740 1 -- 172.21.15.39:0/3253083887 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f06e0011cf0 con 0xb7cae0 2023-11-28T11:59:03.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.015+0000 7f06c57fa700 1 -- 172.21.15.39:0/3253083887 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06d4003860 con 0xb7cae0 2023-11-28T11:59:03.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.015+0000 7f06efa5e740 10 client.5955 fetch_fsmap learned FSMap version 24 2023-11-28T11:59:03.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.015+0000 7f06efa5e740 1 -- 172.21.15.39:0/3253083887 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0xd01a20 con 0xb7cae0 2023-11-28T11:59:03.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.015+0000 7f06c57fa700 1 -- 172.21.15.39:0/3253083887 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e0011cf0 con 0xb7cae0 2023-11-28T11:59:03.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.015+0000 7f06c57fa700 1 -- 172.21.15.39:0/3253083887 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f06d4006860 con 0xb7cae0 2023-11-28T11:59:03.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.015+0000 7f06efa5e740 10 client.5955 fetch_fsmap finished waiting for FSMap version 24 2023-11-28T11:59:03.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.015+0000 7f06efa5e740 10 client.5955 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-28T11:59:03.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.015+0000 7f06efa5e740 20 client.5955 populate_metadata read hostname 'smithi039' 2023-11-28T11:59:03.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.015+0000 7f06efa5e740 1 --2- 172.21.15.39:0/3253083887 >> [v2:172.21.15.184:6836/367294936,v1:172.21.15.184:6837/367294936] conn(0xde7f50 0xde8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:03.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.015+0000 7f06efa5e740 4 client.5955 mds_command: new command op to 5809 tid=0[{"prefix": "status"}] 2023-11-28T11:59:03.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.015+0000 7f06efa5e740 1 -- 172.21.15.39:0/3253083887 --> [v2:172.21.15.184:6836/367294936,v1:172.21.15.184:6837/367294936] -- command(tid 0: {"prefix": "status"}) v1 -- 0xbf9260 con 0xde7f50 2023-11-28T11:59:03.023 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.015+0000 7f06ea56e700 1 --2- 172.21.15.39:0/3253083887 >> [v2:172.21.15.184:6836/367294936,v1:172.21.15.184:6837/367294936] conn(0xde7f50 0xde8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:03.023 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.019+0000 7f06ea56e700 1 --2- 172.21.15.39:0/3253083887 >> [v2:172.21.15.184:6836/367294936,v1:172.21.15.184:6837/367294936] conn(0xde7f50 0xde8320 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2598844b69c98a30 server_cookie=14cf9a323feac119 in_seq=0 out_seq=0 2023-11-28T11:59:03.023 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.019+0000 7f06c57fa700 10 client.5955 ms_handle_connect on v2:172.21.15.184:6836/367294936 2023-11-28T11:59:03.023 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.019+0000 7f06c57fa700 1 -- 172.21.15.39:0/3253083887 <== mds.0 v2:172.21.15.184:6836/367294936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0xbf9260 con 0xde7f50 2023-11-28T11:59:03.023 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.019+0000 7f06c57fa700 10 client.5955 handle_command_reply: tid=0 2023-11-28T11:59:03.023 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.019+0000 7f06efa5e740 1 client.5955 shutdown 2023-11-28T11:59:03.023 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.019+0000 7f06efa5e740 1 -- 172.21.15.39:0/3253083887 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xb7cae0 msgr2=0xe2e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:03.023 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.019+0000 7f06efa5e740 1 --2- 172.21.15.39:0/3253083887 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xb7cae0 0xe2e040 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0xd53960 tx=0x7f06d4001080 comp rx=0 tx=0).stop 2023-11-28T11:59:03.023 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.019+0000 7f06efa5e740 1 -- 172.21.15.39:0/3253083887 shutdown_connections 2023-11-28T11:59:03.023 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.019+0000 7f06efa5e740 1 --2- 172.21.15.39:0/3253083887 >> [v2:172.21.15.184:6836/367294936,v1:172.21.15.184:6837/367294936] conn(0xde7f50 0xde8320 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:03.023 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.019+0000 7f06efa5e740 1 --2- 172.21.15.39:0/3253083887 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xbc7790 0xe2e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:03.024 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.019+0000 7f06efa5e740 1 --2- 172.21.15.39:0/3253083887 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xb7cae0 0xe2e040 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:03.024 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.019+0000 7f06efa5e740 1 --2- 172.21.15.39:0/3253083887 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xb7c710 0xe90040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:03.024 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.019+0000 7f06c57fa700 0 client.5955 ms_handle_reset on v2:172.21.15.184:6836/367294936 2023-11-28T11:59:03.024 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.019+0000 7f06efa5e740 1 -- 172.21.15.39:0/3253083887 >> 172.21.15.39:0/3253083887 conn(0xb7ceb0 msgr2=0xe14db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:03.024 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.019+0000 7f06efa5e740 1 -- 172.21.15.39:0/3253083887 shutdown_connections 2023-11-28T11:59:03.024 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.019+0000 7f06efa5e740 1 -- 172.21.15.39:0/3253083887 wait complete. 2023-11-28T11:59:03.024 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.019+0000 7f06efa5e740 20 client.5955 trim_cache size 0 max 16384 2023-11-28T11:59:03.024 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2023-11-28T11:59:03.025 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "67ce95b1-cd7e-4478-b863-c714ef275520", 2023-11-28T11:59:03.025 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 0, 2023-11-28T11:59:03.025 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 5809, 2023-11-28T11:59:03.025 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2023-11-28T11:59:03.025 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2023-11-28T11:59:03.025 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2023-11-28T11:59:03.025 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 11.377220124999999, 2023-11-28T11:59:03.025 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 24, 2023-11-28T11:59:03.025 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 58, 2023-11-28T11:59:03.025 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 58, 2023-11-28T11:59:03.025 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 16.618649422000001 2023-11-28T11:59:03.026 INFO:teuthology.orchestra.run.smithi039.stdout:} 2023-11-28T11:59:03.026 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.019+0000 7f06eb570700 1 -- 172.21.15.39:0/799006244 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f06c8064ee0 msgr2=0x7f06c8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:03.027 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.019+0000 7f06eb570700 1 --2- 172.21.15.39:0/799006244 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f06c8064ee0 0x7f06c8067390 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f06e00090b0 tx=0x7f06e001c040 comp rx=0 tx=0).stop 2023-11-28T11:59:03.027 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.019+0000 7f06eb570700 1 -- 172.21.15.39:0/799006244 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06e4160710 msgr2=0x7f06e415ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:03.027 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.019+0000 7f06eb570700 1 --2- 172.21.15.39:0/799006244 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06e4160710 0x7f06e415ec40 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f06dc002230 tx=0x7f06dc00cae0 comp rx=0 tx=0).stop 2023-11-28T11:59:03.027 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.019+0000 7f06eb570700 1 -- 172.21.15.39:0/799006244 shutdown_connections 2023-11-28T11:59:03.027 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.019+0000 7f06eb570700 1 --2- 172.21.15.39:0/799006244 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06e4160710 0x7f06e415ec40 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:03.027 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.019+0000 7f06eb570700 1 --2- 172.21.15.39:0/799006244 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f06c8064ee0 0x7f06c8067390 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:03.027 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.019+0000 7f06eb570700 1 --2- 172.21.15.39:0/799006244 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06e40cc860 0x7f06e415a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:03.027 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.019+0000 7f06eb570700 1 --2- 172.21.15.39:0/799006244 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06e4070790 0x7f06e40b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:03.028 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.019+0000 7f06eb570700 1 -- 172.21.15.39:0/799006244 >> 172.21.15.39:0/799006244 conn(0x7f06e40b0f80 msgr2=0x7f06e406bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:03.029 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.019+0000 7f06eb570700 1 -- 172.21.15.39:0/799006244 shutdown_connections 2023-11-28T11:59:03.029 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.019+0000 7f06eb570700 1 -- 172.21.15.39:0/799006244 wait complete. 2023-11-28T11:59:03.045 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T11:59:03.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.239+0000 7f30ea784700 1 Processor -- start 2023-11-28T11:59:03.241 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.239+0000 7f30ea784700 1 -- start start 2023-11-28T11:59:03.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.239+0000 7f30ea784700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f30e4069e00 0x7f30e406a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:03.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.239+0000 7f30ea784700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30e406c600 con 0x7f30e4071aa0 2023-11-28T11:59:03.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.239+0000 7f30ea784700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30e40722f0 con 0x7f30e415c640 2023-11-28T11:59:03.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.239+0000 7f30ea784700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30e406cef0 con 0x7f30e4069e00 2023-11-28T11:59:03.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.243+0000 7f30e8f81700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f30e4071aa0 0x7f30e406d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:50576/0 (socket says 172.21.15.39:50576) 2023-11-28T11:59:03.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.243+0000 7f30e8f81700 1 -- 172.21.15.39:0/3910656634 learned_addr learned my addr 172.21.15.39:0/3910656634 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:59:03.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.243+0000 7f30e9f83700 1 --2- 172.21.15.39:0/3910656634 >> v2:172.21.15.184:3300/0 conn(0x7f30e4069e00 0x7f30e406a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:03.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.243+0000 7f30dbfff700 1 -- 172.21.15.39:0/3910656634 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4195616307 0 0) 0x7f30e40722f0 con 0x7f30e415c640 2023-11-28T11:59:03.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.243+0000 7f30dbfff700 1 -- 172.21.15.39:0/3910656634 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30d00035d0 con 0x7f30e415c640 2023-11-28T11:59:03.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.243+0000 7f30dbfff700 1 -- 172.21.15.39:0/3910656634 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3320894986 0 0) 0x7f30e406c600 con 0x7f30e4071aa0 2023-11-28T11:59:03.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.243+0000 7f30dbfff700 1 -- 172.21.15.39:0/3910656634 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30e40722f0 con 0x7f30e4071aa0 2023-11-28T11:59:03.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.243+0000 7f30e9f83700 1 -- 172.21.15.39:0/3910656634 >> v1:172.21.15.184:6789/0 conn(0x7f30e415c640 legacy=0x7f30e40d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:03.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.243+0000 7f30e9f83700 1 -- 172.21.15.39:0/3910656634 >> v1:172.21.15.39:6789/0 conn(0x7f30e4071aa0 legacy=0x7f30e406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:03.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.243+0000 7f30e9f83700 1 -- 172.21.15.39:0/3910656634 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e406da20 con 0x7f30e4069e00 2023-11-28T11:59:03.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.243+0000 7f30e9f83700 1 --2- 172.21.15.39:0/3910656634 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30e4069e00 0x7f30e406a280 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f30dc009d90 tx=0x7f30dc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d50c6b58f0954ce server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:03.247 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.243+0000 7f30dbfff700 1 -- 172.21.15.39:0/3910656634 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30dc00e070 con 0x7f30e4069e00 2023-11-28T11:59:03.247 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.243+0000 7f30dbfff700 1 -- 172.21.15.39:0/3910656634 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30dc00bb20 con 0x7f30e4069e00 2023-11-28T11:59:03.247 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.243+0000 7f30dbfff700 1 -- 172.21.15.39:0/3910656634 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30dc012430 con 0x7f30e4069e00 2023-11-28T11:59:03.248 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.247+0000 7f30ea784700 1 -- 172.21.15.39:0/3910656634 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30e4069e00 msgr2=0x7f30e406a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:03.248 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.247+0000 7f30ea784700 1 --2- 172.21.15.39:0/3910656634 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30e4069e00 0x7f30e406a280 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f30dc009d90 tx=0x7f30dc00b330 comp rx=0 tx=0).stop 2023-11-28T11:59:03.248 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.247+0000 7f30ea784700 1 -- 172.21.15.39:0/3910656634 shutdown_connections 2023-11-28T11:59:03.248 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.247+0000 7f30ea784700 1 --2- 172.21.15.39:0/3910656634 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30e4069e00 0x7f30e406a280 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:03.248 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.247+0000 7f30ea784700 1 -- 172.21.15.39:0/3910656634 >> 172.21.15.39:0/3910656634 conn(0x7f30e40b6520 msgr2=0x7f30e4071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:03.249 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.247+0000 7f30ea784700 1 -- 172.21.15.39:0/3910656634 shutdown_connections 2023-11-28T11:59:03.249 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.247+0000 7f30ea784700 1 -- 172.21.15.39:0/3910656634 wait complete. 2023-11-28T11:59:03.251 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.247+0000 7f30ea784700 1 Processor -- start 2023-11-28T11:59:03.251 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.247+0000 7f30ea784700 1 -- start start 2023-11-28T11:59:03.253 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.251+0000 7f30ea784700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30e4069e00 0x7f30e40cc670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:03.253 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.251+0000 7f30ea784700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30e4071aa0 0x7f30e40c8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:03.253 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.251+0000 7f30ea784700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30e415c640 0x7f30e40b3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:03.253 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.251+0000 7f30ea784700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e40d38f0 con 0x7f30e4069e00 2023-11-28T11:59:03.254 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.251+0000 7f30ea784700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e415b3c0 con 0x7f30e4071aa0 2023-11-28T11:59:03.254 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.251+0000 7f30ea784700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e40c9a80 con 0x7f30e415c640 2023-11-28T11:59:03.254 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.251+0000 7f30e9782700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30e4069e00 0x7f30e40cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:03.254 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.251+0000 7f30e9782700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30e4069e00 0x7f30e40cc670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55632/0 (socket says 172.21.15.39:55632) 2023-11-28T11:59:03.254 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.251+0000 7f30e9782700 1 -- 172.21.15.39:0/1895952236 learned_addr learned my addr 172.21.15.39:0/1895952236 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:03.254 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.251+0000 7f30e8f81700 1 --2- 172.21.15.39:0/1895952236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30e4071aa0 0x7f30e40c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:03.255 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.251+0000 7f30e9f83700 1 --2- 172.21.15.39:0/1895952236 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30e415c640 0x7f30e40b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:03.255 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.251+0000 7f30e9782700 1 -- 172.21.15.39:0/1895952236 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30e415c640 msgr2=0x7f30e40b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:03.255 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.251+0000 7f30e9782700 1 --2- 172.21.15.39:0/1895952236 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30e415c640 0x7f30e40b3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:03.256 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.251+0000 7f30e9782700 1 -- 172.21.15.39:0/1895952236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30e4071aa0 msgr2=0x7f30e40c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:03.256 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.251+0000 7f30e9782700 1 --2- 172.21.15.39:0/1895952236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30e4071aa0 0x7f30e40c8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:03.256 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.251+0000 7f30e9782700 1 -- 172.21.15.39:0/1895952236 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30dc009a70 con 0x7f30e4069e00 2023-11-28T11:59:03.256 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.251+0000 7f30e8f81700 1 --2- 172.21.15.39:0/1895952236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30e4071aa0 0x7f30e40c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:03.256 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.251+0000 7f30e9782700 1 --2- 172.21.15.39:0/1895952236 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30e4069e00 0x7f30e40cc670 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f30e000c700 tx=0x7f30e000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:03.256 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.251+0000 7f30d9ffb700 1 -- 172.21.15.39:0/1895952236 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e00052d0 con 0x7f30e4069e00 2023-11-28T11:59:03.256 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.251+0000 7f30d9ffb700 1 -- 172.21.15.39:0/1895952236 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e0005430 con 0x7f30e4069e00 2023-11-28T11:59:03.256 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.251+0000 7f30d9ffb700 1 -- 172.21.15.39:0/1895952236 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e00055a0 con 0x7f30e4069e00 2023-11-28T11:59:03.256 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.251+0000 7f30ea784700 1 -- 172.21.15.39:0/1895952236 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30e4072010 con 0x7f30e4069e00 2023-11-28T11:59:03.256 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.251+0000 7f30ea784700 1 -- 172.21.15.39:0/1895952236 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30e415ca10 con 0x7f30e4069e00 2023-11-28T11:59:03.257 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.255+0000 7f30ea784700 1 -- 172.21.15.39:0/1895952236 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30e406c830 con 0x7f30e4069e00 2023-11-28T11:59:03.259 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.255+0000 7f30d9ffb700 1 -- 172.21.15.39:0/1895952236 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f30e0019030 con 0x7f30e4069e00 2023-11-28T11:59:03.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.255+0000 7f30d9ffb700 1 --2- 172.21.15.39:0/1895952236 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f30c8064ee0 0x7f30c8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:03.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.259+0000 7f30d9ffb700 1 -- 172.21.15.39:0/1895952236 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f30e00814c0 con 0x7f30e4069e00 2023-11-28T11:59:03.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.259+0000 7f30e8f81700 1 --2- 172.21.15.39:0/1895952236 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f30c8064ee0 0x7f30c8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:03.262 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.259+0000 7f30e8f81700 1 --2- 172.21.15.39:0/1895952236 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f30c8064ee0 0x7f30c8067390 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f30e40cfdc0 tx=0x7f30d4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:03.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.263+0000 7f30d9ffb700 1 -- 172.21.15.39:0/1895952236 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f30e004f3d0 con 0x7f30e4069e00 2023-11-28T11:59:03.475 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.471+0000 7f30ea784700 1 -- 172.21.15.39:0/1895952236 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f30e40c9360 con 0x7f30e4069e00 2023-11-28T11:59:03.475 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.471+0000 7f30d9ffb700 1 -- 172.21.15.39:0/1895952236 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) v1 ==== 53+0+73 (secure 0 0 0) 0x7f30e00529f0 con 0x7f30e4069e00 2023-11-28T11:59:03.476 INFO:teuthology.orchestra.run.smithi039.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T11:59:03.481 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.479+0000 7f30ea784700 1 -- 172.21.15.39:0/1895952236 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f30c8064ee0 msgr2=0x7f30c8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:03.481 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.479+0000 7f30ea784700 1 --2- 172.21.15.39:0/1895952236 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f30c8064ee0 0x7f30c8067390 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f30e40cfdc0 tx=0x7f30d4009040 comp rx=0 tx=0).stop 2023-11-28T11:59:03.481 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.479+0000 7f30ea784700 1 -- 172.21.15.39:0/1895952236 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30e4069e00 msgr2=0x7f30e40cc670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:03.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.479+0000 7f30ea784700 1 --2- 172.21.15.39:0/1895952236 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30e4069e00 0x7f30e40cc670 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f30e000c700 tx=0x7f30e000cac0 comp rx=0 tx=0).stop 2023-11-28T11:59:03.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.479+0000 7f30ea784700 1 -- 172.21.15.39:0/1895952236 shutdown_connections 2023-11-28T11:59:03.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.479+0000 7f30ea784700 1 --2- 172.21.15.39:0/1895952236 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30e415c640 0x7f30e40b3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:03.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.479+0000 7f30ea784700 1 --2- 172.21.15.39:0/1895952236 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f30c8064ee0 0x7f30c8067390 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:03.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.479+0000 7f30ea784700 1 --2- 172.21.15.39:0/1895952236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30e4071aa0 0x7f30e40c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:03.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.479+0000 7f30ea784700 1 --2- 172.21.15.39:0/1895952236 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30e4069e00 0x7f30e40cc670 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:03.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.479+0000 7f30ea784700 1 -- 172.21.15.39:0/1895952236 >> 172.21.15.39:0/1895952236 conn(0x7f30e40b6520 msgr2=0x7f30e40b1590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:03.483 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.479+0000 7f30ea784700 1 -- 172.21.15.39:0/1895952236 shutdown_connections 2023-11-28T11:59:03.483 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:03.479+0000 7f30ea784700 1 -- 172.21.15.39:0/1895952236 wait complete. 2023-11-28T11:59:03.507 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-28T11:59:03.508 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T11:59:03.508 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi039.front.sepia.ceph.com 2023-11-28T11:59:03.508 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T11:59:03.508 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T11:59:03.508 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-28T11:59:03.508 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T11:59:03.508 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T11:59:03.508 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T11:59:03.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:59:03.509 DEBUG:teuthology.orchestra.run.smithi039:> ip addr 2023-11-28T11:59:03.526 INFO:teuthology.orchestra.run.smithi039.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T11:59:03.527 INFO:teuthology.orchestra.run.smithi039.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T11:59:03.527 INFO:teuthology.orchestra.run.smithi039.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T11:59:03.527 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:59:03.527 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 ::1/128 scope host 2023-11-28T11:59:03.527 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:59:03.527 INFO:teuthology.orchestra.run.smithi039.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:59:03.527 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c6 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:59:03.528 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f0 2023-11-28T11:59:03.528 INFO:teuthology.orchestra.run.smithi039.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T11:59:03.528 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:70 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:59:03.528 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f0 2023-11-28T11:59:03.528 INFO:teuthology.orchestra.run.smithi039.stdout: inet 172.21.15.39/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-28T11:59:03.528 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft 42232sec preferred_lft 42232sec 2023-11-28T11:59:03.528 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::ec4:7aff:febd:1370/64 scope link 2023-11-28T11:59:03.528 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:59:03.529 INFO:teuthology.orchestra.run.smithi039.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:59:03.529 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c7 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:59:03.529 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f1 2023-11-28T11:59:03.529 INFO:teuthology.orchestra.run.smithi039.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:59:03.529 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:71 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:59:03.530 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f1 2023-11-28T11:59:03.530 INFO:teuthology.orchestra.run.smithi039.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T11:59:03.530 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 02:42:df:e8:d2:63 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:59:03.530 INFO:teuthology.orchestra.run.smithi039.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T11:59:03.530 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:59:03.530 INFO:teuthology.orchestra.run.smithi039.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T11:59:03.530 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 82:c4:07:ce:89:23 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:59:03.530 INFO:teuthology.orchestra.run.smithi039.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T11:59:03.531 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:59:03.531 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::48e6:ebff:fe99:9ca6/64 scope link 2023-11-28T11:59:03.531 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:59:03.531 INFO:teuthology.orchestra.run.smithi039.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T11:59:03.531 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 82:c4:07:ce:89:23 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T11:59:03.531 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::80c4:7ff:fece:8923/64 scope link 2023-11-28T11:59:03.531 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:59:03.531 INFO:teuthology.orchestra.run.smithi039.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T11:59:03.532 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 9e:bb:6e:23:db:6b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T11:59:03.532 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::9cbb:6eff:fe23:db6b/64 scope link 2023-11-28T11:59:03.532 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:59:03.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:59:03.532 DEBUG:teuthology.orchestra.run.smithi039:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T11:59:03.606 INFO:teuthology.orchestra.run.smithi039.stdout:1 2023-11-28T11:59:03.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:59:03.610 DEBUG:teuthology.orchestra.run.smithi039:> route 2023-11-28T11:59:03.677 INFO:teuthology.orchestra.run.smithi039.stdout:Kernel IP routing table 2023-11-28T11:59:03.677 INFO:teuthology.orchestra.run.smithi039.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T11:59:03.677 INFO:teuthology.orchestra.run.smithi039.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-28T11:59:03.677 INFO:teuthology.orchestra.run.smithi039.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T11:59:03.677 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-28T11:59:03.678 INFO:teuthology.orchestra.run.smithi039.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T11:59:03.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:59:03.678 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2023-11-28T11:59:03.678 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2023-11-28T11:59:03.678 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-28T11:59:03.678 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-28T11:59:03.678 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-28T11:59:03.678 DEBUG:teuthology.orchestra.run.smithi039:> ') 2023-11-28T11:59:03.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:59:03.819 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2023-11-28T11:59:03.837 INFO:teuthology.orchestra.run.smithi039.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T11:59:03.837 INFO:teuthology.orchestra.run.smithi039.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-28T11:59:03.838 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T11:59:03.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:59:03.838 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set brx.0 up 2023-11-28T11:59:03.917 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:59:03.917 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T11:59:03.982 INFO:teuthology.orchestra.run.smithi039.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T11:59:03.982 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:59:03.983 DEBUG:teuthology.orchestra.run.smithi039:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T11:59:04.043 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-28T11:59:04.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:59:04.043 DEBUG:teuthology.orchestra.run.smithi039:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T11:59:04.177 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T11:59:04.177 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-28T11:59:04.177 INFO:teuthology.orchestra.run.smithi039.stdout:invalid new device string format 2023-11-28T11:59:04.204 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T11:59:04.205 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-28T11:59:04.205 INFO:teuthology.orchestra.run.smithi039.stdout:invalid new device string format 2023-11-28T11:59:04.205 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-11-28T11:59:04.205 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-28T11:59:04.225 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T11:59:04.225 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-28T11:59:04.225 INFO:teuthology.orchestra.run.smithi039.stdout:invalid new device string format 2023-11-28T11:59:04.226 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-11-28T11:59:04.226 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-28T11:59:04.226 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.39:6789,172.21.15.184:6789,172.21.15.184:6790" 2023-11-28T11:59:04.226 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.39:6789,172.21.15.184:6789,172.21.15.184:6790:/ 2023-11-28T11:59:04.226 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=67ce95b1-cd7e-4478-b863-c714ef275520" will pass to kernel 2023-11-28T11:59:04.234 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T11:59:04.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:59:04.234 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T11:59:04.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:59:04.267 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T11:59:04.354 INFO:teuthology.orchestra.run.smithi039.stdout:client5977 2023-11-28T11:59:04.354 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:59:04.354 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:59:04.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:59:04.415 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent_a) 2023-11-28T11:59:04.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:59:04.500 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parent_a/alpha) 2023-11-28T11:59:04.574 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T11:59:04.575 DEBUG:teuthology.orchestra.run.smithi039:> import os 2023-11-28T11:59:04.575 DEBUG:teuthology.orchestra.run.smithi039:> import stat 2023-11-28T11:59:04.575 DEBUG:teuthology.orchestra.run.smithi039:> 2023-11-28T11:59:04.575 DEBUG:teuthology.orchestra.run.smithi039:> print(os.stat("/home/ubuntu/cephtest/mnt.0/parent_a/alpha").st_ino) 2023-11-28T11:59:04.575 DEBUG:teuthology.orchestra.run.smithi039:> ' 2023-11-28T11:59:04.720 INFO:teuthology.orchestra.run.smithi039.stdout:1099511627777 2023-11-28T11:59:04.910 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:59:05.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.135+0000 7f2feb59e700 1 Processor -- start 2023-11-28T11:59:05.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.135+0000 7f2feb59e700 1 -- start start 2023-11-28T11:59:05.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.135+0000 7f2feb59e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2fec0cdeb0 0x7f2fec070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:05.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.135+0000 7f2feb59e700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fec0709d0 con 0x7f2fec15c1a0 2023-11-28T11:59:05.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.135+0000 7f2feb59e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fec0adf90 con 0x7f2fec0705c0 2023-11-28T11:59:05.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.135+0000 7f2feb59e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fec069bf0 con 0x7f2fec0cdeb0 2023-11-28T11:59:05.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.135+0000 7f2fea59c700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f2fec15c1a0 0x7f2fec06c8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:50592/0 (socket says 172.21.15.39:50592) 2023-11-28T11:59:05.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.135+0000 7f2fea59c700 1 -- 172.21.15.39:0/995985438 learned_addr learned my addr 172.21.15.39:0/995985438 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:59:05.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.139+0000 7f2fe9d9b700 1 --2- 172.21.15.39:0/995985438 >> v2:172.21.15.184:3300/0 conn(0x7f2fec0cdeb0 0x7f2fec070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:05.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.139+0000 7f2fe959a700 1 -- 172.21.15.39:0/995985438 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2440820869 0 0) 0x7f2fec0709d0 con 0x7f2fec15c1a0 2023-11-28T11:59:05.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.139+0000 7f2fe959a700 1 -- 172.21.15.39:0/995985438 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fd40035d0 con 0x7f2fec15c1a0 2023-11-28T11:59:05.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.139+0000 7f2fe959a700 1 -- 172.21.15.39:0/995985438 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2338780837 0 0) 0x7f2fd40035d0 con 0x7f2fec15c1a0 2023-11-28T11:59:05.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.139+0000 7f2fe959a700 1 -- 172.21.15.39:0/995985438 >> v2:172.21.15.184:3300/0 conn(0x7f2fec0cdeb0 msgr2=0x7f2fec070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:05.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.139+0000 7f2fe959a700 1 --2- 172.21.15.39:0/995985438 >> v2:172.21.15.184:3300/0 conn(0x7f2fec0cdeb0 0x7f2fec070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:05.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.139+0000 7f2fe959a700 1 -- 172.21.15.39:0/995985438 >> v1:172.21.15.184:6789/0 conn(0x7f2fec0705c0 legacy=0x7f2fec06a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:05.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.139+0000 7f2fe959a700 1 -- 172.21.15.39:0/995985438 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fec0ce370 con 0x7f2fec15c1a0 2023-11-28T11:59:05.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.139+0000 7f2fe959a700 1 -- 172.21.15.39:0/995985438 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4013383302 0 0) 0x7f2fdc001670 con 0x7f2fec15c1a0 2023-11-28T11:59:05.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.139+0000 7f2fe959a700 1 -- 172.21.15.39:0/995985438 >> v1:172.21.15.39:6789/0 conn(0x7f2fec15c1a0 legacy=0x7f2fec06c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:05.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.139+0000 7f2fe959a700 1 --2- 172.21.15.39:0/995985438 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fd4003a20 0x7f2fd4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:05.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.139+0000 7f2fe959a700 1 --2- 172.21.15.39:0/995985438 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fd4004870 0x7f2fd4004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:05.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.139+0000 7f2fe959a700 1 --2- 172.21.15.39:0/995985438 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fd4005220 0x7f2fd400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:05.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.139+0000 7f2fe959a700 1 -- 172.21.15.39:0/995985438 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec069bf0 con 0x7f2fd4003a20 2023-11-28T11:59:05.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.139+0000 7f2fe959a700 1 -- 172.21.15.39:0/995985438 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd400c130 con 0x7f2fd4004870 2023-11-28T11:59:05.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.139+0000 7f2fe959a700 1 -- 172.21.15.39:0/995985438 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd400c2f0 con 0x7f2fd4005220 2023-11-28T11:59:05.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.139+0000 7f2fea59c700 1 --2- 172.21.15.39:0/995985438 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fd4003a20 0x7f2fd4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:05.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.139+0000 7f2fe9d9b700 1 --2- 172.21.15.39:0/995985438 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fd4004870 0x7f2fd4004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:05.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.139+0000 7f2fea59c700 1 -- 172.21.15.39:0/995985438 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fd4005220 msgr2=0x7f2fd400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:05.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.139+0000 7f2fea59c700 1 --2- 172.21.15.39:0/995985438 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fd4005220 0x7f2fd400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:05.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.139+0000 7f2fea59c700 1 -- 172.21.15.39:0/995985438 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fd4004870 msgr2=0x7f2fd4004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:05.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.139+0000 7f2fea59c700 1 --2- 172.21.15.39:0/995985438 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fd4004870 0x7f2fd4004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:05.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.139+0000 7f2fea59c700 1 -- 172.21.15.39:0/995985438 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd40035d0 con 0x7f2fd4003a20 2023-11-28T11:59:05.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.139+0000 7f2fe9d9b700 1 --2- 172.21.15.39:0/995985438 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fd4004870 0x7f2fd4004ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:59:05.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.139+0000 7f2fead9d700 1 -- 172.21.15.39:0/995985438 reap_dead start 2023-11-28T11:59:05.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.139+0000 7f2fea59c700 1 --2- 172.21.15.39:0/995985438 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fd4003a20 0x7f2fd4003e30 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc00c320 tx=0x7f2fd40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=975857bff4730449 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:05.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.139+0000 7f2fe959a700 1 -- 172.21.15.39:0/995985438 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc007c30 con 0x7f2fd4003a20 2023-11-28T11:59:05.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.139+0000 7f2fe959a700 1 -- 172.21.15.39:0/995985438 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fdc00ce80 con 0x7f2fd4003a20 2023-11-28T11:59:05.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.139+0000 7f2fe959a700 1 -- 172.21.15.39:0/995985438 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc005bc0 con 0x7f2fd4003a20 2023-11-28T11:59:05.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.139+0000 7f2feb59e700 1 -- 172.21.15.39:0/995985438 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fd4003a20 msgr2=0x7f2fd4003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:05.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.139+0000 7f2feb59e700 1 --2- 172.21.15.39:0/995985438 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fd4003a20 0x7f2fd4003e30 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc00c320 tx=0x7f2fd40058a0 comp rx=0 tx=0).stop 2023-11-28T11:59:05.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.139+0000 7f2feb59e700 1 -- 172.21.15.39:0/995985438 shutdown_connections 2023-11-28T11:59:05.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.139+0000 7f2feb59e700 1 --2- 172.21.15.39:0/995985438 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fd4003a20 0x7f2fd4003e30 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:05.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.139+0000 7f2feb59e700 1 -- 172.21.15.39:0/995985438 >> 172.21.15.39:0/995985438 conn(0x7f2fec0b0f80 msgr2=0x7f2fec0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:05.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.139+0000 7f2feb59e700 1 -- 172.21.15.39:0/995985438 shutdown_connections 2023-11-28T11:59:05.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.139+0000 7f2feb59e700 1 -- 172.21.15.39:0/995985438 wait complete. 2023-11-28T11:59:05.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.143+0000 7f2feb59e700 1 Processor -- start 2023-11-28T11:59:05.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.143+0000 7f2feb59e700 1 -- start start 2023-11-28T11:59:05.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.143+0000 7f2feb59e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fd4003a20 0x7f2fec14ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:05.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.143+0000 7f2feb59e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fec06a930 0x7f2fec14efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:05.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.143+0000 7f2feb59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fec1f5050 0x7f2fec1f54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:05.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.143+0000 7f2feb59e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec15ab70 con 0x7f2fec06a930 2023-11-28T11:59:05.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.143+0000 7f2feb59e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec14f500 con 0x7f2fd4003a20 2023-11-28T11:59:05.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.143+0000 7f2feb59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec15a240 con 0x7f2fec1f5050 2023-11-28T11:59:05.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.143+0000 7f2fe9d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fec06a930 0x7f2fec14efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:05.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.143+0000 7f2fe9d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fec06a930 0x7f2fec14efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55650/0 (socket says 172.21.15.39:55650) 2023-11-28T11:59:05.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.143+0000 7f2fe9d9b700 1 -- 172.21.15.39:0/1009086999 learned_addr learned my addr 172.21.15.39:0/1009086999 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:05.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.143+0000 7f2fea59c700 1 --2- 172.21.15.39:0/1009086999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fd4003a20 0x7f2fec14ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:05.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.147+0000 7f2fead9d700 1 --2- 172.21.15.39:0/1009086999 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fec1f5050 0x7f2fec1f54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:05.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.147+0000 7f2fea59c700 1 -- 172.21.15.39:0/1009086999 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fec1f5050 msgr2=0x7f2fec1f54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:05.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.147+0000 7f2fea59c700 1 --2- 172.21.15.39:0/1009086999 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fec1f5050 0x7f2fec1f54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:05.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.147+0000 7f2fea59c700 1 -- 172.21.15.39:0/1009086999 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fec06a930 msgr2=0x7f2fec14efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:05.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.147+0000 7f2fea59c700 1 --2- 172.21.15.39:0/1009086999 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fec06a930 0x7f2fec14efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:05.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.147+0000 7f2fea59c700 1 -- 172.21.15.39:0/1009086999 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fec0cc780 con 0x7f2fd4003a20 2023-11-28T11:59:05.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.147+0000 7f2fe9d9b700 1 --2- 172.21.15.39:0/1009086999 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fec06a930 0x7f2fec14efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:05.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.147+0000 7f2fea59c700 1 --2- 172.21.15.39:0/1009086999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fd4003a20 0x7f2fec14ea80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc014000 tx=0x7f2fdc001a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:05.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.147+0000 7f2fdaffd700 1 -- 172.21.15.39:0/1009086999 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc004ca0 con 0x7f2fd4003a20 2023-11-28T11:59:05.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.147+0000 7f2fdaffd700 1 -- 172.21.15.39:0/1009086999 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fdc004e20 con 0x7f2fd4003a20 2023-11-28T11:59:05.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.147+0000 7f2feb59e700 1 -- 172.21.15.39:0/1009086999 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fec0cc4a0 con 0x7f2fd4003a20 2023-11-28T11:59:05.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.147+0000 7f2fdaffd700 1 -- 172.21.15.39:0/1009086999 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc007310 con 0x7f2fd4003a20 2023-11-28T11:59:05.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.147+0000 7f2feb59e700 1 -- 172.21.15.39:0/1009086999 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fec15c570 con 0x7f2fd4003a20 2023-11-28T11:59:05.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.151+0000 7f2feb59e700 1 -- 172.21.15.39:0/1009086999 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fec14f500 con 0x7f2fd4003a20 2023-11-28T11:59:05.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.151+0000 7f2fdaffd700 1 -- 172.21.15.39:0/1009086999 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2fdc023030 con 0x7f2fd4003a20 2023-11-28T11:59:05.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.151+0000 7f2fdaffd700 1 --2- 172.21.15.39:0/1009086999 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2fcc064ee0 0x7f2fcc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:05.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.151+0000 7f2fdaffd700 1 -- 172.21.15.39:0/1009086999 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2fdc082fd0 con 0x7f2fd4003a20 2023-11-28T11:59:05.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.151+0000 7f2fe9d9b700 1 --2- 172.21.15.39:0/1009086999 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2fcc064ee0 0x7f2fcc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:05.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.155+0000 7f2fe9d9b700 1 --2- 172.21.15.39:0/1009086999 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2fcc064ee0 0x7f2fcc067390 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2fec070290 tx=0x7f2fe0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:05.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.159+0000 7f2fdaffd700 1 -- 172.21.15.39:0/1009086999 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2fdc050f40 con 0x7f2fd4003a20 2023-11-28T11:59:05.370 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.367+0000 7f2feb59e700 1 -- 172.21.15.39:0/1009086999 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2fec073cb0 con 0x7f2fd4003a20 2023-11-28T11:59:05.371 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.367+0000 7f2fdaffd700 1 -- 172.21.15.39:0/1009086999 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4648 (secure 0 0 0) 0x7f2fdc054560 con 0x7f2fd4003a20 2023-11-28T11:59:05.372 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:59:05.372 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5775,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3453450609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3453450609},{"type":"v1","addr":"172.21.15.39:6833","nonce":3453450609}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/697075022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":697075022},{"type":"v1","addr":"172.21.15.39:6835","nonce":697075022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5806,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1819593136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1819593136},{"type":"v1","addr":"172.21.15.184:6835","nonce":1819593136}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:58:51.635140+0000","modified":"2023-11-28T11:58:54.706764+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5809},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5809":{"gid":5809,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/367294936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":367294936},{"type":"v1","addr":"172.21.15.184:6837","nonce":367294936}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T11:59:05.374 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.371+0000 7f2feb59e700 1 -- 172.21.15.39:0/1009086999 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2fcc064ee0 msgr2=0x7f2fcc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:05.375 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.371+0000 7f2feb59e700 1 --2- 172.21.15.39:0/1009086999 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2fcc064ee0 0x7f2fcc067390 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2fec070290 tx=0x7f2fe0008040 comp rx=0 tx=0).stop 2023-11-28T11:59:05.375 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.371+0000 7f2feb59e700 1 -- 172.21.15.39:0/1009086999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fd4003a20 msgr2=0x7f2fec14ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:05.375 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.371+0000 7f2feb59e700 1 --2- 172.21.15.39:0/1009086999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fd4003a20 0x7f2fec14ea80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc014000 tx=0x7f2fdc001a00 comp rx=0 tx=0).stop 2023-11-28T11:59:05.375 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.371+0000 7f2feb59e700 1 -- 172.21.15.39:0/1009086999 shutdown_connections 2023-11-28T11:59:05.375 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.371+0000 7f2feb59e700 1 --2- 172.21.15.39:0/1009086999 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fec1f5050 0x7f2fec1f54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:05.375 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.371+0000 7f2feb59e700 1 --2- 172.21.15.39:0/1009086999 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fec06a930 0x7f2fec14efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:05.375 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.371+0000 7f2feb59e700 1 --2- 172.21.15.39:0/1009086999 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2fcc064ee0 0x7f2fcc067390 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:05.375 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.371+0000 7f2feb59e700 1 --2- 172.21.15.39:0/1009086999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fd4003a20 0x7f2fec14ea80 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:05.375 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.371+0000 7f2feb59e700 1 -- 172.21.15.39:0/1009086999 >> 172.21.15.39:0/1009086999 conn(0x7f2fec0b0f80 msgr2=0x7f2fec06c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:05.376 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.371+0000 7f2feb59e700 1 -- 172.21.15.39:0/1009086999 shutdown_connections 2023-11-28T11:59:05.376 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.371+0000 7f2feb59e700 1 -- 172.21.15.39:0/1009086999 wait complete. 2023-11-28T11:59:05.378 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 24 2023-11-28T11:59:05.401 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2023-11-28T11:59:05.624 INFO:teuthology.orchestra.run.smithi184.stdout:{"message":"","return_code":0} 2023-11-28T11:59:05.624 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-11-28T11:59:05.625 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2023-11-28T11:59:05.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.695+0000 7f9d0ed6f140 1 Processor -- start 2023-11-28T11:59:05.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.695+0000 7f9d0ed6f140 1 -- start start 2023-11-28T11:59:05.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.695+0000 7f9d0ed6f140 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55905d55d700 0x55905d58d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:05.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.699+0000 7f9d0ed6f140 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55905d590980 0x55905d61a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:05.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.699+0000 7f9d0ed6f140 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55905d61b830 0x55905d61ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:05.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.699+0000 7f9d0ed6f140 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55905d621310 con 0x55905d590980 2023-11-28T11:59:05.701 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.699+0000 7f9d0ed6f140 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55905d6215b0 con 0x55905d61b830 2023-11-28T11:59:05.701 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.699+0000 7f9d0ed6f140 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55905d621850 con 0x55905d55d700 2023-11-28T11:59:05.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.699+0000 7f9d0c0a3700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55905d590980 0x55905d61a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:05.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.699+0000 7f9d0c8a4700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55905d55d700 0x55905d58d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:05.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.699+0000 7f9d0c0a3700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55905d590980 0x55905d61a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55668/0 (socket says 172.21.15.39:55668) 2023-11-28T11:59:05.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.699+0000 7f9d0c0a3700 1 -- 172.21.15.39:0/2559455064 learned_addr learned my addr 172.21.15.39:0/2559455064 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:05.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.699+0000 7f9d0d0a5700 1 --2- 172.21.15.39:0/2559455064 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55905d61b830 0x55905d61ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:05.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.699+0000 7f9d0c8a4700 1 -- 172.21.15.39:0/2559455064 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55905d61b830 msgr2=0x55905d61ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:05.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.699+0000 7f9d0c8a4700 1 --2- 172.21.15.39:0/2559455064 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55905d61b830 0x55905d61ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:05.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.699+0000 7f9d0c8a4700 1 -- 172.21.15.39:0/2559455064 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55905d590980 msgr2=0x55905d61a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:05.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.699+0000 7f9d0c8a4700 1 --2- 172.21.15.39:0/2559455064 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55905d590980 0x55905d61a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:05.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.699+0000 7f9d0c8a4700 1 -- 172.21.15.39:0/2559455064 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d0400a1c0 con 0x55905d55d700 2023-11-28T11:59:05.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.699+0000 7f9d0c0a3700 1 --2- 172.21.15.39:0/2559455064 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55905d590980 0x55905d61a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:05.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.699+0000 7f9d0c8a4700 1 --2- 172.21.15.39:0/2559455064 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55905d55d700 0x55905d58d6b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc009790 tx=0x7f9cfc005a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db20206bc7e4147a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:05.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.699+0000 7f9d0b0a1700 1 -- 172.21.15.39:0/2559455064 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc00f040 con 0x55905d55d700 2023-11-28T11:59:05.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.699+0000 7f9d0b0a1700 1 -- 172.21.15.39:0/2559455064 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cfc008870 con 0x55905d55d700 2023-11-28T11:59:05.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.699+0000 7f9d0b0a1700 1 -- 172.21.15.39:0/2559455064 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc008c00 con 0x55905d55d700 2023-11-28T11:59:05.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.699+0000 7f9d0ed6f140 1 -- 172.21.15.39:0/2559455064 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55905d55d700 msgr2=0x55905d58d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:05.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.699+0000 7f9d0ed6f140 1 --2- 172.21.15.39:0/2559455064 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55905d55d700 0x55905d58d6b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc009790 tx=0x7f9cfc005a00 comp rx=0 tx=0).stop 2023-11-28T11:59:05.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.699+0000 7f9d0ed6f140 1 -- 172.21.15.39:0/2559455064 shutdown_connections 2023-11-28T11:59:05.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.699+0000 7f9d0ed6f140 1 --2- 172.21.15.39:0/2559455064 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55905d61b830 0x55905d61ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:05.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.699+0000 7f9d0ed6f140 1 --2- 172.21.15.39:0/2559455064 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55905d590980 0x55905d61a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:05.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.699+0000 7f9d0ed6f140 1 --2- 172.21.15.39:0/2559455064 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55905d55d700 0x55905d58d6b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:05.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.699+0000 7f9d0ed6f140 1 -- 172.21.15.39:0/2559455064 >> 172.21.15.39:0/2559455064 conn(0x55905d563c30 msgr2=0x55905d61dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:05.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.699+0000 7f9d0ed6f140 1 -- 172.21.15.39:0/2559455064 shutdown_connections 2023-11-28T11:59:05.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.703+0000 7f9d0ed6f140 1 -- 172.21.15.39:0/2559455064 wait complete. 2023-11-28T11:59:05.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.703+0000 7f9d0ed6f140 1 Processor -- start 2023-11-28T11:59:05.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.703+0000 7f9d0ed6f140 1 -- start start 2023-11-28T11:59:05.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.703+0000 7f9d0ed6f140 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55905d55d700 0x55905d584930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:05.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.703+0000 7f9d0ed6f140 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55905d590980 0x55905d61a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:05.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.703+0000 7f9d0ed6f140 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55905d61b830 0x55905d61acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:05.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.703+0000 7f9d0ed6f140 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55905d61b230 con 0x55905d55d700 2023-11-28T11:59:05.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.703+0000 7f9d0ed6f140 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55905d6cb980 con 0x55905d61b830 2023-11-28T11:59:05.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.703+0000 7f9d0ed6f140 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55905d6cbc20 con 0x55905d590980 2023-11-28T11:59:05.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.703+0000 7f9d0c8a4700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55905d55d700 0x55905d584930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:05.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.703+0000 7f9d0c8a4700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55905d55d700 0x55905d584930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55678/0 (socket says 172.21.15.39:55678) 2023-11-28T11:59:05.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.703+0000 7f9d0c8a4700 1 -- 172.21.15.39:0/2170275812 learned_addr learned my addr 172.21.15.39:0/2170275812 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:05.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.703+0000 7f9d0c0a3700 1 --2- 172.21.15.39:0/2170275812 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55905d590980 0x55905d61a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:05.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.703+0000 7f9d0d0a5700 1 --2- 172.21.15.39:0/2170275812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55905d61b830 0x55905d61acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:05.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.703+0000 7f9d0c8a4700 1 -- 172.21.15.39:0/2170275812 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55905d590980 msgr2=0x55905d61a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:05.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.703+0000 7f9d0c8a4700 1 --2- 172.21.15.39:0/2170275812 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55905d590980 0x55905d61a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:05.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.703+0000 7f9d0c8a4700 1 -- 172.21.15.39:0/2170275812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55905d61b830 msgr2=0x55905d61acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:05.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.703+0000 7f9d0c8a4700 1 --2- 172.21.15.39:0/2170275812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55905d61b830 0x55905d61acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:05.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.703+0000 7f9d0c8a4700 1 -- 172.21.15.39:0/2170275812 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d0000a420 con 0x55905d55d700 2023-11-28T11:59:05.709 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.707+0000 7f9d0c8a4700 1 --2- 172.21.15.39:0/2170275812 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55905d55d700 0x55905d584930 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x55905d621990 tx=0x7f9cfc003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:05.709 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.707+0000 7f9d0a09f700 1 -- 172.21.15.39:0/2170275812 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc00f070 con 0x55905d55d700 2023-11-28T11:59:05.709 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.707+0000 7f9d0a09f700 1 -- 172.21.15.39:0/2170275812 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cfc013830 con 0x55905d55d700 2023-11-28T11:59:05.709 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.707+0000 7f9d0a09f700 1 -- 172.21.15.39:0/2170275812 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc013be0 con 0x55905d55d700 2023-11-28T11:59:05.709 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.707+0000 7f9d0ed6f140 1 -- 172.21.15.39:0/2170275812 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cfc009410 con 0x55905d55d700 2023-11-28T11:59:05.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.707+0000 7f9d0ed6f140 1 -- 172.21.15.39:0/2170275812 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55905d4b7760 con 0x55905d55d700 2023-11-28T11:59:05.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.711+0000 7f9d0a09f700 1 -- 172.21.15.39:0/2170275812 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9cfc013d40 con 0x55905d55d700 2023-11-28T11:59:05.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.711+0000 7f9d0a09f700 1 --2- 172.21.15.39:0/2170275812 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9cf8063870 0x7f9cf8065d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:05.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.711+0000 7f9d0a09f700 1 -- 172.21.15.39:0/2170275812 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f9cfc082bd0 con 0x55905d55d700 2023-11-28T11:59:05.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.711+0000 7f9d0ed6f140 1 --2- 172.21.15.39:0/2170275812 >> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] conn(0x55905d584e70 0x55905d6cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:05.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.711+0000 7f9d0ed6f140 1 -- 172.21.15.39:0/2170275812 --> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] -- osd_op(unknown.0.0:1 9.7 9:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e58) v8 -- 0x55905d6ccde0 con 0x55905d584e70 2023-11-28T11:59:05.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.711+0000 7f9d0c0a3700 1 --2- 172.21.15.39:0/2170275812 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9cf8063870 0x7f9cf8065d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:05.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.711+0000 7f9d0d0a5700 1 --2- 172.21.15.39:0/2170275812 >> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] conn(0x55905d584e70 0x55905d6cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:05.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.715+0000 7f9d0c0a3700 1 --2- 172.21.15.39:0/2170275812 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9cf8063870 0x7f9cf8065d20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9d0000ab60 tx=0x7f9d0000e040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:05.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.715+0000 7f9d0d0a5700 1 --2- 172.21.15.39:0/2170275812 >> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] conn(0x55905d584e70 0x55905d6cc8a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:05.718 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.715+0000 7f9d0d0a5700 1 -- 172.21.15.39:0/2170275812 <== osd.5 v2:172.21.15.184:6808/36505 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x7f9d04017040 con 0x55905d584e70 2023-11-28T11:59:05.718 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.715+0000 7f9d0ed6f140 1 -- 172.21.15.39:0/2170275812 >> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] conn(0x55905d584e70 msgr2=0x55905d6cc8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:05.718 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.715+0000 7f9d0ed6f140 1 --2- 172.21.15.39:0/2170275812 >> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] conn(0x55905d584e70 0x55905d6cc8a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:05.718 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.715+0000 7f9d0ed6f140 1 -- 172.21.15.39:0/2170275812 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9cf8063870 msgr2=0x7f9cf8065d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:05.718 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.715+0000 7f9d0ed6f140 1 --2- 172.21.15.39:0/2170275812 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9cf8063870 0x7f9cf8065d20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9d0000ab60 tx=0x7f9d0000e040 comp rx=0 tx=0).stop 2023-11-28T11:59:05.718 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.715+0000 7f9d0ed6f140 1 -- 172.21.15.39:0/2170275812 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55905d55d700 msgr2=0x55905d584930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:05.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.715+0000 7f9d0ed6f140 1 --2- 172.21.15.39:0/2170275812 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55905d55d700 0x55905d584930 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x55905d621990 tx=0x7f9cfc003020 comp rx=0 tx=0).stop 2023-11-28T11:59:05.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.715+0000 7f9d0d0a5700 1 -- 172.21.15.39:0/2170275812 reap_dead start 2023-11-28T11:59:05.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.715+0000 7f9d0ed6f140 1 -- 172.21.15.39:0/2170275812 shutdown_connections 2023-11-28T11:59:05.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.715+0000 7f9d0ed6f140 1 -- 172.21.15.39:0/2170275812 >> 172.21.15.39:0/2170275812 conn(0x55905d563c30 msgr2=0x55905d61f850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:05.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.715+0000 7f9d0ed6f140 1 -- 172.21.15.39:0/2170275812 shutdown_connections 2023-11-28T11:59:05.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.715+0000 7f9d0ed6f140 1 -- 172.21.15.39:0/2170275812 wait complete. 2023-11-28T11:59:05.726 INFO:teuthology.orchestra.run.smithi039.stdout:Yalphaparent_a 2023-11-28T11:59:05.726 DEBUG:teuthology.orchestra.run.smithi039:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2023-11-28T11:59:05.818 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2023-11-28T11:59:05.818 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511627777, 2023-11-28T11:59:05.818 INFO:teuthology.orchestra.run.smithi039.stdout: "ancestors": [ 2023-11-28T11:59:05.818 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:59:05.818 INFO:teuthology.orchestra.run.smithi039.stdout: "dirino": 1099511627776, 2023-11-28T11:59:05.819 INFO:teuthology.orchestra.run.smithi039.stdout: "dname": "alpha", 2023-11-28T11:59:05.819 INFO:teuthology.orchestra.run.smithi039.stdout: "version": 2 2023-11-28T11:59:05.819 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:59:05.819 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:59:05.819 INFO:teuthology.orchestra.run.smithi039.stdout: "dirino": 1, 2023-11-28T11:59:05.819 INFO:teuthology.orchestra.run.smithi039.stdout: "dname": "parent_a", 2023-11-28T11:59:05.819 INFO:teuthology.orchestra.run.smithi039.stdout: "version": 4 2023-11-28T11:59:05.819 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:59:05.819 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2023-11-28T11:59:05.819 INFO:teuthology.orchestra.run.smithi039.stdout: "pool": 9, 2023-11-28T11:59:05.819 INFO:teuthology.orchestra.run.smithi039.stdout: "old_pools": [] 2023-11-28T11:59:05.820 INFO:teuthology.orchestra.run.smithi039.stdout:} 2023-11-28T11:59:05.820 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:59:05.824 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'oh i'"'"'m sorry did i overwrite your xattr?' 2023-11-28T11:59:05.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.891+0000 7fe47158a140 1 Processor -- start 2023-11-28T11:59:05.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.891+0000 7fe47158a140 1 -- start start 2023-11-28T11:59:05.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.895+0000 7fe47158a140 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55883d72f710 0x55883d7598b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:05.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.895+0000 7fe47158a140 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55883d762990 0x55883d8917e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:05.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.895+0000 7fe47158a140 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55883d7edf50 0x55883d77d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:05.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.895+0000 7fe47158a140 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55883d6c4180 con 0x55883d72f710 2023-11-28T11:59:05.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.895+0000 7fe47158a140 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55883d657240 con 0x55883d762990 2023-11-28T11:59:05.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.895+0000 7fe47158a140 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55883d809fb0 con 0x55883d7edf50 2023-11-28T11:59:05.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.895+0000 7fe46f0bf700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55883d72f710 0x55883d7598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:05.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.895+0000 7fe46f0bf700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55883d72f710 0x55883d7598b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55680/0 (socket says 172.21.15.39:55680) 2023-11-28T11:59:05.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.895+0000 7fe46f0bf700 1 -- 172.21.15.39:0/1219025964 learned_addr learned my addr 172.21.15.39:0/1219025964 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:05.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.895+0000 7fe46e8be700 1 --2- 172.21.15.39:0/1219025964 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55883d762990 0x55883d8917e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:05.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.895+0000 7fe46f8c0700 1 --2- 172.21.15.39:0/1219025964 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55883d7edf50 0x55883d77d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:05.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.895+0000 7fe46f0bf700 1 -- 172.21.15.39:0/1219025964 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55883d7edf50 msgr2=0x55883d77d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:05.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.895+0000 7fe46f0bf700 1 --2- 172.21.15.39:0/1219025964 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55883d7edf50 0x55883d77d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:05.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.895+0000 7fe46f0bf700 1 -- 172.21.15.39:0/1219025964 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55883d762990 msgr2=0x55883d8917e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:05.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.895+0000 7fe46f0bf700 1 --2- 172.21.15.39:0/1219025964 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55883d762990 0x55883d8917e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:05.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.895+0000 7fe46f0bf700 1 -- 172.21.15.39:0/1219025964 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe464005d20 con 0x55883d72f710 2023-11-28T11:59:05.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.895+0000 7fe46f8c0700 1 --2- 172.21.15.39:0/1219025964 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55883d7edf50 0x55883d77d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:05.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.895+0000 7fe46f0bf700 1 --2- 172.21.15.39:0/1219025964 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55883d72f710 0x55883d7598b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fe460001d80 tx=0x7fe46000b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=977b41915c30cf7c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:05.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.895+0000 7fe46d8bc700 1 -- 172.21.15.39:0/1219025964 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe460014070 con 0x55883d72f710 2023-11-28T11:59:05.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.895+0000 7fe46d8bc700 1 -- 172.21.15.39:0/1219025964 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe460008030 con 0x55883d72f710 2023-11-28T11:59:05.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.895+0000 7fe46d8bc700 1 -- 172.21.15.39:0/1219025964 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46000bcc0 con 0x55883d72f710 2023-11-28T11:59:05.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.895+0000 7fe47158a140 1 -- 172.21.15.39:0/1219025964 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55883d72f710 msgr2=0x55883d7598b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:05.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.895+0000 7fe47158a140 1 --2- 172.21.15.39:0/1219025964 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55883d72f710 0x55883d7598b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fe460001d80 tx=0x7fe46000b4c0 comp rx=0 tx=0).stop 2023-11-28T11:59:05.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.895+0000 7fe47158a140 1 -- 172.21.15.39:0/1219025964 shutdown_connections 2023-11-28T11:59:05.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.895+0000 7fe47158a140 1 --2- 172.21.15.39:0/1219025964 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55883d7edf50 0x55883d77d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:05.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.895+0000 7fe47158a140 1 --2- 172.21.15.39:0/1219025964 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55883d762990 0x55883d8917e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:05.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.895+0000 7fe47158a140 1 --2- 172.21.15.39:0/1219025964 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55883d72f710 0x55883d7598b0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:05.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.895+0000 7fe47158a140 1 -- 172.21.15.39:0/1219025964 >> 172.21.15.39:0/1219025964 conn(0x55883d735c40 msgr2=0x55883d77bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:05.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.899+0000 7fe47158a140 1 -- 172.21.15.39:0/1219025964 shutdown_connections 2023-11-28T11:59:05.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.899+0000 7fe47158a140 1 -- 172.21.15.39:0/1219025964 wait complete. 2023-11-28T11:59:05.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.899+0000 7fe47158a140 1 Processor -- start 2023-11-28T11:59:05.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.899+0000 7fe47158a140 1 -- start start 2023-11-28T11:59:05.904 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.899+0000 7fe47158a140 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55883d72f710 0x55883d7f64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:05.904 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.899+0000 7fe47158a140 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55883d762990 0x55883d7ecbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:05.904 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.899+0000 7fe47158a140 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55883d7edf50 0x55883d757bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:05.904 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.899+0000 7fe47158a140 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55883d759ac0 con 0x55883d7edf50 2023-11-28T11:59:05.904 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.899+0000 7fe47158a140 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55883d759d60 con 0x55883d762990 2023-11-28T11:59:05.904 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.899+0000 7fe47158a140 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55883d75a000 con 0x55883d72f710 2023-11-28T11:59:05.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.903+0000 7fe46f8c0700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55883d7edf50 0x55883d757bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:05.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.903+0000 7fe46f8c0700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55883d7edf50 0x55883d757bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55684/0 (socket says 172.21.15.39:55684) 2023-11-28T11:59:05.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.903+0000 7fe46e8be700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55883d762990 0x55883d7ecbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:05.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.903+0000 7fe46f8c0700 1 -- 172.21.15.39:0/2380382504 learned_addr learned my addr 172.21.15.39:0/2380382504 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:05.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.903+0000 7fe46f0bf700 1 --2- 172.21.15.39:0/2380382504 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55883d72f710 0x55883d7f64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:05.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.903+0000 7fe46f8c0700 1 -- 172.21.15.39:0/2380382504 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55883d72f710 msgr2=0x55883d7f64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:05.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.903+0000 7fe46f8c0700 1 --2- 172.21.15.39:0/2380382504 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55883d72f710 0x55883d7f64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:05.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.903+0000 7fe46f8c0700 1 -- 172.21.15.39:0/2380382504 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55883d762990 msgr2=0x55883d7ecbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:05.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.903+0000 7fe46f8c0700 1 --2- 172.21.15.39:0/2380382504 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55883d762990 0x55883d7ecbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:05.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.903+0000 7fe46f8c0700 1 -- 172.21.15.39:0/2380382504 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe46000a040 con 0x55883d7edf50 2023-11-28T11:59:05.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.903+0000 7fe46e8be700 1 --2- 172.21.15.39:0/2380382504 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55883d762990 0x55883d7ecbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:05.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.903+0000 7fe46f8c0700 1 --2- 172.21.15.39:0/2380382504 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55883d7edf50 0x55883d757bd0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe468002240 tx=0x7fe46800d440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:05.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.903+0000 7fe46c8ba700 1 -- 172.21.15.39:0/2380382504 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4680062e0 con 0x55883d7edf50 2023-11-28T11:59:05.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.903+0000 7fe46c8ba700 1 -- 172.21.15.39:0/2380382504 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46800dac0 con 0x55883d7edf50 2023-11-28T11:59:05.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.903+0000 7fe47158a140 1 -- 172.21.15.39:0/2380382504 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55883d6628b0 con 0x55883d7edf50 2023-11-28T11:59:05.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.903+0000 7fe46c8ba700 1 -- 172.21.15.39:0/2380382504 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46800de50 con 0x55883d7edf50 2023-11-28T11:59:05.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.903+0000 7fe47158a140 1 -- 172.21.15.39:0/2380382504 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55883d66f5d0 con 0x55883d7edf50 2023-11-28T11:59:05.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.907+0000 7fe46c8ba700 1 -- 172.21.15.39:0/2380382504 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe46801a030 con 0x55883d7edf50 2023-11-28T11:59:05.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.907+0000 7fe46c8ba700 1 --2- 172.21.15.39:0/2380382504 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe45c063840 0x7fe45c065cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:05.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.907+0000 7fe46c8ba700 1 -- 172.21.15.39:0/2380382504 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe468080290 con 0x55883d7edf50 2023-11-28T11:59:05.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.907+0000 7fe47158a140 1 --2- 172.21.15.39:0/2380382504 >> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] conn(0x55883d8957b0 0x55883d75ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:05.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.907+0000 7fe47158a140 1 -- 172.21.15.39:0/2380382504 --> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] -- osd_op(unknown.0.0:1 9.7 9:e2e07930:::10000000001.00000000:head [setxattr parent (40) in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58) v8 -- 0x55883d75b1c0 con 0x55883d8957b0 2023-11-28T11:59:05.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.907+0000 7fe46f0bf700 1 --2- 172.21.15.39:0/2380382504 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe45c063840 0x7fe45c065cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:05.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.911+0000 7fe46e8be700 1 --2- 172.21.15.39:0/2380382504 >> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] conn(0x55883d8957b0 0x55883d75ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:05.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.911+0000 7fe46f0bf700 1 --2- 172.21.15.39:0/2380382504 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe45c063840 0x7fe45c065cf0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe46000b500 tx=0x7fe460009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:05.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.911+0000 7fe46e8be700 1 --2- 172.21.15.39:0/2380382504 >> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] conn(0x55883d8957b0 0x55883d75ac80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:05.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.915+0000 7fe46e8be700 1 -- 172.21.15.39:0/2380382504 <== osd.5 v2:172.21.15.184:6808/36505 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (40)] v58'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fe464019040 con 0x55883d8957b0 2023-11-28T11:59:05.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.915+0000 7fe47158a140 1 -- 172.21.15.39:0/2380382504 >> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] conn(0x55883d8957b0 msgr2=0x55883d75ac80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:05.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.915+0000 7fe47158a140 1 --2- 172.21.15.39:0/2380382504 >> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] conn(0x55883d8957b0 0x55883d75ac80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:05.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.915+0000 7fe47158a140 1 -- 172.21.15.39:0/2380382504 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe45c063840 msgr2=0x7fe45c065cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:05.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.915+0000 7fe47158a140 1 --2- 172.21.15.39:0/2380382504 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe45c063840 0x7fe45c065cf0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe46000b500 tx=0x7fe460009000 comp rx=0 tx=0).stop 2023-11-28T11:59:05.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.915+0000 7fe47158a140 1 -- 172.21.15.39:0/2380382504 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55883d7edf50 msgr2=0x55883d757bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:05.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.915+0000 7fe47158a140 1 --2- 172.21.15.39:0/2380382504 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55883d7edf50 0x55883d757bd0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe468002240 tx=0x7fe46800d440 comp rx=0 tx=0).stop 2023-11-28T11:59:05.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.915+0000 7fe46f8c0700 1 -- 172.21.15.39:0/2380382504 reap_dead start 2023-11-28T11:59:05.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.915+0000 7fe47158a140 1 -- 172.21.15.39:0/2380382504 shutdown_connections 2023-11-28T11:59:05.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.915+0000 7fe47158a140 1 -- 172.21.15.39:0/2380382504 >> 172.21.15.39:0/2380382504 conn(0x55883d735c40 msgr2=0x55883d736010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:05.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.915+0000 7fe47158a140 1 -- 172.21.15.39:0/2380382504 shutdown_connections 2023-11-28T11:59:05.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:05.915+0000 7fe47158a140 1 -- 172.21.15.39:0/2380382504 wait complete. 2023-11-28T11:59:05.926 DEBUG:teuthology.orchestra.run.smithi039:> sudo daemon-helper kill ceph --cluster ceph -w 2023-11-28T11:59:05.932 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / repair,recursive 2023-11-28T11:59:06.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.103+0000 7fd00ed58700 1 Processor -- start 2023-11-28T11:59:06.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.107+0000 7fd00ed58700 1 -- start start 2023-11-28T11:59:06.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.107+0000 7fd00ed58700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd008159150 0x7fd0080ad6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.107+0000 7fd00ed58700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd0080caf30 0x7fd0080cb380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.107+0000 7fd00ed58700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0080c9460 con 0x7fd00815cbd0 2023-11-28T11:59:06.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.107+0000 7fd00ed58700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0080c8c00 con 0x7fd0080caf30 2023-11-28T11:59:06.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.107+0000 7fd00ed58700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0080adc00 con 0x7fd008159150 2023-11-28T11:59:06.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.107+0000 7fd00e557700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fd00815cbd0 0x7fd00815d030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:50612/0 (socket says 172.21.15.39:50612) 2023-11-28T11:59:06.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.107+0000 7fd00e557700 1 -- 172.21.15.39:0/1118039959 learned_addr learned my addr 172.21.15.39:0/1118039959 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:59:06.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.107+0000 7fd00d555700 1 --2- 172.21.15.39:0/1118039959 >> v2:172.21.15.184:3300/0 conn(0x7fd0080caf30 0x7fd0080cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.107+0000 7fd00dd56700 1 --2- 172.21.15.39:0/1118039959 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd008159150 0x7fd0080ad6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.107+0000 7fd00cd54700 1 -- 172.21.15.39:0/1118039959 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2101698624 0 0) 0x7fd0080c9460 con 0x7fd00815cbd0 2023-11-28T11:59:06.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.107+0000 7fd00cd54700 1 -- 172.21.15.39:0/1118039959 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcff40035d0 con 0x7fd00815cbd0 2023-11-28T11:59:06.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.107+0000 7fd00cd54700 1 -- 172.21.15.39:0/1118039959 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3643191242 0 0) 0x7fcff40035d0 con 0x7fd00815cbd0 2023-11-28T11:59:06.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.107+0000 7fd00cd54700 1 -- 172.21.15.39:0/1118039959 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd008159150 msgr2=0x7fd0080ad6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:06.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.107+0000 7fd00cd54700 1 --2- 172.21.15.39:0/1118039959 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd008159150 0x7fd0080ad6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.107+0000 7fd00cd54700 1 -- 172.21.15.39:0/1118039959 >> v2:172.21.15.184:3300/0 conn(0x7fd0080caf30 msgr2=0x7fd0080cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:06.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.107+0000 7fd00cd54700 1 --2- 172.21.15.39:0/1118039959 >> v2:172.21.15.184:3300/0 conn(0x7fd0080caf30 0x7fd0080cb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.107+0000 7fd00cd54700 1 -- 172.21.15.39:0/1118039959 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0080cb8c0 con 0x7fd00815cbd0 2023-11-28T11:59:06.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.107+0000 7fd00cd54700 1 -- 172.21.15.39:0/1118039959 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4013383302 0 0) 0x7fd0000019f0 con 0x7fd00815cbd0 2023-11-28T11:59:06.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.107+0000 7fd00cd54700 1 -- 172.21.15.39:0/1118039959 >> v1:172.21.15.39:6789/0 conn(0x7fd00815cbd0 legacy=0x7fd00815d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:06.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.107+0000 7fd00cd54700 1 --2- 172.21.15.39:0/1118039959 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcff4003a20 0x7fcff4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.107+0000 7fd00cd54700 1 --2- 172.21.15.39:0/1118039959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcff4004450 0x7fcff4004910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.107+0000 7fd00cd54700 1 --2- 172.21.15.39:0/1118039959 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd008159150 0x7fcff4005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.107+0000 7fd00cd54700 1 -- 172.21.15.39:0/1118039959 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0080c8c00 con 0x7fcff4003a20 2023-11-28T11:59:06.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.107+0000 7fd00cd54700 1 -- 172.21.15.39:0/1118039959 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0080adc00 con 0x7fcff4004450 2023-11-28T11:59:06.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.107+0000 7fd00cd54700 1 -- 172.21.15.39:0/1118039959 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff400dc40 con 0x7fd008159150 2023-11-28T11:59:06.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.107+0000 7fd00d555700 1 --2- 172.21.15.39:0/1118039959 >> v2:172.21.15.184:3300/0 conn(0x7fd0080caf30 0x7fd0080cb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:06.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.111+0000 7fd00dd56700 1 --2- 172.21.15.39:0/1118039959 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcff4003a20 0x7fcff4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.111+0000 7fd00e557700 1 --2- 172.21.15.39:0/1118039959 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd008159150 0x7fcff4005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.111+0000 7fd00d555700 1 --2- 172.21.15.39:0/1118039959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcff4004450 0x7fcff4004910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.111+0000 7fd00dd56700 1 -- 172.21.15.39:0/1118039959 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd008159150 msgr2=0x7fcff4005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:06.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.111+0000 7fd00dd56700 1 --2- 172.21.15.39:0/1118039959 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd008159150 0x7fcff4005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.111+0000 7fd00dd56700 1 -- 172.21.15.39:0/1118039959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcff4004450 msgr2=0x7fcff4004910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:06.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.111+0000 7fd00dd56700 1 --2- 172.21.15.39:0/1118039959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcff4004450 0x7fcff4004910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.111+0000 7fd00dd56700 1 -- 172.21.15.39:0/1118039959 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff40035d0 con 0x7fcff4003a20 2023-11-28T11:59:06.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.111+0000 7fd00d555700 1 --2- 172.21.15.39:0/1118039959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcff4004450 0x7fcff4004910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:06.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.111+0000 7fd00dd56700 1 --2- 172.21.15.39:0/1118039959 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcff4003a20 0x7fcff4003e30 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd004009b90 tx=0x7fcff40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921021a7f9e513ee server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:06.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.111+0000 7fd00cd54700 1 -- 172.21.15.39:0/1118039959 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd004005a40 con 0x7fcff4003a20 2023-11-28T11:59:06.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.111+0000 7fd00cd54700 1 -- 172.21.15.39:0/1118039959 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd004005ba0 con 0x7fcff4003a20 2023-11-28T11:59:06.123 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.111+0000 7fd00cd54700 1 -- 172.21.15.39:0/1118039959 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00400e6c0 con 0x7fcff4003a20 2023-11-28T11:59:06.123 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.111+0000 7fd00ed58700 1 -- 172.21.15.39:0/1118039959 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcff4003a20 msgr2=0x7fcff4003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:06.123 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.111+0000 7fd00ed58700 1 --2- 172.21.15.39:0/1118039959 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcff4003a20 0x7fcff4003e30 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd004009b90 tx=0x7fcff40058a0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.123 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.111+0000 7fd00e557700 1 -- 172.21.15.39:0/1118039959 reap_dead start 2023-11-28T11:59:06.123 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.111+0000 7fd00ed58700 1 -- 172.21.15.39:0/1118039959 shutdown_connections 2023-11-28T11:59:06.123 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.111+0000 7fd00ed58700 1 -- 172.21.15.39:0/1118039959 >> 172.21.15.39:0/1118039959 conn(0x7fd0080ce5b0 msgr2=0x7fd0080ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:06.124 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.111+0000 7fd00ed58700 1 -- 172.21.15.39:0/1118039959 shutdown_connections 2023-11-28T11:59:06.124 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.111+0000 7fd00ed58700 1 -- 172.21.15.39:0/1118039959 wait complete. 2023-11-28T11:59:06.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.115+0000 7fd00ed58700 1 Processor -- start 2023-11-28T11:59:06.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.115+0000 7fd00ed58700 1 -- start start 2023-11-28T11:59:06.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.115+0000 7fd00ed58700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcff4003a20 0x7fd0080aba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.115+0000 7fd00ed58700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd00806aca0 0x7fd0080abf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.115+0000 7fd00ed58700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd00806ba70 0x7fd008159520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.115+0000 7fd00ed58700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0080b0a80 con 0x7fd00806ba70 2023-11-28T11:59:06.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.115+0000 7fd00ed58700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd008070000 con 0x7fd00806aca0 2023-11-28T11:59:06.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.115+0000 7fd00ed58700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd00815b380 con 0x7fcff4003a20 2023-11-28T11:59:06.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.115+0000 7fd00e557700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd00806ba70 0x7fd008159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.115+0000 7fd00e557700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd00806ba70 0x7fd008159520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55702/0 (socket says 172.21.15.39:55702) 2023-11-28T11:59:06.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.115+0000 7fd00e557700 1 -- 172.21.15.39:0/1865394996 learned_addr learned my addr 172.21.15.39:0/1865394996 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:06.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.115+0000 7fd00dd56700 1 --2- 172.21.15.39:0/1865394996 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcff4003a20 0x7fd0080aba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.119+0000 7fd00d555700 1 --2- 172.21.15.39:0/1865394996 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd00806aca0 0x7fd0080abf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.119+0000 7fd00e557700 1 -- 172.21.15.39:0/1865394996 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcff4003a20 msgr2=0x7fd0080aba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:06.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.119+0000 7fd00e557700 1 --2- 172.21.15.39:0/1865394996 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcff4003a20 0x7fd0080aba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.119+0000 7fd00e557700 1 -- 172.21.15.39:0/1865394996 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd00806aca0 msgr2=0x7fd0080abf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:06.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.119+0000 7fd00e557700 1 --2- 172.21.15.39:0/1865394996 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd00806aca0 0x7fd0080abf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.132 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.119+0000 7fd00e557700 1 -- 172.21.15.39:0/1865394996 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0080c8e10 con 0x7fd00806ba70 2023-11-28T11:59:06.132 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.119+0000 7fd00d555700 1 --2- 172.21.15.39:0/1865394996 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd00806aca0 0x7fd0080abf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:06.132 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.119+0000 7fd00e557700 1 --2- 172.21.15.39:0/1865394996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd00806ba70 0x7fd008159520 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd00806fef0 tx=0x7fd0000019e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:06.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.119+0000 7fcffe7fc700 1 -- 172.21.15.39:0/1865394996 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd000007800 con 0x7fd00806ba70 2023-11-28T11:59:06.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.119+0000 7fcffe7fc700 1 -- 172.21.15.39:0/1865394996 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd000007960 con 0x7fd00806ba70 2023-11-28T11:59:06.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.119+0000 7fd00ed58700 1 -- 172.21.15.39:0/1865394996 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd00806a9c0 con 0x7fd00806ba70 2023-11-28T11:59:06.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.119+0000 7fcffe7fc700 1 -- 172.21.15.39:0/1865394996 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0000133f0 con 0x7fd00806ba70 2023-11-28T11:59:06.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.119+0000 7fd00ed58700 1 -- 172.21.15.39:0/1865394996 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0080c90f0 con 0x7fd00806ba70 2023-11-28T11:59:06.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.123+0000 7fcffe7fc700 1 -- 172.21.15.39:0/1865394996 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd000013570 con 0x7fd00806ba70 2023-11-28T11:59:06.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.123+0000 7fcffe7fc700 1 --2- 172.21.15.39:0/1865394996 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcfec064ee0 0x7fcfec067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.123+0000 7fcffe7fc700 1 -- 172.21.15.39:0/1865394996 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd000082680 con 0x7fd00806ba70 2023-11-28T11:59:06.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.123+0000 7fd00dd56700 1 --2- 172.21.15.39:0/1865394996 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcfec064ee0 0x7fcfec067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.123+0000 7fd00dd56700 1 --2- 172.21.15.39:0/1865394996 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcfec064ee0 0x7fcfec067390 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd004009ab0 tx=0x7fd004008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:06.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.127+0000 7fd01323f740 1 Processor -- start 2023-11-28T11:59:06.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.127+0000 7fd01323f740 1 -- start start 2023-11-28T11:59:06.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.127+0000 7fd01323f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xe1ed80 0x10ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.127+0000 7fd01323f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xe1e9b0 0x10d5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.127+0000 7fd01323f740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xe69a30 0x10d6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.127+0000 7fd01323f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0xf8dc80 con 0xe1ed80 2023-11-28T11:59:06.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.127+0000 7fd01323f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0xffdd60 con 0xe1e9b0 2023-11-28T11:59:06.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.127+0000 7fd01323f740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0xff7060 con 0xe69a30 2023-11-28T11:59:06.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.127+0000 7fd00dd56700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xe1ed80 0x10ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.127+0000 7fd00dd56700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xe1ed80 0x10ccd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55704/0 (socket says 172.21.15.39:55704) 2023-11-28T11:59:06.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.127+0000 7fd00dd56700 1 -- 172.21.15.39:0/246422434 learned_addr learned my addr 172.21.15.39:0/246422434 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:06.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.131+0000 7fd00e557700 1 --2- 172.21.15.39:0/246422434 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xe69a30 0x10d6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.131+0000 7fd00d555700 1 --2- 172.21.15.39:0/246422434 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xe1e9b0 0x10d5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.131+0000 7fd00dd56700 1 -- 172.21.15.39:0/246422434 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xe69a30 msgr2=0x10d6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:06.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.131+0000 7fd00dd56700 1 --2- 172.21.15.39:0/246422434 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xe69a30 0x10d6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.131+0000 7fd00dd56700 1 -- 172.21.15.39:0/246422434 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xe1e9b0 msgr2=0x10d5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:06.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.131+0000 7fd00dd56700 1 --2- 172.21.15.39:0/246422434 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xe1e9b0 0x10d5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.131+0000 7fd00dd56700 1 -- 172.21.15.39:0/246422434 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x101c4e0 con 0xe1ed80 2023-11-28T11:59:06.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.131+0000 7fd00e557700 1 --2- 172.21.15.39:0/246422434 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xe69a30 0x10d6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:59:06.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.131+0000 7fd00d555700 1 --2- 172.21.15.39:0/246422434 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xe1e9b0 0x10d5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:59:06.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.131+0000 7fd00dd56700 1 --2- 172.21.15.39:0/246422434 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xe1ed80 0x10ccd70 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd004005f80 tx=0x7fd004013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a66a238b6ae160b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:06.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.131+0000 7fcfeb7fe700 1 -- 172.21.15.39:0/246422434 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00400ee00 con 0xe1ed80 2023-11-28T11:59:06.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.131+0000 7fcfeb7fe700 1 -- 172.21.15.39:0/246422434 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd004021040 con 0xe1ed80 2023-11-28T11:59:06.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.131+0000 7fcfeb7fe700 1 -- 172.21.15.39:0/246422434 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd004006250 con 0xe1ed80 2023-11-28T11:59:06.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.131+0000 7fd01323f740 1 -- 172.21.15.39:0/246422434 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xe1ed80 msgr2=0x10ccd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:06.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.131+0000 7fd01323f740 1 --2- 172.21.15.39:0/246422434 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xe1ed80 0x10ccd70 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd004005f80 tx=0x7fd004013000 comp rx=0 tx=0).stop 2023-11-28T11:59:06.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.131+0000 7fd01323f740 1 -- 172.21.15.39:0/246422434 shutdown_connections 2023-11-28T11:59:06.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.131+0000 7fd01323f740 1 --2- 172.21.15.39:0/246422434 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xe69a30 0x10d6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.131+0000 7fd01323f740 1 --2- 172.21.15.39:0/246422434 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xe1e9b0 0x10d5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.131+0000 7fd01323f740 1 --2- 172.21.15.39:0/246422434 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xe1ed80 0x10ccd70 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.131+0000 7fd01323f740 1 -- 172.21.15.39:0/246422434 >> 172.21.15.39:0/246422434 conn(0xe1f150 msgr2=0x10b7350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:06.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.131+0000 7fd01323f740 1 -- 172.21.15.39:0/246422434 shutdown_connections 2023-11-28T11:59:06.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.131+0000 7fd01323f740 1 -- 172.21.15.39:0/246422434 wait complete. 2023-11-28T11:59:06.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.131+0000 7fd01323f740 1 -- start start 2023-11-28T11:59:06.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.131+0000 7fd01323f740 1 Processor -- start 2023-11-28T11:59:06.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.135+0000 7f5d788b9700 1 Processor -- start 2023-11-28T11:59:06.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.135+0000 7f5d788b9700 1 -- start start 2023-11-28T11:59:06.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.135+0000 7fd01323f740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xe1e9b0 0x10cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.135+0000 7fd01323f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xe1ed80 0x108fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.135+0000 7fd01323f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xe69a30 0x10ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.135+0000 7fd01323f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0xea3dc0 con 0xe1ed80 2023-11-28T11:59:06.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.135+0000 7fd01323f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x108e550 con 0xe69a30 2023-11-28T11:59:06.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.135+0000 7fd01323f740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x108e7f0 con 0xe1e9b0 2023-11-28T11:59:06.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.135+0000 7fd01323f740 10 client.0 _ll_register_callbacks cb 0x1052b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:59:06.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.135+0000 7fd00d555700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xe1ed80 0x108fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.135+0000 7fd00d555700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xe1ed80 0x108fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55712/0 (socket says 172.21.15.39:55712) 2023-11-28T11:59:06.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.135+0000 7fd00d555700 1 -- 172.21.15.39:0/2421166842 learned_addr learned my addr 172.21.15.39:0/2421166842 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:06.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.135+0000 7fd00dd56700 1 --2- 172.21.15.39:0/2421166842 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xe1e9b0 0x10cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.135+0000 7fd00e557700 1 --2- 172.21.15.39:0/2421166842 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xe69a30 0x10ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.135+0000 7f5d788b9700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d7406c040 0x7f5d7406ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.135+0000 7f5d788b9700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5d740b1de0 0x7f5d7415d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.135+0000 7f5d788b9700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d7415db20 con 0x7f5d74159030 2023-11-28T11:59:06.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.135+0000 7f5d788b9700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d740b1950 con 0x7f5d740b1de0 2023-11-28T11:59:06.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.135+0000 7f5d788b9700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7406d340 con 0x7f5d7406c040 2023-11-28T11:59:06.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.135+0000 7f5d7359e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5d740b1de0 0x7f5d7415d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.135+0000 7fd00d555700 1 -- 172.21.15.39:0/2421166842 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xe1e9b0 msgr2=0x10cc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:06.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.135+0000 7fd00d555700 1 --2- 172.21.15.39:0/2421166842 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xe1e9b0 0x10cc5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.135+0000 7fd00d555700 1 -- 172.21.15.39:0/2421166842 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xe69a30 msgr2=0x10ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:06.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.135+0000 7fd00d555700 1 --2- 172.21.15.39:0/2421166842 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xe69a30 0x10ce610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.135+0000 7fd00d555700 1 -- 172.21.15.39:0/2421166842 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcff40035d0 con 0xe1ed80 2023-11-28T11:59:06.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.135+0000 7f5d7359e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5d740b1de0 0x7f5d7415d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55724/0 (socket says 172.21.15.39:55724) 2023-11-28T11:59:06.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.135+0000 7f5d7359e700 1 -- 172.21.15.39:0/1035854681 learned_addr learned my addr 172.21.15.39:0/1035854681 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:06.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.135+0000 7f5d72d9d700 1 --1- 172.21.15.39:0/1035854681 >> v1:172.21.15.184:6789/0 conn(0x7f5d74159030 0x7f5d7406b930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:53198/0 (socket says 172.21.15.39:53198) 2023-11-28T11:59:06.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.135+0000 7f5d7359e700 1 -- 172.21.15.39:0/1035854681 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d7406c040 msgr2=0x7f5d7406ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:06.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.135+0000 7f5d7359e700 1 --2- 172.21.15.39:0/1035854681 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d7406c040 0x7f5d7406ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.135+0000 7f5d7359e700 1 -- 172.21.15.39:0/1035854681 >> v1:172.21.15.184:6789/0 conn(0x7f5d74159030 legacy=0x7f5d7406b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:06.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.135+0000 7fd00d555700 1 --2- 172.21.15.39:0/2421166842 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xe1ed80 0x108fa00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fcff8009b20 tx=0x7fcff8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69acafd869e852b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:06.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.135+0000 7fcfe8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-11-28T11:59:06.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.135+0000 7f5d7359e700 1 -- 172.21.15.39:0/1035854681 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d7406d060 con 0x7f5d740b1de0 2023-11-28T11:59:06.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.139+0000 7f5d7359e700 1 --2- 172.21.15.39:0/1035854681 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d740b1de0 0x7f5d7415d5e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c009e50 tx=0x7f5d6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2c2e96ec9cec02d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:06.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.139+0000 7fcfe8ff9700 1 -- 172.21.15.39:0/2421166842 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff8003dc0 con 0xe1ed80 2023-11-28T11:59:06.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.139+0000 7fd01323f740 1 -- 172.21.15.39:0/2421166842 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xff00e0 con 0xe1ed80 2023-11-28T11:59:06.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.139+0000 7fcfe8ff9700 1 -- 172.21.15.39:0/2421166842 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fcff8016460 con 0xe1ed80 2023-11-28T11:59:06.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.139+0000 7f5d71d9b700 1 -- 172.21.15.39:0/1035854681 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c00e070 con 0x7f5d740b1de0 2023-11-28T11:59:06.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.139+0000 7f5d71d9b700 1 -- 172.21.15.39:0/1035854681 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6c00b9c0 con 0x7f5d740b1de0 2023-11-28T11:59:06.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.139+0000 7f5d71d9b700 1 -- 172.21.15.39:0/1035854681 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c00bd70 con 0x7f5d740b1de0 2023-11-28T11:59:06.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.139+0000 7fcfe8ff9700 1 -- 172.21.15.39:0/2421166842 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcff8016620 con 0xe1ed80 2023-11-28T11:59:06.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.139+0000 7fd01323f740 10 client.5997 fetch_fsmap learned FSMap version 24 2023-11-28T11:59:06.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.139+0000 7fd01323f740 1 -- 172.21.15.39:0/2421166842 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0xe6ac80 con 0xe1ed80 2023-11-28T11:59:06.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.139+0000 7fcfe8ff9700 1 -- 172.21.15.39:0/2421166842 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xff00e0 con 0xe1ed80 2023-11-28T11:59:06.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.139+0000 7fcfe8ff9700 1 -- 172.21.15.39:0/2421166842 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fcff8016780 con 0xe1ed80 2023-11-28T11:59:06.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.139+0000 7fd01323f740 10 client.5997 fetch_fsmap finished waiting for FSMap version 24 2023-11-28T11:59:06.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.139+0000 7fd01323f740 10 client.5997 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.b 2023-11-28T11:59:06.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.139+0000 7fd01323f740 20 client.5997 populate_metadata read hostname 'smithi039' 2023-11-28T11:59:06.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.139+0000 7fd01323f740 1 --2- 172.21.15.39:0/2421166842 >> [v2:172.21.15.184:6836/367294936,v1:172.21.15.184:6837/367294936] conn(0x108ca90 0x108ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.139+0000 7fd01323f740 4 client.5997 mds_command: new command op to 5809 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T11:59:06.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.139+0000 7fd01323f740 1 -- 172.21.15.39:0/2421166842 --> [v2:172.21.15.184:6836/367294936,v1:172.21.15.184:6837/367294936] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xfefe00 con 0x108ca90 2023-11-28T11:59:06.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.139+0000 7f5d788b9700 1 -- 172.21.15.39:0/1035854681 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d740b1de0 msgr2=0x7f5d7415d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:06.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.139+0000 7f5d788b9700 1 --2- 172.21.15.39:0/1035854681 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d740b1de0 0x7f5d7415d5e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c009e50 tx=0x7f5d6c00b330 comp rx=0 tx=0).stop 2023-11-28T11:59:06.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.139+0000 7f5d788b9700 1 -- 172.21.15.39:0/1035854681 shutdown_connections 2023-11-28T11:59:06.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.139+0000 7f5d788b9700 1 --2- 172.21.15.39:0/1035854681 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d740b1de0 0x7f5d7415d5e0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.139+0000 7f5d788b9700 1 --2- 172.21.15.39:0/1035854681 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d7406c040 0x7f5d7406ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.139+0000 7f5d788b9700 1 -- 172.21.15.39:0/1035854681 >> 172.21.15.39:0/1035854681 conn(0x7f5d740b2630 msgr2=0x7f5d740b2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:06.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.139+0000 7f5d788b9700 1 -- 172.21.15.39:0/1035854681 shutdown_connections 2023-11-28T11:59:06.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.139+0000 7f5d788b9700 1 -- 172.21.15.39:0/1035854681 wait complete. 2023-11-28T11:59:06.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.139+0000 7fd00dd56700 1 --2- 172.21.15.39:0/2421166842 >> [v2:172.21.15.184:6836/367294936,v1:172.21.15.184:6837/367294936] conn(0x108ca90 0x108ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.139+0000 7fcfe8ff9700 10 client.5997 ms_handle_connect on v2:172.21.15.184:6836/367294936 2023-11-28T11:59:06.158 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.139+0000 7fd00dd56700 1 --2- 172.21.15.39:0/2421166842 >> [v2:172.21.15.184:6836/367294936,v1:172.21.15.184:6837/367294936] conn(0x108ca90 0x108ce90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce74dac879bf3bb8 server_cookie=766352f88c2ce703 in_seq=0 out_seq=0 2023-11-28T11:59:06.158 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.143+0000 7f5d788b9700 1 Processor -- start 2023-11-28T11:59:06.158 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.143+0000 7f5d788b9700 1 -- start start 2023-11-28T11:59:06.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.143+0000 7fcfe8ff9700 1 -- 172.21.15.39:0/2421166842 <== mds.0 v2:172.21.15.184:6836/367294936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0xfefe00 con 0x108ca90 2023-11-28T11:59:06.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.143+0000 7fcfe8ff9700 10 client.5997 handle_command_reply: tid=0 2023-11-28T11:59:06.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.143+0000 7fd01323f740 1 client.5997 shutdown 2023-11-28T11:59:06.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.143+0000 7fd01323f740 1 -- 172.21.15.39:0/2421166842 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xe1ed80 msgr2=0x108fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:06.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.143+0000 7fd01323f740 1 --2- 172.21.15.39:0/2421166842 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xe1ed80 0x108fa00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fcff8009b20 tx=0x7fcff8009e30 comp rx=0 tx=0).stop 2023-11-28T11:59:06.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.143+0000 7fd01323f740 1 -- 172.21.15.39:0/2421166842 shutdown_connections 2023-11-28T11:59:06.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.143+0000 7fd01323f740 1 --2- 172.21.15.39:0/2421166842 >> [v2:172.21.15.184:6836/367294936,v1:172.21.15.184:6837/367294936] conn(0x108ca90 0x108ce90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.143+0000 7fd01323f740 1 --2- 172.21.15.39:0/2421166842 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xe69a30 0x10ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.143+0000 7fd01323f740 1 --2- 172.21.15.39:0/2421166842 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xe1ed80 0x108fa00 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.143+0000 7fd01323f740 1 --2- 172.21.15.39:0/2421166842 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xe1e9b0 0x10cc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.143+0000 7fcfe8ff9700 0 client.5997 ms_handle_reset on v2:172.21.15.184:6836/367294936 2023-11-28T11:59:06.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.143+0000 7fd01323f740 1 -- 172.21.15.39:0/2421166842 >> 172.21.15.39:0/2421166842 conn(0xe1f150 msgr2=0x10b6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:06.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.143+0000 7f5d788b9700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d7406c040 0x7f5d7414c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.143+0000 7f5d788b9700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d740b1de0 0x7f5d740c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.143+0000 7f5d788b9700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d74159030 0x7f5d740c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.143+0000 7f5d788b9700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7414cef0 con 0x7f5d74159030 2023-11-28T11:59:06.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.143+0000 7f5d788b9700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d740c9ab0 con 0x7f5d7406c040 2023-11-28T11:59:06.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.143+0000 7f5d788b9700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d740cd920 con 0x7f5d740b1de0 2023-11-28T11:59:06.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.143+0000 7f5d7359e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d74159030 0x7f5d740c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.143+0000 7fd01323f740 1 -- 172.21.15.39:0/2421166842 shutdown_connections 2023-11-28T11:59:06.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.143+0000 7f5d7359e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d74159030 0x7f5d740c89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55730/0 (socket says 172.21.15.39:55730) 2023-11-28T11:59:06.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.143+0000 7f5d7359e700 1 -- 172.21.15.39:0/967669953 learned_addr learned my addr 172.21.15.39:0/967669953 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:06.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.143+0000 7fd01323f740 1 -- 172.21.15.39:0/2421166842 wait complete. 2023-11-28T11:59:06.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.143+0000 7f5d72d9d700 1 --2- 172.21.15.39:0/967669953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d7406c040 0x7f5d7414c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.143+0000 7f5d7259c700 1 --2- 172.21.15.39:0/967669953 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d740b1de0 0x7f5d740c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.143+0000 7f5d7359e700 1 -- 172.21.15.39:0/967669953 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d740b1de0 msgr2=0x7f5d740c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:06.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.143+0000 7f5d7359e700 1 --2- 172.21.15.39:0/967669953 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d740b1de0 0x7f5d740c84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.143+0000 7f5d7359e700 1 -- 172.21.15.39:0/967669953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d7406c040 msgr2=0x7f5d7414c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:06.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.143+0000 7f5d7359e700 1 --2- 172.21.15.39:0/967669953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d7406c040 0x7f5d7414c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.143+0000 7f5d7359e700 1 -- 172.21.15.39:0/967669953 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d6c009b30 con 0x7f5d74159030 2023-11-28T11:59:06.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.143+0000 7fd01323f740 20 client.5997 trim_cache size 0 max 16384 2023-11-28T11:59:06.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.143+0000 7f5d7359e700 1 --2- 172.21.15.39:0/967669953 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d74159030 0x7f5d740c89f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f5d740734b0 tx=0x7f5d6c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:06.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.143+0000 7f5d6b7fe700 1 -- 172.21.15.39:0/967669953 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c004960 con 0x7f5d74159030 2023-11-28T11:59:06.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.143+0000 7f5d6b7fe700 1 -- 172.21.15.39:0/967669953 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6c0099b0 con 0x7f5d74159030 2023-11-28T11:59:06.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.143+0000 7f5d788b9700 1 -- 172.21.15.39:0/967669953 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d740b15e0 con 0x7f5d74159030 2023-11-28T11:59:06.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.143+0000 7f5d6b7fe700 1 -- 172.21.15.39:0/967669953 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c01c680 con 0x7f5d74159030 2023-11-28T11:59:06.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.143+0000 7f5d788b9700 1 -- 172.21.15.39:0/967669953 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d740b1300 con 0x7f5d74159030 2023-11-28T11:59:06.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.147+0000 7f5d788b9700 1 -- 172.21.15.39:0/967669953 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f5d74159400 con 0x7f5d74159030 2023-11-28T11:59:06.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.147+0000 7f5d6b7fe700 1 -- 172.21.15.39:0/967669953 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5d6c02c070 con 0x7f5d74159030 2023-11-28T11:59:06.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.147+0000 7f5d6b7fe700 1 --2- 172.21.15.39:0/967669953 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5d54064ee0 0x7f5d54067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.147+0000 7f5d6b7fe700 1 -- 172.21.15.39:0/967669953 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f5d6c083cf0 con 0x7f5d74159030 2023-11-28T11:59:06.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.147+0000 7f5d6b7fe700 1 -- 172.21.15.39:0/967669953 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+502 (secure 0 0 0) 0x7f5d6c089350 con 0x7f5d74159030 2023-11-28T11:59:06.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.147+0000 7f5d72d9d700 1 --2- 172.21.15.39:0/967669953 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5d54064ee0 0x7f5d54067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.147+0000 7f5d788b9700 1 -- 172.21.15.39:0/967669953 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7f5d7404ee90 con 0x7f5d74159030 2023-11-28T11:59:06.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.151+0000 7f5d72d9d700 1 --2- 172.21.15.39:0/967669953 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5d54064ee0 0x7f5d54067390 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5d64000f60 tx=0x7f5d64007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:06.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.163+0000 7fd01323f740 1 Processor -- start 2023-11-28T11:59:06.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.163+0000 7fd01323f740 1 -- start start 2023-11-28T11:59:06.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.163+0000 7fd01323f740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xe1e9b0 0x10a0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.163+0000 7fd01323f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xe1ed80 0x108b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.163+0000 7fd01323f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xe69a30 0x108be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.163+0000 7fd01323f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0xffb060 con 0xe1ed80 2023-11-28T11:59:06.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.163+0000 7fd01323f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0xff29d0 con 0xe69a30 2023-11-28T11:59:06.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.163+0000 7fd01323f740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0xffb1d0 con 0xe1e9b0 2023-11-28T11:59:06.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.167+0000 7fd00dd56700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xe1e9b0 0x10a0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.167+0000 7fd00dd56700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xe1e9b0 0x10a0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:37092/0 (socket says 172.21.15.39:37092) 2023-11-28T11:59:06.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.167+0000 7fd00d555700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xe1ed80 0x108b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.167+0000 7fd00dd56700 1 -- 172.21.15.39:0/2584945781 learned_addr learned my addr 172.21.15.39:0/2584945781 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:06.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.167+0000 7fd00e557700 1 --2- 172.21.15.39:0/2584945781 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xe69a30 0x108be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.167+0000 7fd00dd56700 1 -- 172.21.15.39:0/2584945781 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xe69a30 msgr2=0x108be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:06.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.167+0000 7fd00dd56700 1 --2- 172.21.15.39:0/2584945781 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xe69a30 0x108be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.167+0000 7fd00dd56700 1 -- 172.21.15.39:0/2584945781 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xe1ed80 msgr2=0x108b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:06.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.167+0000 7fd00dd56700 1 --2- 172.21.15.39:0/2584945781 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xe1ed80 0x108b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.167+0000 7fd00dd56700 1 -- 172.21.15.39:0/2584945781 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0080b0f20 con 0xe1e9b0 2023-11-28T11:59:06.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.167+0000 7fd00d555700 1 --2- 172.21.15.39:0/2584945781 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xe1ed80 0x108b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:06.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.167+0000 7fd00dd56700 1 --2- 172.21.15.39:0/2584945781 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xe1e9b0 0x10a0a80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd004034040 tx=0x7fd004023000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15a38dc472d2e026 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:06.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.167+0000 7fcfebfff700 1 -- 172.21.15.39:0/2584945781 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0040098d0 con 0xe1e9b0 2023-11-28T11:59:06.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.167+0000 7fcfebfff700 1 -- 172.21.15.39:0/2584945781 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0040420d0 con 0xe1e9b0 2023-11-28T11:59:06.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.167+0000 7fcfebfff700 1 -- 172.21.15.39:0/2584945781 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd004042440 con 0xe1e9b0 2023-11-28T11:59:06.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.167+0000 7fd01323f740 1 -- 172.21.15.39:0/2584945781 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xe1e9b0 msgr2=0x10a0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:06.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.167+0000 7fd01323f740 1 --2- 172.21.15.39:0/2584945781 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xe1e9b0 0x10a0a80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd004034040 tx=0x7fd004023000 comp rx=0 tx=0).stop 2023-11-28T11:59:06.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.167+0000 7fd01323f740 1 -- 172.21.15.39:0/2584945781 shutdown_connections 2023-11-28T11:59:06.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.167+0000 7fd01323f740 1 --2- 172.21.15.39:0/2584945781 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xe69a30 0x108be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.167+0000 7fd01323f740 1 --2- 172.21.15.39:0/2584945781 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xe1ed80 0x108b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.167+0000 7fd01323f740 1 --2- 172.21.15.39:0/2584945781 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xe1e9b0 0x10a0a80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.167+0000 7fd01323f740 1 -- 172.21.15.39:0/2584945781 >> 172.21.15.39:0/2584945781 conn(0xe1f150 msgr2=0x10b7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:06.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.167+0000 7fd01323f740 1 -- 172.21.15.39:0/2584945781 shutdown_connections 2023-11-28T11:59:06.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.171+0000 7fd01323f740 1 -- 172.21.15.39:0/2584945781 wait complete. 2023-11-28T11:59:06.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.171+0000 7fd01323f740 1 -- start start 2023-11-28T11:59:06.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.171+0000 7fd01323f740 1 Processor -- start 2023-11-28T11:59:06.178 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.171+0000 7fd01323f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xe1e9b0 0x10cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.179 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.171+0000 7fd01323f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xe1ed80 0x10eb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.179 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.171+0000 7fd01323f740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xe69a30 0x10eb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.179 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.171+0000 7fd01323f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0xf9c480 con 0xe1e9b0 2023-11-28T11:59:06.179 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.171+0000 7fd01323f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x10cd7f0 con 0xe1ed80 2023-11-28T11:59:06.179 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.171+0000 7fd01323f740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x108c200 con 0xe69a30 2023-11-28T11:59:06.179 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.171+0000 7fd01323f740 10 client.0 _ll_register_callbacks cb 0x101d910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:59:06.180 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.171+0000 7fd00dd56700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xe1e9b0 0x10cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.180 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.171+0000 7fd00dd56700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xe1e9b0 0x10cd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55742/0 (socket says 172.21.15.39:55742) 2023-11-28T11:59:06.180 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.171+0000 7fd00dd56700 1 -- 172.21.15.39:0/2953041210 learned_addr learned my addr 172.21.15.39:0/2953041210 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:06.180 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.171+0000 7fd00d555700 1 --2- 172.21.15.39:0/2953041210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xe1ed80 0x10eb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.180 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.171+0000 7fd00e557700 1 --2- 172.21.15.39:0/2953041210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xe69a30 0x10eb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.180 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.171+0000 7fd00dd56700 1 -- 172.21.15.39:0/2953041210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xe69a30 msgr2=0x10eb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:06.181 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.171+0000 7fd00dd56700 1 --2- 172.21.15.39:0/2953041210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xe69a30 0x10eb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.181 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.171+0000 7fd00dd56700 1 -- 172.21.15.39:0/2953041210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xe1ed80 msgr2=0x10eb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:06.181 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.171+0000 7fd00dd56700 1 --2- 172.21.15.39:0/2953041210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xe1ed80 0x10eb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.181 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.171+0000 7fd00dd56700 1 -- 172.21.15.39:0/2953041210 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xe6ac80 con 0xe1e9b0 2023-11-28T11:59:06.181 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.171+0000 7fd00e557700 1 --2- 172.21.15.39:0/2953041210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xe69a30 0x10eb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:59:06.181 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.175+0000 7fd00dd56700 1 --2- 172.21.15.39:0/2953041210 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xe1e9b0 0x10cd2b0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd004000c00 tx=0x7fd004011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1db738b75933093 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:06.182 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.175+0000 7fcfe8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-11-28T11:59:06.182 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.175+0000 7fcfe8ff9700 1 -- 172.21.15.39:0/2953041210 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd004042bc0 con 0xe1e9b0 2023-11-28T11:59:06.182 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.175+0000 7fcfe8ff9700 1 -- 172.21.15.39:0/2953041210 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd004042d20 con 0xe1e9b0 2023-11-28T11:59:06.182 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.175+0000 7fd01323f740 1 -- 172.21.15.39:0/2953041210 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd004021040 con 0xe1e9b0 2023-11-28T11:59:06.182 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.175+0000 7fcfe8ff9700 1 -- 172.21.15.39:0/2953041210 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd00400ee60 con 0xe1e9b0 2023-11-28T11:59:06.182 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.175+0000 7fd01323f740 10 client.6009 fetch_fsmap learned FSMap version 24 2023-11-28T11:59:06.182 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.175+0000 7fd01323f740 1 -- 172.21.15.39:0/2953041210 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x101c4e0 con 0xe1e9b0 2023-11-28T11:59:06.183 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.175+0000 7fcfe8ff9700 1 -- 172.21.15.39:0/2953041210 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd004021040 con 0xe1e9b0 2023-11-28T11:59:06.183 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.175+0000 7fcfe8ff9700 1 -- 172.21.15.39:0/2953041210 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fd004011070 con 0xe1e9b0 2023-11-28T11:59:06.183 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.175+0000 7fd01323f740 10 client.6009 fetch_fsmap finished waiting for FSMap version 24 2023-11-28T11:59:06.183 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.175+0000 7fd01323f740 10 client.6009 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.b 2023-11-28T11:59:06.183 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.175+0000 7fd01323f740 20 client.6009 populate_metadata read hostname 'smithi039' 2023-11-28T11:59:06.183 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.175+0000 7fd01323f740 1 --2- 172.21.15.39:0/2953041210 >> [v2:172.21.15.184:6836/367294936,v1:172.21.15.184:6837/367294936] conn(0x10ebd30 0x1135350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.183 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.175+0000 7fd01323f740 4 client.6009 mds_command: new command op to 5809 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2023-11-28T11:59:06.184 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.175+0000 7fd01323f740 1 -- 172.21.15.39:0/2953041210 --> [v2:172.21.15.184:6836/367294936,v1:172.21.15.184:6837/367294936] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) v1 -- 0xe9b500 con 0x10ebd30 2023-11-28T11:59:06.184 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.175+0000 7fd00d555700 1 --2- 172.21.15.39:0/2953041210 >> [v2:172.21.15.184:6836/367294936,v1:172.21.15.184:6837/367294936] conn(0x10ebd30 0x1135350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.185 INFO:tasks.ceph.mds.b.smithi184.stderr:2023-11-28T11:59:06.179+0000 7fc06ce9a700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5977=0-4194304@1} caps={5977=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5977 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x55e64a20db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-11-28T11:59:06.187 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.175+0000 7fd00d555700 1 --2- 172.21.15.39:0/2953041210 >> [v2:172.21.15.184:6836/367294936,v1:172.21.15.184:6837/367294936] conn(0x10ebd30 0x1135350 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6ef5040f741d256 server_cookie=60d35adba4984183 in_seq=0 out_seq=0 2023-11-28T11:59:06.187 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.175+0000 7fcfe8ff9700 10 client.6009 ms_handle_connect on v2:172.21.15.184:6836/367294936 2023-11-28T11:59:06.187 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.179+0000 7fcfe8ff9700 1 -- 172.21.15.39:0/2953041210 <== mds.0 v2:172.21.15.184:6836/367294936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0xe9b500 con 0x10ebd30 2023-11-28T11:59:06.187 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.179+0000 7fcfe8ff9700 10 client.6009 handle_command_reply: tid=0 2023-11-28T11:59:06.187 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.179+0000 7fd01323f740 1 client.6009 shutdown 2023-11-28T11:59:06.187 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.179+0000 7fd01323f740 1 -- 172.21.15.39:0/2953041210 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xe1e9b0 msgr2=0x10cd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:06.187 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.179+0000 7fd01323f740 1 --2- 172.21.15.39:0/2953041210 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xe1e9b0 0x10cd2b0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd004000c00 tx=0x7fd004011000 comp rx=0 tx=0).stop 2023-11-28T11:59:06.187 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.179+0000 7fd01323f740 1 -- 172.21.15.39:0/2953041210 shutdown_connections 2023-11-28T11:59:06.187 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.179+0000 7fd01323f740 1 --2- 172.21.15.39:0/2953041210 >> [v2:172.21.15.184:6836/367294936,v1:172.21.15.184:6837/367294936] conn(0x10ebd30 0x1135350 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.187 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.179+0000 7fd01323f740 1 --2- 172.21.15.39:0/2953041210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xe69a30 0x10eb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.187 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.179+0000 7fd01323f740 1 --2- 172.21.15.39:0/2953041210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xe1ed80 0x10eb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.188 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.179+0000 7fd01323f740 1 --2- 172.21.15.39:0/2953041210 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xe1e9b0 0x10cd2b0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.188 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.179+0000 7fcfe8ff9700 0 client.6009 ms_handle_reset on v2:172.21.15.184:6836/367294936 2023-11-28T11:59:06.188 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.179+0000 7fd01323f740 1 -- 172.21.15.39:0/2953041210 >> 172.21.15.39:0/2953041210 conn(0xe1f150 msgr2=0x10b7390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:06.188 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.179+0000 7fd01323f740 1 -- 172.21.15.39:0/2953041210 shutdown_connections 2023-11-28T11:59:06.188 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.179+0000 7fd01323f740 1 -- 172.21.15.39:0/2953041210 wait complete. 2023-11-28T11:59:06.188 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.179+0000 7fd01323f740 20 client.6009 trim_cache size 0 max 16384 2023-11-28T11:59:06.188 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2023-11-28T11:59:06.188 INFO:teuthology.orchestra.run.smithi039.stdout: "return_code": 0, 2023-11-28T11:59:06.188 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_tag": "9527369f-d6a6-4f72-8b08-9a13a60cfad6", 2023-11-28T11:59:06.188 INFO:teuthology.orchestra.run.smithi039.stdout: "mode": "asynchronous" 2023-11-28T11:59:06.189 INFO:teuthology.orchestra.run.smithi039.stdout:} 2023-11-28T11:59:06.189 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.179+0000 7fd00ed58700 1 -- 172.21.15.39:0/1865394996 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcfec064ee0 msgr2=0x7fcfec067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:06.189 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.179+0000 7fd00ed58700 1 --2- 172.21.15.39:0/1865394996 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcfec064ee0 0x7fcfec067390 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd004009ab0 tx=0x7fd004008030 comp rx=0 tx=0).stop 2023-11-28T11:59:06.189 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.179+0000 7fd00ed58700 1 -- 172.21.15.39:0/1865394996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd00806ba70 msgr2=0x7fd008159520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:06.190 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.179+0000 7fd00ed58700 1 --2- 172.21.15.39:0/1865394996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd00806ba70 0x7fd008159520 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd00806fef0 tx=0x7fd0000019e0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.190 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.179+0000 7fd00ed58700 1 -- 172.21.15.39:0/1865394996 shutdown_connections 2023-11-28T11:59:06.190 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.179+0000 7fd00ed58700 1 --2- 172.21.15.39:0/1865394996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd00806ba70 0x7fd008159520 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.190 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.179+0000 7fd00ed58700 1 --2- 172.21.15.39:0/1865394996 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcfec064ee0 0x7fcfec067390 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.190 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.179+0000 7fd00ed58700 1 --2- 172.21.15.39:0/1865394996 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd00806aca0 0x7fd0080abf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.190 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.179+0000 7fd00ed58700 1 --2- 172.21.15.39:0/1865394996 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcff4003a20 0x7fd0080aba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.190 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.179+0000 7fd00ed58700 1 -- 172.21.15.39:0/1865394996 >> 172.21.15.39:0/1865394996 conn(0x7fd0080ce5b0 msgr2=0x7fd008156bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:06.190 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.179+0000 7fd00ed58700 1 -- 172.21.15.39:0/1865394996 shutdown_connections 2023-11-28T11:59:06.190 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.179+0000 7fd00ed58700 1 -- 172.21.15.39:0/1865394996 wait complete. 2023-11-28T11:59:06.206 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub status 2023-11-28T11:59:06.382 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.379+0000 7f7c4d8dd700 1 Processor -- start 2023-11-28T11:59:06.383 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.379+0000 7f7c4d8dd700 1 -- start start 2023-11-28T11:59:06.385 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.383+0000 7f7c4d8dd700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7c48069e00 0x7f7c4806a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.385 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.383+0000 7f7c4d8dd700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c4806c600 con 0x7f7c48071aa0 2023-11-28T11:59:06.385 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.383+0000 7f7c4d8dd700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c480722f0 con 0x7f7c4815c640 2023-11-28T11:59:06.385 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.383+0000 7f7c4d8dd700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c4806cef0 con 0x7f7c48069e00 2023-11-28T11:59:06.386 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.383+0000 7f7c4d0dc700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7c48069e00 0x7f7c4806a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.386 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.383+0000 7f7c4d0dc700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7c48069e00 0x7f7c4806a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55744/0 (socket says 172.21.15.39:55744) 2023-11-28T11:59:06.387 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.383+0000 7f7c4d0dc700 1 -- 172.21.15.39:0/221899018 learned_addr learned my addr 172.21.15.39:0/221899018 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:06.387 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.383+0000 7f7c4d0dc700 1 -- 172.21.15.39:0/221899018 >> v1:172.21.15.184:6789/0 conn(0x7f7c4815c640 legacy=0x7f7c480d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:06.387 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.383+0000 7f7c4d0dc700 1 -- 172.21.15.39:0/221899018 >> v1:172.21.15.39:6789/0 conn(0x7f7c48071aa0 legacy=0x7f7c4806d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:06.387 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.383+0000 7f7c4d0dc700 1 -- 172.21.15.39:0/221899018 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c4806da20 con 0x7f7c48069e00 2023-11-28T11:59:06.387 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.383+0000 7f7c4d0dc700 1 --2- 172.21.15.39:0/221899018 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7c48069e00 0x7f7c4806a280 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f7c40009e50 tx=0x7f7c4000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6792a6a57bac8ed3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:06.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.383+0000 7f7c477fe700 1 -- 172.21.15.39:0/221899018 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4000e070 con 0x7f7c48069e00 2023-11-28T11:59:06.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.383+0000 7f7c477fe700 1 -- 172.21.15.39:0/221899018 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4000b9c0 con 0x7f7c48069e00 2023-11-28T11:59:06.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.383+0000 7f7c477fe700 1 -- 172.21.15.39:0/221899018 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4000bd70 con 0x7f7c48069e00 2023-11-28T11:59:06.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.387+0000 7f7c4d8dd700 1 -- 172.21.15.39:0/221899018 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7c48069e00 msgr2=0x7f7c4806a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:06.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.387+0000 7f7c4d8dd700 1 --2- 172.21.15.39:0/221899018 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7c48069e00 0x7f7c4806a280 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f7c40009e50 tx=0x7f7c4000b330 comp rx=0 tx=0).stop 2023-11-28T11:59:06.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.387+0000 7f7c4d8dd700 1 -- 172.21.15.39:0/221899018 shutdown_connections 2023-11-28T11:59:06.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.387+0000 7f7c4d8dd700 1 --2- 172.21.15.39:0/221899018 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7c48069e00 0x7f7c4806a280 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.387+0000 7f7c4d8dd700 1 -- 172.21.15.39:0/221899018 >> 172.21.15.39:0/221899018 conn(0x7f7c480b6520 msgr2=0x7f7c48071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:06.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.387+0000 7f7c4d8dd700 1 -- 172.21.15.39:0/221899018 shutdown_connections 2023-11-28T11:59:06.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.387+0000 7f7c4d8dd700 1 -- 172.21.15.39:0/221899018 wait complete. 2023-11-28T11:59:06.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.391+0000 7f7c4d8dd700 1 Processor -- start 2023-11-28T11:59:06.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.391+0000 7f7c4d8dd700 1 -- start start 2023-11-28T11:59:06.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.391+0000 7f7c4d8dd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7c48069e00 0x7f7c480cf600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.391+0000 7f7c4d8dd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c48071aa0 0x7f7c480b1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.391+0000 7f7c4d8dd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c4815c640 0x7f7c480b1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.391+0000 7f7c4d8dd700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c480d38f0 con 0x7f7c48069e00 2023-11-28T11:59:06.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.391+0000 7f7c4d8dd700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c480cde30 con 0x7f7c4815c640 2023-11-28T11:59:06.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.391+0000 7f7c4d8dd700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c480ce110 con 0x7f7c48071aa0 2023-11-28T11:59:06.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.395+0000 7f7c4c8db700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7c48069e00 0x7f7c480cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.395+0000 7f7c4c8db700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7c48069e00 0x7f7c480cf600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55750/0 (socket says 172.21.15.39:55750) 2023-11-28T11:59:06.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.395+0000 7f7c4c8db700 1 -- 172.21.15.39:0/360309732 learned_addr learned my addr 172.21.15.39:0/360309732 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:06.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.395+0000 7f7c47fff700 1 --2- 172.21.15.39:0/360309732 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c48071aa0 0x7f7c480b1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.395+0000 7f7c4d0dc700 1 --2- 172.21.15.39:0/360309732 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c4815c640 0x7f7c480b1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.395+0000 7f7c4c8db700 1 -- 172.21.15.39:0/360309732 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c48071aa0 msgr2=0x7f7c480b1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:06.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.395+0000 7f7c4c8db700 1 --2- 172.21.15.39:0/360309732 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c48071aa0 0x7f7c480b1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.395+0000 7f7c4c8db700 1 -- 172.21.15.39:0/360309732 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c4815c640 msgr2=0x7f7c480b1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:06.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.395+0000 7f7c4c8db700 1 --2- 172.21.15.39:0/360309732 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c4815c640 0x7f7c480b1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.395+0000 7f7c4c8db700 1 -- 172.21.15.39:0/360309732 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c40009b30 con 0x7f7c48069e00 2023-11-28T11:59:06.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.395+0000 7f7c4c8db700 1 --2- 172.21.15.39:0/360309732 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7c48069e00 0x7f7c480cf600 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c00c500 tx=0x7f7c3c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:06.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.395+0000 7f7c457fa700 1 -- 172.21.15.39:0/360309732 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c0052d0 con 0x7f7c48069e00 2023-11-28T11:59:06.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.395+0000 7f7c457fa700 1 -- 172.21.15.39:0/360309732 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3c005430 con 0x7f7c48069e00 2023-11-28T11:59:06.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.395+0000 7f7c4d8dd700 1 -- 172.21.15.39:0/360309732 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c48072010 con 0x7f7c48069e00 2023-11-28T11:59:06.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.395+0000 7f7c457fa700 1 -- 172.21.15.39:0/360309732 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c0055a0 con 0x7f7c48069e00 2023-11-28T11:59:06.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.395+0000 7f7c4d8dd700 1 -- 172.21.15.39:0/360309732 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c4815ca10 con 0x7f7c48069e00 2023-11-28T11:59:06.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.399+0000 7f7c457fa700 1 -- 172.21.15.39:0/360309732 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7c3c019030 con 0x7f7c48069e00 2023-11-28T11:59:06.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.399+0000 7f7c457fa700 1 --2- 172.21.15.39:0/360309732 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7c2c064f10 0x7f7c2c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.399+0000 7f7c457fa700 1 -- 172.21.15.39:0/360309732 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7c3c0813b0 con 0x7f7c48069e00 2023-11-28T11:59:06.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.399+0000 7f7c47fff700 1 --2- 172.21.15.39:0/360309732 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7c2c064f10 0x7f7c2c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.403+0000 7f7c51dc9740 1 Processor -- start 2023-11-28T11:59:06.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.403+0000 7f7c47fff700 1 --2- 172.21.15.39:0/360309732 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7c2c064f10 0x7f7c2c0673c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7c480d1ab0 tx=0x7f7c34009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:06.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.403+0000 7f7c51dc9740 1 -- start start 2023-11-28T11:59:06.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.403+0000 7f7c51dc9740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xbe6c10 0xe667d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.403+0000 7f7c51dc9740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xbe6840 0xe66d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.403+0000 7f7c51dc9740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xc318c0 0xe67250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.403+0000 7f7c51dc9740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0xd55d20 con 0xc318c0 2023-11-28T11:59:06.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.403+0000 7f7c51dc9740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0xdc5d60 con 0xbe6840 2023-11-28T11:59:06.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.403+0000 7f7c51dc9740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0xdbf060 con 0xbe6c10 2023-11-28T11:59:06.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.403+0000 7f7c4d0dc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xc318c0 0xe67250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.403+0000 7f7c4c8db700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xbe6c10 0xe667d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.403+0000 7f7c47fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xbe6840 0xe66d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.403+0000 7f7c4d0dc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xc318c0 0xe67250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55756/0 (socket says 172.21.15.39:55756) 2023-11-28T11:59:06.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.403+0000 7f7c4d0dc700 1 -- 172.21.15.39:0/2706705815 learned_addr learned my addr 172.21.15.39:0/2706705815 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:06.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.403+0000 7f7c4d0dc700 1 -- 172.21.15.39:0/2706705815 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xbe6c10 msgr2=0xe667d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:06.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.403+0000 7f7c4d0dc700 1 --2- 172.21.15.39:0/2706705815 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xbe6c10 0xe667d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.403+0000 7f7c4d0dc700 1 -- 172.21.15.39:0/2706705815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xbe6840 msgr2=0xe66d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:06.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.403+0000 7f7c4d0dc700 1 --2- 172.21.15.39:0/2706705815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xbe6840 0xe66d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.403+0000 7f7c4d0dc700 1 -- 172.21.15.39:0/2706705815 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xde50a0 con 0xc318c0 2023-11-28T11:59:06.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.403+0000 7f7c4d0dc700 1 --2- 172.21.15.39:0/2706705815 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xc318c0 0xe67250 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f7c400092e0 tx=0x7f7c40010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb1ae395383ecb5d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:06.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.407+0000 7f7c327fc700 1 -- 172.21.15.39:0/2706705815 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c400099d0 con 0xc318c0 2023-11-28T11:59:06.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.407+0000 7f7c327fc700 1 -- 172.21.15.39:0/2706705815 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c40003a40 con 0xc318c0 2023-11-28T11:59:06.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.407+0000 7f7c327fc700 1 -- 172.21.15.39:0/2706705815 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c40003df0 con 0xc318c0 2023-11-28T11:59:06.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.407+0000 7f7c51dc9740 1 -- 172.21.15.39:0/2706705815 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xc318c0 msgr2=0xe67250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:06.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.407+0000 7f7c51dc9740 1 --2- 172.21.15.39:0/2706705815 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xc318c0 0xe67250 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f7c400092e0 tx=0x7f7c40010000 comp rx=0 tx=0).stop 2023-11-28T11:59:06.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.407+0000 7f7c51dc9740 1 -- 172.21.15.39:0/2706705815 shutdown_connections 2023-11-28T11:59:06.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.407+0000 7f7c51dc9740 1 --2- 172.21.15.39:0/2706705815 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xc318c0 0xe67250 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.407+0000 7f7c51dc9740 1 --2- 172.21.15.39:0/2706705815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xbe6840 0xe66d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.407+0000 7f7c51dc9740 1 --2- 172.21.15.39:0/2706705815 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xbe6c10 0xe667d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.407+0000 7f7c51dc9740 1 -- 172.21.15.39:0/2706705815 >> 172.21.15.39:0/2706705815 conn(0xbe6fe0 msgr2=0xe7fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:06.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.407+0000 7f7c51dc9740 1 -- 172.21.15.39:0/2706705815 shutdown_connections 2023-11-28T11:59:06.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.407+0000 7f7c51dc9740 1 -- 172.21.15.39:0/2706705815 wait complete. 2023-11-28T11:59:06.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.407+0000 7f7c51dc9740 1 -- start start 2023-11-28T11:59:06.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.407+0000 7f7c51dc9740 1 Processor -- start 2023-11-28T11:59:06.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.407+0000 7f7c51dc9740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xbe6840 0xe65e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.407+0000 7f7c51dc9740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xbe6c10 0xe56ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.407+0000 7f7c51dc9740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xc318c0 0xe55e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.407+0000 7f7c51dc9740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0xc6bc50 con 0xbe6c10 2023-11-28T11:59:06.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.407+0000 7f7c51dc9740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0xe57890 con 0xc318c0 2023-11-28T11:59:06.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.407+0000 7f7c51dc9740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0xe55490 con 0xbe6840 2023-11-28T11:59:06.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.407+0000 7f7c51dc9740 10 client.0 _ll_register_callbacks cb 0xdb89a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:59:06.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.411+0000 7f7c47fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xbe6c10 0xe56ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.411+0000 7f7c4d0dc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xc318c0 0xe55e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.414 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.411+0000 7f7c4c8db700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xbe6840 0xe65e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.414 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.411+0000 7f7c47fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xbe6c10 0xe56ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55764/0 (socket says 172.21.15.39:55764) 2023-11-28T11:59:06.414 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.411+0000 7f7c47fff700 1 -- 172.21.15.39:0/3899042877 learned_addr learned my addr 172.21.15.39:0/3899042877 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:06.415 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.411+0000 7f7c47fff700 1 -- 172.21.15.39:0/3899042877 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xbe6840 msgr2=0xe65e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:06.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.411+0000 7f7c47fff700 1 --2- 172.21.15.39:0/3899042877 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xbe6840 0xe65e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.411+0000 7f7c47fff700 1 -- 172.21.15.39:0/3899042877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xc318c0 msgr2=0xe55e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:06.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.411+0000 7f7c47fff700 1 --2- 172.21.15.39:0/3899042877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xc318c0 0xe55e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.411+0000 7f7c47fff700 1 -- 172.21.15.39:0/3899042877 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c4806da20 con 0xbe6c10 2023-11-28T11:59:06.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.411+0000 7f7c4c8db700 1 --2- 172.21.15.39:0/3899042877 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xbe6840 0xe65e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:06.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.411+0000 7f7c47fff700 1 --2- 172.21.15.39:0/3899042877 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xbe6c10 0xe56ff0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f7c3400ff80 tx=0x7f7c34001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90cbc7b5221bb963 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:06.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.411+0000 7f7c277fe700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-11-28T11:59:06.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.411+0000 7f7c277fe700 1 -- 172.21.15.39:0/3899042877 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c34014ba0 con 0xbe6c10 2023-11-28T11:59:06.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.411+0000 7f7c277fe700 1 -- 172.21.15.39:0/3899042877 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7c3401c040 con 0xbe6c10 2023-11-28T11:59:06.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.411+0000 7f7c51dc9740 1 -- 172.21.15.39:0/3899042877 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xdb80e0 con 0xbe6c10 2023-11-28T11:59:06.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.411+0000 7f7c277fe700 1 -- 172.21.15.39:0/3899042877 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c34014d00 con 0xbe6c10 2023-11-28T11:59:06.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.411+0000 7f7c51dc9740 10 client.6021 fetch_fsmap learned FSMap version 24 2023-11-28T11:59:06.417 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.411+0000 7f7c51dc9740 1 -- 172.21.15.39:0/3899042877 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0xc32b10 con 0xbe6c10 2023-11-28T11:59:06.417 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.411+0000 7f7c277fe700 1 -- 172.21.15.39:0/3899042877 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xdb80e0 con 0xbe6c10 2023-11-28T11:59:06.417 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.411+0000 7f7c277fe700 1 -- 172.21.15.39:0/3899042877 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f7c3402a3f0 con 0xbe6c10 2023-11-28T11:59:06.417 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.411+0000 7f7c51dc9740 10 client.6021 fetch_fsmap finished waiting for FSMap version 24 2023-11-28T11:59:06.417 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.411+0000 7f7c51dc9740 10 client.6021 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.b 2023-11-28T11:59:06.417 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.411+0000 7f7c51dc9740 20 client.6021 populate_metadata read hostname 'smithi039' 2023-11-28T11:59:06.417 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.411+0000 7f7c51dc9740 1 --2- 172.21.15.39:0/3899042877 >> [v2:172.21.15.184:6836/367294936,v1:172.21.15.184:6837/367294936] conn(0xe595c0 0xe53a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.417 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.411+0000 7f7c51dc9740 4 client.6021 mds_command: new command op to 5809 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T11:59:06.418 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.411+0000 7f7c51dc9740 1 -- 172.21.15.39:0/3899042877 --> [v2:172.21.15.184:6836/367294936,v1:172.21.15.184:6837/367294936] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xdb7e00 con 0xe595c0 2023-11-28T11:59:06.418 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.415+0000 7f7c4c8db700 1 --2- 172.21.15.39:0/3899042877 >> [v2:172.21.15.184:6836/367294936,v1:172.21.15.184:6837/367294936] conn(0xe595c0 0xe53a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.418 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.415+0000 7f7c4c8db700 1 --2- 172.21.15.39:0/3899042877 >> [v2:172.21.15.184:6836/367294936,v1:172.21.15.184:6837/367294936] conn(0xe595c0 0xe53a70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18373057bdb15bee server_cookie=d210a33a3c598660 in_seq=0 out_seq=0 2023-11-28T11:59:06.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.415+0000 7f7c277fe700 10 client.6021 ms_handle_connect on v2:172.21.15.184:6836/367294936 2023-11-28T11:59:06.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.415+0000 7f7c277fe700 1 -- 172.21.15.39:0/3899042877 <== mds.0 v2:172.21.15.184:6836/367294936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0xdb7e00 con 0xe595c0 2023-11-28T11:59:06.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.415+0000 7f7c277fe700 10 client.6021 handle_command_reply: tid=0 2023-11-28T11:59:06.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.415+0000 7f7c51dc9740 1 client.6021 shutdown 2023-11-28T11:59:06.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.415+0000 7f7c51dc9740 1 -- 172.21.15.39:0/3899042877 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xbe6c10 msgr2=0xe56ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:06.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.415+0000 7f7c51dc9740 1 --2- 172.21.15.39:0/3899042877 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xbe6c10 0xe56ff0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f7c3400ff80 tx=0x7f7c34001080 comp rx=0 tx=0).stop 2023-11-28T11:59:06.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.415+0000 7f7c51dc9740 1 -- 172.21.15.39:0/3899042877 shutdown_connections 2023-11-28T11:59:06.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.415+0000 7f7c51dc9740 1 --2- 172.21.15.39:0/3899042877 >> [v2:172.21.15.184:6836/367294936,v1:172.21.15.184:6837/367294936] conn(0xe595c0 0xe53a70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.415+0000 7f7c51dc9740 1 --2- 172.21.15.39:0/3899042877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xc318c0 0xe55e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.415+0000 7f7c51dc9740 1 --2- 172.21.15.39:0/3899042877 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xbe6c10 0xe56ff0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.415+0000 7f7c51dc9740 1 --2- 172.21.15.39:0/3899042877 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xbe6840 0xe65e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.415+0000 7f7c277fe700 0 client.6021 ms_handle_reset on v2:172.21.15.184:6836/367294936 2023-11-28T11:59:06.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.415+0000 7f7c51dc9740 1 -- 172.21.15.39:0/3899042877 >> 172.21.15.39:0/3899042877 conn(0xbe6fe0 msgr2=0xe7ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:06.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.415+0000 7f7c51dc9740 1 -- 172.21.15.39:0/3899042877 shutdown_connections 2023-11-28T11:59:06.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.415+0000 7f7c51dc9740 1 -- 172.21.15.39:0/3899042877 wait complete. 2023-11-28T11:59:06.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.415+0000 7f7c51dc9740 20 client.6021 trim_cache size 0 max 16384 2023-11-28T11:59:06.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.447+0000 7f7c51dc9740 1 Processor -- start 2023-11-28T11:59:06.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.447+0000 7f7c51dc9740 1 -- start start 2023-11-28T11:59:06.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.447+0000 7f7c51dc9740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xbe6840 0xe53730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.447+0000 7f7c51dc9740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xbe6c10 0xea1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.447+0000 7f7c51dc9740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xc318c0 0xea2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.447+0000 7f7c51dc9740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0xd84440 con 0xc318c0 2023-11-28T11:59:06.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.447+0000 7f7c51dc9740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0xdbe870 con 0xbe6840 2023-11-28T11:59:06.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.447+0000 7f7c51dc9740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0xd8a570 con 0xbe6c10 2023-11-28T11:59:06.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.447+0000 7f7c4d0dc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xc318c0 0xea2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.447+0000 7f7c47fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xbe6c10 0xea1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.447+0000 7f7c4c8db700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xbe6840 0xe53730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.447+0000 7f7c47fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xbe6c10 0xea1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:37138/0 (socket says 172.21.15.39:37138) 2023-11-28T11:59:06.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.447+0000 7f7c47fff700 1 -- 172.21.15.39:0/4281555145 learned_addr learned my addr 172.21.15.39:0/4281555145 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:06.452 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.447+0000 7f7c47fff700 1 -- 172.21.15.39:0/4281555145 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xbe6840 msgr2=0xe53730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:06.452 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.447+0000 7f7c47fff700 1 --2- 172.21.15.39:0/4281555145 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xbe6840 0xe53730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.451+0000 7f7c47fff700 1 -- 172.21.15.39:0/4281555145 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xc318c0 msgr2=0xea2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:06.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.451+0000 7f7c47fff700 1 --2- 172.21.15.39:0/4281555145 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xc318c0 0xea2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.451+0000 7f7c47fff700 1 -- 172.21.15.39:0/4281555145 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c480c5e20 con 0xbe6c10 2023-11-28T11:59:06.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.451+0000 7f7c47fff700 1 --2- 172.21.15.39:0/4281555145 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xbe6c10 0xea1ec0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7c3400fa20 tx=0x7f7c3401b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3972f220ed219ec4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:06.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.451+0000 7f7c32ffd700 1 -- 172.21.15.39:0/4281555145 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3402ab90 con 0xbe6c10 2023-11-28T11:59:06.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.451+0000 7f7c32ffd700 1 -- 172.21.15.39:0/4281555145 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c34001540 con 0xbe6c10 2023-11-28T11:59:06.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.451+0000 7f7c32ffd700 1 -- 172.21.15.39:0/4281555145 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c34014dc0 con 0xbe6c10 2023-11-28T11:59:06.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.451+0000 7f7c51dc9740 1 -- 172.21.15.39:0/4281555145 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xbe6c10 msgr2=0xea1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:06.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.451+0000 7f7c51dc9740 1 --2- 172.21.15.39:0/4281555145 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xbe6c10 0xea1ec0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7c3400fa20 tx=0x7f7c3401b000 comp rx=0 tx=0).stop 2023-11-28T11:59:06.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.451+0000 7f7c51dc9740 1 -- 172.21.15.39:0/4281555145 shutdown_connections 2023-11-28T11:59:06.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.451+0000 7f7c51dc9740 1 --2- 172.21.15.39:0/4281555145 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xc318c0 0xea2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.451+0000 7f7c51dc9740 1 --2- 172.21.15.39:0/4281555145 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xbe6c10 0xea1ec0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.451+0000 7f7c51dc9740 1 --2- 172.21.15.39:0/4281555145 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xbe6840 0xe53730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.451+0000 7f7c51dc9740 1 -- 172.21.15.39:0/4281555145 >> 172.21.15.39:0/4281555145 conn(0xbe6fe0 msgr2=0xe7b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:06.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.451+0000 7f7c51dc9740 1 -- 172.21.15.39:0/4281555145 shutdown_connections 2023-11-28T11:59:06.457 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.451+0000 7f7c51dc9740 1 -- 172.21.15.39:0/4281555145 wait complete. 2023-11-28T11:59:06.457 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.455+0000 7f7c51dc9740 1 -- start start 2023-11-28T11:59:06.458 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.455+0000 7f7c51dc9740 1 Processor -- start 2023-11-28T11:59:06.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.459+0000 7f7c51dc9740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xbe6840 0xef9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.459+0000 7f7c51dc9740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xbe6c10 0xea1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.459+0000 7f7c51dc9740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xc318c0 0xea2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.459+0000 7f7c51dc9740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0xe64b70 con 0xc318c0 2023-11-28T11:59:06.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.459+0000 7f7c51dc9740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0xead250 con 0xbe6840 2023-11-28T11:59:06.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.459+0000 7f7c51dc9740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0xef9960 con 0xbe6c10 2023-11-28T11:59:06.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.459+0000 7f7c51dc9740 10 client.0 _ll_register_callbacks cb 0x7f7c4000b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:59:06.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.459+0000 7f7c4d0dc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xc318c0 0xea2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.459+0000 7f7c4d0dc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xc318c0 0xea2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55794/0 (socket says 172.21.15.39:55794) 2023-11-28T11:59:06.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.459+0000 7f7c4d0dc700 1 -- 172.21.15.39:0/3268188075 learned_addr learned my addr 172.21.15.39:0/3268188075 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:06.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.459+0000 7f7c47fff700 1 --2- 172.21.15.39:0/3268188075 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xbe6c10 0xea1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.464 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.459+0000 7f7c4c8db700 1 --2- 172.21.15.39:0/3268188075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xbe6840 0xef9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.464 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.459+0000 7f7c4d0dc700 1 -- 172.21.15.39:0/3268188075 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xbe6c10 msgr2=0xea1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:06.464 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.459+0000 7f7c4d0dc700 1 --2- 172.21.15.39:0/3268188075 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xbe6c10 0xea1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.464 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.459+0000 7f7c4d0dc700 1 -- 172.21.15.39:0/3268188075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xbe6840 msgr2=0xef9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:06.464 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.459+0000 7f7c4d0dc700 1 --2- 172.21.15.39:0/3268188075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xbe6840 0xef9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.464 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.459+0000 7f7c4d0dc700 1 -- 172.21.15.39:0/3268188075 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xc32b10 con 0xc318c0 2023-11-28T11:59:06.464 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.459+0000 7f7c4d0dc700 1 --2- 172.21.15.39:0/3268188075 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xc318c0 0xea2440 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0xd61250 tx=0x7f7c40004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85c0e38cde3500da server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:06.464 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.459+0000 7f7c277fe700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-11-28T11:59:06.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.459+0000 7f7c277fe700 1 -- 172.21.15.39:0/3268188075 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4001d8e0 con 0xc318c0 2023-11-28T11:59:06.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.459+0000 7f7c51dc9740 1 -- 172.21.15.39:0/3268188075 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7c40003a40 con 0xc318c0 2023-11-28T11:59:06.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.459+0000 7f7c277fe700 1 -- 172.21.15.39:0/3268188075 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7c4002b040 con 0xc318c0 2023-11-28T11:59:06.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.463+0000 7f7c277fe700 1 -- 172.21.15.39:0/3268188075 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c4001da40 con 0xc318c0 2023-11-28T11:59:06.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.463+0000 7f7c51dc9740 10 client.6027 fetch_fsmap learned FSMap version 24 2023-11-28T11:59:06.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.463+0000 7f7c51dc9740 1 -- 172.21.15.39:0/3268188075 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0xd6baf0 con 0xc318c0 2023-11-28T11:59:06.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.463+0000 7f7c277fe700 1 -- 172.21.15.39:0/3268188075 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c40003a40 con 0xc318c0 2023-11-28T11:59:06.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.463+0000 7f7c277fe700 1 -- 172.21.15.39:0/3268188075 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f7c40023030 con 0xc318c0 2023-11-28T11:59:06.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.463+0000 7f7c51dc9740 10 client.6027 fetch_fsmap finished waiting for FSMap version 24 2023-11-28T11:59:06.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.463+0000 7f7c51dc9740 10 client.6027 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.b 2023-11-28T11:59:06.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.463+0000 7f7c51dc9740 20 client.6027 populate_metadata read hostname 'smithi039' 2023-11-28T11:59:06.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.463+0000 7f7c51dc9740 1 --2- 172.21.15.39:0/3268188075 >> [v2:172.21.15.184:6836/367294936,v1:172.21.15.184:6837/367294936] conn(0xe53340 0xeabe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.463+0000 7f7c51dc9740 4 client.6027 mds_command: new command op to 5809 tid=0[{"prefix": "scrub status"}] 2023-11-28T11:59:06.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.463+0000 7f7c51dc9740 1 -- 172.21.15.39:0/3268188075 --> [v2:172.21.15.184:6836/367294936,v1:172.21.15.184:6837/367294936] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0xc63390 con 0xe53340 2023-11-28T11:59:06.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.463+0000 7f7c4c8db700 1 --2- 172.21.15.39:0/3268188075 >> [v2:172.21.15.184:6836/367294936,v1:172.21.15.184:6837/367294936] conn(0xe53340 0xeabe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.463+0000 7f7c4c8db700 1 --2- 172.21.15.39:0/3268188075 >> [v2:172.21.15.184:6836/367294936,v1:172.21.15.184:6837/367294936] conn(0xe53340 0xeabe90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27c67cda914492c2 server_cookie=5ee774b55fa204e9 in_seq=0 out_seq=0 2023-11-28T11:59:06.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.463+0000 7f7c277fe700 10 client.6027 ms_handle_connect on v2:172.21.15.184:6836/367294936 2023-11-28T11:59:06.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.463+0000 7f7c277fe700 1 -- 172.21.15.39:0/3268188075 <== mds.0 v2:172.21.15.184:6836/367294936 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0xc63390 con 0xe53340 2023-11-28T11:59:06.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.463+0000 7f7c277fe700 10 client.6027 handle_command_reply: tid=0 2023-11-28T11:59:06.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.463+0000 7f7c51dc9740 1 client.6027 shutdown 2023-11-28T11:59:06.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.463+0000 7f7c51dc9740 1 -- 172.21.15.39:0/3268188075 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xc318c0 msgr2=0xea2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:06.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.463+0000 7f7c51dc9740 1 --2- 172.21.15.39:0/3268188075 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xc318c0 0xea2440 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0xd61250 tx=0x7f7c40004b60 comp rx=0 tx=0).stop 2023-11-28T11:59:06.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.463+0000 7f7c51dc9740 1 -- 172.21.15.39:0/3268188075 shutdown_connections 2023-11-28T11:59:06.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.467+0000 7f7c51dc9740 1 --2- 172.21.15.39:0/3268188075 >> [v2:172.21.15.184:6836/367294936,v1:172.21.15.184:6837/367294936] conn(0xe53340 0xeabe90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.467+0000 7f7c51dc9740 1 --2- 172.21.15.39:0/3268188075 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0xc318c0 0xea2440 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.467+0000 7f7c51dc9740 1 --2- 172.21.15.39:0/3268188075 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0xbe6c10 0xea1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.467+0000 7f7c51dc9740 1 --2- 172.21.15.39:0/3268188075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0xbe6840 0xef9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.467+0000 7f7c277fe700 0 client.6027 ms_handle_reset on v2:172.21.15.184:6836/367294936 2023-11-28T11:59:06.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.467+0000 7f7c51dc9740 1 -- 172.21.15.39:0/3268188075 >> 172.21.15.39:0/3268188075 conn(0xbe6fe0 msgr2=0xe57e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:06.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.467+0000 7f7c51dc9740 1 -- 172.21.15.39:0/3268188075 shutdown_connections 2023-11-28T11:59:06.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.467+0000 7f7c51dc9740 1 -- 172.21.15.39:0/3268188075 wait complete. 2023-11-28T11:59:06.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.467+0000 7f7c51dc9740 20 client.6027 trim_cache size 0 max 16384 2023-11-28T11:59:06.471 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2023-11-28T11:59:06.471 INFO:teuthology.orchestra.run.smithi039.stdout: "status": "no active scrubs running", 2023-11-28T11:59:06.471 INFO:teuthology.orchestra.run.smithi039.stdout: "scrubs": {} 2023-11-28T11:59:06.471 INFO:teuthology.orchestra.run.smithi039.stdout:} 2023-11-28T11:59:06.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.467+0000 7f7c4d8dd700 1 -- 172.21.15.39:0/360309732 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7c2c064f10 msgr2=0x7f7c2c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:06.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.467+0000 7f7c4d8dd700 1 --2- 172.21.15.39:0/360309732 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7c2c064f10 0x7f7c2c0673c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7c480d1ab0 tx=0x7f7c34009040 comp rx=0 tx=0).stop 2023-11-28T11:59:06.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.467+0000 7f7c4d8dd700 1 -- 172.21.15.39:0/360309732 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7c48069e00 msgr2=0x7f7c480cf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:06.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.467+0000 7f7c4d8dd700 1 --2- 172.21.15.39:0/360309732 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7c48069e00 0x7f7c480cf600 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c00c500 tx=0x7f7c3c00c810 comp rx=0 tx=0).stop 2023-11-28T11:59:06.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.467+0000 7f7c4d8dd700 1 -- 172.21.15.39:0/360309732 shutdown_connections 2023-11-28T11:59:06.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.467+0000 7f7c4d8dd700 1 --2- 172.21.15.39:0/360309732 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7c2c064f10 0x7f7c2c0673c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.473 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.467+0000 7f7c4d8dd700 1 --2- 172.21.15.39:0/360309732 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c4815c640 0x7f7c480b1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.473 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.467+0000 7f7c4d8dd700 1 --2- 172.21.15.39:0/360309732 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c48071aa0 0x7f7c480b1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.473 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.467+0000 7f7c4d8dd700 1 --2- 172.21.15.39:0/360309732 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7c48069e00 0x7f7c480cf600 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.473 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.467+0000 7f7c4d8dd700 1 -- 172.21.15.39:0/360309732 >> 172.21.15.39:0/360309732 conn(0x7f7c480b6520 msgr2=0x7f7c480b37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:06.473 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.467+0000 7f7c4d8dd700 1 -- 172.21.15.39:0/360309732 shutdown_connections 2023-11-28T11:59:06.473 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.467+0000 7f7c4d8dd700 1 -- 172.21.15.39:0/360309732 wait complete. 2023-11-28T11:59:06.497 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-11-28T11:59:06.598 DEBUG:tasks.ceph_test_case:No log hits yet, waiting... 2023-11-28T11:59:06.880 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:06.875+0000 7f5d6b7fe700 1 -- 172.21.15.39:0/967669953 <== mon.0 v2:172.21.15.39:3300/0 7 ==== log(6 entries from seq 1 at 2023-11-28T11:59:06.179533+0000) v1 ==== 1078+0+0 (secure 0 0 0) 0x7f5d6c003e30 con 0x7f5d74159030 2023-11-28T11:59:06.880 INFO:teuthology.orchestra.run.smithi039.stdout: cluster: 2023-11-28T11:59:06.880 INFO:teuthology.orchestra.run.smithi039.stdout: id: 67ce95b1-cd7e-4478-b863-c714ef275520 2023-11-28T11:59:06.880 INFO:teuthology.orchestra.run.smithi039.stdout: health: HEALTH_OK 2023-11-28T11:59:06.881 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:59:06.881 INFO:teuthology.orchestra.run.smithi039.stdout: services: 2023-11-28T11:59:06.881 INFO:teuthology.orchestra.run.smithi039.stdout: mon: 3 daemons, quorum a,b,c (age 2m) 2023-11-28T11:59:06.881 INFO:teuthology.orchestra.run.smithi039.stdout: mgr: x(active, since 2m), standbys: y 2023-11-28T11:59:06.881 INFO:teuthology.orchestra.run.smithi039.stdout: mds: 1/1 daemons up, 3 standby 2023-11-28T11:59:06.881 INFO:teuthology.orchestra.run.smithi039.stdout: osd: 8 osds: 8 up (since 2m), 8 in (since 2m) 2023-11-28T11:59:06.881 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:59:06.881 INFO:teuthology.orchestra.run.smithi039.stdout: data: 2023-11-28T11:59:06.881 INFO:teuthology.orchestra.run.smithi039.stdout: volumes: 1/1 healthy 2023-11-28T11:59:06.881 INFO:teuthology.orchestra.run.smithi039.stdout: pools: 4 pools, 105 pgs 2023-11-28T11:59:06.881 INFO:teuthology.orchestra.run.smithi039.stdout: objects: 24 objects, 579 KiB 2023-11-28T11:59:06.881 INFO:teuthology.orchestra.run.smithi039.stdout: usage: 79 MiB used, 720 GiB / 720 GiB avail 2023-11-28T11:59:06.882 INFO:teuthology.orchestra.run.smithi039.stdout: pgs: 105 active+clean 2023-11-28T11:59:06.882 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:59:06.882 INFO:teuthology.orchestra.run.smithi039.stdout: io: 2023-11-28T11:59:06.882 INFO:teuthology.orchestra.run.smithi039.stdout: client: 1.1 KiB/s wr, 0 op/s rd, 2 op/s wr 2023-11-28T11:59:06.882 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:59:06.882 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:59:06.882 INFO:teuthology.orchestra.run.smithi039.stdout:2023-11-28T11:59:06.179533+0000 mds.b [INF] scrub queued for path: / 2023-11-28T11:59:06.882 INFO:teuthology.orchestra.run.smithi039.stdout:2023-11-28T11:59:06.179540+0000 mds.b [INF] scrub summary: idle+waiting paths [/] 2023-11-28T11:59:06.882 INFO:teuthology.orchestra.run.smithi039.stdout:2023-11-28T11:59:06.179550+0000 mds.b [INF] scrub summary: active paths [/] 2023-11-28T11:59:06.882 INFO:teuthology.orchestra.run.smithi039.stdout:2023-11-28T11:59:06.181266+0000 mds.b [WRN] bad backtrace on inode 0x10000000001(/parent_a/alpha), rewriting it 2023-11-28T11:59:06.882 INFO:teuthology.orchestra.run.smithi039.stdout:2023-11-28T11:59:06.181283+0000 mds.b [INF] Scrub repaired inode 0x10000000001 (/parent_a/alpha) 2023-11-28T11:59:06.882 INFO:teuthology.orchestra.run.smithi039.stdout:2023-11-28T11:59:06.181971+0000 mds.b [INF] scrub summary: idle+waiting paths [/] 2023-11-28T11:59:07.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:07.891+0000 7f5d6b7fe700 1 -- 172.21.15.39:0/967669953 <== mon.0 v2:172.21.15.39:3300/0 8 ==== log(1 entries from seq 7 at 2023-11-28T11:59:06.412427+0000) v1 ==== 189+0+0 (secure 0 0 0) 0x7f5d6c05daa0 con 0x7f5d74159030 2023-11-28T11:59:07.895 INFO:teuthology.orchestra.run.smithi039.stdout:2023-11-28T11:59:06.412427+0000 mds.b [INF] scrub summary: idle 2023-11-28T11:59:21.626 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:59:21.848 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.842+0000 7fe7a5f07700 1 Processor -- start 2023-11-28T11:59:21.848 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.842+0000 7fe7a5f07700 1 -- start start 2023-11-28T11:59:21.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.846+0000 7fe7a5f07700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7a00b43a0 0x7fe7a015e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:21.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.846+0000 7fe7a5f07700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7a015a550 con 0x7fe7a0070790 2023-11-28T11:59:21.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.846+0000 7fe7a5f07700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7a006b0a0 con 0x7fe7a00b1640 2023-11-28T11:59:21.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.846+0000 7fe7a5f07700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a00caac0 con 0x7fe7a00b43a0 2023-11-28T11:59:21.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.846+0000 7fe7a5706700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fe7a0070790 0x7fe7a006bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:52068/0 (socket says 172.21.15.39:52068) 2023-11-28T11:59:21.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.846+0000 7fe7a5706700 1 -- 172.21.15.39:0/2936768165 learned_addr learned my addr 172.21.15.39:0/2936768165 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:59:21.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.846+0000 7fe7a4f05700 1 --2- 172.21.15.39:0/2936768165 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7a00b43a0 0x7fe7a015e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:21.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.846+0000 7fe7977fe700 1 -- 172.21.15.39:0/2936768165 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1846271358 0 0) 0x7fe798001490 con 0x7fe7a0070790 2023-11-28T11:59:21.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.846+0000 7fe7977fe700 1 -- 172.21.15.39:0/2936768165 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7880035d0 con 0x7fe7a0070790 2023-11-28T11:59:21.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.846+0000 7fe7977fe700 1 -- 172.21.15.39:0/2936768165 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3622764813 0 0) 0x7fe7a006b0a0 con 0x7fe7a00b1640 2023-11-28T11:59:21.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.846+0000 7fe7977fe700 1 -- 172.21.15.39:0/2936768165 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe798001490 con 0x7fe7a00b1640 2023-11-28T11:59:21.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.846+0000 7fe7977fe700 1 -- 172.21.15.39:0/2936768165 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2768682643 0 0) 0x7fe7880035d0 con 0x7fe7a0070790 2023-11-28T11:59:21.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.846+0000 7fe7977fe700 1 -- 172.21.15.39:0/2936768165 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7a00b43a0 msgr2=0x7fe7a015e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:21.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.846+0000 7fe7977fe700 1 --2- 172.21.15.39:0/2936768165 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7a00b43a0 0x7fe7a015e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:21.860 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.846+0000 7fe7977fe700 1 -- 172.21.15.39:0/2936768165 >> v1:172.21.15.184:6789/0 conn(0x7fe7a00b1640 legacy=0x7fe7a0070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:21.860 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.846+0000 7fe7977fe700 1 -- 172.21.15.39:0/2936768165 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a00cada0 con 0x7fe7a0070790 2023-11-28T11:59:21.860 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.846+0000 7fe7977fe700 1 -- 172.21.15.39:0/2936768165 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4013383302 0 0) 0x7fe798001b80 con 0x7fe7a0070790 2023-11-28T11:59:21.860 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.846+0000 7fe7977fe700 1 -- 172.21.15.39:0/2936768165 >> v1:172.21.15.39:6789/0 conn(0x7fe7a0070790 legacy=0x7fe7a006bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:21.861 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.846+0000 7fe7977fe700 1 --2- 172.21.15.39:0/2936768165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe788003be0 0x7fe788003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:21.861 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.846+0000 7fe7977fe700 1 --2- 172.21.15.39:0/2936768165 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7a00b43a0 0x7fe788004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:21.861 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.846+0000 7fe7977fe700 1 --2- 172.21.15.39:0/2936768165 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe788004db0 0x7fe788005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:21.861 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.846+0000 7fe7977fe700 1 -- 172.21.15.39:0/2936768165 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a00caac0 con 0x7fe788004db0 2023-11-28T11:59:21.861 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.846+0000 7fe7977fe700 1 -- 172.21.15.39:0/2936768165 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78800bb30 con 0x7fe788003be0 2023-11-28T11:59:21.861 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.846+0000 7fe7977fe700 1 -- 172.21.15.39:0/2936768165 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe78800bcf0 con 0x7fe7a00b43a0 2023-11-28T11:59:21.861 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.850+0000 7fe7a5706700 1 --2- 172.21.15.39:0/2936768165 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe788004db0 0x7fe788005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:21.862 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.850+0000 7fe7a4f05700 1 --2- 172.21.15.39:0/2936768165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe788003be0 0x7fe788003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:21.862 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.850+0000 7fe797fff700 1 --2- 172.21.15.39:0/2936768165 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7a00b43a0 0x7fe788004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:21.862 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.850+0000 7fe7a4f05700 1 -- 172.21.15.39:0/2936768165 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7a00b43a0 msgr2=0x7fe788004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:21.862 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.850+0000 7fe7a4f05700 1 --2- 172.21.15.39:0/2936768165 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7a00b43a0 0x7fe788004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:21.862 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.850+0000 7fe7a4f05700 1 -- 172.21.15.39:0/2936768165 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe788004db0 msgr2=0x7fe788005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:21.862 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.850+0000 7fe7a4f05700 1 --2- 172.21.15.39:0/2936768165 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe788004db0 0x7fe788005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:21.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.850+0000 7fe7a4f05700 1 -- 172.21.15.39:0/2936768165 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7880035d0 con 0x7fe788003be0 2023-11-28T11:59:21.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.850+0000 7fe7a4f05700 1 --2- 172.21.15.39:0/2936768165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe788003be0 0x7fe788003fd0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe79c009b70 tx=0x7fe7880058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdb0c806cb7836ca server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:21.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.850+0000 7fe7977fe700 1 -- 172.21.15.39:0/2936768165 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c00e6c0 con 0x7fe788003be0 2023-11-28T11:59:21.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.850+0000 7fe7977fe700 1 -- 172.21.15.39:0/2936768165 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79c00e820 con 0x7fe788003be0 2023-11-28T11:59:21.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.850+0000 7fe7977fe700 1 -- 172.21.15.39:0/2936768165 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c00eb90 con 0x7fe788003be0 2023-11-28T11:59:21.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.850+0000 7fe7a5f07700 1 -- 172.21.15.39:0/2936768165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe788003be0 msgr2=0x7fe788003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:21.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.850+0000 7fe7a5f07700 1 --2- 172.21.15.39:0/2936768165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe788003be0 0x7fe788003fd0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe79c009b70 tx=0x7fe7880058a0 comp rx=0 tx=0).stop 2023-11-28T11:59:21.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.850+0000 7fe7a5706700 1 -- 172.21.15.39:0/2936768165 reap_dead start 2023-11-28T11:59:21.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.850+0000 7fe7a5f07700 1 -- 172.21.15.39:0/2936768165 shutdown_connections 2023-11-28T11:59:21.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.850+0000 7fe7a5f07700 1 -- 172.21.15.39:0/2936768165 >> 172.21.15.39:0/2936768165 conn(0x7fe7a00b0f80 msgr2=0x7fe7a00ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:21.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.854+0000 7fe7a5f07700 1 -- 172.21.15.39:0/2936768165 shutdown_connections 2023-11-28T11:59:21.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.854+0000 7fe7a5f07700 1 -- 172.21.15.39:0/2936768165 wait complete. 2023-11-28T11:59:21.868 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.854+0000 7fe7a5f07700 1 Processor -- start 2023-11-28T11:59:21.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.854+0000 7fe7a5f07700 1 -- start start 2023-11-28T11:59:21.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.858+0000 7fe7a5f07700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe788003be0 0x7fe7a014fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:21.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.858+0000 7fe7a5f07700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7a00cd5c0 0x7fe7a00cda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:21.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.858+0000 7fe7a5f07700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7a01f1b50 0x7fe7a01f1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:21.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.858+0000 7fe7a5f07700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a01502d0 con 0x7fe788003be0 2023-11-28T11:59:21.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.858+0000 7fe7a5f07700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a01f2530 con 0x7fe7a01f1b50 2023-11-28T11:59:21.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.858+0000 7fe7a5f07700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a00c79c0 con 0x7fe7a00cd5c0 2023-11-28T11:59:21.870 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.858+0000 7fe7a4f05700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe788003be0 0x7fe7a014fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:21.870 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.858+0000 7fe7a4f05700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe788003be0 0x7fe7a014fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60090/0 (socket says 172.21.15.39:60090) 2023-11-28T11:59:21.870 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.858+0000 7fe7a4f05700 1 -- 172.21.15.39:0/3182783219 learned_addr learned my addr 172.21.15.39:0/3182783219 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:21.870 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.858+0000 7fe7a5706700 1 --2- 172.21.15.39:0/3182783219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7a01f1b50 0x7fe7a01f1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:21.870 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.858+0000 7fe797fff700 1 --2- 172.21.15.39:0/3182783219 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7a00cd5c0 0x7fe7a00cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:21.870 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.858+0000 7fe7a4f05700 1 -- 172.21.15.39:0/3182783219 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7a00cd5c0 msgr2=0x7fe7a00cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:21.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.858+0000 7fe7a4f05700 1 --2- 172.21.15.39:0/3182783219 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7a00cd5c0 0x7fe7a00cda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:21.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.858+0000 7fe7a4f05700 1 -- 172.21.15.39:0/3182783219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7a01f1b50 msgr2=0x7fe7a01f1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:21.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.858+0000 7fe7a4f05700 1 --2- 172.21.15.39:0/3182783219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7a01f1b50 0x7fe7a01f1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:21.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.858+0000 7fe7a4f05700 1 -- 172.21.15.39:0/3182783219 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a006b5d0 con 0x7fe788003be0 2023-11-28T11:59:21.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.858+0000 7fe7a5706700 1 --2- 172.21.15.39:0/3182783219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7a01f1b50 0x7fe7a01f1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:59:21.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.858+0000 7fe797fff700 1 --2- 172.21.15.39:0/3182783219 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7a00cd5c0 0x7fe7a00cda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:59:21.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.858+0000 7fe7a4f05700 1 --2- 172.21.15.39:0/3182783219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe788003be0 0x7fe7a014fd90 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fe78800bcc0 tx=0x7fe79c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:21.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.858+0000 7fe7957fa700 1 -- 172.21.15.39:0/3182783219 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c00e6c0 con 0x7fe788003be0 2023-11-28T11:59:21.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.858+0000 7fe7957fa700 1 -- 172.21.15.39:0/3182783219 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79c013e30 con 0x7fe788003be0 2023-11-28T11:59:21.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.858+0000 7fe7957fa700 1 -- 172.21.15.39:0/3182783219 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c01c690 con 0x7fe788003be0 2023-11-28T11:59:21.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.858+0000 7fe7a5f07700 1 -- 172.21.15.39:0/3182783219 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7a006b2f0 con 0x7fe788003be0 2023-11-28T11:59:21.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.858+0000 7fe7a5f07700 1 -- 172.21.15.39:0/3182783219 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7a00ca7b0 con 0x7fe788003be0 2023-11-28T11:59:21.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.862+0000 7fe7a5f07700 1 -- 172.21.15.39:0/3182783219 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7a0073cb0 con 0x7fe788003be0 2023-11-28T11:59:21.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.862+0000 7fe7957fa700 1 -- 172.21.15.39:0/3182783219 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe79c019030 con 0x7fe788003be0 2023-11-28T11:59:21.873 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.862+0000 7fe7957fa700 1 --2- 172.21.15.39:0/3182783219 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe78c064f10 0x7fe78c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:21.873 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.862+0000 7fe7957fa700 1 -- 172.21.15.39:0/3182783219 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe79c083690 con 0x7fe788003be0 2023-11-28T11:59:21.873 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.866+0000 7fe797fff700 1 --2- 172.21.15.39:0/3182783219 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe78c064f10 0x7fe78c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:21.874 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.866+0000 7fe797fff700 1 --2- 172.21.15.39:0/3182783219 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe78c064f10 0x7fe78c0673c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe790007fd0 tx=0x7fe790009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:21.876 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:21.870+0000 7fe7957fa700 1 -- 172.21.15.39:0/3182783219 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe79c0516f0 con 0x7fe788003be0 2023-11-28T11:59:22.093 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.090+0000 7fe7a5f07700 1 -- 172.21.15.39:0/3182783219 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7a0071090 con 0x7fe788003be0 2023-11-28T11:59:22.094 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.090+0000 7fe7957fa700 1 -- 172.21.15.39:0/3182783219 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4648 (secure 0 0 0) 0x7fe79c054d10 con 0x7fe788003be0 2023-11-28T11:59:22.094 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:59:22.094 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5775,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3453450609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3453450609},{"type":"v1","addr":"172.21.15.39:6833","nonce":3453450609}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/697075022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":697075022},{"type":"v1","addr":"172.21.15.39:6835","nonce":697075022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5806,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1819593136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1819593136},{"type":"v1","addr":"172.21.15.184:6835","nonce":1819593136}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:58:51.635140+0000","modified":"2023-11-28T11:58:54.706764+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5809},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5809":{"gid":5809,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/367294936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":367294936},{"type":"v1","addr":"172.21.15.184:6837","nonce":367294936}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T11:59:22.097 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.094+0000 7fe7a5f07700 1 -- 172.21.15.39:0/3182783219 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe78c064f10 msgr2=0x7fe78c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:22.097 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.094+0000 7fe7a5f07700 1 --2- 172.21.15.39:0/3182783219 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe78c064f10 0x7fe78c0673c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe790007fd0 tx=0x7fe790009040 comp rx=0 tx=0).stop 2023-11-28T11:59:22.097 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.094+0000 7fe7a5f07700 1 -- 172.21.15.39:0/3182783219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe788003be0 msgr2=0x7fe7a014fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:22.097 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.094+0000 7fe7a5f07700 1 --2- 172.21.15.39:0/3182783219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe788003be0 0x7fe7a014fd90 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fe78800bcc0 tx=0x7fe79c0047e0 comp rx=0 tx=0).stop 2023-11-28T11:59:22.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.094+0000 7fe7a5f07700 1 -- 172.21.15.39:0/3182783219 shutdown_connections 2023-11-28T11:59:22.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.094+0000 7fe7a5f07700 1 --2- 172.21.15.39:0/3182783219 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe78c064f10 0x7fe78c0673c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:22.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.094+0000 7fe7a5f07700 1 --2- 172.21.15.39:0/3182783219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7a01f1b50 0x7fe7a01f1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:22.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.094+0000 7fe7a5f07700 1 --2- 172.21.15.39:0/3182783219 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7a00cd5c0 0x7fe7a00cda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:22.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.094+0000 7fe7a5f07700 1 --2- 172.21.15.39:0/3182783219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe788003be0 0x7fe7a014fd90 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:22.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.094+0000 7fe7a5f07700 1 -- 172.21.15.39:0/3182783219 >> 172.21.15.39:0/3182783219 conn(0x7fe7a00b0f80 msgr2=0x7fe7a0070060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:22.099 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.094+0000 7fe7a5f07700 1 -- 172.21.15.39:0/3182783219 shutdown_connections 2023-11-28T11:59:22.099 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.094+0000 7fe7a5f07700 1 -- 172.21.15.39:0/3182783219 wait complete. 2023-11-28T11:59:22.101 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 24 2023-11-28T11:59:22.122 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2023-11-28T11:59:22.332 INFO:teuthology.orchestra.run.smithi184.stdout:{"message":"","return_code":0} 2023-11-28T11:59:22.332 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-11-28T11:59:22.332 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2023-11-28T11:59:22.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.398+0000 7f24cca8e140 1 Processor -- start 2023-11-28T11:59:22.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.398+0000 7f24cca8e140 1 -- start start 2023-11-28T11:59:22.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.398+0000 7f24cca8e140 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x556a127b9700 0x556a12893d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:22.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.398+0000 7f24cca8e140 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556a127ec980 0x556a12894320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:22.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.398+0000 7f24cca8e140 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556a12877f40 0x556a12894860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:22.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.402+0000 7f24cca8e140 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a126e1240 con 0x556a127ec980 2023-11-28T11:59:22.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.402+0000 7f24cca8e140 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a127e35e0 con 0x556a12877f40 2023-11-28T11:59:22.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.402+0000 7f24cca8e140 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x556a12805ef0 con 0x556a127b9700 2023-11-28T11:59:22.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.402+0000 7f24c3fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556a127ec980 0x556a12894320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:22.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.402+0000 7f24cadc4700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556a12877f40 0x556a12894860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:22.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.402+0000 7f24ca5c3700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x556a127b9700 0x556a12893d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:22.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.402+0000 7f24c3fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556a127ec980 0x556a12894320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60112/0 (socket says 172.21.15.39:60112) 2023-11-28T11:59:22.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.402+0000 7f24c3fff700 1 -- 172.21.15.39:0/3040753342 learned_addr learned my addr 172.21.15.39:0/3040753342 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:22.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.402+0000 7f24c3fff700 1 -- 172.21.15.39:0/3040753342 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x556a127b9700 msgr2=0x556a12893d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:22.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.402+0000 7f24c3fff700 1 --2- 172.21.15.39:0/3040753342 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x556a127b9700 0x556a12893d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:22.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.402+0000 7f24c3fff700 1 -- 172.21.15.39:0/3040753342 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556a12877f40 msgr2=0x556a12894860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:22.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.402+0000 7f24c3fff700 1 --2- 172.21.15.39:0/3040753342 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556a12877f40 0x556a12894860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:22.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.402+0000 7f24c3fff700 1 -- 172.21.15.39:0/3040753342 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c400a1c0 con 0x556a127ec980 2023-11-28T11:59:22.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.402+0000 7f24c3fff700 1 --2- 172.21.15.39:0/3040753342 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556a127ec980 0x556a12894320 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f24b4001db0 tx=0x7f24b400b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3e797a1038d03dc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:22.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.402+0000 7f24c95c1700 1 -- 172.21.15.39:0/3040753342 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b4014070 con 0x556a127ec980 2023-11-28T11:59:22.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.402+0000 7f24c95c1700 1 -- 172.21.15.39:0/3040753342 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b4008030 con 0x556a127ec980 2023-11-28T11:59:22.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.402+0000 7f24c95c1700 1 -- 172.21.15.39:0/3040753342 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b400bce0 con 0x556a127ec980 2023-11-28T11:59:22.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.402+0000 7f24cca8e140 1 -- 172.21.15.39:0/3040753342 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556a127ec980 msgr2=0x556a12894320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:22.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.402+0000 7f24cca8e140 1 --2- 172.21.15.39:0/3040753342 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556a127ec980 0x556a12894320 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f24b4001db0 tx=0x7f24b400b4c0 comp rx=0 tx=0).stop 2023-11-28T11:59:22.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.402+0000 7f24cca8e140 1 -- 172.21.15.39:0/3040753342 shutdown_connections 2023-11-28T11:59:22.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.402+0000 7f24cca8e140 1 --2- 172.21.15.39:0/3040753342 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556a12877f40 0x556a12894860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:22.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.402+0000 7f24cca8e140 1 --2- 172.21.15.39:0/3040753342 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556a127ec980 0x556a12894320 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:22.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.402+0000 7f24cca8e140 1 --2- 172.21.15.39:0/3040753342 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x556a127b9700 0x556a12893d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:22.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.402+0000 7f24cca8e140 1 -- 172.21.15.39:0/3040753342 >> 172.21.15.39:0/3040753342 conn(0x556a127bfc30 msgr2=0x556a128075c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:22.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.402+0000 7f24cca8e140 1 -- 172.21.15.39:0/3040753342 shutdown_connections 2023-11-28T11:59:22.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.402+0000 7f24cca8e140 1 -- 172.21.15.39:0/3040753342 wait complete. 2023-11-28T11:59:22.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.406+0000 7f24cca8e140 1 Processor -- start 2023-11-28T11:59:22.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.406+0000 7f24cca8e140 1 -- start start 2023-11-28T11:59:22.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.406+0000 7f24cca8e140 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556a127b9700 0x556a12890300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:22.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.406+0000 7f24cca8e140 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x556a127ec980 0x556a127e3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:22.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.406+0000 7f24cca8e140 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556a12877f40 0x556a127e4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:22.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.406+0000 7f24cca8e140 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a1291ae30 con 0x556a127b9700 2023-11-28T11:59:22.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.406+0000 7f24cca8e140 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a1291b0d0 con 0x556a12877f40 2023-11-28T11:59:22.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.406+0000 7f24cca8e140 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x556a1291b370 con 0x556a127ec980 2023-11-28T11:59:22.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.406+0000 7f24ca5c3700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556a127b9700 0x556a12890300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:22.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.406+0000 7f24ca5c3700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556a127b9700 0x556a12890300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60128/0 (socket says 172.21.15.39:60128) 2023-11-28T11:59:22.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.406+0000 7f24ca5c3700 1 -- 172.21.15.39:0/2927995674 learned_addr learned my addr 172.21.15.39:0/2927995674 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:22.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.406+0000 7f24c3fff700 1 --2- 172.21.15.39:0/2927995674 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x556a127ec980 0x556a127e3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:22.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.406+0000 7f24cadc4700 1 --2- 172.21.15.39:0/2927995674 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556a12877f40 0x556a127e4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:22.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.406+0000 7f24ca5c3700 1 -- 172.21.15.39:0/2927995674 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x556a127ec980 msgr2=0x556a127e3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:22.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.406+0000 7f24ca5c3700 1 --2- 172.21.15.39:0/2927995674 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x556a127ec980 0x556a127e3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:22.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.406+0000 7f24ca5c3700 1 -- 172.21.15.39:0/2927995674 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556a12877f40 msgr2=0x556a127e4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:22.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.406+0000 7f24ca5c3700 1 --2- 172.21.15.39:0/2927995674 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556a12877f40 0x556a127e4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:22.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.406+0000 7f24ca5c3700 1 -- 172.21.15.39:0/2927995674 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b400a040 con 0x556a127b9700 2023-11-28T11:59:22.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.406+0000 7f24ca5c3700 1 --2- 172.21.15.39:0/2927995674 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556a127b9700 0x556a12890300 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f24bc008810 tx=0x7f24bc008bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:22.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.406+0000 7f24c37fe700 1 -- 172.21.15.39:0/2927995674 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc00f040 con 0x556a127b9700 2023-11-28T11:59:22.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.406+0000 7f24c37fe700 1 -- 172.21.15.39:0/2927995674 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24bc015860 con 0x556a127b9700 2023-11-28T11:59:22.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.406+0000 7f24c37fe700 1 -- 172.21.15.39:0/2927995674 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc015bf0 con 0x556a127b9700 2023-11-28T11:59:22.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.406+0000 7f24cca8e140 1 -- 172.21.15.39:0/2927995674 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556a126f9390 con 0x556a127b9700 2023-11-28T11:59:22.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.406+0000 7f24cca8e140 1 -- 172.21.15.39:0/2927995674 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556a126ec8b0 con 0x556a127b9700 2023-11-28T11:59:22.415 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.410+0000 7f24c37fe700 1 -- 172.21.15.39:0/2927995674 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f24bc015d50 con 0x556a127b9700 2023-11-28T11:59:22.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.410+0000 7f24c37fe700 1 --2- 172.21.15.39:0/2927995674 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f24ac063840 0x7f24ac065cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:22.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.410+0000 7f24c37fe700 1 -- 172.21.15.39:0/2927995674 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f24bc0818f0 con 0x556a127b9700 2023-11-28T11:59:22.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.414+0000 7f24cca8e140 1 --2- 172.21.15.39:0/2927995674 >> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] conn(0x556a1291bd50 0x556a1291c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:22.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.414+0000 7f24cca8e140 1 -- 172.21.15.39:0/2927995674 --> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] -- osd_op(unknown.0.0:1 9.7 9:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e58) v8 -- 0x556a1291c690 con 0x556a1291bd50 2023-11-28T11:59:22.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.414+0000 7f24c3fff700 1 --2- 172.21.15.39:0/2927995674 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f24ac063840 0x7f24ac065cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:22.417 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.414+0000 7f24cadc4700 1 --2- 172.21.15.39:0/2927995674 >> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] conn(0x556a1291bd50 0x556a1291c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:22.418 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.414+0000 7f24c3fff700 1 --2- 172.21.15.39:0/2927995674 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f24ac063840 0x7f24ac065cf0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f24b4003040 tx=0x7f24b4009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:22.418 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.414+0000 7f24cadc4700 1 --2- 172.21.15.39:0/2927995674 >> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] conn(0x556a1291bd50 0x556a1291c150 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:22.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.414+0000 7f24cadc4700 1 -- 172.21.15.39:0/2927995674 <== osd.5 v2:172.21.15.184:6808/36505 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x7f24c4017040 con 0x556a1291bd50 2023-11-28T11:59:22.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.414+0000 7f24cca8e140 1 -- 172.21.15.39:0/2927995674 >> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] conn(0x556a1291bd50 msgr2=0x556a1291c150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:22.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.414+0000 7f24cca8e140 1 --2- 172.21.15.39:0/2927995674 >> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] conn(0x556a1291bd50 0x556a1291c150 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:22.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.414+0000 7f24cca8e140 1 -- 172.21.15.39:0/2927995674 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f24ac063840 msgr2=0x7f24ac065cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:22.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.414+0000 7f24cca8e140 1 --2- 172.21.15.39:0/2927995674 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f24ac063840 0x7f24ac065cf0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f24b4003040 tx=0x7f24b4009000 comp rx=0 tx=0).stop 2023-11-28T11:59:22.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.414+0000 7f24cca8e140 1 -- 172.21.15.39:0/2927995674 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556a127b9700 msgr2=0x556a12890300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:22.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.414+0000 7f24cca8e140 1 --2- 172.21.15.39:0/2927995674 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556a127b9700 0x556a12890300 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f24bc008810 tx=0x7f24bc008bd0 comp rx=0 tx=0).stop 2023-11-28T11:59:22.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.414+0000 7f24cadc4700 1 -- 172.21.15.39:0/2927995674 reap_dead start 2023-11-28T11:59:22.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.414+0000 7f24cca8e140 1 -- 172.21.15.39:0/2927995674 shutdown_connections 2023-11-28T11:59:22.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.414+0000 7f24cca8e140 1 -- 172.21.15.39:0/2927995674 >> 172.21.15.39:0/2927995674 conn(0x556a127bfc30 msgr2=0x556a127e2420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:22.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.414+0000 7f24cca8e140 1 -- 172.21.15.39:0/2927995674 shutdown_connections 2023-11-28T11:59:22.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.414+0000 7f24cca8e140 1 -- 172.21.15.39:0/2927995674 wait complete. 2023-11-28T11:59:22.427 INFO:teuthology.orchestra.run.smithi039.stdout:Yalphaparent_a 2023-11-28T11:59:22.427 DEBUG:teuthology.orchestra.run.smithi039:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2023-11-28T11:59:22.505 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2023-11-28T11:59:22.505 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511627777, 2023-11-28T11:59:22.505 INFO:teuthology.orchestra.run.smithi039.stdout: "ancestors": [ 2023-11-28T11:59:22.505 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:59:22.505 INFO:teuthology.orchestra.run.smithi039.stdout: "dirino": 1099511627776, 2023-11-28T11:59:22.506 INFO:teuthology.orchestra.run.smithi039.stdout: "dname": "alpha", 2023-11-28T11:59:22.506 INFO:teuthology.orchestra.run.smithi039.stdout: "version": 2 2023-11-28T11:59:22.506 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:59:22.506 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:59:22.506 INFO:teuthology.orchestra.run.smithi039.stdout: "dirino": 1, 2023-11-28T11:59:22.506 INFO:teuthology.orchestra.run.smithi039.stdout: "dname": "parent_a", 2023-11-28T11:59:22.506 INFO:teuthology.orchestra.run.smithi039.stdout: "version": 4 2023-11-28T11:59:22.506 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:59:22.506 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2023-11-28T11:59:22.506 INFO:teuthology.orchestra.run.smithi039.stdout: "pool": 9, 2023-11-28T11:59:22.506 INFO:teuthology.orchestra.run.smithi039.stdout: "old_pools": [] 2023-11-28T11:59:22.506 INFO:teuthology.orchestra.run.smithi039.stdout:} 2023-11-28T11:59:22.506 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:59:22.512 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T11:59:22.512 DEBUG:teuthology.orchestra.run.smithi039:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T11:59:22.602 DEBUG:teuthology.orchestra.run.smithi184:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T11:59:22.644 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T11:59:22.645 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:59:22.645 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:59:22.664 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:59:22.665 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:59:22.725 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:59:22.950 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.946+0000 7f55b1b4f700 1 Processor -- start 2023-11-28T11:59:22.950 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.946+0000 7f55b1b4f700 1 -- start start 2023-11-28T11:59:22.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.950+0000 7f55b1b4f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f55ac15d510 0x7f55ac0b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:22.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.950+0000 7f55b1b4f700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55ac15d080 con 0x7f55ac0b6030 2023-11-28T11:59:22.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.950+0000 7f55b1b4f700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55ac153870 con 0x7f55ac1534a0 2023-11-28T11:59:22.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.950+0000 7f55b1b4f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac15d940 con 0x7f55ac15d510 2023-11-28T11:59:22.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.950+0000 7f55abfff700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f55ac0b6030 0x7f55ac070630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:52070/0 (socket says 172.21.15.39:52070) 2023-11-28T11:59:22.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.950+0000 7f55abfff700 1 -- 172.21.15.39:0/2315263127 learned_addr learned my addr 172.21.15.39:0/2315263127 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:59:22.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.950+0000 7f55aaffd700 1 --2- 172.21.15.39:0/2315263127 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f55ac15d510 0x7f55ac0b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:22.955 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.950+0000 7f55aa7fc700 1 -- 172.21.15.39:0/2315263127 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1574257289 0 0) 0x7f55ac15d080 con 0x7f55ac0b6030 2023-11-28T11:59:22.955 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.950+0000 7f55aa7fc700 1 -- 172.21.15.39:0/2315263127 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55940035d0 con 0x7f55ac0b6030 2023-11-28T11:59:22.955 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.950+0000 7f55aa7fc700 1 -- 172.21.15.39:0/2315263127 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 896049115 0 0) 0x7f55ac153870 con 0x7f55ac1534a0 2023-11-28T11:59:22.955 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.950+0000 7f55aa7fc700 1 -- 172.21.15.39:0/2315263127 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55ac15d080 con 0x7f55ac1534a0 2023-11-28T11:59:22.955 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.950+0000 7f55aaffd700 1 -- 172.21.15.39:0/2315263127 >> v1:172.21.15.184:6789/0 conn(0x7f55ac1534a0 legacy=0x7f55ac160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:22.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.950+0000 7f55aaffd700 1 -- 172.21.15.39:0/2315263127 >> v1:172.21.15.39:6789/0 conn(0x7f55ac0b6030 legacy=0x7f55ac070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:22.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.950+0000 7f55aaffd700 1 -- 172.21.15.39:0/2315263127 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ac0b6450 con 0x7f55ac15d510 2023-11-28T11:59:22.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.954+0000 7f55aaffd700 1 --2- 172.21.15.39:0/2315263127 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f55ac15d510 0x7f55ac0b5af0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f55a0009880 tx=0x7f55a0009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed2e7290d4111657 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:22.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.954+0000 7f55aa7fc700 1 -- 172.21.15.39:0/2315263127 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a0011830 con 0x7f55ac15d510 2023-11-28T11:59:22.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.954+0000 7f55aa7fc700 1 -- 172.21.15.39:0/2315263127 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a0011990 con 0x7f55ac15d510 2023-11-28T11:59:22.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.954+0000 7f55aa7fc700 1 -- 172.21.15.39:0/2315263127 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a0011d00 con 0x7f55ac15d510 2023-11-28T11:59:22.958 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.954+0000 7f55b1b4f700 1 -- 172.21.15.39:0/2315263127 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f55ac15d510 msgr2=0x7f55ac0b5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:22.958 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.954+0000 7f55b1b4f700 1 --2- 172.21.15.39:0/2315263127 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f55ac15d510 0x7f55ac0b5af0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f55a0009880 tx=0x7f55a0009b90 comp rx=0 tx=0).stop 2023-11-28T11:59:22.958 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.954+0000 7f55b1b4f700 1 -- 172.21.15.39:0/2315263127 shutdown_connections 2023-11-28T11:59:22.958 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.954+0000 7f55b1b4f700 1 --2- 172.21.15.39:0/2315263127 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f55ac15d510 0x7f55ac0b5af0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:22.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.954+0000 7f55b1b4f700 1 -- 172.21.15.39:0/2315263127 >> 172.21.15.39:0/2315263127 conn(0x7f55ac06bfc0 msgr2=0x7f55ac06c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:22.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.954+0000 7f55b1b4f700 1 -- 172.21.15.39:0/2315263127 shutdown_connections 2023-11-28T11:59:22.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.954+0000 7f55b1b4f700 1 -- 172.21.15.39:0/2315263127 wait complete. 2023-11-28T11:59:22.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.958+0000 7f55b1b4f700 1 Processor -- start 2023-11-28T11:59:22.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.958+0000 7f55b1b4f700 1 -- start start 2023-11-28T11:59:22.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.962+0000 7f55b1b4f700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f55ac0b6030 0x7f55ac14c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:22.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.962+0000 7f55b1b4f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55ac1534a0 0x7f55ac14e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:22.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.962+0000 7f55b1b4f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f55ac15d510 0x7f55ac15e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:22.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.962+0000 7f55b1b4f700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac154160 con 0x7f55ac0b6030 2023-11-28T11:59:22.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.962+0000 7f55b1b4f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac1f1830 con 0x7f55ac1534a0 2023-11-28T11:59:22.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.962+0000 7f55b1b4f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac14c6c0 con 0x7f55ac15d510 2023-11-28T11:59:22.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.962+0000 7f55ab7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f55ac0b6030 0x7f55ac14c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:22.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.962+0000 7f55aaffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55ac1534a0 0x7f55ac14e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:22.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.962+0000 7f55aaffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55ac1534a0 0x7f55ac14e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:34148/0 (socket says 172.21.15.39:34148) 2023-11-28T11:59:22.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.962+0000 7f55aaffd700 1 -- 172.21.15.39:0/1259802874 learned_addr learned my addr 172.21.15.39:0/1259802874 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:22.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.962+0000 7f55abfff700 1 --2- 172.21.15.39:0/1259802874 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f55ac15d510 0x7f55ac15e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:22.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.962+0000 7f55aaffd700 1 -- 172.21.15.39:0/1259802874 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f55ac15d510 msgr2=0x7f55ac15e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:22.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.962+0000 7f55aaffd700 1 --2- 172.21.15.39:0/1259802874 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f55ac15d510 0x7f55ac15e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:22.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.962+0000 7f55aaffd700 1 -- 172.21.15.39:0/1259802874 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f55ac0b6030 msgr2=0x7f55ac14c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:22.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.962+0000 7f55aaffd700 1 --2- 172.21.15.39:0/1259802874 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f55ac0b6030 0x7f55ac14c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:22.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.962+0000 7f55aaffd700 1 -- 172.21.15.39:0/1259802874 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a00094b0 con 0x7f55ac1534a0 2023-11-28T11:59:22.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.962+0000 7f55ab7fe700 1 --2- 172.21.15.39:0/1259802874 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f55ac0b6030 0x7f55ac14c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:22.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.962+0000 7f55aaffd700 1 --2- 172.21.15.39:0/1259802874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55ac1534a0 0x7f55ac14e7f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f55a00090b0 tx=0x7f55a0004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:22.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.966+0000 7f5593fff700 1 -- 172.21.15.39:0/1259802874 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a0004510 con 0x7f55ac1534a0 2023-11-28T11:59:22.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.966+0000 7f5593fff700 1 -- 172.21.15.39:0/1259802874 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a00036c0 con 0x7f55ac1534a0 2023-11-28T11:59:22.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.966+0000 7f5593fff700 1 -- 172.21.15.39:0/1259802874 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a0003a70 con 0x7f55ac1534a0 2023-11-28T11:59:22.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.966+0000 7f55b1b4f700 1 -- 172.21.15.39:0/1259802874 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55ac0b56a0 con 0x7f55ac1534a0 2023-11-28T11:59:22.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.966+0000 7f55b1b4f700 1 -- 172.21.15.39:0/1259802874 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55ac0b53c0 con 0x7f55ac1534a0 2023-11-28T11:59:22.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.966+0000 7f55b1b4f700 1 -- 172.21.15.39:0/1259802874 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55ac15ca30 con 0x7f55ac1534a0 2023-11-28T11:59:22.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.970+0000 7f5593fff700 1 -- 172.21.15.39:0/1259802874 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f55a000f050 con 0x7f55ac1534a0 2023-11-28T11:59:22.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.970+0000 7f5593fff700 1 --2- 172.21.15.39:0/1259802874 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5598064ee0 0x7f5598067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:22.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.970+0000 7f5593fff700 1 -- 172.21.15.39:0/1259802874 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f55a0083300 con 0x7f55ac1534a0 2023-11-28T11:59:22.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.970+0000 7f55ab7fe700 1 --2- 172.21.15.39:0/1259802874 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5598064ee0 0x7f5598067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:22.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.974+0000 7f55ab7fe700 1 --2- 172.21.15.39:0/1259802874 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5598064ee0 0x7f5598067390 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f559c0011e0 tx=0x7f559c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:22.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:22.974+0000 7f5593fff700 1 -- 172.21.15.39:0/1259802874 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f55a0051360 con 0x7f55ac1534a0 2023-11-28T11:59:23.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.150+0000 7f55b1b4f700 1 -- 172.21.15.39:0/1259802874 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55ac0726c0 con 0x7f55ac1534a0 2023-11-28T11:59:23.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.154+0000 7f5593fff700 1 -- 172.21.15.39:0/1259802874 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+18084 (secure 0 0 0) 0x7f55a0054980 con 0x7f55ac1534a0 2023-11-28T11:59:23.157 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:59:23.157 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":58,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:58:52.640486+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:58:50.082546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-28T11:58:50.610241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:59:23.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.158+0000 7f55b1b4f700 1 -- 172.21.15.39:0/1259802874 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5598064ee0 msgr2=0x7f5598067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:23.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.158+0000 7f55b1b4f700 1 --2- 172.21.15.39:0/1259802874 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5598064ee0 0x7f5598067390 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f559c0011e0 tx=0x7f559c009040 comp rx=0 tx=0).stop 2023-11-28T11:59:23.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.158+0000 7f55b1b4f700 1 -- 172.21.15.39:0/1259802874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55ac1534a0 msgr2=0x7f55ac14e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:23.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.158+0000 7f55b1b4f700 1 --2- 172.21.15.39:0/1259802874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55ac1534a0 0x7f55ac14e7f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f55a00090b0 tx=0x7f55a0004770 comp rx=0 tx=0).stop 2023-11-28T11:59:23.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.158+0000 7f55b1b4f700 1 -- 172.21.15.39:0/1259802874 shutdown_connections 2023-11-28T11:59:23.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.158+0000 7f55b1b4f700 1 --2- 172.21.15.39:0/1259802874 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f55ac15d510 0x7f55ac15e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.158+0000 7f55b1b4f700 1 --2- 172.21.15.39:0/1259802874 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5598064ee0 0x7f5598067390 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.158+0000 7f55b1b4f700 1 --2- 172.21.15.39:0/1259802874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55ac1534a0 0x7f55ac14e7f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.158+0000 7f55b1b4f700 1 --2- 172.21.15.39:0/1259802874 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f55ac0b6030 0x7f55ac14c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.158+0000 7f55b1b4f700 1 -- 172.21.15.39:0/1259802874 >> 172.21.15.39:0/1259802874 conn(0x7f55ac06bfc0 msgr2=0x7f55ac159d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:23.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.158+0000 7f55b1b4f700 1 -- 172.21.15.39:0/1259802874 shutdown_connections 2023-11-28T11:59:23.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.158+0000 7f55b1b4f700 1 -- 172.21.15.39:0/1259802874 wait complete. 2023-11-28T11:59:23.186 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:56:26.631457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:56:33.242202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:58:50.082546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:58:50.610241+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:59:23.186 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:59:23.370 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.366+0000 7f0d2e777700 1 Processor -- start 2023-11-28T11:59:23.371 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.366+0000 7f0d2e777700 1 -- start start 2023-11-28T11:59:23.375 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.370+0000 7f0d2e777700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0d2815c150 0x7f0d280b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:23.375 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.370+0000 7f0d2e777700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0d2806ff10 0x7f0d28070360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:23.375 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.370+0000 7f0d2e777700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d2815c520 con 0x7f0d2815fc30 2023-11-28T11:59:23.375 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.370+0000 7f0d2e777700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d280b4240 con 0x7f0d2815c150 2023-11-28T11:59:23.375 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.370+0000 7f0d2e777700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d280708a0 con 0x7f0d2806ff10 2023-11-28T11:59:23.376 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.370+0000 7f0d2d775700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0d2815c150 0x7f0d280b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:23.376 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.370+0000 7f0d2d775700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0d2815c150 0x7f0d280b3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60150/0 (socket says 172.21.15.39:60150) 2023-11-28T11:59:23.376 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.370+0000 7f0d2d775700 1 -- 172.21.15.39:0/3236675230 learned_addr learned my addr 172.21.15.39:0/3236675230 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:23.376 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.370+0000 7f0d2cf74700 1 --2- 172.21.15.39:0/3236675230 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0d2806ff10 0x7f0d28070360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:23.378 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.374+0000 7f0d2d775700 1 -- 172.21.15.39:0/3236675230 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0d2806ff10 msgr2=0x7f0d28070360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:23.379 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.374+0000 7f0d2d775700 1 --2- 172.21.15.39:0/3236675230 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0d2806ff10 0x7f0d28070360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.379 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.374+0000 7f0d2d775700 1 -- 172.21.15.39:0/3236675230 >> v1:172.21.15.184:6789/0 conn(0x7f0d2815fc30 legacy=0x7f0d281600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:23.379 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.374+0000 7f0d2d775700 1 -- 172.21.15.39:0/3236675230 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2806ac00 con 0x7f0d2815c150 2023-11-28T11:59:23.379 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.374+0000 7f0d2cf74700 1 --2- 172.21.15.39:0/3236675230 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0d2806ff10 0x7f0d28070360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:23.379 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.374+0000 7f0d2d775700 1 --2- 172.21.15.39:0/3236675230 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d2815c150 0x7f0d280b3d00 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f0d24009910 tx=0x7f0d24009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=420b9275834bc0cf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:23.379 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.374+0000 7f0d1ffff700 1 -- 172.21.15.39:0/3236675230 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2400ba60 con 0x7f0d2815c150 2023-11-28T11:59:23.379 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.374+0000 7f0d1ffff700 1 -- 172.21.15.39:0/3236675230 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2400bbc0 con 0x7f0d2815c150 2023-11-28T11:59:23.379 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.374+0000 7f0d1ffff700 1 -- 172.21.15.39:0/3236675230 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d24009e60 con 0x7f0d2815c150 2023-11-28T11:59:23.379 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.374+0000 7f0d2e777700 1 -- 172.21.15.39:0/3236675230 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d2815c150 msgr2=0x7f0d280b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:23.379 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.374+0000 7f0d2e777700 1 --2- 172.21.15.39:0/3236675230 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d2815c150 0x7f0d280b3d00 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f0d24009910 tx=0x7f0d24009c20 comp rx=0 tx=0).stop 2023-11-28T11:59:23.380 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.374+0000 7f0d2e777700 1 -- 172.21.15.39:0/3236675230 shutdown_connections 2023-11-28T11:59:23.380 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.374+0000 7f0d2e777700 1 --2- 172.21.15.39:0/3236675230 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0d2806ff10 0x7f0d28070360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.380 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.374+0000 7f0d2e777700 1 --2- 172.21.15.39:0/3236675230 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d2815c150 0x7f0d280b3d00 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.380 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.374+0000 7f0d2e777700 1 -- 172.21.15.39:0/3236675230 >> 172.21.15.39:0/3236675230 conn(0x7f0d280d3680 msgr2=0x7f0d280cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:23.380 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.374+0000 7f0d2e777700 1 -- 172.21.15.39:0/3236675230 shutdown_connections 2023-11-28T11:59:23.380 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.374+0000 7f0d2e777700 1 -- 172.21.15.39:0/3236675230 wait complete. 2023-11-28T11:59:23.381 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.378+0000 7f0d2e777700 1 Processor -- start 2023-11-28T11:59:23.382 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.378+0000 7f0d2e777700 1 -- start start 2023-11-28T11:59:23.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.378+0000 7f0d2e777700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d2806ff10 0x7f0d281566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:23.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.378+0000 7f0d2e777700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d2815c150 0x7f0d28156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:23.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.378+0000 7f0d2e777700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0d2815fc30 0x7f0d280cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:23.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.378+0000 7f0d2e777700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d280cb700 con 0x7f0d2806ff10 2023-11-28T11:59:23.385 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.378+0000 7f0d2e777700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d280cab30 con 0x7f0d2815c150 2023-11-28T11:59:23.385 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.378+0000 7f0d2e777700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d280cadd0 con 0x7f0d2815fc30 2023-11-28T11:59:23.385 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.382+0000 7f0d2d775700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d2806ff10 0x7f0d281566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:23.385 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.382+0000 7f0d2d775700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d2806ff10 0x7f0d281566f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60156/0 (socket says 172.21.15.39:60156) 2023-11-28T11:59:23.385 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.382+0000 7f0d2d775700 1 -- 172.21.15.39:0/915598486 learned_addr learned my addr 172.21.15.39:0/915598486 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:23.386 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.382+0000 7f0d2cf74700 1 --2- 172.21.15.39:0/915598486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d2815c150 0x7f0d28156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:23.386 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.382+0000 7f0d2df76700 1 --2- 172.21.15.39:0/915598486 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0d2815fc30 0x7f0d280cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:23.386 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.382+0000 7f0d2d775700 1 -- 172.21.15.39:0/915598486 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0d2815fc30 msgr2=0x7f0d280cbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:23.386 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.382+0000 7f0d2d775700 1 --2- 172.21.15.39:0/915598486 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0d2815fc30 0x7f0d280cbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.386 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.382+0000 7f0d2d775700 1 -- 172.21.15.39:0/915598486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d2815c150 msgr2=0x7f0d28156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:23.386 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.382+0000 7f0d2d775700 1 --2- 172.21.15.39:0/915598486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d2815c150 0x7f0d28156f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.386 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.382+0000 7f0d2d775700 1 -- 172.21.15.39:0/915598486 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d24009570 con 0x7f0d2806ff10 2023-11-28T11:59:23.386 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.382+0000 7f0d2df76700 1 --2- 172.21.15.39:0/915598486 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0d2815fc30 0x7f0d280cbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:23.386 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.382+0000 7f0d2cf74700 1 --2- 172.21.15.39:0/915598486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d2815c150 0x7f0d28156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:23.387 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.382+0000 7f0d2d775700 1 --2- 172.21.15.39:0/915598486 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d2806ff10 0x7f0d281566f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f0d28073200 tx=0x7f0d24004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:23.387 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.382+0000 7f0d1dffb700 1 -- 172.21.15.39:0/915598486 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d24004610 con 0x7f0d2806ff10 2023-11-28T11:59:23.387 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.382+0000 7f0d1dffb700 1 -- 172.21.15.39:0/915598486 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2401f070 con 0x7f0d2806ff10 2023-11-28T11:59:23.387 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.382+0000 7f0d2e777700 1 -- 172.21.15.39:0/915598486 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d280d2450 con 0x7f0d2806ff10 2023-11-28T11:59:23.387 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.382+0000 7f0d1dffb700 1 -- 172.21.15.39:0/915598486 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d24003900 con 0x7f0d2806ff10 2023-11-28T11:59:23.387 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.382+0000 7f0d2e777700 1 -- 172.21.15.39:0/915598486 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d2806cc50 con 0x7f0d2806ff10 2023-11-28T11:59:23.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.386+0000 7f0d2e777700 1 -- 172.21.15.39:0/915598486 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d280d2730 con 0x7f0d2806ff10 2023-11-28T11:59:23.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.386+0000 7f0d1dffb700 1 -- 172.21.15.39:0/915598486 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0d2400f050 con 0x7f0d2806ff10 2023-11-28T11:59:23.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.390+0000 7f0d1dffb700 1 --2- 172.21.15.39:0/915598486 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0d0c064f30 0x7f0d0c0673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:23.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.390+0000 7f0d1dffb700 1 -- 172.21.15.39:0/915598486 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0d24021070 con 0x7f0d2806ff10 2023-11-28T11:59:23.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.390+0000 7f0d2cf74700 1 --2- 172.21.15.39:0/915598486 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0d0c064f30 0x7f0d0c0673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:23.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.390+0000 7f0d2cf74700 1 --2- 172.21.15.39:0/915598486 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0d0c064f30 0x7f0d0c0673e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0d280b5da0 tx=0x7f0d18008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:23.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.394+0000 7f0d1dffb700 1 -- 172.21.15.39:0/915598486 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0d240518d0 con 0x7f0d2806ff10 2023-11-28T11:59:23.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.570+0000 7f0d2e777700 1 -- 172.21.15.39:0/915598486 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0d28073d20 con 0x7f0d2806ff10 2023-11-28T11:59:23.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.574+0000 7f0d1dffb700 1 -- 172.21.15.39:0/915598486 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0d24024380 con 0x7f0d2806ff10 2023-11-28T11:59:23.577 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-11-28T11:59:23.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.578+0000 7f0d2e777700 1 -- 172.21.15.39:0/915598486 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0d0c064f30 msgr2=0x7f0d0c0673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:23.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.578+0000 7f0d2e777700 1 --2- 172.21.15.39:0/915598486 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0d0c064f30 0x7f0d0c0673e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0d280b5da0 tx=0x7f0d18008040 comp rx=0 tx=0).stop 2023-11-28T11:59:23.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.578+0000 7f0d2e777700 1 -- 172.21.15.39:0/915598486 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d2806ff10 msgr2=0x7f0d281566f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:23.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.578+0000 7f0d2e777700 1 --2- 172.21.15.39:0/915598486 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d2806ff10 0x7f0d281566f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f0d28073200 tx=0x7f0d24004770 comp rx=0 tx=0).stop 2023-11-28T11:59:23.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.578+0000 7f0d2e777700 1 -- 172.21.15.39:0/915598486 shutdown_connections 2023-11-28T11:59:23.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.578+0000 7f0d2e777700 1 --2- 172.21.15.39:0/915598486 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0d2815fc30 0x7f0d280cbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.583 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.578+0000 7f0d2e777700 1 --2- 172.21.15.39:0/915598486 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0d0c064f30 0x7f0d0c0673e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.583 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.578+0000 7f0d2e777700 1 --2- 172.21.15.39:0/915598486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d2815c150 0x7f0d28156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.583 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.578+0000 7f0d2e777700 1 --2- 172.21.15.39:0/915598486 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d2806ff10 0x7f0d281566f0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.583 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.578+0000 7f0d2e777700 1 -- 172.21.15.39:0/915598486 >> 172.21.15.39:0/915598486 conn(0x7f0d280d3680 msgr2=0x7f0d280c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:23.583 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.578+0000 7f0d2e777700 1 -- 172.21.15.39:0/915598486 shutdown_connections 2023-11-28T11:59:23.583 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.578+0000 7f0d2e777700 1 -- 172.21.15.39:0/915598486 wait complete. 2023-11-28T11:59:23.605 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:59:23.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.790+0000 7f3212a3e700 1 Processor -- start 2023-11-28T11:59:23.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.790+0000 7f3212a3e700 1 -- start start 2023-11-28T11:59:23.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.794+0000 7f3212a3e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f320c15d930 0x7f320c0b1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:23.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.794+0000 7f3212a3e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f320c156e10 0x7f320c0b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:23.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.794+0000 7f3212a3e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f320c0cee70 con 0x7f320c156a40 2023-11-28T11:59:23.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.794+0000 7f3212a3e700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f320c15a540 con 0x7f320c156e10 2023-11-28T11:59:23.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.794+0000 7f3212a3e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f320c0cddd0 con 0x7f320c15d930 2023-11-28T11:59:23.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.794+0000 7f320bfff700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f320c156a40 0x7f320c159e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:49428/0 (socket says 172.21.15.39:49428) 2023-11-28T11:59:23.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.794+0000 7f320bfff700 1 -- 172.21.15.39:0/3515655710 learned_addr learned my addr 172.21.15.39:0/3515655710 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:59:23.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.794+0000 7f32037fe700 1 --2- 172.21.15.39:0/3515655710 >> v2:172.21.15.184:3300/0 conn(0x7f320c15d930 0x7f320c0b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:23.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.794+0000 7f3210fdb700 1 --2- 172.21.15.39:0/3515655710 >> v2:172.21.15.39:3300/0 conn(0x7f320c156e10 0x7f320c0b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:23.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.798+0000 7f320b7fe700 1 -- 172.21.15.39:0/3515655710 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3359386946 0 0) 0x7f320c0cee70 con 0x7f320c156a40 2023-11-28T11:59:23.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.798+0000 7f320b7fe700 1 -- 172.21.15.39:0/3515655710 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31f80035d0 con 0x7f320c156a40 2023-11-28T11:59:23.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.798+0000 7f32037fe700 1 -- 172.21.15.39:0/3515655710 >> v2:172.21.15.39:3300/0 conn(0x7f320c156e10 msgr2=0x7f320c0b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:23.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.798+0000 7f32037fe700 1 --2- 172.21.15.39:0/3515655710 >> v2:172.21.15.39:3300/0 conn(0x7f320c156e10 0x7f320c0b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.798+0000 7f32037fe700 1 -- 172.21.15.39:0/3515655710 >> v1:172.21.15.184:6789/0 conn(0x7f320c156a40 legacy=0x7f320c159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:23.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.798+0000 7f32037fe700 1 -- 172.21.15.39:0/3515655710 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f320c0ce0b0 con 0x7f320c15d930 2023-11-28T11:59:23.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.798+0000 7f32037fe700 1 --2- 172.21.15.39:0/3515655710 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f320c15d930 0x7f320c0b1400 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f320c0d0a50 tx=0x7f31f4009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d4d78ebfd4814b4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:23.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.798+0000 7f320b7fe700 1 -- 172.21.15.39:0/3515655710 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f4011830 con 0x7f320c15d930 2023-11-28T11:59:23.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.798+0000 7f320b7fe700 1 -- 172.21.15.39:0/3515655710 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f4011990 con 0x7f320c15d930 2023-11-28T11:59:23.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.798+0000 7f320b7fe700 1 -- 172.21.15.39:0/3515655710 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f4011d20 con 0x7f320c15d930 2023-11-28T11:59:23.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.798+0000 7f3212a3e700 1 -- 172.21.15.39:0/3515655710 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f320c15d930 msgr2=0x7f320c0b1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:23.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.798+0000 7f3212a3e700 1 --2- 172.21.15.39:0/3515655710 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f320c15d930 0x7f320c0b1400 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f320c0d0a50 tx=0x7f31f4009b30 comp rx=0 tx=0).stop 2023-11-28T11:59:23.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.798+0000 7f3212a3e700 1 -- 172.21.15.39:0/3515655710 shutdown_connections 2023-11-28T11:59:23.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.798+0000 7f3212a3e700 1 --2- 172.21.15.39:0/3515655710 >> v2:172.21.15.39:3300/0 conn(0x7f320c156e10 0x7f320c0b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.798+0000 7f3212a3e700 1 --2- 172.21.15.39:0/3515655710 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f320c15d930 0x7f320c0b1400 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.798+0000 7f3212a3e700 1 -- 172.21.15.39:0/3515655710 >> 172.21.15.39:0/3515655710 conn(0x7f320c06e2e0 msgr2=0x7f320c06e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:23.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.798+0000 7f3212a3e700 1 -- 172.21.15.39:0/3515655710 shutdown_connections 2023-11-28T11:59:23.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.798+0000 7f3212a3e700 1 -- 172.21.15.39:0/3515655710 wait complete. 2023-11-28T11:59:23.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.802+0000 7f3212a3e700 1 Processor -- start 2023-11-28T11:59:23.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.802+0000 7f3212a3e700 1 -- start start 2023-11-28T11:59:23.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.806+0000 7f3212a3e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f320c156a40 0x7f320c0c9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:23.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.806+0000 7f3212a3e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f320c156e10 0x7f320c0c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:23.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.806+0000 7f3212a3e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f320c15d930 0x7f320c158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:23.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.806+0000 7f3212a3e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320c15a960 con 0x7f320c156e10 2023-11-28T11:59:23.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.806+0000 7f3212a3e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320c15b200 con 0x7f320c15d930 2023-11-28T11:59:23.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.806+0000 7f3212a3e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f320c0c2a30 con 0x7f320c156a40 2023-11-28T11:59:23.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.806+0000 7f32037fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f320c156e10 0x7f320c0c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:23.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.806+0000 7f32037fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f320c156e10 0x7f320c0c74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60170/0 (socket says 172.21.15.39:60170) 2023-11-28T11:59:23.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.806+0000 7f32037fe700 1 -- 172.21.15.39:0/2560060458 learned_addr learned my addr 172.21.15.39:0/2560060458 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:23.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.806+0000 7f320bfff700 1 --2- 172.21.15.39:0/2560060458 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f320c156a40 0x7f320c0c9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:23.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.806+0000 7f3210fdb700 1 --2- 172.21.15.39:0/2560060458 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f320c15d930 0x7f320c158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:23.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.806+0000 7f32037fe700 1 -- 172.21.15.39:0/2560060458 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f320c156a40 msgr2=0x7f320c0c9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:23.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.806+0000 7f32037fe700 1 --2- 172.21.15.39:0/2560060458 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f320c156a40 0x7f320c0c9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.806+0000 7f32037fe700 1 -- 172.21.15.39:0/2560060458 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f320c15d930 msgr2=0x7f320c158420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:23.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.806+0000 7f32037fe700 1 --2- 172.21.15.39:0/2560060458 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f320c15d930 0x7f320c158420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.806+0000 7f32037fe700 1 -- 172.21.15.39:0/2560060458 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f40094b0 con 0x7f320c156e10 2023-11-28T11:59:23.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.806+0000 7f320bfff700 1 --2- 172.21.15.39:0/2560060458 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f320c156a40 0x7f320c0c9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:23.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.806+0000 7f32037fe700 1 --2- 172.21.15.39:0/2560060458 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f320c156e10 0x7f320c0c74f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f31f40090b0 tx=0x7f31f4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:23.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.806+0000 7f32097fa700 1 -- 172.21.15.39:0/2560060458 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f4004590 con 0x7f320c156e10 2023-11-28T11:59:23.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.806+0000 7f32097fa700 1 -- 172.21.15.39:0/2560060458 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f401e070 con 0x7f320c156e10 2023-11-28T11:59:23.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.806+0000 7f32097fa700 1 -- 172.21.15.39:0/2560060458 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f40038c0 con 0x7f320c156e10 2023-11-28T11:59:23.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.806+0000 7f3212a3e700 1 -- 172.21.15.39:0/2560060458 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f320c0ce670 con 0x7f320c156e10 2023-11-28T11:59:23.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.806+0000 7f3212a3e700 1 -- 172.21.15.39:0/2560060458 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f320c0ce390 con 0x7f320c156e10 2023-11-28T11:59:23.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.810+0000 7f3212a3e700 1 -- 172.21.15.39:0/2560060458 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f320c0ce950 con 0x7f320c156e10 2023-11-28T11:59:23.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.810+0000 7f32097fa700 1 -- 172.21.15.39:0/2560060458 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f31f400f050 con 0x7f320c156e10 2023-11-28T11:59:23.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.814+0000 7f32097fa700 1 --2- 172.21.15.39:0/2560060458 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f31ec064ee0 0x7f31ec067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:23.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.814+0000 7f32097fa700 1 -- 172.21.15.39:0/2560060458 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f31f4082ee0 con 0x7f320c156e10 2023-11-28T11:59:23.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.814+0000 7f320bfff700 1 --2- 172.21.15.39:0/2560060458 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f31ec064ee0 0x7f31ec067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:23.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.814+0000 7f320bfff700 1 --2- 172.21.15.39:0/2560060458 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f31ec064ee0 0x7f31ec067390 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f31fc0011e0 tx=0x7f31fc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:23.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.818+0000 7f32097fa700 1 -- 172.21.15.39:0/2560060458 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f31f4050e50 con 0x7f320c156e10 2023-11-28T11:59:23.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.994+0000 7f3212a3e700 1 -- 172.21.15.39:0/2560060458 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f320c0c67a0 con 0x7f320c156e10 2023-11-28T11:59:23.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.994+0000 7f32097fa700 1 -- 172.21.15.39:0/2560060458 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v58) v1 ==== 92+0+10 (secure 0 0 0) 0x7f31f4054470 con 0x7f320c156e10 2023-11-28T11:59:23.999 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-11-28T11:59:24.000 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.998+0000 7f3212a3e700 1 -- 172.21.15.39:0/2560060458 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f31ec064ee0 msgr2=0x7f31ec067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:24.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.998+0000 7f3212a3e700 1 --2- 172.21.15.39:0/2560060458 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f31ec064ee0 0x7f31ec067390 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f31fc0011e0 tx=0x7f31fc009040 comp rx=0 tx=0).stop 2023-11-28T11:59:24.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.998+0000 7f3212a3e700 1 -- 172.21.15.39:0/2560060458 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f320c156e10 msgr2=0x7f320c0c74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:24.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.998+0000 7f3212a3e700 1 --2- 172.21.15.39:0/2560060458 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f320c156e10 0x7f320c0c74f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f31f40090b0 tx=0x7f31f4004770 comp rx=0 tx=0).stop 2023-11-28T11:59:24.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.998+0000 7f3212a3e700 1 -- 172.21.15.39:0/2560060458 shutdown_connections 2023-11-28T11:59:24.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.998+0000 7f3212a3e700 1 --2- 172.21.15.39:0/2560060458 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f31ec064ee0 0x7f31ec067390 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:24.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.998+0000 7f3212a3e700 1 --2- 172.21.15.39:0/2560060458 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f320c15d930 0x7f320c158420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:24.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.998+0000 7f3212a3e700 1 --2- 172.21.15.39:0/2560060458 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f320c156e10 0x7f320c0c74f0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:24.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.998+0000 7f3212a3e700 1 --2- 172.21.15.39:0/2560060458 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f320c156a40 0x7f320c0c9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:24.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.998+0000 7f3212a3e700 1 -- 172.21.15.39:0/2560060458 >> 172.21.15.39:0/2560060458 conn(0x7f320c06e2e0 msgr2=0x7f320c0caff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:24.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.998+0000 7f3212a3e700 1 -- 172.21.15.39:0/2560060458 shutdown_connections 2023-11-28T11:59:24.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:23.998+0000 7f3212a3e700 1 -- 172.21.15.39:0/2560060458 wait complete. 2023-11-28T11:59:24.024 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:59:24.209 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.206+0000 7f99e5562700 1 Processor -- start 2023-11-28T11:59:24.209 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.206+0000 7f99e5562700 1 -- start start 2023-11-28T11:59:24.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.206+0000 7f99e5562700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f99e0159f10 0x7f99e0070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:24.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.206+0000 7f99e5562700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e0070600 con 0x7f99e015a9f0 2023-11-28T11:59:24.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.206+0000 7f99e5562700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e015adf0 con 0x7f99e00c8c90 2023-11-28T11:59:24.212 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.206+0000 7f99e5562700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e00c9130 con 0x7f99e0159f10 2023-11-28T11:59:24.212 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.206+0000 7f99deffd700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f99e0159f10 0x7f99e0070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:24.212 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.206+0000 7f99deffd700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f99e0159f10 0x7f99e0070a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60176/0 (socket says 172.21.15.39:60176) 2023-11-28T11:59:24.212 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.206+0000 7f99deffd700 1 -- 172.21.15.39:0/1493302386 learned_addr learned my addr 172.21.15.39:0/1493302386 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:24.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.210+0000 7f99deffd700 1 -- 172.21.15.39:0/1493302386 >> v1:172.21.15.184:6789/0 conn(0x7f99e00c8c90 legacy=0x7f99e015a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:24.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.210+0000 7f99deffd700 1 -- 172.21.15.39:0/1493302386 >> v1:172.21.15.39:6789/0 conn(0x7f99e015a9f0 legacy=0x7f99e006be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:24.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.210+0000 7f99deffd700 1 -- 172.21.15.39:0/1493302386 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e00afcc0 con 0x7f99e0159f10 2023-11-28T11:59:24.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.210+0000 7f99deffd700 1 --2- 172.21.15.39:0/1493302386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99e0159f10 0x7f99e0070a90 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f99d0009e50 tx=0x7f99d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be6bfdf14e2cccd3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:24.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.210+0000 7f99de7fc700 1 -- 172.21.15.39:0/1493302386 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d000e070 con 0x7f99e0159f10 2023-11-28T11:59:24.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.210+0000 7f99de7fc700 1 -- 172.21.15.39:0/1493302386 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d0003a40 con 0x7f99e0159f10 2023-11-28T11:59:24.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.210+0000 7f99de7fc700 1 -- 172.21.15.39:0/1493302386 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d0003df0 con 0x7f99e0159f10 2023-11-28T11:59:24.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.210+0000 7f99e5562700 1 -- 172.21.15.39:0/1493302386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99e0159f10 msgr2=0x7f99e0070a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:24.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.210+0000 7f99e5562700 1 --2- 172.21.15.39:0/1493302386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99e0159f10 0x7f99e0070a90 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f99d0009e50 tx=0x7f99d000b330 comp rx=0 tx=0).stop 2023-11-28T11:59:24.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.210+0000 7f99e5562700 1 -- 172.21.15.39:0/1493302386 shutdown_connections 2023-11-28T11:59:24.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.210+0000 7f99e5562700 1 --2- 172.21.15.39:0/1493302386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99e0159f10 0x7f99e0070a90 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:24.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.210+0000 7f99e5562700 1 -- 172.21.15.39:0/1493302386 >> 172.21.15.39:0/1493302386 conn(0x7f99e00cf280 msgr2=0x7f99e00cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:24.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.210+0000 7f99e5562700 1 -- 172.21.15.39:0/1493302386 shutdown_connections 2023-11-28T11:59:24.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.210+0000 7f99e5562700 1 -- 172.21.15.39:0/1493302386 wait complete. 2023-11-28T11:59:24.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.214+0000 7f99e5562700 1 Processor -- start 2023-11-28T11:59:24.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.214+0000 7f99e5562700 1 -- start start 2023-11-28T11:59:24.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.218+0000 7f99e5562700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99e00c8c90 0x7f99e00b1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:24.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.218+0000 7f99e5562700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99e0159f10 0x7f99e00c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:24.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.218+0000 7f99e5562700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99e015a9f0 0x7f99e01f2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:24.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.218+0000 7f99e5562700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e014b9b0 con 0x7f99e0159f10 2023-11-28T11:59:24.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.218+0000 7f99e5562700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e01f1bd0 con 0x7f99e00c8c90 2023-11-28T11:59:24.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.218+0000 7f99e5562700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e00b1de0 con 0x7f99e015a9f0 2023-11-28T11:59:24.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.218+0000 7f99d7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99e0159f10 0x7f99e00c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:24.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.218+0000 7f99d7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99e0159f10 0x7f99e00c7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60178/0 (socket says 172.21.15.39:60178) 2023-11-28T11:59:24.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.218+0000 7f99d7fff700 1 -- 172.21.15.39:0/4192078477 learned_addr learned my addr 172.21.15.39:0/4192078477 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:24.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.218+0000 7f99df7fe700 1 --2- 172.21.15.39:0/4192078477 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99e015a9f0 0x7f99e01f2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:24.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.218+0000 7f99deffd700 1 --2- 172.21.15.39:0/4192078477 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99e00c8c90 0x7f99e00b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:24.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.218+0000 7f99d7fff700 1 -- 172.21.15.39:0/4192078477 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99e015a9f0 msgr2=0x7f99e01f2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:24.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.218+0000 7f99d7fff700 1 --2- 172.21.15.39:0/4192078477 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99e015a9f0 0x7f99e01f2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:24.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.218+0000 7f99d7fff700 1 -- 172.21.15.39:0/4192078477 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99e00c8c90 msgr2=0x7f99e00b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:24.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.218+0000 7f99d7fff700 1 --2- 172.21.15.39:0/4192078477 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99e00c8c90 0x7f99e00b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:24.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.218+0000 7f99d7fff700 1 -- 172.21.15.39:0/4192078477 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d0009b30 con 0x7f99e0159f10 2023-11-28T11:59:24.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.218+0000 7f99d7fff700 1 --2- 172.21.15.39:0/4192078477 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99e0159f10 0x7f99e00c7d20 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f99c800c510 tx=0x7f99c800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:24.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.218+0000 7f99d77fe700 1 -- 172.21.15.39:0/4192078477 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c8011790 con 0x7f99e0159f10 2023-11-28T11:59:24.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.218+0000 7f99d77fe700 1 -- 172.21.15.39:0/4192078477 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c8011910 con 0x7f99e0159f10 2023-11-28T11:59:24.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.218+0000 7f99e5562700 1 -- 172.21.15.39:0/4192078477 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e0070290 con 0x7f99e0159f10 2023-11-28T11:59:24.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.218+0000 7f99d77fe700 1 -- 172.21.15.39:0/4192078477 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c8011cc0 con 0x7f99e0159f10 2023-11-28T11:59:24.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.218+0000 7f99e5562700 1 -- 172.21.15.39:0/4192078477 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e006ffb0 con 0x7f99e0159f10 2023-11-28T11:59:24.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.222+0000 7f99e5562700 1 -- 172.21.15.39:0/4192078477 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e00affa0 con 0x7f99e0159f10 2023-11-28T11:59:24.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.222+0000 7f99d77fe700 1 -- 172.21.15.39:0/4192078477 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f99c8010050 con 0x7f99e0159f10 2023-11-28T11:59:24.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.222+0000 7f99d77fe700 1 --2- 172.21.15.39:0/4192078477 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f99c0064ee0 0x7f99c0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:24.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.222+0000 7f99d77fe700 1 -- 172.21.15.39:0/4192078477 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f99c8081be0 con 0x7f99e0159f10 2023-11-28T11:59:24.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.222+0000 7f99deffd700 1 --2- 172.21.15.39:0/4192078477 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f99c0064ee0 0x7f99c0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:24.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.226+0000 7f99deffd700 1 --2- 172.21.15.39:0/4192078477 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f99c0064ee0 0x7f99c0067390 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f99d0015040 tx=0x7f99d0009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:24.234 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.230+0000 7f99d77fe700 1 -- 172.21.15.39:0/4192078477 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f99c804fbe0 con 0x7f99e0159f10 2023-11-28T11:59:24.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.406+0000 7f99e5562700 1 -- 172.21.15.39:0/4192078477 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f99e006cf30 con 0x7f99e0159f10 2023-11-28T11:59:24.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.406+0000 7f99d77fe700 1 -- 172.21.15.39:0/4192078477 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v58) v1 ==== 104+0+11 (secure 0 0 0) 0x7f99c8053200 con 0x7f99e0159f10 2023-11-28T11:59:24.411 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-11-28T11:59:24.415 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.410+0000 7f99e5562700 1 -- 172.21.15.39:0/4192078477 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f99c0064ee0 msgr2=0x7f99c0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:24.415 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.410+0000 7f99e5562700 1 --2- 172.21.15.39:0/4192078477 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f99c0064ee0 0x7f99c0067390 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f99d0015040 tx=0x7f99d0009000 comp rx=0 tx=0).stop 2023-11-28T11:59:24.415 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.410+0000 7f99e5562700 1 -- 172.21.15.39:0/4192078477 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99e0159f10 msgr2=0x7f99e00c7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:24.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.410+0000 7f99e5562700 1 --2- 172.21.15.39:0/4192078477 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99e0159f10 0x7f99e00c7d20 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f99c800c510 tx=0x7f99c800c820 comp rx=0 tx=0).stop 2023-11-28T11:59:24.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.410+0000 7f99e5562700 1 -- 172.21.15.39:0/4192078477 shutdown_connections 2023-11-28T11:59:24.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.410+0000 7f99e5562700 1 --2- 172.21.15.39:0/4192078477 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99e015a9f0 0x7f99e01f2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:24.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.410+0000 7f99e5562700 1 --2- 172.21.15.39:0/4192078477 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99e0159f10 0x7f99e00c7d20 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:24.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.410+0000 7f99e5562700 1 --2- 172.21.15.39:0/4192078477 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f99c0064ee0 0x7f99c0067390 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:24.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.410+0000 7f99e5562700 1 --2- 172.21.15.39:0/4192078477 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99e00c8c90 0x7f99e00b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:24.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.410+0000 7f99e5562700 1 -- 172.21.15.39:0/4192078477 >> 172.21.15.39:0/4192078477 conn(0x7f99e00cf280 msgr2=0x7f99e00c34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:24.417 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.410+0000 7f99e5562700 1 -- 172.21.15.39:0/4192078477 shutdown_connections 2023-11-28T11:59:24.417 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.410+0000 7f99e5562700 1 -- 172.21.15.39:0/4192078477 wait complete. 2023-11-28T11:59:24.447 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:59:24.635 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.630+0000 7f20fa7b4700 1 Processor -- start 2023-11-28T11:59:24.635 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.630+0000 7f20fa7b4700 1 -- start start 2023-11-28T11:59:24.639 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.634+0000 7f20fa7b4700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f20f415c150 0x7f20f40b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:24.639 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.634+0000 7f20fa7b4700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f20f4070360 0x7f20f4160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:24.639 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.634+0000 7f20fa7b4700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20f415c520 con 0x7f20f406ff10 2023-11-28T11:59:24.639 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.634+0000 7f20fa7b4700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20f40b4240 con 0x7f20f4070360 2023-11-28T11:59:24.639 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.634+0000 7f20fa7b4700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20f406ac00 con 0x7f20f415c150 2023-11-28T11:59:24.640 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.634+0000 7f20f9fb3700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f20f4070360 0x7f20f4160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:24.640 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.634+0000 7f20f97b2700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f20f415c150 0x7f20f40b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:24.640 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.634+0000 7f20f9fb3700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f20f4070360 0x7f20f4160340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60190/0 (socket says 172.21.15.39:60190) 2023-11-28T11:59:24.640 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.634+0000 7f20f9fb3700 1 -- 172.21.15.39:0/2427169505 learned_addr learned my addr 172.21.15.39:0/2427169505 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:24.640 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.634+0000 7f20f8fb1700 1 --1- 172.21.15.39:0/2427169505 >> v1:172.21.15.184:6789/0 conn(0x7f20f406ff10 0x7f20f415fc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:49440/0 (socket says 172.21.15.39:49440) 2023-11-28T11:59:24.641 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.638+0000 7f20f9fb3700 1 -- 172.21.15.39:0/2427169505 >> v2:172.21.15.184:3300/0 conn(0x7f20f415c150 msgr2=0x7f20f40b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:24.641 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.638+0000 7f20f9fb3700 1 --2- 172.21.15.39:0/2427169505 >> v2:172.21.15.184:3300/0 conn(0x7f20f415c150 0x7f20f40b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:24.641 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.638+0000 7f20f9fb3700 1 -- 172.21.15.39:0/2427169505 >> v1:172.21.15.184:6789/0 conn(0x7f20f406ff10 legacy=0x7f20f415fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:24.641 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.638+0000 7f20ebfff700 1 -- 172.21.15.39:0/2427169505 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2777823780 0 0) 0x7f20f415c520 con 0x7f20f406ff10 2023-11-28T11:59:24.641 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.638+0000 7f20f9fb3700 1 -- 172.21.15.39:0/2427169505 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f406cc50 con 0x7f20f4070360 2023-11-28T11:59:24.641 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.638+0000 7f20f9fb3700 1 --2- 172.21.15.39:0/2427169505 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20f4070360 0x7f20f4160340 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f20f4071900 tx=0x7f20ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88d81de725c831af server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:24.642 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.638+0000 7f20ebfff700 1 -- 172.21.15.39:0/2427169505 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ec00e070 con 0x7f20f4070360 2023-11-28T11:59:24.642 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.638+0000 7f20ebfff700 1 -- 172.21.15.39:0/2427169505 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20ec00b910 con 0x7f20f4070360 2023-11-28T11:59:24.642 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.638+0000 7f20ebfff700 1 -- 172.21.15.39:0/2427169505 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ec00bcc0 con 0x7f20f4070360 2023-11-28T11:59:24.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.638+0000 7f20fa7b4700 1 -- 172.21.15.39:0/2427169505 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20f4070360 msgr2=0x7f20f4160340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:24.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.638+0000 7f20fa7b4700 1 --2- 172.21.15.39:0/2427169505 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20f4070360 0x7f20f4160340 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f20f4071900 tx=0x7f20ec00b330 comp rx=0 tx=0).stop 2023-11-28T11:59:24.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.638+0000 7f20fa7b4700 1 -- 172.21.15.39:0/2427169505 shutdown_connections 2023-11-28T11:59:24.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.638+0000 7f20fa7b4700 1 --2- 172.21.15.39:0/2427169505 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20f4070360 0x7f20f4160340 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:24.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.638+0000 7f20fa7b4700 1 --2- 172.21.15.39:0/2427169505 >> v2:172.21.15.184:3300/0 conn(0x7f20f415c150 0x7f20f40b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:24.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.638+0000 7f20fa7b4700 1 -- 172.21.15.39:0/2427169505 >> 172.21.15.39:0/2427169505 conn(0x7f20f40d3680 msgr2=0x7f20f40cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:24.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.638+0000 7f20fa7b4700 1 -- 172.21.15.39:0/2427169505 shutdown_connections 2023-11-28T11:59:24.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.638+0000 7f20fa7b4700 1 -- 172.21.15.39:0/2427169505 wait complete. 2023-11-28T11:59:24.646 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.642+0000 7f20fa7b4700 1 Processor -- start 2023-11-28T11:59:24.646 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.642+0000 7f20fa7b4700 1 -- start start 2023-11-28T11:59:24.648 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.642+0000 7f20fa7b4700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20f406ff10 0x7f20f40ca880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:24.648 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.642+0000 7f20fa7b4700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20f4070360 0x7f20f4148250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:24.648 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.642+0000 7f20fa7b4700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20f415c150 0x7f20f40cd980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:24.648 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.642+0000 7f20fa7b4700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f40b6350 con 0x7f20f406ff10 2023-11-28T11:59:24.648 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.642+0000 7f20fa7b4700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f40cadc0 con 0x7f20f415c150 2023-11-28T11:59:24.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.642+0000 7f20fa7b4700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f40b59f0 con 0x7f20f4070360 2023-11-28T11:59:24.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.642+0000 7f20f97b2700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20f406ff10 0x7f20f40ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:24.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.642+0000 7f20f97b2700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20f406ff10 0x7f20f40ca880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60198/0 (socket says 172.21.15.39:60198) 2023-11-28T11:59:24.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.642+0000 7f20f97b2700 1 -- 172.21.15.39:0/1246975788 learned_addr learned my addr 172.21.15.39:0/1246975788 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:24.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.642+0000 7f20f8fb1700 1 --2- 172.21.15.39:0/1246975788 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20f4070360 0x7f20f4148250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:24.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.642+0000 7f20f9fb3700 1 --2- 172.21.15.39:0/1246975788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20f415c150 0x7f20f40cd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:24.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.646+0000 7f20f97b2700 1 -- 172.21.15.39:0/1246975788 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20f4070360 msgr2=0x7f20f4148250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:24.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.646+0000 7f20f97b2700 1 --2- 172.21.15.39:0/1246975788 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20f4070360 0x7f20f4148250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:24.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.646+0000 7f20f97b2700 1 -- 172.21.15.39:0/1246975788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20f415c150 msgr2=0x7f20f40cd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:24.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.646+0000 7f20f97b2700 1 --2- 172.21.15.39:0/1246975788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20f415c150 0x7f20f40cd980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:24.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.646+0000 7f20f97b2700 1 -- 172.21.15.39:0/1246975788 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ec009b30 con 0x7f20f406ff10 2023-11-28T11:59:24.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.646+0000 7f20f97b2700 1 --2- 172.21.15.39:0/1246975788 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20f406ff10 0x7f20f40ca880 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f20f000e840 tx=0x7f20f000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:24.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.646+0000 7f20e9ffb700 1 -- 172.21.15.39:0/1246975788 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f00095a0 con 0x7f20f406ff10 2023-11-28T11:59:24.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.646+0000 7f20fa7b4700 1 -- 172.21.15.39:0/1246975788 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20f40d2730 con 0x7f20f406ff10 2023-11-28T11:59:24.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.646+0000 7f20e9ffb700 1 -- 172.21.15.39:0/1246975788 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f0013680 con 0x7f20f406ff10 2023-11-28T11:59:24.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.646+0000 7f20e9ffb700 1 -- 172.21.15.39:0/1246975788 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f00139f0 con 0x7f20f406ff10 2023-11-28T11:59:24.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.646+0000 7f20fa7b4700 1 -- 172.21.15.39:0/1246975788 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f40d2450 con 0x7f20f406ff10 2023-11-28T11:59:24.652 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.646+0000 7f20fa7b4700 1 -- 172.21.15.39:0/1246975788 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20f40d05e0 con 0x7f20f406ff10 2023-11-28T11:59:24.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.650+0000 7f20e9ffb700 1 -- 172.21.15.39:0/1246975788 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f20f0019030 con 0x7f20f406ff10 2023-11-28T11:59:24.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.650+0000 7f20e9ffb700 1 --2- 172.21.15.39:0/1246975788 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f20d8064ee0 0x7f20d8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:24.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.650+0000 7f20e9ffb700 1 -- 172.21.15.39:0/1246975788 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f20f0081e70 con 0x7f20f406ff10 2023-11-28T11:59:24.655 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.650+0000 7f20f8fb1700 1 --2- 172.21.15.39:0/1246975788 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f20d8064ee0 0x7f20d8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:24.656 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.654+0000 7f20f8fb1700 1 --2- 172.21.15.39:0/1246975788 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f20d8064ee0 0x7f20d8067390 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f20f40cef50 tx=0x7f20e4007dd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:24.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.658+0000 7f20e9ffb700 1 -- 172.21.15.39:0/1246975788 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f20f004fd00 con 0x7f20f406ff10 2023-11-28T11:59:24.846 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.842+0000 7f20fa7b4700 1 -- 172.21.15.39:0/1246975788 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f20f40b65c0 con 0x7f20f406ff10 2023-11-28T11:59:24.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.842+0000 7f20e9ffb700 1 -- 172.21.15.39:0/1246975788 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v58) v1 ==== 100+0+11 (secure 0 0 0) 0x7f20f0053320 con 0x7f20f406ff10 2023-11-28T11:59:24.847 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2023-11-28T11:59:24.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.846+0000 7f20fa7b4700 1 -- 172.21.15.39:0/1246975788 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f20d8064ee0 msgr2=0x7f20d8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:24.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.846+0000 7f20fa7b4700 1 --2- 172.21.15.39:0/1246975788 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f20d8064ee0 0x7f20d8067390 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f20f40cef50 tx=0x7f20e4007dd0 comp rx=0 tx=0).stop 2023-11-28T11:59:24.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.846+0000 7f20fa7b4700 1 -- 172.21.15.39:0/1246975788 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20f406ff10 msgr2=0x7f20f40ca880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:24.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.846+0000 7f20fa7b4700 1 --2- 172.21.15.39:0/1246975788 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20f406ff10 0x7f20f40ca880 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f20f000e840 tx=0x7f20f000eb50 comp rx=0 tx=0).stop 2023-11-28T11:59:24.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.846+0000 7f20fa7b4700 1 -- 172.21.15.39:0/1246975788 shutdown_connections 2023-11-28T11:59:24.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.846+0000 7f20fa7b4700 1 --2- 172.21.15.39:0/1246975788 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f20d8064ee0 0x7f20d8067390 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:24.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.846+0000 7f20fa7b4700 1 --2- 172.21.15.39:0/1246975788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20f415c150 0x7f20f40cd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:24.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.846+0000 7f20fa7b4700 1 --2- 172.21.15.39:0/1246975788 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20f4070360 0x7f20f4148250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:24.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.846+0000 7f20fa7b4700 1 --2- 172.21.15.39:0/1246975788 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20f406ff10 0x7f20f40ca880 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:24.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.846+0000 7f20fa7b4700 1 -- 172.21.15.39:0/1246975788 >> 172.21.15.39:0/1246975788 conn(0x7f20f40d3680 msgr2=0x7f20f40c8f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:24.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.846+0000 7f20fa7b4700 1 -- 172.21.15.39:0/1246975788 shutdown_connections 2023-11-28T11:59:24.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:24.846+0000 7f20fa7b4700 1 -- 172.21.15.39:0/1246975788 wait complete. 2023-11-28T11:59:24.872 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T11:59:25.057 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.054+0000 7f51d0016700 1 Processor -- start 2023-11-28T11:59:25.057 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.054+0000 7f51d0016700 1 -- start start 2023-11-28T11:59:25.059 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.054+0000 7f51d0016700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51c806d4c0 0x7f51c816b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:25.059 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.054+0000 7f51d0016700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c8164080 con 0x7f51c8163cb0 2023-11-28T11:59:25.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.054+0000 7f51d0016700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c8069bf0 con 0x7f51c80cdfb0 2023-11-28T11:59:25.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.054+0000 7f51d0016700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c80cc290 con 0x7f51c806d4c0 2023-11-28T11:59:25.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.054+0000 7f51cddb2700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f51c8163cb0 0x7f51c8164cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:52086/0 (socket says 172.21.15.39:52086) 2023-11-28T11:59:25.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.054+0000 7f51cddb2700 1 -- 172.21.15.39:0/291877801 learned_addr learned my addr 172.21.15.39:0/291877801 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:59:25.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.058+0000 7f51ce5b3700 1 --2- 172.21.15.39:0/291877801 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51c806d4c0 0x7f51c816b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:25.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.058+0000 7f51ccdb0700 1 -- 172.21.15.39:0/291877801 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1734577662 0 0) 0x7f51c8164080 con 0x7f51c8163cb0 2023-11-28T11:59:25.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.058+0000 7f51ccdb0700 1 -- 172.21.15.39:0/291877801 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51b00035d0 con 0x7f51c8163cb0 2023-11-28T11:59:25.062 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.058+0000 7f51ccdb0700 1 -- 172.21.15.39:0/291877801 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1500244516 0 0) 0x7f51c8069bf0 con 0x7f51c80cdfb0 2023-11-28T11:59:25.062 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.058+0000 7f51ccdb0700 1 -- 172.21.15.39:0/291877801 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51c8164080 con 0x7f51c80cdfb0 2023-11-28T11:59:25.062 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.058+0000 7f51ce5b3700 1 -- 172.21.15.39:0/291877801 >> v1:172.21.15.184:6789/0 conn(0x7f51c80cdfb0 legacy=0x7f51c806cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:25.062 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.058+0000 7f51ce5b3700 1 -- 172.21.15.39:0/291877801 >> v1:172.21.15.39:6789/0 conn(0x7f51c8163cb0 legacy=0x7f51c8164cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:25.062 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.058+0000 7f51ce5b3700 1 -- 172.21.15.39:0/291877801 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c80cc4a0 con 0x7f51c806d4c0 2023-11-28T11:59:25.063 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.058+0000 7f51ce5b3700 1 --2- 172.21.15.39:0/291877801 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51c806d4c0 0x7f51c816b630 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f51c0009dc0 tx=0x7f51c000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=333fc926745f907f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:25.063 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.058+0000 7f51ccdb0700 1 -- 172.21.15.39:0/291877801 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c000e070 con 0x7f51c806d4c0 2023-11-28T11:59:25.063 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.058+0000 7f51ccdb0700 1 -- 172.21.15.39:0/291877801 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c000bb20 con 0x7f51c806d4c0 2023-11-28T11:59:25.064 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.058+0000 7f51ccdb0700 1 -- 172.21.15.39:0/291877801 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c0012430 con 0x7f51c806d4c0 2023-11-28T11:59:25.064 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.058+0000 7f51d0016700 1 -- 172.21.15.39:0/291877801 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51c806d4c0 msgr2=0x7f51c816b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:25.064 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.058+0000 7f51d0016700 1 --2- 172.21.15.39:0/291877801 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51c806d4c0 0x7f51c816b630 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f51c0009dc0 tx=0x7f51c000b330 comp rx=0 tx=0).stop 2023-11-28T11:59:25.064 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.058+0000 7f51d0016700 1 -- 172.21.15.39:0/291877801 shutdown_connections 2023-11-28T11:59:25.064 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.058+0000 7f51d0016700 1 --2- 172.21.15.39:0/291877801 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51c806d4c0 0x7f51c816b630 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:25.065 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.058+0000 7f51d0016700 1 -- 172.21.15.39:0/291877801 >> 172.21.15.39:0/291877801 conn(0x7f51c80cf350 msgr2=0x7f51c80b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:25.065 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.062+0000 7f51d0016700 1 -- 172.21.15.39:0/291877801 shutdown_connections 2023-11-28T11:59:25.065 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.062+0000 7f51d0016700 1 -- 172.21.15.39:0/291877801 wait complete. 2023-11-28T11:59:25.067 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.062+0000 7f51d0016700 1 Processor -- start 2023-11-28T11:59:25.067 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.062+0000 7f51d0016700 1 -- start start 2023-11-28T11:59:25.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.066+0000 7f51d0016700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51c806d4c0 0x7f51c80c21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:25.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.066+0000 7f51d0016700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51c80cdfb0 0x7f51c815dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:25.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.066+0000 7f51d0016700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51c8163cb0 0x7f51c80b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:25.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.066+0000 7f51d0016700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c80b44b0 con 0x7f51c806d4c0 2023-11-28T11:59:25.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.066+0000 7f51d0016700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c815e420 con 0x7f51c80cdfb0 2023-11-28T11:59:25.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.066+0000 7f51d0016700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c80c62b0 con 0x7f51c8163cb0 2023-11-28T11:59:25.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.066+0000 7f51cddb2700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51c806d4c0 0x7f51c80c21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:25.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.066+0000 7f51cddb2700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51c806d4c0 0x7f51c80c21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60206/0 (socket says 172.21.15.39:60206) 2023-11-28T11:59:25.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.066+0000 7f51cddb2700 1 -- 172.21.15.39:0/93015256 learned_addr learned my addr 172.21.15.39:0/93015256 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:25.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.066+0000 7f51ce5b3700 1 --2- 172.21.15.39:0/93015256 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51c8163cb0 0x7f51c80b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:25.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.066+0000 7f51cd5b1700 1 --2- 172.21.15.39:0/93015256 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51c80cdfb0 0x7f51c815dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:25.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.066+0000 7f51cddb2700 1 -- 172.21.15.39:0/93015256 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51c8163cb0 msgr2=0x7f51c80b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:25.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.066+0000 7f51cddb2700 1 --2- 172.21.15.39:0/93015256 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51c8163cb0 0x7f51c80b14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:25.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.066+0000 7f51cddb2700 1 -- 172.21.15.39:0/93015256 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51c80cdfb0 msgr2=0x7f51c815dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:25.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.066+0000 7f51cddb2700 1 --2- 172.21.15.39:0/93015256 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51c80cdfb0 0x7f51c815dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:25.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.066+0000 7f51cddb2700 1 -- 172.21.15.39:0/93015256 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c0009a70 con 0x7f51c806d4c0 2023-11-28T11:59:25.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.066+0000 7f51cddb2700 1 --2- 172.21.15.39:0/93015256 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51c806d4c0 0x7f51c80c21b0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f51b800c560 tx=0x7f51b800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:25.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.066+0000 7f51c67fc700 1 -- 172.21.15.39:0/93015256 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b8005d90 con 0x7f51c806d4c0 2023-11-28T11:59:25.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.066+0000 7f51c67fc700 1 -- 172.21.15.39:0/93015256 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b80070d0 con 0x7f51c806d4c0 2023-11-28T11:59:25.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.066+0000 7f51d0016700 1 -- 172.21.15.39:0/93015256 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51c8069e40 con 0x7f51c806d4c0 2023-11-28T11:59:25.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.066+0000 7f51c67fc700 1 -- 172.21.15.39:0/93015256 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b8007440 con 0x7f51c806d4c0 2023-11-28T11:59:25.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.066+0000 7f51d0016700 1 -- 172.21.15.39:0/93015256 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c80cc780 con 0x7f51c806d4c0 2023-11-28T11:59:25.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.070+0000 7f51d0016700 1 -- 172.21.15.39:0/93015256 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51c806a120 con 0x7f51c806d4c0 2023-11-28T11:59:25.075 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.070+0000 7f51c67fc700 1 -- 172.21.15.39:0/93015256 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f51b8019030 con 0x7f51c806d4c0 2023-11-28T11:59:25.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.074+0000 7f51c67fc700 1 --2- 172.21.15.39:0/93015256 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f51b4064ee0 0x7f51b4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:25.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.074+0000 7f51c67fc700 1 -- 172.21.15.39:0/93015256 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f51b8081310 con 0x7f51c806d4c0 2023-11-28T11:59:25.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.074+0000 7f51cd5b1700 1 --2- 172.21.15.39:0/93015256 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f51b4064ee0 0x7f51b4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:25.078 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.074+0000 7f51cd5b1700 1 --2- 172.21.15.39:0/93015256 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f51b4064ee0 0x7f51b4067390 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f51c806d290 tx=0x7f51bc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:25.085 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.078+0000 7f51c67fc700 1 -- 172.21.15.39:0/93015256 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f51b804a400 con 0x7f51c806d4c0 2023-11-28T11:59:25.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.266+0000 7f51d0016700 1 -- 172.21.15.39:0/93015256 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f51c80726c0 con 0x7f51c806d4c0 2023-11-28T11:59:25.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.270+0000 7f51c67fc700 1 -- 172.21.15.39:0/93015256 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v58) v1 ==== 80+0+0 (secure 0 0 0) 0x7f51b804f420 con 0x7f51c806d4c0 2023-11-28T11:59:25.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.270+0000 7f51d0016700 1 -- 172.21.15.39:0/93015256 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f51b4064ee0 msgr2=0x7f51b4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:25.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.270+0000 7f51d0016700 1 --2- 172.21.15.39:0/93015256 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f51b4064ee0 0x7f51b4067390 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f51c806d290 tx=0x7f51bc009040 comp rx=0 tx=0).stop 2023-11-28T11:59:25.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.270+0000 7f51d0016700 1 -- 172.21.15.39:0/93015256 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51c806d4c0 msgr2=0x7f51c80c21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:25.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.270+0000 7f51d0016700 1 --2- 172.21.15.39:0/93015256 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51c806d4c0 0x7f51c80c21b0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f51b800c560 tx=0x7f51b800c920 comp rx=0 tx=0).stop 2023-11-28T11:59:25.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.270+0000 7f51d0016700 1 -- 172.21.15.39:0/93015256 shutdown_connections 2023-11-28T11:59:25.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.270+0000 7f51d0016700 1 --2- 172.21.15.39:0/93015256 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51c8163cb0 0x7f51c80b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:25.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.270+0000 7f51d0016700 1 --2- 172.21.15.39:0/93015256 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f51b4064ee0 0x7f51b4067390 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:25.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.270+0000 7f51d0016700 1 --2- 172.21.15.39:0/93015256 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51c80cdfb0 0x7f51c815dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:25.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.270+0000 7f51d0016700 1 --2- 172.21.15.39:0/93015256 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51c806d4c0 0x7f51c80c21b0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:25.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.270+0000 7f51d0016700 1 -- 172.21.15.39:0/93015256 >> 172.21.15.39:0/93015256 conn(0x7f51c80cf350 msgr2=0x7f51c80af6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:25.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.270+0000 7f51d0016700 1 -- 172.21.15.39:0/93015256 shutdown_connections 2023-11-28T11:59:25.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.274+0000 7f51d0016700 1 -- 172.21.15.39:0/93015256 wait complete. 2023-11-28T11:59:25.278 INFO:teuthology.orchestra.run.smithi039.stderr:listed 0 entries 2023-11-28T11:59:25.297 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-28T11:59:25.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:59:25.297 DEBUG:teuthology.orchestra.run.smithi039:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-28T11:59:25.378 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi039.front.sepia.ceph.com 2023-11-28T11:59:25.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:59:25.378 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T11:59:25.401 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:59:25.401 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:59:25.412 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352324k,nr_inodes=4088081,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9254 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T11:59:25.413 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:59:25.413 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:59:25.463 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352324k,nr_inodes=4088081,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6229 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T11:59:25.463 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:59:25.463 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:59:25.478 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352324k,nr_inodes=4088081,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9254 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T11:59:25.478 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:59:25.689 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.686+0000 7f3958f77700 1 Processor -- start 2023-11-28T11:59:25.689 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.686+0000 7f3958f77700 1 -- start start 2023-11-28T11:59:25.692 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.686+0000 7f3958f77700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3954071aa0 0x7f395406d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:25.692 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.686+0000 7f3958f77700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3954069e00 0x7f395406a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:25.692 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.686+0000 7f3958f77700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f395406c600 con 0x7f395415c640 2023-11-28T11:59:25.692 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.686+0000 7f3958f77700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f395406cef0 con 0x7f3954071aa0 2023-11-28T11:59:25.692 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.686+0000 7f3958f77700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39540d38f0 con 0x7f3954069e00 2023-11-28T11:59:25.692 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.686+0000 7f3952ffd700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3954071aa0 0x7f395406d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:25.692 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.686+0000 7f3952ffd700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3954071aa0 0x7f395406d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60212/0 (socket says 172.21.15.39:60212) 2023-11-28T11:59:25.692 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.686+0000 7f3952ffd700 1 -- 172.21.15.39:0/1654288631 learned_addr learned my addr 172.21.15.39:0/1654288631 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:25.692 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.686+0000 7f3953fff700 1 --2- 172.21.15.39:0/1654288631 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3954069e00 0x7f395406a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:25.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.690+0000 7f39527fc700 1 -- 172.21.15.39:0/1654288631 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3879917485 0 0) 0x7f395406c600 con 0x7f395415c640 2023-11-28T11:59:25.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.690+0000 7f39527fc700 1 -- 172.21.15.39:0/1654288631 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f393c0035d0 con 0x7f395415c640 2023-11-28T11:59:25.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.690+0000 7f3952ffd700 1 -- 172.21.15.39:0/1654288631 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3954069e00 msgr2=0x7f395406a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:25.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.690+0000 7f3952ffd700 1 --2- 172.21.15.39:0/1654288631 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3954069e00 0x7f395406a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:25.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.690+0000 7f3952ffd700 1 -- 172.21.15.39:0/1654288631 >> v1:172.21.15.184:6789/0 conn(0x7f395415c640 legacy=0x7f39540d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:25.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.690+0000 7f3952ffd700 1 -- 172.21.15.39:0/1654288631 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39540722f0 con 0x7f3954071aa0 2023-11-28T11:59:25.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.690+0000 7f3953fff700 1 --2- 172.21.15.39:0/1654288631 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3954069e00 0x7f395406a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:25.694 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.690+0000 7f3952ffd700 1 --2- 172.21.15.39:0/1654288631 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3954071aa0 0x7f395406d310 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f3948009910 tx=0x7f3948009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51f1f7540182d4ef server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:25.694 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.690+0000 7f39527fc700 1 -- 172.21.15.39:0/1654288631 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3948011830 con 0x7f3954071aa0 2023-11-28T11:59:25.694 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.690+0000 7f39527fc700 1 -- 172.21.15.39:0/1654288631 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3948011990 con 0x7f3954071aa0 2023-11-28T11:59:25.694 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.690+0000 7f39527fc700 1 -- 172.21.15.39:0/1654288631 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3948011d40 con 0x7f3954071aa0 2023-11-28T11:59:25.695 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.690+0000 7f3958f77700 1 -- 172.21.15.39:0/1654288631 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3954071aa0 msgr2=0x7f395406d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:25.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.690+0000 7f3958f77700 1 --2- 172.21.15.39:0/1654288631 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3954071aa0 0x7f395406d310 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f3948009910 tx=0x7f3948009c20 comp rx=0 tx=0).stop 2023-11-28T11:59:25.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.690+0000 7f3958f77700 1 -- 172.21.15.39:0/1654288631 shutdown_connections 2023-11-28T11:59:25.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.690+0000 7f3958f77700 1 --2- 172.21.15.39:0/1654288631 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3954069e00 0x7f395406a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:25.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.690+0000 7f3958f77700 1 --2- 172.21.15.39:0/1654288631 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3954071aa0 0x7f395406d310 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:25.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.690+0000 7f3958f77700 1 -- 172.21.15.39:0/1654288631 >> 172.21.15.39:0/1654288631 conn(0x7f39540b6520 msgr2=0x7f3954071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:25.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.690+0000 7f3958f77700 1 -- 172.21.15.39:0/1654288631 shutdown_connections 2023-11-28T11:59:25.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.690+0000 7f3958f77700 1 -- 172.21.15.39:0/1654288631 wait complete. 2023-11-28T11:59:25.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.694+0000 7f3958f77700 1 Processor -- start 2023-11-28T11:59:25.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.694+0000 7f3958f77700 1 -- start start 2023-11-28T11:59:25.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.694+0000 7f3958f77700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3954069e00 0x7f39540ca740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:25.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.694+0000 7f3958f77700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3954071aa0 0x7f39540cb670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:25.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.694+0000 7f3958f77700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f395415c640 0x7f39540c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:25.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.694+0000 7f3958f77700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39540af580 con 0x7f3954071aa0 2023-11-28T11:59:25.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.694+0000 7f3958f77700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39540cac80 con 0x7f3954069e00 2023-11-28T11:59:25.701 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.694+0000 7f3958f77700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39540b15a0 con 0x7f395415c640 2023-11-28T11:59:25.701 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.698+0000 7f3952ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3954071aa0 0x7f39540cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:25.701 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.698+0000 7f3952ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3954071aa0 0x7f39540cb670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60218/0 (socket says 172.21.15.39:60218) 2023-11-28T11:59:25.701 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.698+0000 7f3952ffd700 1 -- 172.21.15.39:0/2764803957 learned_addr learned my addr 172.21.15.39:0/2764803957 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:25.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.698+0000 7f39537fe700 1 --2- 172.21.15.39:0/2764803957 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3954069e00 0x7f39540ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:25.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.698+0000 7f3953fff700 1 --2- 172.21.15.39:0/2764803957 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f395415c640 0x7f39540c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:25.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.698+0000 7f3952ffd700 1 -- 172.21.15.39:0/2764803957 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f395415c640 msgr2=0x7f39540c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:25.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.698+0000 7f3952ffd700 1 --2- 172.21.15.39:0/2764803957 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f395415c640 0x7f39540c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:25.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.698+0000 7f3952ffd700 1 -- 172.21.15.39:0/2764803957 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3954069e00 msgr2=0x7f39540ca740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:25.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.698+0000 7f3952ffd700 1 --2- 172.21.15.39:0/2764803957 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3954069e00 0x7f39540ca740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:25.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.698+0000 7f3952ffd700 1 -- 172.21.15.39:0/2764803957 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f394c009a70 con 0x7f3954071aa0 2023-11-28T11:59:25.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.698+0000 7f39537fe700 1 --2- 172.21.15.39:0/2764803957 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3954069e00 0x7f39540ca740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:25.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.698+0000 7f3952ffd700 1 --2- 172.21.15.39:0/2764803957 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3954071aa0 0x7f39540cb670 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f3948000c00 tx=0x7f3948004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:25.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.698+0000 7f393bfff700 1 -- 172.21.15.39:0/2764803957 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3948004510 con 0x7f3954071aa0 2023-11-28T11:59:25.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.698+0000 7f393bfff700 1 -- 172.21.15.39:0/2764803957 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39480036c0 con 0x7f3954071aa0 2023-11-28T11:59:25.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.698+0000 7f393bfff700 1 -- 172.21.15.39:0/2764803957 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3948003a70 con 0x7f3954071aa0 2023-11-28T11:59:25.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.698+0000 7f3958f77700 1 -- 172.21.15.39:0/2764803957 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3948009570 con 0x7f3954071aa0 2023-11-28T11:59:25.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.698+0000 7f3958f77700 1 -- 172.21.15.39:0/2764803957 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3954072010 con 0x7f3954071aa0 2023-11-28T11:59:25.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.698+0000 7f3958f77700 1 -- 172.21.15.39:0/2764803957 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f395415ca10 con 0x7f3954071aa0 2023-11-28T11:59:25.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.702+0000 7f393bfff700 1 -- 172.21.15.39:0/2764803957 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f394802d070 con 0x7f3954071aa0 2023-11-28T11:59:25.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.702+0000 7f393bfff700 1 --2- 172.21.15.39:0/2764803957 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3940064ee0 0x7f3940067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:25.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.702+0000 7f393bfff700 1 -- 172.21.15.39:0/2764803957 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3948021030 con 0x7f3954071aa0 2023-11-28T11:59:25.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.702+0000 7f39537fe700 1 --2- 172.21.15.39:0/2764803957 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3940064ee0 0x7f3940067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:25.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.710+0000 7f39537fe700 1 --2- 172.21.15.39:0/2764803957 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3940064ee0 0x7f3940067390 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f39440011e0 tx=0x7f3944009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:25.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.710+0000 7f393bfff700 1 -- 172.21.15.39:0/2764803957 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3948051590 con 0x7f3954071aa0 2023-11-28T11:59:25.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.930+0000 7f3958f77700 1 -- 172.21.15.39:0/2764803957 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f395406c830 con 0x7f3954071aa0 2023-11-28T11:59:25.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.930+0000 7f393bfff700 1 -- 172.21.15.39:0/2764803957 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4648 (secure 0 0 0) 0x7f394802b090 con 0x7f3954071aa0 2023-11-28T11:59:25.936 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:59:25.936 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5775,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3453450609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3453450609},{"type":"v1","addr":"172.21.15.39:6833","nonce":3453450609}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/697075022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":697075022},{"type":"v1","addr":"172.21.15.39:6835","nonce":697075022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5806,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1819593136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1819593136},{"type":"v1","addr":"172.21.15.184:6835","nonce":1819593136}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:58:51.635140+0000","modified":"2023-11-28T11:58:54.706764+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5809},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5809":{"gid":5809,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/367294936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":367294936},{"type":"v1","addr":"172.21.15.184:6837","nonce":367294936}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T11:59:25.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.934+0000 7f3958f77700 1 -- 172.21.15.39:0/2764803957 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3940064ee0 msgr2=0x7f3940067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:25.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.934+0000 7f3958f77700 1 --2- 172.21.15.39:0/2764803957 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3940064ee0 0x7f3940067390 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f39440011e0 tx=0x7f3944009040 comp rx=0 tx=0).stop 2023-11-28T11:59:25.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.934+0000 7f3958f77700 1 -- 172.21.15.39:0/2764803957 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3954071aa0 msgr2=0x7f39540cb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:25.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.934+0000 7f3958f77700 1 --2- 172.21.15.39:0/2764803957 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3954071aa0 0x7f39540cb670 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f3948000c00 tx=0x7f3948004770 comp rx=0 tx=0).stop 2023-11-28T11:59:25.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.934+0000 7f3958f77700 1 -- 172.21.15.39:0/2764803957 shutdown_connections 2023-11-28T11:59:25.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.934+0000 7f3958f77700 1 --2- 172.21.15.39:0/2764803957 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f395415c640 0x7f39540c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:25.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.934+0000 7f3958f77700 1 --2- 172.21.15.39:0/2764803957 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3954071aa0 0x7f39540cb670 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:25.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.934+0000 7f3958f77700 1 --2- 172.21.15.39:0/2764803957 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3940064ee0 0x7f3940067390 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:25.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.934+0000 7f3958f77700 1 --2- 172.21.15.39:0/2764803957 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3954069e00 0x7f39540ca740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:25.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.934+0000 7f3958f77700 1 -- 172.21.15.39:0/2764803957 >> 172.21.15.39:0/2764803957 conn(0x7f39540b6520 msgr2=0x7f395415a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:25.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.934+0000 7f3958f77700 1 -- 172.21.15.39:0/2764803957 shutdown_connections 2023-11-28T11:59:25.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:25.934+0000 7f3958f77700 1 -- 172.21.15.39:0/2764803957 wait complete. 2023-11-28T11:59:25.941 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 24 2023-11-28T11:59:25.959 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:59:26.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.134+0000 7f515193e700 1 Processor -- start 2023-11-28T11:59:26.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.134+0000 7f515193e700 1 -- start start 2023-11-28T11:59:26.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.134+0000 7f515193e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f514c071aa0 0x7f514c06d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.134+0000 7f515193e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f514c069e00 0x7f514c06a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.134+0000 7f515193e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514c06c600 con 0x7f514c15c640 2023-11-28T11:59:26.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.134+0000 7f515193e700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f514c06cef0 con 0x7f514c069e00 2023-11-28T11:59:26.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.134+0000 7f515193e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f514c0d38f0 con 0x7f514c071aa0 2023-11-28T11:59:26.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.134+0000 7f515113d700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f514c069e00 0x7f514c06a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.134+0000 7f515113d700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f514c069e00 0x7f514c06a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60234/0 (socket says 172.21.15.39:60234) 2023-11-28T11:59:26.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.134+0000 7f515113d700 1 -- 172.21.15.39:0/1648036034 learned_addr learned my addr 172.21.15.39:0/1648036034 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:26.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.134+0000 7f514bfff700 1 --2- 172.21.15.39:0/1648036034 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f514c071aa0 0x7f514c06d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.134+0000 7f515113d700 1 -- 172.21.15.39:0/1648036034 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f514c071aa0 msgr2=0x7f514c06d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:26.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.134+0000 7f515113d700 1 --2- 172.21.15.39:0/1648036034 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f514c071aa0 0x7f514c06d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.134+0000 7f515113d700 1 -- 172.21.15.39:0/1648036034 >> v1:172.21.15.184:6789/0 conn(0x7f514c15c640 legacy=0x7f514c0d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:26.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.138+0000 7f515113d700 1 -- 172.21.15.39:0/1648036034 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514c0722f0 con 0x7f514c069e00 2023-11-28T11:59:26.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.138+0000 7f515113d700 1 --2- 172.21.15.39:0/1648036034 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f514c069e00 0x7f514c06a280 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f5144009910 tx=0x7f5144009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=878480b3fa2ba695 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:26.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.138+0000 7f514b7fe700 1 -- 172.21.15.39:0/1648036034 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514400ba60 con 0x7f514c069e00 2023-11-28T11:59:26.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.138+0000 7f514b7fe700 1 -- 172.21.15.39:0/1648036034 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514400bbc0 con 0x7f514c069e00 2023-11-28T11:59:26.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.138+0000 7f514b7fe700 1 -- 172.21.15.39:0/1648036034 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5144009e60 con 0x7f514c069e00 2023-11-28T11:59:26.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.138+0000 7f515193e700 1 -- 172.21.15.39:0/1648036034 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f514c069e00 msgr2=0x7f514c06a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.138+0000 7f515193e700 1 --2- 172.21.15.39:0/1648036034 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f514c069e00 0x7f514c06a280 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f5144009910 tx=0x7f5144009c20 comp rx=0 tx=0).stop 2023-11-28T11:59:26.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.138+0000 7f515193e700 1 -- 172.21.15.39:0/1648036034 shutdown_connections 2023-11-28T11:59:26.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.138+0000 7f515193e700 1 --2- 172.21.15.39:0/1648036034 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f514c069e00 0x7f514c06a280 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.138+0000 7f515193e700 1 --2- 172.21.15.39:0/1648036034 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f514c071aa0 0x7f514c06d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.138+0000 7f515193e700 1 -- 172.21.15.39:0/1648036034 >> 172.21.15.39:0/1648036034 conn(0x7f514c0b6520 msgr2=0x7f514c071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:26.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.138+0000 7f515193e700 1 -- 172.21.15.39:0/1648036034 shutdown_connections 2023-11-28T11:59:26.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.138+0000 7f515193e700 1 -- 172.21.15.39:0/1648036034 wait complete. 2023-11-28T11:59:26.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.142+0000 7f515193e700 1 Processor -- start 2023-11-28T11:59:26.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.142+0000 7f515193e700 1 -- start start 2023-11-28T11:59:26.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.142+0000 7f515193e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f514c069e00 0x7f514c0cc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.142+0000 7f515193e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f514c071aa0 0x7f514c0c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.142+0000 7f515193e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f514c15c640 0x7f514c0c64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.142+0000 7f515193e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514c0b1860 con 0x7f514c069e00 2023-11-28T11:59:26.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.142+0000 7f515193e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514c15dd50 con 0x7f514c071aa0 2023-11-28T11:59:26.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.142+0000 7f515193e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f514c0ca6b0 con 0x7f514c15c640 2023-11-28T11:59:26.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.146+0000 7f515093c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f514c069e00 0x7f514c0cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.146+0000 7f515093c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f514c069e00 0x7f514c0cc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60242/0 (socket says 172.21.15.39:60242) 2023-11-28T11:59:26.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.146+0000 7f515093c700 1 -- 172.21.15.39:0/4135973632 learned_addr learned my addr 172.21.15.39:0/4135973632 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:26.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.146+0000 7f514bfff700 1 --2- 172.21.15.39:0/4135973632 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f514c071aa0 0x7f514c0c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.146+0000 7f515113d700 1 --2- 172.21.15.39:0/4135973632 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f514c15c640 0x7f514c0c64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.146+0000 7f515093c700 1 -- 172.21.15.39:0/4135973632 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f514c15c640 msgr2=0x7f514c0c64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.146+0000 7f515093c700 1 --2- 172.21.15.39:0/4135973632 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f514c15c640 0x7f514c0c64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.146+0000 7f515093c700 1 -- 172.21.15.39:0/4135973632 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f514c071aa0 msgr2=0x7f514c0c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.146+0000 7f515093c700 1 --2- 172.21.15.39:0/4135973632 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f514c071aa0 0x7f514c0c9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.146+0000 7f515093c700 1 -- 172.21.15.39:0/4135973632 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5144009570 con 0x7f514c069e00 2023-11-28T11:59:26.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.146+0000 7f515093c700 1 --2- 172.21.15.39:0/4135973632 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f514c069e00 0x7f514c0cc660 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f5140001ed0 tx=0x7f51400021e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:26.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.146+0000 7f51497fa700 1 -- 172.21.15.39:0/4135973632 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5140003c20 con 0x7f514c069e00 2023-11-28T11:59:26.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.146+0000 7f51497fa700 1 -- 172.21.15.39:0/4135973632 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5140003d80 con 0x7f514c069e00 2023-11-28T11:59:26.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.146+0000 7f515193e700 1 -- 172.21.15.39:0/4135973632 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f514c072010 con 0x7f514c069e00 2023-11-28T11:59:26.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.146+0000 7f51497fa700 1 -- 172.21.15.39:0/4135973632 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514000abf0 con 0x7f514c069e00 2023-11-28T11:59:26.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.146+0000 7f515193e700 1 -- 172.21.15.39:0/4135973632 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f514c15ca10 con 0x7f514c069e00 2023-11-28T11:59:26.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.150+0000 7f515193e700 1 -- 172.21.15.39:0/4135973632 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f514c06c830 con 0x7f514c069e00 2023-11-28T11:59:26.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.150+0000 7f51497fa700 1 -- 172.21.15.39:0/4135973632 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5140010050 con 0x7f514c069e00 2023-11-28T11:59:26.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.150+0000 7f51497fa700 1 --2- 172.21.15.39:0/4135973632 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5130064ee0 0x7f5130067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.150+0000 7f51497fa700 1 -- 172.21.15.39:0/4135973632 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f51400820e0 con 0x7f514c069e00 2023-11-28T11:59:26.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.154+0000 7f514bfff700 1 --2- 172.21.15.39:0/4135973632 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5130064ee0 0x7f5130067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.154+0000 7f514bfff700 1 --2- 172.21.15.39:0/4135973632 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5130064ee0 0x7f5130067390 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f514c0d1880 tx=0x7f5138008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:26.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.158+0000 7f51497fa700 1 -- 172.21.15.39:0/4135973632 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f514004ff70 con 0x7f514c069e00 2023-11-28T11:59:26.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.330+0000 7f515193e700 1 -- 172.21.15.39:0/4135973632 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f514c073cb0 con 0x7f514c069e00 2023-11-28T11:59:26.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.334+0000 7f51497fa700 1 -- 172.21.15.39:0/4135973632 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+18084 (secure 0 0 0) 0x7f5140053590 con 0x7f514c069e00 2023-11-28T11:59:26.338 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:59:26.338 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":58,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:58:52.640486+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:58:50.082546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-28T11:58:50.610241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:59:26.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.338+0000 7f515193e700 1 -- 172.21.15.39:0/4135973632 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5130064ee0 msgr2=0x7f5130067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.338+0000 7f515193e700 1 --2- 172.21.15.39:0/4135973632 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5130064ee0 0x7f5130067390 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f514c0d1880 tx=0x7f5138008040 comp rx=0 tx=0).stop 2023-11-28T11:59:26.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.338+0000 7f515193e700 1 -- 172.21.15.39:0/4135973632 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f514c069e00 msgr2=0x7f514c0cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.338+0000 7f515193e700 1 --2- 172.21.15.39:0/4135973632 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f514c069e00 0x7f514c0cc660 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f5140001ed0 tx=0x7f51400021e0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.338+0000 7f515193e700 1 -- 172.21.15.39:0/4135973632 shutdown_connections 2023-11-28T11:59:26.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.338+0000 7f515193e700 1 --2- 172.21.15.39:0/4135973632 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f514c15c640 0x7f514c0c64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.338+0000 7f515193e700 1 --2- 172.21.15.39:0/4135973632 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5130064ee0 0x7f5130067390 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.338+0000 7f515193e700 1 --2- 172.21.15.39:0/4135973632 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f514c071aa0 0x7f514c0c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.338+0000 7f515193e700 1 --2- 172.21.15.39:0/4135973632 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f514c069e00 0x7f514c0cc660 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.338+0000 7f515193e700 1 -- 172.21.15.39:0/4135973632 >> 172.21.15.39:0/4135973632 conn(0x7f514c0b6520 msgr2=0x7f514c0d19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:26.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.338+0000 7f515193e700 1 -- 172.21.15.39:0/4135973632 shutdown_connections 2023-11-28T11:59:26.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.338+0000 7f515193e700 1 -- 172.21.15.39:0/4135973632 wait complete. 2023-11-28T11:59:26.365 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:56:26.631457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:56:33.242202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:58:50.082546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:58:50.610241+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:59:26.366 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:59:26.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.546+0000 7f1d5086f700 1 Processor -- start 2023-11-28T11:59:26.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.546+0000 7f1d5086f700 1 -- start start 2023-11-28T11:59:26.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.550+0000 7f1d5086f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d4c15c150 0x7f1d4c0b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.550+0000 7f1d5086f700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d4c15c520 con 0x7f1d4c06ff10 2023-11-28T11:59:26.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.550+0000 7f1d5086f700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d4c06ac00 con 0x7f1d4c070360 2023-11-28T11:59:26.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.550+0000 7f1d5086f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c0b4240 con 0x7f1d4c15c150 2023-11-28T11:59:26.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.550+0000 7f1d42ffd700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f1d4c06ff10 0x7f1d4c15fc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:52092/0 (socket says 172.21.15.39:52092) 2023-11-28T11:59:26.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.550+0000 7f1d42ffd700 1 -- 172.21.15.39:0/3537942866 learned_addr learned my addr 172.21.15.39:0/3537942866 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:59:26.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.550+0000 7f1d4b7fe700 1 --2- 172.21.15.39:0/3537942866 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d4c15c150 0x7f1d4c0b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.550+0000 7f1d4affd700 1 -- 172.21.15.39:0/3537942866 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3627224920 0 0) 0x7f1d4c15c520 con 0x7f1d4c06ff10 2023-11-28T11:59:26.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.550+0000 7f1d4affd700 1 -- 172.21.15.39:0/3537942866 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d380035d0 con 0x7f1d4c06ff10 2023-11-28T11:59:26.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.550+0000 7f1d4affd700 1 -- 172.21.15.39:0/3537942866 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 482586033 0 0) 0x7f1d4c06ac00 con 0x7f1d4c070360 2023-11-28T11:59:26.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.550+0000 7f1d4b7fe700 1 -- 172.21.15.39:0/3537942866 >> v1:172.21.15.184:6789/0 conn(0x7f1d4c070360 legacy=0x7f1d4c160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.550+0000 7f1d4b7fe700 1 -- 172.21.15.39:0/3537942866 >> v1:172.21.15.39:6789/0 conn(0x7f1d4c06ff10 legacy=0x7f1d4c15fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.550+0000 7f1d4b7fe700 1 -- 172.21.15.39:0/3537942866 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d4c160a50 con 0x7f1d4c15c150 2023-11-28T11:59:26.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.554+0000 7f1d4b7fe700 1 --2- 172.21.15.39:0/3537942866 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d4c15c150 0x7f1d4c0b3d00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009880 tx=0x7f1d3c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e71584bf4f29db61 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:26.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.554+0000 7f1d4affd700 1 -- 172.21.15.39:0/3537942866 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c011830 con 0x7f1d4c15c150 2023-11-28T11:59:26.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.554+0000 7f1d4affd700 1 -- 172.21.15.39:0/3537942866 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3c011990 con 0x7f1d4c15c150 2023-11-28T11:59:26.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.554+0000 7f1d4affd700 1 -- 172.21.15.39:0/3537942866 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c011d20 con 0x7f1d4c15c150 2023-11-28T11:59:26.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.554+0000 7f1d5086f700 1 -- 172.21.15.39:0/3537942866 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d4c15c150 msgr2=0x7f1d4c0b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.554+0000 7f1d5086f700 1 --2- 172.21.15.39:0/3537942866 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d4c15c150 0x7f1d4c0b3d00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009880 tx=0x7f1d3c009b90 comp rx=0 tx=0).stop 2023-11-28T11:59:26.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.554+0000 7f1d5086f700 1 -- 172.21.15.39:0/3537942866 shutdown_connections 2023-11-28T11:59:26.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.554+0000 7f1d5086f700 1 --2- 172.21.15.39:0/3537942866 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d4c15c150 0x7f1d4c0b3d00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.554+0000 7f1d5086f700 1 -- 172.21.15.39:0/3537942866 >> 172.21.15.39:0/3537942866 conn(0x7f1d4c0d3680 msgr2=0x7f1d4c0cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:26.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.554+0000 7f1d5086f700 1 -- 172.21.15.39:0/3537942866 shutdown_connections 2023-11-28T11:59:26.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.554+0000 7f1d5086f700 1 -- 172.21.15.39:0/3537942866 wait complete. 2023-11-28T11:59:26.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.558+0000 7f1d5086f700 1 Processor -- start 2023-11-28T11:59:26.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.558+0000 7f1d5086f700 1 -- start start 2023-11-28T11:59:26.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.558+0000 7f1d5086f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d4c06ff10 0x7f1d4c14a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.558+0000 7f1d5086f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d4c070360 0x7f1d4c14d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.558+0000 7f1d5086f700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d4c15c150 0x7f1d4c14c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.558+0000 7f1d5086f700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c15a4b0 con 0x7f1d4c15c150 2023-11-28T11:59:26.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.558+0000 7f1d5086f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c14ab50 con 0x7f1d4c06ff10 2023-11-28T11:59:26.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.558+0000 7f1d5086f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c14dde0 con 0x7f1d4c070360 2023-11-28T11:59:26.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.558+0000 7f1d4bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d4c15c150 0x7f1d4c14c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.558+0000 7f1d42ffd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d4c070360 0x7f1d4c14d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.558+0000 7f1d4b7fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d4c06ff10 0x7f1d4c14a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.558+0000 7f1d4bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d4c15c150 0x7f1d4c14c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60246/0 (socket says 172.21.15.39:60246) 2023-11-28T11:59:26.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.558+0000 7f1d4bfff700 1 -- 172.21.15.39:0/3469251353 learned_addr learned my addr 172.21.15.39:0/3469251353 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:26.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.558+0000 7f1d4bfff700 1 -- 172.21.15.39:0/3469251353 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d4c070360 msgr2=0x7f1d4c14d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.558+0000 7f1d4bfff700 1 --2- 172.21.15.39:0/3469251353 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d4c070360 0x7f1d4c14d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.558+0000 7f1d4bfff700 1 -- 172.21.15.39:0/3469251353 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d4c06ff10 msgr2=0x7f1d4c14a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.558+0000 7f1d4bfff700 1 --2- 172.21.15.39:0/3469251353 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d4c06ff10 0x7f1d4c14a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.558+0000 7f1d4bfff700 1 -- 172.21.15.39:0/3469251353 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3c0094b0 con 0x7f1d4c15c150 2023-11-28T11:59:26.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.562+0000 7f1d4b7fe700 1 --2- 172.21.15.39:0/3469251353 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d4c06ff10 0x7f1d4c14a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:26.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.562+0000 7f1d4bfff700 1 --2- 172.21.15.39:0/3469251353 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d4c15c150 0x7f1d4c14c420 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f1d4400cca0 tx=0x7f1d4400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:26.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.562+0000 7f1d48ff9700 1 -- 172.21.15.39:0/3469251353 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d44003e50 con 0x7f1d4c15c150 2023-11-28T11:59:26.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.562+0000 7f1d48ff9700 1 -- 172.21.15.39:0/3469251353 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d4400a720 con 0x7f1d4c15c150 2023-11-28T11:59:26.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.562+0000 7f1d5086f700 1 -- 172.21.15.39:0/3469251353 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d4c0d2450 con 0x7f1d4c15c150 2023-11-28T11:59:26.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.562+0000 7f1d48ff9700 1 -- 172.21.15.39:0/3469251353 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4400aad0 con 0x7f1d4c15c150 2023-11-28T11:59:26.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.562+0000 7f1d5086f700 1 -- 172.21.15.39:0/3469251353 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d4c06cc50 con 0x7f1d4c15c150 2023-11-28T11:59:26.567 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.562+0000 7f1d5086f700 1 -- 172.21.15.39:0/3469251353 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d4c0d2730 con 0x7f1d4c15c150 2023-11-28T11:59:26.569 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.566+0000 7f1d48ff9700 1 -- 172.21.15.39:0/3469251353 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1d44019030 con 0x7f1d4c15c150 2023-11-28T11:59:26.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.566+0000 7f1d48ff9700 1 --2- 172.21.15.39:0/3469251353 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1d2c064f10 0x7f1d2c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.566+0000 7f1d48ff9700 1 -- 172.21.15.39:0/3469251353 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1d440819e0 con 0x7f1d4c15c150 2023-11-28T11:59:26.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.566+0000 7f1d4b7fe700 1 --2- 172.21.15.39:0/3469251353 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1d2c064f10 0x7f1d2c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.570+0000 7f1d4b7fe700 1 --2- 172.21.15.39:0/3469251353 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1d2c064f10 0x7f1d2c0673c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c0090b0 tx=0x7f1d3c01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:26.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.574+0000 7f1d48ff9700 1 -- 172.21.15.39:0/3469251353 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1d4404f950 con 0x7f1d4c15c150 2023-11-28T11:59:26.748 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.742+0000 7f1d5086f700 1 -- 172.21.15.39:0/3469251353 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1d4c0d0150 con 0x7f1d4c15c150 2023-11-28T11:59:26.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.746+0000 7f1d48ff9700 1 -- 172.21.15.39:0/3469251353 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1d440170a0 con 0x7f1d4c15c150 2023-11-28T11:59:26.749 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-11-28T11:59:26.751 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.746+0000 7f1d5086f700 1 -- 172.21.15.39:0/3469251353 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1d2c064f10 msgr2=0x7f1d2c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.752 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.746+0000 7f1d5086f700 1 --2- 172.21.15.39:0/3469251353 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1d2c064f10 0x7f1d2c0673c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c0090b0 tx=0x7f1d3c01c040 comp rx=0 tx=0).stop 2023-11-28T11:59:26.752 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.746+0000 7f1d5086f700 1 -- 172.21.15.39:0/3469251353 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d4c15c150 msgr2=0x7f1d4c14c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.752 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.746+0000 7f1d5086f700 1 --2- 172.21.15.39:0/3469251353 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d4c15c150 0x7f1d4c14c420 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f1d4400cca0 tx=0x7f1d4400a060 comp rx=0 tx=0).stop 2023-11-28T11:59:26.752 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.746+0000 7f1d5086f700 1 -- 172.21.15.39:0/3469251353 shutdown_connections 2023-11-28T11:59:26.752 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.746+0000 7f1d5086f700 1 --2- 172.21.15.39:0/3469251353 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d4c15c150 0x7f1d4c14c420 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.752 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.746+0000 7f1d5086f700 1 --2- 172.21.15.39:0/3469251353 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d4c070360 0x7f1d4c14d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.752 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.746+0000 7f1d5086f700 1 --2- 172.21.15.39:0/3469251353 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1d2c064f10 0x7f1d2c0673c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.752 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.746+0000 7f1d5086f700 1 --2- 172.21.15.39:0/3469251353 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d4c06ff10 0x7f1d4c14a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.752 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.746+0000 7f1d5086f700 1 -- 172.21.15.39:0/3469251353 >> 172.21.15.39:0/3469251353 conn(0x7f1d4c0d3680 msgr2=0x7f1d4c0b3ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:26.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.746+0000 7f1d5086f700 1 -- 172.21.15.39:0/3469251353 shutdown_connections 2023-11-28T11:59:26.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.750+0000 7f1d5086f700 1 -- 172.21.15.39:0/3469251353 wait complete. 2023-11-28T11:59:26.774 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:59:26.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.958+0000 7f4247192700 1 Processor -- start 2023-11-28T11:59:26.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.962+0000 7f4247192700 1 -- start start 2023-11-28T11:59:26.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.962+0000 7f4247192700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42400cd050 0x7f4240061010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.962+0000 7f4247192700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f424006b2f0 0x7f424015c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.962+0000 7f4247192700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f42400cd420 0x7f424015c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.962+0000 7f4247192700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f424015ca90 con 0x7f42400cd420 2023-11-28T11:59:26.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.962+0000 7f4247192700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4240160150 con 0x7f424006b2f0 2023-11-28T11:59:26.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.962+0000 7f4247192700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4240061550 con 0x7f42400cd050 2023-11-28T11:59:26.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.962+0000 7f423ffff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f424006b2f0 0x7f424015c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.962+0000 7f4244f2e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42400cd050 0x7f4240061010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.962+0000 7f424572f700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f42400cd420 0x7f424015c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.962+0000 7f423ffff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f424006b2f0 0x7f424015c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:34228/0 (socket says 172.21.15.39:34228) 2023-11-28T11:59:26.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.962+0000 7f423ffff700 1 -- 172.21.15.39:0/1233078518 learned_addr learned my addr 172.21.15.39:0/1233078518 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:26.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.966+0000 7f423ffff700 1 -- 172.21.15.39:0/1233078518 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42400cd050 msgr2=0x7f4240061010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:26.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.966+0000 7f423ffff700 1 --2- 172.21.15.39:0/1233078518 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42400cd050 0x7f4240061010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.966+0000 7f423ffff700 1 -- 172.21.15.39:0/1233078518 >> v2:172.21.15.39:3300/0 conn(0x7f42400cd420 msgr2=0x7f424015c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:26.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.966+0000 7f423ffff700 1 --2- 172.21.15.39:0/1233078518 >> v2:172.21.15.39:3300/0 conn(0x7f42400cd420 0x7f424015c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.966+0000 7f423ffff700 1 -- 172.21.15.39:0/1233078518 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42401603a0 con 0x7f424006b2f0 2023-11-28T11:59:26.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.966+0000 7f423ffff700 1 --2- 172.21.15.39:0/1233078518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f424006b2f0 0x7f424015c010 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f422c009910 tx=0x7f422c009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a9f5dfb3f293a29 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:26.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.966+0000 7f423f7fe700 1 -- 172.21.15.39:0/1233078518 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c011830 con 0x7f424006b2f0 2023-11-28T11:59:26.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.966+0000 7f423f7fe700 1 -- 172.21.15.39:0/1233078518 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422c011990 con 0x7f424006b2f0 2023-11-28T11:59:26.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.966+0000 7f423f7fe700 1 -- 172.21.15.39:0/1233078518 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c011d40 con 0x7f424006b2f0 2023-11-28T11:59:26.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.966+0000 7f4247192700 1 -- 172.21.15.39:0/1233078518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f424006b2f0 msgr2=0x7f424015c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.966+0000 7f4247192700 1 --2- 172.21.15.39:0/1233078518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f424006b2f0 0x7f424015c010 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f422c009910 tx=0x7f422c009c20 comp rx=0 tx=0).stop 2023-11-28T11:59:26.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.966+0000 7f4247192700 1 -- 172.21.15.39:0/1233078518 shutdown_connections 2023-11-28T11:59:26.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.966+0000 7f4247192700 1 --2- 172.21.15.39:0/1233078518 >> v2:172.21.15.39:3300/0 conn(0x7f42400cd420 0x7f424015c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.966+0000 7f4247192700 1 --2- 172.21.15.39:0/1233078518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f424006b2f0 0x7f424015c010 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.966+0000 7f4247192700 1 --2- 172.21.15.39:0/1233078518 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42400cd050 0x7f4240061010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.966+0000 7f4247192700 1 -- 172.21.15.39:0/1233078518 >> 172.21.15.39:0/1233078518 conn(0x7f42400cf210 msgr2=0x7f42400cf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:26.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.966+0000 7f4247192700 1 -- 172.21.15.39:0/1233078518 shutdown_connections 2023-11-28T11:59:26.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.966+0000 7f4247192700 1 -- 172.21.15.39:0/1233078518 wait complete. 2023-11-28T11:59:26.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.970+0000 7f4247192700 1 Processor -- start 2023-11-28T11:59:26.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.970+0000 7f4247192700 1 -- start start 2023-11-28T11:59:26.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.974+0000 7f4247192700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f424006b2f0 0x7f42400b4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.974+0000 7f4247192700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42400cd050 0x7f42401f1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.974+0000 7f4247192700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42400cd420 0x7f42400c4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.974+0000 7f4247192700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42400b3bd0 con 0x7f424006b2f0 2023-11-28T11:59:26.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.974+0000 7f4247192700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42400b2fc0 con 0x7f42400cd050 2023-11-28T11:59:26.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.974+0000 7f4247192700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42400b32a0 con 0x7f42400cd420 2023-11-28T11:59:26.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.974+0000 7f4244f2e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f424006b2f0 0x7f42400b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.974+0000 7f4244f2e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f424006b2f0 0x7f42400b4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60254/0 (socket says 172.21.15.39:60254) 2023-11-28T11:59:26.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.974+0000 7f4244f2e700 1 -- 172.21.15.39:0/706760193 learned_addr learned my addr 172.21.15.39:0/706760193 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:26.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.974+0000 7f423ffff700 1 --2- 172.21.15.39:0/706760193 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42400cd050 0x7f42401f1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.974+0000 7f424572f700 1 --2- 172.21.15.39:0/706760193 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42400cd420 0x7f42400c4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.974+0000 7f4244f2e700 1 -- 172.21.15.39:0/706760193 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42400cd420 msgr2=0x7f42400c4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.974+0000 7f4244f2e700 1 --2- 172.21.15.39:0/706760193 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42400cd420 0x7f42400c4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.974+0000 7f4244f2e700 1 -- 172.21.15.39:0/706760193 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42400cd050 msgr2=0x7f42401f1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.974+0000 7f4244f2e700 1 --2- 172.21.15.39:0/706760193 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42400cd050 0x7f42401f1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.974+0000 7f4244f2e700 1 -- 172.21.15.39:0/706760193 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422c009570 con 0x7f424006b2f0 2023-11-28T11:59:26.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.974+0000 7f4244f2e700 1 --2- 172.21.15.39:0/706760193 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f424006b2f0 0x7f42400b4060 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f423400e960 tx=0x7f423400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:26.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.974+0000 7f423d7fa700 1 -- 172.21.15.39:0/706760193 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42340096c0 con 0x7f424006b2f0 2023-11-28T11:59:26.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.974+0000 7f4247192700 1 -- 172.21.15.39:0/706760193 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4240160960 con 0x7f424006b2f0 2023-11-28T11:59:26.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.974+0000 7f423d7fa700 1 -- 172.21.15.39:0/706760193 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4234013680 con 0x7f424006b2f0 2023-11-28T11:59:26.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.974+0000 7f423d7fa700 1 -- 172.21.15.39:0/706760193 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4234013a10 con 0x7f424006b2f0 2023-11-28T11:59:26.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.974+0000 7f4247192700 1 -- 172.21.15.39:0/706760193 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4240160680 con 0x7f424006b2f0 2023-11-28T11:59:26.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.978+0000 7f4247192700 1 -- 172.21.15.39:0/706760193 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4240160c40 con 0x7f424006b2f0 2023-11-28T11:59:26.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.978+0000 7f423d7fa700 1 -- 172.21.15.39:0/706760193 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4234019030 con 0x7f424006b2f0 2023-11-28T11:59:26.984 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.978+0000 7f423d7fa700 1 --2- 172.21.15.39:0/706760193 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4224064ee0 0x7f4224067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.984 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.982+0000 7f423d7fa700 1 -- 172.21.15.39:0/706760193 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4234081fe0 con 0x7f424006b2f0 2023-11-28T11:59:26.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.982+0000 7f423ffff700 1 --2- 172.21.15.39:0/706760193 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4224064ee0 0x7f4224067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.982+0000 7f423ffff700 1 --2- 172.21.15.39:0/706760193 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4224064ee0 0x7f4224067390 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f424006b700 tx=0x7f422c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:26.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:26.990+0000 7f423d7fa700 1 -- 172.21.15.39:0/706760193 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f423404fed0 con 0x7f424006b2f0 2023-11-28T11:59:27.170 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.166+0000 7f4247192700 1 -- 172.21.15.39:0/706760193 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f42400726c0 con 0x7f424006b2f0 2023-11-28T11:59:27.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.166+0000 7f423d7fa700 1 -- 172.21.15.39:0/706760193 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v58) v1 ==== 92+0+10 (secure 0 0 0) 0x7f42340534f0 con 0x7f424006b2f0 2023-11-28T11:59:27.171 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-11-28T11:59:27.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.170+0000 7f4247192700 1 -- 172.21.15.39:0/706760193 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4224064ee0 msgr2=0x7f4224067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.170+0000 7f4247192700 1 --2- 172.21.15.39:0/706760193 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4224064ee0 0x7f4224067390 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f424006b700 tx=0x7f422c008030 comp rx=0 tx=0).stop 2023-11-28T11:59:27.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.170+0000 7f4247192700 1 -- 172.21.15.39:0/706760193 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f424006b2f0 msgr2=0x7f42400b4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.170+0000 7f4247192700 1 --2- 172.21.15.39:0/706760193 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f424006b2f0 0x7f42400b4060 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f423400e960 tx=0x7f423400ec70 comp rx=0 tx=0).stop 2023-11-28T11:59:27.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.170+0000 7f4247192700 1 -- 172.21.15.39:0/706760193 shutdown_connections 2023-11-28T11:59:27.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.170+0000 7f4247192700 1 --2- 172.21.15.39:0/706760193 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42400cd420 0x7f42400c4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.170+0000 7f4247192700 1 --2- 172.21.15.39:0/706760193 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4224064ee0 0x7f4224067390 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.170+0000 7f4247192700 1 --2- 172.21.15.39:0/706760193 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42400cd050 0x7f42401f1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.170+0000 7f4247192700 1 --2- 172.21.15.39:0/706760193 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f424006b2f0 0x7f42400b4060 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.170+0000 7f4247192700 1 -- 172.21.15.39:0/706760193 >> 172.21.15.39:0/706760193 conn(0x7f42400cf210 msgr2=0x7f42400ab8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:27.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.170+0000 7f4247192700 1 -- 172.21.15.39:0/706760193 shutdown_connections 2023-11-28T11:59:27.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.170+0000 7f4247192700 1 -- 172.21.15.39:0/706760193 wait complete. 2023-11-28T11:59:27.196 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:59:27.381 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.374+0000 7f317d66d700 1 Processor -- start 2023-11-28T11:59:27.381 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.374+0000 7f317d66d700 1 -- start start 2023-11-28T11:59:27.382 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.374+0000 7f317d66d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3178070620 0x7f31780b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:27.382 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.374+0000 7f317d66d700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f317815c520 con 0x7f3178069bf0 2023-11-28T11:59:27.382 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.374+0000 7f317d66d700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f317806cc50 con 0x7f317815c150 2023-11-28T11:59:27.382 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.374+0000 7f317d66d700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31780b4240 con 0x7f3178070620 2023-11-28T11:59:27.382 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.374+0000 7f317ce6c700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f3178069bf0 0x7f3178069ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:52104/0 (socket says 172.21.15.39:52104) 2023-11-28T11:59:27.382 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.374+0000 7f317ce6c700 1 -- 172.21.15.39:0/4190468497 learned_addr learned my addr 172.21.15.39:0/4190468497 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:59:27.382 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.374+0000 7f316ffff700 1 --2- 172.21.15.39:0/4190468497 >> v2:172.21.15.184:3300/0 conn(0x7f3178070620 0x7f31780b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:27.382 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.374+0000 7f31777fe700 1 -- 172.21.15.39:0/4190468497 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 653695437 0 0) 0x7f317815c520 con 0x7f3178069bf0 2023-11-28T11:59:27.382 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.374+0000 7f31777fe700 1 -- 172.21.15.39:0/4190468497 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31640035d0 con 0x7f3178069bf0 2023-11-28T11:59:27.382 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.374+0000 7f31777fe700 1 -- 172.21.15.39:0/4190468497 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3036275832 0 0) 0x7f317806cc50 con 0x7f317815c150 2023-11-28T11:59:27.382 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.374+0000 7f31777fe700 1 -- 172.21.15.39:0/4190468497 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f317815c520 con 0x7f317815c150 2023-11-28T11:59:27.382 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.378+0000 7f316ffff700 1 -- 172.21.15.39:0/4190468497 >> v1:172.21.15.184:6789/0 conn(0x7f317815c150 legacy=0x7f317806ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.383 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.378+0000 7f316ffff700 1 -- 172.21.15.39:0/4190468497 >> v1:172.21.15.39:6789/0 conn(0x7f3178069bf0 legacy=0x7f3178069ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.383 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.378+0000 7f316ffff700 1 -- 172.21.15.39:0/4190468497 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31780d2450 con 0x7f3178070620 2023-11-28T11:59:27.383 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.378+0000 7f316ffff700 1 --2- 172.21.15.39:0/4190468497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3178070620 0x7f31780b3d00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3160009840 tx=0x7f3160009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48a015c4e96b6b0a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:27.383 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.378+0000 7f31777fe700 1 -- 172.21.15.39:0/4190468497 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3160005e50 con 0x7f3178070620 2023-11-28T11:59:27.383 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.378+0000 7f31777fe700 1 -- 172.21.15.39:0/4190468497 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3160006030 con 0x7f3178070620 2023-11-28T11:59:27.383 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.378+0000 7f31777fe700 1 -- 172.21.15.39:0/4190468497 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31600063c0 con 0x7f3178070620 2023-11-28T11:59:27.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.378+0000 7f317d66d700 1 -- 172.21.15.39:0/4190468497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3178070620 msgr2=0x7f31780b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.378+0000 7f317d66d700 1 --2- 172.21.15.39:0/4190468497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3178070620 0x7f31780b3d00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3160009840 tx=0x7f3160009b50 comp rx=0 tx=0).stop 2023-11-28T11:59:27.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.378+0000 7f317d66d700 1 -- 172.21.15.39:0/4190468497 shutdown_connections 2023-11-28T11:59:27.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.378+0000 7f317d66d700 1 --2- 172.21.15.39:0/4190468497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3178070620 0x7f31780b3d00 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.378+0000 7f317d66d700 1 -- 172.21.15.39:0/4190468497 >> 172.21.15.39:0/4190468497 conn(0x7f31780d3680 msgr2=0x7f31780cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:27.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.378+0000 7f317d66d700 1 -- 172.21.15.39:0/4190468497 shutdown_connections 2023-11-28T11:59:27.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.378+0000 7f317d66d700 1 -- 172.21.15.39:0/4190468497 wait complete. 2023-11-28T11:59:27.386 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.382+0000 7f317d66d700 1 Processor -- start 2023-11-28T11:59:27.386 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.382+0000 7f317d66d700 1 -- start start 2023-11-28T11:59:27.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.382+0000 7f317d66d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3178069bf0 0x7f31781f5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:27.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.382+0000 7f317d66d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3178070620 0x7f3178149f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:27.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.382+0000 7f317d66d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f317815c150 0x7f317815c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:27.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.386+0000 7f317d66d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317814ae80 con 0x7f3178069bf0 2023-11-28T11:59:27.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.386+0000 7f317d66d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317814a8c0 con 0x7f317815c150 2023-11-28T11:59:27.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.386+0000 7f317d66d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f317814aba0 con 0x7f3178070620 2023-11-28T11:59:27.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.386+0000 7f3177fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3178069bf0 0x7f31781f5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:27.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.386+0000 7f3177fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3178069bf0 0x7f31781f5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60258/0 (socket says 172.21.15.39:60258) 2023-11-28T11:59:27.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.386+0000 7f3177fff700 1 -- 172.21.15.39:0/3174723810 learned_addr learned my addr 172.21.15.39:0/3174723810 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:27.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.386+0000 7f317ce6c700 1 --2- 172.21.15.39:0/3174723810 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f317815c150 0x7f317815c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:27.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.386+0000 7f316ffff700 1 --2- 172.21.15.39:0/3174723810 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3178070620 0x7f3178149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:27.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.386+0000 7f3177fff700 1 -- 172.21.15.39:0/3174723810 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3178070620 msgr2=0x7f3178149f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.386+0000 7f3177fff700 1 --2- 172.21.15.39:0/3174723810 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3178070620 0x7f3178149f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.386+0000 7f3177fff700 1 -- 172.21.15.39:0/3174723810 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f317815c150 msgr2=0x7f317815c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.386+0000 7f3177fff700 1 --2- 172.21.15.39:0/3174723810 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f317815c150 0x7f317815c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.386+0000 7f3177fff700 1 -- 172.21.15.39:0/3174723810 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3160009450 con 0x7f3178069bf0 2023-11-28T11:59:27.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.386+0000 7f317ce6c700 1 --2- 172.21.15.39:0/3174723810 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f317815c150 0x7f317815c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:27.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.386+0000 7f3177fff700 1 --2- 172.21.15.39:0/3174723810 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3178069bf0 0x7f31781f5800 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f316800c490 tx=0x7f316800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:27.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.386+0000 7f31757fa700 1 -- 172.21.15.39:0/3174723810 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31680052d0 con 0x7f3178069bf0 2023-11-28T11:59:27.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.386+0000 7f31757fa700 1 -- 172.21.15.39:0/3174723810 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3168005450 con 0x7f3178069bf0 2023-11-28T11:59:27.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.386+0000 7f31757fa700 1 -- 172.21.15.39:0/3174723810 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31680038e0 con 0x7f3178069bf0 2023-11-28T11:59:27.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.386+0000 7f317d66d700 1 -- 172.21.15.39:0/3174723810 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31780d05e0 con 0x7f3178069bf0 2023-11-28T11:59:27.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.386+0000 7f317d66d700 1 -- 172.21.15.39:0/3174723810 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31780d2730 con 0x7f3178069bf0 2023-11-28T11:59:27.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.386+0000 7f317d66d700 1 -- 172.21.15.39:0/3174723810 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31780d2140 con 0x7f3178069bf0 2023-11-28T11:59:27.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.390+0000 7f31757fa700 1 -- 172.21.15.39:0/3174723810 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3168019030 con 0x7f3178069bf0 2023-11-28T11:59:27.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.390+0000 7f31757fa700 1 --2- 172.21.15.39:0/3174723810 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3158064ee0 0x7f3158067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:27.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.390+0000 7f31757fa700 1 -- 172.21.15.39:0/3174723810 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f31680813b0 con 0x7f3178069bf0 2023-11-28T11:59:27.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.390+0000 7f316ffff700 1 --2- 172.21.15.39:0/3174723810 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3158064ee0 0x7f3158067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:27.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.394+0000 7f316ffff700 1 --2- 172.21.15.39:0/3174723810 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3158064ee0 0x7f3158067390 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3178070a10 tx=0x7f3160008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:27.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.394+0000 7f31757fa700 1 -- 172.21.15.39:0/3174723810 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f316804f410 con 0x7f3178069bf0 2023-11-28T11:59:27.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.566+0000 7f317d66d700 1 -- 172.21.15.39:0/3174723810 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3178073d20 con 0x7f3178069bf0 2023-11-28T11:59:27.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.566+0000 7f31757fa700 1 -- 172.21.15.39:0/3174723810 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v58) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3168052a30 con 0x7f3178069bf0 2023-11-28T11:59:27.571 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-11-28T11:59:27.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.570+0000 7f317d66d700 1 -- 172.21.15.39:0/3174723810 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3158064ee0 msgr2=0x7f3158067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.570+0000 7f317d66d700 1 --2- 172.21.15.39:0/3174723810 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3158064ee0 0x7f3158067390 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3178070a10 tx=0x7f3160008070 comp rx=0 tx=0).stop 2023-11-28T11:59:27.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.570+0000 7f317d66d700 1 -- 172.21.15.39:0/3174723810 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3178069bf0 msgr2=0x7f31781f5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.570+0000 7f317d66d700 1 --2- 172.21.15.39:0/3174723810 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3178069bf0 0x7f31781f5800 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f316800c490 tx=0x7f316800c850 comp rx=0 tx=0).stop 2023-11-28T11:59:27.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.570+0000 7f317d66d700 1 -- 172.21.15.39:0/3174723810 shutdown_connections 2023-11-28T11:59:27.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.570+0000 7f317d66d700 1 --2- 172.21.15.39:0/3174723810 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3158064ee0 0x7f3158067390 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.570+0000 7f317d66d700 1 --2- 172.21.15.39:0/3174723810 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f317815c150 0x7f317815c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.570+0000 7f317d66d700 1 --2- 172.21.15.39:0/3174723810 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3178070620 0x7f3178149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.570+0000 7f317d66d700 1 --2- 172.21.15.39:0/3174723810 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3178069bf0 0x7f31781f5800 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.570+0000 7f317d66d700 1 -- 172.21.15.39:0/3174723810 >> 172.21.15.39:0/3174723810 conn(0x7f31780d3680 msgr2=0x7f31780d0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:27.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.570+0000 7f317d66d700 1 -- 172.21.15.39:0/3174723810 shutdown_connections 2023-11-28T11:59:27.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.570+0000 7f317d66d700 1 -- 172.21.15.39:0/3174723810 wait complete. 2023-11-28T11:59:27.595 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:59:27.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.770+0000 7f6578b18700 1 Processor -- start 2023-11-28T11:59:27.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.770+0000 7f6578b18700 1 -- start start 2023-11-28T11:59:27.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.774+0000 7f6578b18700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f657415c0f0 0x7f65740ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:27.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.774+0000 7f6578b18700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f65740cc050 0x7f657406a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:27.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.774+0000 7f6578b18700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65740c95b0 con 0x7f6574160770 2023-11-28T11:59:27.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.774+0000 7f6578b18700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6574069bf0 con 0x7f65740cc050 2023-11-28T11:59:27.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.774+0000 7f6578b18700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6574069ed0 con 0x7f657415c0f0 2023-11-28T11:59:27.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.774+0000 7f6573fff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f65740cc050 0x7f657406a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:27.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.774+0000 7f65737fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f657415c0f0 0x7f65740ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:27.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.774+0000 7f6573fff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f65740cc050 0x7f657406a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60260/0 (socket says 172.21.15.39:60260) 2023-11-28T11:59:27.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.774+0000 7f6573fff700 1 -- 172.21.15.39:0/199119189 learned_addr learned my addr 172.21.15.39:0/199119189 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:27.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.774+0000 7f6573fff700 1 -- 172.21.15.39:0/199119189 >> v2:172.21.15.184:3300/0 conn(0x7f657415c0f0 msgr2=0x7f65740ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:27.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.774+0000 7f6573fff700 1 --2- 172.21.15.39:0/199119189 >> v2:172.21.15.184:3300/0 conn(0x7f657415c0f0 0x7f65740ce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.774+0000 7f6573fff700 1 -- 172.21.15.39:0/199119189 >> v1:172.21.15.184:6789/0 conn(0x7f6574160770 legacy=0x7f65740cb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.774+0000 7f6573fff700 1 -- 172.21.15.39:0/199119189 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65740cece0 con 0x7f65740cc050 2023-11-28T11:59:27.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.774+0000 7f6573fff700 1 --2- 172.21.15.39:0/199119189 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f65740cc050 0x7f657406a360 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f65740ceec0 tx=0x7f656c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e80edfe2b102323 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:27.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.774+0000 7f65727fc700 1 -- 172.21.15.39:0/199119189 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656c00e070 con 0x7f65740cc050 2023-11-28T11:59:27.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.774+0000 7f65727fc700 1 -- 172.21.15.39:0/199119189 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656c00b910 con 0x7f65740cc050 2023-11-28T11:59:27.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.774+0000 7f65727fc700 1 -- 172.21.15.39:0/199119189 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656c00bcc0 con 0x7f65740cc050 2023-11-28T11:59:27.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.778+0000 7f6578b18700 1 -- 172.21.15.39:0/199119189 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f65740cc050 msgr2=0x7f657406a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.778+0000 7f6578b18700 1 --2- 172.21.15.39:0/199119189 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f65740cc050 0x7f657406a360 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f65740ceec0 tx=0x7f656c00b330 comp rx=0 tx=0).stop 2023-11-28T11:59:27.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.778+0000 7f6578b18700 1 -- 172.21.15.39:0/199119189 shutdown_connections 2023-11-28T11:59:27.782 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.778+0000 7f6578b18700 1 --2- 172.21.15.39:0/199119189 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f65740cc050 0x7f657406a360 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.782 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.778+0000 7f6578b18700 1 --2- 172.21.15.39:0/199119189 >> v2:172.21.15.184:3300/0 conn(0x7f657415c0f0 0x7f65740ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.782 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.778+0000 7f6578b18700 1 -- 172.21.15.39:0/199119189 >> 172.21.15.39:0/199119189 conn(0x7f65740cef60 msgr2=0x7f65740cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:27.782 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.778+0000 7f6578b18700 1 -- 172.21.15.39:0/199119189 shutdown_connections 2023-11-28T11:59:27.782 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.778+0000 7f6578b18700 1 -- 172.21.15.39:0/199119189 wait complete. 2023-11-28T11:59:27.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.782+0000 7f6578b18700 1 Processor -- start 2023-11-28T11:59:27.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.782+0000 7f6578b18700 1 -- start start 2023-11-28T11:59:27.786 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.782+0000 7f6578b18700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f65740cc050 0x7f65740c59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:27.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.782+0000 7f6578b18700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f657415c0f0 0x7f65741f28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:27.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.782+0000 7f6578b18700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6574160770 0x7f65741f1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:27.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.782+0000 7f6578b18700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65741f2df0 con 0x7f65740cc050 2023-11-28T11:59:27.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.782+0000 7f6578b18700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657415e760 con 0x7f6574160770 2023-11-28T11:59:27.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.782+0000 7f6578b18700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f657415e480 con 0x7f657415c0f0 2023-11-28T11:59:27.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.782+0000 7f65737fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f65740cc050 0x7f65740c59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:27.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.782+0000 7f65737fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f65740cc050 0x7f65740c59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60274/0 (socket says 172.21.15.39:60274) 2023-11-28T11:59:27.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.782+0000 7f65737fe700 1 -- 172.21.15.39:0/3014005100 learned_addr learned my addr 172.21.15.39:0/3014005100 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:27.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.782+0000 7f6572ffd700 1 --2- 172.21.15.39:0/3014005100 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f657415c0f0 0x7f65741f28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:27.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.782+0000 7f6573fff700 1 --2- 172.21.15.39:0/3014005100 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6574160770 0x7f65741f1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:27.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.782+0000 7f65737fe700 1 -- 172.21.15.39:0/3014005100 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f657415c0f0 msgr2=0x7f65741f28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.782+0000 7f65737fe700 1 --2- 172.21.15.39:0/3014005100 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f657415c0f0 0x7f65741f28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.782+0000 7f65737fe700 1 -- 172.21.15.39:0/3014005100 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6574160770 msgr2=0x7f65741f1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.782+0000 7f65737fe700 1 --2- 172.21.15.39:0/3014005100 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6574160770 0x7f65741f1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.782+0000 7f65737fe700 1 -- 172.21.15.39:0/3014005100 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f656c009b30 con 0x7f65740cc050 2023-11-28T11:59:27.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.786+0000 7f65737fe700 1 --2- 172.21.15.39:0/3014005100 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f65740cc050 0x7f65740c59d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f656400e870 tx=0x7f656400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:27.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.786+0000 7f655bfff700 1 -- 172.21.15.39:0/3014005100 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65640095a0 con 0x7f65740cc050 2023-11-28T11:59:27.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.786+0000 7f655bfff700 1 -- 172.21.15.39:0/3014005100 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6564013680 con 0x7f65740cc050 2023-11-28T11:59:27.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.786+0000 7f655bfff700 1 -- 172.21.15.39:0/3014005100 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65640139f0 con 0x7f65740cc050 2023-11-28T11:59:27.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.786+0000 7f6578b18700 1 -- 172.21.15.39:0/3014005100 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65740ccf40 con 0x7f65740cc050 2023-11-28T11:59:27.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.786+0000 7f6578b18700 1 -- 172.21.15.39:0/3014005100 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65740ccc60 con 0x7f65740cc050 2023-11-28T11:59:27.791 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.786+0000 7f6578b18700 1 -- 172.21.15.39:0/3014005100 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6574160bc0 con 0x7f65740cc050 2023-11-28T11:59:27.792 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.790+0000 7f655bfff700 1 -- 172.21.15.39:0/3014005100 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6564019030 con 0x7f65740cc050 2023-11-28T11:59:27.794 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.790+0000 7f655bfff700 1 --2- 172.21.15.39:0/3014005100 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6560064ee0 0x7f6560067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:27.794 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.790+0000 7f655bfff700 1 -- 172.21.15.39:0/3014005100 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6564081d80 con 0x7f65740cc050 2023-11-28T11:59:27.795 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.790+0000 7f6572ffd700 1 --2- 172.21.15.39:0/3014005100 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6560064ee0 0x7f6560067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:27.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.790+0000 7f6572ffd700 1 --2- 172.21.15.39:0/3014005100 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6560064ee0 0x7f6560067390 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f65740b4ae0 tx=0x7f6568009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:27.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.798+0000 7f655bfff700 1 -- 172.21.15.39:0/3014005100 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f656404fcf0 con 0x7f65740cc050 2023-11-28T11:59:27.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.970+0000 7f6578b18700 1 -- 172.21.15.39:0/3014005100 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6574073d20 con 0x7f65740cc050 2023-11-28T11:59:27.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.970+0000 7f655bfff700 1 -- 172.21.15.39:0/3014005100 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v58) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6564053310 con 0x7f65740cc050 2023-11-28T11:59:27.974 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2023-11-28T11:59:27.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.970+0000 7f6578b18700 1 -- 172.21.15.39:0/3014005100 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6560064ee0 msgr2=0x7f6560067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.970+0000 7f6578b18700 1 --2- 172.21.15.39:0/3014005100 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6560064ee0 0x7f6560067390 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f65740b4ae0 tx=0x7f6568009040 comp rx=0 tx=0).stop 2023-11-28T11:59:27.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.970+0000 7f6578b18700 1 -- 172.21.15.39:0/3014005100 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f65740cc050 msgr2=0x7f65740c59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.970+0000 7f6578b18700 1 --2- 172.21.15.39:0/3014005100 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f65740cc050 0x7f65740c59d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f656400e870 tx=0x7f656400eb80 comp rx=0 tx=0).stop 2023-11-28T11:59:27.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.970+0000 7f6578b18700 1 -- 172.21.15.39:0/3014005100 shutdown_connections 2023-11-28T11:59:27.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.970+0000 7f6578b18700 1 --2- 172.21.15.39:0/3014005100 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6560064ee0 0x7f6560067390 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.974+0000 7f6578b18700 1 --2- 172.21.15.39:0/3014005100 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6574160770 0x7f65741f1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.974+0000 7f6578b18700 1 --2- 172.21.15.39:0/3014005100 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f657415c0f0 0x7f65741f28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.974+0000 7f6578b18700 1 --2- 172.21.15.39:0/3014005100 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f65740cc050 0x7f65740c59d0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.974+0000 7f6578b18700 1 -- 172.21.15.39:0/3014005100 >> 172.21.15.39:0/3014005100 conn(0x7f65740cef60 msgr2=0x7f657406a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:27.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.974+0000 7f6578b18700 1 -- 172.21.15.39:0/3014005100 shutdown_connections 2023-11-28T11:59:27.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:27.974+0000 7f6578b18700 1 -- 172.21.15.39:0/3014005100 wait complete. 2023-11-28T11:59:27.997 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:59:28.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.166+0000 7ff49cc45700 1 Processor -- start 2023-11-28T11:59:28.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.166+0000 7ff49cc45700 1 -- start start 2023-11-28T11:59:28.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.166+0000 7ff49cc45700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4980b1640 0x7ff498070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:28.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.170+0000 7ff49cc45700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff4980c9040 0x7ff4980705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:28.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.170+0000 7ff49cc45700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49815a550 con 0x7ff4980b43a0 2023-11-28T11:59:28.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.170+0000 7ff49cc45700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff49806b0a0 con 0x7ff4980c9040 2023-11-28T11:59:28.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.170+0000 7ff49cc45700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4980caac0 con 0x7ff4980b1640 2023-11-28T11:59:28.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.170+0000 7ff497fff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff4980c9040 0x7ff4980705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:28.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.170+0000 7ff4977fe700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7ff4980b43a0 0x7ff49815e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:40250/0 (socket says 172.21.15.39:40250) 2023-11-28T11:59:28.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.170+0000 7ff4977fe700 1 -- 172.21.15.39:0/3912289249 learned_addr learned my addr 172.21.15.39:0/3912289249 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:59:28.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.170+0000 7ff48effd700 1 --2- 172.21.15.39:0/3912289249 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4980b1640 0x7ff498070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:28.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.170+0000 7ff496ffd700 1 -- 172.21.15.39:0/3912289249 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1072914463 0 0) 0x7ff488001110 con 0x7ff4980b43a0 2023-11-28T11:59:28.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.170+0000 7ff496ffd700 1 -- 172.21.15.39:0/3912289249 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4840035d0 con 0x7ff4980b43a0 2023-11-28T11:59:28.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.170+0000 7ff497fff700 1 -- 172.21.15.39:0/3912289249 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4980b1640 msgr2=0x7ff498070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:28.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.170+0000 7ff497fff700 1 --2- 172.21.15.39:0/3912289249 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4980b1640 0x7ff498070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.170+0000 7ff497fff700 1 -- 172.21.15.39:0/3912289249 >> v1:172.21.15.39:6789/0 conn(0x7ff4980b43a0 legacy=0x7ff49815e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:28.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.170+0000 7ff497fff700 1 -- 172.21.15.39:0/3912289249 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4980cada0 con 0x7ff4980c9040 2023-11-28T11:59:28.176 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.170+0000 7ff497fff700 1 --2- 172.21.15.39:0/3912289249 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4980c9040 0x7ff4980705c0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff490009d90 tx=0x7ff49000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e078b4a8a9b35 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:28.176 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.170+0000 7ff496ffd700 1 -- 172.21.15.39:0/3912289249 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49000e070 con 0x7ff4980c9040 2023-11-28T11:59:28.176 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.170+0000 7ff496ffd700 1 -- 172.21.15.39:0/3912289249 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff49000bb20 con 0x7ff4980c9040 2023-11-28T11:59:28.176 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.170+0000 7ff496ffd700 1 -- 172.21.15.39:0/3912289249 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff490012430 con 0x7ff4980c9040 2023-11-28T11:59:28.177 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.174+0000 7ff49cc45700 1 -- 172.21.15.39:0/3912289249 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4980c9040 msgr2=0x7ff4980705c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:28.177 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.174+0000 7ff49cc45700 1 --2- 172.21.15.39:0/3912289249 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4980c9040 0x7ff4980705c0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff490009d90 tx=0x7ff49000b330 comp rx=0 tx=0).stop 2023-11-28T11:59:28.177 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.174+0000 7ff49cc45700 1 -- 172.21.15.39:0/3912289249 shutdown_connections 2023-11-28T11:59:28.177 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.174+0000 7ff49cc45700 1 --2- 172.21.15.39:0/3912289249 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4980c9040 0x7ff4980705c0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.177 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.174+0000 7ff49cc45700 1 --2- 172.21.15.39:0/3912289249 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4980b1640 0x7ff498070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.178 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.174+0000 7ff49cc45700 1 -- 172.21.15.39:0/3912289249 >> 172.21.15.39:0/3912289249 conn(0x7ff4980b0f80 msgr2=0x7ff4980ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:28.178 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.174+0000 7ff49cc45700 1 -- 172.21.15.39:0/3912289249 shutdown_connections 2023-11-28T11:59:28.178 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.174+0000 7ff49cc45700 1 -- 172.21.15.39:0/3912289249 wait complete. 2023-11-28T11:59:28.180 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.178+0000 7ff49cc45700 1 Processor -- start 2023-11-28T11:59:28.181 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.178+0000 7ff49cc45700 1 -- start start 2023-11-28T11:59:28.183 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.178+0000 7ff49cc45700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4980b1640 0x7ff4981f53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:28.183 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.178+0000 7ff49cc45700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4980b43a0 0x7ff4980cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:28.183 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.178+0000 7ff49cc45700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4980c9040 0x7ff4980cc320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:28.183 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.178+0000 7ff49cc45700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4981f5900 con 0x7ff4980b43a0 2023-11-28T11:59:28.184 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.178+0000 7ff49cc45700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4980ccc70 con 0x7ff4980b1640 2023-11-28T11:59:28.184 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.178+0000 7ff49cc45700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4980ccf50 con 0x7ff4980c9040 2023-11-28T11:59:28.184 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.178+0000 7ff48effd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4980b43a0 0x7ff4980cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:28.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.178+0000 7ff48effd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4980b43a0 0x7ff4980cdd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54518/0 (socket says 172.21.15.39:54518) 2023-11-28T11:59:28.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.178+0000 7ff48effd700 1 -- 172.21.15.39:0/379524242 learned_addr learned my addr 172.21.15.39:0/379524242 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:28.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.178+0000 7ff497fff700 1 --2- 172.21.15.39:0/379524242 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4980c9040 0x7ff4980cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:28.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.178+0000 7ff4977fe700 1 --2- 172.21.15.39:0/379524242 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4980b1640 0x7ff4981f53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:28.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.182+0000 7ff48effd700 1 -- 172.21.15.39:0/379524242 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4980c9040 msgr2=0x7ff4980cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:28.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.182+0000 7ff48effd700 1 --2- 172.21.15.39:0/379524242 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4980c9040 0x7ff4980cc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.182+0000 7ff48effd700 1 -- 172.21.15.39:0/379524242 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4980b1640 msgr2=0x7ff4981f53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:28.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.182+0000 7ff48effd700 1 --2- 172.21.15.39:0/379524242 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4980b1640 0x7ff4981f53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.182+0000 7ff48effd700 1 -- 172.21.15.39:0/379524242 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff490009a70 con 0x7ff4980b43a0 2023-11-28T11:59:28.186 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.182+0000 7ff48effd700 1 --2- 172.21.15.39:0/379524242 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4980b43a0 0x7ff4980cdd10 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ff48000e840 tx=0x7ff48000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:28.186 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.182+0000 7ff494ff9700 1 -- 172.21.15.39:0/379524242 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4800095a0 con 0x7ff4980b43a0 2023-11-28T11:59:28.186 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.182+0000 7ff494ff9700 1 -- 172.21.15.39:0/379524242 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff480013680 con 0x7ff4980b43a0 2023-11-28T11:59:28.186 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.182+0000 7ff494ff9700 1 -- 172.21.15.39:0/379524242 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4800139f0 con 0x7ff4980b43a0 2023-11-28T11:59:28.186 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.182+0000 7ff49cc45700 1 -- 172.21.15.39:0/379524242 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff49806b5d0 con 0x7ff4980b43a0 2023-11-28T11:59:28.186 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.182+0000 7ff49cc45700 1 -- 172.21.15.39:0/379524242 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff49806b2f0 con 0x7ff4980b43a0 2023-11-28T11:59:28.187 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.182+0000 7ff49cc45700 1 -- 172.21.15.39:0/379524242 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4980ca7b0 con 0x7ff4980b43a0 2023-11-28T11:59:28.188 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.186+0000 7ff494ff9700 1 -- 172.21.15.39:0/379524242 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff480019030 con 0x7ff4980b43a0 2023-11-28T11:59:28.190 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.186+0000 7ff494ff9700 1 --2- 172.21.15.39:0/379524242 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff478064ee0 0x7ff478067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:28.190 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.186+0000 7ff494ff9700 1 -- 172.21.15.39:0/379524242 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff480081e20 con 0x7ff4980b43a0 2023-11-28T11:59:28.190 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.186+0000 7ff4977fe700 1 --2- 172.21.15.39:0/379524242 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff478064ee0 0x7ff478067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:28.193 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.186+0000 7ff4977fe700 1 --2- 172.21.15.39:0/379524242 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff478064ee0 0x7ff478067390 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff488007fd0 tx=0x7ff488007c60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:28.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.190+0000 7ff494ff9700 1 -- 172.21.15.39:0/379524242 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff48004fd30 con 0x7ff4980b43a0 2023-11-28T11:59:28.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.398+0000 7ff49cc45700 1 -- 172.21.15.39:0/379524242 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff498073cb0 con 0x7ff4980b43a0 2023-11-28T11:59:28.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.398+0000 7ff494ff9700 1 -- 172.21.15.39:0/379524242 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4648 (secure 0 0 0) 0x7ff480053350 con 0x7ff4980b43a0 2023-11-28T11:59:28.404 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:59:28.404 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5775,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3453450609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3453450609},{"type":"v1","addr":"172.21.15.39:6833","nonce":3453450609}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/697075022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":697075022},{"type":"v1","addr":"172.21.15.39:6835","nonce":697075022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5806,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1819593136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1819593136},{"type":"v1","addr":"172.21.15.184:6835","nonce":1819593136}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:58:51.635140+0000","modified":"2023-11-28T11:58:54.706764+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5809},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5809":{"gid":5809,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/367294936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":367294936},{"type":"v1","addr":"172.21.15.184:6837","nonce":367294936}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T11:59:28.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.402+0000 7ff49cc45700 1 -- 172.21.15.39:0/379524242 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff478064ee0 msgr2=0x7ff478067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:28.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.402+0000 7ff49cc45700 1 --2- 172.21.15.39:0/379524242 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff478064ee0 0x7ff478067390 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff488007fd0 tx=0x7ff488007c60 comp rx=0 tx=0).stop 2023-11-28T11:59:28.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.402+0000 7ff49cc45700 1 -- 172.21.15.39:0/379524242 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4980b43a0 msgr2=0x7ff4980cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:28.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.402+0000 7ff49cc45700 1 --2- 172.21.15.39:0/379524242 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4980b43a0 0x7ff4980cdd10 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ff48000e840 tx=0x7ff48000eb50 comp rx=0 tx=0).stop 2023-11-28T11:59:28.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.402+0000 7ff49cc45700 1 -- 172.21.15.39:0/379524242 shutdown_connections 2023-11-28T11:59:28.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.402+0000 7ff49cc45700 1 --2- 172.21.15.39:0/379524242 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4980c9040 0x7ff4980cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.402+0000 7ff49cc45700 1 --2- 172.21.15.39:0/379524242 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4980b43a0 0x7ff4980cdd10 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.402+0000 7ff49cc45700 1 --2- 172.21.15.39:0/379524242 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff478064ee0 0x7ff478067390 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.402+0000 7ff49cc45700 1 --2- 172.21.15.39:0/379524242 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4980b1640 0x7ff4981f53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.402+0000 7ff49cc45700 1 -- 172.21.15.39:0/379524242 >> 172.21.15.39:0/379524242 conn(0x7ff4980b0f80 msgr2=0x7ff498159bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:28.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.402+0000 7ff49cc45700 1 -- 172.21.15.39:0/379524242 shutdown_connections 2023-11-28T11:59:28.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.402+0000 7ff49cc45700 1 -- 172.21.15.39:0/379524242 wait complete. 2023-11-28T11:59:28.409 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 24 2023-11-28T11:59:28.429 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:59:28.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.606+0000 7f48fa88c700 1 Processor -- start 2023-11-28T11:59:28.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.606+0000 7f48fa88c700 1 -- start start 2023-11-28T11:59:28.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.610+0000 7f48fa88c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48f415c1a0 0x7f48f406c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:28.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.610+0000 7f48fa88c700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48f40adf90 con 0x7f48f40cdeb0 2023-11-28T11:59:28.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.610+0000 7f48fa88c700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48f40ce370 con 0x7f48f4070790 2023-11-28T11:59:28.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.610+0000 7f48fa88c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f4069bf0 con 0x7f48f415c1a0 2023-11-28T11:59:28.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.610+0000 7f48f9089700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f48f40cdeb0 0x7f48f4070080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:40258/0 (socket says 172.21.15.39:40258) 2023-11-28T11:59:28.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.610+0000 7f48f988a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48f415c1a0 0x7f48f406c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:28.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.610+0000 7f48f9089700 1 -- 172.21.15.39:0/317707629 learned_addr learned my addr 172.21.15.39:0/317707629 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:59:28.615 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.610+0000 7f48f988a700 1 -- 172.21.15.39:0/317707629 >> v1:172.21.15.184:6789/0 conn(0x7f48f4070790 legacy=0x7f48f406a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:28.615 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.610+0000 7f48f988a700 1 -- 172.21.15.39:0/317707629 >> v1:172.21.15.39:6789/0 conn(0x7f48f40cdeb0 legacy=0x7f48f4070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:28.615 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.610+0000 7f48f988a700 1 -- 172.21.15.39:0/317707629 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f40cc4a0 con 0x7f48f415c1a0 2023-11-28T11:59:28.616 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.610+0000 7f48f988a700 1 --2- 172.21.15.39:0/317707629 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48f415c1a0 0x7f48f406c8b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f48f0009880 tx=0x7f48f0009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4d32e4b15bf2d79 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:28.616 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.614+0000 7f48f8888700 1 -- 172.21.15.39:0/317707629 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f0011830 con 0x7f48f415c1a0 2023-11-28T11:59:28.616 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.614+0000 7f48f8888700 1 -- 172.21.15.39:0/317707629 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f0011990 con 0x7f48f415c1a0 2023-11-28T11:59:28.616 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.614+0000 7f48f8888700 1 -- 172.21.15.39:0/317707629 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f0011d20 con 0x7f48f415c1a0 2023-11-28T11:59:28.617 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.614+0000 7f48fa88c700 1 -- 172.21.15.39:0/317707629 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48f415c1a0 msgr2=0x7f48f406c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:28.617 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.614+0000 7f48fa88c700 1 --2- 172.21.15.39:0/317707629 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48f415c1a0 0x7f48f406c8b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f48f0009880 tx=0x7f48f0009b90 comp rx=0 tx=0).stop 2023-11-28T11:59:28.617 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.614+0000 7f48fa88c700 1 -- 172.21.15.39:0/317707629 shutdown_connections 2023-11-28T11:59:28.617 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.614+0000 7f48fa88c700 1 --2- 172.21.15.39:0/317707629 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48f415c1a0 0x7f48f406c8b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.618 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.614+0000 7f48fa88c700 1 -- 172.21.15.39:0/317707629 >> 172.21.15.39:0/317707629 conn(0x7f48f40b0f80 msgr2=0x7f48f40ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:28.618 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.614+0000 7f48fa88c700 1 -- 172.21.15.39:0/317707629 shutdown_connections 2023-11-28T11:59:28.618 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.614+0000 7f48fa88c700 1 -- 172.21.15.39:0/317707629 wait complete. 2023-11-28T11:59:28.620 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.618+0000 7f48fa88c700 1 Processor -- start 2023-11-28T11:59:28.621 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.618+0000 7f48fa88c700 1 -- start start 2023-11-28T11:59:28.622 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.618+0000 7f48fa88c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48f4070790 0x7f48f4157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:28.622 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.618+0000 7f48fa88c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48f40cdeb0 0x7f48f40c5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:28.622 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.618+0000 7f48fa88c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48f415c1a0 0x7f48f40c5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:28.622 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.618+0000 7f48fa88c700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f41578d0 con 0x7f48f40cdeb0 2023-11-28T11:59:28.622 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.618+0000 7f48fa88c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f41f1ad0 con 0x7f48f4070790 2023-11-28T11:59:28.622 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.618+0000 7f48fa88c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f41f2af0 con 0x7f48f415c1a0 2023-11-28T11:59:28.623 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.618+0000 7f48f9089700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48f40cdeb0 0x7f48f40c5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:28.624 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.618+0000 7f48f9089700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48f40cdeb0 0x7f48f40c5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54522/0 (socket says 172.21.15.39:54522) 2023-11-28T11:59:28.624 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.618+0000 7f48f9089700 1 -- 172.21.15.39:0/1853610046 learned_addr learned my addr 172.21.15.39:0/1853610046 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:28.624 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.618+0000 7f48f988a700 1 --2- 172.21.15.39:0/1853610046 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48f4070790 0x7f48f4157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:28.624 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.618+0000 7f48fa08b700 1 --2- 172.21.15.39:0/1853610046 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48f415c1a0 0x7f48f40c5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:28.624 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.618+0000 7f48f9089700 1 -- 172.21.15.39:0/1853610046 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48f415c1a0 msgr2=0x7f48f40c5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:28.624 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.618+0000 7f48f9089700 1 --2- 172.21.15.39:0/1853610046 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48f415c1a0 0x7f48f40c5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.624 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.618+0000 7f48f9089700 1 -- 172.21.15.39:0/1853610046 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48f4070790 msgr2=0x7f48f4157390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:28.624 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.618+0000 7f48f9089700 1 --2- 172.21.15.39:0/1853610046 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48f4070790 0x7f48f4157390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.624 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.618+0000 7f48f9089700 1 -- 172.21.15.39:0/1853610046 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f00094b0 con 0x7f48f40cdeb0 2023-11-28T11:59:28.625 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.618+0000 7f48f9089700 1 --2- 172.21.15.39:0/1853610046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48f40cdeb0 0x7f48f40c5ab0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f48e400c500 tx=0x7f48e400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:28.625 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.622+0000 7f48ea7fc700 1 -- 172.21.15.39:0/1853610046 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e4005d90 con 0x7f48f40cdeb0 2023-11-28T11:59:28.625 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.622+0000 7f48ea7fc700 1 -- 172.21.15.39:0/1853610046 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e40070d0 con 0x7f48f40cdeb0 2023-11-28T11:59:28.625 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.622+0000 7f48fa88c700 1 -- 172.21.15.39:0/1853610046 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48f406cdf0 con 0x7f48f40cdeb0 2023-11-28T11:59:28.626 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.622+0000 7f48ea7fc700 1 -- 172.21.15.39:0/1853610046 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e4007460 con 0x7f48f40cdeb0 2023-11-28T11:59:28.626 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.622+0000 7f48fa88c700 1 -- 172.21.15.39:0/1853610046 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48f40cc780 con 0x7f48f40cdeb0 2023-11-28T11:59:28.626 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.622+0000 7f48fa88c700 1 -- 172.21.15.39:0/1853610046 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48f415c570 con 0x7f48f40cdeb0 2023-11-28T11:59:28.628 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.622+0000 7f48ea7fc700 1 -- 172.21.15.39:0/1853610046 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f48e4019030 con 0x7f48f40cdeb0 2023-11-28T11:59:28.630 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.626+0000 7f48ea7fc700 1 --2- 172.21.15.39:0/1853610046 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f48d8064ee0 0x7f48d8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:28.630 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.626+0000 7f48ea7fc700 1 -- 172.21.15.39:0/1853610046 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f48e40813c0 con 0x7f48f40cdeb0 2023-11-28T11:59:28.630 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.626+0000 7f48f988a700 1 --2- 172.21.15.39:0/1853610046 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f48d8064ee0 0x7f48d8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:28.632 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.626+0000 7f48f988a700 1 --2- 172.21.15.39:0/1853610046 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f48d8064ee0 0x7f48d8067390 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f48f00090b0 tx=0x7f48f001c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:28.635 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.630+0000 7f48ea7fc700 1 -- 172.21.15.39:0/1853610046 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f48e404f330 con 0x7f48f40cdeb0 2023-11-28T11:59:28.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.802+0000 7f48fa88c700 1 -- 172.21.15.39:0/1853610046 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48f4066d70 con 0x7f48f40cdeb0 2023-11-28T11:59:28.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.806+0000 7f48ea7fc700 1 -- 172.21.15.39:0/1853610046 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+18084 (secure 0 0 0) 0x7f48e4052950 con 0x7f48f40cdeb0 2023-11-28T11:59:28.811 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:59:28.811 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":58,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:58:52.640486+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:58:50.082546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-28T11:58:50.610241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:59:28.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.810+0000 7f48fa88c700 1 -- 172.21.15.39:0/1853610046 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f48d8064ee0 msgr2=0x7f48d8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:28.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.810+0000 7f48fa88c700 1 --2- 172.21.15.39:0/1853610046 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f48d8064ee0 0x7f48d8067390 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f48f00090b0 tx=0x7f48f001c040 comp rx=0 tx=0).stop 2023-11-28T11:59:28.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.810+0000 7f48fa88c700 1 -- 172.21.15.39:0/1853610046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48f40cdeb0 msgr2=0x7f48f40c5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:28.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.810+0000 7f48fa88c700 1 --2- 172.21.15.39:0/1853610046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48f40cdeb0 0x7f48f40c5ab0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f48e400c500 tx=0x7f48e400c810 comp rx=0 tx=0).stop 2023-11-28T11:59:28.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.810+0000 7f48fa88c700 1 -- 172.21.15.39:0/1853610046 shutdown_connections 2023-11-28T11:59:28.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.810+0000 7f48fa88c700 1 --2- 172.21.15.39:0/1853610046 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48f415c1a0 0x7f48f40c5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.810+0000 7f48fa88c700 1 --2- 172.21.15.39:0/1853610046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48f40cdeb0 0x7f48f40c5ab0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.810+0000 7f48fa88c700 1 --2- 172.21.15.39:0/1853610046 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f48d8064ee0 0x7f48d8067390 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.810+0000 7f48fa88c700 1 --2- 172.21.15.39:0/1853610046 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48f4070790 0x7f48f4157390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.810+0000 7f48fa88c700 1 -- 172.21.15.39:0/1853610046 >> 172.21.15.39:0/1853610046 conn(0x7f48f40b0f80 msgr2=0x7f48f415fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:28.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.810+0000 7f48fa88c700 1 -- 172.21.15.39:0/1853610046 shutdown_connections 2023-11-28T11:59:28.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:28.810+0000 7f48fa88c700 1 -- 172.21.15.39:0/1853610046 wait complete. 2023-11-28T11:59:28.838 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T11:59:28.838 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:59:29.024 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.018+0000 7f139c88c700 1 Processor -- start 2023-11-28T11:59:29.024 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.018+0000 7f139c88c700 1 -- start start 2023-11-28T11:59:29.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.022+0000 7f139c88c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1398071aa0 0x7f139806d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:29.026 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.022+0000 7f139c88c700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1398069e00 0x7f139806a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:29.026 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.022+0000 7f139c88c700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f139806c600 con 0x7f139815c640 2023-11-28T11:59:29.026 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.022+0000 7f139c88c700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f139806cef0 con 0x7f1398069e00 2023-11-28T11:59:29.026 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.022+0000 7f139c88c700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13980d38f0 con 0x7f1398071aa0 2023-11-28T11:59:29.027 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.022+0000 7f1396ffd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1398071aa0 0x7f139806d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:29.027 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.022+0000 7f1397fff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1398069e00 0x7f139806a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:29.027 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.022+0000 7f1396ffd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1398071aa0 0x7f139806d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:48332/0 (socket says 172.21.15.39:48332) 2023-11-28T11:59:29.027 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.022+0000 7f1396ffd700 1 -- 172.21.15.39:0/530598549 learned_addr learned my addr 172.21.15.39:0/530598549 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:29.027 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.022+0000 7f13977fe700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f139815c640 0x7f13980d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:49666/0 (socket says 172.21.15.39:49666) 2023-11-28T11:59:29.027 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.022+0000 7f1396ffd700 1 -- 172.21.15.39:0/530598549 >> v2:172.21.15.39:3300/0 conn(0x7f1398069e00 msgr2=0x7f139806a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:29.027 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.022+0000 7f1396ffd700 1 --2- 172.21.15.39:0/530598549 >> v2:172.21.15.39:3300/0 conn(0x7f1398069e00 0x7f139806a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:29.027 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.022+0000 7f1396ffd700 1 -- 172.21.15.39:0/530598549 >> v1:172.21.15.184:6789/0 conn(0x7f139815c640 legacy=0x7f13980d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:29.028 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.022+0000 7f1396ffd700 1 -- 172.21.15.39:0/530598549 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13980722f0 con 0x7f1398071aa0 2023-11-28T11:59:29.028 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.022+0000 7f1396ffd700 1 --2- 172.21.15.39:0/530598549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1398071aa0 0x7f139806d310 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1398070e70 tx=0x7f138c009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3eb15708decd8735 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:29.028 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.022+0000 7f13967fc700 1 -- 172.21.15.39:0/530598549 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138c011830 con 0x7f1398071aa0 2023-11-28T11:59:29.029 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.022+0000 7f13967fc700 1 -- 172.21.15.39:0/530598549 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f138c011990 con 0x7f1398071aa0 2023-11-28T11:59:29.029 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.022+0000 7f13967fc700 1 -- 172.21.15.39:0/530598549 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138c011d20 con 0x7f1398071aa0 2023-11-28T11:59:29.029 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.026+0000 7f139c88c700 1 -- 172.21.15.39:0/530598549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1398071aa0 msgr2=0x7f139806d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:29.029 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.026+0000 7f139c88c700 1 --2- 172.21.15.39:0/530598549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1398071aa0 0x7f139806d310 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1398070e70 tx=0x7f138c009bf0 comp rx=0 tx=0).stop 2023-11-28T11:59:29.029 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.026+0000 7f139c88c700 1 -- 172.21.15.39:0/530598549 shutdown_connections 2023-11-28T11:59:29.029 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.026+0000 7f139c88c700 1 --2- 172.21.15.39:0/530598549 >> v2:172.21.15.39:3300/0 conn(0x7f1398069e00 0x7f139806a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:29.029 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.026+0000 7f139c88c700 1 --2- 172.21.15.39:0/530598549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1398071aa0 0x7f139806d310 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:29.029 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.026+0000 7f139c88c700 1 -- 172.21.15.39:0/530598549 >> 172.21.15.39:0/530598549 conn(0x7f13980b6520 msgr2=0x7f1398071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:29.029 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.026+0000 7f139c88c700 1 -- 172.21.15.39:0/530598549 shutdown_connections 2023-11-28T11:59:29.029 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.026+0000 7f139c88c700 1 -- 172.21.15.39:0/530598549 wait complete. 2023-11-28T11:59:29.030 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.026+0000 7f139c88c700 1 Processor -- start 2023-11-28T11:59:29.031 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.026+0000 7f139c88c700 1 -- start start 2023-11-28T11:59:29.032 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.030+0000 7f139c88c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1398069e00 0x7f13980c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:29.032 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.030+0000 7f139c88c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1398071aa0 0x7f13980ce840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:29.032 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.030+0000 7f139c88c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f139815c640 0x7f13981f11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:29.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.030+0000 7f139c88c700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13980cf1b0 con 0x7f139815c640 2023-11-28T11:59:29.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.030+0000 7f139c88c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13980cf490 con 0x7f1398071aa0 2023-11-28T11:59:29.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.030+0000 7f139c88c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13980cf770 con 0x7f1398069e00 2023-11-28T11:59:29.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.030+0000 7f1397fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f139815c640 0x7f13981f11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:29.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.030+0000 7f1397fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f139815c640 0x7f13981f11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54532/0 (socket says 172.21.15.39:54532) 2023-11-28T11:59:29.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.030+0000 7f1397fff700 1 -- 172.21.15.39:0/2276549629 learned_addr learned my addr 172.21.15.39:0/2276549629 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:29.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.030+0000 7f13977fe700 1 --2- 172.21.15.39:0/2276549629 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1398069e00 0x7f13980c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:29.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.030+0000 7f1396ffd700 1 --2- 172.21.15.39:0/2276549629 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1398071aa0 0x7f13980ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:29.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.030+0000 7f1397fff700 1 -- 172.21.15.39:0/2276549629 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1398069e00 msgr2=0x7f13980c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:29.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.030+0000 7f1397fff700 1 --2- 172.21.15.39:0/2276549629 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1398069e00 0x7f13980c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:29.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.030+0000 7f1397fff700 1 -- 172.21.15.39:0/2276549629 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1398071aa0 msgr2=0x7f13980ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:29.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.030+0000 7f1397fff700 1 --2- 172.21.15.39:0/2276549629 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1398071aa0 0x7f13980ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:29.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.030+0000 7f1397fff700 1 -- 172.21.15.39:0/2276549629 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f138c009570 con 0x7f139815c640 2023-11-28T11:59:29.035 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.030+0000 7f1397fff700 1 --2- 172.21.15.39:0/2276549629 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f139815c640 0x7f13981f11a0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f139000efc0 tx=0x7f139000c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:29.035 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.030+0000 7f137ffff700 1 -- 172.21.15.39:0/2276549629 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139000cad0 con 0x7f139815c640 2023-11-28T11:59:29.035 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.030+0000 7f137ffff700 1 -- 172.21.15.39:0/2276549629 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139000f040 con 0x7f139815c640 2023-11-28T11:59:29.035 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.030+0000 7f139c88c700 1 -- 172.21.15.39:0/2276549629 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1398072010 con 0x7f139815c640 2023-11-28T11:59:29.035 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.030+0000 7f137ffff700 1 -- 172.21.15.39:0/2276549629 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139000ce70 con 0x7f139815c640 2023-11-28T11:59:29.036 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.030+0000 7f139c88c700 1 -- 172.21.15.39:0/2276549629 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f139815ca10 con 0x7f139815c640 2023-11-28T11:59:29.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.034+0000 7f139c88c700 1 -- 172.21.15.39:0/2276549629 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f139806c830 con 0x7f139815c640 2023-11-28T11:59:29.038 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.034+0000 7f137ffff700 1 -- 172.21.15.39:0/2276549629 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1390014480 con 0x7f139815c640 2023-11-28T11:59:29.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.034+0000 7f137ffff700 1 --2- 172.21.15.39:0/2276549629 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1384064ee0 0x7f1384067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:29.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.034+0000 7f137ffff700 1 -- 172.21.15.39:0/2276549629 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1390082890 con 0x7f139815c640 2023-11-28T11:59:29.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.034+0000 7f13977fe700 1 --2- 172.21.15.39:0/2276549629 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1384064ee0 0x7f1384067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:29.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.038+0000 7f13977fe700 1 --2- 172.21.15.39:0/2276549629 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1384064ee0 0x7f1384067390 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1388000f60 tx=0x7f1388007ef0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:29.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.042+0000 7f137ffff700 1 -- 172.21.15.39:0/2276549629 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1390050890 con 0x7f139815c640 2023-11-28T11:59:29.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.270+0000 7f139c88c700 1 -- 172.21.15.39:0/2276549629 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1398073cb0 con 0x7f139815c640 2023-11-28T11:59:29.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.274+0000 7f137ffff700 1 -- 172.21.15.39:0/2276549629 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4648 (secure 0 0 0) 0x7f1390053eb0 con 0x7f139815c640 2023-11-28T11:59:29.277 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:59:29.278 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5775,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3453450609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3453450609},{"type":"v1","addr":"172.21.15.39:6833","nonce":3453450609}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/697075022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":697075022},{"type":"v1","addr":"172.21.15.39:6835","nonce":697075022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5806,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1819593136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1819593136},{"type":"v1","addr":"172.21.15.184:6835","nonce":1819593136}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:58:51.635140+0000","modified":"2023-11-28T11:58:54.706764+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5809},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5809":{"gid":5809,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/367294936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":367294936},{"type":"v1","addr":"172.21.15.184:6837","nonce":367294936}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T11:59:29.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.274+0000 7f139c88c700 1 -- 172.21.15.39:0/2276549629 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1384064ee0 msgr2=0x7f1384067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:29.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.274+0000 7f139c88c700 1 --2- 172.21.15.39:0/2276549629 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1384064ee0 0x7f1384067390 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1388000f60 tx=0x7f1388007ef0 comp rx=0 tx=0).stop 2023-11-28T11:59:29.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.274+0000 7f139c88c700 1 -- 172.21.15.39:0/2276549629 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f139815c640 msgr2=0x7f13981f11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:29.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.274+0000 7f139c88c700 1 --2- 172.21.15.39:0/2276549629 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f139815c640 0x7f13981f11a0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f139000efc0 tx=0x7f139000c0c0 comp rx=0 tx=0).stop 2023-11-28T11:59:29.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.274+0000 7f139c88c700 1 -- 172.21.15.39:0/2276549629 shutdown_connections 2023-11-28T11:59:29.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.274+0000 7f139c88c700 1 --2- 172.21.15.39:0/2276549629 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f139815c640 0x7f13981f11a0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:29.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.274+0000 7f139c88c700 1 --2- 172.21.15.39:0/2276549629 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1384064ee0 0x7f1384067390 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:29.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.274+0000 7f139c88c700 1 --2- 172.21.15.39:0/2276549629 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1398071aa0 0x7f13980ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:29.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.274+0000 7f139c88c700 1 --2- 172.21.15.39:0/2276549629 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1398069e00 0x7f13980c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:29.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.274+0000 7f139c88c700 1 -- 172.21.15.39:0/2276549629 >> 172.21.15.39:0/2276549629 conn(0x7f13980b6520 msgr2=0x7f13980b1590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:29.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.274+0000 7f139c88c700 1 -- 172.21.15.39:0/2276549629 shutdown_connections 2023-11-28T11:59:29.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.278+0000 7f139c88c700 1 -- 172.21.15.39:0/2276549629 wait complete. 2023-11-28T11:59:29.283 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 24 2023-11-28T11:59:29.302 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:59:29.485 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.482+0000 7f5a2ad33700 1 Processor -- start 2023-11-28T11:59:29.485 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.482+0000 7f5a2ad33700 1 -- start start 2023-11-28T11:59:29.487 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.482+0000 7f5a2ad33700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5a24156b60 0x7f5a240cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:29.487 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.482+0000 7f5a2ad33700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5a241605b0 0x7f5a240ce000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:29.487 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.482+0000 7f5a2ad33700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a2406b0d0 con 0x7f5a24156790 2023-11-28T11:59:29.487 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.482+0000 7f5a2ad33700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a240ce540 con 0x7f5a241605b0 2023-11-28T11:59:29.487 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.482+0000 7f5a2ad33700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a2406b560 con 0x7f5a24156b60 2023-11-28T11:59:29.488 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.482+0000 7f5a292d0700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5a241605b0 0x7f5a240ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:29.488 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.482+0000 7f5a1bfff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5a24156b60 0x7f5a240cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:29.488 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.482+0000 7f5a1bfff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5a24156b60 0x7f5a240cc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:48354/0 (socket says 172.21.15.39:48354) 2023-11-28T11:59:29.488 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.482+0000 7f5a1bfff700 1 -- 172.21.15.39:0/3997824467 learned_addr learned my addr 172.21.15.39:0/3997824467 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:29.488 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.482+0000 7f5a292d0700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5a241605b0 0x7f5a240ce000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54548/0 (socket says 172.21.15.39:54548) 2023-11-28T11:59:29.488 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.486+0000 7f5a1bfff700 1 -- 172.21.15.39:0/3997824467 >> v2:172.21.15.39:3300/0 conn(0x7f5a241605b0 msgr2=0x7f5a240ce000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:29.489 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.486+0000 7f5a1bfff700 1 --2- 172.21.15.39:0/3997824467 >> v2:172.21.15.39:3300/0 conn(0x7f5a241605b0 0x7f5a240ce000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:29.489 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.486+0000 7f5a1bfff700 1 -- 172.21.15.39:0/3997824467 >> v1:172.21.15.184:6789/0 conn(0x7f5a24156790 legacy=0x7f5a2415fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:29.489 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.486+0000 7f5a1bfff700 1 -- 172.21.15.39:0/3997824467 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a240cc990 con 0x7f5a24156b60 2023-11-28T11:59:29.489 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.486+0000 7f5a1bfff700 1 --2- 172.21.15.39:0/3997824467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a24156b60 0x7f5a240cc290 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5a2415d900 tx=0x7f5a14009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a2b4b1bd7f4bf3e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:29.489 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.486+0000 7f5a1b7fe700 1 -- 172.21.15.39:0/3997824467 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a14011830 con 0x7f5a24156b60 2023-11-28T11:59:29.489 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.486+0000 7f5a1b7fe700 1 -- 172.21.15.39:0/3997824467 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a14011990 con 0x7f5a24156b60 2023-11-28T11:59:29.490 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.486+0000 7f5a1b7fe700 1 -- 172.21.15.39:0/3997824467 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a14011d20 con 0x7f5a24156b60 2023-11-28T11:59:29.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.486+0000 7f5a2ad33700 1 -- 172.21.15.39:0/3997824467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a24156b60 msgr2=0x7f5a240cc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:29.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.486+0000 7f5a2ad33700 1 --2- 172.21.15.39:0/3997824467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a24156b60 0x7f5a240cc290 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5a2415d900 tx=0x7f5a14009bf0 comp rx=0 tx=0).stop 2023-11-28T11:59:29.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.486+0000 7f5a2ad33700 1 -- 172.21.15.39:0/3997824467 shutdown_connections 2023-11-28T11:59:29.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.486+0000 7f5a2ad33700 1 --2- 172.21.15.39:0/3997824467 >> v2:172.21.15.39:3300/0 conn(0x7f5a241605b0 0x7f5a240ce000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:29.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.486+0000 7f5a2ad33700 1 --2- 172.21.15.39:0/3997824467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a24156b60 0x7f5a240cc290 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:29.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.486+0000 7f5a2ad33700 1 -- 172.21.15.39:0/3997824467 >> 172.21.15.39:0/3997824467 conn(0x7f5a240cf350 msgr2=0x7f5a240b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:29.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.486+0000 7f5a2ad33700 1 -- 172.21.15.39:0/3997824467 shutdown_connections 2023-11-28T11:59:29.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.486+0000 7f5a2ad33700 1 -- 172.21.15.39:0/3997824467 wait complete. 2023-11-28T11:59:29.493 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.490+0000 7f5a2ad33700 1 Processor -- start 2023-11-28T11:59:29.493 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.490+0000 7f5a2ad33700 1 -- start start 2023-11-28T11:59:29.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.490+0000 7f5a2ad33700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a24156790 0x7f5a240c48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:29.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.490+0000 7f5a2ad33700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a24156b60 0x7f5a24155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:29.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.490+0000 7f5a2ad33700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a241605b0 0x7f5a240afa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:29.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.490+0000 7f5a2ad33700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a24156180 con 0x7f5a24156790 2023-11-28T11:59:29.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.490+0000 7f5a2ad33700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a240aff50 con 0x7f5a241605b0 2023-11-28T11:59:29.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.490+0000 7f5a2ad33700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a240c4f00 con 0x7f5a24156b60 2023-11-28T11:59:29.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.490+0000 7f5a28acf700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a24156790 0x7f5a240c48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:29.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.490+0000 7f5a28acf700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a24156790 0x7f5a240c48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54552/0 (socket says 172.21.15.39:54552) 2023-11-28T11:59:29.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.490+0000 7f5a28acf700 1 -- 172.21.15.39:0/2480479858 learned_addr learned my addr 172.21.15.39:0/2480479858 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:29.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.494+0000 7f5a1bfff700 1 --2- 172.21.15.39:0/2480479858 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a24156b60 0x7f5a24155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:29.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.494+0000 7f5a292d0700 1 --2- 172.21.15.39:0/2480479858 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a241605b0 0x7f5a240afa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:29.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.494+0000 7f5a28acf700 1 -- 172.21.15.39:0/2480479858 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a24156b60 msgr2=0x7f5a24155c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:29.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.494+0000 7f5a28acf700 1 --2- 172.21.15.39:0/2480479858 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a24156b60 0x7f5a24155c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:29.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.494+0000 7f5a28acf700 1 -- 172.21.15.39:0/2480479858 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a241605b0 msgr2=0x7f5a240afa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:29.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.494+0000 7f5a28acf700 1 --2- 172.21.15.39:0/2480479858 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a241605b0 0x7f5a240afa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:29.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.494+0000 7f5a28acf700 1 -- 172.21.15.39:0/2480479858 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a14009570 con 0x7f5a24156790 2023-11-28T11:59:29.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.494+0000 7f5a292d0700 1 --2- 172.21.15.39:0/2480479858 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a241605b0 0x7f5a240afa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:29.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.494+0000 7f5a28acf700 1 --2- 172.21.15.39:0/2480479858 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a24156790 0x7f5a240c48b0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f5a2000c4e0 tx=0x7f5a2000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:29.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.494+0000 7f5a197fa700 1 -- 172.21.15.39:0/2480479858 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a200052d0 con 0x7f5a24156790 2023-11-28T11:59:29.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.494+0000 7f5a197fa700 1 -- 172.21.15.39:0/2480479858 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a20005430 con 0x7f5a24156790 2023-11-28T11:59:29.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.494+0000 7f5a2ad33700 1 -- 172.21.15.39:0/2480479858 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a2406aa80 con 0x7f5a24156790 2023-11-28T11:59:29.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.494+0000 7f5a197fa700 1 -- 172.21.15.39:0/2480479858 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a200055a0 con 0x7f5a24156790 2023-11-28T11:59:29.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.494+0000 7f5a2ad33700 1 -- 172.21.15.39:0/2480479858 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a2406a7a0 con 0x7f5a24156790 2023-11-28T11:59:29.500 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.494+0000 7f5a2ad33700 1 -- 172.21.15.39:0/2480479858 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a2406ad60 con 0x7f5a24156790 2023-11-28T11:59:29.502 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.498+0000 7f5a197fa700 1 -- 172.21.15.39:0/2480479858 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5a20019030 con 0x7f5a24156790 2023-11-28T11:59:29.503 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.498+0000 7f5a197fa700 1 --2- 172.21.15.39:0/2480479858 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5a10064f10 0x7f5a100673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:29.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.498+0000 7f5a197fa700 1 -- 172.21.15.39:0/2480479858 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f5a200813e0 con 0x7f5a24156790 2023-11-28T11:59:29.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.502+0000 7f5a1bfff700 1 --2- 172.21.15.39:0/2480479858 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5a10064f10 0x7f5a100673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:29.505 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.502+0000 7f5a1bfff700 1 --2- 172.21.15.39:0/2480479858 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5a10064f10 0x7f5a100673c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5a14000c00 tx=0x7f5a14008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:29.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.506+0000 7f5a197fa700 1 -- 172.21.15.39:0/2480479858 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5a2004f350 con 0x7f5a24156790 2023-11-28T11:59:29.720 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.714+0000 7f5a2ad33700 1 -- 172.21.15.39:0/2480479858 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a240726c0 con 0x7f5a24156790 2023-11-28T11:59:29.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.718+0000 7f5a197fa700 1 -- 172.21.15.39:0/2480479858 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4648 (secure 0 0 0) 0x7f5a20052970 con 0x7f5a24156790 2023-11-28T11:59:29.722 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:59:29.722 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5775,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3453450609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3453450609},{"type":"v1","addr":"172.21.15.39:6833","nonce":3453450609}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/697075022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":697075022},{"type":"v1","addr":"172.21.15.39:6835","nonce":697075022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5806,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1819593136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1819593136},{"type":"v1","addr":"172.21.15.184:6835","nonce":1819593136}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:58:51.635140+0000","modified":"2023-11-28T11:58:54.706764+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5809},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5809":{"gid":5809,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/367294936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":367294936},{"type":"v1","addr":"172.21.15.184:6837","nonce":367294936}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T11:59:29.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.718+0000 7f5a2ad33700 1 -- 172.21.15.39:0/2480479858 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5a10064f10 msgr2=0x7f5a100673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:29.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.718+0000 7f5a2ad33700 1 --2- 172.21.15.39:0/2480479858 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5a10064f10 0x7f5a100673c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5a14000c00 tx=0x7f5a14008030 comp rx=0 tx=0).stop 2023-11-28T11:59:29.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.718+0000 7f5a2ad33700 1 -- 172.21.15.39:0/2480479858 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a24156790 msgr2=0x7f5a240c48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:29.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.718+0000 7f5a2ad33700 1 --2- 172.21.15.39:0/2480479858 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a24156790 0x7f5a240c48b0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f5a2000c4e0 tx=0x7f5a2000c7f0 comp rx=0 tx=0).stop 2023-11-28T11:59:29.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.722+0000 7f5a2ad33700 1 -- 172.21.15.39:0/2480479858 shutdown_connections 2023-11-28T11:59:29.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.722+0000 7f5a2ad33700 1 --2- 172.21.15.39:0/2480479858 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5a10064f10 0x7f5a100673c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:29.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.722+0000 7f5a2ad33700 1 --2- 172.21.15.39:0/2480479858 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a241605b0 0x7f5a240afa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:29.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.722+0000 7f5a2ad33700 1 --2- 172.21.15.39:0/2480479858 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a24156b60 0x7f5a24155c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:29.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.722+0000 7f5a2ad33700 1 --2- 172.21.15.39:0/2480479858 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a24156790 0x7f5a240c48b0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:29.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.722+0000 7f5a2ad33700 1 -- 172.21.15.39:0/2480479858 >> 172.21.15.39:0/2480479858 conn(0x7f5a240cf350 msgr2=0x7f5a240b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:29.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.722+0000 7f5a2ad33700 1 -- 172.21.15.39:0/2480479858 shutdown_connections 2023-11-28T11:59:29.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.722+0000 7f5a2ad33700 1 -- 172.21.15.39:0/2480479858 wait complete. 2023-11-28T11:59:29.729 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 24 2023-11-28T11:59:29.746 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:59:29.930 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.922+0000 7f288775e700 1 Processor -- start 2023-11-28T11:59:29.930 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.922+0000 7f288775e700 1 -- start start 2023-11-28T11:59:29.930 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.926+0000 7f288775e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f2880163cb0 0x7f2880164cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:29.931 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.926+0000 7f288775e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f288006d4c0 0x7f288006a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:29.931 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.926+0000 7f288775e700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2880164080 con 0x7f28800cdfb0 2023-11-28T11:59:29.931 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.926+0000 7f288775e700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28800cc290 con 0x7f2880163cb0 2023-11-28T11:59:29.931 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.926+0000 7f288775e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2880069bf0 con 0x7f288006d4c0 2023-11-28T11:59:29.931 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.926+0000 7f28854fa700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f2880163cb0 0x7f2880164cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:29.931 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.926+0000 7f2884cf9700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f28800cdfb0 0x7f288006cdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:40266/0 (socket says 172.21.15.39:40266) 2023-11-28T11:59:29.931 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.926+0000 7f2884cf9700 1 -- 172.21.15.39:0/639371176 learned_addr learned my addr 172.21.15.39:0/639371176 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:59:29.931 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.926+0000 7f2885cfb700 1 --2- 172.21.15.39:0/639371176 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f288006d4c0 0x7f288006a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:29.931 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.926+0000 7f2877fff700 1 -- 172.21.15.39:0/639371176 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2684430112 0 0) 0x7f2880164080 con 0x7f28800cdfb0 2023-11-28T11:59:29.931 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.926+0000 7f2877fff700 1 -- 172.21.15.39:0/639371176 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f286c0035d0 con 0x7f28800cdfb0 2023-11-28T11:59:29.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.926+0000 7f28854fa700 1 -- 172.21.15.39:0/639371176 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f288006d4c0 msgr2=0x7f288006a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:29.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.926+0000 7f28854fa700 1 --2- 172.21.15.39:0/639371176 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f288006d4c0 0x7f288006a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:29.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.926+0000 7f28854fa700 1 -- 172.21.15.39:0/639371176 >> v1:172.21.15.39:6789/0 conn(0x7f28800cdfb0 legacy=0x7f288006cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:29.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.926+0000 7f28854fa700 1 -- 172.21.15.39:0/639371176 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28801651f0 con 0x7f2880163cb0 2023-11-28T11:59:29.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.926+0000 7f28854fa700 1 --2- 172.21.15.39:0/639371176 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2880163cb0 0x7f2880164cb0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f287c009850 tx=0x7f287c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b8917909cb26e00 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:29.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.930+0000 7f2877fff700 1 -- 172.21.15.39:0/639371176 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c011830 con 0x7f2880163cb0 2023-11-28T11:59:29.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.930+0000 7f2877fff700 1 -- 172.21.15.39:0/639371176 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287c011990 con 0x7f2880163cb0 2023-11-28T11:59:29.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.930+0000 7f2877fff700 1 -- 172.21.15.39:0/639371176 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c011d00 con 0x7f2880163cb0 2023-11-28T11:59:29.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.930+0000 7f288775e700 1 -- 172.21.15.39:0/639371176 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2880163cb0 msgr2=0x7f2880164cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:29.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.930+0000 7f288775e700 1 --2- 172.21.15.39:0/639371176 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2880163cb0 0x7f2880164cb0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f287c009850 tx=0x7f287c009b60 comp rx=0 tx=0).stop 2023-11-28T11:59:29.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.930+0000 7f288775e700 1 -- 172.21.15.39:0/639371176 shutdown_connections 2023-11-28T11:59:29.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.930+0000 7f288775e700 1 --2- 172.21.15.39:0/639371176 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f288006d4c0 0x7f288006a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:29.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.930+0000 7f288775e700 1 --2- 172.21.15.39:0/639371176 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2880163cb0 0x7f2880164cb0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:29.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.930+0000 7f288775e700 1 -- 172.21.15.39:0/639371176 >> 172.21.15.39:0/639371176 conn(0x7f28800cf350 msgr2=0x7f28800b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:29.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.930+0000 7f288775e700 1 -- 172.21.15.39:0/639371176 shutdown_connections 2023-11-28T11:59:29.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.930+0000 7f288775e700 1 -- 172.21.15.39:0/639371176 wait complete. 2023-11-28T11:59:29.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.934+0000 7f288775e700 1 Processor -- start 2023-11-28T11:59:29.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.934+0000 7f288775e700 1 -- start start 2023-11-28T11:59:29.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.934+0000 7f288775e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f288006d4c0 0x7f28800c2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:29.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.934+0000 7f288775e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f28800cdfb0 0x7f288015a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:29.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.934+0000 7f288775e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2880163cb0 0x7f28800ae3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:29.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.934+0000 7f288775e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28801f9c00 con 0x7f28800cdfb0 2023-11-28T11:59:29.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.934+0000 7f288775e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28800c2870 con 0x7f288006d4c0 2023-11-28T11:59:29.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.934+0000 7f288775e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28800c2590 con 0x7f2880163cb0 2023-11-28T11:59:29.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.934+0000 7f2884cf9700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f28800cdfb0 0x7f288015a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:29.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.934+0000 7f2884cf9700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f28800cdfb0 0x7f288015a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54570/0 (socket says 172.21.15.39:54570) 2023-11-28T11:59:29.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.934+0000 7f2884cf9700 1 -- 172.21.15.39:0/3625149924 learned_addr learned my addr 172.21.15.39:0/3625149924 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:29.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.934+0000 7f28854fa700 1 --2- 172.21.15.39:0/3625149924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f288006d4c0 0x7f28800c2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:29.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.934+0000 7f2885cfb700 1 --2- 172.21.15.39:0/3625149924 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2880163cb0 0x7f28800ae3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:29.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.938+0000 7f2884cf9700 1 -- 172.21.15.39:0/3625149924 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2880163cb0 msgr2=0x7f28800ae3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:29.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.938+0000 7f2884cf9700 1 --2- 172.21.15.39:0/3625149924 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2880163cb0 0x7f28800ae3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:29.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.938+0000 7f2884cf9700 1 -- 172.21.15.39:0/3625149924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f288006d4c0 msgr2=0x7f28800c2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:29.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.938+0000 7f2884cf9700 1 --2- 172.21.15.39:0/3625149924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f288006d4c0 0x7f28800c2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:29.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.938+0000 7f2884cf9700 1 -- 172.21.15.39:0/3625149924 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287c0094b0 con 0x7f28800cdfb0 2023-11-28T11:59:29.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.938+0000 7f2884cf9700 1 --2- 172.21.15.39:0/3625149924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f28800cdfb0 0x7f288015a160 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f287000c4f0 tx=0x7f287000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:29.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.938+0000 7f2875ffb700 1 -- 172.21.15.39:0/3625149924 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2870005d90 con 0x7f28800cdfb0 2023-11-28T11:59:29.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.938+0000 7f2875ffb700 1 -- 172.21.15.39:0/3625149924 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28700070d0 con 0x7f28800cdfb0 2023-11-28T11:59:29.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.938+0000 7f288775e700 1 -- 172.21.15.39:0/3625149924 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28800cc780 con 0x7f28800cdfb0 2023-11-28T11:59:29.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.938+0000 7f2875ffb700 1 -- 172.21.15.39:0/3625149924 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2870007440 con 0x7f28800cdfb0 2023-11-28T11:59:29.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.938+0000 7f288775e700 1 -- 172.21.15.39:0/3625149924 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28800cc4a0 con 0x7f28800cdfb0 2023-11-28T11:59:29.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.938+0000 7f288775e700 1 -- 172.21.15.39:0/3625149924 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2880069e40 con 0x7f28800cdfb0 2023-11-28T11:59:29.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.942+0000 7f2875ffb700 1 -- 172.21.15.39:0/3625149924 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2870019030 con 0x7f28800cdfb0 2023-11-28T11:59:29.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.942+0000 7f2875ffb700 1 --2- 172.21.15.39:0/3625149924 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2864064ee0 0x7f2864067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:29.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.942+0000 7f2875ffb700 1 -- 172.21.15.39:0/3625149924 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2870081270 con 0x7f28800cdfb0 2023-11-28T11:59:29.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.942+0000 7f28854fa700 1 --2- 172.21.15.39:0/3625149924 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2864064ee0 0x7f2864067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:29.949 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.946+0000 7f28854fa700 1 --2- 172.21.15.39:0/3625149924 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2864064ee0 0x7f2864067390 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f287c0090b0 tx=0x7f287c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:29.955 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:29.950+0000 7f2875ffb700 1 -- 172.21.15.39:0/3625149924 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f287004a400 con 0x7f28800cdfb0 2023-11-28T11:59:30.113 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:59:30.121 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:59:30.124 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.122+0000 7f288775e700 1 -- 172.21.15.39:0/3625149924 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28801f9d40 con 0x7f28800cdfb0 2023-11-28T11:59:30.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.122+0000 7f2875ffb700 1 -- 172.21.15.39:0/3625149924 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+18084 (secure 0 0 0) 0x7f28801f9d40 con 0x7f28800cdfb0 2023-11-28T11:59:30.128 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:59:30.128 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":58,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:58:52.640486+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:58:50.082546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-28T11:58:50.610241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:59:30.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.126+0000 7f288775e700 1 -- 172.21.15.39:0/3625149924 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2864064ee0 msgr2=0x7f2864067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:30.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.126+0000 7f288775e700 1 --2- 172.21.15.39:0/3625149924 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2864064ee0 0x7f2864067390 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f287c0090b0 tx=0x7f287c008030 comp rx=0 tx=0).stop 2023-11-28T11:59:30.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.130+0000 7f288775e700 1 -- 172.21.15.39:0/3625149924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f28800cdfb0 msgr2=0x7f288015a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:30.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.130+0000 7f288775e700 1 --2- 172.21.15.39:0/3625149924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f28800cdfb0 0x7f288015a160 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f287000c4f0 tx=0x7f287000c800 comp rx=0 tx=0).stop 2023-11-28T11:59:30.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.130+0000 7f288775e700 1 -- 172.21.15.39:0/3625149924 shutdown_connections 2023-11-28T11:59:30.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.130+0000 7f288775e700 1 --2- 172.21.15.39:0/3625149924 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2880163cb0 0x7f28800ae3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:30.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.130+0000 7f288775e700 1 --2- 172.21.15.39:0/3625149924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f28800cdfb0 0x7f288015a160 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:30.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.130+0000 7f288775e700 1 --2- 172.21.15.39:0/3625149924 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2864064ee0 0x7f2864067390 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:30.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.130+0000 7f288775e700 1 --2- 172.21.15.39:0/3625149924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f288006d4c0 0x7f28800c2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:30.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.130+0000 7f288775e700 1 -- 172.21.15.39:0/3625149924 >> 172.21.15.39:0/3625149924 conn(0x7f28800cf350 msgr2=0x7f28800af4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:30.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.130+0000 7f288775e700 1 -- 172.21.15.39:0/3625149924 shutdown_connections 2023-11-28T11:59:30.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.130+0000 7f288775e700 1 -- 172.21.15.39:0/3625149924 wait complete. 2023-11-28T11:59:30.157 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T11:59:30.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.382+0000 7efc581b1700 1 Processor -- start 2023-11-28T11:59:30.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.386+0000 7efc581b1700 1 -- start start 2023-11-28T11:59:30.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.386+0000 7efc581b1700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7efc5015d510 0x7efc500b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:30.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.386+0000 7efc581b1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc500b6030 0x7efc50070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:30.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.386+0000 7efc581b1700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc5015d080 con 0x7efc501534a0 2023-11-28T11:59:30.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.386+0000 7efc581b1700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc5015d970 con 0x7efc5015d510 2023-11-28T11:59:30.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.386+0000 7efc581b1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc50153870 con 0x7efc500b6030 2023-11-28T11:59:30.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.386+0000 7efc5574c700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7efc5015d510 0x7efc500b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:30.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.386+0000 7efc5574c700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7efc5015d510 0x7efc500b5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54574/0 (socket says 172.21.15.39:54574) 2023-11-28T11:59:30.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.386+0000 7efc5574c700 1 -- 172.21.15.39:0/3870319086 learned_addr learned my addr 172.21.15.39:0/3870319086 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:30.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.386+0000 7efc5674e700 1 --2- 172.21.15.39:0/3870319086 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc500b6030 0x7efc50070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:30.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.386+0000 7efc5574c700 1 -- 172.21.15.39:0/3870319086 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc500b6030 msgr2=0x7efc50070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:30.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.386+0000 7efc5574c700 1 --2- 172.21.15.39:0/3870319086 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc500b6030 0x7efc50070630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:30.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.386+0000 7efc5574c700 1 -- 172.21.15.39:0/3870319086 >> v1:172.21.15.184:6789/0 conn(0x7efc501534a0 legacy=0x7efc50160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:30.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.386+0000 7efc5574c700 1 -- 172.21.15.39:0/3870319086 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc500b6430 con 0x7efc5015d510 2023-11-28T11:59:30.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.390+0000 7efc5574c700 1 --2- 172.21.15.39:0/3870319086 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc5015d510 0x7efc500b5af0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7efc40009910 tx=0x7efc40009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d92d3b2aec62abb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:30.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.390+0000 7efc54f4b700 1 -- 172.21.15.39:0/3870319086 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4000ba60 con 0x7efc5015d510 2023-11-28T11:59:30.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.390+0000 7efc54f4b700 1 -- 172.21.15.39:0/3870319086 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4000bbc0 con 0x7efc5015d510 2023-11-28T11:59:30.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.390+0000 7efc54f4b700 1 -- 172.21.15.39:0/3870319086 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc40009e60 con 0x7efc5015d510 2023-11-28T11:59:30.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.390+0000 7efc581b1700 1 -- 172.21.15.39:0/3870319086 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc5015d510 msgr2=0x7efc500b5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:30.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.390+0000 7efc581b1700 1 --2- 172.21.15.39:0/3870319086 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc5015d510 0x7efc500b5af0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7efc40009910 tx=0x7efc40009c20 comp rx=0 tx=0).stop 2023-11-28T11:59:30.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.390+0000 7efc581b1700 1 -- 172.21.15.39:0/3870319086 shutdown_connections 2023-11-28T11:59:30.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.390+0000 7efc581b1700 1 --2- 172.21.15.39:0/3870319086 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc500b6030 0x7efc50070630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:30.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.390+0000 7efc581b1700 1 --2- 172.21.15.39:0/3870319086 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc5015d510 0x7efc500b5af0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:30.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.390+0000 7efc581b1700 1 -- 172.21.15.39:0/3870319086 >> 172.21.15.39:0/3870319086 conn(0x7efc5006bfc0 msgr2=0x7efc5006c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:30.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.390+0000 7efc581b1700 1 -- 172.21.15.39:0/3870319086 shutdown_connections 2023-11-28T11:59:30.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.390+0000 7efc581b1700 1 -- 172.21.15.39:0/3870319086 wait complete. 2023-11-28T11:59:30.397 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.394+0000 7efc581b1700 1 Processor -- start 2023-11-28T11:59:30.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.394+0000 7efc581b1700 1 -- start start 2023-11-28T11:59:30.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.394+0000 7efc581b1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc500b6030 0x7efc5014b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:30.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.394+0000 7efc581b1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc501534a0 0x7efc5014efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:30.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.394+0000 7efc581b1700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc5015d510 0x7efc5014f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:30.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.394+0000 7efc581b1700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5014be20 con 0x7efc5015d510 2023-11-28T11:59:30.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.394+0000 7efc581b1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5014c100 con 0x7efc500b6030 2023-11-28T11:59:30.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.394+0000 7efc581b1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc5014c840 con 0x7efc501534a0 2023-11-28T11:59:30.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.398+0000 7efc5674e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc5015d510 0x7efc5014f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:30.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.398+0000 7efc5674e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc5015d510 0x7efc5014f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54576/0 (socket says 172.21.15.39:54576) 2023-11-28T11:59:30.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.398+0000 7efc5674e700 1 -- 172.21.15.39:0/1471840751 learned_addr learned my addr 172.21.15.39:0/1471840751 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:30.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.398+0000 7efc5574c700 1 --2- 172.21.15.39:0/1471840751 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc501534a0 0x7efc5014efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:30.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.398+0000 7efc55f4d700 1 --2- 172.21.15.39:0/1471840751 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc500b6030 0x7efc5014b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:30.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.398+0000 7efc5674e700 1 -- 172.21.15.39:0/1471840751 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc501534a0 msgr2=0x7efc5014efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:30.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.398+0000 7efc5674e700 1 --2- 172.21.15.39:0/1471840751 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc501534a0 0x7efc5014efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:30.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.398+0000 7efc5674e700 1 -- 172.21.15.39:0/1471840751 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc500b6030 msgr2=0x7efc5014b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:30.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.398+0000 7efc5674e700 1 --2- 172.21.15.39:0/1471840751 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc500b6030 0x7efc5014b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:30.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.398+0000 7efc5674e700 1 -- 172.21.15.39:0/1471840751 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc40009570 con 0x7efc5015d510 2023-11-28T11:59:30.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.398+0000 7efc5674e700 1 --2- 172.21.15.39:0/1471840751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc5015d510 0x7efc5014f4f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7efc4800d800 tx=0x7efc4800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:30.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.398+0000 7efc467fc700 1 -- 172.21.15.39:0/1471840751 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc480125f0 con 0x7efc5015d510 2023-11-28T11:59:30.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.398+0000 7efc467fc700 1 -- 172.21.15.39:0/1471840751 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc48012790 con 0x7efc5015d510 2023-11-28T11:59:30.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.398+0000 7efc467fc700 1 -- 172.21.15.39:0/1471840751 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc48012b40 con 0x7efc5015d510 2023-11-28T11:59:30.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.398+0000 7efc581b1700 1 -- 172.21.15.39:0/1471840751 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc500b56a0 con 0x7efc5015d510 2023-11-28T11:59:30.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.398+0000 7efc581b1700 1 -- 172.21.15.39:0/1471840751 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc500b53c0 con 0x7efc5015d510 2023-11-28T11:59:30.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.402+0000 7efc581b1700 1 -- 172.21.15.39:0/1471840751 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc5015ca30 con 0x7efc5015d510 2023-11-28T11:59:30.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.402+0000 7efc467fc700 1 -- 172.21.15.39:0/1471840751 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7efc48012ca0 con 0x7efc5015d510 2023-11-28T11:59:30.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.402+0000 7efc467fc700 1 --2- 172.21.15.39:0/1471840751 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7efc34064f10 0x7efc340673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:30.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.402+0000 7efc467fc700 1 -- 172.21.15.39:0/1471840751 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7efc480820d0 con 0x7efc5015d510 2023-11-28T11:59:30.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.402+0000 7efc55f4d700 1 --2- 172.21.15.39:0/1471840751 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7efc34064f10 0x7efc340673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:30.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.406+0000 7efc55f4d700 1 --2- 172.21.15.39:0/1471840751 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7efc34064f10 0x7efc340673c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7efc4c00f290 tx=0x7efc4c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:30.414 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.410+0000 7efc467fc700 1 -- 172.21.15.39:0/1471840751 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7efc48050130 con 0x7efc5015d510 2023-11-28T11:59:30.631 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:30.622+0000 7efc581b1700 1 -- 172.21.15.39:0/1471840751 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7efc500726c0 con 0x7efc5015d510 2023-11-28T11:59:31.026 INFO:tasks.ceph.mon.a.smithi039.stderr:2023-11-28T11:59:31.022+0000 7ff4e35f9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T11:59:31.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.038+0000 7efc467fc700 1 -- 172.21.15.39:0/1471840751 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) v1 ==== 161+0+0 (secure 0 0 0) 0x7efc48053750 con 0x7efc5015d510 2023-11-28T11:59:31.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.042+0000 7efc581b1700 1 -- 172.21.15.39:0/1471840751 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7efc34064f10 msgr2=0x7efc340673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:31.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.042+0000 7efc581b1700 1 --2- 172.21.15.39:0/1471840751 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7efc34064f10 0x7efc340673c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7efc4c00f290 tx=0x7efc4c009040 comp rx=0 tx=0).stop 2023-11-28T11:59:31.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.042+0000 7efc581b1700 1 -- 172.21.15.39:0/1471840751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc5015d510 msgr2=0x7efc5014f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:31.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.042+0000 7efc581b1700 1 --2- 172.21.15.39:0/1471840751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc5015d510 0x7efc5014f4f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7efc4800d800 tx=0x7efc4800db10 comp rx=0 tx=0).stop 2023-11-28T11:59:31.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.042+0000 7efc581b1700 1 -- 172.21.15.39:0/1471840751 shutdown_connections 2023-11-28T11:59:31.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.042+0000 7efc581b1700 1 --2- 172.21.15.39:0/1471840751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc5015d510 0x7efc5014f4f0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:31.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.042+0000 7efc581b1700 1 --2- 172.21.15.39:0/1471840751 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc501534a0 0x7efc5014efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:31.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.042+0000 7efc581b1700 1 --2- 172.21.15.39:0/1471840751 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7efc34064f10 0x7efc340673c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:31.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.042+0000 7efc581b1700 1 --2- 172.21.15.39:0/1471840751 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc500b6030 0x7efc5014b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:31.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.042+0000 7efc581b1700 1 -- 172.21.15.39:0/1471840751 >> 172.21.15.39:0/1471840751 conn(0x7efc5006bfc0 msgr2=0x7efc500d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:31.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.042+0000 7efc581b1700 1 -- 172.21.15.39:0/1471840751 shutdown_connections 2023-11-28T11:59:31.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.046+0000 7efc581b1700 1 -- 172.21.15.39:0/1471840751 wait complete. 2023-11-28T11:59:31.053 INFO:teuthology.orchestra.run.smithi039.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T11:59:31.059 INFO:tasks.ceph.mds.b.smithi184.stderr: -4916> 2023-11-28T11:58:57.091+0000 7fc0706a1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T11:59:31.064 INFO:tasks.ceph.mds.b.smithi184.stderr: -2392> 2023-11-28T11:59:06.179+0000 7fc06ce9a700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5977=0-4194304@1} caps={5977=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5977 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x55e64a20db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-11-28T11:59:31.076 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-28T11:59:31.115 INFO:tasks.ceph.mds.b.smithi184.stdout:starting mds.b at 2023-11-28T11:59:31.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.266+0000 7fc24abbc700 1 Processor -- start 2023-11-28T11:59:31.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.270+0000 7fc24abbc700 1 -- start start 2023-11-28T11:59:31.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.270+0000 7fc24abbc700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc244070790 0x7fc244164fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:31.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.270+0000 7fc24abbc700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc24415a550 con 0x7fc2440b1640 2023-11-28T11:59:31.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.270+0000 7fc24abbc700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc24406b0a0 con 0x7fc2440b43a0 2023-11-28T11:59:31.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.270+0000 7fc24abbc700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2440caac0 con 0x7fc244070790 2023-11-28T11:59:31.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.270+0000 7fc2493b9700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fc2440b1640 0x7fc244070080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:40282/0 (socket says 172.21.15.39:40282) 2023-11-28T11:59:31.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.270+0000 7fc2493b9700 1 -- 172.21.15.39:0/2986222933 learned_addr learned my addr 172.21.15.39:0/2986222933 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:59:31.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.270+0000 7fc24a3bb700 1 --2- 172.21.15.39:0/2986222933 >> v2:172.21.15.184:3300/0 conn(0x7fc244070790 0x7fc244164fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:31.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.270+0000 7fc248bb8700 1 -- 172.21.15.39:0/2986222933 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2306401557 0 0) 0x7fc234001110 con 0x7fc2440b1640 2023-11-28T11:59:31.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.274+0000 7fc248bb8700 1 -- 172.21.15.39:0/2986222933 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2300035d0 con 0x7fc2440b1640 2023-11-28T11:59:31.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.274+0000 7fc248bb8700 1 -- 172.21.15.39:0/2986222933 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2988962744 0 0) 0x7fc24406b0a0 con 0x7fc2440b43a0 2023-11-28T11:59:31.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.274+0000 7fc248bb8700 1 -- 172.21.15.39:0/2986222933 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc234001110 con 0x7fc2440b43a0 2023-11-28T11:59:31.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.274+0000 7fc248bb8700 1 -- 172.21.15.39:0/2986222933 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2240782664 0 0) 0x7fc2300035d0 con 0x7fc2440b1640 2023-11-28T11:59:31.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.274+0000 7fc248bb8700 1 -- 172.21.15.39:0/2986222933 >> v2:172.21.15.184:3300/0 conn(0x7fc244070790 msgr2=0x7fc244164fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:31.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.274+0000 7fc248bb8700 1 --2- 172.21.15.39:0/2986222933 >> v2:172.21.15.184:3300/0 conn(0x7fc244070790 0x7fc244164fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:31.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.274+0000 7fc248bb8700 1 -- 172.21.15.39:0/2986222933 >> v1:172.21.15.184:6789/0 conn(0x7fc2440b43a0 legacy=0x7fc24415e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:31.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.274+0000 7fc248bb8700 1 -- 172.21.15.39:0/2986222933 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2440cada0 con 0x7fc2440b1640 2023-11-28T11:59:31.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.274+0000 7fc248bb8700 1 -- 172.21.15.39:0/2986222933 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4013383302 0 0) 0x7fc234001800 con 0x7fc2440b1640 2023-11-28T11:59:31.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.274+0000 7fc248bb8700 1 -- 172.21.15.39:0/2986222933 >> v1:172.21.15.39:6789/0 conn(0x7fc2440b1640 legacy=0x7fc244070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:31.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.274+0000 7fc248bb8700 1 --2- 172.21.15.39:0/2986222933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc230004c10 0x7fc230005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:31.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.274+0000 7fc248bb8700 1 --2- 172.21.15.39:0/2986222933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc230003810 0x7fc230003c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:31.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.274+0000 7fc248bb8700 1 --2- 172.21.15.39:0/2986222933 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2300041c0 0x7fc23000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:31.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.274+0000 7fc248bb8700 1 -- 172.21.15.39:0/2986222933 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2440caac0 con 0x7fc230004c10 2023-11-28T11:59:31.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.274+0000 7fc248bb8700 1 -- 172.21.15.39:0/2986222933 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23000c130 con 0x7fc230003810 2023-11-28T11:59:31.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.274+0000 7fc248bb8700 1 -- 172.21.15.39:0/2986222933 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc23000c2f0 con 0x7fc2300041c0 2023-11-28T11:59:31.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.274+0000 7fc249bba700 1 --2- 172.21.15.39:0/2986222933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc230004c10 0x7fc230005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:31.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.274+0000 7fc2493b9700 1 --2- 172.21.15.39:0/2986222933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc230003810 0x7fc230003c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:31.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.274+0000 7fc24a3bb700 1 --2- 172.21.15.39:0/2986222933 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2300041c0 0x7fc23000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:31.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.274+0000 7fc249bba700 1 -- 172.21.15.39:0/2986222933 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2300041c0 msgr2=0x7fc23000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:31.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.274+0000 7fc249bba700 1 --2- 172.21.15.39:0/2986222933 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2300041c0 0x7fc23000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:31.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.274+0000 7fc249bba700 1 -- 172.21.15.39:0/2986222933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc230003810 msgr2=0x7fc230003c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:31.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.274+0000 7fc249bba700 1 --2- 172.21.15.39:0/2986222933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc230003810 0x7fc230003c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:31.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.274+0000 7fc249bba700 1 -- 172.21.15.39:0/2986222933 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2300035d0 con 0x7fc230004c10 2023-11-28T11:59:31.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.274+0000 7fc24a3bb700 1 -- 172.21.15.39:0/2986222933 reap_dead start 2023-11-28T11:59:31.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.274+0000 7fc2493b9700 1 --2- 172.21.15.39:0/2986222933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc230003810 0x7fc230003c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:31.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.274+0000 7fc249bba700 1 --2- 172.21.15.39:0/2986222933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc230004c10 0x7fc230005000 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fc240002230 tx=0x7fc2300058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40bcfbe36b87419e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:31.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.274+0000 7fc248bb8700 1 -- 172.21.15.39:0/2986222933 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc240001f30 con 0x7fc230004c10 2023-11-28T11:59:31.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.274+0000 7fc248bb8700 1 -- 172.21.15.39:0/2986222933 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc24000ce20 con 0x7fc230004c10 2023-11-28T11:59:31.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.274+0000 7fc248bb8700 1 -- 172.21.15.39:0/2986222933 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc240003c60 con 0x7fc230004c10 2023-11-28T11:59:31.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.278+0000 7fc24abbc700 1 -- 172.21.15.39:0/2986222933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc230004c10 msgr2=0x7fc230005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:31.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.278+0000 7fc24abbc700 1 --2- 172.21.15.39:0/2986222933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc230004c10 0x7fc230005000 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fc240002230 tx=0x7fc2300058a0 comp rx=0 tx=0).stop 2023-11-28T11:59:31.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.278+0000 7fc24abbc700 1 -- 172.21.15.39:0/2986222933 shutdown_connections 2023-11-28T11:59:31.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.278+0000 7fc24abbc700 1 --2- 172.21.15.39:0/2986222933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc230004c10 0x7fc230005000 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:31.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.278+0000 7fc24abbc700 1 -- 172.21.15.39:0/2986222933 >> 172.21.15.39:0/2986222933 conn(0x7fc2440b0f80 msgr2=0x7fc2440ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:31.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.278+0000 7fc24abbc700 1 -- 172.21.15.39:0/2986222933 shutdown_connections 2023-11-28T11:59:31.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.278+0000 7fc24abbc700 1 -- 172.21.15.39:0/2986222933 wait complete. 2023-11-28T11:59:31.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.278+0000 7fc24abbc700 1 Processor -- start 2023-11-28T11:59:31.284 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.278+0000 7fc24abbc700 1 -- start start 2023-11-28T11:59:31.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.282+0000 7fc24abbc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc230004c10 0x7fc2441eee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:31.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.282+0000 7fc24abbc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2440c33d0 0x7fc2440c3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:31.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.282+0000 7fc24abbc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2441f2b70 0x7fc2441f2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:31.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.282+0000 7fc24abbc700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2441f34e0 con 0x7fc230004c10 2023-11-28T11:59:31.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.282+0000 7fc24abbc700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2441f5eb0 con 0x7fc2440c33d0 2023-11-28T11:59:31.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.282+0000 7fc24abbc700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2440c2f40 con 0x7fc2441f2b70 2023-11-28T11:59:31.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.282+0000 7fc249bba700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc230004c10 0x7fc2441eee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:31.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.282+0000 7fc249bba700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc230004c10 0x7fc2441eee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54596/0 (socket says 172.21.15.39:54596) 2023-11-28T11:59:31.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.282+0000 7fc249bba700 1 -- 172.21.15.39:0/2112271201 learned_addr learned my addr 172.21.15.39:0/2112271201 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:31.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.282+0000 7fc24a3bb700 1 --2- 172.21.15.39:0/2112271201 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2441f2b70 0x7fc2441f2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:31.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.282+0000 7fc2493b9700 1 --2- 172.21.15.39:0/2112271201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2440c33d0 0x7fc2440c3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:31.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.282+0000 7fc249bba700 1 -- 172.21.15.39:0/2112271201 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2441f2b70 msgr2=0x7fc2441f2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:31.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.282+0000 7fc249bba700 1 --2- 172.21.15.39:0/2112271201 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2441f2b70 0x7fc2441f2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:31.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.282+0000 7fc249bba700 1 -- 172.21.15.39:0/2112271201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2440c33d0 msgr2=0x7fc2440c3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:31.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.282+0000 7fc249bba700 1 --2- 172.21.15.39:0/2112271201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2440c33d0 0x7fc2440c3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:31.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.282+0000 7fc249bba700 1 -- 172.21.15.39:0/2112271201 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc24406b5d0 con 0x7fc230004c10 2023-11-28T11:59:31.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.282+0000 7fc2493b9700 1 --2- 172.21.15.39:0/2112271201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2440c33d0 0x7fc2440c3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:31.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.282+0000 7fc24a3bb700 1 --2- 172.21.15.39:0/2112271201 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2441f2b70 0x7fc2441f2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:31.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.282+0000 7fc249bba700 1 --2- 172.21.15.39:0/2112271201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc230004c10 0x7fc2441eee70 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc240005040 tx=0x7fc240001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:31.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.282+0000 7fc23a7fc700 1 -- 172.21.15.39:0/2112271201 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2400052e0 con 0x7fc230004c10 2023-11-28T11:59:31.289 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.282+0000 7fc23a7fc700 1 -- 172.21.15.39:0/2112271201 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc240005440 con 0x7fc230004c10 2023-11-28T11:59:31.289 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.282+0000 7fc23a7fc700 1 -- 172.21.15.39:0/2112271201 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2400057f0 con 0x7fc230004c10 2023-11-28T11:59:31.289 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.282+0000 7fc24abbc700 1 -- 172.21.15.39:0/2112271201 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc24406b2f0 con 0x7fc230004c10 2023-11-28T11:59:31.289 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.282+0000 7fc24abbc700 1 -- 172.21.15.39:0/2112271201 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2440ca7b0 con 0x7fc230004c10 2023-11-28T11:59:31.289 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.286+0000 7fc24abbc700 1 -- 172.21.15.39:0/2112271201 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc244073cb0 con 0x7fc230004c10 2023-11-28T11:59:31.290 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.286+0000 7fc23a7fc700 1 -- 172.21.15.39:0/2112271201 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc24002e070 con 0x7fc230004c10 2023-11-28T11:59:31.291 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.286+0000 7fc23a7fc700 1 --2- 172.21.15.39:0/2112271201 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc228064ee0 0x7fc228067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:31.291 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.286+0000 7fc23a7fc700 1 -- 172.21.15.39:0/2112271201 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6468+0+0 (secure 0 0 0) 0x7fc2400834e0 con 0x7fc230004c10 2023-11-28T11:59:31.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.286+0000 7fc2493b9700 1 --2- 172.21.15.39:0/2112271201 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc228064ee0 0x7fc228067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:31.293 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.290+0000 7fc2493b9700 1 --2- 172.21.15.39:0/2112271201 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc228064ee0 0x7fc228067390 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc2340010e0 tx=0x7fc234009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:31.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.294+0000 7fc23a7fc700 1 -- 172.21.15.39:0/2112271201 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc2400513f0 con 0x7fc230004c10 2023-11-28T11:59:31.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:31.506+0000 7fc24abbc700 1 -- 172.21.15.39:0/2112271201 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc244071090 con 0x7fc230004c10 2023-11-28T11:59:32.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.042+0000 7fc23a7fc700 1 -- 172.21.15.39:0/2112271201 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc240002090 con 0x7fc230004c10 2023-11-28T11:59:32.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.046+0000 7fc24abbc700 1 -- 172.21.15.39:0/2112271201 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc228064ee0 msgr2=0x7fc228067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:32.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.046+0000 7fc24abbc700 1 --2- 172.21.15.39:0/2112271201 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc228064ee0 0x7fc228067390 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc2340010e0 tx=0x7fc234009040 comp rx=0 tx=0).stop 2023-11-28T11:59:32.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.046+0000 7fc24abbc700 1 -- 172.21.15.39:0/2112271201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc230004c10 msgr2=0x7fc2441eee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:32.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.046+0000 7fc24abbc700 1 --2- 172.21.15.39:0/2112271201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc230004c10 0x7fc2441eee70 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc240005040 tx=0x7fc240001650 comp rx=0 tx=0).stop 2023-11-28T11:59:32.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.046+0000 7fc24abbc700 1 -- 172.21.15.39:0/2112271201 shutdown_connections 2023-11-28T11:59:32.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.046+0000 7fc24abbc700 1 --2- 172.21.15.39:0/2112271201 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2441f2b70 0x7fc2441f2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:32.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.046+0000 7fc24abbc700 1 --2- 172.21.15.39:0/2112271201 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc228064ee0 0x7fc228067390 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:32.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.046+0000 7fc24abbc700 1 --2- 172.21.15.39:0/2112271201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2440c33d0 0x7fc2440c3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:32.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.046+0000 7fc24abbc700 1 --2- 172.21.15.39:0/2112271201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc230004c10 0x7fc2441eee70 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:32.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.046+0000 7fc24abbc700 1 -- 172.21.15.39:0/2112271201 >> 172.21.15.39:0/2112271201 conn(0x7fc2440b0f80 msgr2=0x7fc2440b33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:32.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.046+0000 7fc24abbc700 1 -- 172.21.15.39:0/2112271201 shutdown_connections 2023-11-28T11:59:32.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.046+0000 7fc24abbc700 1 -- 172.21.15.39:0/2112271201 wait complete. 2023-11-28T11:59:32.077 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-28T11:59:32.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.270+0000 7f38cd041700 1 Processor -- start 2023-11-28T11:59:32.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.270+0000 7f38cd041700 1 -- start start 2023-11-28T11:59:32.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.274+0000 7f38cd041700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f38c815c6e0 0x7f38c8071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:32.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.274+0000 7f38cd041700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f38c8071fe0 0x7f38c8069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:32.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.274+0000 7f38cd041700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38c806a340 0x7f38c80b79a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:32.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.274+0000 7f38cd041700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c80d2800 con 0x7f38c815c6e0 2023-11-28T11:59:32.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.274+0000 7f38cd041700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c806a7c0 con 0x7f38c8071fe0 2023-11-28T11:59:32.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.274+0000 7f38cd041700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c815cab0 con 0x7f38c806a340 2023-11-28T11:59:32.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.274+0000 7f38c7fff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f38c815c6e0 0x7f38c8071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:32.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.274+0000 7f38c7fff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f38c815c6e0 0x7f38c8071aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54598/0 (socket says 172.21.15.39:54598) 2023-11-28T11:59:32.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.274+0000 7f38c7fff700 1 -- 172.21.15.39:0/2212888396 learned_addr learned my addr 172.21.15.39:0/2212888396 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:32.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.274+0000 7f38c77fe700 1 --2- 172.21.15.39:0/2212888396 >> v2:172.21.15.184:3300/0 conn(0x7f38c8071fe0 0x7f38c8069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:32.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.274+0000 7f38cc840700 1 --2- 172.21.15.39:0/2212888396 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38c806a340 0x7f38c80b79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:32.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.274+0000 7f38c7fff700 1 -- 172.21.15.39:0/2212888396 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38c806a340 msgr2=0x7f38c80b79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:32.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.274+0000 7f38c7fff700 1 --2- 172.21.15.39:0/2212888396 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38c806a340 0x7f38c80b79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:32.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.274+0000 7f38c7fff700 1 -- 172.21.15.39:0/2212888396 >> v2:172.21.15.184:3300/0 conn(0x7f38c8071fe0 msgr2=0x7f38c8069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:32.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.274+0000 7f38c7fff700 1 --2- 172.21.15.39:0/2212888396 >> v2:172.21.15.184:3300/0 conn(0x7f38c8071fe0 0x7f38c8069e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:32.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.274+0000 7f38c7fff700 1 -- 172.21.15.39:0/2212888396 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c80702d0 con 0x7f38c815c6e0 2023-11-28T11:59:32.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.274+0000 7f38c7fff700 1 --2- 172.21.15.39:0/2212888396 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38c815c6e0 0x7f38c8071aa0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f38c806f9b0 tx=0x7f38b8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66f6756d61566a5d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:32.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.274+0000 7f38c6ffd700 1 -- 172.21.15.39:0/2212888396 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b800b8a0 con 0x7f38c815c6e0 2023-11-28T11:59:32.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.274+0000 7f38c6ffd700 1 -- 172.21.15.39:0/2212888396 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b800ba00 con 0x7f38c815c6e0 2023-11-28T11:59:32.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.274+0000 7f38c6ffd700 1 -- 172.21.15.39:0/2212888396 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b800bd90 con 0x7f38c815c6e0 2023-11-28T11:59:32.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.274+0000 7f38cd041700 1 -- 172.21.15.39:0/2212888396 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38c815c6e0 msgr2=0x7f38c8071aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:32.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.274+0000 7f38cd041700 1 --2- 172.21.15.39:0/2212888396 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38c815c6e0 0x7f38c8071aa0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f38c806f9b0 tx=0x7f38b8009bf0 comp rx=0 tx=0).stop 2023-11-28T11:59:32.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.274+0000 7f38cd041700 1 -- 172.21.15.39:0/2212888396 shutdown_connections 2023-11-28T11:59:32.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.274+0000 7f38cd041700 1 --2- 172.21.15.39:0/2212888396 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38c806a340 0x7f38c80b79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:32.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.274+0000 7f38cd041700 1 --2- 172.21.15.39:0/2212888396 >> v2:172.21.15.184:3300/0 conn(0x7f38c8071fe0 0x7f38c8069e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:32.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.274+0000 7f38cd041700 1 --2- 172.21.15.39:0/2212888396 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38c815c6e0 0x7f38c8071aa0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:32.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.274+0000 7f38cd041700 1 -- 172.21.15.39:0/2212888396 >> 172.21.15.39:0/2212888396 conn(0x7f38c80b65b0 msgr2=0x7f38c8071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:32.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.274+0000 7f38cd041700 1 -- 172.21.15.39:0/2212888396 shutdown_connections 2023-11-28T11:59:32.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.274+0000 7f38cd041700 1 -- 172.21.15.39:0/2212888396 wait complete. 2023-11-28T11:59:32.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.278+0000 7f38cd041700 1 Processor -- start 2023-11-28T11:59:32.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.278+0000 7f38cd041700 1 -- start start 2023-11-28T11:59:32.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.282+0000 7f38cd041700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38c806a340 0x7f38c8099e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:32.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.282+0000 7f38cd041700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38c8071fe0 0x7f38c80cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:32.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.282+0000 7f38cd041700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38c815c6e0 0x7f38c80c4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:32.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.282+0000 7f38cd041700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c809a440 con 0x7f38c815c6e0 2023-11-28T11:59:32.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.282+0000 7f38cd041700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c809a720 con 0x7f38c806a340 2023-11-28T11:59:32.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.282+0000 7f38cd041700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c809aa00 con 0x7f38c8071fe0 2023-11-28T11:59:32.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.282+0000 7f38cc840700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38c815c6e0 0x7f38c80c4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:32.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.282+0000 7f38cc840700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38c815c6e0 0x7f38c80c4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54612/0 (socket says 172.21.15.39:54612) 2023-11-28T11:59:32.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.282+0000 7f38cc840700 1 -- 172.21.15.39:0/1997201968 learned_addr learned my addr 172.21.15.39:0/1997201968 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:32.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.282+0000 7f38c7fff700 1 --2- 172.21.15.39:0/1997201968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38c806a340 0x7f38c8099e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:32.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.282+0000 7f38c77fe700 1 --2- 172.21.15.39:0/1997201968 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38c8071fe0 0x7f38c80cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:32.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.282+0000 7f38cc840700 1 -- 172.21.15.39:0/1997201968 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38c8071fe0 msgr2=0x7f38c80cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:32.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.282+0000 7f38cc840700 1 --2- 172.21.15.39:0/1997201968 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38c8071fe0 0x7f38c80cf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:32.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.282+0000 7f38cc840700 1 -- 172.21.15.39:0/1997201968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38c806a340 msgr2=0x7f38c8099e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:32.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.282+0000 7f38cc840700 1 --2- 172.21.15.39:0/1997201968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38c806a340 0x7f38c8099e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:32.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.282+0000 7f38cc840700 1 -- 172.21.15.39:0/1997201968 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b8009570 con 0x7f38c815c6e0 2023-11-28T11:59:32.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.282+0000 7f38cc840700 1 --2- 172.21.15.39:0/1997201968 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38c815c6e0 0x7f38c80c4090 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f38c0007e60 tx=0x7f38c000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:32.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.282+0000 7f38c4ff9700 1 -- 172.21.15.39:0/1997201968 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c000ed30 con 0x7f38c815c6e0 2023-11-28T11:59:32.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.282+0000 7f38c4ff9700 1 -- 172.21.15.39:0/1997201968 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c0014420 con 0x7f38c815c6e0 2023-11-28T11:59:32.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.282+0000 7f38c4ff9700 1 -- 172.21.15.39:0/1997201968 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c00147d0 con 0x7f38c815c6e0 2023-11-28T11:59:32.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.282+0000 7f38cd041700 1 -- 172.21.15.39:0/1997201968 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c80d2cf0 con 0x7f38c815c6e0 2023-11-28T11:59:32.289 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.286+0000 7f38cd041700 1 -- 172.21.15.39:0/1997201968 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c80d2a10 con 0x7f38c815c6e0 2023-11-28T11:59:32.290 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.286+0000 7f38cd041700 1 -- 172.21.15.39:0/1997201968 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c80d2fd0 con 0x7f38c815c6e0 2023-11-28T11:59:32.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.286+0000 7f38c4ff9700 1 -- 172.21.15.39:0/1997201968 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f38c0012050 con 0x7f38c815c6e0 2023-11-28T11:59:32.293 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.290+0000 7f38c4ff9700 1 --2- 172.21.15.39:0/1997201968 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f38b4064ee0 0x7f38b4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:32.293 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.290+0000 7f38c4ff9700 1 -- 172.21.15.39:0/1997201968 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f38c00825f0 con 0x7f38c815c6e0 2023-11-28T11:59:32.294 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.290+0000 7f38c7fff700 1 --2- 172.21.15.39:0/1997201968 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f38b4064ee0 0x7f38b4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:32.295 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.290+0000 7f38c7fff700 1 --2- 172.21.15.39:0/1997201968 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f38b4064ee0 0x7f38b4067390 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f38b8000c00 tx=0x7f38b8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:32.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.294+0000 7f38c4ff9700 1 -- 172.21.15.39:0/1997201968 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f38c0050500 con 0x7f38c815c6e0 2023-11-28T11:59:32.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:32.466+0000 7f38cd041700 1 -- 172.21.15.39:0/1997201968 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f38c809aec0 con 0x7f38c815c6e0 2023-11-28T11:59:33.065 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.062+0000 7f38c4ff9700 1 -- 172.21.15.39:0/1997201968 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v60) v1 ==== 181+0+0 (secure 0 0 0) 0x7f38c0053b20 con 0x7f38c815c6e0 2023-11-28T11:59:33.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.066+0000 7f38cd041700 1 -- 172.21.15.39:0/1997201968 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f38b4064ee0 msgr2=0x7f38b4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:33.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.066+0000 7f38cd041700 1 --2- 172.21.15.39:0/1997201968 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f38b4064ee0 0x7f38b4067390 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f38b8000c00 tx=0x7f38b8008030 comp rx=0 tx=0).stop 2023-11-28T11:59:33.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.066+0000 7f38cd041700 1 -- 172.21.15.39:0/1997201968 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38c815c6e0 msgr2=0x7f38c80c4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:33.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.066+0000 7f38cd041700 1 --2- 172.21.15.39:0/1997201968 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38c815c6e0 0x7f38c80c4090 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f38c0007e60 tx=0x7f38c000e3c0 comp rx=0 tx=0).stop 2023-11-28T11:59:33.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.066+0000 7f38cd041700 1 -- 172.21.15.39:0/1997201968 shutdown_connections 2023-11-28T11:59:33.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.066+0000 7f38cd041700 1 --2- 172.21.15.39:0/1997201968 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38c815c6e0 0x7f38c80c4090 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:33.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.066+0000 7f38cd041700 1 --2- 172.21.15.39:0/1997201968 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38c8071fe0 0x7f38c80cf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:33.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.066+0000 7f38cd041700 1 --2- 172.21.15.39:0/1997201968 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f38b4064ee0 0x7f38b4067390 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:33.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.066+0000 7f38cd041700 1 --2- 172.21.15.39:0/1997201968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38c806a340 0x7f38c8099e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:33.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.066+0000 7f38cd041700 1 -- 172.21.15.39:0/1997201968 >> 172.21.15.39:0/1997201968 conn(0x7f38c80b65b0 msgr2=0x7f38c80d1310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:33.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.066+0000 7f38cd041700 1 -- 172.21.15.39:0/1997201968 shutdown_connections 2023-11-28T11:59:33.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.066+0000 7f38cd041700 1 -- 172.21.15.39:0/1997201968 wait complete. 2023-11-28T11:59:33.074 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_metadata' removed 2023-11-28T11:59:33.096 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-28T11:59:33.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.290+0000 7f36c8a45700 1 Processor -- start 2023-11-28T11:59:36.624 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.290+0000 7f36c8a45700 1 -- start start 2023-11-28T11:59:36.624 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.290+0000 7f36c8a45700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f36c415cf20 0x7f36c406f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:36.625 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.290+0000 7f36c8a45700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36c415d2f0 0x7f36c40b22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:36.625 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.294+0000 7f36c8a45700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36c415dcc0 con 0x7f36c40b2810 2023-11-28T11:59:36.625 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.294+0000 7f36c8a45700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36c406f710 con 0x7f36c415cf20 2023-11-28T11:59:36.625 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.294+0000 7f36c8a45700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c40b2c90 con 0x7f36c415d2f0 2023-11-28T11:59:36.625 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.294+0000 7f36c37fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f36c415cf20 0x7f36c406f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:36.648 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.294+0000 7f36c2ffd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36c415d2f0 0x7f36c40b22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:36.648 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.294+0000 7f36c37fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f36c415cf20 0x7f36c406f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54618/0 (socket says 172.21.15.39:54618) 2023-11-28T11:59:36.648 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.294+0000 7f36c2ffd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36c415d2f0 0x7f36c40b22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:50120/0 (socket says 172.21.15.39:50120) 2023-11-28T11:59:36.648 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.294+0000 7f36c37fe700 1 -- 172.21.15.39:0/3217151043 learned_addr learned my addr 172.21.15.39:0/3217151043 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:36.648 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.294+0000 7f36c2ffd700 1 -- 172.21.15.39:0/3217151043 >> v2:172.21.15.39:3300/0 conn(0x7f36c415cf20 msgr2=0x7f36c406f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:36.648 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.294+0000 7f36c2ffd700 1 --2- 172.21.15.39:0/3217151043 >> v2:172.21.15.39:3300/0 conn(0x7f36c415cf20 0x7f36c406f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:36.648 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.294+0000 7f36c2ffd700 1 -- 172.21.15.39:0/3217151043 >> v1:172.21.15.184:6789/0 conn(0x7f36c40b2810 legacy=0x7f36c40ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:36.648 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.294+0000 7f36c2ffd700 1 -- 172.21.15.39:0/3217151043 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c40b30e0 con 0x7f36c415d2f0 2023-11-28T11:59:36.648 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.294+0000 7f36c37fe700 1 --2- 172.21.15.39:0/3217151043 >> v2:172.21.15.39:3300/0 conn(0x7f36c415cf20 0x7f36c406f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:36.648 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.294+0000 7f36c2ffd700 1 --2- 172.21.15.39:0/3217151043 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36c415d2f0 0x7f36c40b22d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f36b8009850 tx=0x7f36b8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d349a3f3c232a9c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:36.648 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.294+0000 7f36c27fc700 1 -- 172.21.15.39:0/3217151043 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b8011830 con 0x7f36c415d2f0 2023-11-28T11:59:36.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.294+0000 7f36c27fc700 1 -- 172.21.15.39:0/3217151043 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b8011990 con 0x7f36c415d2f0 2023-11-28T11:59:36.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.294+0000 7f36c27fc700 1 -- 172.21.15.39:0/3217151043 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b8011d40 con 0x7f36c415d2f0 2023-11-28T11:59:36.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.298+0000 7f36c8a45700 1 -- 172.21.15.39:0/3217151043 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36c415d2f0 msgr2=0x7f36c40b22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:36.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.298+0000 7f36c8a45700 1 --2- 172.21.15.39:0/3217151043 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36c415d2f0 0x7f36c40b22d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f36b8009850 tx=0x7f36b8009b60 comp rx=0 tx=0).stop 2023-11-28T11:59:36.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.298+0000 7f36c8a45700 1 -- 172.21.15.39:0/3217151043 shutdown_connections 2023-11-28T11:59:36.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.298+0000 7f36c8a45700 1 --2- 172.21.15.39:0/3217151043 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36c415d2f0 0x7f36c40b22d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:36.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.298+0000 7f36c8a45700 1 --2- 172.21.15.39:0/3217151043 >> v2:172.21.15.39:3300/0 conn(0x7f36c415cf20 0x7f36c406f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:36.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.298+0000 7f36c8a45700 1 -- 172.21.15.39:0/3217151043 >> 172.21.15.39:0/3217151043 conn(0x7f36c406fd90 msgr2=0x7f36c4070160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:36.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.298+0000 7f36c8a45700 1 -- 172.21.15.39:0/3217151043 shutdown_connections 2023-11-28T11:59:36.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.298+0000 7f36c8a45700 1 -- 172.21.15.39:0/3217151043 wait complete. 2023-11-28T11:59:36.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.298+0000 7f36c8a45700 1 Processor -- start 2023-11-28T11:59:36.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.298+0000 7f36c8a45700 1 -- start start 2023-11-28T11:59:36.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.302+0000 7f36c8a45700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36c40b2810 0x7f36c40b5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:36.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.302+0000 7f36c8a45700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36c415cf20 0x7f36c4152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:36.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.302+0000 7f36c8a45700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f36c415d2f0 0x7f36c40b1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:36.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.302+0000 7f36c8a45700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c40b4390 con 0x7f36c415d2f0 2023-11-28T11:59:36.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.302+0000 7f36c8a45700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c40b4670 con 0x7f36c415cf20 2023-11-28T11:59:36.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.302+0000 7f36c8a45700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c40b4950 con 0x7f36c40b2810 2023-11-28T11:59:36.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.302+0000 7f36c3fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f36c415d2f0 0x7f36c40b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:36.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.302+0000 7f36c37fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36c40b2810 0x7f36c40b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:36.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.302+0000 7f36c3fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f36c415d2f0 0x7f36c40b1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54622/0 (socket says 172.21.15.39:54622) 2023-11-28T11:59:36.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.302+0000 7f36c3fff700 1 -- 172.21.15.39:0/3951475093 learned_addr learned my addr 172.21.15.39:0/3951475093 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:36.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.302+0000 7f36c2ffd700 1 --2- 172.21.15.39:0/3951475093 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36c415cf20 0x7f36c4152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:36.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.302+0000 7f36c3fff700 1 -- 172.21.15.39:0/3951475093 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36c40b2810 msgr2=0x7f36c40b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:36.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.302+0000 7f36c3fff700 1 --2- 172.21.15.39:0/3951475093 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36c40b2810 0x7f36c40b5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:36.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.302+0000 7f36c3fff700 1 -- 172.21.15.39:0/3951475093 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36c415cf20 msgr2=0x7f36c4152950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:36.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.302+0000 7f36c3fff700 1 --2- 172.21.15.39:0/3951475093 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36c415cf20 0x7f36c4152950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:36.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.302+0000 7f36c3fff700 1 -- 172.21.15.39:0/3951475093 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b4009570 con 0x7f36c415d2f0 2023-11-28T11:59:36.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.302+0000 7f36c3fff700 1 --2- 172.21.15.39:0/3951475093 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f36c415d2f0 0x7f36c40b1300 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f36bc00cb50 tx=0x7f36bc00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:36.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.302+0000 7f36abfff700 1 -- 172.21.15.39:0/3951475093 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36bc003c20 con 0x7f36c415d2f0 2023-11-28T11:59:36.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.302+0000 7f36c8a45700 1 -- 172.21.15.39:0/3951475093 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b80094b0 con 0x7f36c415d2f0 2023-11-28T11:59:36.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.302+0000 7f36abfff700 1 -- 172.21.15.39:0/3951475093 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36bc003d80 con 0x7f36c415d2f0 2023-11-28T11:59:36.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.302+0000 7f36abfff700 1 -- 172.21.15.39:0/3951475093 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36bc00aac0 con 0x7f36c415d2f0 2023-11-28T11:59:36.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.306+0000 7f36c8a45700 1 -- 172.21.15.39:0/3951475093 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36c40ce760 con 0x7f36c415d2f0 2023-11-28T11:59:36.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.306+0000 7f36c8a45700 1 -- 172.21.15.39:0/3951475093 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36c40ce4c0 con 0x7f36c415d2f0 2023-11-28T11:59:36.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.306+0000 7f36abfff700 1 -- 172.21.15.39:0/3951475093 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f36bc010050 con 0x7f36c415d2f0 2023-11-28T11:59:36.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.310+0000 7f36abfff700 1 --2- 172.21.15.39:0/3951475093 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f36b0064f10 0x7f36b00673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:36.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.310+0000 7f36abfff700 1 -- 172.21.15.39:0/3951475093 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6030+0+0 (secure 0 0 0) 0x7f36bc081d30 con 0x7f36c415d2f0 2023-11-28T11:59:36.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.310+0000 7f36c37fe700 1 --2- 172.21.15.39:0/3951475093 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f36b0064f10 0x7f36b00673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:36.652 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.310+0000 7f36c37fe700 1 --2- 172.21.15.39:0/3951475093 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f36b0064f10 0x7f36b00673c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f36b4006d50 tx=0x7f36b40092e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:36.652 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.314+0000 7f36abfff700 1 -- 172.21.15.39:0/3951475093 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f36bc04fe70 con 0x7f36c415d2f0 2023-11-28T11:59:36.652 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:33.498+0000 7f36c8a45700 1 -- 172.21.15.39:0/3951475093 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f36c40cea40 con 0x7f36c415d2f0 2023-11-28T11:59:36.652 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:34.070+0000 7f36abfff700 1 -- 172.21.15.39:0/3951475093 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v61) v1 ==== 169+0+0 (secure 0 0 0) 0x7f36bc053490 con 0x7f36c415d2f0 2023-11-28T11:59:36.652 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:34.074+0000 7f36c8a45700 1 -- 172.21.15.39:0/3951475093 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f36b0064f10 msgr2=0x7f36b00673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:36.652 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:34.074+0000 7f36c8a45700 1 --2- 172.21.15.39:0/3951475093 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f36b0064f10 0x7f36b00673c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f36b4006d50 tx=0x7f36b40092e0 comp rx=0 tx=0).stop 2023-11-28T11:59:36.652 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:34.074+0000 7f36c8a45700 1 -- 172.21.15.39:0/3951475093 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f36c415d2f0 msgr2=0x7f36c40b1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:36.652 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:34.074+0000 7f36c8a45700 1 --2- 172.21.15.39:0/3951475093 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f36c415d2f0 0x7f36c40b1300 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f36bc00cb50 tx=0x7f36bc00ce60 comp rx=0 tx=0).stop 2023-11-28T11:59:36.652 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:34.074+0000 7f36c8a45700 1 -- 172.21.15.39:0/3951475093 shutdown_connections 2023-11-28T11:59:36.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:34.074+0000 7f36c8a45700 1 --2- 172.21.15.39:0/3951475093 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f36c415d2f0 0x7f36c40b1300 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:36.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:34.074+0000 7f36c8a45700 1 --2- 172.21.15.39:0/3951475093 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f36b0064f10 0x7f36b00673c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:36.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:34.074+0000 7f36c8a45700 1 --2- 172.21.15.39:0/3951475093 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36c415cf20 0x7f36c4152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:36.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:34.074+0000 7f36c8a45700 1 --2- 172.21.15.39:0/3951475093 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36c40b2810 0x7f36c40b5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:36.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:34.074+0000 7f36c8a45700 1 -- 172.21.15.39:0/3951475093 >> 172.21.15.39:0/3951475093 conn(0x7f36c406fd90 msgr2=0x7f36c415b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:36.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:34.074+0000 7f36c8a45700 1 -- 172.21.15.39:0/3951475093 shutdown_connections 2023-11-28T11:59:36.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:34.074+0000 7f36c8a45700 1 -- 172.21.15.39:0/3951475093 wait complete. 2023-11-28T11:59:36.653 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_data' removed 2023-11-28T11:59:36.653 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-28T11:59:36.842 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.838+0000 7f09a9419700 1 Processor -- start 2023-11-28T11:59:36.843 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.838+0000 7f09a9419700 1 -- start start 2023-11-28T11:59:36.845 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.842+0000 7f09a9419700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f09a4069e00 0x7f09a406a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:36.845 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.842+0000 7f09a9419700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09a406c600 con 0x7f09a4071aa0 2023-11-28T11:59:36.845 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.842+0000 7f09a9419700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09a40722f0 con 0x7f09a415c640 2023-11-28T11:59:36.845 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.842+0000 7f09a9419700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09a406cef0 con 0x7f09a4069e00 2023-11-28T11:59:36.846 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.842+0000 7f09a27fc700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f09a4071aa0 0x7f09a406d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:40292/0 (socket says 172.21.15.39:40292) 2023-11-28T11:59:36.846 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.842+0000 7f09a27fc700 1 -- 172.21.15.39:0/1908586165 learned_addr learned my addr 172.21.15.39:0/1908586165 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:59:36.846 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.842+0000 7f09a37fe700 1 --2- 172.21.15.39:0/1908586165 >> v2:172.21.15.184:3300/0 conn(0x7f09a4069e00 0x7f09a406a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:36.846 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.842+0000 7f09a1ffb700 1 -- 172.21.15.39:0/1908586165 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2166618051 0 0) 0x7f09a406c600 con 0x7f09a4071aa0 2023-11-28T11:59:36.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.842+0000 7f09a1ffb700 1 -- 172.21.15.39:0/1908586165 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f098c0035d0 con 0x7f09a4071aa0 2023-11-28T11:59:36.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.842+0000 7f09a1ffb700 1 -- 172.21.15.39:0/1908586165 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2274015054 0 0) 0x7f09a40722f0 con 0x7f09a415c640 2023-11-28T11:59:36.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.842+0000 7f09a1ffb700 1 -- 172.21.15.39:0/1908586165 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09a406c600 con 0x7f09a415c640 2023-11-28T11:59:36.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.842+0000 7f09a37fe700 1 -- 172.21.15.39:0/1908586165 >> v1:172.21.15.184:6789/0 conn(0x7f09a415c640 legacy=0x7f09a40d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:36.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.842+0000 7f09a1ffb700 1 -- 172.21.15.39:0/1908586165 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1202519948 0 0) 0x7f098c0035d0 con 0x7f09a4071aa0 2023-11-28T11:59:36.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.842+0000 7f09a37fe700 1 -- 172.21.15.39:0/1908586165 >> v1:172.21.15.39:6789/0 conn(0x7f09a4071aa0 legacy=0x7f09a406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:36.848 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.842+0000 7f09a37fe700 1 -- 172.21.15.39:0/1908586165 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a406da20 con 0x7f09a4069e00 2023-11-28T11:59:36.848 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.846+0000 7f09a37fe700 1 --2- 172.21.15.39:0/1908586165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09a4069e00 0x7f09a406a280 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f099c009d90 tx=0x7f099c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=717f0c3d51febef1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:36.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.846+0000 7f09a1ffb700 1 -- 172.21.15.39:0/1908586165 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099c00e070 con 0x7f09a4069e00 2023-11-28T11:59:36.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.846+0000 7f09a1ffb700 1 -- 172.21.15.39:0/1908586165 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099c003a40 con 0x7f09a4069e00 2023-11-28T11:59:36.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.846+0000 7f09a1ffb700 1 -- 172.21.15.39:0/1908586165 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0998001670 con 0x7f09a4069e00 2023-11-28T11:59:36.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.846+0000 7f09a9419700 1 -- 172.21.15.39:0/1908586165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09a4069e00 msgr2=0x7f09a406a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:36.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.846+0000 7f09a9419700 1 --2- 172.21.15.39:0/1908586165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09a4069e00 0x7f09a406a280 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f099c009d90 tx=0x7f099c00b330 comp rx=0 tx=0).stop 2023-11-28T11:59:36.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.846+0000 7f09a9419700 1 -- 172.21.15.39:0/1908586165 shutdown_connections 2023-11-28T11:59:36.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.846+0000 7f09a9419700 1 --2- 172.21.15.39:0/1908586165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09a4069e00 0x7f09a406a280 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:36.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.846+0000 7f09a9419700 1 -- 172.21.15.39:0/1908586165 >> 172.21.15.39:0/1908586165 conn(0x7f09a40b6520 msgr2=0x7f09a4071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:36.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.846+0000 7f09a9419700 1 -- 172.21.15.39:0/1908586165 shutdown_connections 2023-11-28T11:59:36.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.846+0000 7f09a9419700 1 -- 172.21.15.39:0/1908586165 wait complete. 2023-11-28T11:59:36.852 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.846+0000 7f09a9419700 1 Processor -- start 2023-11-28T11:59:36.852 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.850+0000 7f09a9419700 1 -- start start 2023-11-28T11:59:36.853 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.850+0000 7f09a9419700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09a4069e00 0x7f09a41f4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:36.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.850+0000 7f09a9419700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f09a4071aa0 0x7f09a40b4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:36.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.850+0000 7f09a9419700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09a415c640 0x7f09a40b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:36.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.850+0000 7f09a9419700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a40d38f0 con 0x7f09a4069e00 2023-11-28T11:59:36.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.850+0000 7f09a9419700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a40cde40 con 0x7f09a415c640 2023-11-28T11:59:36.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.850+0000 7f09a9419700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a40ce120 con 0x7f09a4071aa0 2023-11-28T11:59:36.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.850+0000 7f09a2ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09a4069e00 0x7f09a41f4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:36.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.850+0000 7f09a2ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09a4069e00 0x7f09a41f4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54626/0 (socket says 172.21.15.39:54626) 2023-11-28T11:59:36.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.850+0000 7f09a2ffd700 1 -- 172.21.15.39:0/3501680838 learned_addr learned my addr 172.21.15.39:0/3501680838 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:36.855 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.850+0000 7f09a37fe700 1 --2- 172.21.15.39:0/3501680838 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09a415c640 0x7f09a40b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:36.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.850+0000 7f09a27fc700 1 --2- 172.21.15.39:0/3501680838 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f09a4071aa0 0x7f09a40b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:36.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.850+0000 7f09a2ffd700 1 -- 172.21.15.39:0/3501680838 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f09a4071aa0 msgr2=0x7f09a40b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:36.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.850+0000 7f09a2ffd700 1 --2- 172.21.15.39:0/3501680838 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f09a4071aa0 0x7f09a40b4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:36.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.850+0000 7f09a2ffd700 1 -- 172.21.15.39:0/3501680838 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09a415c640 msgr2=0x7f09a40b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:36.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.850+0000 7f09a2ffd700 1 --2- 172.21.15.39:0/3501680838 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09a415c640 0x7f09a40b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:36.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.850+0000 7f09a2ffd700 1 -- 172.21.15.39:0/3501680838 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f099c009a70 con 0x7f09a4069e00 2023-11-28T11:59:36.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.850+0000 7f09a37fe700 1 --2- 172.21.15.39:0/3501680838 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09a415c640 0x7f09a40b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:36.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.850+0000 7f09a2ffd700 1 --2- 172.21.15.39:0/3501680838 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09a4069e00 0x7f09a41f4630 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f099400c520 tx=0x7f099400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:36.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.850+0000 7f098b7fe700 1 -- 172.21.15.39:0/3501680838 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09940052d0 con 0x7f09a4069e00 2023-11-28T11:59:36.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.850+0000 7f098b7fe700 1 -- 172.21.15.39:0/3501680838 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0994005450 con 0x7f09a4069e00 2023-11-28T11:59:36.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.850+0000 7f098b7fe700 1 -- 172.21.15.39:0/3501680838 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09940038e0 con 0x7f09a4069e00 2023-11-28T11:59:36.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.850+0000 7f09a9419700 1 -- 172.21.15.39:0/3501680838 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09a4072010 con 0x7f09a4069e00 2023-11-28T11:59:36.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.850+0000 7f09a9419700 1 -- 172.21.15.39:0/3501680838 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09a415ca10 con 0x7f09a4069e00 2023-11-28T11:59:36.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.854+0000 7f09a9419700 1 -- 172.21.15.39:0/3501680838 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09a406c830 con 0x7f09a4069e00 2023-11-28T11:59:36.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.854+0000 7f098b7fe700 1 -- 172.21.15.39:0/3501680838 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0994019030 con 0x7f09a4069e00 2023-11-28T11:59:36.860 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.858+0000 7f098b7fe700 1 --2- 172.21.15.39:0/3501680838 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0990064ee0 0x7f0990067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:36.860 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.858+0000 7f098b7fe700 1 -- 172.21.15.39:0/3501680838 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f0994081110 con 0x7f09a4069e00 2023-11-28T11:59:36.861 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.858+0000 7f09a27fc700 1 --2- 172.21.15.39:0/3501680838 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0990064ee0 0x7f0990067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:36.862 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.858+0000 7f09a27fc700 1 --2- 172.21.15.39:0/3501680838 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0990064ee0 0x7f0990067390 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0998007fd0 tx=0x7f0998007a80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:36.867 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:36.862+0000 7f098b7fe700 1 -- 172.21.15.39:0/3501680838 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f099404f410 con 0x7f09a4069e00 2023-11-28T11:59:37.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.038+0000 7f09a9419700 1 -- 172.21.15.39:0/3501680838 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f09a4073cb0 con 0x7f09a4069e00 2023-11-28T11:59:37.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.046+0000 7f098b7fe700 1 -- 172.21.15.39:0/3501680838 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0994052a30 con 0x7f09a4069e00 2023-11-28T11:59:37.056 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.050+0000 7f09a9419700 1 -- 172.21.15.39:0/3501680838 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0990064ee0 msgr2=0x7f0990067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:37.057 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.050+0000 7f09a9419700 1 --2- 172.21.15.39:0/3501680838 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0990064ee0 0x7f0990067390 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0998007fd0 tx=0x7f0998007a80 comp rx=0 tx=0).stop 2023-11-28T11:59:37.057 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.050+0000 7f09a9419700 1 -- 172.21.15.39:0/3501680838 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09a4069e00 msgr2=0x7f09a41f4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:37.057 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.050+0000 7f09a9419700 1 --2- 172.21.15.39:0/3501680838 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09a4069e00 0x7f09a41f4630 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f099400c520 tx=0x7f099400c8e0 comp rx=0 tx=0).stop 2023-11-28T11:59:37.058 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.050+0000 7f09a9419700 1 -- 172.21.15.39:0/3501680838 shutdown_connections 2023-11-28T11:59:37.058 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.050+0000 7f09a9419700 1 --2- 172.21.15.39:0/3501680838 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0990064ee0 0x7f0990067390 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:37.058 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.050+0000 7f09a9419700 1 --2- 172.21.15.39:0/3501680838 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09a415c640 0x7f09a40b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:37.058 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.050+0000 7f09a9419700 1 --2- 172.21.15.39:0/3501680838 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f09a4071aa0 0x7f09a40b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:37.058 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.050+0000 7f09a9419700 1 --2- 172.21.15.39:0/3501680838 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09a4069e00 0x7f09a41f4630 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:37.058 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.050+0000 7f09a9419700 1 -- 172.21.15.39:0/3501680838 >> 172.21.15.39:0/3501680838 conn(0x7f09a40b6520 msgr2=0x7f09a40b1590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:37.058 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.050+0000 7f09a9419700 1 -- 172.21.15.39:0/3501680838 shutdown_connections 2023-11-28T11:59:37.058 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.054+0000 7f09a9419700 1 -- 172.21.15.39:0/3501680838 wait complete. 2023-11-28T11:59:37.079 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2023-11-28T11:59:37.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.262+0000 7f167a9a8700 1 Processor -- start 2023-11-28T11:59:37.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.262+0000 7f167a9a8700 1 -- start start 2023-11-28T11:59:37.267 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.262+0000 7f167a9a8700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1674070080 0x7f16740704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:37.267 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.262+0000 7f167a9a8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1674164250 0x7f16741646d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:37.267 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.262+0000 7f167a9a8700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16740ad6c0 con 0x7f1674160710 2023-11-28T11:59:37.267 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.262+0000 7f167a9a8700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f167406b1c0 con 0x7f1674070080 2023-11-28T11:59:37.267 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.262+0000 7f167a9a8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16740adc60 con 0x7f1674164250 2023-11-28T11:59:37.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.262+0000 7f16799a6700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f1674160710 0x7f16740cc320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:40306/0 (socket says 172.21.15.39:40306) 2023-11-28T11:59:37.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.262+0000 7f16799a6700 1 -- 172.21.15.39:0/1960843508 learned_addr learned my addr 172.21.15.39:0/1960843508 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:59:37.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.262+0000 7f16791a5700 1 --2- 172.21.15.39:0/1960843508 >> v2:172.21.15.39:3300/0 conn(0x7f1674070080 0x7f16740704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:37.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.262+0000 7f167a1a7700 1 --2- 172.21.15.39:0/1960843508 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1674164250 0x7f16741646d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:37.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.266+0000 7f16791a5700 1 -- 172.21.15.39:0/1960843508 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1674164250 msgr2=0x7f16741646d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:37.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.266+0000 7f16791a5700 1 --2- 172.21.15.39:0/1960843508 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1674164250 0x7f16741646d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:37.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.266+0000 7f16791a5700 1 -- 172.21.15.39:0/1960843508 >> v1:172.21.15.39:6789/0 conn(0x7f1674160710 legacy=0x7f16740cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:37.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.266+0000 7f16791a5700 1 -- 172.21.15.39:0/1960843508 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16740709f0 con 0x7f1674070080 2023-11-28T11:59:37.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.266+0000 7f16789a4700 1 -- 172.21.15.39:0/1960843508 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3526005378 0 0) 0x7f16740ad6c0 con 0x7f1674160710 2023-11-28T11:59:37.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.266+0000 7f16791a5700 1 --2- 172.21.15.39:0/1960843508 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1674070080 0x7f16740704b0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f1664009850 tx=0x7f1664009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b8f9148cf14eb0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:37.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.266+0000 7f16789a4700 1 -- 172.21.15.39:0/1960843508 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1664011830 con 0x7f1674070080 2023-11-28T11:59:37.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.266+0000 7f16789a4700 1 -- 172.21.15.39:0/1960843508 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1664011990 con 0x7f1674070080 2023-11-28T11:59:37.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.266+0000 7f16789a4700 1 -- 172.21.15.39:0/1960843508 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1664011d40 con 0x7f1674070080 2023-11-28T11:59:37.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.266+0000 7f167a9a8700 1 -- 172.21.15.39:0/1960843508 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1674070080 msgr2=0x7f16740704b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:37.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.266+0000 7f167a9a8700 1 --2- 172.21.15.39:0/1960843508 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1674070080 0x7f16740704b0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f1664009850 tx=0x7f1664009b60 comp rx=0 tx=0).stop 2023-11-28T11:59:37.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.266+0000 7f167a9a8700 1 -- 172.21.15.39:0/1960843508 shutdown_connections 2023-11-28T11:59:37.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.266+0000 7f167a9a8700 1 --2- 172.21.15.39:0/1960843508 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1674164250 0x7f16741646d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:37.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.266+0000 7f167a9a8700 1 --2- 172.21.15.39:0/1960843508 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1674070080 0x7f16740704b0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:37.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.266+0000 7f167a9a8700 1 -- 172.21.15.39:0/1960843508 >> 172.21.15.39:0/1960843508 conn(0x7f16740b0f80 msgr2=0x7f16740ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:37.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.266+0000 7f167a9a8700 1 -- 172.21.15.39:0/1960843508 shutdown_connections 2023-11-28T11:59:37.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.266+0000 7f167a9a8700 1 -- 172.21.15.39:0/1960843508 wait complete. 2023-11-28T11:59:37.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.270+0000 7f167a9a8700 1 Processor -- start 2023-11-28T11:59:37.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.270+0000 7f167a9a8700 1 -- start start 2023-11-28T11:59:37.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.270+0000 7f167a9a8700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1674070080 0x7f16740c3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:37.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.270+0000 7f167a9a8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1674160710 0x7f1674151a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:37.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.270+0000 7f167a9a8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1674164250 0x7f167415df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:37.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.270+0000 7f167a9a8700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167415da90 con 0x7f1674070080 2023-11-28T11:59:37.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.270+0000 7f167a9a8700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167415ce80 con 0x7f1674164250 2023-11-28T11:59:37.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.270+0000 7f167a9a8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f167415d160 con 0x7f1674160710 2023-11-28T11:59:37.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.270+0000 7f16799a6700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1674070080 0x7f16740c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:37.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.270+0000 7f16799a6700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1674070080 0x7f16740c3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54644/0 (socket says 172.21.15.39:54644) 2023-11-28T11:59:37.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.270+0000 7f16799a6700 1 -- 172.21.15.39:0/268797468 learned_addr learned my addr 172.21.15.39:0/268797468 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:37.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.270+0000 7f167a1a7700 1 --2- 172.21.15.39:0/268797468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1674164250 0x7f167415df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:37.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.270+0000 7f16791a5700 1 --2- 172.21.15.39:0/268797468 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1674160710 0x7f1674151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:37.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.270+0000 7f16799a6700 1 -- 172.21.15.39:0/268797468 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1674160710 msgr2=0x7f1674151a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:37.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.270+0000 7f16799a6700 1 --2- 172.21.15.39:0/268797468 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1674160710 0x7f1674151a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:37.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.270+0000 7f16799a6700 1 -- 172.21.15.39:0/268797468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1674164250 msgr2=0x7f167415df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:37.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.270+0000 7f16799a6700 1 --2- 172.21.15.39:0/268797468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1674164250 0x7f167415df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:37.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.270+0000 7f16799a6700 1 -- 172.21.15.39:0/268797468 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16640094b0 con 0x7f1674070080 2023-11-28T11:59:37.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.270+0000 7f16799a6700 1 --2- 172.21.15.39:0/268797468 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1674070080 0x7f16740c3bf0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f167000c580 tx=0x7f167000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:37.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.274+0000 7f166a7fc700 1 -- 172.21.15.39:0/268797468 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1670004ca0 con 0x7f1674070080 2023-11-28T11:59:37.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.274+0000 7f166a7fc700 1 -- 172.21.15.39:0/268797468 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1670004e20 con 0x7f1674070080 2023-11-28T11:59:37.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.274+0000 7f167a9a8700 1 -- 172.21.15.39:0/268797468 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f167406b3d0 con 0x7f1674070080 2023-11-28T11:59:37.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.274+0000 7f166a7fc700 1 -- 172.21.15.39:0/268797468 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1670007310 con 0x7f1674070080 2023-11-28T11:59:37.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.274+0000 7f167a9a8700 1 -- 172.21.15.39:0/268797468 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16740cca30 con 0x7f1674070080 2023-11-28T11:59:37.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.274+0000 7f167a9a8700 1 -- 172.21.15.39:0/268797468 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f167406b6b0 con 0x7f1674070080 2023-11-28T11:59:37.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.274+0000 7f166a7fc700 1 -- 172.21.15.39:0/268797468 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f167001a020 con 0x7f1674070080 2023-11-28T11:59:37.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.278+0000 7f166a7fc700 1 --2- 172.21.15.39:0/268797468 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1658064ee0 0x7f1658067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:37.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.278+0000 7f166a7fc700 1 -- 172.21.15.39:0/268797468 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f1670081ab0 con 0x7f1674070080 2023-11-28T11:59:37.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.278+0000 7f16791a5700 1 --2- 172.21.15.39:0/268797468 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1658064ee0 0x7f1658067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:37.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.278+0000 7f16791a5700 1 --2- 172.21.15.39:0/268797468 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1658064ee0 0x7f1658067390 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f16640090b0 tx=0x7f1664008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:37.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.282+0000 7f166a7fc700 1 -- 172.21.15.39:0/268797468 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f167004fce0 con 0x7f1674070080 2023-11-28T11:59:37.525 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.522+0000 7f167a9a8700 1 -- 172.21.15.39:0/268797468 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) v1 -- 0x7f1674073cb0 con 0x7f1674070080 2023-11-28T11:59:37.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.678+0000 7f166a7fc700 1 -- 172.21.15.39:0/268797468 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v179) v1 ==== 149+0+0 (secure 0 0 0) 0x7f1670053300 con 0x7f1674070080 2023-11-28T11:59:37.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.682+0000 7f167a9a8700 1 -- 172.21.15.39:0/268797468 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1658064ee0 msgr2=0x7f1658067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:37.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.682+0000 7f167a9a8700 1 --2- 172.21.15.39:0/268797468 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1658064ee0 0x7f1658067390 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f16640090b0 tx=0x7f1664008030 comp rx=0 tx=0).stop 2023-11-28T11:59:37.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.682+0000 7f167a9a8700 1 -- 172.21.15.39:0/268797468 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1674070080 msgr2=0x7f16740c3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:37.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.682+0000 7f167a9a8700 1 --2- 172.21.15.39:0/268797468 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1674070080 0x7f16740c3bf0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f167000c580 tx=0x7f167000c940 comp rx=0 tx=0).stop 2023-11-28T11:59:37.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.682+0000 7f167a9a8700 1 -- 172.21.15.39:0/268797468 shutdown_connections 2023-11-28T11:59:37.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.682+0000 7f167a9a8700 1 --2- 172.21.15.39:0/268797468 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1658064ee0 0x7f1658067390 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:37.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.682+0000 7f167a9a8700 1 --2- 172.21.15.39:0/268797468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1674164250 0x7f167415df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:37.689 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.682+0000 7f167a9a8700 1 --2- 172.21.15.39:0/268797468 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1674160710 0x7f1674151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:37.689 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.682+0000 7f167a9a8700 1 --2- 172.21.15.39:0/268797468 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1674070080 0x7f16740c3bf0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:37.689 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.682+0000 7f167a9a8700 1 -- 172.21.15.39:0/268797468 >> 172.21.15.39:0/268797468 conn(0x7f16740b0f80 msgr2=0x7f16740c4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:37.689 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.682+0000 7f167a9a8700 1 -- 172.21.15.39:0/268797468 shutdown_connections 2023-11-28T11:59:37.689 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.686+0000 7f167a9a8700 1 -- 172.21.15.39:0/268797468 wait complete. 2023-11-28T11:59:37.710 INFO:tasks.cephfs_test_runner:That the MDS can repair an inodes backtrace in the data pool ... ok 2023-11-28T11:59:37.711 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2023-11-28T11:59:37.711 INFO:tasks.cephfs_test_runner:test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-28T11:59:37.711 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair' 2023-11-28T11:59:37.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.882+0000 7f9c873fc700 1 Processor -- start 2023-11-28T11:59:37.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.886+0000 7f9c873fc700 1 -- start start 2023-11-28T11:59:37.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.886+0000 7f9c873fc700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9c80156b60 0x7f9c800cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:37.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.886+0000 7f9c873fc700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9c801605b0 0x7f9c800ce000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:37.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.886+0000 7f9c873fc700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c8006b0d0 con 0x7f9c80156790 2023-11-28T11:59:37.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.886+0000 7f9c873fc700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c800ce540 con 0x7f9c801605b0 2023-11-28T11:59:37.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.886+0000 7f9c873fc700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c8006b560 con 0x7f9c80156b60 2023-11-28T11:59:37.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.886+0000 7f9c85999700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9c801605b0 0x7f9c800ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:37.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.886+0000 7f9c85999700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9c801605b0 0x7f9c800ce000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54658/0 (socket says 172.21.15.39:54658) 2023-11-28T11:59:37.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.886+0000 7f9c85999700 1 -- 172.21.15.39:0/2705907793 learned_addr learned my addr 172.21.15.39:0/2705907793 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:37.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.886+0000 7f9c84997700 1 --2- 172.21.15.39:0/2705907793 >> v2:172.21.15.184:3300/0 conn(0x7f9c80156b60 0x7f9c800cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:37.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.886+0000 7f9c84997700 1 -- 172.21.15.39:0/2705907793 >> v2:172.21.15.39:3300/0 conn(0x7f9c801605b0 msgr2=0x7f9c800ce000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:37.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.886+0000 7f9c84997700 1 --2- 172.21.15.39:0/2705907793 >> v2:172.21.15.39:3300/0 conn(0x7f9c801605b0 0x7f9c800ce000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:37.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.886+0000 7f9c84997700 1 -- 172.21.15.39:0/2705907793 >> v1:172.21.15.184:6789/0 conn(0x7f9c80156790 legacy=0x7f9c8015fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:37.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.886+0000 7f9c84997700 1 -- 172.21.15.39:0/2705907793 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c800cc990 con 0x7f9c80156b60 2023-11-28T11:59:37.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.886+0000 7f9c85999700 1 --2- 172.21.15.39:0/2705907793 >> v2:172.21.15.39:3300/0 conn(0x7f9c801605b0 0x7f9c800ce000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:37.893 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.890+0000 7f9c84997700 1 --2- 172.21.15.39:0/2705907793 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c80156b60 0x7f9c800cc290 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9c8015d900 tx=0x7f9c70009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7a9cf365c22475f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:37.893 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.890+0000 7f9c77fff700 1 -- 172.21.15.39:0/2705907793 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c70011830 con 0x7f9c80156b60 2023-11-28T11:59:37.893 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.890+0000 7f9c77fff700 1 -- 172.21.15.39:0/2705907793 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c70011990 con 0x7f9c80156b60 2023-11-28T11:59:37.893 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.890+0000 7f9c77fff700 1 -- 172.21.15.39:0/2705907793 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c70011d20 con 0x7f9c80156b60 2023-11-28T11:59:37.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.890+0000 7f9c873fc700 1 -- 172.21.15.39:0/2705907793 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c80156b60 msgr2=0x7f9c800cc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:37.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.890+0000 7f9c873fc700 1 --2- 172.21.15.39:0/2705907793 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c80156b60 0x7f9c800cc290 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9c8015d900 tx=0x7f9c70009b30 comp rx=0 tx=0).stop 2023-11-28T11:59:37.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.890+0000 7f9c873fc700 1 -- 172.21.15.39:0/2705907793 shutdown_connections 2023-11-28T11:59:37.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.890+0000 7f9c873fc700 1 --2- 172.21.15.39:0/2705907793 >> v2:172.21.15.39:3300/0 conn(0x7f9c801605b0 0x7f9c800ce000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:37.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.890+0000 7f9c873fc700 1 --2- 172.21.15.39:0/2705907793 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c80156b60 0x7f9c800cc290 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:37.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.890+0000 7f9c873fc700 1 -- 172.21.15.39:0/2705907793 >> 172.21.15.39:0/2705907793 conn(0x7f9c800cf350 msgr2=0x7f9c800b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:37.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.890+0000 7f9c873fc700 1 -- 172.21.15.39:0/2705907793 shutdown_connections 2023-11-28T11:59:37.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.890+0000 7f9c873fc700 1 -- 172.21.15.39:0/2705907793 wait complete. 2023-11-28T11:59:37.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.894+0000 7f9c873fc700 1 Processor -- start 2023-11-28T11:59:37.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.894+0000 7f9c873fc700 1 -- start start 2023-11-28T11:59:37.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.894+0000 7f9c873fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c80156790 0x7f9c800c48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:37.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.894+0000 7f9c873fc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c80156b60 0x7f9c80155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:37.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.894+0000 7f9c873fc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c801605b0 0x7f9c800afa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:37.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.894+0000 7f9c873fc700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c80156180 con 0x7f9c80156790 2023-11-28T11:59:37.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.894+0000 7f9c873fc700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c800aff50 con 0x7f9c801605b0 2023-11-28T11:59:37.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.894+0000 7f9c873fc700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c800c4f00 con 0x7f9c80156b60 2023-11-28T11:59:37.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.894+0000 7f9c85198700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c80156790 0x7f9c800c48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:37.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.894+0000 7f9c85198700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c80156790 0x7f9c800c48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54674/0 (socket says 172.21.15.39:54674) 2023-11-28T11:59:37.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.894+0000 7f9c85198700 1 -- 172.21.15.39:0/2536912131 learned_addr learned my addr 172.21.15.39:0/2536912131 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:37.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.894+0000 7f9c85999700 1 --2- 172.21.15.39:0/2536912131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c801605b0 0x7f9c800afa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:37.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.894+0000 7f9c84997700 1 --2- 172.21.15.39:0/2536912131 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c80156b60 0x7f9c80155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:37.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.898+0000 7f9c85198700 1 -- 172.21.15.39:0/2536912131 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c80156b60 msgr2=0x7f9c80155c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:37.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.898+0000 7f9c85198700 1 --2- 172.21.15.39:0/2536912131 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c80156b60 0x7f9c80155c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:37.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.898+0000 7f9c85198700 1 -- 172.21.15.39:0/2536912131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c801605b0 msgr2=0x7f9c800afa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:37.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.898+0000 7f9c85198700 1 --2- 172.21.15.39:0/2536912131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c801605b0 0x7f9c800afa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:37.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.898+0000 7f9c85198700 1 -- 172.21.15.39:0/2536912131 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c78009570 con 0x7f9c80156790 2023-11-28T11:59:37.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.898+0000 7f9c85198700 1 --2- 172.21.15.39:0/2536912131 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c80156790 0x7f9c800c48b0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00cc50 tx=0x7f9c7c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:37.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.898+0000 7f9c75ffb700 1 -- 172.21.15.39:0/2536912131 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c00ade0 con 0x7f9c80156790 2023-11-28T11:59:37.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.898+0000 7f9c75ffb700 1 -- 172.21.15.39:0/2536912131 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7c00ce50 con 0x7f9c80156790 2023-11-28T11:59:37.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.898+0000 7f9c873fc700 1 -- 172.21.15.39:0/2536912131 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c700094b0 con 0x7f9c80156790 2023-11-28T11:59:37.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.898+0000 7f9c75ffb700 1 -- 172.21.15.39:0/2536912131 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c003c80 con 0x7f9c80156790 2023-11-28T11:59:37.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.898+0000 7f9c873fc700 1 -- 172.21.15.39:0/2536912131 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c8006aa80 con 0x7f9c80156790 2023-11-28T11:59:37.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.898+0000 7f9c873fc700 1 -- 172.21.15.39:0/2536912131 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c8006a7a0 con 0x7f9c80156790 2023-11-28T11:59:37.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.898+0000 7f9c75ffb700 1 -- 172.21.15.39:0/2536912131 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9c7c010050 con 0x7f9c80156790 2023-11-28T11:59:37.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.902+0000 7f9c75ffb700 1 --2- 172.21.15.39:0/2536912131 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9c64064f10 0x7f9c640673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:37.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.902+0000 7f9c75ffb700 1 -- 172.21.15.39:0/2536912131 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f9c7c081de0 con 0x7f9c80156790 2023-11-28T11:59:37.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.902+0000 7f9c84997700 1 --2- 172.21.15.39:0/2536912131 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9c64064f10 0x7f9c640673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:37.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.902+0000 7f9c84997700 1 --2- 172.21.15.39:0/2536912131 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9c64064f10 0x7f9c640673c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9c70000c00 tx=0x7f9c70008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:37.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:37.910+0000 7f9c75ffb700 1 -- 172.21.15.39:0/2536912131 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9c7c050070 con 0x7f9c80156790 2023-11-28T11:59:38.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.142+0000 7f9c873fc700 1 -- 172.21.15.39:0/2536912131 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]} v 0) v1 -- 0x7f9c8006ad60 con 0x7f9c80156790 2023-11-28T11:59:38.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.682+0000 7f9c75ffb700 1 -- 172.21.15.39:0/2536912131 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]}]=0 v180) v1 ==== 172+0+0 (secure 0 0 0) 0x7f9c7c053690 con 0x7f9c80156790 2023-11-28T11:59:38.691 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.686+0000 7f9c873fc700 1 -- 172.21.15.39:0/2536912131 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9c64064f10 msgr2=0x7f9c640673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:38.691 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.686+0000 7f9c873fc700 1 --2- 172.21.15.39:0/2536912131 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9c64064f10 0x7f9c640673c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9c70000c00 tx=0x7f9c70008030 comp rx=0 tx=0).stop 2023-11-28T11:59:38.691 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.686+0000 7f9c873fc700 1 -- 172.21.15.39:0/2536912131 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c80156790 msgr2=0x7f9c800c48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:38.691 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.686+0000 7f9c873fc700 1 --2- 172.21.15.39:0/2536912131 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c80156790 0x7f9c800c48b0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00cc50 tx=0x7f9c7c00a340 comp rx=0 tx=0).stop 2023-11-28T11:59:38.691 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.686+0000 7f9c873fc700 1 -- 172.21.15.39:0/2536912131 shutdown_connections 2023-11-28T11:59:38.691 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.686+0000 7f9c873fc700 1 --2- 172.21.15.39:0/2536912131 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9c64064f10 0x7f9c640673c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:38.692 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.686+0000 7f9c873fc700 1 --2- 172.21.15.39:0/2536912131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c801605b0 0x7f9c800afa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:38.692 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.686+0000 7f9c873fc700 1 --2- 172.21.15.39:0/2536912131 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c80156b60 0x7f9c80155c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:38.692 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.686+0000 7f9c873fc700 1 --2- 172.21.15.39:0/2536912131 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c80156790 0x7f9c800c48b0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:38.692 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.686+0000 7f9c873fc700 1 -- 172.21.15.39:0/2536912131 >> 172.21.15.39:0/2536912131 conn(0x7f9c800cf350 msgr2=0x7f9c800b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:38.692 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.686+0000 7f9c873fc700 1 -- 172.21.15.39:0/2536912131 shutdown_connections 2023-11-28T11:59:38.692 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.686+0000 7f9c873fc700 1 -- 172.21.15.39:0/2536912131 wait complete. 2023-11-28T11:59:38.717 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-28T11:59:38.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.946+0000 7f2bf70fb700 1 Processor -- start 2023-11-28T11:59:38.952 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.946+0000 7f2bf70fb700 1 -- start start 2023-11-28T11:59:38.955 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.950+0000 7f2bf70fb700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2bf0159f10 0x7f2bf0070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:38.955 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.950+0000 7f2bf70fb700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2bf015a9f0 0x7f2bf006b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:38.955 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.950+0000 7f2bf70fb700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bf0070600 con 0x7f2bf00c8c90 2023-11-28T11:59:38.955 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.950+0000 7f2bf70fb700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bf00c9100 con 0x7f2bf015a9f0 2023-11-28T11:59:38.955 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.950+0000 7f2bf70fb700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf006b840 con 0x7f2bf0159f10 2023-11-28T11:59:38.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.950+0000 7f2bf58f8700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f2bf00c8c90 0x7f2bf015a2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:41028/0 (socket says 172.21.15.39:41028) 2023-11-28T11:59:38.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.950+0000 7f2bf58f8700 1 -- 172.21.15.39:0/2823513611 learned_addr learned my addr 172.21.15.39:0/2823513611 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:59:38.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.950+0000 7f2bf60f9700 1 --2- 172.21.15.39:0/2823513611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2bf0159f10 0x7f2bf0070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:38.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.950+0000 7f2bf68fa700 1 --2- 172.21.15.39:0/2823513611 >> v2:172.21.15.184:3300/0 conn(0x7f2bf015a9f0 0x7f2bf006b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:38.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.954+0000 7f2bf60f9700 1 -- 172.21.15.39:0/2823513611 >> v2:172.21.15.184:3300/0 conn(0x7f2bf015a9f0 msgr2=0x7f2bf006b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:38.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.954+0000 7f2bf60f9700 1 --2- 172.21.15.39:0/2823513611 >> v2:172.21.15.184:3300/0 conn(0x7f2bf015a9f0 0x7f2bf006b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:38.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.954+0000 7f2bf50f7700 1 -- 172.21.15.39:0/2823513611 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1397610936 0 0) 0x7f2bf0070600 con 0x7f2bf00c8c90 2023-11-28T11:59:38.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.954+0000 7f2bf60f9700 1 -- 172.21.15.39:0/2823513611 >> v1:172.21.15.39:6789/0 conn(0x7f2bf00c8c90 legacy=0x7f2bf015a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:38.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.954+0000 7f2bf60f9700 1 -- 172.21.15.39:0/2823513611 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf015ae30 con 0x7f2bf0159f10 2023-11-28T11:59:38.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.954+0000 7f2bf60f9700 1 --2- 172.21.15.39:0/2823513611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2bf0159f10 0x7f2bf0070a90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2bec009d90 tx=0x7f2bec00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce9f66504b722934 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:38.958 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.954+0000 7f2bf50f7700 1 -- 172.21.15.39:0/2823513611 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec00e070 con 0x7f2bf0159f10 2023-11-28T11:59:38.958 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.954+0000 7f2bf50f7700 1 -- 172.21.15.39:0/2823513611 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bec00bb20 con 0x7f2bf0159f10 2023-11-28T11:59:38.958 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.954+0000 7f2bf50f7700 1 -- 172.21.15.39:0/2823513611 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec012430 con 0x7f2bf0159f10 2023-11-28T11:59:38.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.954+0000 7f2bf70fb700 1 -- 172.21.15.39:0/2823513611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2bf0159f10 msgr2=0x7f2bf0070a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:38.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.954+0000 7f2bf70fb700 1 --2- 172.21.15.39:0/2823513611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2bf0159f10 0x7f2bf0070a90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2bec009d90 tx=0x7f2bec00b330 comp rx=0 tx=0).stop 2023-11-28T11:59:38.960 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.954+0000 7f2bf70fb700 1 -- 172.21.15.39:0/2823513611 shutdown_connections 2023-11-28T11:59:38.960 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.954+0000 7f2bf70fb700 1 --2- 172.21.15.39:0/2823513611 >> v2:172.21.15.184:3300/0 conn(0x7f2bf015a9f0 0x7f2bf006b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:38.960 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.954+0000 7f2bf70fb700 1 --2- 172.21.15.39:0/2823513611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2bf0159f10 0x7f2bf0070a90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:38.960 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.954+0000 7f2bf70fb700 1 -- 172.21.15.39:0/2823513611 >> 172.21.15.39:0/2823513611 conn(0x7f2bf00cf280 msgr2=0x7f2bf00cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:38.960 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.954+0000 7f2bf70fb700 1 -- 172.21.15.39:0/2823513611 shutdown_connections 2023-11-28T11:59:38.960 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.954+0000 7f2bf70fb700 1 -- 172.21.15.39:0/2823513611 wait complete. 2023-11-28T11:59:38.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.958+0000 7f2bf70fb700 1 Processor -- start 2023-11-28T11:59:38.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.958+0000 7f2bf70fb700 1 -- start start 2023-11-28T11:59:38.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.962+0000 7f2bf70fb700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2bf00c8c90 0x7f2bf00b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:38.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.962+0000 7f2bf70fb700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2bf0159f10 0x7f2bf00cda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:38.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.962+0000 7f2bf70fb700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2bf015a9f0 0x7f2bf01f5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:38.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.962+0000 7f2bf70fb700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf01f5f30 con 0x7f2bf0159f10 2023-11-28T11:59:38.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.962+0000 7f2bf70fb700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf01f6210 con 0x7f2bf015a9f0 2023-11-28T11:59:38.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.962+0000 7f2bf70fb700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf01f64f0 con 0x7f2bf00c8c90 2023-11-28T11:59:38.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.962+0000 7f2bf58f8700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2bf0159f10 0x7f2bf00cda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:38.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.962+0000 7f2bf58f8700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2bf0159f10 0x7f2bf00cda80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47026/0 (socket says 172.21.15.39:47026) 2023-11-28T11:59:38.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.962+0000 7f2bf58f8700 1 -- 172.21.15.39:0/2589142646 learned_addr learned my addr 172.21.15.39:0/2589142646 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:38.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.962+0000 7f2bf68fa700 1 --2- 172.21.15.39:0/2589142646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2bf015a9f0 0x7f2bf01f5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:38.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.962+0000 7f2bf60f9700 1 --2- 172.21.15.39:0/2589142646 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2bf00c8c90 0x7f2bf00b1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:38.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.962+0000 7f2bf58f8700 1 -- 172.21.15.39:0/2589142646 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2bf00c8c90 msgr2=0x7f2bf00b1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:38.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.962+0000 7f2bf58f8700 1 --2- 172.21.15.39:0/2589142646 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2bf00c8c90 0x7f2bf00b1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:38.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.962+0000 7f2bf58f8700 1 -- 172.21.15.39:0/2589142646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2bf015a9f0 msgr2=0x7f2bf01f5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:38.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.962+0000 7f2bf58f8700 1 --2- 172.21.15.39:0/2589142646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2bf015a9f0 0x7f2bf01f5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:38.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.962+0000 7f2bf58f8700 1 -- 172.21.15.39:0/2589142646 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bec009a70 con 0x7f2bf0159f10 2023-11-28T11:59:38.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.962+0000 7f2bf58f8700 1 --2- 172.21.15.39:0/2589142646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2bf0159f10 0x7f2bf00cda80 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f2be000c580 tx=0x7f2be000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:38.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.962+0000 7f2be6ffd700 1 -- 172.21.15.39:0/2589142646 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be0004ca0 con 0x7f2bf0159f10 2023-11-28T11:59:38.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.962+0000 7f2be6ffd700 1 -- 172.21.15.39:0/2589142646 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be0004e20 con 0x7f2bf0159f10 2023-11-28T11:59:38.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.962+0000 7f2bf70fb700 1 -- 172.21.15.39:0/2589142646 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bf006ffb0 con 0x7f2bf0159f10 2023-11-28T11:59:38.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.962+0000 7f2be6ffd700 1 -- 172.21.15.39:0/2589142646 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be0007310 con 0x7f2bf0159f10 2023-11-28T11:59:38.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.962+0000 7f2bf70fb700 1 -- 172.21.15.39:0/2589142646 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bf00afcc0 con 0x7f2bf0159f10 2023-11-28T11:59:38.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.966+0000 7f2bf70fb700 1 -- 172.21.15.39:0/2589142646 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bf0070290 con 0x7f2bf0159f10 2023-11-28T11:59:38.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.966+0000 7f2be6ffd700 1 -- 172.21.15.39:0/2589142646 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2be001a020 con 0x7f2bf0159f10 2023-11-28T11:59:38.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.966+0000 7f2be6ffd700 1 --2- 172.21.15.39:0/2589142646 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2bd4064ee0 0x7f2bd4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:38.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.966+0000 7f2be6ffd700 1 -- 172.21.15.39:0/2589142646 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f2be0081970 con 0x7f2bf0159f10 2023-11-28T11:59:38.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.966+0000 7f2bf60f9700 1 --2- 172.21.15.39:0/2589142646 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2bd4064ee0 0x7f2bd4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:38.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.970+0000 7f2bf60f9700 1 --2- 172.21.15.39:0/2589142646 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2bd4064ee0 0x7f2bd4067390 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2bec014040 tx=0x7f2bec011000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:38.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:38.974+0000 7f2be6ffd700 1 -- 172.21.15.39:0/2589142646 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2be004fc00 con 0x7f2bf0159f10 2023-11-28T11:59:39.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.150+0000 7f2bf70fb700 1 -- 172.21.15.39:0/2589142646 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f2bf006cf30 con 0x7f2bf0159f10 2023-11-28T11:59:39.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.158+0000 7f2be6ffd700 1 -- 172.21.15.39:0/2589142646 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2be0053220 con 0x7f2bf0159f10 2023-11-28T11:59:39.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.162+0000 7f2bf70fb700 1 -- 172.21.15.39:0/2589142646 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2bd4064ee0 msgr2=0x7f2bd4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:39.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.162+0000 7f2bf70fb700 1 --2- 172.21.15.39:0/2589142646 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2bd4064ee0 0x7f2bd4067390 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2bec014040 tx=0x7f2bec011000 comp rx=0 tx=0).stop 2023-11-28T11:59:39.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.162+0000 7f2bf70fb700 1 -- 172.21.15.39:0/2589142646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2bf0159f10 msgr2=0x7f2bf00cda80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:39.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.162+0000 7f2bf70fb700 1 --2- 172.21.15.39:0/2589142646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2bf0159f10 0x7f2bf00cda80 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f2be000c580 tx=0x7f2be000c890 comp rx=0 tx=0).stop 2023-11-28T11:59:39.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.162+0000 7f2bf70fb700 1 -- 172.21.15.39:0/2589142646 shutdown_connections 2023-11-28T11:59:39.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.162+0000 7f2bf70fb700 1 --2- 172.21.15.39:0/2589142646 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2bd4064ee0 0x7f2bd4067390 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:39.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.162+0000 7f2bf70fb700 1 --2- 172.21.15.39:0/2589142646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2bf015a9f0 0x7f2bf01f5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:39.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.162+0000 7f2bf70fb700 1 --2- 172.21.15.39:0/2589142646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2bf0159f10 0x7f2bf00cda80 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:39.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.162+0000 7f2bf70fb700 1 --2- 172.21.15.39:0/2589142646 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2bf00c8c90 0x7f2bf00b1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:39.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.162+0000 7f2bf70fb700 1 -- 172.21.15.39:0/2589142646 >> 172.21.15.39:0/2589142646 conn(0x7f2bf00cf280 msgr2=0x7f2bf00ca4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:39.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.162+0000 7f2bf70fb700 1 -- 172.21.15.39:0/2589142646 shutdown_connections 2023-11-28T11:59:39.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.162+0000 7f2bf70fb700 1 -- 172.21.15.39:0/2589142646 wait complete. 2023-11-28T11:59:39.188 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T11:59:39.189 DEBUG:teuthology.orchestra.run.smithi039:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T11:59:39.239 DEBUG:teuthology.orchestra.run.smithi184:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T11:59:39.290 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T11:59:39.290 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:59:39.291 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:59:39.312 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352324k,nr_inodes=4088081,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6229 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T11:59:39.312 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:59:39.312 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:59:39.353 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352324k,nr_inodes=4088081,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9254 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T11:59:39.353 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:59:39.353 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:59:39.374 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352324k,nr_inodes=4088081,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6229 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T11:59:39.374 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:59:39.375 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:59:39.417 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352324k,nr_inodes=4088081,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9254 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T11:59:39.417 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-28T11:59:39.418 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:59:39.604 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.598+0000 7f1758e91700 1 Processor -- start 2023-11-28T11:59:39.604 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.598+0000 7f1758e91700 1 -- start start 2023-11-28T11:59:39.606 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.602+0000 7f1758e91700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f17540ca6d0 0x7f1754069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:39.606 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.602+0000 7f1758e91700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1754158b80 con 0x7f17541587b0 2023-11-28T11:59:39.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.602+0000 7f1758e91700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f175406d520 con 0x7f175406a130 2023-11-28T11:59:39.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.602+0000 7f1758e91700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17540adfe0 con 0x7f17540ca6d0 2023-11-28T11:59:39.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.602+0000 7f175259c700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f17541587b0 0x7f175406cad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:41040/0 (socket says 172.21.15.39:41040) 2023-11-28T11:59:39.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.602+0000 7f175259c700 1 -- 172.21.15.39:0/1621192339 learned_addr learned my addr 172.21.15.39:0/1621192339 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:59:39.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.602+0000 7f1751d9b700 1 --2- 172.21.15.39:0/1621192339 >> v2:172.21.15.39:3300/0 conn(0x7f17540ca6d0 0x7f1754069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:39.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.602+0000 7f175159a700 1 -- 172.21.15.39:0/1621192339 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1767782191 0 0) 0x7f1754158b80 con 0x7f17541587b0 2023-11-28T11:59:39.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.602+0000 7f175159a700 1 -- 172.21.15.39:0/1621192339 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f173c0035d0 con 0x7f17541587b0 2023-11-28T11:59:39.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.602+0000 7f175159a700 1 -- 172.21.15.39:0/1621192339 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3594554322 0 0) 0x7f175406d520 con 0x7f175406a130 2023-11-28T11:59:39.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.606+0000 7f175159a700 1 -- 172.21.15.39:0/1621192339 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1754158b80 con 0x7f175406a130 2023-11-28T11:59:39.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.606+0000 7f175159a700 1 -- 172.21.15.39:0/1621192339 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1599253527 0 0) 0x7f173c0035d0 con 0x7f17541587b0 2023-11-28T11:59:39.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.606+0000 7f175159a700 1 -- 172.21.15.39:0/1621192339 >> v2:172.21.15.39:3300/0 conn(0x7f17540ca6d0 msgr2=0x7f1754069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:39.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.606+0000 7f175159a700 1 --2- 172.21.15.39:0/1621192339 >> v2:172.21.15.39:3300/0 conn(0x7f17540ca6d0 0x7f1754069bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:39.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.606+0000 7f175159a700 1 -- 172.21.15.39:0/1621192339 >> v1:172.21.15.184:6789/0 conn(0x7f175406a130 legacy=0x7f175406a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:39.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.606+0000 7f175159a700 1 -- 172.21.15.39:0/1621192339 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175406d800 con 0x7f17541587b0 2023-11-28T11:59:39.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.606+0000 7f175159a700 1 -- 172.21.15.39:0/1621192339 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4013383302 0 0) 0x7f17440019f0 con 0x7f17541587b0 2023-11-28T11:59:39.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.606+0000 7f1751d9b700 1 --2- 172.21.15.39:0/1621192339 >> v2:172.21.15.39:3300/0 conn(0x7f17540ca6d0 0x7f1754069bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:39.610 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.606+0000 7f175159a700 1 -- 172.21.15.39:0/1621192339 >> v1:172.21.15.39:6789/0 conn(0x7f17541587b0 legacy=0x7f175406cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:39.610 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.606+0000 7f175159a700 1 --2- 172.21.15.39:0/1621192339 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f173c003bb0 0x7f173c003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:39.610 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.606+0000 7f175159a700 1 --2- 172.21.15.39:0/1621192339 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f173c004870 0x7f173c004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:39.610 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.606+0000 7f175159a700 1 --2- 172.21.15.39:0/1621192339 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f173c005220 0x7f173c00dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:39.610 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.606+0000 7f175159a700 1 -- 172.21.15.39:0/1621192339 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17540adfe0 con 0x7f173c005220 2023-11-28T11:59:39.610 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.606+0000 7f175159a700 1 -- 172.21.15.39:0/1621192339 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f173c00e290 con 0x7f173c003bb0 2023-11-28T11:59:39.610 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.606+0000 7f175159a700 1 -- 172.21.15.39:0/1621192339 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f173c00e450 con 0x7f173c004870 2023-11-28T11:59:39.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.606+0000 7f175259c700 1 --2- 172.21.15.39:0/1621192339 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f173c003bb0 0x7f173c003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:39.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.606+0000 7f1751d9b700 1 --2- 172.21.15.39:0/1621192339 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f173c004870 0x7f173c004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:39.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.606+0000 7f1752d9d700 1 --2- 172.21.15.39:0/1621192339 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f173c005220 0x7f173c00dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:39.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.606+0000 7f175259c700 1 -- 172.21.15.39:0/1621192339 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f173c004870 msgr2=0x7f173c004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:39.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.606+0000 7f175259c700 1 --2- 172.21.15.39:0/1621192339 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f173c004870 0x7f173c004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:39.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.606+0000 7f175259c700 1 -- 172.21.15.39:0/1621192339 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f173c005220 msgr2=0x7f173c00dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:39.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.606+0000 7f175259c700 1 --2- 172.21.15.39:0/1621192339 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f173c005220 0x7f173c00dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:39.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.606+0000 7f175259c700 1 -- 172.21.15.39:0/1621192339 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f173c0035d0 con 0x7f173c003bb0 2023-11-28T11:59:39.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.606+0000 7f1752d9d700 1 -- 172.21.15.39:0/1621192339 reap_dead start 2023-11-28T11:59:39.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.606+0000 7f175259c700 1 --2- 172.21.15.39:0/1621192339 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f173c003bb0 0x7f173c003fa0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f174400a7d0 tx=0x7f173c0058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90bff7f81363f5b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:39.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.606+0000 7f175159a700 1 -- 172.21.15.39:0/1621192339 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17440072d0 con 0x7f173c003bb0 2023-11-28T11:59:39.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.606+0000 7f175159a700 1 -- 172.21.15.39:0/1621192339 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174400ae90 con 0x7f173c003bb0 2023-11-28T11:59:39.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.606+0000 7f175159a700 1 -- 172.21.15.39:0/1621192339 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1744007670 con 0x7f173c003bb0 2023-11-28T11:59:39.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.606+0000 7f1758e91700 1 -- 172.21.15.39:0/1621192339 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f173c003bb0 msgr2=0x7f173c003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:39.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.606+0000 7f1758e91700 1 --2- 172.21.15.39:0/1621192339 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f173c003bb0 0x7f173c003fa0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f174400a7d0 tx=0x7f173c0058a0 comp rx=0 tx=0).stop 2023-11-28T11:59:39.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.610+0000 7f1758e91700 1 -- 172.21.15.39:0/1621192339 shutdown_connections 2023-11-28T11:59:39.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.610+0000 7f1758e91700 1 --2- 172.21.15.39:0/1621192339 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f173c003bb0 0x7f173c003fa0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:39.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.610+0000 7f1758e91700 1 -- 172.21.15.39:0/1621192339 >> 172.21.15.39:0/1621192339 conn(0x7f17540cf350 msgr2=0x7f17540b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:39.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.610+0000 7f1758e91700 1 -- 172.21.15.39:0/1621192339 shutdown_connections 2023-11-28T11:59:39.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.610+0000 7f1758e91700 1 -- 172.21.15.39:0/1621192339 wait complete. 2023-11-28T11:59:39.615 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.610+0000 7f1758e91700 1 Processor -- start 2023-11-28T11:59:39.616 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.610+0000 7f1758e91700 1 -- start start 2023-11-28T11:59:39.618 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.614+0000 7f1758e91700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f173c003bb0 0x7f17541e1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:39.618 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.614+0000 7f1758e91700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1754150600 0x7f17540abac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:39.618 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.614+0000 7f1758e91700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17540c8450 0x7f17540ac000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:39.618 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.614+0000 7f1758e91700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175415b640 con 0x7f1754150600 2023-11-28T11:59:39.618 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.614+0000 7f1758e91700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175415aa30 con 0x7f17540c8450 2023-11-28T11:59:39.618 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.614+0000 7f1758e91700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f175415ad10 con 0x7f173c003bb0 2023-11-28T11:59:39.619 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.614+0000 7f1751d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1754150600 0x7f17540abac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:39.619 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.614+0000 7f1751d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1754150600 0x7f17540abac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47052/0 (socket says 172.21.15.39:47052) 2023-11-28T11:59:39.620 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.614+0000 7f1751d9b700 1 -- 172.21.15.39:0/2445992229 learned_addr learned my addr 172.21.15.39:0/2445992229 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:39.622 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.614+0000 7f175259c700 1 --2- 172.21.15.39:0/2445992229 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f173c003bb0 0x7f17541e1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:39.622 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.614+0000 7f1752d9d700 1 --2- 172.21.15.39:0/2445992229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17540c8450 0x7f17540ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:39.622 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.614+0000 7f1751d9b700 1 -- 172.21.15.39:0/2445992229 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f173c003bb0 msgr2=0x7f17541e1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:39.622 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.614+0000 7f1751d9b700 1 --2- 172.21.15.39:0/2445992229 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f173c003bb0 0x7f17541e1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:39.622 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.614+0000 7f1751d9b700 1 -- 172.21.15.39:0/2445992229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17540c8450 msgr2=0x7f17540ac000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:39.622 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.614+0000 7f1751d9b700 1 --2- 172.21.15.39:0/2445992229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17540c8450 0x7f17540ac000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:39.622 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.614+0000 7f1751d9b700 1 -- 172.21.15.39:0/2445992229 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17540c91a0 con 0x7f1754150600 2023-11-28T11:59:39.622 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.614+0000 7f1752d9d700 1 --2- 172.21.15.39:0/2445992229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17540c8450 0x7f17540ac000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:39.622 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.614+0000 7f1751d9b700 1 --2- 172.21.15.39:0/2445992229 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1754150600 0x7f17540abac0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f1748011ba0 tx=0x7f1748011eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:39.622 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.614+0000 7f1742ffd700 1 -- 172.21.15.39:0/2445992229 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174800fcd0 con 0x7f1754150600 2023-11-28T11:59:39.622 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.614+0000 7f1742ffd700 1 -- 172.21.15.39:0/2445992229 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174800fe30 con 0x7f1754150600 2023-11-28T11:59:39.623 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.614+0000 7f1758e91700 1 -- 172.21.15.39:0/2445992229 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f175406dae0 con 0x7f1754150600 2023-11-28T11:59:39.623 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.614+0000 7f1742ffd700 1 -- 172.21.15.39:0/2445992229 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174801c6a0 con 0x7f1754150600 2023-11-28T11:59:39.623 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.614+0000 7f1758e91700 1 -- 172.21.15.39:0/2445992229 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17540cccd0 con 0x7f1754150600 2023-11-28T11:59:39.623 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.618+0000 7f1758e91700 1 -- 172.21.15.39:0/2445992229 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17540726c0 con 0x7f1754150600 2023-11-28T11:59:39.623 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.618+0000 7f1742ffd700 1 -- 172.21.15.39:0/2445992229 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f174800e040 con 0x7f1754150600 2023-11-28T11:59:39.624 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.618+0000 7f1742ffd700 1 --2- 172.21.15.39:0/2445992229 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1734064f10 0x7f17340673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:39.624 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.618+0000 7f1742ffd700 1 -- 172.21.15.39:0/2445992229 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f1748017070 con 0x7f1754150600 2023-11-28T11:59:39.624 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.622+0000 7f175259c700 1 --2- 172.21.15.39:0/2445992229 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1734064f10 0x7f17340673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:39.626 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.622+0000 7f175259c700 1 --2- 172.21.15.39:0/2445992229 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1734064f10 0x7f17340673c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1744001c30 tx=0x7f1744009070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:39.630 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.626+0000 7f1742ffd700 1 -- 172.21.15.39:0/2445992229 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1748050d00 con 0x7f1754150600 2023-11-28T11:59:39.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.846+0000 7f1758e91700 1 -- 172.21.15.39:0/2445992229 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f175406bc90 con 0x7f1754150600 2023-11-28T11:59:39.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.846+0000 7f1742ffd700 1 -- 172.21.15.39:0/2445992229 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f1748021de0 con 0x7f1754150600 2023-11-28T11:59:39.850 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:59:39.850 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":26,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5594,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/701055613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":701055613},{"type":"v1","addr":"172.21.15.184:6837","nonce":701055613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5775,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6833/3453450609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3453450609},{"type":"v1","addr":"172.21.15.39:6833","nonce":3453450609}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/697075022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":697075022},{"type":"v1","addr":"172.21.15.39:6835","nonce":697075022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5806,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1819593136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1819593136},{"type":"v1","addr":"172.21.15.184:6835","nonce":1819593136}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[]} 2023-11-28T11:59:39.853 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.850+0000 7f1758e91700 1 -- 172.21.15.39:0/2445992229 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1734064f10 msgr2=0x7f17340673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:39.853 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.850+0000 7f1758e91700 1 --2- 172.21.15.39:0/2445992229 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1734064f10 0x7f17340673c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1744001c30 tx=0x7f1744009070 comp rx=0 tx=0).stop 2023-11-28T11:59:39.853 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.850+0000 7f1758e91700 1 -- 172.21.15.39:0/2445992229 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1754150600 msgr2=0x7f17540abac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:39.853 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.850+0000 7f1758e91700 1 --2- 172.21.15.39:0/2445992229 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1754150600 0x7f17540abac0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f1748011ba0 tx=0x7f1748011eb0 comp rx=0 tx=0).stop 2023-11-28T11:59:39.853 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.850+0000 7f1758e91700 1 -- 172.21.15.39:0/2445992229 shutdown_connections 2023-11-28T11:59:39.853 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.850+0000 7f1758e91700 1 --2- 172.21.15.39:0/2445992229 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1734064f10 0x7f17340673c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:39.853 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.850+0000 7f1758e91700 1 --2- 172.21.15.39:0/2445992229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17540c8450 0x7f17540ac000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:39.853 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.850+0000 7f1758e91700 1 --2- 172.21.15.39:0/2445992229 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1754150600 0x7f17540abac0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:39.853 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.850+0000 7f1758e91700 1 --2- 172.21.15.39:0/2445992229 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f173c003bb0 0x7f17541e1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:39.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.850+0000 7f1758e91700 1 -- 172.21.15.39:0/2445992229 >> 172.21.15.39:0/2445992229 conn(0x7f17540cf350 msgr2=0x7f175406af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:39.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.850+0000 7f1758e91700 1 -- 172.21.15.39:0/2445992229 shutdown_connections 2023-11-28T11:59:39.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:39.850+0000 7f1758e91700 1 -- 172.21.15.39:0/2445992229 wait complete. 2023-11-28T11:59:39.855 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 26 2023-11-28T11:59:39.875 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T11:59:39.875 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-28T11:59:39.875 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-28T11:59:39.875 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:59:39.876 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T11:59:39.876 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-28T11:59:39.876 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-28T11:59:39.876 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:59:39.876 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T11:59:39.876 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-28T11:59:39.877 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-28T11:59:39.877 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:59:39.877 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-28T11:59:39.877 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-28T11:59:39.877 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-28T11:59:39.877 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:59:39.896 INFO:tasks.ceph.mds.a:Stopped 2023-11-28T11:59:39.896 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T11:59:39.901 INFO:tasks.ceph.mds.c:Stopped 2023-11-28T11:59:39.901 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T11:59:39.902 INFO:tasks.ceph.mds.d:Stopped 2023-11-28T11:59:39.902 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-28T11:59:39.905 INFO:tasks.ceph.mds.b:Stopped 2023-11-28T11:59:39.905 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T11:59:39.954 INFO:tasks.ceph.mds.a:Started 2023-11-28T11:59:39.955 DEBUG:teuthology.parallel:result is None 2023-11-28T11:59:39.955 INFO:tasks.ceph.mds.d:Started 2023-11-28T11:59:39.955 DEBUG:teuthology.parallel:result is None 2023-11-28T11:59:39.958 INFO:tasks.ceph.mds.c:Started 2023-11-28T11:59:39.958 DEBUG:teuthology.parallel:result is None 2023-11-28T11:59:39.961 INFO:tasks.ceph.mds.b:Started 2023-11-28T11:59:39.961 DEBUG:teuthology.parallel:result is None 2023-11-28T11:59:39.962 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-28T11:59:40.075 INFO:tasks.ceph.mds.c.smithi039.stdout:starting mds.c at 2023-11-28T11:59:40.076 INFO:tasks.ceph.mds.a.smithi039.stdout:starting mds.a at 2023-11-28T11:59:40.086 INFO:tasks.ceph.mds.b.smithi184.stdout:starting mds.b at 2023-11-28T11:59:40.089 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2023-11-28T11:59:40.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.134+0000 7f16e9891700 1 Processor -- start 2023-11-28T11:59:40.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.134+0000 7f16e9891700 1 -- start start 2023-11-28T11:59:40.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.138+0000 7f16e9891700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16e40707e0 0x7f16e40b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:40.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.138+0000 7f16e9891700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f16e40b4100 0x7f16e40b0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:40.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.138+0000 7f16e9891700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16e40b4560 con 0x7f16e4159fe0 2023-11-28T11:59:40.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.138+0000 7f16e9891700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16e4071940 con 0x7f16e40b4100 2023-11-28T11:59:40.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.138+0000 7f16e9891700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e4070d30 con 0x7f16e40707e0 2023-11-28T11:59:40.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.138+0000 7f16e2ffd700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f16e4159fe0 0x7f16e406a600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:41056/0 (socket says 172.21.15.39:41056) 2023-11-28T11:59:40.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.138+0000 7f16e2ffd700 1 -- 172.21.15.39:0/2161102085 learned_addr learned my addr 172.21.15.39:0/2161102085 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:59:40.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.138+0000 7f16e3fff700 1 --2- 172.21.15.39:0/2161102085 >> v2:172.21.15.39:3300/0 conn(0x7f16e40b4100 0x7f16e40b0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:40.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.138+0000 7f16e27fc700 1 --2- 172.21.15.39:0/2161102085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16e40707e0 0x7f16e40b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:40.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.138+0000 7f16e3fff700 1 -- 172.21.15.39:0/2161102085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16e40707e0 msgr2=0x7f16e40b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:40.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.138+0000 7f16e3fff700 1 --2- 172.21.15.39:0/2161102085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16e40707e0 0x7f16e40b3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:40.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.138+0000 7f16e3fff700 1 -- 172.21.15.39:0/2161102085 >> v1:172.21.15.39:6789/0 conn(0x7f16e4159fe0 legacy=0x7f16e406a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:40.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.138+0000 7f16e3fff700 1 -- 172.21.15.39:0/2161102085 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e4071010 con 0x7f16e40b4100 2023-11-28T11:59:40.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.138+0000 7f16e1ffb700 1 -- 172.21.15.39:0/2161102085 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 290666965 0 0) 0x7f16e40b4560 con 0x7f16e4159fe0 2023-11-28T11:59:40.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.138+0000 7f16e3fff700 1 --2- 172.21.15.39:0/2161102085 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16e40b4100 0x7f16e40b0ba0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f16dc009d90 tx=0x7f16dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f14ec679105913a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:40.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.138+0000 7f16e1ffb700 1 -- 172.21.15.39:0/2161102085 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc00e070 con 0x7f16e40b4100 2023-11-28T11:59:40.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.138+0000 7f16e1ffb700 1 -- 172.21.15.39:0/2161102085 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16dc00bb20 con 0x7f16e40b4100 2023-11-28T11:59:40.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.138+0000 7f16e1ffb700 1 -- 172.21.15.39:0/2161102085 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc012430 con 0x7f16e40b4100 2023-11-28T11:59:40.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.138+0000 7f16e9891700 1 -- 172.21.15.39:0/2161102085 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16e40b4100 msgr2=0x7f16e40b0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:40.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.138+0000 7f16e9891700 1 --2- 172.21.15.39:0/2161102085 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16e40b4100 0x7f16e40b0ba0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f16dc009d90 tx=0x7f16dc00b330 comp rx=0 tx=0).stop 2023-11-28T11:59:40.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.138+0000 7f16e9891700 1 -- 172.21.15.39:0/2161102085 shutdown_connections 2023-11-28T11:59:40.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.138+0000 7f16e9891700 1 --2- 172.21.15.39:0/2161102085 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16e40b4100 0x7f16e40b0ba0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:40.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.138+0000 7f16e9891700 1 --2- 172.21.15.39:0/2161102085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16e40707e0 0x7f16e40b3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:40.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.138+0000 7f16e9891700 1 -- 172.21.15.39:0/2161102085 >> 172.21.15.39:0/2161102085 conn(0x7f16e40cebc0 msgr2=0x7f16e40cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:40.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.138+0000 7f16e9891700 1 -- 172.21.15.39:0/2161102085 shutdown_connections 2023-11-28T11:59:40.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.142+0000 7f16e9891700 1 -- 172.21.15.39:0/2161102085 wait complete. 2023-11-28T11:59:40.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.142+0000 7f16e9891700 1 Processor -- start 2023-11-28T11:59:40.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.142+0000 7f16e9891700 1 -- start start 2023-11-28T11:59:40.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.142+0000 7f16e9891700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16e40707e0 0x7f16e41f1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:40.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.142+0000 7f16e9891700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f16e40b4100 0x7f16e41f4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:40.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.142+0000 7f16e9891700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16e4159fe0 0x7f16e40acf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:40.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.142+0000 7f16e9891700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e4158ff0 con 0x7f16e4159fe0 2023-11-28T11:59:40.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.142+0000 7f16e9891700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e40ca690 con 0x7f16e40b4100 2023-11-28T11:59:40.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.142+0000 7f16e9891700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e40ca970 con 0x7f16e40707e0 2023-11-28T11:59:40.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.146+0000 7f16e3fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16e4159fe0 0x7f16e40acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:40.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.146+0000 7f16e3fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16e4159fe0 0x7f16e40acf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47112/0 (socket says 172.21.15.39:47112) 2023-11-28T11:59:40.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.146+0000 7f16e3fff700 1 -- 172.21.15.39:0/3276189098 learned_addr learned my addr 172.21.15.39:0/3276189098 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:40.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.146+0000 7f16e27fc700 1 --2- 172.21.15.39:0/3276189098 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f16e40b4100 0x7f16e41f4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:40.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.146+0000 7f16e2ffd700 1 --2- 172.21.15.39:0/3276189098 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16e40707e0 0x7f16e41f1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:40.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.146+0000 7f16e3fff700 1 -- 172.21.15.39:0/3276189098 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16e40707e0 msgr2=0x7f16e41f1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:40.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.146+0000 7f16e3fff700 1 --2- 172.21.15.39:0/3276189098 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16e40707e0 0x7f16e41f1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:40.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.146+0000 7f16e3fff700 1 -- 172.21.15.39:0/3276189098 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f16e40b4100 msgr2=0x7f16e41f4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:40.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.146+0000 7f16e3fff700 1 --2- 172.21.15.39:0/3276189098 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f16e40b4100 0x7f16e41f4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:40.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.146+0000 7f16e3fff700 1 -- 172.21.15.39:0/3276189098 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16dc009a70 con 0x7f16e4159fe0 2023-11-28T11:59:40.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.146+0000 7f16e3fff700 1 --2- 172.21.15.39:0/3276189098 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16e4159fe0 0x7f16e40acf30 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f16dc014040 tx=0x7f16dc004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:40.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.146+0000 7f16cbfff700 1 -- 172.21.15.39:0/3276189098 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc012430 con 0x7f16e4159fe0 2023-11-28T11:59:40.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.146+0000 7f16cbfff700 1 -- 172.21.15.39:0/3276189098 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16dc020070 con 0x7f16e4159fe0 2023-11-28T11:59:40.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.146+0000 7f16e9891700 1 -- 172.21.15.39:0/3276189098 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16e40715d0 con 0x7f16e4159fe0 2023-11-28T11:59:40.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.146+0000 7f16cbfff700 1 -- 172.21.15.39:0/3276189098 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc004280 con 0x7f16e4159fe0 2023-11-28T11:59:40.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.146+0000 7f16e9891700 1 -- 172.21.15.39:0/3276189098 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e40712f0 con 0x7f16e4159fe0 2023-11-28T11:59:40.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.146+0000 7f16e9891700 1 -- 172.21.15.39:0/3276189098 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16e415a3b0 con 0x7f16e4159fe0 2023-11-28T11:59:40.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.150+0000 7f16cbfff700 1 -- 172.21.15.39:0/3276189098 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f16dc0043e0 con 0x7f16e4159fe0 2023-11-28T11:59:40.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.150+0000 7f16cbfff700 1 --2- 172.21.15.39:0/3276189098 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f16d0064f10 0x7f16d00673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:40.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.150+0000 7f16cbfff700 1 -- 172.21.15.39:0/3276189098 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f16dc022070 con 0x7f16e4159fe0 2023-11-28T11:59:40.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.150+0000 7f16e2ffd700 1 --2- 172.21.15.39:0/3276189098 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f16d0064f10 0x7f16d00673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:40.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.150+0000 7f16e2ffd700 1 --2- 172.21.15.39:0/3276189098 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f16d0064f10 0x7f16d00673c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f16d4000f60 tx=0x7f16d4007c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:40.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.158+0000 7f16cbfff700 1 -- 172.21.15.39:0/3276189098 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f16dc052600 con 0x7f16e4159fe0 2023-11-28T11:59:40.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:40.338+0000 7f16e9891700 1 -- 172.21.15.39:0/3276189098 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f16e40726c0 con 0x7f16e4159fe0 2023-11-28T11:59:41.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.158+0000 7f16cbfff700 1 -- 172.21.15.39:0/3276189098 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v66) v1 ==== 97+0+0 (secure 0 0 0) 0x7f16dc055c20 con 0x7f16e4159fe0 2023-11-28T11:59:41.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.162+0000 7f16e9891700 1 -- 172.21.15.39:0/3276189098 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f16d0064f10 msgr2=0x7f16d00673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:41.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.162+0000 7f16e9891700 1 --2- 172.21.15.39:0/3276189098 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f16d0064f10 0x7f16d00673c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f16d4000f60 tx=0x7f16d4007c00 comp rx=0 tx=0).stop 2023-11-28T11:59:41.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.162+0000 7f16e9891700 1 -- 172.21.15.39:0/3276189098 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16e4159fe0 msgr2=0x7f16e40acf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:41.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.162+0000 7f16e9891700 1 --2- 172.21.15.39:0/3276189098 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16e4159fe0 0x7f16e40acf30 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f16dc014040 tx=0x7f16dc004b40 comp rx=0 tx=0).stop 2023-11-28T11:59:41.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.162+0000 7f16e9891700 1 -- 172.21.15.39:0/3276189098 shutdown_connections 2023-11-28T11:59:41.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.162+0000 7f16e9891700 1 --2- 172.21.15.39:0/3276189098 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16e4159fe0 0x7f16e40acf30 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:41.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.162+0000 7f16e9891700 1 --2- 172.21.15.39:0/3276189098 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f16d0064f10 0x7f16d00673c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:41.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.162+0000 7f16e9891700 1 --2- 172.21.15.39:0/3276189098 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f16e40b4100 0x7f16e41f4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:41.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.162+0000 7f16e9891700 1 --2- 172.21.15.39:0/3276189098 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16e40707e0 0x7f16e41f1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:41.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.162+0000 7f16e9891700 1 -- 172.21.15.39:0/3276189098 >> 172.21.15.39:0/3276189098 conn(0x7f16e40cebc0 msgr2=0x7f16e40cdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:41.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.162+0000 7f16e9891700 1 -- 172.21.15.39:0/3276189098 shutdown_connections 2023-11-28T11:59:41.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.162+0000 7f16e9891700 1 -- 172.21.15.39:0/3276189098 wait complete. 2023-11-28T11:59:41.168 INFO:teuthology.orchestra.run.smithi039.stderr: removed all blocklist entries 2023-11-28T11:59:41.190 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-28T11:59:41.376 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.370+0000 7f68c091a700 1 Processor -- start 2023-11-28T11:59:41.376 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.374+0000 7f68c091a700 1 -- start start 2023-11-28T11:59:41.378 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.374+0000 7f68c091a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f68bc06c040 0x7f68bc06c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:41.378 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.374+0000 7f68c091a700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f68bc0cafd0 0x7f68bc0cb450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:41.378 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.374+0000 7f68c091a700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68bc0cebb0 con 0x7f68bc15c3b0 2023-11-28T11:59:41.378 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.374+0000 7f68c091a700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68bc0cb990 con 0x7f68bc0cafd0 2023-11-28T11:59:41.379 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.374+0000 7f68c091a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68bc0ce5f0 con 0x7f68bc06c040 2023-11-28T11:59:41.379 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.374+0000 7f68ba59c700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f68bc15c3b0 0x7f68bc0d00b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:41064/0 (socket says 172.21.15.39:41064) 2023-11-28T11:59:41.379 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.374+0000 7f68ba59c700 1 -- 172.21.15.39:0/406465888 learned_addr learned my addr 172.21.15.39:0/406465888 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:59:41.379 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.374+0000 7f68bad9d700 1 --2- 172.21.15.39:0/406465888 >> v2:172.21.15.184:3300/0 conn(0x7f68bc0cafd0 0x7f68bc0cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:41.379 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.374+0000 7f68b9d9b700 1 --2- 172.21.15.39:0/406465888 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f68bc06c040 0x7f68bc06c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:41.380 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.378+0000 7f68b959a700 1 -- 172.21.15.39:0/406465888 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3574769064 0 0) 0x7f68bc0cebb0 con 0x7f68bc15c3b0 2023-11-28T11:59:41.380 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.378+0000 7f68b959a700 1 -- 172.21.15.39:0/406465888 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68a40035d0 con 0x7f68bc15c3b0 2023-11-28T11:59:41.380 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.378+0000 7f68b9d9b700 1 -- 172.21.15.39:0/406465888 >> v2:172.21.15.184:3300/0 conn(0x7f68bc0cafd0 msgr2=0x7f68bc0cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:41.381 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.378+0000 7f68b9d9b700 1 --2- 172.21.15.39:0/406465888 >> v2:172.21.15.184:3300/0 conn(0x7f68bc0cafd0 0x7f68bc0cb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:41.381 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.378+0000 7f68b9d9b700 1 -- 172.21.15.39:0/406465888 >> v1:172.21.15.39:6789/0 conn(0x7f68bc15c3b0 legacy=0x7f68bc0d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:41.381 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.378+0000 7f68b9d9b700 1 -- 172.21.15.39:0/406465888 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68bc0ce8d0 con 0x7f68bc06c040 2023-11-28T11:59:41.381 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.378+0000 7f68b9d9b700 1 --2- 172.21.15.39:0/406465888 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f68bc06c040 0x7f68bc06c490 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f68b0009850 tx=0x7f68b0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d84edb30e10f6ea server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:41.382 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.378+0000 7f68b959a700 1 -- 172.21.15.39:0/406465888 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b0011830 con 0x7f68bc06c040 2023-11-28T11:59:41.382 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.378+0000 7f68b959a700 1 -- 172.21.15.39:0/406465888 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b0011990 con 0x7f68bc06c040 2023-11-28T11:59:41.382 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.378+0000 7f68b959a700 1 -- 172.21.15.39:0/406465888 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b0011d00 con 0x7f68bc06c040 2023-11-28T11:59:41.383 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.378+0000 7f68c091a700 1 -- 172.21.15.39:0/406465888 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f68bc06c040 msgr2=0x7f68bc06c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:41.383 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.378+0000 7f68c091a700 1 --2- 172.21.15.39:0/406465888 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f68bc06c040 0x7f68bc06c490 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f68b0009850 tx=0x7f68b0009b60 comp rx=0 tx=0).stop 2023-11-28T11:59:41.383 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.378+0000 7f68c091a700 1 -- 172.21.15.39:0/406465888 shutdown_connections 2023-11-28T11:59:41.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.378+0000 7f68c091a700 1 --2- 172.21.15.39:0/406465888 >> v2:172.21.15.184:3300/0 conn(0x7f68bc0cafd0 0x7f68bc0cb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:41.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.378+0000 7f68c091a700 1 --2- 172.21.15.39:0/406465888 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f68bc06c040 0x7f68bc06c490 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:41.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.378+0000 7f68c091a700 1 -- 172.21.15.39:0/406465888 >> 172.21.15.39:0/406465888 conn(0x7f68bc06e520 msgr2=0x7f68bc06e920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:41.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.378+0000 7f68c091a700 1 -- 172.21.15.39:0/406465888 shutdown_connections 2023-11-28T11:59:41.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.378+0000 7f68c091a700 1 -- 172.21.15.39:0/406465888 wait complete. 2023-11-28T11:59:41.387 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.382+0000 7f68c091a700 1 Processor -- start 2023-11-28T11:59:41.387 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.382+0000 7f68c091a700 1 -- start start 2023-11-28T11:59:41.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.386+0000 7f68c091a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f68bc06c040 0x7f68bc0b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:41.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.386+0000 7f68c091a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f68bc0cafd0 0x7f68bc0b0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:41.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.386+0000 7f68c091a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68bc15c3b0 0x7f68bc0c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:41.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.386+0000 7f68c091a700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68bc0b3310 con 0x7f68bc06c040 2023-11-28T11:59:41.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.386+0000 7f68c091a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68bc15b700 con 0x7f68bc15c3b0 2023-11-28T11:59:41.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.386+0000 7f68c091a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68bc0c5340 con 0x7f68bc0cafd0 2023-11-28T11:59:41.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.386+0000 7f68ba59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f68bc06c040 0x7f68bc0b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:41.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.386+0000 7f68ba59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f68bc06c040 0x7f68bc0b2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47120/0 (socket says 172.21.15.39:47120) 2023-11-28T11:59:41.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.386+0000 7f68ba59c700 1 -- 172.21.15.39:0/3692119142 learned_addr learned my addr 172.21.15.39:0/3692119142 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:41.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.386+0000 7f68b9d9b700 1 --2- 172.21.15.39:0/3692119142 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f68bc0cafd0 0x7f68bc0b0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:41.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.386+0000 7f68bad9d700 1 --2- 172.21.15.39:0/3692119142 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68bc15c3b0 0x7f68bc0c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:41.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.386+0000 7f68ba59c700 1 -- 172.21.15.39:0/3692119142 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f68bc0cafd0 msgr2=0x7f68bc0b0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:41.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.386+0000 7f68ba59c700 1 --2- 172.21.15.39:0/3692119142 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f68bc0cafd0 0x7f68bc0b0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:41.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.386+0000 7f68ba59c700 1 -- 172.21.15.39:0/3692119142 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68bc15c3b0 msgr2=0x7f68bc0c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:41.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.386+0000 7f68ba59c700 1 --2- 172.21.15.39:0/3692119142 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68bc15c3b0 0x7f68bc0c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:41.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.386+0000 7f68ba59c700 1 -- 172.21.15.39:0/3692119142 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b00094b0 con 0x7f68bc06c040 2023-11-28T11:59:41.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.386+0000 7f68ba59c700 1 --2- 172.21.15.39:0/3692119142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f68bc06c040 0x7f68bc0b2dd0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f68ac00cad0 tx=0x7f68ac00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:41.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.386+0000 7f68aaffd700 1 -- 172.21.15.39:0/3692119142 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac007480 con 0x7f68bc06c040 2023-11-28T11:59:41.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.386+0000 7f68aaffd700 1 -- 172.21.15.39:0/3692119142 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ac0075e0 con 0x7f68bc06c040 2023-11-28T11:59:41.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.386+0000 7f68aaffd700 1 -- 172.21.15.39:0/3692119142 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac007970 con 0x7f68bc06c040 2023-11-28T11:59:41.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.386+0000 7f68c091a700 1 -- 172.21.15.39:0/3692119142 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68bc06bb20 con 0x7f68bc06c040 2023-11-28T11:59:41.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.386+0000 7f68c091a700 1 -- 172.21.15.39:0/3692119142 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68bc06b840 con 0x7f68bc06c040 2023-11-28T11:59:41.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.390+0000 7f68c091a700 1 -- 172.21.15.39:0/3692119142 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68bc15fe30 con 0x7f68bc06c040 2023-11-28T11:59:41.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.390+0000 7f68aaffd700 1 -- 172.21.15.39:0/3692119142 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f68ac019030 con 0x7f68bc06c040 2023-11-28T11:59:41.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.390+0000 7f68aaffd700 1 --2- 172.21.15.39:0/3692119142 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f689c064ee0 0x7f689c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:41.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.390+0000 7f68aaffd700 1 -- 172.21.15.39:0/3692119142 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f68ac0815e0 con 0x7f68bc06c040 2023-11-28T11:59:41.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.394+0000 7f68b9d9b700 1 --2- 172.21.15.39:0/3692119142 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f689c064ee0 0x7f689c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:41.397 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.394+0000 7f68b9d9b700 1 --2- 172.21.15.39:0/3692119142 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f689c064ee0 0x7f689c067390 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f68b00090b0 tx=0x7f68b0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:41.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.398+0000 7f68aaffd700 1 -- 172.21.15.39:0/3692119142 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f68ac04f7c0 con 0x7f68bc06c040 2023-11-28T11:59:41.631 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.626+0000 7f68c091a700 1 -- 172.21.15.39:0/3692119142 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f68bc0726c0 con 0x7f68bc06c040 2023-11-28T11:59:41.632 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.630+0000 7f68aaffd700 1 -- 172.21.15.39:0/3692119142 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+5298 (secure 0 0 0) 0x7f68ac017090 con 0x7f68bc06c040 2023-11-28T11:59:41.633 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:59:41.633 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2023-11-28T11:59:41.633 INFO:teuthology.orchestra.run.smithi039.stdout: "auth_dump": [ 2023-11-28T11:59:41.633 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:59:41.633 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mds.a", 2023-11-28T11:59:41.633 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQA01WVlQyBbKxAAY5bRNsaX8hfv1p9qFxGk7A==", 2023-11-28T11:59:41.633 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:59:41.633 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2023-11-28T11:59:41.633 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow *", 2023-11-28T11:59:41.633 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow *", 2023-11-28T11:59:41.634 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:59:41.634 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:59:41.634 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:59:41.634 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:59:41.634 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mds.b", 2023-11-28T11:59:41.634 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQA11WVlZB1uAxAAzd+69PaNzatkv+qGZhwEng==", 2023-11-28T11:59:41.634 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:59:41.634 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2023-11-28T11:59:41.634 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow *", 2023-11-28T11:59:41.634 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow *", 2023-11-28T11:59:41.634 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:59:41.634 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:59:41.634 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:59:41.635 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:59:41.635 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mds.c", 2023-11-28T11:59:41.635 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQA01WVltd/PNhAARPTeQ/ls/8rykZx5Nqpdaw==", 2023-11-28T11:59:41.635 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:59:41.635 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2023-11-28T11:59:41.635 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow *", 2023-11-28T11:59:41.635 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow *", 2023-11-28T11:59:41.635 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:59:41.635 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:59:41.635 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:59:41.635 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:59:41.635 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mds.d", 2023-11-28T11:59:41.636 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQA11WVl3BKfDhAABJE0cb9fBNb7Sy9gC8wS7w==", 2023-11-28T11:59:41.636 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:59:41.636 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2023-11-28T11:59:41.636 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow *", 2023-11-28T11:59:41.636 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow *", 2023-11-28T11:59:41.636 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:59:41.636 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:59:41.636 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:59:41.636 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:59:41.636 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.0", 2023-11-28T11:59:41.636 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQA81WVlStbVERAAQPnXIt45pPKg99io3w4nHA==", 2023-11-28T11:59:41.636 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:59:41.637 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2023-11-28T11:59:41.637 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2023-11-28T11:59:41.637 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:59:41.637 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:59:41.637 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:59:41.637 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:59:41.637 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.1", 2023-11-28T11:59:41.637 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQA/1WVlrdM7IxAA2g0ZCNubjLlQMt1fSQxrFQ==", 2023-11-28T11:59:41.637 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:59:41.637 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2023-11-28T11:59:41.637 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2023-11-28T11:59:41.637 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:59:41.637 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:59:41.638 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:59:41.638 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:59:41.638 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.2", 2023-11-28T11:59:41.638 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQBC1WVlg3ITMhAAm9eJaDLqZDJ0cZGrMdcAdQ==", 2023-11-28T11:59:41.638 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:59:41.638 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2023-11-28T11:59:41.638 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2023-11-28T11:59:41.638 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:59:41.638 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:59:41.638 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:59:41.638 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:59:41.638 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.3", 2023-11-28T11:59:41.638 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQBG1WVliM+vBhAAGP25Wh7MAPte/DgAH0t2sg==", 2023-11-28T11:59:41.639 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:59:41.639 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2023-11-28T11:59:41.639 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2023-11-28T11:59:41.639 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:59:41.639 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:59:41.639 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:59:41.639 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:59:41.639 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.4", 2023-11-28T11:59:41.639 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQBM1WVlFgQ0HxAAoisaw/l1WjPkX6ndrRC9zw==", 2023-11-28T11:59:41.639 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:59:41.639 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2023-11-28T11:59:41.639 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2023-11-28T11:59:41.640 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:59:41.640 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:59:41.640 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:59:41.640 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:59:41.640 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.5", 2023-11-28T11:59:41.640 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQBQ1WVlIGsdARAAFGnkOWG4A4wMr68uP8c73A==", 2023-11-28T11:59:41.640 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:59:41.640 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2023-11-28T11:59:41.640 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2023-11-28T11:59:41.640 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:59:41.640 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:59:41.640 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:59:41.641 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:59:41.641 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.6", 2023-11-28T11:59:41.641 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQBT1WVl7WokEBAAARrh+05BXBzm8tJPplREMg==", 2023-11-28T11:59:41.641 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:59:41.641 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2023-11-28T11:59:41.641 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2023-11-28T11:59:41.641 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:59:41.641 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:59:41.641 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:59:41.641 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:59:41.641 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.7", 2023-11-28T11:59:41.641 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQBW1WVl/yFiHhAAzxVK7EGFHEK0oEyqjaJ8uQ==", 2023-11-28T11:59:41.641 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:59:41.642 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2023-11-28T11:59:41.642 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2023-11-28T11:59:41.642 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:59:41.642 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:59:41.642 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:59:41.642 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:59:41.642 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.0", 2023-11-28T11:59:41.642 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQA11WVlc1G2FRAAQ7OTgUCsPgSquiptDBs73Q==", 2023-11-28T11:59:41.642 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:59:41.642 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2023-11-28T11:59:41.642 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow r", 2023-11-28T11:59:41.642 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow rw pool=cephfs_data" 2023-11-28T11:59:41.643 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:59:41.643 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:59:41.643 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:59:41.643 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.1", 2023-11-28T11:59:41.643 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQA11WVlrvFzIhAAgF6N85WgJkyxjS5R19vj2A==", 2023-11-28T11:59:41.643 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:59:41.643 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2023-11-28T11:59:41.643 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow r", 2023-11-28T11:59:41.643 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow rw", 2023-11-28T11:59:41.643 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow rwx" 2023-11-28T11:59:41.643 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:59:41.643 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:59:41.643 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:59:41.644 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.2", 2023-11-28T11:59:41.644 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQA11WVlWm/8GxAAXdoSzGMMGGRpddGUgipXaw==", 2023-11-28T11:59:41.644 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:59:41.644 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2023-11-28T11:59:41.644 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow r", 2023-11-28T11:59:41.644 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow rw", 2023-11-28T11:59:41.644 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow rwx" 2023-11-28T11:59:41.644 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:59:41.644 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:59:41.644 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:59:41.644 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.3", 2023-11-28T11:59:41.644 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQA11WVlhyZcKBAARWiULAwCFB1cHeFUgPlYKQ==", 2023-11-28T11:59:41.645 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:59:41.645 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2023-11-28T11:59:41.645 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow r", 2023-11-28T11:59:41.645 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow rw", 2023-11-28T11:59:41.645 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow rwx" 2023-11-28T11:59:41.645 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:59:41.645 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:59:41.645 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:59:41.645 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.admin", 2023-11-28T11:59:41.645 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQA01WVl0bEeARAAf2Z53D+fRxlgR+ySp2GojQ==", 2023-11-28T11:59:41.645 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:59:41.645 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow *", 2023-11-28T11:59:41.646 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow *", 2023-11-28T11:59:41.646 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow *", 2023-11-28T11:59:41.646 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:59:41.646 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:59:41.646 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:59:41.646 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:59:41.646 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mgr.x", 2023-11-28T11:59:41.646 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQA01WVlZ2c8JBAAZIy0cQXW2ZvyFXfMMhU66g==", 2023-11-28T11:59:41.646 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:59:41.646 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow *", 2023-11-28T11:59:41.646 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile mgr", 2023-11-28T11:59:41.646 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:59:41.646 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:59:41.647 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:59:41.647 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:59:41.647 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mgr.y", 2023-11-28T11:59:41.647 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQA01WVl2MuIHRAAJcRCzINF6RaIyQSyE4VLgQ==", 2023-11-28T11:59:41.647 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-11-28T11:59:41.647 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow *", 2023-11-28T11:59:41.647 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile mgr", 2023-11-28T11:59:41.647 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-11-28T11:59:41.647 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:59:41.647 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:59:41.647 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2023-11-28T11:59:41.648 INFO:teuthology.orchestra.run.smithi039.stdout:} 2023-11-28T11:59:41.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.630+0000 7f68c091a700 1 -- 172.21.15.39:0/3692119142 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f689c064ee0 msgr2=0x7f689c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:41.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.630+0000 7f68c091a700 1 --2- 172.21.15.39:0/3692119142 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f689c064ee0 0x7f689c067390 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f68b00090b0 tx=0x7f68b0008030 comp rx=0 tx=0).stop 2023-11-28T11:59:41.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.630+0000 7f68c091a700 1 -- 172.21.15.39:0/3692119142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f68bc06c040 msgr2=0x7f68bc0b2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:41.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.630+0000 7f68c091a700 1 --2- 172.21.15.39:0/3692119142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f68bc06c040 0x7f68bc0b2dd0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f68ac00cad0 tx=0x7f68ac00cb00 comp rx=0 tx=0).stop 2023-11-28T11:59:41.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.630+0000 7f68c091a700 1 -- 172.21.15.39:0/3692119142 shutdown_connections 2023-11-28T11:59:41.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.630+0000 7f68c091a700 1 --2- 172.21.15.39:0/3692119142 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f689c064ee0 0x7f689c067390 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:41.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.630+0000 7f68c091a700 1 --2- 172.21.15.39:0/3692119142 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68bc15c3b0 0x7f68bc0c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:41.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.630+0000 7f68c091a700 1 --2- 172.21.15.39:0/3692119142 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f68bc0cafd0 0x7f68bc0b0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:41.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.630+0000 7f68c091a700 1 --2- 172.21.15.39:0/3692119142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f68bc06c040 0x7f68bc0b2dd0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:41.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.630+0000 7f68c091a700 1 -- 172.21.15.39:0/3692119142 >> 172.21.15.39:0/3692119142 conn(0x7f68bc06e520 msgr2=0x7f68bc0b40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:41.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.630+0000 7f68c091a700 1 -- 172.21.15.39:0/3692119142 shutdown_connections 2023-11-28T11:59:41.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.630+0000 7f68c091a700 1 -- 172.21.15.39:0/3692119142 wait complete. 2023-11-28T11:59:41.660 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:59:41.835 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.830+0000 7fd8cb529700 1 Processor -- start 2023-11-28T11:59:41.835 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.830+0000 7fd8cb529700 1 -- start start 2023-11-28T11:59:41.837 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.834+0000 7fd8cb529700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd8c40b1640 0x7fd8c4070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:41.837 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.834+0000 7fd8cb529700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8c415a550 con 0x7fd8c40c9040 2023-11-28T11:59:41.837 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.834+0000 7fd8cb529700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8c406b0a0 con 0x7fd8c40b43a0 2023-11-28T11:59:41.837 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.834+0000 7fd8cb529700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8c40caac0 con 0x7fd8c40b1640 2023-11-28T11:59:41.838 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.834+0000 7fd8cad28700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fd8c40c9040 0x7fd8c406bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:41066/0 (socket says 172.21.15.39:41066) 2023-11-28T11:59:41.838 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.834+0000 7fd8cad28700 1 -- 172.21.15.39:0/2720677321 learned_addr learned my addr 172.21.15.39:0/2720677321 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:59:41.838 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.834+0000 7fd8c9d26700 1 --2- 172.21.15.39:0/2720677321 >> v2:172.21.15.39:3300/0 conn(0x7fd8c40b1640 0x7fd8c4070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:41.839 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.834+0000 7fd8c9525700 1 -- 172.21.15.39:0/2720677321 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3571262192 0 0) 0x7fd8bc001490 con 0x7fd8c40c9040 2023-11-28T11:59:41.839 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.834+0000 7fd8c9525700 1 -- 172.21.15.39:0/2720677321 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8b00035d0 con 0x7fd8c40c9040 2023-11-28T11:59:41.839 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.834+0000 7fd8c9d26700 1 -- 172.21.15.39:0/2720677321 >> v1:172.21.15.184:6789/0 conn(0x7fd8c40b43a0 legacy=0x7fd8c415e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:41.839 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.834+0000 7fd8c9525700 1 -- 172.21.15.39:0/2720677321 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3592629513 0 0) 0x7fd8c406b0a0 con 0x7fd8c40b43a0 2023-11-28T11:59:41.839 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.834+0000 7fd8c9d26700 1 -- 172.21.15.39:0/2720677321 >> v1:172.21.15.39:6789/0 conn(0x7fd8c40c9040 legacy=0x7fd8c406bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:41.839 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.834+0000 7fd8c9d26700 1 -- 172.21.15.39:0/2720677321 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c40cada0 con 0x7fd8c40b1640 2023-11-28T11:59:41.840 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.834+0000 7fd8c9d26700 1 --2- 172.21.15.39:0/2720677321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8c40b1640 0x7fd8c4070080 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4009850 tx=0x7fd8b4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7fc2cedb9e6974e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:41.840 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.834+0000 7fd8c9525700 1 -- 172.21.15.39:0/2720677321 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4011830 con 0x7fd8c40b1640 2023-11-28T11:59:41.840 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.834+0000 7fd8c9525700 1 -- 172.21.15.39:0/2720677321 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b4011990 con 0x7fd8c40b1640 2023-11-28T11:59:41.840 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.834+0000 7fd8c9525700 1 -- 172.21.15.39:0/2720677321 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4011d40 con 0x7fd8c40b1640 2023-11-28T11:59:41.841 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.838+0000 7fd8cb529700 1 -- 172.21.15.39:0/2720677321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8c40b1640 msgr2=0x7fd8c4070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:41.841 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.838+0000 7fd8cb529700 1 --2- 172.21.15.39:0/2720677321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8c40b1640 0x7fd8c4070080 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4009850 tx=0x7fd8b4009b60 comp rx=0 tx=0).stop 2023-11-28T11:59:41.841 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.838+0000 7fd8cb529700 1 -- 172.21.15.39:0/2720677321 shutdown_connections 2023-11-28T11:59:41.842 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.838+0000 7fd8cb529700 1 --2- 172.21.15.39:0/2720677321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8c40b1640 0x7fd8c4070080 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:41.842 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.838+0000 7fd8cb529700 1 -- 172.21.15.39:0/2720677321 >> 172.21.15.39:0/2720677321 conn(0x7fd8c40b0f80 msgr2=0x7fd8c40ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:41.842 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.838+0000 7fd8cb529700 1 -- 172.21.15.39:0/2720677321 shutdown_connections 2023-11-28T11:59:41.842 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.838+0000 7fd8cb529700 1 -- 172.21.15.39:0/2720677321 wait complete. 2023-11-28T11:59:41.844 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.838+0000 7fd8cb529700 1 Processor -- start 2023-11-28T11:59:41.844 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.842+0000 7fd8cb529700 1 -- start start 2023-11-28T11:59:41.846 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.842+0000 7fd8cb529700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8c40b1640 0x7fd8c4157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:41.846 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.842+0000 7fd8cb529700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8c40b43a0 0x7fd8c40b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:41.846 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.842+0000 7fd8cb529700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8c40c9040 0x7fd8c40ac6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:41.846 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.842+0000 7fd8cb529700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c41f60e0 con 0x7fd8c40b43a0 2023-11-28T11:59:41.846 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.842+0000 7fd8cb529700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c40b33e0 con 0x7fd8c40b1640 2023-11-28T11:59:41.846 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.842+0000 7fd8cb529700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c4156e20 con 0x7fd8c40c9040 2023-11-28T11:59:41.848 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.842+0000 7fd8c9d26700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8c40b43a0 0x7fd8c40b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:41.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.842+0000 7fd8c9d26700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8c40b43a0 0x7fd8c40b2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47136/0 (socket says 172.21.15.39:47136) 2023-11-28T11:59:41.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.842+0000 7fd8c9d26700 1 -- 172.21.15.39:0/979486362 learned_addr learned my addr 172.21.15.39:0/979486362 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:41.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.842+0000 7fd8ca527700 1 --2- 172.21.15.39:0/979486362 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8c40b1640 0x7fd8c4157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:41.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.842+0000 7fd8cad28700 1 --2- 172.21.15.39:0/979486362 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8c40c9040 0x7fd8c40ac6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:41.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.842+0000 7fd8c9d26700 1 -- 172.21.15.39:0/979486362 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8c40c9040 msgr2=0x7fd8c40ac6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:41.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.842+0000 7fd8c9d26700 1 --2- 172.21.15.39:0/979486362 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8c40c9040 0x7fd8c40ac6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:41.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.842+0000 7fd8c9d26700 1 -- 172.21.15.39:0/979486362 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8c40b1640 msgr2=0x7fd8c4157ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:41.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.842+0000 7fd8c9d26700 1 --2- 172.21.15.39:0/979486362 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8c40b1640 0x7fd8c4157ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:41.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.842+0000 7fd8c9d26700 1 -- 172.21.15.39:0/979486362 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b40094b0 con 0x7fd8c40b43a0 2023-11-28T11:59:41.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.842+0000 7fd8cad28700 1 --2- 172.21.15.39:0/979486362 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8c40c9040 0x7fd8c40ac6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:59:41.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.842+0000 7fd8c9d26700 1 --2- 172.21.15.39:0/979486362 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8c40b43a0 0x7fd8c40b2ea0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd8b40090b0 tx=0x7fd8b4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:41.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.842+0000 7fd8baffd700 1 -- 172.21.15.39:0/979486362 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4019b60 con 0x7fd8c40b43a0 2023-11-28T11:59:41.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.842+0000 7fd8baffd700 1 -- 172.21.15.39:0/979486362 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b401e070 con 0x7fd8c40b43a0 2023-11-28T11:59:41.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.842+0000 7fd8cb529700 1 -- 172.21.15.39:0/979486362 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c406b5d0 con 0x7fd8c40b43a0 2023-11-28T11:59:41.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.842+0000 7fd8baffd700 1 -- 172.21.15.39:0/979486362 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b401a420 con 0x7fd8c40b43a0 2023-11-28T11:59:41.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.842+0000 7fd8cb529700 1 -- 172.21.15.39:0/979486362 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c406b2f0 con 0x7fd8c40b43a0 2023-11-28T11:59:41.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.846+0000 7fd8cb529700 1 -- 172.21.15.39:0/979486362 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8c40ca7b0 con 0x7fd8c40b43a0 2023-11-28T11:59:41.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.846+0000 7fd8baffd700 1 -- 172.21.15.39:0/979486362 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd8b400f050 con 0x7fd8c40b43a0 2023-11-28T11:59:41.852 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.850+0000 7fd8baffd700 1 --2- 172.21.15.39:0/979486362 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd8a8064ee0 0x7fd8a8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:41.852 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.850+0000 7fd8baffd700 1 -- 172.21.15.39:0/979486362 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fd8b4082e50 con 0x7fd8c40b43a0 2023-11-28T11:59:41.853 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.850+0000 7fd8ca527700 1 --2- 172.21.15.39:0/979486362 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd8a8064ee0 0x7fd8a8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:41.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.850+0000 7fd8ca527700 1 --2- 172.21.15.39:0/979486362 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd8a8064ee0 0x7fd8a8067390 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0000f60 tx=0x7fd8c0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:41.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:41.854+0000 7fd8baffd700 1 -- 172.21.15.39:0/979486362 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd8b4051110 con 0x7fd8c40b43a0 2023-11-28T11:59:42.040 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.034+0000 7fd8cb529700 1 -- 172.21.15.39:0/979486362 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8c4073cb0 con 0x7fd8c40b43a0 2023-11-28T11:59:42.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.038+0000 7fd8baffd700 1 -- 172.21.15.39:0/979486362 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+14376 (secure 0 0 0) 0x7fd8b4020090 con 0x7fd8c40b43a0 2023-11-28T11:59:42.043 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:59:42.043 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":66,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:59:41.138351+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:59:42.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.042+0000 7fd8cb529700 1 -- 172.21.15.39:0/979486362 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd8a8064ee0 msgr2=0x7fd8a8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:42.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.042+0000 7fd8cb529700 1 --2- 172.21.15.39:0/979486362 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd8a8064ee0 0x7fd8a8067390 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0000f60 tx=0x7fd8c0009040 comp rx=0 tx=0).stop 2023-11-28T11:59:42.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.042+0000 7fd8cb529700 1 -- 172.21.15.39:0/979486362 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8c40b43a0 msgr2=0x7fd8c40b2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:42.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.042+0000 7fd8cb529700 1 --2- 172.21.15.39:0/979486362 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8c40b43a0 0x7fd8c40b2ea0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd8b40090b0 tx=0x7fd8b4004770 comp rx=0 tx=0).stop 2023-11-28T11:59:42.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.042+0000 7fd8cb529700 1 -- 172.21.15.39:0/979486362 shutdown_connections 2023-11-28T11:59:42.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.042+0000 7fd8cb529700 1 --2- 172.21.15.39:0/979486362 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8c40c9040 0x7fd8c40ac6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:42.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.042+0000 7fd8cb529700 1 --2- 172.21.15.39:0/979486362 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8c40b43a0 0x7fd8c40b2ea0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:42.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.042+0000 7fd8cb529700 1 --2- 172.21.15.39:0/979486362 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd8a8064ee0 0x7fd8a8067390 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:42.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.042+0000 7fd8cb529700 1 --2- 172.21.15.39:0/979486362 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8c40b1640 0x7fd8c4157ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:42.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.042+0000 7fd8cb529700 1 -- 172.21.15.39:0/979486362 >> 172.21.15.39:0/979486362 conn(0x7fd8c40b0f80 msgr2=0x7fd8c4158410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:42.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.042+0000 7fd8cb529700 1 -- 172.21.15.39:0/979486362 shutdown_connections 2023-11-28T11:59:42.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.042+0000 7fd8cb529700 1 -- 172.21.15.39:0/979486362 wait complete. 2023-11-28T11:59:42.070 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:56:26.631457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:56:33.242202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:59:42.070 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:59:42.254 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.250+0000 7fd470c6d700 1 Processor -- start 2023-11-28T11:59:42.255 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.250+0000 7fd470c6d700 1 -- start start 2023-11-28T11:59:42.257 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.254+0000 7fd470c6d700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd46c15c150 0x7fd46c0b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:42.257 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.254+0000 7fd470c6d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd46c06ff10 0x7fd46c070360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:42.257 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.254+0000 7fd470c6d700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd46c15c520 con 0x7fd46c15fc30 2023-11-28T11:59:42.257 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.254+0000 7fd470c6d700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd46c0b4240 con 0x7fd46c15c150 2023-11-28T11:59:42.257 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.254+0000 7fd470c6d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c0708a0 con 0x7fd46c06ff10 2023-11-28T11:59:42.258 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.254+0000 7fd46b7fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd46c15c150 0x7fd46c0b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:42.258 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.254+0000 7fd46b7fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd46c15c150 0x7fd46c0b3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47144/0 (socket says 172.21.15.39:47144) 2023-11-28T11:59:42.258 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.254+0000 7fd46b7fe700 1 -- 172.21.15.39:0/1520101653 learned_addr learned my addr 172.21.15.39:0/1520101653 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:42.258 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.254+0000 7fd46affd700 1 --2- 172.21.15.39:0/1520101653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd46c06ff10 0x7fd46c070360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:42.259 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.254+0000 7fd46a7fc700 1 -- 172.21.15.39:0/1520101653 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 430998906 0 0) 0x7fd46c15c520 con 0x7fd46c15fc30 2023-11-28T11:59:42.259 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.254+0000 7fd46a7fc700 1 -- 172.21.15.39:0/1520101653 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4540035d0 con 0x7fd46c15fc30 2023-11-28T11:59:42.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.254+0000 7fd46b7fe700 1 -- 172.21.15.39:0/1520101653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd46c06ff10 msgr2=0x7fd46c070360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:42.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.254+0000 7fd46b7fe700 1 --2- 172.21.15.39:0/1520101653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd46c06ff10 0x7fd46c070360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:42.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.254+0000 7fd46b7fe700 1 -- 172.21.15.39:0/1520101653 >> v1:172.21.15.184:6789/0 conn(0x7fd46c15fc30 legacy=0x7fd46c1600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:42.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.254+0000 7fd46b7fe700 1 -- 172.21.15.39:0/1520101653 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46c06ac00 con 0x7fd46c15c150 2023-11-28T11:59:42.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.254+0000 7fd46b7fe700 1 --2- 172.21.15.39:0/1520101653 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd46c15c150 0x7fd46c0b3d00 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fd45c009910 tx=0x7fd45c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26df89b5a0165a23 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:42.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.258+0000 7fd46a7fc700 1 -- 172.21.15.39:0/1520101653 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c011830 con 0x7fd46c15c150 2023-11-28T11:59:42.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.258+0000 7fd46a7fc700 1 -- 172.21.15.39:0/1520101653 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45c011990 con 0x7fd46c15c150 2023-11-28T11:59:42.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.258+0000 7fd46a7fc700 1 -- 172.21.15.39:0/1520101653 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c011d40 con 0x7fd46c15c150 2023-11-28T11:59:42.262 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.258+0000 7fd470c6d700 1 -- 172.21.15.39:0/1520101653 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd46c15c150 msgr2=0x7fd46c0b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:42.262 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.258+0000 7fd470c6d700 1 --2- 172.21.15.39:0/1520101653 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd46c15c150 0x7fd46c0b3d00 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fd45c009910 tx=0x7fd45c009c20 comp rx=0 tx=0).stop 2023-11-28T11:59:42.262 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.258+0000 7fd470c6d700 1 -- 172.21.15.39:0/1520101653 shutdown_connections 2023-11-28T11:59:42.262 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.258+0000 7fd470c6d700 1 --2- 172.21.15.39:0/1520101653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd46c06ff10 0x7fd46c070360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:42.262 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.258+0000 7fd470c6d700 1 --2- 172.21.15.39:0/1520101653 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd46c15c150 0x7fd46c0b3d00 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:42.262 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.258+0000 7fd470c6d700 1 -- 172.21.15.39:0/1520101653 >> 172.21.15.39:0/1520101653 conn(0x7fd46c0d3680 msgr2=0x7fd46c0cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:42.263 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.258+0000 7fd470c6d700 1 -- 172.21.15.39:0/1520101653 shutdown_connections 2023-11-28T11:59:42.263 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.258+0000 7fd470c6d700 1 -- 172.21.15.39:0/1520101653 wait complete. 2023-11-28T11:59:42.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.262+0000 7fd470c6d700 1 Processor -- start 2023-11-28T11:59:42.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.262+0000 7fd470c6d700 1 -- start start 2023-11-28T11:59:42.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.262+0000 7fd470c6d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd46c06ff10 0x7fd46c0cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:42.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.262+0000 7fd470c6d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd46c15c150 0x7fd46c0caf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:42.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.262+0000 7fd470c6d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd46c15fc30 0x7fd46c1f4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:42.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.262+0000 7fd470c6d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c0caae0 con 0x7fd46c06ff10 2023-11-28T11:59:42.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.262+0000 7fd470c6d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c0c9ed0 con 0x7fd46c15c150 2023-11-28T11:59:42.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.262+0000 7fd470c6d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c0ca1b0 con 0x7fd46c15fc30 2023-11-28T11:59:42.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.266+0000 7fd46b7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd46c06ff10 0x7fd46c0cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:42.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.266+0000 7fd46b7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd46c06ff10 0x7fd46c0cedd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47152/0 (socket says 172.21.15.39:47152) 2023-11-28T11:59:42.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.266+0000 7fd46b7fe700 1 -- 172.21.15.39:0/3711312116 learned_addr learned my addr 172.21.15.39:0/3711312116 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:42.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.266+0000 7fd46affd700 1 --2- 172.21.15.39:0/3711312116 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd46c15c150 0x7fd46c0caf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:42.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.266+0000 7fd46bfff700 1 --2- 172.21.15.39:0/3711312116 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd46c15fc30 0x7fd46c1f4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:42.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.266+0000 7fd46b7fe700 1 -- 172.21.15.39:0/3711312116 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd46c15fc30 msgr2=0x7fd46c1f4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:42.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.266+0000 7fd46b7fe700 1 --2- 172.21.15.39:0/3711312116 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd46c15fc30 0x7fd46c1f4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:42.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.266+0000 7fd46b7fe700 1 -- 172.21.15.39:0/3711312116 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd46c15c150 msgr2=0x7fd46c0caf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:42.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.266+0000 7fd46b7fe700 1 --2- 172.21.15.39:0/3711312116 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd46c15c150 0x7fd46c0caf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:42.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.266+0000 7fd46b7fe700 1 -- 172.21.15.39:0/3711312116 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd45c009570 con 0x7fd46c06ff10 2023-11-28T11:59:42.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.266+0000 7fd46bfff700 1 --2- 172.21.15.39:0/3711312116 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd46c15fc30 0x7fd46c1f4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:59:42.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.266+0000 7fd46affd700 1 --2- 172.21.15.39:0/3711312116 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd46c15c150 0x7fd46c0caf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:42.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.266+0000 7fd46b7fe700 1 --2- 172.21.15.39:0/3711312116 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd46c06ff10 0x7fd46c0cedd0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fd45c000c00 tx=0x7fd45c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:42.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.266+0000 7fd453fff700 1 -- 172.21.15.39:0/3711312116 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c004590 con 0x7fd46c06ff10 2023-11-28T11:59:42.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.266+0000 7fd453fff700 1 -- 172.21.15.39:0/3711312116 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45c0036c0 con 0x7fd46c06ff10 2023-11-28T11:59:42.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.266+0000 7fd453fff700 1 -- 172.21.15.39:0/3711312116 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c003a70 con 0x7fd46c06ff10 2023-11-28T11:59:42.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.266+0000 7fd470c6d700 1 -- 172.21.15.39:0/3711312116 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd46c0d2450 con 0x7fd46c06ff10 2023-11-28T11:59:42.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.266+0000 7fd470c6d700 1 -- 172.21.15.39:0/3711312116 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd46c06cc50 con 0x7fd46c06ff10 2023-11-28T11:59:42.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.266+0000 7fd470c6d700 1 -- 172.21.15.39:0/3711312116 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd46c0d2730 con 0x7fd46c06ff10 2023-11-28T11:59:42.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.270+0000 7fd453fff700 1 -- 172.21.15.39:0/3711312116 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd45c00f050 con 0x7fd46c06ff10 2023-11-28T11:59:42.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.270+0000 7fd453fff700 1 --2- 172.21.15.39:0/3711312116 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd458064ee0 0x7fd458067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:42.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.270+0000 7fd453fff700 1 -- 172.21.15.39:0/3711312116 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fd45c021030 con 0x7fd46c06ff10 2023-11-28T11:59:42.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.270+0000 7fd46affd700 1 --2- 172.21.15.39:0/3711312116 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd458064ee0 0x7fd458067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:42.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.274+0000 7fd46affd700 1 --2- 172.21.15.39:0/3711312116 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd458064ee0 0x7fd458067390 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd46c06b360 tx=0x7fd460008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:42.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.278+0000 7fd453fff700 1 -- 172.21.15.39:0/3711312116 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd45c051480 con 0x7fd46c06ff10 2023-11-28T11:59:42.459 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.454+0000 7fd470c6d700 1 -- 172.21.15.39:0/3711312116 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd46c073d20 con 0x7fd46c06ff10 2023-11-28T11:59:42.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.454+0000 7fd453fff700 1 -- 172.21.15.39:0/3711312116 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v66) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd45c0150a0 con 0x7fd46c06ff10 2023-11-28T11:59:42.461 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-11-28T11:59:42.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.458+0000 7fd470c6d700 1 -- 172.21.15.39:0/3711312116 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd458064ee0 msgr2=0x7fd458067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:42.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.458+0000 7fd470c6d700 1 --2- 172.21.15.39:0/3711312116 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd458064ee0 0x7fd458067390 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd46c06b360 tx=0x7fd460008040 comp rx=0 tx=0).stop 2023-11-28T11:59:42.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.458+0000 7fd470c6d700 1 -- 172.21.15.39:0/3711312116 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd46c06ff10 msgr2=0x7fd46c0cedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:42.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.458+0000 7fd470c6d700 1 --2- 172.21.15.39:0/3711312116 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd46c06ff10 0x7fd46c0cedd0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fd45c000c00 tx=0x7fd45c004770 comp rx=0 tx=0).stop 2023-11-28T11:59:42.464 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.458+0000 7fd470c6d700 1 -- 172.21.15.39:0/3711312116 shutdown_connections 2023-11-28T11:59:42.464 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.458+0000 7fd470c6d700 1 --2- 172.21.15.39:0/3711312116 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd46c15fc30 0x7fd46c1f4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:42.464 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.458+0000 7fd470c6d700 1 --2- 172.21.15.39:0/3711312116 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd458064ee0 0x7fd458067390 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:42.464 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.458+0000 7fd470c6d700 1 --2- 172.21.15.39:0/3711312116 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd46c15c150 0x7fd46c0caf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:42.464 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.458+0000 7fd470c6d700 1 --2- 172.21.15.39:0/3711312116 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd46c06ff10 0x7fd46c0cedd0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:42.464 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.458+0000 7fd470c6d700 1 -- 172.21.15.39:0/3711312116 >> 172.21.15.39:0/3711312116 conn(0x7fd46c0d3680 msgr2=0x7fd46c0c8030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:42.465 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.458+0000 7fd470c6d700 1 -- 172.21.15.39:0/3711312116 shutdown_connections 2023-11-28T11:59:42.465 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.458+0000 7fd470c6d700 1 -- 172.21.15.39:0/3711312116 wait complete. 2023-11-28T11:59:42.483 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:59:42.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.662+0000 7f928e5b4700 1 Processor -- start 2023-11-28T11:59:42.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.662+0000 7f928e5b4700 1 -- start start 2023-11-28T11:59:42.668 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.666+0000 7f928e5b4700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f928815e190 0x7f92880cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:42.668 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.666+0000 7f928e5b4700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9288161560 0x7f9288069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:42.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.666+0000 7f928e5b4700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f928806ff10 0x7f9288070390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:42.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.666+0000 7f928e5b4700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92880708d0 con 0x7f928806ff10 2023-11-28T11:59:42.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.666+0000 7f928e5b4700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f928815e560 con 0x7f928815e190 2023-11-28T11:59:42.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.666+0000 7f928e5b4700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928806be80 con 0x7f9288161560 2023-11-28T11:59:42.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.666+0000 7f928ddb3700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f928806ff10 0x7f9288070390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:42.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.666+0000 7f928ddb3700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f928806ff10 0x7f9288070390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47154/0 (socket says 172.21.15.39:47154) 2023-11-28T11:59:42.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.666+0000 7f928ddb3700 1 -- 172.21.15.39:0/3331130564 learned_addr learned my addr 172.21.15.39:0/3331130564 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:42.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.666+0000 7f928cdb1700 1 --2- 172.21.15.39:0/3331130564 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9288161560 0x7f9288069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:42.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.666+0000 7f928d5b2700 1 --2- 172.21.15.39:0/3331130564 >> v2:172.21.15.184:3300/0 conn(0x7f928815e190 0x7f92880cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:42.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.666+0000 7f928ddb3700 1 -- 172.21.15.39:0/3331130564 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9288161560 msgr2=0x7f9288069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:42.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.666+0000 7f928ddb3700 1 --2- 172.21.15.39:0/3331130564 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9288161560 0x7f9288069bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:42.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.666+0000 7f928ddb3700 1 -- 172.21.15.39:0/3331130564 >> v2:172.21.15.184:3300/0 conn(0x7f928815e190 msgr2=0x7f92880cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:42.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.666+0000 7f928ddb3700 1 --2- 172.21.15.39:0/3331130564 >> v2:172.21.15.184:3300/0 conn(0x7f928815e190 0x7f92880cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:42.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.666+0000 7f928ddb3700 1 -- 172.21.15.39:0/3331130564 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92880ce330 con 0x7f928806ff10 2023-11-28T11:59:42.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.666+0000 7f928ddb3700 1 --2- 172.21.15.39:0/3331130564 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f928806ff10 0x7f9288070390 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f92880cb9b0 tx=0x7f928000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6763f3138848f06f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:42.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.666+0000 7f927ffff700 1 -- 172.21.15.39:0/3331130564 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928000e070 con 0x7f928806ff10 2023-11-28T11:59:42.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.666+0000 7f927ffff700 1 -- 172.21.15.39:0/3331130564 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f928000b910 con 0x7f928806ff10 2023-11-28T11:59:42.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.666+0000 7f927ffff700 1 -- 172.21.15.39:0/3331130564 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928000bcc0 con 0x7f928806ff10 2023-11-28T11:59:42.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.670+0000 7f928e5b4700 1 -- 172.21.15.39:0/3331130564 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f928806ff10 msgr2=0x7f9288070390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:42.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.670+0000 7f928e5b4700 1 --2- 172.21.15.39:0/3331130564 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f928806ff10 0x7f9288070390 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f92880cb9b0 tx=0x7f928000b330 comp rx=0 tx=0).stop 2023-11-28T11:59:42.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.670+0000 7f928e5b4700 1 -- 172.21.15.39:0/3331130564 shutdown_connections 2023-11-28T11:59:42.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.670+0000 7f928e5b4700 1 --2- 172.21.15.39:0/3331130564 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9288161560 0x7f9288069bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:42.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.670+0000 7f928e5b4700 1 --2- 172.21.15.39:0/3331130564 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f928806ff10 0x7f9288070390 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:42.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.670+0000 7f928e5b4700 1 --2- 172.21.15.39:0/3331130564 >> v2:172.21.15.184:3300/0 conn(0x7f928815e190 0x7f92880cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:42.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.670+0000 7f928e5b4700 1 -- 172.21.15.39:0/3331130564 >> 172.21.15.39:0/3331130564 conn(0x7f92880cf280 msgr2=0x7f92880cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:42.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.670+0000 7f928e5b4700 1 -- 172.21.15.39:0/3331130564 shutdown_connections 2023-11-28T11:59:42.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.670+0000 7f928e5b4700 1 -- 172.21.15.39:0/3331130564 wait complete. 2023-11-28T11:59:42.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.670+0000 7f928e5b4700 1 Processor -- start 2023-11-28T11:59:42.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.674+0000 7f928e5b4700 1 -- start start 2023-11-28T11:59:42.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.674+0000 7f928e5b4700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f928806ff10 0x7f928814c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:42.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.674+0000 7f928e5b4700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f928815e190 0x7f928815b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:42.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.674+0000 7f928e5b4700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9288161560 0x7f9288161990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:42.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.674+0000 7f928e5b4700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9288158200 con 0x7f9288161560 2023-11-28T11:59:42.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.674+0000 7f928e5b4700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9288156940 con 0x7f928806ff10 2023-11-28T11:59:42.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.674+0000 7f928e5b4700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9288156b90 con 0x7f928815e190 2023-11-28T11:59:42.679 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.674+0000 7f928ddb3700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9288161560 0x7f9288161990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:42.679 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.674+0000 7f928ddb3700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9288161560 0x7f9288161990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47164/0 (socket says 172.21.15.39:47164) 2023-11-28T11:59:42.679 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.674+0000 7f928ddb3700 1 -- 172.21.15.39:0/2557676344 learned_addr learned my addr 172.21.15.39:0/2557676344 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:42.679 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.674+0000 7f928d5b2700 1 --2- 172.21.15.39:0/2557676344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f928806ff10 0x7f928814c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:42.679 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.674+0000 7f928cdb1700 1 --2- 172.21.15.39:0/2557676344 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f928815e190 0x7f928815b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:42.680 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.674+0000 7f928ddb3700 1 -- 172.21.15.39:0/2557676344 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f928815e190 msgr2=0x7f928815b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:42.680 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.674+0000 7f928ddb3700 1 --2- 172.21.15.39:0/2557676344 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f928815e190 0x7f928815b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:42.680 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.674+0000 7f928ddb3700 1 -- 172.21.15.39:0/2557676344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f928806ff10 msgr2=0x7f928814c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:42.680 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.674+0000 7f928ddb3700 1 --2- 172.21.15.39:0/2557676344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f928806ff10 0x7f928814c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:42.680 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.674+0000 7f928ddb3700 1 -- 172.21.15.39:0/2557676344 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9280009b30 con 0x7f9288161560 2023-11-28T11:59:42.680 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.674+0000 7f928ddb3700 1 --2- 172.21.15.39:0/2557676344 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9288161560 0x7f9288161990 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f92880717e0 tx=0x7f9280004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:42.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.674+0000 7f927dffb700 1 -- 172.21.15.39:0/2557676344 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9280004930 con 0x7f9288161560 2023-11-28T11:59:42.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.674+0000 7f927dffb700 1 -- 172.21.15.39:0/2557676344 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92800099b0 con 0x7f9288161560 2023-11-28T11:59:42.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.674+0000 7f927dffb700 1 -- 172.21.15.39:0/2557676344 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928001c680 con 0x7f9288161560 2023-11-28T11:59:42.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.674+0000 7f928e5b4700 1 -- 172.21.15.39:0/2557676344 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92880afc70 con 0x7f9288161560 2023-11-28T11:59:42.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.678+0000 7f928e5b4700 1 -- 172.21.15.39:0/2557676344 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92880af990 con 0x7f9288161560 2023-11-28T11:59:42.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.678+0000 7f928e5b4700 1 -- 172.21.15.39:0/2557676344 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92880aff50 con 0x7f9288161560 2023-11-28T11:59:42.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.678+0000 7f927dffb700 1 -- 172.21.15.39:0/2557676344 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9280022030 con 0x7f9288161560 2023-11-28T11:59:42.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.682+0000 7f927dffb700 1 --2- 172.21.15.39:0/2557676344 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f926c064ee0 0x7f926c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:42.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.682+0000 7f927dffb700 1 -- 172.21.15.39:0/2557676344 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f9280083410 con 0x7f9288161560 2023-11-28T11:59:42.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.682+0000 7f928d5b2700 1 --2- 172.21.15.39:0/2557676344 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f926c064ee0 0x7f926c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:42.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.682+0000 7f928d5b2700 1 --2- 172.21.15.39:0/2557676344 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f926c064ee0 0x7f926c067390 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9284009bf0 tx=0x7f9284009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:42.692 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.690+0000 7f927dffb700 1 -- 172.21.15.39:0/2557676344 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f92800516d0 con 0x7f9288161560 2023-11-28T11:59:42.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.862+0000 7f928e5b4700 1 -- 172.21.15.39:0/2557676344 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9288158340 con 0x7f9288161560 2023-11-28T11:59:42.867 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.862+0000 7f927dffb700 1 -- 172.21.15.39:0/2557676344 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v66) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9280054cf0 con 0x7f9288161560 2023-11-28T11:59:42.867 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-11-28T11:59:42.870 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.866+0000 7f928e5b4700 1 -- 172.21.15.39:0/2557676344 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f926c064ee0 msgr2=0x7f926c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:42.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.866+0000 7f928e5b4700 1 --2- 172.21.15.39:0/2557676344 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f926c064ee0 0x7f926c067390 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9284009bf0 tx=0x7f9284009240 comp rx=0 tx=0).stop 2023-11-28T11:59:42.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.866+0000 7f928e5b4700 1 -- 172.21.15.39:0/2557676344 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9288161560 msgr2=0x7f9288161990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:42.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.866+0000 7f928e5b4700 1 --2- 172.21.15.39:0/2557676344 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9288161560 0x7f9288161990 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f92880717e0 tx=0x7f9280004af0 comp rx=0 tx=0).stop 2023-11-28T11:59:42.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.866+0000 7f928e5b4700 1 -- 172.21.15.39:0/2557676344 shutdown_connections 2023-11-28T11:59:42.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.866+0000 7f928e5b4700 1 --2- 172.21.15.39:0/2557676344 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9288161560 0x7f9288161990 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:42.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.866+0000 7f928e5b4700 1 --2- 172.21.15.39:0/2557676344 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f928815e190 0x7f928815b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:42.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.866+0000 7f928e5b4700 1 --2- 172.21.15.39:0/2557676344 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f926c064ee0 0x7f926c067390 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:42.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.866+0000 7f928e5b4700 1 --2- 172.21.15.39:0/2557676344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f928806ff10 0x7f928814c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:42.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.866+0000 7f928e5b4700 1 -- 172.21.15.39:0/2557676344 >> 172.21.15.39:0/2557676344 conn(0x7f92880cf280 msgr2=0x7f92880cdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:42.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.866+0000 7f928e5b4700 1 -- 172.21.15.39:0/2557676344 shutdown_connections 2023-11-28T11:59:42.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:42.866+0000 7f928e5b4700 1 -- 172.21.15.39:0/2557676344 wait complete. 2023-11-28T11:59:42.892 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T11:59:43.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.070+0000 7f95dbfff700 1 Processor -- start 2023-11-28T11:59:43.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.070+0000 7f95dbfff700 1 -- start start 2023-11-28T11:59:43.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.074+0000 7f95dbfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95dc15c640 0x7f95dc0d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:43.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.074+0000 7f95dbfff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f95dc069e00 0x7f95dc06a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:43.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.074+0000 7f95dbfff700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95dc06c600 con 0x7f95dc071aa0 2023-11-28T11:59:43.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.074+0000 7f95dbfff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95dc06cef0 con 0x7f95dc069e00 2023-11-28T11:59:43.078 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.074+0000 7f95dbfff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95dc06a7c0 con 0x7f95dc15c640 2023-11-28T11:59:43.079 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.074+0000 7f95da7fc700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f95dc071aa0 0x7f95dc06d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:41080/0 (socket says 172.21.15.39:41080) 2023-11-28T11:59:43.079 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.074+0000 7f95da7fc700 1 -- 172.21.15.39:0/1282461127 learned_addr learned my addr 172.21.15.39:0/1282461127 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:59:43.079 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.074+0000 7f95db7fe700 1 --2- 172.21.15.39:0/1282461127 >> v2:172.21.15.184:3300/0 conn(0x7f95dc069e00 0x7f95dc06a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:43.080 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.074+0000 7f95daffd700 1 --2- 172.21.15.39:0/1282461127 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95dc15c640 0x7f95dc0d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:43.080 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.074+0000 7f95d9ffb700 1 -- 172.21.15.39:0/1282461127 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1008529281 0 0) 0x7f95dc06c600 con 0x7f95dc071aa0 2023-11-28T11:59:43.080 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.074+0000 7f95d9ffb700 1 -- 172.21.15.39:0/1282461127 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95c40035d0 con 0x7f95dc071aa0 2023-11-28T11:59:43.081 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.074+0000 7f95d9ffb700 1 -- 172.21.15.39:0/1282461127 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3418720681 0 0) 0x7f95c40035d0 con 0x7f95dc071aa0 2023-11-28T11:59:43.081 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.074+0000 7f95db7fe700 1 -- 172.21.15.39:0/1282461127 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95dc15c640 msgr2=0x7f95dc0d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:43.081 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.074+0000 7f95db7fe700 1 --2- 172.21.15.39:0/1282461127 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95dc15c640 0x7f95dc0d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:43.081 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.074+0000 7f95db7fe700 1 -- 172.21.15.39:0/1282461127 >> v1:172.21.15.39:6789/0 conn(0x7f95dc071aa0 legacy=0x7f95dc06d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:43.081 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.074+0000 7f95db7fe700 1 -- 172.21.15.39:0/1282461127 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95dc0722f0 con 0x7f95dc069e00 2023-11-28T11:59:43.081 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.074+0000 7f95daffd700 1 --2- 172.21.15.39:0/1282461127 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95dc15c640 0x7f95dc0d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:43.083 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.074+0000 7f95db7fe700 1 --2- 172.21.15.39:0/1282461127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95dc069e00 0x7f95dc06a280 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f95d4009d90 tx=0x7f95d400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13b52d68689bef93 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:43.083 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.078+0000 7f95d9ffb700 1 -- 172.21.15.39:0/1282461127 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d400e070 con 0x7f95dc069e00 2023-11-28T11:59:43.083 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.078+0000 7f95d9ffb700 1 -- 172.21.15.39:0/1282461127 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d4003a40 con 0x7f95dc069e00 2023-11-28T11:59:43.083 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.078+0000 7f95d9ffb700 1 -- 172.21.15.39:0/1282461127 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d0001670 con 0x7f95dc069e00 2023-11-28T11:59:43.083 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.078+0000 7f95dbfff700 1 -- 172.21.15.39:0/1282461127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95dc069e00 msgr2=0x7f95dc06a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:43.083 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.078+0000 7f95dbfff700 1 --2- 172.21.15.39:0/1282461127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95dc069e00 0x7f95dc06a280 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f95d4009d90 tx=0x7f95d400b330 comp rx=0 tx=0).stop 2023-11-28T11:59:43.084 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.078+0000 7f95dbfff700 1 -- 172.21.15.39:0/1282461127 shutdown_connections 2023-11-28T11:59:43.084 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.078+0000 7f95dbfff700 1 --2- 172.21.15.39:0/1282461127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95dc069e00 0x7f95dc06a280 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:43.084 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.078+0000 7f95dbfff700 1 --2- 172.21.15.39:0/1282461127 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95dc15c640 0x7f95dc0d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:43.084 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.078+0000 7f95dbfff700 1 -- 172.21.15.39:0/1282461127 >> 172.21.15.39:0/1282461127 conn(0x7f95dc0b6520 msgr2=0x7f95dc071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:43.084 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.078+0000 7f95dbfff700 1 -- 172.21.15.39:0/1282461127 shutdown_connections 2023-11-28T11:59:43.084 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.078+0000 7f95dbfff700 1 -- 172.21.15.39:0/1282461127 wait complete. 2023-11-28T11:59:43.086 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.078+0000 7f95dbfff700 1 Processor -- start 2023-11-28T11:59:43.086 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.078+0000 7f95dbfff700 1 -- start start 2023-11-28T11:59:43.086 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.082+0000 7f95dbfff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95dc069e00 0x7f95dc158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:43.086 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.082+0000 7f95dbfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95dc071aa0 0x7f95dc0c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:43.086 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.082+0000 7f95dbfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95dc15c640 0x7f95dc0afb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:43.086 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.082+0000 7f95dbfff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95dc0c8f00 con 0x7f95dc071aa0 2023-11-28T11:59:43.087 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.082+0000 7f95dbfff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95dc0c7e60 con 0x7f95dc069e00 2023-11-28T11:59:43.087 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.082+0000 7f95dbfff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95dc0c8140 con 0x7f95dc15c640 2023-11-28T11:59:43.087 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.082+0000 7f95da7fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95dc071aa0 0x7f95dc0c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:43.087 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.082+0000 7f95da7fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95dc071aa0 0x7f95dc0c7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47180/0 (socket says 172.21.15.39:47180) 2023-11-28T11:59:43.087 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.082+0000 7f95da7fc700 1 -- 172.21.15.39:0/3726658498 learned_addr learned my addr 172.21.15.39:0/3726658498 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:43.087 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.082+0000 7f95db7fe700 1 --2- 172.21.15.39:0/3726658498 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95dc15c640 0x7f95dc0afb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:43.087 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.082+0000 7f95daffd700 1 --2- 172.21.15.39:0/3726658498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95dc069e00 0x7f95dc158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:43.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.082+0000 7f95da7fc700 1 -- 172.21.15.39:0/3726658498 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95dc15c640 msgr2=0x7f95dc0afb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:43.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.082+0000 7f95da7fc700 1 --2- 172.21.15.39:0/3726658498 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95dc15c640 0x7f95dc0afb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:43.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.082+0000 7f95da7fc700 1 -- 172.21.15.39:0/3726658498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95dc069e00 msgr2=0x7f95dc158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:43.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.082+0000 7f95da7fc700 1 --2- 172.21.15.39:0/3726658498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95dc069e00 0x7f95dc158e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:43.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.082+0000 7f95da7fc700 1 -- 172.21.15.39:0/3726658498 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95cc0094b0 con 0x7f95dc071aa0 2023-11-28T11:59:43.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.082+0000 7f95db7fe700 1 --2- 172.21.15.39:0/3726658498 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95dc15c640 0x7f95dc0afb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:43.089 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.082+0000 7f95da7fc700 1 --2- 172.21.15.39:0/3726658498 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95dc071aa0 0x7f95dc0c7530 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f95d000c520 tx=0x7f95d000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:43.090 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.082+0000 7f95c37fe700 1 -- 172.21.15.39:0/3726658498 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d0004ca0 con 0x7f95dc071aa0 2023-11-28T11:59:43.090 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.082+0000 7f95c37fe700 1 -- 172.21.15.39:0/3726658498 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d0004e20 con 0x7f95dc071aa0 2023-11-28T11:59:43.090 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.082+0000 7f95dbfff700 1 -- 172.21.15.39:0/3726658498 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95d4009a70 con 0x7f95dc071aa0 2023-11-28T11:59:43.090 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.082+0000 7f95c37fe700 1 -- 172.21.15.39:0/3726658498 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d0007310 con 0x7f95dc071aa0 2023-11-28T11:59:43.090 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.082+0000 7f95dbfff700 1 -- 172.21.15.39:0/3726658498 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95dc15ca10 con 0x7f95dc071aa0 2023-11-28T11:59:43.090 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.086+0000 7f95dbfff700 1 -- 172.21.15.39:0/3726658498 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95dc06da20 con 0x7f95dc071aa0 2023-11-28T11:59:43.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.086+0000 7f95c37fe700 1 -- 172.21.15.39:0/3726658498 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f95d001a020 con 0x7f95dc071aa0 2023-11-28T11:59:43.092 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.086+0000 7f95c37fe700 1 --2- 172.21.15.39:0/3726658498 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f95c8064ee0 0x7f95c8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:43.092 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.090+0000 7f95c37fe700 1 -- 172.21.15.39:0/3726658498 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f95d00819f0 con 0x7f95dc071aa0 2023-11-28T11:59:43.092 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.090+0000 7f95daffd700 1 --2- 172.21.15.39:0/3726658498 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f95c8064ee0 0x7f95c8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:43.094 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.090+0000 7f95daffd700 1 --2- 172.21.15.39:0/3726658498 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f95c8064ee0 0x7f95c8067390 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f95cc009d10 tx=0x7f95cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:43.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.094+0000 7f95c37fe700 1 -- 172.21.15.39:0/3726658498 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f95d004fcb0 con 0x7f95dc071aa0 2023-11-28T11:59:43.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.266+0000 7f95dbfff700 1 -- 172.21.15.39:0/3726658498 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f95dc072010 con 0x7f95dc071aa0 2023-11-28T11:59:43.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.270+0000 7f95c37fe700 1 -- 172.21.15.39:0/3726658498 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v66) v1 ==== 84+0+126 (secure 0 0 0) 0x7f95d00532d0 con 0x7f95dc071aa0 2023-11-28T11:59:43.272 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:59:43.272 INFO:teuthology.orchestra.run.smithi039.stdout:[ 2023-11-28T11:59:43.273 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:59:43.273 INFO:teuthology.orchestra.run.smithi039.stdout: "poolnum": 1, 2023-11-28T11:59:43.273 INFO:teuthology.orchestra.run.smithi039.stdout: "poolname": ".mgr" 2023-11-28T11:59:43.273 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:59:43.273 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:59:43.273 INFO:teuthology.orchestra.run.smithi039.stdout: "poolnum": 2, 2023-11-28T11:59:43.273 INFO:teuthology.orchestra.run.smithi039.stdout: "poolname": "rbd" 2023-11-28T11:59:43.273 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:59:43.273 INFO:teuthology.orchestra.run.smithi039.stdout:] 2023-11-28T11:59:43.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.270+0000 7f95dbfff700 1 -- 172.21.15.39:0/3726658498 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f95c8064ee0 msgr2=0x7f95c8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:43.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.270+0000 7f95dbfff700 1 --2- 172.21.15.39:0/3726658498 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f95c8064ee0 0x7f95c8067390 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f95cc009d10 tx=0x7f95cc008040 comp rx=0 tx=0).stop 2023-11-28T11:59:43.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.270+0000 7f95dbfff700 1 -- 172.21.15.39:0/3726658498 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95dc071aa0 msgr2=0x7f95dc0c7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:43.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.270+0000 7f95dbfff700 1 --2- 172.21.15.39:0/3726658498 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95dc071aa0 0x7f95dc0c7530 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f95d000c520 tx=0x7f95d000c8e0 comp rx=0 tx=0).stop 2023-11-28T11:59:43.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.270+0000 7f95dbfff700 1 -- 172.21.15.39:0/3726658498 shutdown_connections 2023-11-28T11:59:43.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.270+0000 7f95dbfff700 1 --2- 172.21.15.39:0/3726658498 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95dc15c640 0x7f95dc0afb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:43.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.270+0000 7f95dbfff700 1 --2- 172.21.15.39:0/3726658498 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95dc071aa0 0x7f95dc0c7530 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:43.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.270+0000 7f95dbfff700 1 --2- 172.21.15.39:0/3726658498 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f95c8064ee0 0x7f95c8067390 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:43.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.270+0000 7f95dbfff700 1 --2- 172.21.15.39:0/3726658498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95dc069e00 0x7f95dc158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:43.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.270+0000 7f95dbfff700 1 -- 172.21.15.39:0/3726658498 >> 172.21.15.39:0/3726658498 conn(0x7f95dc0b6520 msgr2=0x7f95dc15eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:43.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.270+0000 7f95dbfff700 1 -- 172.21.15.39:0/3726658498 shutdown_connections 2023-11-28T11:59:43.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.270+0000 7f95dbfff700 1 -- 172.21.15.39:0/3726658498 wait complete. 2023-11-28T11:59:43.305 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T11:59:43.305 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T11:59:43.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.486+0000 7f49b9169700 1 Processor -- start 2023-11-28T11:59:43.492 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.486+0000 7f49b9169700 1 -- start start 2023-11-28T11:59:43.493 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.490+0000 7f49b9169700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49b415c6e0 0x7f49b4071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:43.494 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.490+0000 7f49b9169700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f49b406a510 0x7f49b406c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:43.494 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.490+0000 7f49b9169700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49b415cab0 con 0x7f49b4071fe0 2023-11-28T11:59:43.494 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.490+0000 7f49b9169700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49b40d2800 con 0x7f49b406a510 2023-11-28T11:59:43.494 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.490+0000 7f49b9169700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b40702d0 con 0x7f49b415c6e0 2023-11-28T11:59:43.494 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.490+0000 7f49ab7fe700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f49b4071fe0 0x7f49b4069e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:41090/0 (socket says 172.21.15.39:41090) 2023-11-28T11:59:43.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.490+0000 7f49ab7fe700 1 -- 172.21.15.39:0/3194053489 learned_addr learned my addr 172.21.15.39:0/3194053489 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:59:43.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.490+0000 7f49b8968700 1 --2- 172.21.15.39:0/3194053489 >> v2:172.21.15.39:3300/0 conn(0x7f49b406a510 0x7f49b406c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:43.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.490+0000 7f49b3fff700 1 --2- 172.21.15.39:0/3194053489 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49b415c6e0 0x7f49b4071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:43.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.490+0000 7f49b37fe700 1 -- 172.21.15.39:0/3194053489 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2790362707 0 0) 0x7f49b415cab0 con 0x7f49b4071fe0 2023-11-28T11:59:43.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.490+0000 7f49b37fe700 1 -- 172.21.15.39:0/3194053489 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49a00035d0 con 0x7f49b4071fe0 2023-11-28T11:59:43.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.490+0000 7f49b8968700 1 -- 172.21.15.39:0/3194053489 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49b415c6e0 msgr2=0x7f49b4071aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:43.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.490+0000 7f49b8968700 1 --2- 172.21.15.39:0/3194053489 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49b415c6e0 0x7f49b4071aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:43.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.490+0000 7f49b8968700 1 -- 172.21.15.39:0/3194053489 >> v1:172.21.15.39:6789/0 conn(0x7f49b4071fe0 legacy=0x7f49b4069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:43.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.490+0000 7f49b8968700 1 -- 172.21.15.39:0/3194053489 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b40d2a10 con 0x7f49b406a510 2023-11-28T11:59:43.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.490+0000 7f49b8968700 1 --2- 172.21.15.39:0/3194053489 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49b406a510 0x7f49b406c630 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f49ac009850 tx=0x7f49ac009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ed28c5bc6c9be server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:43.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.494+0000 7f49b37fe700 1 -- 172.21.15.39:0/3194053489 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ac011830 con 0x7f49b406a510 2023-11-28T11:59:43.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.494+0000 7f49b37fe700 1 -- 172.21.15.39:0/3194053489 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49ac011990 con 0x7f49b406a510 2023-11-28T11:59:43.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.494+0000 7f49b37fe700 1 -- 172.21.15.39:0/3194053489 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ac011d40 con 0x7f49b406a510 2023-11-28T11:59:43.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.494+0000 7f49b9169700 1 -- 172.21.15.39:0/3194053489 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49b406a510 msgr2=0x7f49b406c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:43.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.494+0000 7f49b9169700 1 --2- 172.21.15.39:0/3194053489 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49b406a510 0x7f49b406c630 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f49ac009850 tx=0x7f49ac009b60 comp rx=0 tx=0).stop 2023-11-28T11:59:43.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.494+0000 7f49b9169700 1 -- 172.21.15.39:0/3194053489 shutdown_connections 2023-11-28T11:59:43.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.494+0000 7f49b9169700 1 --2- 172.21.15.39:0/3194053489 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49b406a510 0x7f49b406c630 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:43.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.494+0000 7f49b9169700 1 --2- 172.21.15.39:0/3194053489 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49b415c6e0 0x7f49b4071aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:43.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.494+0000 7f49b9169700 1 -- 172.21.15.39:0/3194053489 >> 172.21.15.39:0/3194053489 conn(0x7f49b40b65b0 msgr2=0x7f49b4071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:43.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.494+0000 7f49b9169700 1 -- 172.21.15.39:0/3194053489 shutdown_connections 2023-11-28T11:59:43.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.494+0000 7f49b9169700 1 -- 172.21.15.39:0/3194053489 wait complete. 2023-11-28T11:59:43.502 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.498+0000 7f49b9169700 1 Processor -- start 2023-11-28T11:59:43.502 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.498+0000 7f49b9169700 1 -- start start 2023-11-28T11:59:43.503 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.498+0000 7f49b9169700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49b406a510 0x7f49b40c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:43.503 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.498+0000 7f49b9169700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49b4071fe0 0x7f49b40d1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:43.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.498+0000 7f49b9169700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49b415c6e0 0x7f49b40d1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:43.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.498+0000 7f49b9169700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b40c6d40 con 0x7f49b406a510 2023-11-28T11:59:43.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.498+0000 7f49b9169700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b40c60c0 con 0x7f49b4071fe0 2023-11-28T11:59:43.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.498+0000 7f49b9169700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b40c63a0 con 0x7f49b415c6e0 2023-11-28T11:59:43.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.498+0000 7f49b3fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49b406a510 0x7f49b40c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:43.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.498+0000 7f49b3fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49b406a510 0x7f49b40c56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47186/0 (socket says 172.21.15.39:47186) 2023-11-28T11:59:43.505 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.498+0000 7f49b3fff700 1 -- 172.21.15.39:0/756679775 learned_addr learned my addr 172.21.15.39:0/756679775 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:43.505 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.502+0000 7f49b8968700 1 --2- 172.21.15.39:0/756679775 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49b415c6e0 0x7f49b40d1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:43.505 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.502+0000 7f49ab7fe700 1 --2- 172.21.15.39:0/756679775 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49b4071fe0 0x7f49b40d1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:43.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.502+0000 7f49b3fff700 1 -- 172.21.15.39:0/756679775 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49b415c6e0 msgr2=0x7f49b40d1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:43.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.502+0000 7f49b3fff700 1 --2- 172.21.15.39:0/756679775 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49b415c6e0 0x7f49b40d1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:43.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.502+0000 7f49b3fff700 1 -- 172.21.15.39:0/756679775 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49b4071fe0 msgr2=0x7f49b40d1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:43.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.502+0000 7f49b3fff700 1 --2- 172.21.15.39:0/756679775 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49b4071fe0 0x7f49b40d1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:43.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.502+0000 7f49b3fff700 1 -- 172.21.15.39:0/756679775 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ac0094b0 con 0x7f49b406a510 2023-11-28T11:59:43.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.502+0000 7f49b3fff700 1 --2- 172.21.15.39:0/756679775 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49b406a510 0x7f49b40c56d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f49a400efc0 tx=0x7f49a400c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:43.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.502+0000 7f49b17fa700 1 -- 172.21.15.39:0/756679775 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a400cb50 con 0x7f49b406a510 2023-11-28T11:59:43.507 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.502+0000 7f49b17fa700 1 -- 172.21.15.39:0/756679775 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a400f040 con 0x7f49b406a510 2023-11-28T11:59:43.507 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.502+0000 7f49b17fa700 1 -- 172.21.15.39:0/756679775 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a4014480 con 0x7f49b406a510 2023-11-28T11:59:43.507 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.502+0000 7f49b9169700 1 -- 172.21.15.39:0/756679775 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49b40d2fd0 con 0x7f49b406a510 2023-11-28T11:59:43.507 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.502+0000 7f49b9169700 1 -- 172.21.15.39:0/756679775 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49b40d2cf0 con 0x7f49b406a510 2023-11-28T11:59:43.508 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.506+0000 7f49b9169700 1 -- 172.21.15.39:0/756679775 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49b40d32b0 con 0x7f49b406a510 2023-11-28T11:59:43.509 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.506+0000 7f49b17fa700 1 -- 172.21.15.39:0/756679775 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f49a40145e0 con 0x7f49b406a510 2023-11-28T11:59:43.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.506+0000 7f49b17fa700 1 --2- 172.21.15.39:0/756679775 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4994064ee0 0x7f4994067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:43.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.506+0000 7f49b17fa700 1 -- 172.21.15.39:0/756679775 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f49a4082660 con 0x7f49b406a510 2023-11-28T11:59:43.511 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.506+0000 7f49ab7fe700 1 --2- 172.21.15.39:0/756679775 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4994064ee0 0x7f4994067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:43.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.510+0000 7f49ab7fe700 1 --2- 172.21.15.39:0/756679775 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4994064ee0 0x7f4994067390 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f49b415aa10 tx=0x7f499c007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:43.514 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.510+0000 7f49b17fa700 1 -- 172.21.15.39:0/756679775 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f49a40509d0 con 0x7f49b406a510 2023-11-28T11:59:43.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.682+0000 7f49b9169700 1 -- 172.21.15.39:0/756679775 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f49b40c9520 con 0x7f49b406a510 2023-11-28T11:59:43.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.806+0000 7f49b17fa700 1 -- 172.21.15.39:0/756679775 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v67) v1 ==== 138+0+0 (secure 0 0 0) 0x7f49a4053ff0 con 0x7f49b406a510 2023-11-28T11:59:43.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.814+0000 7f49b9169700 1 -- 172.21.15.39:0/756679775 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4994064ee0 msgr2=0x7f4994067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:43.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.814+0000 7f49b9169700 1 --2- 172.21.15.39:0/756679775 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4994064ee0 0x7f4994067390 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f49b415aa10 tx=0x7f499c007de0 comp rx=0 tx=0).stop 2023-11-28T11:59:43.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.814+0000 7f49b9169700 1 -- 172.21.15.39:0/756679775 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49b406a510 msgr2=0x7f49b40c56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:43.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.814+0000 7f49b9169700 1 --2- 172.21.15.39:0/756679775 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49b406a510 0x7f49b40c56d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f49a400efc0 tx=0x7f49a400c0c0 comp rx=0 tx=0).stop 2023-11-28T11:59:43.819 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.814+0000 7f49b9169700 1 -- 172.21.15.39:0/756679775 shutdown_connections 2023-11-28T11:59:43.819 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.814+0000 7f49b9169700 1 --2- 172.21.15.39:0/756679775 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49b415c6e0 0x7f49b40d1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:43.819 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.814+0000 7f49b9169700 1 --2- 172.21.15.39:0/756679775 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4994064ee0 0x7f4994067390 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:43.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.814+0000 7f49b9169700 1 --2- 172.21.15.39:0/756679775 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49b4071fe0 0x7f49b40d1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:43.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.814+0000 7f49b9169700 1 --2- 172.21.15.39:0/756679775 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49b406a510 0x7f49b40c56d0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:43.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.814+0000 7f49b9169700 1 -- 172.21.15.39:0/756679775 >> 172.21.15.39:0/756679775 conn(0x7f49b40b65b0 msgr2=0x7f49b40c8840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:43.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.814+0000 7f49b9169700 1 -- 172.21.15.39:0/756679775 shutdown_connections 2023-11-28T11:59:43.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:43.814+0000 7f49b9169700 1 -- 172.21.15.39:0/756679775 wait complete. 2023-11-28T11:59:43.822 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_metadata' created 2023-11-28T11:59:43.841 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T11:59:44.026 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.022+0000 7ffa52c45700 1 Processor -- start 2023-11-28T11:59:44.027 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.022+0000 7ffa52c45700 1 -- start start 2023-11-28T11:59:44.030 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.026+0000 7ffa52c45700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ffa4c1605e0 0x7ffa4c0cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:44.031 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.026+0000 7ffa52c45700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa4c0ce410 con 0x7ffa4c0af9f0 2023-11-28T11:59:44.031 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.026+0000 7ffa52c45700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa4c0cc3d0 con 0x7ffa4c070620 2023-11-28T11:59:44.031 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.026+0000 7ffa52c45700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa4c070d60 con 0x7ffa4c1605e0 2023-11-28T11:59:44.031 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.026+0000 7ffa51442700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7ffa4c0af9f0 0x7ffa4c06ff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:41098/0 (socket says 172.21.15.39:41098) 2023-11-28T11:59:44.031 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.026+0000 7ffa51442700 1 -- 172.21.15.39:0/1316325905 learned_addr learned my addr 172.21.15.39:0/1316325905 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:59:44.032 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.026+0000 7ffa51c43700 1 --2- 172.21.15.39:0/1316325905 >> v2:172.21.15.184:3300/0 conn(0x7ffa4c1605e0 0x7ffa4c0cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:44.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.030+0000 7ffa50c41700 1 -- 172.21.15.39:0/1316325905 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3381362878 0 0) 0x7ffa4c0ce410 con 0x7ffa4c0af9f0 2023-11-28T11:59:44.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.030+0000 7ffa50c41700 1 -- 172.21.15.39:0/1316325905 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa380035d0 con 0x7ffa4c0af9f0 2023-11-28T11:59:44.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.030+0000 7ffa50c41700 1 -- 172.21.15.39:0/1316325905 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2812544394 0 0) 0x7ffa4c0cc3d0 con 0x7ffa4c070620 2023-11-28T11:59:44.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.030+0000 7ffa51c43700 1 -- 172.21.15.39:0/1316325905 >> v1:172.21.15.184:6789/0 conn(0x7ffa4c070620 legacy=0x7ffa4c069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:44.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.030+0000 7ffa51c43700 1 -- 172.21.15.39:0/1316325905 >> v1:172.21.15.39:6789/0 conn(0x7ffa4c0af9f0 legacy=0x7ffa4c06ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:44.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.030+0000 7ffa51c43700 1 -- 172.21.15.39:0/1316325905 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa4c1609b0 con 0x7ffa4c1605e0 2023-11-28T11:59:44.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.030+0000 7ffa51c43700 1 --2- 172.21.15.39:0/1316325905 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa4c1605e0 0x7ffa4c0cdda0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ffa48009850 tx=0x7ffa48009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6966430ccbe07b78 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:44.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.030+0000 7ffa50c41700 1 -- 172.21.15.39:0/1316325905 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa48011830 con 0x7ffa4c1605e0 2023-11-28T11:59:44.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.030+0000 7ffa50c41700 1 -- 172.21.15.39:0/1316325905 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa48011990 con 0x7ffa4c1605e0 2023-11-28T11:59:44.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.030+0000 7ffa50c41700 1 -- 172.21.15.39:0/1316325905 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa48011d40 con 0x7ffa4c1605e0 2023-11-28T11:59:44.035 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.030+0000 7ffa52c45700 1 -- 172.21.15.39:0/1316325905 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa4c1605e0 msgr2=0x7ffa4c0cdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:44.035 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.030+0000 7ffa52c45700 1 --2- 172.21.15.39:0/1316325905 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa4c1605e0 0x7ffa4c0cdda0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ffa48009850 tx=0x7ffa48009b60 comp rx=0 tx=0).stop 2023-11-28T11:59:44.035 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.030+0000 7ffa52c45700 1 -- 172.21.15.39:0/1316325905 shutdown_connections 2023-11-28T11:59:44.035 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.030+0000 7ffa52c45700 1 --2- 172.21.15.39:0/1316325905 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa4c1605e0 0x7ffa4c0cdda0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:44.035 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.030+0000 7ffa52c45700 1 -- 172.21.15.39:0/1316325905 >> 172.21.15.39:0/1316325905 conn(0x7ffa4c0cf280 msgr2=0x7ffa4c0cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:44.035 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.030+0000 7ffa52c45700 1 -- 172.21.15.39:0/1316325905 shutdown_connections 2023-11-28T11:59:44.036 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.030+0000 7ffa52c45700 1 -- 172.21.15.39:0/1316325905 wait complete. 2023-11-28T11:59:44.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.034+0000 7ffa52c45700 1 Processor -- start 2023-11-28T11:59:44.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.034+0000 7ffa52c45700 1 -- start start 2023-11-28T11:59:44.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.034+0000 7ffa52c45700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa4c070620 0x7ffa4c15fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:44.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.034+0000 7ffa52c45700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa4c0af9f0 0x7ffa4c148af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:44.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.034+0000 7ffa52c45700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffa4c1605e0 0x7ffa4c0c5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:44.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.034+0000 7ffa52c45700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4c15e9b0 con 0x7ffa4c070620 2023-11-28T11:59:44.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.034+0000 7ffa52c45700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4c15ec90 con 0x7ffa4c0af9f0 2023-11-28T11:59:44.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.034+0000 7ffa52c45700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4c15ef70 con 0x7ffa4c1605e0 2023-11-28T11:59:44.040 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.034+0000 7ffa51c43700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa4c070620 0x7ffa4c15fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:44.040 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.034+0000 7ffa51c43700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa4c070620 0x7ffa4c15fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47192/0 (socket says 172.21.15.39:47192) 2023-11-28T11:59:44.040 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.034+0000 7ffa51c43700 1 -- 172.21.15.39:0/632171370 learned_addr learned my addr 172.21.15.39:0/632171370 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:44.040 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.034+0000 7ffa51442700 1 --2- 172.21.15.39:0/632171370 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa4c0af9f0 0x7ffa4c148af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:44.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.034+0000 7ffa52444700 1 --2- 172.21.15.39:0/632171370 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffa4c1605e0 0x7ffa4c0c5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:44.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.034+0000 7ffa51c43700 1 -- 172.21.15.39:0/632171370 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffa4c1605e0 msgr2=0x7ffa4c0c5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:44.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.034+0000 7ffa51c43700 1 --2- 172.21.15.39:0/632171370 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffa4c1605e0 0x7ffa4c0c5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:44.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.034+0000 7ffa51c43700 1 -- 172.21.15.39:0/632171370 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa4c0af9f0 msgr2=0x7ffa4c148af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:44.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.034+0000 7ffa51c43700 1 --2- 172.21.15.39:0/632171370 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa4c0af9f0 0x7ffa4c148af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:44.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.034+0000 7ffa51c43700 1 -- 172.21.15.39:0/632171370 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa480094b0 con 0x7ffa4c070620 2023-11-28T11:59:44.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.038+0000 7ffa51c43700 1 --2- 172.21.15.39:0/632171370 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa4c070620 0x7ffa4c15fa50 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c0717e0 tx=0x7ffa48004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:44.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.038+0000 7ffa427fc700 1 -- 172.21.15.39:0/632171370 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4801aa00 con 0x7ffa4c070620 2023-11-28T11:59:44.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.038+0000 7ffa427fc700 1 -- 172.21.15.39:0/632171370 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4801f070 con 0x7ffa4c070620 2023-11-28T11:59:44.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.038+0000 7ffa427fc700 1 -- 172.21.15.39:0/632171370 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4801ada0 con 0x7ffa4c070620 2023-11-28T11:59:44.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.038+0000 7ffa52c45700 1 -- 172.21.15.39:0/632171370 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa4c06c9c0 con 0x7ffa4c070620 2023-11-28T11:59:44.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.038+0000 7ffa52c45700 1 -- 172.21.15.39:0/632171370 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa4c0cc860 con 0x7ffa4c070620 2023-11-28T11:59:44.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.038+0000 7ffa52c45700 1 -- 172.21.15.39:0/632171370 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa4c06cca0 con 0x7ffa4c070620 2023-11-28T11:59:44.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.042+0000 7ffa427fc700 1 -- 172.21.15.39:0/632171370 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ffa4800f050 con 0x7ffa4c070620 2023-11-28T11:59:44.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.042+0000 7ffa427fc700 1 --2- 172.21.15.39:0/632171370 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ffa30064ee0 0x7ffa30067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:44.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.042+0000 7ffa427fc700 1 -- 172.21.15.39:0/632171370 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5900+0+0 (secure 0 0 0) 0x7ffa48083000 con 0x7ffa4c070620 2023-11-28T11:59:44.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.042+0000 7ffa51442700 1 --2- 172.21.15.39:0/632171370 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ffa30064ee0 0x7ffa30067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:44.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.046+0000 7ffa51442700 1 --2- 172.21.15.39:0/632171370 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ffa30064ee0 0x7ffa30067390 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c000f60 tx=0x7ffa3c000ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:44.054 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.050+0000 7ffa427fc700 1 -- 172.21.15.39:0/632171370 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ffa48051150 con 0x7ffa4c070620 2023-11-28T11:59:44.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.222+0000 7ffa52c45700 1 -- 172.21.15.39:0/632171370 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ffa4c073cb0 con 0x7ffa4c070620 2023-11-28T11:59:44.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.822+0000 7ffa427fc700 1 -- 172.21.15.39:0/632171370 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v68) v1 ==== 170+0+0 (secure 0 0 0) 0x7ffa480150d0 con 0x7ffa4c070620 2023-11-28T11:59:44.840 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.834+0000 7ffa52c45700 1 -- 172.21.15.39:0/632171370 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ffa30064ee0 msgr2=0x7ffa30067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:44.841 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.834+0000 7ffa52c45700 1 --2- 172.21.15.39:0/632171370 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ffa30064ee0 0x7ffa30067390 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c000f60 tx=0x7ffa3c000ed0 comp rx=0 tx=0).stop 2023-11-28T11:59:44.841 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.834+0000 7ffa52c45700 1 -- 172.21.15.39:0/632171370 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa4c070620 msgr2=0x7ffa4c15fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:44.841 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.834+0000 7ffa52c45700 1 --2- 172.21.15.39:0/632171370 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa4c070620 0x7ffa4c15fa50 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c0717e0 tx=0x7ffa48004770 comp rx=0 tx=0).stop 2023-11-28T11:59:44.841 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.838+0000 7ffa52c45700 1 -- 172.21.15.39:0/632171370 shutdown_connections 2023-11-28T11:59:44.842 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.838+0000 7ffa52c45700 1 --2- 172.21.15.39:0/632171370 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffa4c1605e0 0x7ffa4c0c5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:44.842 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.838+0000 7ffa52c45700 1 --2- 172.21.15.39:0/632171370 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ffa30064ee0 0x7ffa30067390 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:44.842 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.838+0000 7ffa52c45700 1 --2- 172.21.15.39:0/632171370 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa4c0af9f0 0x7ffa4c148af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:44.842 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.838+0000 7ffa52c45700 1 --2- 172.21.15.39:0/632171370 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa4c070620 0x7ffa4c15fa50 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:44.842 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.838+0000 7ffa52c45700 1 -- 172.21.15.39:0/632171370 >> 172.21.15.39:0/632171370 conn(0x7ffa4c0cf280 msgr2=0x7ffa4c0b1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:44.842 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.838+0000 7ffa52c45700 1 -- 172.21.15.39:0/632171370 shutdown_connections 2023-11-28T11:59:44.843 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:44.838+0000 7ffa52c45700 1 -- 172.21.15.39:0/632171370 wait complete. 2023-11-28T11:59:44.848 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_data' created 2023-11-28T11:59:44.871 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T11:59:45.050 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.046+0000 7fd219882700 1 Processor -- start 2023-11-28T11:59:45.050 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.046+0000 7fd219882700 1 -- start start 2023-11-28T11:59:45.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.050+0000 7fd219882700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd21406b220 0x7fd214160cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:45.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.050+0000 7fd219882700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd21406c040 0x7fd21406c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:45.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.050+0000 7fd219882700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2140ca3b0 con 0x7fd2140ada10 2023-11-28T11:59:45.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.050+0000 7fd219882700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2141608b0 con 0x7fd21406b220 2023-11-28T11:59:45.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.050+0000 7fd219882700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21406ca00 con 0x7fd21406c040 2023-11-28T11:59:45.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.050+0000 7fd2127fc700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd21406b220 0x7fd214160cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:45.054 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.050+0000 7fd2137fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd21406c040 0x7fd21406c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:45.054 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.050+0000 7fd2127fc700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd21406b220 0x7fd214160cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47206/0 (socket says 172.21.15.39:47206) 2023-11-28T11:59:45.054 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.050+0000 7fd2127fc700 1 -- 172.21.15.39:0/256638891 learned_addr learned my addr 172.21.15.39:0/256638891 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:45.055 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.050+0000 7fd2127fc700 1 -- 172.21.15.39:0/256638891 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd21406c040 msgr2=0x7fd21406c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:45.055 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.050+0000 7fd2127fc700 1 --2- 172.21.15.39:0/256638891 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd21406c040 0x7fd21406c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:45.055 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.050+0000 7fd2127fc700 1 -- 172.21.15.39:0/256638891 >> v1:172.21.15.39:6789/0 conn(0x7fd2140ada10 legacy=0x7fd2140c9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:45.055 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.050+0000 7fd2127fc700 1 -- 172.21.15.39:0/256638891 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2141601f0 con 0x7fd21406b220 2023-11-28T11:59:45.055 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.050+0000 7fd2137fe700 1 --2- 172.21.15.39:0/256638891 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd21406c040 0x7fd21406c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:45.055 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.050+0000 7fd211ffb700 1 -- 172.21.15.39:0/256638891 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2317277764 0 0) 0x7fd2140ca3b0 con 0x7fd2140ada10 2023-11-28T11:59:45.055 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.050+0000 7fd2127fc700 1 --2- 172.21.15.39:0/256638891 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd21406b220 0x7fd214160cd0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fd208009910 tx=0x7fd208009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d983c8ffcff6899b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:45.056 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.050+0000 7fd211ffb700 1 -- 172.21.15.39:0/256638891 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd208011830 con 0x7fd21406b220 2023-11-28T11:59:45.056 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.050+0000 7fd211ffb700 1 -- 172.21.15.39:0/256638891 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd208011990 con 0x7fd21406b220 2023-11-28T11:59:45.056 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.050+0000 7fd211ffb700 1 -- 172.21.15.39:0/256638891 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd208011d40 con 0x7fd21406b220 2023-11-28T11:59:45.056 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.050+0000 7fd219882700 1 -- 172.21.15.39:0/256638891 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd21406b220 msgr2=0x7fd214160cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:45.057 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.050+0000 7fd219882700 1 --2- 172.21.15.39:0/256638891 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd21406b220 0x7fd214160cd0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fd208009910 tx=0x7fd208009c20 comp rx=0 tx=0).stop 2023-11-28T11:59:45.057 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.054+0000 7fd219882700 1 -- 172.21.15.39:0/256638891 shutdown_connections 2023-11-28T11:59:45.057 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.054+0000 7fd219882700 1 --2- 172.21.15.39:0/256638891 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd21406c040 0x7fd21406c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:45.057 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.054+0000 7fd219882700 1 --2- 172.21.15.39:0/256638891 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd21406b220 0x7fd214160cd0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:45.057 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.054+0000 7fd219882700 1 -- 172.21.15.39:0/256638891 >> 172.21.15.39:0/256638891 conn(0x7fd2140cf580 msgr2=0x7fd2140cb370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:45.057 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.054+0000 7fd219882700 1 -- 172.21.15.39:0/256638891 shutdown_connections 2023-11-28T11:59:45.057 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.054+0000 7fd219882700 1 -- 172.21.15.39:0/256638891 wait complete. 2023-11-28T11:59:45.059 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.054+0000 7fd219882700 1 Processor -- start 2023-11-28T11:59:45.059 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.054+0000 7fd219882700 1 -- start start 2023-11-28T11:59:45.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.058+0000 7fd219882700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd21406b220 0x7fd21414ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:45.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.058+0000 7fd219882700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd21406c040 0x7fd21415f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:45.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.058+0000 7fd219882700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2140ada10 0x7fd2141f4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:45.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.058+0000 7fd219882700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21414f360 con 0x7fd21406b220 2023-11-28T11:59:45.062 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.058+0000 7fd219882700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2140c3e90 con 0x7fd2140ada10 2023-11-28T11:59:45.062 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.058+0000 7fd219882700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2140c4170 con 0x7fd21406c040 2023-11-28T11:59:45.062 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.058+0000 7fd212ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd21406b220 0x7fd21414ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:45.062 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.058+0000 7fd212ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd21406b220 0x7fd21414ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47214/0 (socket says 172.21.15.39:47214) 2023-11-28T11:59:45.062 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.058+0000 7fd212ffd700 1 -- 172.21.15.39:0/2932985484 learned_addr learned my addr 172.21.15.39:0/2932985484 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:45.062 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.058+0000 7fd2127fc700 1 --2- 172.21.15.39:0/2932985484 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd21406c040 0x7fd21415f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:45.062 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.058+0000 7fd2137fe700 1 --2- 172.21.15.39:0/2932985484 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2140ada10 0x7fd2141f4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:45.063 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.058+0000 7fd2127fc700 1 -- 172.21.15.39:0/2932985484 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2140ada10 msgr2=0x7fd2141f4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:45.063 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.058+0000 7fd2127fc700 1 --2- 172.21.15.39:0/2932985484 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2140ada10 0x7fd2141f4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:45.063 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.058+0000 7fd2127fc700 1 -- 172.21.15.39:0/2932985484 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd21406b220 msgr2=0x7fd21414ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:45.064 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.058+0000 7fd2127fc700 1 --2- 172.21.15.39:0/2932985484 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd21406b220 0x7fd21414ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:45.064 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.058+0000 7fd2127fc700 1 -- 172.21.15.39:0/2932985484 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20c009a70 con 0x7fd21406c040 2023-11-28T11:59:45.064 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.058+0000 7fd212ffd700 1 --2- 172.21.15.39:0/2932985484 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd21406b220 0x7fd21414ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:45.064 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.058+0000 7fd2127fc700 1 --2- 172.21.15.39:0/2932985484 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd21406c040 0x7fd21415f280 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd2140700b0 tx=0x7fd208004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:45.064 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.058+0000 7fd1fbfff700 1 -- 172.21.15.39:0/2932985484 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20800b8b0 con 0x7fd21406c040 2023-11-28T11:59:45.064 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.058+0000 7fd219882700 1 -- 172.21.15.39:0/2932985484 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd208009570 con 0x7fd21406c040 2023-11-28T11:59:45.064 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.058+0000 7fd1fbfff700 1 -- 172.21.15.39:0/2932985484 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20801e070 con 0x7fd21406c040 2023-11-28T11:59:45.064 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.058+0000 7fd1fbfff700 1 -- 172.21.15.39:0/2932985484 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20800bc70 con 0x7fd21406c040 2023-11-28T11:59:45.064 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.058+0000 7fd219882700 1 -- 172.21.15.39:0/2932985484 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2140ca690 con 0x7fd21406c040 2023-11-28T11:59:45.065 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.062+0000 7fd219882700 1 -- 172.21.15.39:0/2932985484 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2141604d0 con 0x7fd21406c040 2023-11-28T11:59:45.066 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.062+0000 7fd1fbfff700 1 -- 172.21.15.39:0/2932985484 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd20800f050 con 0x7fd21406c040 2023-11-28T11:59:45.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.062+0000 7fd1fbfff700 1 --2- 172.21.15.39:0/2932985484 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd200064ee0 0x7fd200067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:45.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.062+0000 7fd1fbfff700 1 -- 172.21.15.39:0/2932985484 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6282+0+0 (secure 0 0 0) 0x7fd208082f10 con 0x7fd21406c040 2023-11-28T11:59:45.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.066+0000 7fd212ffd700 1 --2- 172.21.15.39:0/2932985484 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd200064ee0 0x7fd200067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:45.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.066+0000 7fd212ffd700 1 --2- 172.21.15.39:0/2932985484 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd200064ee0 0x7fd200067390 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd204000f60 tx=0x7fd204009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:45.076 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.074+0000 7fd1fbfff700 1 -- 172.21.15.39:0/2932985484 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd208050e60 con 0x7fd21406c040 2023-11-28T11:59:45.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.282+0000 7fd219882700 1 -- 172.21.15.39:0/2932985484 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd2140adde0 con 0x7fd21406c040 2023-11-28T11:59:45.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.298+0000 7fd1fbfff700 1 -- 172.21.15.39:0/2932985484 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v28) v1 ==== 174+0+0 (secure 0 0 0) 0x7fd208006da0 con 0x7fd21406c040 2023-11-28T11:59:45.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.306+0000 7fd219882700 1 -- 172.21.15.39:0/2932985484 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd200064ee0 msgr2=0x7fd200067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:45.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.306+0000 7fd219882700 1 --2- 172.21.15.39:0/2932985484 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd200064ee0 0x7fd200067390 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd204000f60 tx=0x7fd204009040 comp rx=0 tx=0).stop 2023-11-28T11:59:45.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.306+0000 7fd219882700 1 -- 172.21.15.39:0/2932985484 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd21406c040 msgr2=0x7fd21415f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:45.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.306+0000 7fd219882700 1 --2- 172.21.15.39:0/2932985484 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd21406c040 0x7fd21415f280 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd2140700b0 tx=0x7fd208004770 comp rx=0 tx=0).stop 2023-11-28T11:59:45.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.310+0000 7fd219882700 1 -- 172.21.15.39:0/2932985484 shutdown_connections 2023-11-28T11:59:45.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.310+0000 7fd219882700 1 --2- 172.21.15.39:0/2932985484 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd200064ee0 0x7fd200067390 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:45.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.310+0000 7fd219882700 1 --2- 172.21.15.39:0/2932985484 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2140ada10 0x7fd2141f4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:45.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.310+0000 7fd219882700 1 --2- 172.21.15.39:0/2932985484 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd21406c040 0x7fd21415f280 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:45.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.310+0000 7fd219882700 1 --2- 172.21.15.39:0/2932985484 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd21406b220 0x7fd21414ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:45.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.310+0000 7fd219882700 1 -- 172.21.15.39:0/2932985484 >> 172.21.15.39:0/2932985484 conn(0x7fd2140cf580 msgr2=0x7fd2140ac0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:45.315 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.310+0000 7fd219882700 1 -- 172.21.15.39:0/2932985484 shutdown_connections 2023-11-28T11:59:45.315 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.310+0000 7fd219882700 1 -- 172.21.15.39:0/2932985484 wait complete. 2023-11-28T11:59:45.326 INFO:teuthology.orchestra.run.smithi039.stderr:new fs with metadata pool 10 and data pool 11 2023-11-28T11:59:45.349 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:59:45.516 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.510+0000 7f2dc9d37700 1 Processor -- start 2023-11-28T11:59:45.516 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.514+0000 7f2dc9d37700 1 -- start start 2023-11-28T11:59:45.518 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.514+0000 7f2dc9d37700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2dc4070790 0x7f2dc4164fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:45.518 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.514+0000 7f2dc9d37700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc415a550 con 0x7f2dc40b1640 2023-11-28T11:59:45.518 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.514+0000 7f2dc9d37700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc406b0a0 con 0x7f2dc40b43a0 2023-11-28T11:59:45.518 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.514+0000 7f2dc9d37700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc40caac0 con 0x7f2dc4070790 2023-11-28T11:59:45.518 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.514+0000 7f2dbbfff700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f2dc40b1640 0x7f2dc4070080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:41122/0 (socket says 172.21.15.39:41122) 2023-11-28T11:59:45.518 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.514+0000 7f2dbbfff700 1 -- 172.21.15.39:0/2376812527 learned_addr learned my addr 172.21.15.39:0/2376812527 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:59:45.520 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.514+0000 7f2dc9536700 1 --2- 172.21.15.39:0/2376812527 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2dc4070790 0x7f2dc4164fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:45.520 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.514+0000 7f2dbb7fe700 1 -- 172.21.15.39:0/2376812527 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 832502280 0 0) 0x7f2db4001110 con 0x7f2dc40b1640 2023-11-28T11:59:45.520 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.514+0000 7f2dbb7fe700 1 -- 172.21.15.39:0/2376812527 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dac0035d0 con 0x7f2dc40b1640 2023-11-28T11:59:45.521 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.514+0000 7f2dbb7fe700 1 -- 172.21.15.39:0/2376812527 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 913790565 0 0) 0x7f2dac0035d0 con 0x7f2dc40b1640 2023-11-28T11:59:45.521 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.514+0000 7f2dbb7fe700 1 -- 172.21.15.39:0/2376812527 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2dc4070790 msgr2=0x7f2dc4164fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:45.521 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.514+0000 7f2dbb7fe700 1 --2- 172.21.15.39:0/2376812527 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2dc4070790 0x7f2dc4164fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:45.521 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.514+0000 7f2dbb7fe700 1 -- 172.21.15.39:0/2376812527 >> v1:172.21.15.184:6789/0 conn(0x7f2dc40b43a0 legacy=0x7f2dc415e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:45.521 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.514+0000 7f2dbb7fe700 1 -- 172.21.15.39:0/2376812527 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc40cada0 con 0x7f2dc40b1640 2023-11-28T11:59:45.521 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.514+0000 7f2dbb7fe700 1 -- 172.21.15.39:0/2376812527 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4013383302 0 0) 0x7f2db4001800 con 0x7f2dc40b1640 2023-11-28T11:59:45.521 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.514+0000 7f2dbb7fe700 1 -- 172.21.15.39:0/2376812527 >> v1:172.21.15.39:6789/0 conn(0x7f2dc40b1640 legacy=0x7f2dc4070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:45.521 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.514+0000 7f2dbb7fe700 1 --2- 172.21.15.39:0/2376812527 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dac003a50 0x7f2dac003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:45.521 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.514+0000 7f2dbb7fe700 1 --2- 172.21.15.39:0/2376812527 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2dac0043f0 0x7f2dac0048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:45.521 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.514+0000 7f2dbb7fe700 1 --2- 172.21.15.39:0/2376812527 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2dc4070790 0x7f2dac0051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:45.521 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.514+0000 7f2dbb7fe700 1 -- 172.21.15.39:0/2376812527 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc40caac0 con 0x7f2dac0043f0 2023-11-28T11:59:45.521 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.514+0000 7f2dbb7fe700 1 -- 172.21.15.39:0/2376812527 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac00bae0 con 0x7f2dac003a50 2023-11-28T11:59:45.521 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.514+0000 7f2dbb7fe700 1 -- 172.21.15.39:0/2376812527 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac00bca0 con 0x7f2dc4070790 2023-11-28T11:59:45.522 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.518+0000 7f2dbbfff700 1 --2- 172.21.15.39:0/2376812527 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2dac0043f0 0x7f2dac0048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:45.522 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.518+0000 7f2dc8d35700 1 --2- 172.21.15.39:0/2376812527 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dac003a50 0x7f2dac003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:45.522 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.518+0000 7f2dc9536700 1 --2- 172.21.15.39:0/2376812527 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2dc4070790 0x7f2dac0051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:45.523 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.518+0000 7f2dbbfff700 1 -- 172.21.15.39:0/2376812527 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2dc4070790 msgr2=0x7f2dac0051b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:45.523 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.518+0000 7f2dbbfff700 1 --2- 172.21.15.39:0/2376812527 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2dc4070790 0x7f2dac0051b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:45.523 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.518+0000 7f2dbbfff700 1 -- 172.21.15.39:0/2376812527 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dac003a50 msgr2=0x7f2dac003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:45.523 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.518+0000 7f2dbbfff700 1 --2- 172.21.15.39:0/2376812527 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dac003a50 0x7f2dac003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:45.523 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.518+0000 7f2dbbfff700 1 -- 172.21.15.39:0/2376812527 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dac0035d0 con 0x7f2dac0043f0 2023-11-28T11:59:45.524 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.518+0000 7f2dbbfff700 1 --2- 172.21.15.39:0/2376812527 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2dac0043f0 0x7f2dac0048b0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f2db400c320 tx=0x7f2dac0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c5e6f9786835c6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:45.524 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.518+0000 7f2dbb7fe700 1 -- 172.21.15.39:0/2376812527 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db400cda0 con 0x7f2dac0043f0 2023-11-28T11:59:45.524 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.518+0000 7f2dbb7fe700 1 -- 172.21.15.39:0/2376812527 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db4005980 con 0x7f2dac0043f0 2023-11-28T11:59:45.524 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.518+0000 7f2dbb7fe700 1 -- 172.21.15.39:0/2376812527 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db4005d30 con 0x7f2dac0043f0 2023-11-28T11:59:45.524 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.518+0000 7f2dc9d37700 1 -- 172.21.15.39:0/2376812527 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2dac0043f0 msgr2=0x7f2dac0048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:45.524 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.518+0000 7f2dc9d37700 1 --2- 172.21.15.39:0/2376812527 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2dac0043f0 0x7f2dac0048b0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f2db400c320 tx=0x7f2dac0058a0 comp rx=0 tx=0).stop 2023-11-28T11:59:45.525 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.518+0000 7f2dc9536700 1 -- 172.21.15.39:0/2376812527 reap_dead start 2023-11-28T11:59:45.525 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.518+0000 7f2dc9d37700 1 -- 172.21.15.39:0/2376812527 shutdown_connections 2023-11-28T11:59:45.525 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.518+0000 7f2dc9d37700 1 -- 172.21.15.39:0/2376812527 >> 172.21.15.39:0/2376812527 conn(0x7f2dc40b0f80 msgr2=0x7f2dc40ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:45.525 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.518+0000 7f2dc9d37700 1 -- 172.21.15.39:0/2376812527 shutdown_connections 2023-11-28T11:59:45.525 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.518+0000 7f2dc9d37700 1 -- 172.21.15.39:0/2376812527 wait complete. 2023-11-28T11:59:45.527 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.522+0000 7f2dc9d37700 1 Processor -- start 2023-11-28T11:59:45.527 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.522+0000 7f2dc9d37700 1 -- start start 2023-11-28T11:59:45.529 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.526+0000 7f2dc9d37700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2dac0043f0 0x7f2dc40cd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:45.529 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.526+0000 7f2dc9d37700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dc415d180 0x7f2dc41538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:45.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.526+0000 7f2dc9d37700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2dc40af570 0x7f2dc40af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:45.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.526+0000 7f2dc9d37700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc40aff20 con 0x7f2dc40af570 2023-11-28T11:59:45.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.526+0000 7f2dc9d37700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc4153e30 con 0x7f2dc415d180 2023-11-28T11:59:45.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.526+0000 7f2dc9d37700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc40cd9d0 con 0x7f2dac0043f0 2023-11-28T11:59:45.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.526+0000 7f2dc9536700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2dc40af570 0x7f2dc40af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:45.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.526+0000 7f2dc9536700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2dc40af570 0x7f2dc40af9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47240/0 (socket says 172.21.15.39:47240) 2023-11-28T11:59:45.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.526+0000 7f2dc9536700 1 -- 172.21.15.39:0/4282533686 learned_addr learned my addr 172.21.15.39:0/4282533686 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:45.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.526+0000 7f2dc8d35700 1 --2- 172.21.15.39:0/4282533686 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2dac0043f0 0x7f2dc40cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:45.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.526+0000 7f2dbbfff700 1 --2- 172.21.15.39:0/4282533686 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dc415d180 0x7f2dc41538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:45.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.526+0000 7f2dc9536700 1 -- 172.21.15.39:0/4282533686 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2dac0043f0 msgr2=0x7f2dc40cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:45.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.526+0000 7f2dc9536700 1 --2- 172.21.15.39:0/4282533686 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2dac0043f0 0x7f2dc40cd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:45.531 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.526+0000 7f2dc9536700 1 -- 172.21.15.39:0/4282533686 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dc415d180 msgr2=0x7f2dc41538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:45.531 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.526+0000 7f2dc9536700 1 --2- 172.21.15.39:0/4282533686 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dc415d180 0x7f2dc41538f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:45.531 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.526+0000 7f2dc9536700 1 -- 172.21.15.39:0/4282533686 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc406b5d0 con 0x7f2dc40af570 2023-11-28T11:59:45.531 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.526+0000 7f2dc9536700 1 --2- 172.21.15.39:0/4282533686 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2dc40af570 0x7f2dc40af9e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f2dc40ce5f0 tx=0x7f2dbc011b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:45.532 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.526+0000 7f2db97fa700 1 -- 172.21.15.39:0/4282533686 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc004300 con 0x7f2dc40af570 2023-11-28T11:59:45.532 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.526+0000 7f2db97fa700 1 -- 172.21.15.39:0/4282533686 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dbc004460 con 0x7f2dc40af570 2023-11-28T11:59:45.532 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.526+0000 7f2db97fa700 1 -- 172.21.15.39:0/4282533686 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc0045d0 con 0x7f2dc40af570 2023-11-28T11:59:45.532 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.526+0000 7f2dc9d37700 1 -- 172.21.15.39:0/4282533686 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dc406b2f0 con 0x7f2dc40af570 2023-11-28T11:59:45.532 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.526+0000 7f2dc9d37700 1 -- 172.21.15.39:0/4282533686 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dc40ca7b0 con 0x7f2dc40af570 2023-11-28T11:59:45.532 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.526+0000 7f2dc9d37700 1 -- 172.21.15.39:0/4282533686 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dc4073cb0 con 0x7f2dc40af570 2023-11-28T11:59:45.533 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.530+0000 7f2db97fa700 1 -- 172.21.15.39:0/4282533686 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2dbc003900 con 0x7f2dc40af570 2023-11-28T11:59:45.535 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.530+0000 7f2db97fa700 1 --2- 172.21.15.39:0/4282533686 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2db0064f10 0x7f2db00673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:45.535 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.530+0000 7f2db97fa700 1 -- 172.21.15.39:0/4282533686 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2dbc082c70 con 0x7f2dc40af570 2023-11-28T11:59:45.535 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.530+0000 7f2dc8d35700 1 --2- 172.21.15.39:0/4282533686 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2db0064f10 0x7f2db00673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:45.536 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.534+0000 7f2dc8d35700 1 --2- 172.21.15.39:0/4282533686 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2db0064f10 0x7f2db00673c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0002230 tx=0x7f2dc0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:45.538 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.534+0000 7f2db97fa700 1 -- 172.21.15.39:0/4282533686 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2dbc050d70 con 0x7f2dc40af570 2023-11-28T11:59:45.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.702+0000 7f2dc9d37700 1 -- 172.21.15.39:0/4282533686 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2dc4071090 con 0x7f2dc40af570 2023-11-28T11:59:45.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.706+0000 7f2db97fa700 1 -- 172.21.15.39:0/4282533686 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+18100 (secure 0 0 0) 0x7f2dbc054390 con 0x7f2dc40af570 2023-11-28T11:59:45.710 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:59:45.710 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":69,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:59:45.289268+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:59:43.752184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-28T11:59:44.294885+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:59:45.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.710+0000 7f2dc9d37700 1 -- 172.21.15.39:0/4282533686 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2db0064f10 msgr2=0x7f2db00673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:45.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.710+0000 7f2dc9d37700 1 --2- 172.21.15.39:0/4282533686 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2db0064f10 0x7f2db00673c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0002230 tx=0x7f2dc0009040 comp rx=0 tx=0).stop 2023-11-28T11:59:45.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.710+0000 7f2dc9d37700 1 -- 172.21.15.39:0/4282533686 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2dc40af570 msgr2=0x7f2dc40af9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:45.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.710+0000 7f2dc9d37700 1 --2- 172.21.15.39:0/4282533686 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2dc40af570 0x7f2dc40af9e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f2dc40ce5f0 tx=0x7f2dbc011b80 comp rx=0 tx=0).stop 2023-11-28T11:59:45.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.710+0000 7f2dc9d37700 1 -- 172.21.15.39:0/4282533686 shutdown_connections 2023-11-28T11:59:45.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.710+0000 7f2dc9d37700 1 --2- 172.21.15.39:0/4282533686 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2dc40af570 0x7f2dc40af9e0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:45.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.710+0000 7f2dc9d37700 1 --2- 172.21.15.39:0/4282533686 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2db0064f10 0x7f2db00673c0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:45.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.710+0000 7f2dc9d37700 1 --2- 172.21.15.39:0/4282533686 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dc415d180 0x7f2dc41538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:45.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.710+0000 7f2dc9d37700 1 --2- 172.21.15.39:0/4282533686 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2dac0043f0 0x7f2dc40cd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:45.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.710+0000 7f2dc9d37700 1 -- 172.21.15.39:0/4282533686 >> 172.21.15.39:0/4282533686 conn(0x7f2dc40b0f80 msgr2=0x7f2dc4070060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:45.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.710+0000 7f2dc9d37700 1 -- 172.21.15.39:0/4282533686 shutdown_connections 2023-11-28T11:59:45.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.710+0000 7f2dc9d37700 1 -- 172.21.15.39:0/4282533686 wait complete. 2023-11-28T11:59:45.735 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:59:45.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.906+0000 7f4ce6afb700 1 Processor -- start 2023-11-28T11:59:45.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.906+0000 7f4ce6afb700 1 -- start start 2023-11-28T11:59:45.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.906+0000 7f4ce6afb700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4ce0070080 0x7f4ce00704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:45.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.906+0000 7f4ce6afb700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ce00ad6c0 con 0x7f4ce0164250 2023-11-28T11:59:45.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.906+0000 7f4ce6afb700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ce00adc60 con 0x7f4ce0160710 2023-11-28T11:59:45.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.906+0000 7f4ce6afb700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ce006b1c0 con 0x7f4ce0070080 2023-11-28T11:59:45.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.910+0000 7f4ce52f8700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4ce0070080 0x7f4ce00704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:45.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.910+0000 7f4ce62fa700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f4ce0164250 0x7f4ce01646b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:41138/0 (socket says 172.21.15.39:41138) 2023-11-28T11:59:45.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.910+0000 7f4ce62fa700 1 -- 172.21.15.39:0/1371673201 learned_addr learned my addr 172.21.15.39:0/1371673201 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:59:45.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.910+0000 7f4ce52f8700 1 -- 172.21.15.39:0/1371673201 >> v1:172.21.15.184:6789/0 conn(0x7f4ce0160710 legacy=0x7f4ce00cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:45.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.910+0000 7f4ce52f8700 1 -- 172.21.15.39:0/1371673201 >> v1:172.21.15.39:6789/0 conn(0x7f4ce0164250 legacy=0x7f4ce01646b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:45.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.910+0000 7f4ce52f8700 1 -- 172.21.15.39:0/1371673201 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce00709f0 con 0x7f4ce0070080 2023-11-28T11:59:45.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.910+0000 7f4ce52f8700 1 --2- 172.21.15.39:0/1371673201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ce0070080 0x7f4ce00704b0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0009850 tx=0x7f4cd0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ef4c04911274e48 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:45.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.910+0000 7f4ce4af7700 1 -- 172.21.15.39:0/1371673201 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd0011830 con 0x7f4ce0070080 2023-11-28T11:59:45.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.910+0000 7f4ce4af7700 1 -- 172.21.15.39:0/1371673201 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd0011990 con 0x7f4ce0070080 2023-11-28T11:59:45.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.910+0000 7f4ce4af7700 1 -- 172.21.15.39:0/1371673201 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd0011d00 con 0x7f4ce0070080 2023-11-28T11:59:45.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.910+0000 7f4ce6afb700 1 -- 172.21.15.39:0/1371673201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ce0070080 msgr2=0x7f4ce00704b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:45.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.910+0000 7f4ce6afb700 1 --2- 172.21.15.39:0/1371673201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ce0070080 0x7f4ce00704b0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0009850 tx=0x7f4cd0009b60 comp rx=0 tx=0).stop 2023-11-28T11:59:45.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.910+0000 7f4ce6afb700 1 -- 172.21.15.39:0/1371673201 shutdown_connections 2023-11-28T11:59:45.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.910+0000 7f4ce6afb700 1 --2- 172.21.15.39:0/1371673201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ce0070080 0x7f4ce00704b0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:45.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.910+0000 7f4ce6afb700 1 -- 172.21.15.39:0/1371673201 >> 172.21.15.39:0/1371673201 conn(0x7f4ce00b0f80 msgr2=0x7f4ce00ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:45.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.910+0000 7f4ce6afb700 1 -- 172.21.15.39:0/1371673201 shutdown_connections 2023-11-28T11:59:45.916 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.910+0000 7f4ce6afb700 1 -- 172.21.15.39:0/1371673201 wait complete. 2023-11-28T11:59:45.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.914+0000 7f4ce6afb700 1 Processor -- start 2023-11-28T11:59:45.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.914+0000 7f4ce6afb700 1 -- start start 2023-11-28T11:59:45.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.914+0000 7f4ce6afb700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ce0070080 0x7f4ce00c2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:45.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.914+0000 7f4ce6afb700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ce0160710 0x7f4ce0162650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:45.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.914+0000 7f4ce6afb700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ce0164250 0x7f4ce00c17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:45.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.914+0000 7f4ce6afb700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce00c2bd0 con 0x7f4ce0160710 2023-11-28T11:59:45.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.914+0000 7f4ce6afb700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce00c1d20 con 0x7f4ce0164250 2023-11-28T11:59:45.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.914+0000 7f4ce6afb700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce00c1f50 con 0x7f4ce0070080 2023-11-28T11:59:45.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.914+0000 7f4ce52f8700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ce0160710 0x7f4ce0162650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:45.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.914+0000 7f4ce52f8700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ce0160710 0x7f4ce0162650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47246/0 (socket says 172.21.15.39:47246) 2023-11-28T11:59:45.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.914+0000 7f4ce52f8700 1 -- 172.21.15.39:0/975528047 learned_addr learned my addr 172.21.15.39:0/975528047 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:45.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.918+0000 7f4ce62fa700 1 --2- 172.21.15.39:0/975528047 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ce0164250 0x7f4ce00c17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:45.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.918+0000 7f4ce5af9700 1 --2- 172.21.15.39:0/975528047 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ce0070080 0x7f4ce00c2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:45.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.918+0000 7f4ce52f8700 1 -- 172.21.15.39:0/975528047 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ce0070080 msgr2=0x7f4ce00c2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:45.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.918+0000 7f4ce52f8700 1 --2- 172.21.15.39:0/975528047 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ce0070080 0x7f4ce00c2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:45.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.918+0000 7f4ce52f8700 1 -- 172.21.15.39:0/975528047 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ce0164250 msgr2=0x7f4ce00c17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:45.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.918+0000 7f4ce52f8700 1 --2- 172.21.15.39:0/975528047 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ce0164250 0x7f4ce00c17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:45.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.918+0000 7f4ce52f8700 1 -- 172.21.15.39:0/975528047 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd00094b0 con 0x7f4ce0160710 2023-11-28T11:59:45.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.918+0000 7f4ce5af9700 1 --2- 172.21.15.39:0/975528047 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ce0070080 0x7f4ce00c2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:45.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.918+0000 7f4ce52f8700 1 --2- 172.21.15.39:0/975528047 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ce0160710 0x7f4ce0162650 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0009fd0 tx=0x7f4cd0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:45.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.918+0000 7f4cd67fc700 1 -- 172.21.15.39:0/975528047 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd00044a0 con 0x7f4ce0160710 2023-11-28T11:59:45.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.918+0000 7f4cd67fc700 1 -- 172.21.15.39:0/975528047 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd001f070 con 0x7f4ce0160710 2023-11-28T11:59:45.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.918+0000 7f4cd67fc700 1 -- 172.21.15.39:0/975528047 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd0003900 con 0x7f4ce0160710 2023-11-28T11:59:45.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.918+0000 7f4ce6afb700 1 -- 172.21.15.39:0/975528047 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ce006b3d0 con 0x7f4ce0160710 2023-11-28T11:59:45.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.918+0000 7f4ce6afb700 1 -- 172.21.15.39:0/975528047 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ce00cca30 con 0x7f4ce0160710 2023-11-28T11:59:45.924 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.918+0000 7f4ce6afb700 1 -- 172.21.15.39:0/975528047 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ce006b6b0 con 0x7f4ce0160710 2023-11-28T11:59:45.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.922+0000 7f4cd67fc700 1 -- 172.21.15.39:0/975528047 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4cd002a020 con 0x7f4ce0160710 2023-11-28T11:59:45.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.922+0000 7f4cd67fc700 1 --2- 172.21.15.39:0/975528047 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4cc4064ee0 0x7f4cc4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:45.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.922+0000 7f4cd67fc700 1 -- 172.21.15.39:0/975528047 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4cd0083610 con 0x7f4ce0160710 2023-11-28T11:59:45.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.922+0000 7f4ce5af9700 1 --2- 172.21.15.39:0/975528047 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4cc4064ee0 0x7f4cc4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:45.929 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.926+0000 7f4ce5af9700 1 --2- 172.21.15.39:0/975528047 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4cc4064ee0 0x7f4cc4067390 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc000f60 tx=0x7f4cdc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:45.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:45.930+0000 7f4cd67fc700 1 -- 172.21.15.39:0/975528047 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4cd0051670 con 0x7f4ce0160710 2023-11-28T11:59:46.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.110+0000 7f4ce6afb700 1 -- 172.21.15.39:0/975528047 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ce00c2d10 con 0x7f4ce0160710 2023-11-28T11:59:46.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.114+0000 7f4cd67fc700 1 -- 172.21.15.39:0/975528047 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+18100 (secure 0 0 0) 0x7f4ce00c2d10 con 0x7f4ce0160710 2023-11-28T11:59:46.118 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:59:46.118 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":69,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:59:45.289268+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:59:43.752184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-28T11:59:44.294885+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:59:46.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.114+0000 7f4ce6afb700 1 -- 172.21.15.39:0/975528047 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4cc4064ee0 msgr2=0x7f4cc4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:46.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.114+0000 7f4ce6afb700 1 --2- 172.21.15.39:0/975528047 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4cc4064ee0 0x7f4cc4067390 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc000f60 tx=0x7f4cdc009040 comp rx=0 tx=0).stop 2023-11-28T11:59:46.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.114+0000 7f4ce6afb700 1 -- 172.21.15.39:0/975528047 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ce0160710 msgr2=0x7f4ce0162650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:46.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.114+0000 7f4ce6afb700 1 --2- 172.21.15.39:0/975528047 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ce0160710 0x7f4ce0162650 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0009fd0 tx=0x7f4cd0004770 comp rx=0 tx=0).stop 2023-11-28T11:59:46.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.118+0000 7f4ce6afb700 1 -- 172.21.15.39:0/975528047 shutdown_connections 2023-11-28T11:59:46.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.118+0000 7f4ce6afb700 1 --2- 172.21.15.39:0/975528047 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4cc4064ee0 0x7f4cc4067390 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:46.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.118+0000 7f4ce6afb700 1 --2- 172.21.15.39:0/975528047 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ce0164250 0x7f4ce00c17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:46.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.118+0000 7f4ce6afb700 1 --2- 172.21.15.39:0/975528047 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ce0160710 0x7f4ce0162650 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:46.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.118+0000 7f4ce6afb700 1 --2- 172.21.15.39:0/975528047 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ce0070080 0x7f4ce00c2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:46.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.118+0000 7f4ce6afb700 1 -- 172.21.15.39:0/975528047 >> 172.21.15.39:0/975528047 conn(0x7f4ce00b0f80 msgr2=0x7f4ce00b3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:46.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.118+0000 7f4ce6afb700 1 -- 172.21.15.39:0/975528047 shutdown_connections 2023-11-28T11:59:46.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.118+0000 7f4ce6afb700 1 -- 172.21.15.39:0/975528047 wait complete. 2023-11-28T11:59:46.143 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T11:59:46.330 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.326+0000 7f2d25474700 1 Processor -- start 2023-11-28T11:59:46.330 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.326+0000 7f2d25474700 1 -- start start 2023-11-28T11:59:46.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.326+0000 7f2d25474700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d2006c590 0x7f2d200ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:46.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.326+0000 7f2d25474700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d200cd110 con 0x7f2d2006cbc0 2023-11-28T11:59:46.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.326+0000 7f2d25474700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d200cd340 con 0x7f2d2015c360 2023-11-28T11:59:46.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.326+0000 7f2d25474700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d200c9a40 con 0x7f2d2006c590 2023-11-28T11:59:46.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.330+0000 7f2d1f7fe700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f2d2006cbc0 0x7f2d200c9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:41140/0 (socket says 172.21.15.39:41140) 2023-11-28T11:59:46.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.330+0000 7f2d1f7fe700 1 -- 172.21.15.39:0/1966027507 learned_addr learned my addr 172.21.15.39:0/1966027507 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:59:46.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.330+0000 7f2d17fff700 1 --2- 172.21.15.39:0/1966027507 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d2006c590 0x7f2d200ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:46.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.330+0000 7f2d1e7fc700 1 -- 172.21.15.39:0/1966027507 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4071451894 0 0) 0x7f2d200cd110 con 0x7f2d2006cbc0 2023-11-28T11:59:46.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.330+0000 7f2d1e7fc700 1 -- 172.21.15.39:0/1966027507 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d0c0035d0 con 0x7f2d2006cbc0 2023-11-28T11:59:46.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.330+0000 7f2d1e7fc700 1 -- 172.21.15.39:0/1966027507 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4170976360 0 0) 0x7f2d200cd340 con 0x7f2d2015c360 2023-11-28T11:59:46.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.330+0000 7f2d17fff700 1 -- 172.21.15.39:0/1966027507 >> v1:172.21.15.184:6789/0 conn(0x7f2d2015c360 legacy=0x7f2d2006be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:46.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.330+0000 7f2d17fff700 1 -- 172.21.15.39:0/1966027507 >> v1:172.21.15.39:6789/0 conn(0x7f2d2006cbc0 legacy=0x7f2d200c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:46.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.330+0000 7f2d17fff700 1 -- 172.21.15.39:0/1966027507 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d200cd620 con 0x7f2d2006c590 2023-11-28T11:59:46.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.330+0000 7f2d17fff700 1 --2- 172.21.15.39:0/1966027507 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d2006c590 0x7f2d200ccbd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2d08009880 tx=0x7f2d08009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d16f28016b9dbc40 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:46.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.330+0000 7f2d1e7fc700 1 -- 172.21.15.39:0/1966027507 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d08011830 con 0x7f2d2006c590 2023-11-28T11:59:46.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.330+0000 7f2d1e7fc700 1 -- 172.21.15.39:0/1966027507 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d08011990 con 0x7f2d2006c590 2023-11-28T11:59:46.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.330+0000 7f2d1e7fc700 1 -- 172.21.15.39:0/1966027507 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d08011d20 con 0x7f2d2006c590 2023-11-28T11:59:46.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.330+0000 7f2d25474700 1 -- 172.21.15.39:0/1966027507 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d2006c590 msgr2=0x7f2d200ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:46.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.330+0000 7f2d25474700 1 --2- 172.21.15.39:0/1966027507 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d2006c590 0x7f2d200ccbd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2d08009880 tx=0x7f2d08009b90 comp rx=0 tx=0).stop 2023-11-28T11:59:46.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.330+0000 7f2d25474700 1 -- 172.21.15.39:0/1966027507 shutdown_connections 2023-11-28T11:59:46.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.330+0000 7f2d25474700 1 --2- 172.21.15.39:0/1966027507 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d2006c590 0x7f2d200ccbd0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:46.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.330+0000 7f2d25474700 1 -- 172.21.15.39:0/1966027507 >> 172.21.15.39:0/1966027507 conn(0x7f2d200cf280 msgr2=0x7f2d200cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:46.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.330+0000 7f2d25474700 1 -- 172.21.15.39:0/1966027507 shutdown_connections 2023-11-28T11:59:46.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.330+0000 7f2d25474700 1 -- 172.21.15.39:0/1966027507 wait complete. 2023-11-28T11:59:46.338 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.334+0000 7f2d25474700 1 Processor -- start 2023-11-28T11:59:46.339 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.334+0000 7f2d25474700 1 -- start start 2023-11-28T11:59:46.340 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.334+0000 7f2d25474700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d2006c590 0x7f2d201502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:46.340 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.334+0000 7f2d25474700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d2006cbc0 0x7f2d201553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:46.340 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.334+0000 7f2d25474700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2d2015c360 0x7f2d2014e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:46.340 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.334+0000 7f2d25474700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2014ea00 con 0x7f2d2015c360 2023-11-28T11:59:46.340 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.334+0000 7f2d25474700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d20154330 con 0x7f2d2006c590 2023-11-28T11:59:46.340 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.334+0000 7f2d25474700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d20154610 con 0x7f2d2006cbc0 2023-11-28T11:59:46.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.338+0000 7f2d1f7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2d2015c360 0x7f2d2014e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:46.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.338+0000 7f2d1f7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2d2015c360 0x7f2d2014e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47256/0 (socket says 172.21.15.39:47256) 2023-11-28T11:59:46.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.338+0000 7f2d1f7fe700 1 -- 172.21.15.39:0/1153098034 learned_addr learned my addr 172.21.15.39:0/1153098034 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:46.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.338+0000 7f2d17fff700 1 --2- 172.21.15.39:0/1153098034 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d2006cbc0 0x7f2d201553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:46.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.338+0000 7f2d1effd700 1 --2- 172.21.15.39:0/1153098034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d2006c590 0x7f2d201502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:46.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.338+0000 7f2d1f7fe700 1 -- 172.21.15.39:0/1153098034 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d2006cbc0 msgr2=0x7f2d201553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:46.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.338+0000 7f2d1f7fe700 1 --2- 172.21.15.39:0/1153098034 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d2006cbc0 0x7f2d201553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:46.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.338+0000 7f2d1f7fe700 1 -- 172.21.15.39:0/1153098034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d2006c590 msgr2=0x7f2d201502e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:46.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.338+0000 7f2d1f7fe700 1 --2- 172.21.15.39:0/1153098034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d2006c590 0x7f2d201502e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:46.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.338+0000 7f2d1f7fe700 1 -- 172.21.15.39:0/1153098034 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d080094b0 con 0x7f2d2015c360 2023-11-28T11:59:46.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.338+0000 7f2d17fff700 1 --2- 172.21.15.39:0/1153098034 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d2006cbc0 0x7f2d201553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:46.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.338+0000 7f2d1f7fe700 1 --2- 172.21.15.39:0/1153098034 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2d2015c360 0x7f2d2014e4c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f2d1800caa0 tx=0x7f2d1800cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:46.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.338+0000 7f2d177fe700 1 -- 172.21.15.39:0/1153098034 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d18007480 con 0x7f2d2015c360 2023-11-28T11:59:46.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.338+0000 7f2d177fe700 1 -- 172.21.15.39:0/1153098034 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d180075e0 con 0x7f2d2015c360 2023-11-28T11:59:46.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.338+0000 7f2d177fe700 1 -- 172.21.15.39:0/1153098034 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d18007970 con 0x7f2d2015c360 2023-11-28T11:59:46.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.338+0000 7f2d25474700 1 -- 172.21.15.39:0/1153098034 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d2015c730 con 0x7f2d2015c360 2023-11-28T11:59:46.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.338+0000 7f2d25474700 1 -- 172.21.15.39:0/1153098034 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d200c9660 con 0x7f2d2015c360 2023-11-28T11:59:46.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.342+0000 7f2d25474700 1 -- 172.21.15.39:0/1153098034 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d200c9350 con 0x7f2d2015c360 2023-11-28T11:59:46.346 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.342+0000 7f2d177fe700 1 -- 172.21.15.39:0/1153098034 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2d18019030 con 0x7f2d2015c360 2023-11-28T11:59:46.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.342+0000 7f2d177fe700 1 --2- 172.21.15.39:0/1153098034 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2d00064ee0 0x7f2d00067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:46.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.342+0000 7f2d177fe700 1 -- 172.21.15.39:0/1153098034 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2d18081830 con 0x7f2d2015c360 2023-11-28T11:59:46.348 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.342+0000 7f2d1effd700 1 --2- 172.21.15.39:0/1153098034 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2d00064ee0 0x7f2d00067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:46.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.346+0000 7f2d1effd700 1 --2- 172.21.15.39:0/1153098034 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2d00064ee0 0x7f2d00067390 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2d10007fd0 tx=0x7f2d10009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:46.355 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.350+0000 7f2d177fe700 1 -- 172.21.15.39:0/1153098034 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2d1804f810 con 0x7f2d2015c360 2023-11-28T11:59:46.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:46.558+0000 7f2d25474700 1 -- 172.21.15.39:0/1153098034 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2d2006b840 con 0x7f2d2015c360 2023-11-28T11:59:47.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.318+0000 7f2d177fe700 1 -- 172.21.15.39:0/1153098034 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v31) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2d18052e30 con 0x7f2d2015c360 2023-11-28T11:59:47.325 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.322+0000 7f2d25474700 1 -- 172.21.15.39:0/1153098034 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2d00064ee0 msgr2=0x7f2d00067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:47.325 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.322+0000 7f2d25474700 1 --2- 172.21.15.39:0/1153098034 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2d00064ee0 0x7f2d00067390 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2d10007fd0 tx=0x7f2d10009040 comp rx=0 tx=0).stop 2023-11-28T11:59:47.325 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.322+0000 7f2d25474700 1 -- 172.21.15.39:0/1153098034 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2d2015c360 msgr2=0x7f2d2014e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:47.325 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.322+0000 7f2d25474700 1 --2- 172.21.15.39:0/1153098034 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2d2015c360 0x7f2d2014e4c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f2d1800caa0 tx=0x7f2d1800cad0 comp rx=0 tx=0).stop 2023-11-28T11:59:47.325 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.322+0000 7f2d25474700 1 -- 172.21.15.39:0/1153098034 shutdown_connections 2023-11-28T11:59:47.325 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.322+0000 7f2d25474700 1 --2- 172.21.15.39:0/1153098034 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2d2015c360 0x7f2d2014e4c0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:47.325 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.322+0000 7f2d25474700 1 --2- 172.21.15.39:0/1153098034 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d2006cbc0 0x7f2d201553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:47.325 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.322+0000 7f2d25474700 1 --2- 172.21.15.39:0/1153098034 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2d00064ee0 0x7f2d00067390 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:47.326 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.322+0000 7f2d25474700 1 --2- 172.21.15.39:0/1153098034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d2006c590 0x7f2d201502e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:47.326 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.322+0000 7f2d25474700 1 -- 172.21.15.39:0/1153098034 >> 172.21.15.39:0/1153098034 conn(0x7f2d200cf280 msgr2=0x7f2d200c34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:47.326 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.322+0000 7f2d25474700 1 -- 172.21.15.39:0/1153098034 shutdown_connections 2023-11-28T11:59:47.326 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.322+0000 7f2d25474700 1 -- 172.21.15.39:0/1153098034 wait complete. 2023-11-28T11:59:47.351 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T11:59:47.351 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T11:59:47.545 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.542+0000 7f163d770700 1 Processor -- start 2023-11-28T11:59:47.545 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.542+0000 7f163d770700 1 -- start start 2023-11-28T11:59:47.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.542+0000 7f163d770700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f163815c150 0x7f16380b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:47.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.542+0000 7f163d770700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1638070360 0x7f1638160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:47.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.542+0000 7f163d770700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f163815c520 con 0x7f163806ff10 2023-11-28T11:59:47.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.542+0000 7f163d770700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16380b4240 con 0x7f163815c150 2023-11-28T11:59:47.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.542+0000 7f163d770700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f163806ac00 con 0x7f1638070360 2023-11-28T11:59:47.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.546+0000 7f1636ffd700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f163815c150 0x7f16380b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:47.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.546+0000 7f1636ffd700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f163815c150 0x7f16380b3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47262/0 (socket says 172.21.15.39:47262) 2023-11-28T11:59:47.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.546+0000 7f1636ffd700 1 -- 172.21.15.39:0/3291025497 learned_addr learned my addr 172.21.15.39:0/3291025497 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:47.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.546+0000 7f16377fe700 1 --2- 172.21.15.39:0/3291025497 >> v2:172.21.15.184:3300/0 conn(0x7f1638070360 0x7f1638160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:47.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.546+0000 7f16367fc700 1 --1- 172.21.15.39:0/3291025497 >> v1:172.21.15.39:6789/0 conn(0x7f163806ff10 0x7f163815fc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:41152/0 (socket says 172.21.15.39:41152) 2023-11-28T11:59:47.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.546+0000 7f16377fe700 1 -- 172.21.15.39:0/3291025497 >> v2:172.21.15.39:3300/0 conn(0x7f163815c150 msgr2=0x7f16380b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:47.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.546+0000 7f16377fe700 1 --2- 172.21.15.39:0/3291025497 >> v2:172.21.15.39:3300/0 conn(0x7f163815c150 0x7f16380b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:47.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.546+0000 7f16377fe700 1 -- 172.21.15.39:0/3291025497 >> v1:172.21.15.39:6789/0 conn(0x7f163806ff10 legacy=0x7f163815fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:47.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.546+0000 7f16377fe700 1 -- 172.21.15.39:0/3291025497 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f163806cc50 con 0x7f1638070360 2023-11-28T11:59:47.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.546+0000 7f1636ffd700 1 --2- 172.21.15.39:0/3291025497 >> v2:172.21.15.39:3300/0 conn(0x7f163815c150 0x7f16380b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:47.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.546+0000 7f16377fe700 1 --2- 172.21.15.39:0/3291025497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1638070360 0x7f1638160340 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f163806de90 tx=0x7f163000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afa0eec81eb81f27 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:47.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.546+0000 7f1635ffb700 1 -- 172.21.15.39:0/3291025497 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163000e070 con 0x7f1638070360 2023-11-28T11:59:47.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.546+0000 7f1635ffb700 1 -- 172.21.15.39:0/3291025497 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f163000bb20 con 0x7f1638070360 2023-11-28T11:59:47.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.546+0000 7f1635ffb700 1 -- 172.21.15.39:0/3291025497 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1630012430 con 0x7f1638070360 2023-11-28T11:59:47.552 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.546+0000 7f163d770700 1 -- 172.21.15.39:0/3291025497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1638070360 msgr2=0x7f1638160340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:47.552 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.546+0000 7f163d770700 1 --2- 172.21.15.39:0/3291025497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1638070360 0x7f1638160340 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f163806de90 tx=0x7f163000b330 comp rx=0 tx=0).stop 2023-11-28T11:59:47.552 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.546+0000 7f163d770700 1 -- 172.21.15.39:0/3291025497 shutdown_connections 2023-11-28T11:59:47.552 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.546+0000 7f163d770700 1 --2- 172.21.15.39:0/3291025497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1638070360 0x7f1638160340 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:47.552 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.546+0000 7f163d770700 1 --2- 172.21.15.39:0/3291025497 >> v2:172.21.15.39:3300/0 conn(0x7f163815c150 0x7f16380b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:47.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.546+0000 7f163d770700 1 -- 172.21.15.39:0/3291025497 >> 172.21.15.39:0/3291025497 conn(0x7f16380d3680 msgr2=0x7f16380cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:47.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.550+0000 7f163d770700 1 -- 172.21.15.39:0/3291025497 shutdown_connections 2023-11-28T11:59:47.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.550+0000 7f163d770700 1 -- 172.21.15.39:0/3291025497 wait complete. 2023-11-28T11:59:47.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.550+0000 7f163d770700 1 Processor -- start 2023-11-28T11:59:47.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.550+0000 7f163d770700 1 -- start start 2023-11-28T11:59:47.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.554+0000 7f163d770700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f163806ff10 0x7f16380b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:47.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.554+0000 7f163d770700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1638070360 0x7f16380b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:47.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.554+0000 7f163d770700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f163815c150 0x7f163815aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:47.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.554+0000 7f163d770700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16380b8350 con 0x7f1638070360 2023-11-28T11:59:47.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.554+0000 7f163d770700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16380b7740 con 0x7f163815c150 2023-11-28T11:59:47.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.554+0000 7f163d770700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16380b7a20 con 0x7f163806ff10 2023-11-28T11:59:47.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.554+0000 7f16367fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1638070360 0x7f16380b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:47.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.554+0000 7f16367fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1638070360 0x7f16380b6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47274/0 (socket says 172.21.15.39:47274) 2023-11-28T11:59:47.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.554+0000 7f16367fc700 1 -- 172.21.15.39:0/340660175 learned_addr learned my addr 172.21.15.39:0/340660175 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:47.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.554+0000 7f1636ffd700 1 --2- 172.21.15.39:0/340660175 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f163806ff10 0x7f16380b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:47.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.554+0000 7f16377fe700 1 --2- 172.21.15.39:0/340660175 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f163815c150 0x7f163815aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:47.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.554+0000 7f16367fc700 1 -- 172.21.15.39:0/340660175 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f163806ff10 msgr2=0x7f16380b63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:47.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.554+0000 7f16367fc700 1 --2- 172.21.15.39:0/340660175 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f163806ff10 0x7f16380b63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:47.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.554+0000 7f16367fc700 1 -- 172.21.15.39:0/340660175 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f163815c150 msgr2=0x7f163815aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:47.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.554+0000 7f16367fc700 1 --2- 172.21.15.39:0/340660175 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f163815c150 0x7f163815aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:47.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.554+0000 7f16367fc700 1 -- 172.21.15.39:0/340660175 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1628009570 con 0x7f1638070360 2023-11-28T11:59:47.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.554+0000 7f16367fc700 1 --2- 172.21.15.39:0/340660175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1638070360 0x7f16380b6d60 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f162c00c520 tx=0x7f162c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:47.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.554+0000 7f161f7fe700 1 -- 172.21.15.39:0/340660175 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162c005cd0 con 0x7f1638070360 2023-11-28T11:59:47.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.554+0000 7f161f7fe700 1 -- 172.21.15.39:0/340660175 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162c005e50 con 0x7f1638070360 2023-11-28T11:59:47.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.554+0000 7f163d770700 1 -- 172.21.15.39:0/340660175 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1630009a70 con 0x7f1638070360 2023-11-28T11:59:47.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.554+0000 7f161f7fe700 1 -- 172.21.15.39:0/340660175 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162c007310 con 0x7f1638070360 2023-11-28T11:59:47.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.554+0000 7f163d770700 1 -- 172.21.15.39:0/340660175 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16380d2730 con 0x7f1638070360 2023-11-28T11:59:47.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.558+0000 7f163d770700 1 -- 172.21.15.39:0/340660175 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16380d05e0 con 0x7f1638070360 2023-11-28T11:59:47.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.558+0000 7f161f7fe700 1 -- 172.21.15.39:0/340660175 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f162c019030 con 0x7f1638070360 2023-11-28T11:59:47.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.558+0000 7f161f7fe700 1 --2- 172.21.15.39:0/340660175 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1624064ee0 0x7f1624067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:47.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.558+0000 7f161f7fe700 1 -- 172.21.15.39:0/340660175 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f162c0815d0 con 0x7f1638070360 2023-11-28T11:59:47.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.558+0000 7f1636ffd700 1 --2- 172.21.15.39:0/340660175 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1624064ee0 0x7f1624067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:47.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.562+0000 7f1636ffd700 1 --2- 172.21.15.39:0/340660175 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1624064ee0 0x7f1624067390 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1628009c70 tx=0x7f1628008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:47.568 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.566+0000 7f161f7fe700 1 -- 172.21.15.39:0/340660175 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f162c04f430 con 0x7f1638070360 2023-11-28T11:59:47.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:47.778+0000 7f163d770700 1 -- 172.21.15.39:0/340660175 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f16380d2430 con 0x7f1638070360 2023-11-28T11:59:48.338 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.334+0000 7f161f7fe700 1 -- 172.21.15.39:0/340660175 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7f162c017020 con 0x7f1638070360 2023-11-28T11:59:48.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.338+0000 7f163d770700 1 -- 172.21.15.39:0/340660175 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1624064ee0 msgr2=0x7f1624067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:48.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.338+0000 7f163d770700 1 --2- 172.21.15.39:0/340660175 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1624064ee0 0x7f1624067390 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1628009c70 tx=0x7f1628008040 comp rx=0 tx=0).stop 2023-11-28T11:59:48.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.338+0000 7f163d770700 1 -- 172.21.15.39:0/340660175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1638070360 msgr2=0x7f16380b6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:48.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.338+0000 7f163d770700 1 --2- 172.21.15.39:0/340660175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1638070360 0x7f16380b6d60 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f162c00c520 tx=0x7f162c00c8e0 comp rx=0 tx=0).stop 2023-11-28T11:59:48.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.338+0000 7f163d770700 1 -- 172.21.15.39:0/340660175 shutdown_connections 2023-11-28T11:59:48.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.338+0000 7f163d770700 1 --2- 172.21.15.39:0/340660175 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1624064ee0 0x7f1624067390 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:48.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.338+0000 7f163d770700 1 --2- 172.21.15.39:0/340660175 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f163815c150 0x7f163815aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:48.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.338+0000 7f163d770700 1 --2- 172.21.15.39:0/340660175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1638070360 0x7f16380b6d60 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:48.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.338+0000 7f163d770700 1 --2- 172.21.15.39:0/340660175 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f163806ff10 0x7f16380b63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:48.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.338+0000 7f163d770700 1 -- 172.21.15.39:0/340660175 >> 172.21.15.39:0/340660175 conn(0x7f16380d3680 msgr2=0x7f16380c8f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:48.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.338+0000 7f163d770700 1 -- 172.21.15.39:0/340660175 shutdown_connections 2023-11-28T11:59:48.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.338+0000 7f163d770700 1 -- 172.21.15.39:0/340660175 wait complete. 2023-11-28T11:59:48.371 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T11:59:48.371 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:59:48.567 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.562+0000 7fa9687a0700 1 Processor -- start 2023-11-28T11:59:48.567 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.562+0000 7fa9687a0700 1 -- start start 2023-11-28T11:59:48.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.566+0000 7fa9687a0700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9600c8d10 0x7fa9600cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:48.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.566+0000 7fa9687a0700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa96015a850 con 0x7fa96015a480 2023-11-28T11:59:48.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.566+0000 7fa9687a0700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9600cada0 con 0x7fa960069d60 2023-11-28T11:59:48.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.566+0000 7fa9687a0700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9600ce060 con 0x7fa9600c8d10 2023-11-28T11:59:48.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.566+0000 7fa96653c700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fa96015a480 0x7fa9600cc290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42270/0 (socket says 172.21.15.39:42270) 2023-11-28T11:59:48.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.566+0000 7fa96653c700 1 -- 172.21.15.39:0/1005535802 learned_addr learned my addr 172.21.15.39:0/1005535802 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:59:48.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.566+0000 7fa965d3b700 1 --2- 172.21.15.39:0/1005535802 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9600c8d10 0x7fa9600cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:48.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.566+0000 7fa96553a700 1 -- 172.21.15.39:0/1005535802 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2962371405 0 0) 0x7fa96015a850 con 0x7fa96015a480 2023-11-28T11:59:48.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.566+0000 7fa965d3b700 1 -- 172.21.15.39:0/1005535802 >> v1:172.21.15.184:6789/0 conn(0x7fa960069d60 legacy=0x7fa96006a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:48.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.566+0000 7fa965d3b700 1 -- 172.21.15.39:0/1005535802 >> v1:172.21.15.39:6789/0 conn(0x7fa96015a480 legacy=0x7fa9600cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:48.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.566+0000 7fa965d3b700 1 -- 172.21.15.39:0/1005535802 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9600ce300 con 0x7fa9600c8d10 2023-11-28T11:59:48.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.570+0000 7fa965d3b700 1 --2- 172.21.15.39:0/1005535802 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9600c8d10 0x7fa9600cc9a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa950009880 tx=0x7fa950009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5500eb100ac2d0c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:48.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.570+0000 7fa96553a700 1 -- 172.21.15.39:0/1005535802 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa950011830 con 0x7fa9600c8d10 2023-11-28T11:59:48.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.570+0000 7fa96553a700 1 -- 172.21.15.39:0/1005535802 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa950011990 con 0x7fa9600c8d10 2023-11-28T11:59:48.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.570+0000 7fa96553a700 1 -- 172.21.15.39:0/1005535802 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa950011d20 con 0x7fa9600c8d10 2023-11-28T11:59:48.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.570+0000 7fa9687a0700 1 -- 172.21.15.39:0/1005535802 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9600c8d10 msgr2=0x7fa9600cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:48.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.570+0000 7fa9687a0700 1 --2- 172.21.15.39:0/1005535802 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9600c8d10 0x7fa9600cc9a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa950009880 tx=0x7fa950009b90 comp rx=0 tx=0).stop 2023-11-28T11:59:48.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.570+0000 7fa9687a0700 1 -- 172.21.15.39:0/1005535802 shutdown_connections 2023-11-28T11:59:48.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.570+0000 7fa9687a0700 1 --2- 172.21.15.39:0/1005535802 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9600c8d10 0x7fa9600cc9a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:48.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.570+0000 7fa9687a0700 1 -- 172.21.15.39:0/1005535802 >> 172.21.15.39:0/1005535802 conn(0x7fa9600cf350 msgr2=0x7fa9600b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:48.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.570+0000 7fa9687a0700 1 -- 172.21.15.39:0/1005535802 shutdown_connections 2023-11-28T11:59:48.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.570+0000 7fa9687a0700 1 -- 172.21.15.39:0/1005535802 wait complete. 2023-11-28T11:59:48.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.574+0000 7fa9687a0700 1 Processor -- start 2023-11-28T11:59:48.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.574+0000 7fa9687a0700 1 -- start start 2023-11-28T11:59:48.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.574+0000 7fa9687a0700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa960069d60 0x7fa96015d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:48.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.574+0000 7fa9687a0700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9600c8d10 0x7fa9601ef460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:48.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.574+0000 7fa9687a0700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa96015a480 0x7fa9600b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:48.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.574+0000 7fa9687a0700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96014b800 con 0x7fa96015a480 2023-11-28T11:59:48.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.574+0000 7fa9687a0700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9601f3d80 con 0x7fa960069d60 2023-11-28T11:59:48.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.574+0000 7fa9687a0700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9601f4060 con 0x7fa9600c8d10 2023-11-28T11:59:48.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.574+0000 7fa966d3d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa96015a480 0x7fa9600b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:48.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.574+0000 7fa966d3d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa96015a480 0x7fa9600b28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38390/0 (socket says 172.21.15.39:38390) 2023-11-28T11:59:48.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.574+0000 7fa966d3d700 1 -- 172.21.15.39:0/3921266381 learned_addr learned my addr 172.21.15.39:0/3921266381 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:48.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.578+0000 7fa96653c700 1 --2- 172.21.15.39:0/3921266381 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa960069d60 0x7fa96015d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:48.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.578+0000 7fa965d3b700 1 --2- 172.21.15.39:0/3921266381 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9600c8d10 0x7fa9601ef460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:48.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.578+0000 7fa966d3d700 1 -- 172.21.15.39:0/3921266381 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9600c8d10 msgr2=0x7fa9601ef460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:48.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.578+0000 7fa966d3d700 1 --2- 172.21.15.39:0/3921266381 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9600c8d10 0x7fa9601ef460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:48.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.578+0000 7fa966d3d700 1 -- 172.21.15.39:0/3921266381 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa960069d60 msgr2=0x7fa96015d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:48.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.578+0000 7fa966d3d700 1 --2- 172.21.15.39:0/3921266381 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa960069d60 0x7fa96015d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:48.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.578+0000 7fa966d3d700 1 -- 172.21.15.39:0/3921266381 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9500094b0 con 0x7fa96015a480 2023-11-28T11:59:48.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.578+0000 7fa965d3b700 1 --2- 172.21.15.39:0/3921266381 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9600c8d10 0x7fa9601ef460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:48.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.578+0000 7fa966d3d700 1 --2- 172.21.15.39:0/3921266381 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa96015a480 0x7fa9600b28f0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fa95800c430 tx=0x7fa95800c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:48.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.578+0000 7fa956ffd700 1 -- 172.21.15.39:0/3921266381 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9580052d0 con 0x7fa96015a480 2023-11-28T11:59:48.583 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.578+0000 7fa956ffd700 1 -- 172.21.15.39:0/3921266381 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa958005430 con 0x7fa96015a480 2023-11-28T11:59:48.583 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.578+0000 7fa9687a0700 1 -- 172.21.15.39:0/3921266381 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9600add50 con 0x7fa96015a480 2023-11-28T11:59:48.583 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.578+0000 7fa956ffd700 1 -- 172.21.15.39:0/3921266381 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9580055a0 con 0x7fa96015a480 2023-11-28T11:59:48.583 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.578+0000 7fa9687a0700 1 -- 172.21.15.39:0/3921266381 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9600caa30 con 0x7fa96015a480 2023-11-28T11:59:48.585 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.578+0000 7fa9687a0700 1 -- 172.21.15.39:0/3921266381 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9600ca6e0 con 0x7fa96015a480 2023-11-28T11:59:48.585 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.582+0000 7fa956ffd700 1 -- 172.21.15.39:0/3921266381 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa958019030 con 0x7fa96015a480 2023-11-28T11:59:48.587 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.582+0000 7fa956ffd700 1 --2- 172.21.15.39:0/3921266381 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa944064ee0 0x7fa944067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:48.587 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.582+0000 7fa956ffd700 1 -- 172.21.15.39:0/3921266381 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa9580811e0 con 0x7fa96015a480 2023-11-28T11:59:48.587 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.582+0000 7fa96653c700 1 --2- 172.21.15.39:0/3921266381 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa944064ee0 0x7fa944067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:48.589 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.586+0000 7fa96653c700 1 --2- 172.21.15.39:0/3921266381 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa944064ee0 0x7fa944067390 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa95c001d90 tx=0x7fa95c001d20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:48.592 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.590+0000 7fa956ffd700 1 -- 172.21.15.39:0/3921266381 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa95804f240 con 0x7fa96015a480 2023-11-28T11:59:48.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.802+0000 7fa9687a0700 1 -- 172.21.15.39:0/3921266381 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9600726c0 con 0x7fa96015a480 2023-11-28T11:59:48.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.806+0000 7fa956ffd700 1 -- 172.21.15.39:0/3921266381 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4653 (secure 0 0 0) 0x7fa958056e60 con 0x7fa96015a480 2023-11-28T11:59:48.810 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:59:48.810 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5645,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/3875262459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3875262459},{"type":"v1","addr":"172.21.15.184:6835","nonce":3875262459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5648,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/3845363738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3845363738},{"type":"v1","addr":"172.21.15.184:6837","nonce":3845363738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6225,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6834/2646905389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6833","nonce":2646905389},{"type":"v1","addr":"172.21.15.39:6834","nonce":2646905389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:59:45.290110+0000","modified":"2023-11-28T11:59:48.326013+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6244":{"gid":6244,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6835/990492858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":990492858},{"type":"v1","addr":"172.21.15.39:6835","nonce":990492858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T11:59:48.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.810+0000 7fa9687a0700 1 -- 172.21.15.39:0/3921266381 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa944064ee0 msgr2=0x7fa944067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:48.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.810+0000 7fa9687a0700 1 --2- 172.21.15.39:0/3921266381 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa944064ee0 0x7fa944067390 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa95c001d90 tx=0x7fa95c001d20 comp rx=0 tx=0).stop 2023-11-28T11:59:48.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.810+0000 7fa9687a0700 1 -- 172.21.15.39:0/3921266381 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa96015a480 msgr2=0x7fa9600b28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:48.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.810+0000 7fa9687a0700 1 --2- 172.21.15.39:0/3921266381 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa96015a480 0x7fa9600b28f0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fa95800c430 tx=0x7fa95800c740 comp rx=0 tx=0).stop 2023-11-28T11:59:48.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.810+0000 7fa9687a0700 1 -- 172.21.15.39:0/3921266381 shutdown_connections 2023-11-28T11:59:48.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.810+0000 7fa9687a0700 1 --2- 172.21.15.39:0/3921266381 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa96015a480 0x7fa9600b28f0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:48.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.810+0000 7fa9687a0700 1 --2- 172.21.15.39:0/3921266381 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9600c8d10 0x7fa9601ef460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:48.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.810+0000 7fa9687a0700 1 --2- 172.21.15.39:0/3921266381 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa944064ee0 0x7fa944067390 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:48.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.810+0000 7fa9687a0700 1 --2- 172.21.15.39:0/3921266381 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa960069d60 0x7fa96015d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:48.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.810+0000 7fa9687a0700 1 -- 172.21.15.39:0/3921266381 >> 172.21.15.39:0/3921266381 conn(0x7fa9600cf350 msgr2=0x7fa9600afcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:48.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.810+0000 7fa9687a0700 1 -- 172.21.15.39:0/3921266381 shutdown_connections 2023-11-28T11:59:48.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:48.810+0000 7fa9687a0700 1 -- 172.21.15.39:0/3921266381 wait complete. 2023-11-28T11:59:48.817 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 32 2023-11-28T11:59:48.837 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:59:49.024 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.018+0000 7f97f5933700 1 Processor -- start 2023-11-28T11:59:49.024 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.018+0000 7f97f5933700 1 -- start start 2023-11-28T11:59:49.026 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.022+0000 7f97f5933700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f97f015a480 0x7f97f00cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:49.026 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.022+0000 7f97f5933700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f97f00c8d10 0x7f97f00cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:49.026 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.022+0000 7f97f5933700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97f015a850 con 0x7f97f00ccd10 2023-11-28T11:59:49.026 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.022+0000 7f97f5933700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f00ce060 con 0x7f97f00c8d10 2023-11-28T11:59:49.026 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.022+0000 7f97f5933700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f00ce300 con 0x7f97f015a480 2023-11-28T11:59:49.027 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.022+0000 7f97ef7fe700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f97f00ccd10 0x7f97f015dee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42276/0 (socket says 172.21.15.39:42276) 2023-11-28T11:59:49.027 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.022+0000 7f97ef7fe700 1 -- 172.21.15.39:0/4000479774 learned_addr learned my addr 172.21.15.39:0/4000479774 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:59:49.027 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.022+0000 7f97e67fc700 1 --2- 172.21.15.39:0/4000479774 >> v2:172.21.15.39:3300/0 conn(0x7f97f00c8d10 0x7f97f00cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:49.027 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.022+0000 7f97eeffd700 1 --2- 172.21.15.39:0/4000479774 >> v2:172.21.15.184:3300/0 conn(0x7f97f015a480 0x7f97f00cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:49.028 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.022+0000 7f97ee7fc700 1 -- 172.21.15.39:0/4000479774 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3169657453 0 0) 0x7f97f015a850 con 0x7f97f00ccd10 2023-11-28T11:59:49.028 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.022+0000 7f97ee7fc700 1 -- 172.21.15.39:0/4000479774 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97dc0035d0 con 0x7f97f00ccd10 2023-11-28T11:59:49.028 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.022+0000 7f97e67fc700 1 -- 172.21.15.39:0/4000479774 >> v2:172.21.15.184:3300/0 conn(0x7f97f015a480 msgr2=0x7f97f00cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:49.028 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.022+0000 7f97e67fc700 1 --2- 172.21.15.39:0/4000479774 >> v2:172.21.15.184:3300/0 conn(0x7f97f015a480 0x7f97f00cc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:49.028 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.022+0000 7f97e67fc700 1 -- 172.21.15.39:0/4000479774 >> v1:172.21.15.39:6789/0 conn(0x7f97f00ccd10 legacy=0x7f97f015dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:49.028 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.022+0000 7f97e67fc700 1 -- 172.21.15.39:0/4000479774 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f00cada0 con 0x7f97f00c8d10 2023-11-28T11:59:49.029 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.022+0000 7f97eeffd700 1 --2- 172.21.15.39:0/4000479774 >> v2:172.21.15.184:3300/0 conn(0x7f97f015a480 0x7f97f00cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:49.029 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.026+0000 7f97e67fc700 1 --2- 172.21.15.39:0/4000479774 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97f00c8d10 0x7f97f00cc7d0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f97f00c9390 tx=0x7f97d8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7e1457bcdb0082f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:49.029 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.026+0000 7f97ee7fc700 1 -- 172.21.15.39:0/4000479774 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d8011830 con 0x7f97f00c8d10 2023-11-28T11:59:49.029 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.026+0000 7f97ee7fc700 1 -- 172.21.15.39:0/4000479774 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d8011990 con 0x7f97f00c8d10 2023-11-28T11:59:49.029 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.026+0000 7f97ee7fc700 1 -- 172.21.15.39:0/4000479774 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d8011d20 con 0x7f97f00c8d10 2023-11-28T11:59:49.030 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.026+0000 7f97f5933700 1 -- 172.21.15.39:0/4000479774 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97f00c8d10 msgr2=0x7f97f00cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:49.030 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.026+0000 7f97f5933700 1 --2- 172.21.15.39:0/4000479774 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97f00c8d10 0x7f97f00cc7d0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f97f00c9390 tx=0x7f97d8009b30 comp rx=0 tx=0).stop 2023-11-28T11:59:49.030 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.026+0000 7f97f5933700 1 -- 172.21.15.39:0/4000479774 shutdown_connections 2023-11-28T11:59:49.031 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.026+0000 7f97f5933700 1 --2- 172.21.15.39:0/4000479774 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97f00c8d10 0x7f97f00cc7d0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:49.031 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.026+0000 7f97f5933700 1 --2- 172.21.15.39:0/4000479774 >> v2:172.21.15.184:3300/0 conn(0x7f97f015a480 0x7f97f00cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:49.031 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.026+0000 7f97f5933700 1 -- 172.21.15.39:0/4000479774 >> 172.21.15.39:0/4000479774 conn(0x7f97f00cf350 msgr2=0x7f97f00b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:49.031 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.026+0000 7f97f5933700 1 -- 172.21.15.39:0/4000479774 shutdown_connections 2023-11-28T11:59:49.031 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.026+0000 7f97f5933700 1 -- 172.21.15.39:0/4000479774 wait complete. 2023-11-28T11:59:49.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.030+0000 7f97f5933700 1 Processor -- start 2023-11-28T11:59:49.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.030+0000 7f97f5933700 1 -- start start 2023-11-28T11:59:49.035 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.030+0000 7f97f5933700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97f00c8d10 0x7f97f00c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:49.035 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.030+0000 7f97f5933700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97f00ccd10 0x7f97f00c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:49.035 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.030+0000 7f97f5933700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97f015a480 0x7f97f01f6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:49.035 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.030+0000 7f97f5933700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f01523d0 con 0x7f97f015a480 2023-11-28T11:59:49.035 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.030+0000 7f97f5933700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f00c7be0 con 0x7f97f00c8d10 2023-11-28T11:59:49.035 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.030+0000 7f97f5933700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f00c7ec0 con 0x7f97f00ccd10 2023-11-28T11:59:49.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.030+0000 7f97ef7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97f015a480 0x7f97f01f6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:49.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.030+0000 7f97ef7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97f015a480 0x7f97f01f6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38412/0 (socket says 172.21.15.39:38412) 2023-11-28T11:59:49.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.030+0000 7f97ef7fe700 1 -- 172.21.15.39:0/121919228 learned_addr learned my addr 172.21.15.39:0/121919228 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:49.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.030+0000 7f97eeffd700 1 --2- 172.21.15.39:0/121919228 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97f00c8d10 0x7f97f00c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:49.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.030+0000 7f97e67fc700 1 --2- 172.21.15.39:0/121919228 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97f00ccd10 0x7f97f00c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:49.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.030+0000 7f97ef7fe700 1 -- 172.21.15.39:0/121919228 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97f00ccd10 msgr2=0x7f97f00c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:49.038 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.030+0000 7f97ef7fe700 1 --2- 172.21.15.39:0/121919228 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97f00ccd10 0x7f97f00c5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:49.038 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.030+0000 7f97ef7fe700 1 -- 172.21.15.39:0/121919228 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97f00c8d10 msgr2=0x7f97f00c5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:49.038 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.030+0000 7f97ef7fe700 1 --2- 172.21.15.39:0/121919228 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97f00c8d10 0x7f97f00c5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:49.038 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.034+0000 7f97ef7fe700 1 -- 172.21.15.39:0/121919228 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e00094b0 con 0x7f97f015a480 2023-11-28T11:59:49.038 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.034+0000 7f97eeffd700 1 --2- 172.21.15.39:0/121919228 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97f00c8d10 0x7f97f00c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:49.038 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.034+0000 7f97ef7fe700 1 --2- 172.21.15.39:0/121919228 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97f015a480 0x7f97f01f6a10 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f97e800caa0 tx=0x7f97e800cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:49.038 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.034+0000 7f97ecff9700 1 -- 172.21.15.39:0/121919228 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e8007480 con 0x7f97f015a480 2023-11-28T11:59:49.038 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.034+0000 7f97ecff9700 1 -- 172.21.15.39:0/121919228 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e80075e0 con 0x7f97f015a480 2023-11-28T11:59:49.038 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.034+0000 7f97f5933700 1 -- 172.21.15.39:0/121919228 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97d80094b0 con 0x7f97f015a480 2023-11-28T11:59:49.038 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.034+0000 7f97ecff9700 1 -- 172.21.15.39:0/121919228 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e8007970 con 0x7f97f015a480 2023-11-28T11:59:49.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.034+0000 7f97f5933700 1 -- 172.21.15.39:0/121919228 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f00add50 con 0x7f97f015a480 2023-11-28T11:59:49.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.034+0000 7f97f5933700 1 -- 172.21.15.39:0/121919228 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f00caa30 con 0x7f97f015a480 2023-11-28T11:59:49.040 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.034+0000 7f97ecff9700 1 -- 172.21.15.39:0/121919228 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f97e8019030 con 0x7f97f015a480 2023-11-28T11:59:49.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.038+0000 7f97ecff9700 1 --2- 172.21.15.39:0/121919228 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f97d0064ee0 0x7f97d0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:49.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.038+0000 7f97ecff9700 1 -- 172.21.15.39:0/121919228 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f97e80817e0 con 0x7f97f015a480 2023-11-28T11:59:49.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.038+0000 7f97eeffd700 1 --2- 172.21.15.39:0/121919228 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f97d0064ee0 0x7f97d0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:49.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.038+0000 7f97eeffd700 1 --2- 172.21.15.39:0/121919228 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f97d0064ee0 0x7f97d0067390 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f97e00113d0 tx=0x7f97e0009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:49.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.042+0000 7f97ecff9700 1 -- 172.21.15.39:0/121919228 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f97e804f840 con 0x7f97f015a480 2023-11-28T11:59:49.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.222+0000 7f97f5933700 1 -- 172.21.15.39:0/121919228 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97f00ca6e0 con 0x7f97f015a480 2023-11-28T11:59:49.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.222+0000 7f97ecff9700 1 -- 172.21.15.39:0/121919228 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+18087 (secure 0 0 0) 0x7f97e8052e60 con 0x7f97f015a480 2023-11-28T11:59:49.229 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:59:49.229 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":70,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:59:46.296300+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:59:43.752184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-28T11:59:44.294885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:59:49.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.226+0000 7f97f5933700 1 -- 172.21.15.39:0/121919228 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f97d0064ee0 msgr2=0x7f97d0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:49.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.226+0000 7f97f5933700 1 --2- 172.21.15.39:0/121919228 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f97d0064ee0 0x7f97d0067390 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f97e00113d0 tx=0x7f97e0009240 comp rx=0 tx=0).stop 2023-11-28T11:59:49.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.226+0000 7f97f5933700 1 -- 172.21.15.39:0/121919228 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97f015a480 msgr2=0x7f97f01f6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:49.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.226+0000 7f97f5933700 1 --2- 172.21.15.39:0/121919228 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97f015a480 0x7f97f01f6a10 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f97e800caa0 tx=0x7f97e800cad0 comp rx=0 tx=0).stop 2023-11-28T11:59:49.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.226+0000 7f97f5933700 1 -- 172.21.15.39:0/121919228 shutdown_connections 2023-11-28T11:59:49.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.226+0000 7f97f5933700 1 --2- 172.21.15.39:0/121919228 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97f015a480 0x7f97f01f6a10 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:49.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.226+0000 7f97f5933700 1 --2- 172.21.15.39:0/121919228 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97f00ccd10 0x7f97f00c5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:49.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.226+0000 7f97f5933700 1 --2- 172.21.15.39:0/121919228 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f97d0064ee0 0x7f97d0067390 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:49.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.226+0000 7f97f5933700 1 --2- 172.21.15.39:0/121919228 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97f00c8d10 0x7f97f00c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:49.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.226+0000 7f97f5933700 1 -- 172.21.15.39:0/121919228 >> 172.21.15.39:0/121919228 conn(0x7f97f00cf350 msgr2=0x7f97f0154990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:49.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.226+0000 7f97f5933700 1 -- 172.21.15.39:0/121919228 shutdown_connections 2023-11-28T11:59:49.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.226+0000 7f97f5933700 1 -- 172.21.15.39:0/121919228 wait complete. 2023-11-28T11:59:49.257 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T11:59:49.258 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:59:49.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.438+0000 7fb8f5a4c700 1 Processor -- start 2023-11-28T11:59:49.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.438+0000 7fb8f5a4c700 1 -- start start 2023-11-28T11:59:49.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.442+0000 7fb8f5a4c700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb8f015c330 0x7fb8f00b19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:49.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.442+0000 7fb8f5a4c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb8f0071ad0 0x7fb8f00b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:49.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.442+0000 7fb8f5a4c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8f00ce6b0 0x7fb8f00704d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:49.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.442+0000 7fb8f5a4c700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f0160b70 con 0x7fb8f015c330 2023-11-28T11:59:49.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.442+0000 7fb8f5a4c700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f015fd10 con 0x7fb8f0071ad0 2023-11-28T11:59:49.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.442+0000 7fb8f5a4c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f00b3e70 con 0x7fb8f00ce6b0 2023-11-28T11:59:49.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.442+0000 7fb8f4a4a700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb8f015c330 0x7fb8f00b19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:49.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.442+0000 7fb8f4a4a700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb8f015c330 0x7fb8f00b19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38424/0 (socket says 172.21.15.39:38424) 2023-11-28T11:59:49.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.442+0000 7fb8f4a4a700 1 -- 172.21.15.39:0/577628014 learned_addr learned my addr 172.21.15.39:0/577628014 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:49.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.442+0000 7fb8e7fff700 1 --2- 172.21.15.39:0/577628014 >> v2:172.21.15.184:3300/0 conn(0x7fb8f0071ad0 0x7fb8f00b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:49.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.442+0000 7fb8f524b700 1 --2- 172.21.15.39:0/577628014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8f00ce6b0 0x7fb8f00704d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:49.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.442+0000 7fb8f4a4a700 1 -- 172.21.15.39:0/577628014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8f00ce6b0 msgr2=0x7fb8f00704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:49.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.442+0000 7fb8f4a4a700 1 --2- 172.21.15.39:0/577628014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8f00ce6b0 0x7fb8f00704d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:49.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.442+0000 7fb8f4a4a700 1 -- 172.21.15.39:0/577628014 >> v2:172.21.15.184:3300/0 conn(0x7fb8f0071ad0 msgr2=0x7fb8f00b1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:49.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.442+0000 7fb8f4a4a700 1 --2- 172.21.15.39:0/577628014 >> v2:172.21.15.184:3300/0 conn(0x7fb8f0071ad0 0x7fb8f00b1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:49.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.442+0000 7fb8f4a4a700 1 -- 172.21.15.39:0/577628014 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f015ff60 con 0x7fb8f015c330 2023-11-28T11:59:49.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.442+0000 7fb8e7fff700 1 --2- 172.21.15.39:0/577628014 >> v2:172.21.15.184:3300/0 conn(0x7fb8f0071ad0 0x7fb8f00b1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:49.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.442+0000 7fb8f524b700 1 --2- 172.21.15.39:0/577628014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8f00ce6b0 0x7fb8f00704d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:49.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.442+0000 7fb8f4a4a700 1 --2- 172.21.15.39:0/577628014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8f015c330 0x7fb8f00b19a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fb8f00ae300 tx=0x7fb8ec009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29269fc0a8ea5ca7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:49.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.442+0000 7fb8e77fe700 1 -- 172.21.15.39:0/577628014 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec00b8a0 con 0x7fb8f015c330 2023-11-28T11:59:49.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.446+0000 7fb8e77fe700 1 -- 172.21.15.39:0/577628014 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8ec00ba00 con 0x7fb8f015c330 2023-11-28T11:59:49.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.446+0000 7fb8e77fe700 1 -- 172.21.15.39:0/577628014 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec00bd90 con 0x7fb8f015c330 2023-11-28T11:59:49.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.446+0000 7fb8f5a4c700 1 -- 172.21.15.39:0/577628014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8f015c330 msgr2=0x7fb8f00b19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:49.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.446+0000 7fb8f5a4c700 1 --2- 172.21.15.39:0/577628014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8f015c330 0x7fb8f00b19a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fb8f00ae300 tx=0x7fb8ec009bf0 comp rx=0 tx=0).stop 2023-11-28T11:59:49.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.446+0000 7fb8f5a4c700 1 -- 172.21.15.39:0/577628014 shutdown_connections 2023-11-28T11:59:49.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.446+0000 7fb8f5a4c700 1 --2- 172.21.15.39:0/577628014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8f00ce6b0 0x7fb8f00704d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:49.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.446+0000 7fb8f5a4c700 1 --2- 172.21.15.39:0/577628014 >> v2:172.21.15.184:3300/0 conn(0x7fb8f0071ad0 0x7fb8f00b1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:49.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.446+0000 7fb8f5a4c700 1 --2- 172.21.15.39:0/577628014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8f015c330 0x7fb8f00b19a0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:49.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.446+0000 7fb8f5a4c700 1 -- 172.21.15.39:0/577628014 >> 172.21.15.39:0/577628014 conn(0x7fb8f00b06a0 msgr2=0x7fb8f00b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:49.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.446+0000 7fb8f5a4c700 1 -- 172.21.15.39:0/577628014 shutdown_connections 2023-11-28T11:59:49.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.446+0000 7fb8f5a4c700 1 -- 172.21.15.39:0/577628014 wait complete. 2023-11-28T11:59:49.452 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.450+0000 7fb8f5a4c700 1 Processor -- start 2023-11-28T11:59:49.452 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.450+0000 7fb8f5a4c700 1 -- start start 2023-11-28T11:59:49.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.450+0000 7fb8f5a4c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8f0071ad0 0x7fb8f006a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:49.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.450+0000 7fb8f5a4c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8f00ce6b0 0x7fb8f01431f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:49.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.450+0000 7fb8f5a4c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8f015c330 0x7fb8f0143730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:49.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.450+0000 7fb8f5a4c700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f00ccc40 con 0x7fb8f0071ad0 2023-11-28T11:59:49.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.450+0000 7fb8f5a4c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f00cc2a0 con 0x7fb8f015c330 2023-11-28T11:59:49.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.450+0000 7fb8f5a4c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f00cc580 con 0x7fb8f00ce6b0 2023-11-28T11:59:49.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.450+0000 7fb8f4a4a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8f0071ad0 0x7fb8f006a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:49.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.450+0000 7fb8f4a4a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8f0071ad0 0x7fb8f006a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38436/0 (socket says 172.21.15.39:38436) 2023-11-28T11:59:49.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.450+0000 7fb8f4a4a700 1 -- 172.21.15.39:0/2252436873 learned_addr learned my addr 172.21.15.39:0/2252436873 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:49.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.450+0000 7fb8f524b700 1 --2- 172.21.15.39:0/2252436873 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8f015c330 0x7fb8f0143730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:49.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.450+0000 7fb8e7fff700 1 --2- 172.21.15.39:0/2252436873 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8f00ce6b0 0x7fb8f01431f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:49.457 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.450+0000 7fb8f4a4a700 1 -- 172.21.15.39:0/2252436873 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8f00ce6b0 msgr2=0x7fb8f01431f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:49.457 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.450+0000 7fb8f4a4a700 1 --2- 172.21.15.39:0/2252436873 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8f00ce6b0 0x7fb8f01431f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:49.457 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.450+0000 7fb8f4a4a700 1 -- 172.21.15.39:0/2252436873 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8f015c330 msgr2=0x7fb8f0143730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:49.457 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.450+0000 7fb8f4a4a700 1 --2- 172.21.15.39:0/2252436873 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8f015c330 0x7fb8f0143730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:49.458 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.450+0000 7fb8f4a4a700 1 -- 172.21.15.39:0/2252436873 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ec009570 con 0x7fb8f0071ad0 2023-11-28T11:59:49.458 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.450+0000 7fb8e7fff700 1 --2- 172.21.15.39:0/2252436873 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8f00ce6b0 0x7fb8f01431f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:49.458 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.454+0000 7fb8f4a4a700 1 --2- 172.21.15.39:0/2252436873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8f0071ad0 0x7fb8f006a510 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec009860 tx=0x7fb8ec004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:49.458 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.454+0000 7fb8e57fa700 1 -- 172.21.15.39:0/2252436873 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec0036c0 con 0x7fb8f0071ad0 2023-11-28T11:59:49.458 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.454+0000 7fb8e57fa700 1 -- 172.21.15.39:0/2252436873 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8ec01f070 con 0x7fb8f0071ad0 2023-11-28T11:59:49.458 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.454+0000 7fb8e57fa700 1 -- 172.21.15.39:0/2252436873 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec003a60 con 0x7fb8f0071ad0 2023-11-28T11:59:49.458 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.454+0000 7fb8f5a4c700 1 -- 172.21.15.39:0/2252436873 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f0160520 con 0x7fb8f0071ad0 2023-11-28T11:59:49.458 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.454+0000 7fb8f5a4c700 1 -- 172.21.15.39:0/2252436873 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f0160240 con 0x7fb8f0071ad0 2023-11-28T11:59:49.459 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.454+0000 7fb8f5a4c700 1 -- 172.21.15.39:0/2252436873 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f0160800 con 0x7fb8f0071ad0 2023-11-28T11:59:49.460 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.454+0000 7fb8e57fa700 1 -- 172.21.15.39:0/2252436873 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb8ec02a020 con 0x7fb8f0071ad0 2023-11-28T11:59:49.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.458+0000 7fb8e57fa700 1 --2- 172.21.15.39:0/2252436873 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb8dc064ee0 0x7fb8dc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:49.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.458+0000 7fb8e57fa700 1 -- 172.21.15.39:0/2252436873 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb8ec0837c0 con 0x7fb8f0071ad0 2023-11-28T11:59:49.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.458+0000 7fb8e7fff700 1 --2- 172.21.15.39:0/2252436873 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb8dc064ee0 0x7fb8dc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:49.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.458+0000 7fb8e7fff700 1 --2- 172.21.15.39:0/2252436873 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb8dc064ee0 0x7fb8dc067390 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb8f00ab820 tx=0x7fb8e0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:49.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.462+0000 7fb8e57fa700 1 -- 172.21.15.39:0/2252436873 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb8ec051820 con 0x7fb8f0071ad0 2023-11-28T11:59:49.635 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.630+0000 7fb8f5a4c700 1 -- 172.21.15.39:0/2252436873 --> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb8f00ccd80 con 0x7fb8dc064ee0 2023-11-28T11:59:49.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.650+0000 7fb8e57fa700 1 -- 172.21.15.39:0/2252436873 <== mgr.4104 v2:172.21.15.184:6832/36166 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308829 (secure 0 0 0) 0x7fb8f00ccd80 con 0x7fb8dc064ee0 2023-11-28T11:59:49.658 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:59:49.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.658+0000 7fb8f5a4c700 1 -- 172.21.15.39:0/2252436873 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb8dc064ee0 msgr2=0x7fb8dc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:49.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.658+0000 7fb8f5a4c700 1 --2- 172.21.15.39:0/2252436873 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb8dc064ee0 0x7fb8dc067390 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb8f00ab820 tx=0x7fb8e0008040 comp rx=0 tx=0).stop 2023-11-28T11:59:49.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.658+0000 7fb8f5a4c700 1 -- 172.21.15.39:0/2252436873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8f0071ad0 msgr2=0x7fb8f006a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:49.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.658+0000 7fb8f5a4c700 1 --2- 172.21.15.39:0/2252436873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8f0071ad0 0x7fb8f006a510 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec009860 tx=0x7fb8ec004770 comp rx=0 tx=0).stop 2023-11-28T11:59:49.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.658+0000 7fb8f5a4c700 1 -- 172.21.15.39:0/2252436873 shutdown_connections 2023-11-28T11:59:49.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.658+0000 7fb8f5a4c700 1 --2- 172.21.15.39:0/2252436873 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb8dc064ee0 0x7fb8dc067390 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:49.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.658+0000 7fb8f5a4c700 1 --2- 172.21.15.39:0/2252436873 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8f015c330 0x7fb8f0143730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:49.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.658+0000 7fb8f5a4c700 1 --2- 172.21.15.39:0/2252436873 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8f00ce6b0 0x7fb8f01431f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:49.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.658+0000 7fb8f5a4c700 1 --2- 172.21.15.39:0/2252436873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8f0071ad0 0x7fb8f006a510 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:49.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.658+0000 7fb8f5a4c700 1 -- 172.21.15.39:0/2252436873 >> 172.21.15.39:0/2252436873 conn(0x7fb8f00b06a0 msgr2=0x7fb8f00b0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:49.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.658+0000 7fb8f5a4c700 1 -- 172.21.15.39:0/2252436873 shutdown_connections 2023-11-28T11:59:49.664 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.658+0000 7fb8f5a4c700 1 -- 172.21.15.39:0/2252436873 wait complete. 2023-11-28T11:59:49.665 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2023-11-28T11:59:49.685 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":165,"stamp":"2023-11-28T11:59:48.619597+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":67,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":88684,"kb_used_data":7660,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":754886036,"statfs":{"total":773094113280,"available":773003300864,"internally_reserved":0,"allocated":7843840,"data_stored":4249814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.809551"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.400336+0000","last_change":"2023-11-28T11:59:45.336331+0000","last_active":"2023-11-28T11:59:46.400336+0000","last_peered":"2023-11-28T11:59:46.400336+0000","last_clean":"2023-11-28T11:59:46.400336+0000","last_became_active":"2023-11-28T11:59:45.335902+0000","last_became_peered":"2023-11-28T11:59:45.335902+0000","last_unstale":"2023-11-28T11:59:46.400336+0000","last_undegraded":"2023-11-28T11:59:46.400336+0000","last_fullsized":"2023-11-28T11:59:46.400336+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:27:51.533750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.318919+0000","last_change":"2023-11-28T11:59:45.319531+0000","last_active":"2023-11-28T11:59:46.318919+0000","last_peered":"2023-11-28T11:59:46.318919+0000","last_clean":"2023-11-28T11:59:46.318919+0000","last_became_active":"2023-11-28T11:59:45.319222+0000","last_became_peered":"2023-11-28T11:59:45.319222+0000","last_unstale":"2023-11-28T11:59:46.318919+0000","last_undegraded":"2023-11-28T11:59:46.318919+0000","last_fullsized":"2023-11-28T11:59:46.318919+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:59:34.845363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.319963+0000","last_change":"2023-11-28T11:59:45.326792+0000","last_active":"2023-11-28T11:59:46.319963+0000","last_peered":"2023-11-28T11:59:46.319963+0000","last_clean":"2023-11-28T11:59:46.319963+0000","last_became_active":"2023-11-28T11:59:45.326443+0000","last_became_peered":"2023-11-28T11:59:45.326443+0000","last_unstale":"2023-11-28T11:59:46.319963+0000","last_undegraded":"2023-11-28T11:59:46.319963+0000","last_fullsized":"2023-11-28T11:59:46.319963+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:54:36.933079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.336467+0000","last_change":"2023-11-28T11:59:45.329874+0000","last_active":"2023-11-28T11:59:45.336467+0000","last_peered":"2023-11-28T11:59:45.336467+0000","last_clean":"2023-11-28T11:59:45.336467+0000","last_became_active":"2023-11-28T11:59:45.328648+0000","last_became_peered":"2023-11-28T11:59:45.328648+0000","last_unstale":"2023-11-28T11:59:45.336467+0000","last_undegraded":"2023-11-28T11:59:45.336467+0000","last_fullsized":"2023-11-28T11:59:45.336467+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:53:06.623995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.343051+0000","last_change":"2023-11-28T11:59:45.336913+0000","last_active":"2023-11-28T11:59:45.343051+0000","last_peered":"2023-11-28T11:59:45.343051+0000","last_clean":"2023-11-28T11:59:45.343051+0000","last_became_active":"2023-11-28T11:59:45.336585+0000","last_became_peered":"2023-11-28T11:59:45.336585+0000","last_unstale":"2023-11-28T11:59:45.343051+0000","last_undegraded":"2023-11-28T11:59:45.343051+0000","last_fullsized":"2023-11-28T11:59:45.343051+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:07:54.133626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.318414+0000","last_change":"2023-11-28T11:59:45.331171+0000","last_active":"2023-11-28T11:59:46.318414+0000","last_peered":"2023-11-28T11:59:46.318414+0000","last_clean":"2023-11-28T11:59:46.318414+0000","last_became_active":"2023-11-28T11:59:45.330890+0000","last_became_peered":"2023-11-28T11:59:45.330890+0000","last_unstale":"2023-11-28T11:59:46.318414+0000","last_undegraded":"2023-11-28T11:59:46.318414+0000","last_fullsized":"2023-11-28T11:59:46.318414+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:21:19.901080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.340055+0000","last_change":"2023-11-28T11:59:45.328256+0000","last_active":"2023-11-28T11:59:45.340055+0000","last_peered":"2023-11-28T11:59:45.340055+0000","last_clean":"2023-11-28T11:59:45.340055+0000","last_became_active":"2023-11-28T11:59:45.327965+0000","last_became_peered":"2023-11-28T11:59:45.327965+0000","last_unstale":"2023-11-28T11:59:45.340055+0000","last_undegraded":"2023-11-28T11:59:45.340055+0000","last_fullsized":"2023-11-28T11:59:45.340055+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:26:44.696630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.318233+0000","last_change":"2023-11-28T11:59:45.319444+0000","last_active":"2023-11-28T11:59:46.318233+0000","last_peered":"2023-11-28T11:59:46.318233+0000","last_clean":"2023-11-28T11:59:46.318233+0000","last_became_active":"2023-11-28T11:59:45.318937+0000","last_became_peered":"2023-11-28T11:59:45.318937+0000","last_unstale":"2023-11-28T11:59:46.318233+0000","last_undegraded":"2023-11-28T11:59:46.318233+0000","last_fullsized":"2023-11-28T11:59:46.318233+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:46:05.333603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.342560+0000","last_change":"2023-11-28T11:59:45.334195+0000","last_active":"2023-11-28T11:59:45.342560+0000","last_peered":"2023-11-28T11:59:45.342560+0000","last_clean":"2023-11-28T11:59:45.342560+0000","last_became_active":"2023-11-28T11:59:45.333688+0000","last_became_peered":"2023-11-28T11:59:45.333688+0000","last_unstale":"2023-11-28T11:59:45.342560+0000","last_undegraded":"2023-11-28T11:59:45.342560+0000","last_fullsized":"2023-11-28T11:59:45.342560+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:12:39.748235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.343102+0000","last_change":"2023-11-28T11:59:45.339925+0000","last_active":"2023-11-28T11:59:45.343102+0000","last_peered":"2023-11-28T11:59:45.343102+0000","last_clean":"2023-11-28T11:59:45.343102+0000","last_became_active":"2023-11-28T11:59:45.339561+0000","last_became_peered":"2023-11-28T11:59:45.339561+0000","last_unstale":"2023-11-28T11:59:45.343102+0000","last_undegraded":"2023-11-28T11:59:45.343102+0000","last_fullsized":"2023-11-28T11:59:45.343102+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:08:07.726587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.400127+0000","last_change":"2023-11-28T11:59:45.313799+0000","last_active":"2023-11-28T11:59:46.400127+0000","last_peered":"2023-11-28T11:59:46.400127+0000","last_clean":"2023-11-28T11:59:46.400127+0000","last_became_active":"2023-11-28T11:59:45.313537+0000","last_became_peered":"2023-11-28T11:59:45.313537+0000","last_unstale":"2023-11-28T11:59:46.400127+0000","last_undegraded":"2023-11-28T11:59:46.400127+0000","last_fullsized":"2023-11-28T11:59:46.400127+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:43:55.064840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.339977+0000","last_change":"2023-11-28T11:59:45.333586+0000","last_active":"2023-11-28T11:59:45.339977+0000","last_peered":"2023-11-28T11:59:45.339977+0000","last_clean":"2023-11-28T11:59:45.339977+0000","last_became_active":"2023-11-28T11:59:45.332578+0000","last_became_peered":"2023-11-28T11:59:45.332578+0000","last_unstale":"2023-11-28T11:59:45.339977+0000","last_undegraded":"2023-11-28T11:59:45.339977+0000","last_fullsized":"2023-11-28T11:59:45.339977+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:03:48.634313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.339938+0000","last_change":"2023-11-28T11:59:45.334941+0000","last_active":"2023-11-28T11:59:45.339938+0000","last_peered":"2023-11-28T11:59:45.339938+0000","last_clean":"2023-11-28T11:59:45.339938+0000","last_became_active":"2023-11-28T11:59:45.334667+0000","last_became_peered":"2023-11-28T11:59:45.334667+0000","last_unstale":"2023-11-28T11:59:45.339938+0000","last_undegraded":"2023-11-28T11:59:45.339938+0000","last_fullsized":"2023-11-28T11:59:45.339938+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:35:40.695315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.339530+0000","last_change":"2023-11-28T11:59:45.329149+0000","last_active":"2023-11-28T11:59:45.339530+0000","last_peered":"2023-11-28T11:59:45.339530+0000","last_clean":"2023-11-28T11:59:45.339530+0000","last_became_active":"2023-11-28T11:59:45.328800+0000","last_became_peered":"2023-11-28T11:59:45.328800+0000","last_unstale":"2023-11-28T11:59:45.339530+0000","last_undegraded":"2023-11-28T11:59:45.339530+0000","last_fullsized":"2023-11-28T11:59:45.339530+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:47:33.772309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.338290+0000","last_change":"2023-11-28T11:59:45.328267+0000","last_active":"2023-11-28T11:59:45.338290+0000","last_peered":"2023-11-28T11:59:45.338290+0000","last_clean":"2023-11-28T11:59:45.338290+0000","last_became_active":"2023-11-28T11:59:45.327358+0000","last_became_peered":"2023-11-28T11:59:45.327358+0000","last_unstale":"2023-11-28T11:59:45.338290+0000","last_undegraded":"2023-11-28T11:59:45.338290+0000","last_fullsized":"2023-11-28T11:59:45.338290+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:43:42.520383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.335956+0000","last_change":"2023-11-28T11:59:45.323059+0000","last_active":"2023-11-28T11:59:45.335956+0000","last_peered":"2023-11-28T11:59:45.335956+0000","last_clean":"2023-11-28T11:59:45.335956+0000","last_became_active":"2023-11-28T11:59:45.322803+0000","last_became_peered":"2023-11-28T11:59:45.322803+0000","last_unstale":"2023-11-28T11:59:45.335956+0000","last_undegraded":"2023-11-28T11:59:45.335956+0000","last_fullsized":"2023-11-28T11:59:45.335956+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:34:58.375576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.342537+0000","last_change":"2023-11-28T11:59:45.333995+0000","last_active":"2023-11-28T11:59:45.342537+0000","last_peered":"2023-11-28T11:59:45.342537+0000","last_clean":"2023-11-28T11:59:45.342537+0000","last_became_active":"2023-11-28T11:59:45.333435+0000","last_became_peered":"2023-11-28T11:59:45.333435+0000","last_unstale":"2023-11-28T11:59:45.342537+0000","last_undegraded":"2023-11-28T11:59:45.342537+0000","last_fullsized":"2023-11-28T11:59:45.342537+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:34:35.412269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.329887+0000","last_change":"2023-11-28T11:59:45.324124+0000","last_active":"2023-11-28T11:59:45.329887+0000","last_peered":"2023-11-28T11:59:45.329887+0000","last_clean":"2023-11-28T11:59:45.329887+0000","last_became_active":"2023-11-28T11:59:45.323788+0000","last_became_peered":"2023-11-28T11:59:45.323788+0000","last_unstale":"2023-11-28T11:59:45.329887+0000","last_undegraded":"2023-11-28T11:59:45.329887+0000","last_fullsized":"2023-11-28T11:59:45.329887+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:56:45.470631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.318585+0000","last_change":"2023-11-28T11:59:45.328812+0000","last_active":"2023-11-28T11:59:46.318585+0000","last_peered":"2023-11-28T11:59:46.318585+0000","last_clean":"2023-11-28T11:59:46.318585+0000","last_became_active":"2023-11-28T11:59:45.325469+0000","last_became_peered":"2023-11-28T11:59:45.325469+0000","last_unstale":"2023-11-28T11:59:46.318585+0000","last_undegraded":"2023-11-28T11:59:46.318585+0000","last_fullsized":"2023-11-28T11:59:46.318585+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:46:49.485730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.332595+0000","last_change":"2023-11-28T11:59:45.330583+0000","last_active":"2023-11-28T11:59:45.332595+0000","last_peered":"2023-11-28T11:59:45.332595+0000","last_clean":"2023-11-28T11:59:45.332595+0000","last_became_active":"2023-11-28T11:59:45.330283+0000","last_became_peered":"2023-11-28T11:59:45.330283+0000","last_unstale":"2023-11-28T11:59:45.332595+0000","last_undegraded":"2023-11-28T11:59:45.332595+0000","last_fullsized":"2023-11-28T11:59:45.332595+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:13:43.025323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.340173+0000","last_change":"2023-11-28T11:59:45.329546+0000","last_active":"2023-11-28T11:59:45.340173+0000","last_peered":"2023-11-28T11:59:45.340173+0000","last_clean":"2023-11-28T11:59:45.340173+0000","last_became_active":"2023-11-28T11:59:45.329202+0000","last_became_peered":"2023-11-28T11:59:45.329202+0000","last_unstale":"2023-11-28T11:59:45.340173+0000","last_undegraded":"2023-11-28T11:59:45.340173+0000","last_fullsized":"2023-11-28T11:59:45.340173+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:16:51.575130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.340580+0000","last_change":"2023-11-28T11:59:45.330904+0000","last_active":"2023-11-28T11:59:45.340580+0000","last_peered":"2023-11-28T11:59:45.340580+0000","last_clean":"2023-11-28T11:59:45.340580+0000","last_became_active":"2023-11-28T11:59:45.330603+0000","last_became_peered":"2023-11-28T11:59:45.330603+0000","last_unstale":"2023-11-28T11:59:45.340580+0000","last_undegraded":"2023-11-28T11:59:45.340580+0000","last_fullsized":"2023-11-28T11:59:45.340580+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:37:19.019271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.399390+0000","last_change":"2023-11-28T11:59:45.324418+0000","last_active":"2023-11-28T11:59:46.399390+0000","last_peered":"2023-11-28T11:59:46.399390+0000","last_clean":"2023-11-28T11:59:46.399390+0000","last_became_active":"2023-11-28T11:59:45.323851+0000","last_became_peered":"2023-11-28T11:59:45.323851+0000","last_unstale":"2023-11-28T11:59:46.399390+0000","last_undegraded":"2023-11-28T11:59:46.399390+0000","last_fullsized":"2023-11-28T11:59:46.399390+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:18:54.010324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.399219+0000","last_change":"2023-11-28T11:59:45.326044+0000","last_active":"2023-11-28T11:59:46.399219+0000","last_peered":"2023-11-28T11:59:46.399219+0000","last_clean":"2023-11-28T11:59:46.399219+0000","last_became_active":"2023-11-28T11:59:45.325692+0000","last_became_peered":"2023-11-28T11:59:45.325692+0000","last_unstale":"2023-11-28T11:59:46.399219+0000","last_undegraded":"2023-11-28T11:59:46.399219+0000","last_fullsized":"2023-11-28T11:59:46.399219+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:30:52.764137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.336436+0000","last_change":"2023-11-28T11:59:45.325773+0000","last_active":"2023-11-28T11:59:45.336436+0000","last_peered":"2023-11-28T11:59:45.336436+0000","last_clean":"2023-11-28T11:59:45.336436+0000","last_became_active":"2023-11-28T11:59:45.322908+0000","last_became_peered":"2023-11-28T11:59:45.322908+0000","last_unstale":"2023-11-28T11:59:45.336436+0000","last_undegraded":"2023-11-28T11:59:45.336436+0000","last_fullsized":"2023-11-28T11:59:45.336436+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:56.700738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.326557+0000","last_change":"2023-11-28T11:59:45.324363+0000","last_active":"2023-11-28T11:59:45.326557+0000","last_peered":"2023-11-28T11:59:45.326557+0000","last_clean":"2023-11-28T11:59:45.326557+0000","last_became_active":"2023-11-28T11:59:45.324083+0000","last_became_peered":"2023-11-28T11:59:45.324083+0000","last_unstale":"2023-11-28T11:59:45.326557+0000","last_undegraded":"2023-11-28T11:59:45.326557+0000","last_fullsized":"2023-11-28T11:59:45.326557+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:27:51.533750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.320082+0000","last_change":"2023-11-28T11:59:45.310138+0000","last_active":"2023-11-28T11:59:46.320082+0000","last_peered":"2023-11-28T11:59:46.320082+0000","last_clean":"2023-11-28T11:59:46.320082+0000","last_became_active":"2023-11-28T11:59:45.309693+0000","last_became_peered":"2023-11-28T11:59:45.309693+0000","last_unstale":"2023-11-28T11:59:46.320082+0000","last_undegraded":"2023-11-28T11:59:46.320082+0000","last_fullsized":"2023-11-28T11:59:46.320082+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:50:16.031938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.340407+0000","last_change":"2023-11-28T11:59:45.333426+0000","last_active":"2023-11-28T11:59:45.340407+0000","last_peered":"2023-11-28T11:59:45.340407+0000","last_clean":"2023-11-28T11:59:45.340407+0000","last_became_active":"2023-11-28T11:59:45.333154+0000","last_became_peered":"2023-11-28T11:59:45.333154+0000","last_unstale":"2023-11-28T11:59:45.340407+0000","last_undegraded":"2023-11-28T11:59:45.340407+0000","last_fullsized":"2023-11-28T11:59:45.340407+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:22:46.822835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.319726+0000","last_change":"2023-11-28T11:59:45.340592+0000","last_active":"2023-11-28T11:59:46.319726+0000","last_peered":"2023-11-28T11:59:46.319726+0000","last_clean":"2023-11-28T11:59:46.319726+0000","last_became_active":"2023-11-28T11:59:45.340280+0000","last_became_peered":"2023-11-28T11:59:45.340280+0000","last_unstale":"2023-11-28T11:59:46.319726+0000","last_undegraded":"2023-11-28T11:59:46.319726+0000","last_fullsized":"2023-11-28T11:59:46.319726+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:08:58.529379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.340539+0000","last_change":"2023-11-28T11:59:45.333999+0000","last_active":"2023-11-28T11:59:45.340539+0000","last_peered":"2023-11-28T11:59:45.340539+0000","last_clean":"2023-11-28T11:59:45.340539+0000","last_became_active":"2023-11-28T11:59:45.333530+0000","last_became_peered":"2023-11-28T11:59:45.333530+0000","last_unstale":"2023-11-28T11:59:45.340539+0000","last_undegraded":"2023-11-28T11:59:45.340539+0000","last_fullsized":"2023-11-28T11:59:45.340539+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:26.480820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.340073+0000","last_change":"2023-11-28T11:59:45.333402+0000","last_active":"2023-11-28T11:59:45.340073+0000","last_peered":"2023-11-28T11:59:45.340073+0000","last_clean":"2023-11-28T11:59:45.340073+0000","last_became_active":"2023-11-28T11:59:45.333113+0000","last_became_peered":"2023-11-28T11:59:45.333113+0000","last_unstale":"2023-11-28T11:59:45.340073+0000","last_undegraded":"2023-11-28T11:59:45.340073+0000","last_fullsized":"2023-11-28T11:59:45.340073+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:09:08.152387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.318394+0000","last_change":"2023-11-28T11:59:45.319247+0000","last_active":"2023-11-28T11:59:46.318394+0000","last_peered":"2023-11-28T11:59:46.318394+0000","last_clean":"2023-11-28T11:59:46.318394+0000","last_became_active":"2023-11-28T11:59:45.318629+0000","last_became_peered":"2023-11-28T11:59:45.318629+0000","last_unstale":"2023-11-28T11:59:46.318394+0000","last_undegraded":"2023-11-28T11:59:46.318394+0000","last_fullsized":"2023-11-28T11:59:46.318394+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:09:59.189361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.400371+0000","last_change":"2023-11-28T11:59:45.326234+0000","last_active":"2023-11-28T11:59:46.400371+0000","last_peered":"2023-11-28T11:59:46.400371+0000","last_clean":"2023-11-28T11:59:46.400371+0000","last_became_active":"2023-11-28T11:59:45.325896+0000","last_became_peered":"2023-11-28T11:59:45.325896+0000","last_unstale":"2023-11-28T11:59:46.400371+0000","last_undegraded":"2023-11-28T11:59:46.400371+0000","last_fullsized":"2023-11-28T11:59:46.400371+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:34:56.589892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"69'4","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.400587+0000","last_change":"2023-11-28T11:59:44.855245+0000","last_active":"2023-11-28T11:59:46.400587+0000","last_peered":"2023-11-28T11:59:46.400587+0000","last_clean":"2023-11-28T11:59:46.400587+0000","last_became_active":"2023-11-28T11:59:44.854941+0000","last_became_peered":"2023-11-28T11:59:44.854941+0000","last_unstale":"2023-11-28T11:59:46.400587+0000","last_undegraded":"2023-11-28T11:59:46.400587+0000","last_fullsized":"2023-11-28T11:59:46.400587+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:31:48.928068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.342578+0000","last_change":"2023-11-28T11:59:45.334372+0000","last_active":"2023-11-28T11:59:45.342578+0000","last_peered":"2023-11-28T11:59:45.342578+0000","last_clean":"2023-11-28T11:59:45.342578+0000","last_became_active":"2023-11-28T11:59:45.332927+0000","last_became_peered":"2023-11-28T11:59:45.332927+0000","last_unstale":"2023-11-28T11:59:45.342578+0000","last_undegraded":"2023-11-28T11:59:45.342578+0000","last_fullsized":"2023-11-28T11:59:45.342578+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:17:11.307810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"69'1","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.333445+0000","last_change":"2023-11-28T11:59:44.854325+0000","last_active":"2023-11-28T11:59:45.333445+0000","last_peered":"2023-11-28T11:59:45.333445+0000","last_clean":"2023-11-28T11:59:45.333445+0000","last_became_active":"2023-11-28T11:59:44.853467+0000","last_became_peered":"2023-11-28T11:59:44.853467+0000","last_unstale":"2023-11-28T11:59:45.333445+0000","last_undegraded":"2023-11-28T11:59:45.333445+0000","last_fullsized":"2023-11-28T11:59:45.333445+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:55:26.505632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.318642+0000","last_change":"2023-11-28T11:59:45.321270+0000","last_active":"2023-11-28T11:59:46.318642+0000","last_peered":"2023-11-28T11:59:46.318642+0000","last_clean":"2023-11-28T11:59:46.318642+0000","last_became_active":"2023-11-28T11:59:45.320980+0000","last_became_peered":"2023-11-28T11:59:45.320980+0000","last_unstale":"2023-11-28T11:59:46.318642+0000","last_undegraded":"2023-11-28T11:59:46.318642+0000","last_fullsized":"2023-11-28T11:59:46.318642+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:33:28.030587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"69'2","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.341089+0000","last_change":"2023-11-28T11:59:44.852922+0000","last_active":"2023-11-28T11:59:45.341089+0000","last_peered":"2023-11-28T11:59:45.341089+0000","last_clean":"2023-11-28T11:59:45.341089+0000","last_became_active":"2023-11-28T11:59:44.852581+0000","last_became_peered":"2023-11-28T11:59:44.852581+0000","last_unstale":"2023-11-28T11:59:45.341089+0000","last_undegraded":"2023-11-28T11:59:45.341089+0000","last_fullsized":"2023-11-28T11:59:45.341089+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:44:50.583317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.400199+0000","last_change":"2023-11-28T11:59:45.317883+0000","last_active":"2023-11-28T11:59:46.400199+0000","last_peered":"2023-11-28T11:59:46.400199+0000","last_clean":"2023-11-28T11:59:46.400199+0000","last_became_active":"2023-11-28T11:59:45.317626+0000","last_became_peered":"2023-11-28T11:59:45.317626+0000","last_unstale":"2023-11-28T11:59:46.400199+0000","last_undegraded":"2023-11-28T11:59:46.400199+0000","last_fullsized":"2023-11-28T11:59:46.400199+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:26:44.696630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.318765+0000","last_change":"2023-11-28T11:59:44.850372+0000","last_active":"2023-11-28T11:59:46.318765+0000","last_peered":"2023-11-28T11:59:46.318765+0000","last_clean":"2023-11-28T11:59:46.318765+0000","last_became_active":"2023-11-28T11:59:44.850066+0000","last_became_peered":"2023-11-28T11:59:44.850066+0000","last_unstale":"2023-11-28T11:59:46.318765+0000","last_undegraded":"2023-11-28T11:59:46.318765+0000","last_fullsized":"2023-11-28T11:59:46.318765+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:56:44.464532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.340507+0000","last_change":"2023-11-28T11:59:45.333822+0000","last_active":"2023-11-28T11:59:45.340507+0000","last_peered":"2023-11-28T11:59:45.340507+0000","last_clean":"2023-11-28T11:59:45.340507+0000","last_became_active":"2023-11-28T11:59:45.332715+0000","last_became_peered":"2023-11-28T11:59:45.332715+0000","last_unstale":"2023-11-28T11:59:45.340507+0000","last_undegraded":"2023-11-28T11:59:45.340507+0000","last_fullsized":"2023-11-28T11:59:45.340507+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:33:52.102085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"69'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.320141+0000","last_change":"2023-11-28T11:59:44.850288+0000","last_active":"2023-11-28T11:59:46.320141+0000","last_peered":"2023-11-28T11:59:46.320141+0000","last_clean":"2023-11-28T11:59:46.320141+0000","last_became_active":"2023-11-28T11:59:44.849946+0000","last_became_peered":"2023-11-28T11:59:44.849946+0000","last_unstale":"2023-11-28T11:59:46.320141+0000","last_undegraded":"2023-11-28T11:59:46.320141+0000","last_fullsized":"2023-11-28T11:59:46.320141+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:48:14.849203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.332784+0000","last_change":"2023-11-28T11:59:45.323627+0000","last_active":"2023-11-28T11:59:45.332784+0000","last_peered":"2023-11-28T11:59:45.332784+0000","last_clean":"2023-11-28T11:59:45.332784+0000","last_became_active":"2023-11-28T11:59:45.323374+0000","last_became_peered":"2023-11-28T11:59:45.323374+0000","last_unstale":"2023-11-28T11:59:45.332784+0000","last_undegraded":"2023-11-28T11:59:45.332784+0000","last_fullsized":"2023-11-28T11:59:45.332784+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:48:15.855301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"69'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.318478+0000","last_change":"2023-11-28T11:59:44.844405+0000","last_active":"2023-11-28T11:59:46.318478+0000","last_peered":"2023-11-28T11:59:46.318478+0000","last_clean":"2023-11-28T11:59:46.318478+0000","last_became_active":"2023-11-28T11:59:44.844074+0000","last_became_peered":"2023-11-28T11:59:44.844074+0000","last_unstale":"2023-11-28T11:59:46.318478+0000","last_undegraded":"2023-11-28T11:59:46.318478+0000","last_fullsized":"2023-11-28T11:59:46.318478+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:41:36.909694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.339566+0000","last_change":"2023-11-28T11:59:45.331027+0000","last_active":"2023-11-28T11:59:45.339566+0000","last_peered":"2023-11-28T11:59:45.339566+0000","last_clean":"2023-11-28T11:59:45.339566+0000","last_became_active":"2023-11-28T11:59:45.330716+0000","last_became_peered":"2023-11-28T11:59:45.330716+0000","last_unstale":"2023-11-28T11:59:45.339566+0000","last_undegraded":"2023-11-28T11:59:45.339566+0000","last_fullsized":"2023-11-28T11:59:45.339566+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:18:10.782045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.311241+0000","last_change":"2023-11-28T11:59:44.850644+0000","last_active":"2023-11-28T11:59:45.311241+0000","last_peered":"2023-11-28T11:59:45.311241+0000","last_clean":"2023-11-28T11:59:45.311241+0000","last_became_active":"2023-11-28T11:59:44.850365+0000","last_became_peered":"2023-11-28T11:59:44.850365+0000","last_unstale":"2023-11-28T11:59:45.311241+0000","last_undegraded":"2023-11-28T11:59:45.311241+0000","last_fullsized":"2023-11-28T11:59:45.311241+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:02:17.628084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.339730+0000","last_change":"2023-11-28T11:59:45.331709+0000","last_active":"2023-11-28T11:59:45.339730+0000","last_peered":"2023-11-28T11:59:45.339730+0000","last_clean":"2023-11-28T11:59:45.339730+0000","last_became_active":"2023-11-28T11:59:45.327973+0000","last_became_peered":"2023-11-28T11:59:45.327973+0000","last_unstale":"2023-11-28T11:59:45.339730+0000","last_undegraded":"2023-11-28T11:59:45.339730+0000","last_fullsized":"2023-11-28T11:59:45.339730+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:19:14.160813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.320593+0000","last_change":"2023-11-28T11:59:44.847794+0000","last_active":"2023-11-28T11:59:45.320593+0000","last_peered":"2023-11-28T11:59:45.320593+0000","last_clean":"2023-11-28T11:59:45.320593+0000","last_became_active":"2023-11-28T11:59:44.847515+0000","last_became_peered":"2023-11-28T11:59:44.847515+0000","last_unstale":"2023-11-28T11:59:45.320593+0000","last_undegraded":"2023-11-28T11:59:45.320593+0000","last_fullsized":"2023-11-28T11:59:45.320593+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:24:58.202228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.339073+0000","last_change":"2023-11-28T11:59:45.332169+0000","last_active":"2023-11-28T11:59:45.339073+0000","last_peered":"2023-11-28T11:59:45.339073+0000","last_clean":"2023-11-28T11:59:45.339073+0000","last_became_active":"2023-11-28T11:59:45.331881+0000","last_became_peered":"2023-11-28T11:59:45.331881+0000","last_unstale":"2023-11-28T11:59:45.339073+0000","last_undegraded":"2023-11-28T11:59:45.339073+0000","last_fullsized":"2023-11-28T11:59:45.339073+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:21:04.665404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.312319+0000","last_change":"2023-11-28T11:59:44.850504+0000","last_active":"2023-11-28T11:59:45.312319+0000","last_peered":"2023-11-28T11:59:45.312319+0000","last_clean":"2023-11-28T11:59:45.312319+0000","last_became_active":"2023-11-28T11:59:44.850171+0000","last_became_peered":"2023-11-28T11:59:44.850171+0000","last_unstale":"2023-11-28T11:59:45.312319+0000","last_undegraded":"2023-11-28T11:59:45.312319+0000","last_fullsized":"2023-11-28T11:59:45.312319+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:26:43.690531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.400405+0000","last_change":"2023-11-28T11:59:45.326076+0000","last_active":"2023-11-28T11:59:46.400405+0000","last_peered":"2023-11-28T11:59:46.400405+0000","last_clean":"2023-11-28T11:59:46.400405+0000","last_became_active":"2023-11-28T11:59:45.325747+0000","last_became_peered":"2023-11-28T11:59:45.325747+0000","last_unstale":"2023-11-28T11:59:46.400405+0000","last_undegraded":"2023-11-28T11:59:46.400405+0000","last_fullsized":"2023-11-28T11:59:46.400405+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:34:58.375576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.318893+0000","last_change":"2023-11-28T11:59:44.859655+0000","last_active":"2023-11-28T11:59:46.318893+0000","last_peered":"2023-11-28T11:59:46.318893+0000","last_clean":"2023-11-28T11:59:46.318893+0000","last_became_active":"2023-11-28T11:59:44.859281+0000","last_became_peered":"2023-11-28T11:59:44.859281+0000","last_unstale":"2023-11-28T11:59:46.318893+0000","last_undegraded":"2023-11-28T11:59:46.318893+0000","last_fullsized":"2023-11-28T11:59:46.318893+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:53:05.617897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.318690+0000","last_change":"2023-11-28T11:59:45.315393+0000","last_active":"2023-11-28T11:59:46.318690+0000","last_peered":"2023-11-28T11:59:46.318690+0000","last_clean":"2023-11-28T11:59:46.318690+0000","last_became_active":"2023-11-28T11:59:45.314980+0000","last_became_peered":"2023-11-28T11:59:45.314980+0000","last_unstale":"2023-11-28T11:59:46.318690+0000","last_undegraded":"2023-11-28T11:59:46.318690+0000","last_fullsized":"2023-11-28T11:59:46.318690+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:50:46.289212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"69'3","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.320163+0000","last_change":"2023-11-28T11:59:44.859569+0000","last_active":"2023-11-28T11:59:46.320163+0000","last_peered":"2023-11-28T11:59:46.320163+0000","last_clean":"2023-11-28T11:59:46.320163+0000","last_became_active":"2023-11-28T11:59:44.859181+0000","last_became_peered":"2023-11-28T11:59:44.859181+0000","last_unstale":"2023-11-28T11:59:46.320163+0000","last_undegraded":"2023-11-28T11:59:46.320163+0000","last_fullsized":"2023-11-28T11:59:46.320163+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:16:50.569031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.339309+0000","last_change":"2023-11-28T11:59:45.327313+0000","last_active":"2023-11-28T11:59:45.339309+0000","last_peered":"2023-11-28T11:59:45.339309+0000","last_clean":"2023-11-28T11:59:45.339309+0000","last_became_active":"2023-11-28T11:59:45.327015+0000","last_became_peered":"2023-11-28T11:59:45.327015+0000","last_unstale":"2023-11-28T11:59:45.339309+0000","last_undegraded":"2023-11-28T11:59:45.339309+0000","last_fullsized":"2023-11-28T11:59:45.339309+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:32:34.061833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"69'6","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.344957+0000","last_change":"2023-11-28T11:59:44.850184+0000","last_active":"2023-11-28T11:59:45.344957+0000","last_peered":"2023-11-28T11:59:45.344957+0000","last_clean":"2023-11-28T11:59:45.344957+0000","last_became_active":"2023-11-28T11:59:44.849898+0000","last_became_peered":"2023-11-28T11:59:44.849898+0000","last_unstale":"2023-11-28T11:59:45.344957+0000","last_undegraded":"2023-11-28T11:59:45.344957+0000","last_fullsized":"2023-11-28T11:59:45.344957+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:34:36.202514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.399671+0000","last_change":"2023-11-28T11:59:45.336091+0000","last_active":"2023-11-28T11:59:46.399671+0000","last_peered":"2023-11-28T11:59:46.399671+0000","last_clean":"2023-11-28T11:59:46.399671+0000","last_became_active":"2023-11-28T11:59:45.335781+0000","last_became_peered":"2023-11-28T11:59:45.335781+0000","last_unstale":"2023-11-28T11:59:46.399671+0000","last_undegraded":"2023-11-28T11:59:46.399671+0000","last_fullsized":"2023-11-28T11:59:46.399671+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:26.480820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"69'2","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.336612+0000","last_change":"2023-11-28T11:59:44.855935+0000","last_active":"2023-11-28T11:59:45.336612+0000","last_peered":"2023-11-28T11:59:45.336612+0000","last_clean":"2023-11-28T11:59:45.336612+0000","last_became_active":"2023-11-28T11:59:44.855507+0000","last_became_peered":"2023-11-28T11:59:44.855507+0000","last_unstale":"2023-11-28T11:59:45.336612+0000","last_undegraded":"2023-11-28T11:59:45.336612+0000","last_fullsized":"2023-11-28T11:59:45.336612+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:10:08.146459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.335785+0000","last_change":"2023-11-28T11:59:45.326275+0000","last_active":"2023-11-28T11:59:45.335785+0000","last_peered":"2023-11-28T11:59:45.335785+0000","last_clean":"2023-11-28T11:59:45.335785+0000","last_became_active":"2023-11-28T11:59:45.326026+0000","last_became_peered":"2023-11-28T11:59:45.326026+0000","last_unstale":"2023-11-28T11:59:45.335785+0000","last_undegraded":"2023-11-28T11:59:45.335785+0000","last_fullsized":"2023-11-28T11:59:45.335785+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:04:05.709700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.318640+0000","last_change":"2023-11-28T11:59:44.848316+0000","last_active":"2023-11-28T11:59:46.318640+0000","last_peered":"2023-11-28T11:59:46.318640+0000","last_clean":"2023-11-28T11:59:46.318640+0000","last_became_active":"2023-11-28T11:59:44.847558+0000","last_became_peered":"2023-11-28T11:59:44.847558+0000","last_unstale":"2023-11-28T11:59:46.318640+0000","last_undegraded":"2023-11-28T11:59:46.318640+0000","last_fullsized":"2023-11-28T11:59:46.318640+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:54:13.816055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.340033+0000","last_change":"2023-11-28T11:59:45.335815+0000","last_active":"2023-11-28T11:59:45.340033+0000","last_peered":"2023-11-28T11:59:45.340033+0000","last_clean":"2023-11-28T11:59:45.340033+0000","last_became_active":"2023-11-28T11:59:45.335544+0000","last_became_peered":"2023-11-28T11:59:45.335544+0000","last_unstale":"2023-11-28T11:59:45.340033+0000","last_undegraded":"2023-11-28T11:59:45.340033+0000","last_fullsized":"2023-11-28T11:59:45.340033+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:35:33.195316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.311323+0000","last_change":"2023-11-28T11:59:44.862138+0000","last_active":"2023-11-28T11:59:45.311323+0000","last_peered":"2023-11-28T11:59:45.311323+0000","last_clean":"2023-11-28T11:59:45.311323+0000","last_became_active":"2023-11-28T11:59:44.861850+0000","last_became_peered":"2023-11-28T11:59:44.861850+0000","last_unstale":"2023-11-28T11:59:45.311323+0000","last_undegraded":"2023-11-28T11:59:45.311323+0000","last_fullsized":"2023-11-28T11:59:45.311323+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:50:45.283113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.333235+0000","last_change":"2023-11-28T11:59:45.322704+0000","last_active":"2023-11-28T11:59:45.333235+0000","last_peered":"2023-11-28T11:59:45.333235+0000","last_clean":"2023-11-28T11:59:45.333235+0000","last_became_active":"2023-11-28T11:59:45.322425+0000","last_became_peered":"2023-11-28T11:59:45.322425+0000","last_unstale":"2023-11-28T11:59:45.333235+0000","last_undegraded":"2023-11-28T11:59:45.333235+0000","last_fullsized":"2023-11-28T11:59:45.333235+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:37.744607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"69'8","reported_seq":18,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.341986+0000","last_change":"2023-11-28T11:59:44.852787+0000","last_active":"2023-11-28T11:59:45.341986+0000","last_peered":"2023-11-28T11:59:45.341986+0000","last_clean":"2023-11-28T11:59:45.341986+0000","last_became_active":"2023-11-28T11:59:44.852500+0000","last_became_peered":"2023-11-28T11:59:44.852500+0000","last_unstale":"2023-11-28T11:59:45.341986+0000","last_undegraded":"2023-11-28T11:59:45.341986+0000","last_fullsized":"2023-11-28T11:59:45.341986+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:37.132693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.339920+0000","last_change":"2023-11-28T11:59:45.334903+0000","last_active":"2023-11-28T11:59:45.339920+0000","last_peered":"2023-11-28T11:59:45.339920+0000","last_clean":"2023-11-28T11:59:45.339920+0000","last_became_active":"2023-11-28T11:59:45.334633+0000","last_became_peered":"2023-11-28T11:59:45.334633+0000","last_unstale":"2023-11-28T11:59:45.339920+0000","last_undegraded":"2023-11-28T11:59:45.339920+0000","last_fullsized":"2023-11-28T11:59:45.339920+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:58:05.663175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.318970+0000","last_change":"2023-11-28T11:59:44.852068+0000","last_active":"2023-11-28T11:59:46.318970+0000","last_peered":"2023-11-28T11:59:46.318970+0000","last_clean":"2023-11-28T11:59:46.318970+0000","last_became_active":"2023-11-28T11:59:44.851773+0000","last_became_peered":"2023-11-28T11:59:44.851773+0000","last_unstale":"2023-11-28T11:59:46.318970+0000","last_undegraded":"2023-11-28T11:59:46.318970+0000","last_fullsized":"2023-11-28T11:59:46.318970+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:06:51.207895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.336450+0000","last_change":"2023-11-28T11:59:45.328104+0000","last_active":"2023-11-28T11:59:45.336450+0000","last_peered":"2023-11-28T11:59:45.336450+0000","last_clean":"2023-11-28T11:59:45.336450+0000","last_became_active":"2023-11-28T11:59:45.327810+0000","last_became_peered":"2023-11-28T11:59:45.327810+0000","last_unstale":"2023-11-28T11:59:45.336450+0000","last_undegraded":"2023-11-28T11:59:45.336450+0000","last_fullsized":"2023-11-28T11:59:45.336450+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:10:25.194452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.312404+0000","last_change":"2023-11-28T11:59:44.858711+0000","last_active":"2023-11-28T11:59:45.312404+0000","last_peered":"2023-11-28T11:59:45.312404+0000","last_clean":"2023-11-28T11:59:45.312404+0000","last_became_active":"2023-11-28T11:59:44.858274+0000","last_became_peered":"2023-11-28T11:59:44.858274+0000","last_unstale":"2023-11-28T11:59:45.312404+0000","last_undegraded":"2023-11-28T11:59:45.312404+0000","last_fullsized":"2023-11-28T11:59:45.312404+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:48:46.966429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.399907+0000","last_change":"2023-11-28T11:59:45.326400+0000","last_active":"2023-11-28T11:59:46.399907+0000","last_peered":"2023-11-28T11:59:46.399907+0000","last_clean":"2023-11-28T11:59:46.399907+0000","last_became_active":"2023-11-28T11:59:45.324786+0000","last_became_peered":"2023-11-28T11:59:45.324786+0000","last_unstale":"2023-11-28T11:59:46.399907+0000","last_undegraded":"2023-11-28T11:59:46.399907+0000","last_fullsized":"2023-11-28T11:59:46.399907+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:21:04.665404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.321248+0000","last_change":"2023-11-28T11:59:44.853018+0000","last_active":"2023-11-28T11:59:45.321248+0000","last_peered":"2023-11-28T11:59:45.321248+0000","last_clean":"2023-11-28T11:59:45.321248+0000","last_became_active":"2023-11-28T11:59:44.851317+0000","last_became_peered":"2023-11-28T11:59:44.851317+0000","last_unstale":"2023-11-28T11:59:45.321248+0000","last_undegraded":"2023-11-28T11:59:45.321248+0000","last_fullsized":"2023-11-28T11:59:45.321248+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:37:12.464676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.400394+0000","last_change":"2023-11-28T11:59:45.336117+0000","last_active":"2023-11-28T11:59:46.400394+0000","last_peered":"2023-11-28T11:59:46.400394+0000","last_clean":"2023-11-28T11:59:46.400394+0000","last_became_active":"2023-11-28T11:59:45.335763+0000","last_became_peered":"2023-11-28T11:59:45.335763+0000","last_unstale":"2023-11-28T11:59:46.400394+0000","last_undegraded":"2023-11-28T11:59:46.400394+0000","last_fullsized":"2023-11-28T11:59:46.400394+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:33:52.102085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.308773+0000","last_change":"2023-11-28T11:59:44.853153+0000","last_active":"2023-11-28T11:59:45.308773+0000","last_peered":"2023-11-28T11:59:45.308773+0000","last_clean":"2023-11-28T11:59:45.308773+0000","last_became_active":"2023-11-28T11:59:44.852890+0000","last_became_peered":"2023-11-28T11:59:44.852890+0000","last_unstale":"2023-11-28T11:59:45.308773+0000","last_undegraded":"2023-11-28T11:59:45.308773+0000","last_fullsized":"2023-11-28T11:59:45.308773+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:57:36.489047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.342513+0000","last_change":"2023-11-28T11:59:45.332655+0000","last_active":"2023-11-28T11:59:45.342513+0000","last_peered":"2023-11-28T11:59:45.342513+0000","last_clean":"2023-11-28T11:59:45.342513+0000","last_became_active":"2023-11-28T11:59:45.332113+0000","last_became_peered":"2023-11-28T11:59:45.332113+0000","last_unstale":"2023-11-28T11:59:45.342513+0000","last_undegraded":"2023-11-28T11:59:45.342513+0000","last_fullsized":"2023-11-28T11:59:45.342513+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:06.952405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.322092+0000","last_change":"2023-11-28T11:59:44.858349+0000","last_active":"2023-11-28T11:59:45.322092+0000","last_peered":"2023-11-28T11:59:45.322092+0000","last_clean":"2023-11-28T11:59:45.322092+0000","last_became_active":"2023-11-28T11:59:44.858064+0000","last_became_peered":"2023-11-28T11:59:44.858064+0000","last_unstale":"2023-11-28T11:59:45.322092+0000","last_undegraded":"2023-11-28T11:59:45.322092+0000","last_fullsized":"2023-11-28T11:59:45.322092+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:59:42.833606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.318851+0000","last_change":"2023-11-28T11:59:45.323346+0000","last_active":"2023-11-28T11:59:46.318851+0000","last_peered":"2023-11-28T11:59:46.318851+0000","last_clean":"2023-11-28T11:59:46.318851+0000","last_became_active":"2023-11-28T11:59:45.322949+0000","last_became_peered":"2023-11-28T11:59:45.322949+0000","last_unstale":"2023-11-28T11:59:46.318851+0000","last_undegraded":"2023-11-28T11:59:46.318851+0000","last_fullsized":"2023-11-28T11:59:46.318851+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:11:25.876501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.311351+0000","last_change":"2023-11-28T11:59:44.850846+0000","last_active":"2023-11-28T11:59:45.311351+0000","last_peered":"2023-11-28T11:59:45.311351+0000","last_clean":"2023-11-28T11:59:45.311351+0000","last_became_active":"2023-11-28T11:59:44.850564+0000","last_became_peered":"2023-11-28T11:59:44.850564+0000","last_unstale":"2023-11-28T11:59:45.311351+0000","last_undegraded":"2023-11-28T11:59:45.311351+0000","last_fullsized":"2023-11-28T11:59:45.311351+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:17:44.178578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.325019+0000","last_change":"2023-11-28T11:59:45.317595+0000","last_active":"2023-11-28T11:59:45.325019+0000","last_peered":"2023-11-28T11:59:45.325019+0000","last_clean":"2023-11-28T11:59:45.325019+0000","last_became_active":"2023-11-28T11:59:45.317332+0000","last_became_peered":"2023-11-28T11:59:45.317332+0000","last_unstale":"2023-11-28T11:59:45.325019+0000","last_undegraded":"2023-11-28T11:59:45.325019+0000","last_fullsized":"2023-11-28T11:59:45.325019+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:15:48.339649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.309048+0000","last_change":"2023-11-28T11:59:44.853983+0000","last_active":"2023-11-28T11:59:45.309048+0000","last_peered":"2023-11-28T11:59:45.309048+0000","last_clean":"2023-11-28T11:59:45.309048+0000","last_became_active":"2023-11-28T11:59:44.853650+0000","last_became_peered":"2023-11-28T11:59:44.853650+0000","last_unstale":"2023-11-28T11:59:45.309048+0000","last_undegraded":"2023-11-28T11:59:45.309048+0000","last_fullsized":"2023-11-28T11:59:45.309048+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:10:24.188353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.318118+0000","last_change":"2023-11-28T11:59:45.320556+0000","last_active":"2023-11-28T11:59:46.318118+0000","last_peered":"2023-11-28T11:59:46.318118+0000","last_clean":"2023-11-28T11:59:46.318118+0000","last_became_active":"2023-11-28T11:59:45.320108+0000","last_became_peered":"2023-11-28T11:59:45.320108+0000","last_unstale":"2023-11-28T11:59:46.318118+0000","last_undegraded":"2023-11-28T11:59:46.318118+0000","last_fullsized":"2023-11-28T11:59:46.318118+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:49:23.311334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.318457+0000","last_change":"2023-11-28T11:59:44.850243+0000","last_active":"2023-11-28T11:59:46.318457+0000","last_peered":"2023-11-28T11:59:46.318457+0000","last_clean":"2023-11-28T11:59:46.318457+0000","last_became_active":"2023-11-28T11:59:44.849921+0000","last_became_peered":"2023-11-28T11:59:44.849921+0000","last_unstale":"2023-11-28T11:59:46.318457+0000","last_undegraded":"2023-11-28T11:59:46.318457+0000","last_fullsized":"2023-11-28T11:59:46.318457+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:18:27.183843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.340210+0000","last_change":"2023-11-28T11:59:45.328491+0000","last_active":"2023-11-28T11:59:45.340210+0000","last_peered":"2023-11-28T11:59:45.340210+0000","last_clean":"2023-11-28T11:59:45.340210+0000","last_became_active":"2023-11-28T11:59:45.328217+0000","last_became_peered":"2023-11-28T11:59:45.328217+0000","last_unstale":"2023-11-28T11:59:45.340210+0000","last_undegraded":"2023-11-28T11:59:45.340210+0000","last_fullsized":"2023-11-28T11:59:45.340210+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:01:12.958339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"69'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.318966+0000","last_change":"2023-11-28T11:59:44.851554+0000","last_active":"2023-11-28T11:59:46.318966+0000","last_peered":"2023-11-28T11:59:46.318966+0000","last_clean":"2023-11-28T11:59:46.318966+0000","last_became_active":"2023-11-28T11:59:44.851290+0000","last_became_peered":"2023-11-28T11:59:44.851290+0000","last_unstale":"2023-11-28T11:59:46.318966+0000","last_undegraded":"2023-11-28T11:59:46.318966+0000","last_fullsized":"2023-11-28T11:59:46.318966+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:10:23.273392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":60,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.327095+0000","last_change":"2023-11-28T11:56:34.384408+0000","last_active":"2023-11-28T11:59:45.327095+0000","last_peered":"2023-11-28T11:59:45.327095+0000","last_clean":"2023-11-28T11:59:45.327095+0000","last_became_active":"2023-11-28T11:56:34.384036+0000","last_became_peered":"2023-11-28T11:56:34.384036+0000","last_unstale":"2023-11-28T11:59:45.327095+0000","last_undegraded":"2023-11-28T11:59:45.327095+0000","last_fullsized":"2023-11-28T11:59:45.327095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:58:55.003786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.400601+0000","last_change":"2023-11-28T11:59:45.315656+0000","last_active":"2023-11-28T11:59:46.400601+0000","last_peered":"2023-11-28T11:59:46.400601+0000","last_clean":"2023-11-28T11:59:46.400601+0000","last_became_active":"2023-11-28T11:59:45.315345+0000","last_became_peered":"2023-11-28T11:59:45.315345+0000","last_unstale":"2023-11-28T11:59:46.400601+0000","last_undegraded":"2023-11-28T11:59:46.400601+0000","last_fullsized":"2023-11-28T11:59:46.400601+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:09:08.152387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"69'2","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.340259+0000","last_change":"2023-11-28T11:59:44.852912+0000","last_active":"2023-11-28T11:59:45.340259+0000","last_peered":"2023-11-28T11:59:45.340259+0000","last_clean":"2023-11-28T11:59:45.340259+0000","last_became_active":"2023-11-28T11:59:44.852619+0000","last_became_peered":"2023-11-28T11:59:44.852619+0000","last_unstale":"2023-11-28T11:59:45.340259+0000","last_undegraded":"2023-11-28T11:59:45.340259+0000","last_fullsized":"2023-11-28T11:59:45.340259+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:04:04.703601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:59:44.827702+0000","last_change":"2023-11-28T11:56:34.384088+0000","last_active":"2023-11-28T11:59:44.827702+0000","last_peered":"2023-11-28T11:59:44.827702+0000","last_clean":"2023-11-28T11:59:44.827702+0000","last_became_active":"2023-11-28T11:56:34.383631+0000","last_became_peered":"2023-11-28T11:56:34.383631+0000","last_unstale":"2023-11-28T11:59:44.827702+0000","last_undegraded":"2023-11-28T11:59:44.827702+0000","last_fullsized":"2023-11-28T11:59:44.827702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:15:42.772333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.329420+0000","last_change":"2023-11-28T11:59:45.322771+0000","last_active":"2023-11-28T11:59:45.329420+0000","last_peered":"2023-11-28T11:59:45.329420+0000","last_clean":"2023-11-28T11:59:45.329420+0000","last_became_active":"2023-11-28T11:59:45.322447+0000","last_became_peered":"2023-11-28T11:59:45.322447+0000","last_unstale":"2023-11-28T11:59:45.329420+0000","last_undegraded":"2023-11-28T11:59:45.329420+0000","last_fullsized":"2023-11-28T11:59:45.329420+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:20:16.703314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"69'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.318733+0000","last_change":"2023-11-28T11:59:44.852534+0000","last_active":"2023-11-28T11:59:46.318733+0000","last_peered":"2023-11-28T11:59:46.318733+0000","last_clean":"2023-11-28T11:59:46.318733+0000","last_became_active":"2023-11-28T11:59:44.852218+0000","last_became_peered":"2023-11-28T11:59:44.852218+0000","last_unstale":"2023-11-28T11:59:46.318733+0000","last_undegraded":"2023-11-28T11:59:46.318733+0000","last_fullsized":"2023-11-28T11:59:46.318733+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:34:36.202514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.306164+0000","last_change":"2023-11-28T11:56:34.386399+0000","last_active":"2023-11-28T11:59:45.306164+0000","last_peered":"2023-11-28T11:59:45.306164+0000","last_clean":"2023-11-28T11:59:45.306164+0000","last_became_active":"2023-11-28T11:56:34.385994+0000","last_became_peered":"2023-11-28T11:56:34.385994+0000","last_unstale":"2023-11-28T11:59:45.306164+0000","last_undegraded":"2023-11-28T11:59:45.306164+0000","last_fullsized":"2023-11-28T11:59:45.306164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:58:02.172295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.343034+0000","last_change":"2023-11-28T11:59:45.336416+0000","last_active":"2023-11-28T11:59:45.343034+0000","last_peered":"2023-11-28T11:59:45.343034+0000","last_clean":"2023-11-28T11:59:45.343034+0000","last_became_active":"2023-11-28T11:59:45.336153+0000","last_became_peered":"2023-11-28T11:59:45.336153+0000","last_unstale":"2023-11-28T11:59:45.343034+0000","last_undegraded":"2023-11-28T11:59:45.343034+0000","last_fullsized":"2023-11-28T11:59:45.343034+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:08:15.672758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.399937+0000","last_change":"2023-11-28T11:59:44.855744+0000","last_active":"2023-11-28T11:59:46.399937+0000","last_peered":"2023-11-28T11:59:46.399937+0000","last_clean":"2023-11-28T11:59:46.399937+0000","last_became_active":"2023-11-28T11:59:44.855495+0000","last_became_peered":"2023-11-28T11:59:44.855495+0000","last_unstale":"2023-11-28T11:59:46.399937+0000","last_undegraded":"2023-11-28T11:59:46.399937+0000","last_fullsized":"2023-11-28T11:59:46.399937+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:48:46.966429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:59:44.827832+0000","last_change":"2023-11-28T11:56:34.384999+0000","last_active":"2023-11-28T11:59:44.827832+0000","last_peered":"2023-11-28T11:59:44.827832+0000","last_clean":"2023-11-28T11:59:44.827832+0000","last_became_active":"2023-11-28T11:56:34.384531+0000","last_became_peered":"2023-11-28T11:56:34.384531+0000","last_unstale":"2023-11-28T11:59:44.827832+0000","last_undegraded":"2023-11-28T11:59:44.827832+0000","last_fullsized":"2023-11-28T11:59:44.827832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:09:50.083366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.320051+0000","last_change":"2023-11-28T11:59:45.314465+0000","last_active":"2023-11-28T11:59:46.320051+0000","last_peered":"2023-11-28T11:59:46.320051+0000","last_clean":"2023-11-28T11:59:46.320051+0000","last_became_active":"2023-11-28T11:59:45.314220+0000","last_became_peered":"2023-11-28T11:59:45.314220+0000","last_unstale":"2023-11-28T11:59:46.320051+0000","last_undegraded":"2023-11-28T11:59:46.320051+0000","last_fullsized":"2023-11-28T11:59:46.320051+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:59:23.102714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.318835+0000","last_change":"2023-11-28T11:59:44.843953+0000","last_active":"2023-11-28T11:59:46.318835+0000","last_peered":"2023-11-28T11:59:46.318835+0000","last_clean":"2023-11-28T11:59:46.318835+0000","last_became_active":"2023-11-28T11:59:44.843473+0000","last_became_peered":"2023-11-28T11:59:44.843473+0000","last_unstale":"2023-11-28T11:59:46.318835+0000","last_undegraded":"2023-11-28T11:59:46.318835+0000","last_fullsized":"2023-11-28T11:59:46.318835+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:06:03.287232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":50,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:59:44.844687+0000","last_change":"2023-11-28T11:56:34.389076+0000","last_active":"2023-11-28T11:59:44.844687+0000","last_peered":"2023-11-28T11:59:44.844687+0000","last_clean":"2023-11-28T11:59:44.844687+0000","last_became_active":"2023-11-28T11:56:34.388689+0000","last_became_peered":"2023-11-28T11:56:34.388689+0000","last_unstale":"2023-11-28T11:59:44.844687+0000","last_undegraded":"2023-11-28T11:59:44.844687+0000","last_fullsized":"2023-11-28T11:59:44.844687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:20.936349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.319856+0000","last_change":"2023-11-28T11:59:45.325470+0000","last_active":"2023-11-28T11:59:46.319856+0000","last_peered":"2023-11-28T11:59:46.319856+0000","last_clean":"2023-11-28T11:59:46.319856+0000","last_became_active":"2023-11-28T11:59:45.324621+0000","last_became_peered":"2023-11-28T11:59:45.324621+0000","last_unstale":"2023-11-28T11:59:46.319856+0000","last_undegraded":"2023-11-28T11:59:46.319856+0000","last_fullsized":"2023-11-28T11:59:46.319856+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:14:16.432927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.311463+0000","last_change":"2023-11-28T11:59:44.858155+0000","last_active":"2023-11-28T11:59:45.311463+0000","last_peered":"2023-11-28T11:59:45.311463+0000","last_clean":"2023-11-28T11:59:45.311463+0000","last_became_active":"2023-11-28T11:59:44.857663+0000","last_became_peered":"2023-11-28T11:59:44.857663+0000","last_unstale":"2023-11-28T11:59:45.311463+0000","last_undegraded":"2023-11-28T11:59:45.311463+0000","last_fullsized":"2023-11-28T11:59:45.311463+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:31:48.928068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:59:44.847494+0000","last_change":"2023-11-28T11:56:34.486178+0000","last_active":"2023-11-28T11:59:44.847494+0000","last_peered":"2023-11-28T11:59:44.847494+0000","last_clean":"2023-11-28T11:59:44.847494+0000","last_became_active":"2023-11-28T11:56:34.485702+0000","last_became_peered":"2023-11-28T11:56:34.485702+0000","last_unstale":"2023-11-28T11:59:44.847494+0000","last_undegraded":"2023-11-28T11:59:44.847494+0000","last_fullsized":"2023-11-28T11:59:44.847494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:06.323407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.319729+0000","last_change":"2023-11-28T11:59:45.324840+0000","last_active":"2023-11-28T11:59:46.319729+0000","last_peered":"2023-11-28T11:59:46.319729+0000","last_clean":"2023-11-28T11:59:46.319729+0000","last_became_active":"2023-11-28T11:59:45.324405+0000","last_became_peered":"2023-11-28T11:59:45.324405+0000","last_unstale":"2023-11-28T11:59:46.319729+0000","last_undegraded":"2023-11-28T11:59:46.319729+0000","last_fullsized":"2023-11-28T11:59:46.319729+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:05:17.318973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.309626+0000","last_change":"2023-11-28T11:59:44.851549+0000","last_active":"2023-11-28T11:59:45.309626+0000","last_peered":"2023-11-28T11:59:45.309626+0000","last_clean":"2023-11-28T11:59:45.309626+0000","last_became_active":"2023-11-28T11:59:44.851268+0000","last_became_peered":"2023-11-28T11:59:44.851268+0000","last_unstale":"2023-11-28T11:59:45.309626+0000","last_undegraded":"2023-11-28T11:59:45.309626+0000","last_fullsized":"2023-11-28T11:59:45.309626+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:17:43.892118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.303719+0000","last_change":"2023-11-28T11:56:34.387293+0000","last_active":"2023-11-28T11:59:45.303719+0000","last_peered":"2023-11-28T11:59:45.303719+0000","last_clean":"2023-11-28T11:59:45.303719+0000","last_became_active":"2023-11-28T11:56:34.386976+0000","last_became_peered":"2023-11-28T11:56:34.386976+0000","last_unstale":"2023-11-28T11:59:45.303719+0000","last_undegraded":"2023-11-28T11:59:45.303719+0000","last_fullsized":"2023-11-28T11:59:45.303719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:32.704729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.319888+0000","last_change":"2023-11-28T11:59:45.321506+0000","last_active":"2023-11-28T11:59:46.319888+0000","last_peered":"2023-11-28T11:59:46.319888+0000","last_clean":"2023-11-28T11:59:46.319888+0000","last_became_active":"2023-11-28T11:59:45.321281+0000","last_became_peered":"2023-11-28T11:59:45.321281+0000","last_unstale":"2023-11-28T11:59:46.319888+0000","last_undegraded":"2023-11-28T11:59:46.319888+0000","last_fullsized":"2023-11-28T11:59:46.319888+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:54:05.310216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.318301+0000","last_change":"2023-11-28T11:59:44.850456+0000","last_active":"2023-11-28T11:59:46.318301+0000","last_peered":"2023-11-28T11:59:46.318301+0000","last_clean":"2023-11-28T11:59:46.318301+0000","last_became_active":"2023-11-28T11:59:44.850155+0000","last_became_peered":"2023-11-28T11:59:44.850155+0000","last_unstale":"2023-11-28T11:59:46.318301+0000","last_undegraded":"2023-11-28T11:59:46.318301+0000","last_fullsized":"2023-11-28T11:59:46.318301+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:15:47.333550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":50,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:59:44.844199+0000","last_change":"2023-11-28T11:56:34.389222+0000","last_active":"2023-11-28T11:59:44.844199+0000","last_peered":"2023-11-28T11:59:44.844199+0000","last_clean":"2023-11-28T11:59:44.844199+0000","last_became_active":"2023-11-28T11:56:34.388671+0000","last_became_peered":"2023-11-28T11:56:34.388671+0000","last_unstale":"2023-11-28T11:59:44.844199+0000","last_undegraded":"2023-11-28T11:59:44.844199+0000","last_fullsized":"2023-11-28T11:59:44.844199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:32.704729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":205,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.303864+0000","last_change":"2023-11-28T11:56:28.472008+0000","last_active":"2023-11-28T11:59:45.303864+0000","last_peered":"2023-11-28T11:59:45.303864+0000","last_clean":"2023-11-28T11:59:45.303864+0000","last_became_active":"2023-11-28T11:56:28.469273+0000","last_became_peered":"2023-11-28T11:56:28.469273+0000","last_unstale":"2023-11-28T11:59:45.303864+0000","last_undegraded":"2023-11-28T11:59:45.303864+0000","last_fullsized":"2023-11-28T11:59:45.303864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:27.291192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:27.291192+0000","last_clean_scrub_stamp":"2023-11-28T11:56:27.291192+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:14:48.860420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509483,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15036,"kb_used_data":1396,"kb_used_omap":0,"kb_used_meta":13632,"kb_avail":94356804,"statfs":{"total":96636764160,"available":96621367296,"internally_reserved":0,"allocated":1429504,"data_stored":975319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13959168},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.0880000000000001,"15min":1.0960000000000001},"min":{"1min":0.77000000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4379999999999999,"5min":1.468,"15min":1.468},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.101,"5min":1.083,"15min":1.079},"min":{"1min":0.81699999999999995,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.615,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.155}]},{"osd":1,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.1950000000000001,"15min":1.204},"min":{"1min":0.83999999999999997,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.542,"5min":1.71,"15min":1.71},"last":1.028},{"interface":"front","average":{"1min":1.143,"5min":1.1659999999999999,"15min":1.177},"min":{"1min":0.79500000000000004,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.502,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.999}]},{"osd":2,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.165,"15min":1.181},"min":{"1min":0.73099999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.579,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.262},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.2629999999999999,"15min":1.2789999999999999},"min":{"1min":0.82399999999999995,"5min":0.749,"15min":0.749},"max":{"1min":1.5209999999999999,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.123}]},{"osd":3,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2869999999999999,"15min":1.3109999999999999},"min":{"1min":0.872,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.4610000000000001,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.337,"15min":1.355},"min":{"1min":1.006,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.5629999999999999,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.2030000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.244,"15min":1.294},"min":{"1min":0.90000000000000002,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.278,"15min":1.3300000000000001},"min":{"1min":0.92700000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.5129999999999999,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.0600000000000001}]},{"osd":5,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.377,"15min":1.429},"min":{"1min":0.91900000000000004,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.5549999999999999,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.353,"15min":1.391},"min":{"1min":1.145,"5min":0.872,"15min":0.872},"max":{"1min":1.603,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":1.085}]},{"osd":6,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.494,"15min":1.548},"min":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"max":{"1min":1.706,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.319,"5min":1.401,"15min":1.4470000000000001},"min":{"1min":1.0760000000000001,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.5920000000000001,"5min":2.468,"15min":2.468},"last":0.91300000000000003}]}]},{"osd":6,"up_from":15,"seq":64424509483,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9784,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94362056,"statfs":{"total":96636764160,"available":96626745344,"internally_reserved":0,"allocated":835584,"data_stored":384443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.004,"15min":0.99399999999999999},"min":{"1min":0.59899999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.5149999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.119},{"interface":"front","average":{"1min":1.044,"5min":1.1539999999999999,"15min":1.1899999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.5049999999999999,"5min":2.347,"15min":2.347},"last":0.83399999999999996}]},{"osd":1,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1699999999999999,"15min":1.1739999999999999},"min":{"1min":0.79900000000000004,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.137,"5min":1.157,"15min":1.171},"min":{"1min":0.72699999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.454,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":1.212}]},{"osd":2,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.198,"15min":1.242},"min":{"1min":0.754,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4410000000000001,"5min":3.9620000000000002,"15min":3.9620000000000002},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1639999999999999,"15min":1.1679999999999999},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.01}]},{"osd":3,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.258,"15min":1.26},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.496,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.258,"15min":1.268},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.5209999999999999,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.042}]},{"osd":4,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.2050000000000001,"15min":1.232},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.4179999999999999,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.4159999999999999,"15min":1.4670000000000001},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.8540000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.1619999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.2250000000000001,"15min":1.266},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.091},{"interface":"front","average":{"1min":1.175,"5min":1.244,"15min":1.27},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.98799999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.3200000000000001,"15min":1.3360000000000001},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.343,"15min":1.355},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.978,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.1879999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509483,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9652,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":8832,"kb_avail":94362188,"statfs":{"total":96636764160,"available":96626880512,"internally_reserved":0,"allocated":831488,"data_stored":384441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9043968},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.0840000000000001,"15min":1.089},"min":{"1min":0.73899999999999999,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.3500000000000001,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.0900000000000001,"15min":1.0820000000000001},"min":{"1min":0.90400000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.359,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.97699999999999998}]},{"osd":1,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1479999999999999,"15min":1.1519999999999999},"min":{"1min":0.77500000000000002,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.48,"5min":1.843,"15min":1.843},"last":1.036},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.0920000000000001,"15min":1.0900000000000001},"min":{"1min":0.77300000000000002,"5min":0.752,"15min":0.752},"max":{"1min":1.4870000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.3680000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.171,"15min":1.167},"min":{"1min":0.77600000000000002,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.1930000000000001,"15min":1.198},"min":{"1min":0.86899999999999999,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.4990000000000001,"5min":1.79,"15min":1.79},"last":1.242}]},{"osd":3,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.252,"15min":1.2729999999999999},"min":{"1min":0.84099999999999997,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.5649999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.353,"5min":1.365,"15min":1.3919999999999999},"min":{"1min":1.0069999999999999,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.712,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.3180000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.1739999999999999,"15min":1.2090000000000001},"min":{"1min":0.77900000000000003,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.431,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.5469999999999999},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.228,"15min":1.234},"min":{"1min":0.876,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.4770000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.0900000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.2689999999999999,"15min":1.276},"min":{"1min":0.91800000000000004,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.6259999999999999,"5min":1.732,"15min":1.732},"last":1.419},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.2829999999999999,"15min":1.2849999999999999},"min":{"1min":0.99399999999999999,"5min":0.874,"15min":0.874},"max":{"1min":1.4550000000000001,"5min":1.704,"15min":1.704},"last":1.4490000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3520000000000001,"15min":1.3620000000000001},"min":{"1min":0.97499999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.6859999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.446,"15min":1.472},"min":{"1min":1.05,"5min":1.002,"15min":1.002},"max":{"1min":1.762,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.512}]}]},{"osd":4,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9972,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":9152,"kb_avail":94361868,"statfs":{"total":96636764160,"available":96626552832,"internally_reserved":0,"allocated":831488,"data_stored":384421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9371648},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.109,"15min":1.1100000000000001},"min":{"1min":0.76100000000000001,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5429999999999999,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.1279999999999999,"15min":1.1519999999999999},"min":{"1min":0.71699999999999997,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.554,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.1890000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.173,"15min":1.2090000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.496,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.171,"5min":1.1819999999999999,"15min":1.202},"min":{"1min":0.70999999999999996,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.7190000000000001,"5min":2.8860000000000001,"15min":2.8860000000000001},"last":1.371}]},{"osd":2,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.208,"15min":1.238},"min":{"1min":0.81999999999999995,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.589,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.143},{"interface":"front","average":{"1min":1.236,"5min":1.3520000000000001,"15min":1.403},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.5389999999999999,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":1.504}]},{"osd":3,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.282,"15min":1.3160000000000001},"min":{"1min":0.89700000000000002,"5min":0.746,"15min":0.746},"max":{"1min":1.4790000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3560000000000001,"15min":1.3740000000000001},"min":{"1min":1.004,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.877,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.0109999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.3640000000000001,"15min":1.431},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.0139999999999998,"5min":2.972,"15min":2.972},"last":1.226},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.296,"15min":1.353},"min":{"1min":0.78600000000000003,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.2389999999999999,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.323}]},{"osd":6,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3580000000000001,"15min":1.4059999999999999},"min":{"1min":0.96699999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.919,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.3},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.49,"15min":1.542},"min":{"1min":1.0189999999999999,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":2.0790000000000002,"5min":3.133,"15min":3.133},"last":1.4550000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.4570000000000001,"15min":1.5169999999999999},"min":{"1min":0.95199999999999996,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.992,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.474,"5min":1.5369999999999999,"15min":1.5880000000000001},"min":{"1min":1.145,"5min":1.0760000000000001,"15min":1.0760000000000001},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.413}]}]},{"osd":3,"up_from":15,"seq":64424509483,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14020,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":13184,"kb_avail":94357820,"statfs":{"total":96636764160,"available":96622407680,"internally_reserved":0,"allocated":847872,"data_stored":391436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13500416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.82999999999999996,"15min":0.84199999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.292,"5min":1.478,"15min":1.478},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.91900000000000004,"15min":0.91800000000000004},"min":{"1min":0.64200000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.276,"5min":2.177,"15min":2.177},"last":0.93000000000000005}]},{"osd":1,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.86699999999999999,"15min":0.86599999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.468,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.01},{"interface":"front","average":{"1min":1.006,"5min":1.044,"15min":1.0600000000000001},"min":{"1min":0.59099999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4179999999999999,"5min":1.968,"15min":1.968},"last":1.1679999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.109,"15min":1.139},"min":{"1min":0.63700000000000001,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.548,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.171,"15min":1.2070000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.5389999999999999,"5min":2.093,"15min":2.093},"last":1.27}]},{"osd":4,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.1719999999999999,"15min":1.1779999999999999},"min":{"1min":0.84199999999999997,"5min":0.75,"15min":0.75},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":1.5369999999999999},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.294,"15min":1.3320000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.837,"5min":2.8439999999999999,"15min":2.8439999999999999},"last":1.2230000000000001}]},{"osd":5,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.325,"15min":1.359},"min":{"1min":0.85699999999999998,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.6040000000000001,"5min":2.9670000000000001,"15min":2.9670000000000001},"last":1.821},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3999999999999999,"15min":1.444},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.655,"5min":3.7429999999999999,"15min":3.7429999999999999},"last":1.5649999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3360000000000001,"15min":1.3520000000000001},"min":{"1min":0.91700000000000004,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.077,"5min":2.323,"15min":2.323},"last":1.6559999999999999},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.407,"15min":1.444},"min":{"1min":0.93899999999999995,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.7210000000000001,"5min":2.927,"15min":2.927},"last":1.873}]},{"osd":7,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.4570000000000001,"15min":1.498},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.794,"5min":3.5030000000000001,"15min":3.5030000000000001},"last":1.7110000000000001},{"interface":"front","average":{"1min":1.369,"5min":1.4430000000000001,"15min":1.4750000000000001},"min":{"1min":1.0720000000000001,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.1549999999999998,"5min":2.6320000000000001,"15min":2.6320000000000001},"last":1.603}]}]},{"osd":1,"up_from":15,"seq":64424509483,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9732,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362108,"statfs":{"total":96636764160,"available":96626798592,"internally_reserved":0,"allocated":847872,"data_stored":386499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.89300000000000002,"15min":0.93400000000000005},"min":{"1min":0.495,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.3919999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.018,"15min":1.0089999999999999},"min":{"1min":0.67700000000000005,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.5429999999999999,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.67100000000000004}]},{"osd":2,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.069,"15min":1.083},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.6160000000000001,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0860000000000001,"15min":1.1000000000000001},"min":{"1min":0.72599999999999998,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.7769999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.84199999999999997}]},{"osd":3,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.1859999999999999,"15min":1.2030000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.635,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.103,"5min":1.1339999999999999,"15min":1.171},"min":{"1min":0.65600000000000003,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.4670000000000001,"5min":1.8,"15min":1.8},"last":0.78000000000000003}]},{"osd":4,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.353,"15min":1.3720000000000001},"min":{"1min":1.002,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.6890000000000001,"5min":3.411,"15min":3.411},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.3009999999999999,"15min":1.339},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.7969999999999999,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":1.214}]},{"osd":5,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.3799999999999999,"15min":1.423},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.9039999999999999,"5min":3.6869999999999998,"15min":3.6869999999999998},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.284,"5min":1.306,"15min":1.3260000000000001},"min":{"1min":0.97699999999999998,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.736,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.1819999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.4239999999999999,"15min":1.4550000000000001},"min":{"1min":0.99399999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.8899999999999999,"5min":3.5379999999999998,"15min":3.5379999999999998},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.4470000000000001,"15min":1.49},"min":{"1min":0.84099999999999997,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.0259999999999998,"5min":2.5739999999999998,"15min":2.5739999999999998},"last":1.413}]},{"osd":7,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.4510000000000001,"15min":1.4770000000000001},"min":{"1min":1.1040000000000001,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.9490000000000001,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.492,"15min":1.52},"min":{"1min":1.1870000000000001,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.986,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.335}]}]},{"osd":2,"up_from":14,"seq":60129542187,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9508,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362332,"statfs":{"total":96636764160,"available":96627027968,"internally_reserved":0,"allocated":815104,"data_stored":376903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:27 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85499999999999998,"15min":0.86699999999999999},"min":{"1min":0.59999999999999998,"5min":0.497,"15min":0.497},"max":{"1min":1.28,"5min":1.722,"15min":1.722},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.98199999999999998,"15min":1.002},"min":{"1min":0.55800000000000005,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.389,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":0.76800000000000002}]},{"osd":1,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.01,"15min":1.028},"min":{"1min":0.58699999999999997,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.276,"5min":1.754,"15min":1.754},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.92800000000000005,"15min":0.93999999999999995},"min":{"1min":0.627,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2729999999999999,"5min":1.484,"15min":1.484},"last":0.871}]},{"osd":3,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.105,"15min":1.127},"min":{"1min":0.74299999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.5109999999999999,"5min":2.048,"15min":2.048},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.214,"5min":1.2629999999999999,"15min":1.2869999999999999},"min":{"1min":0.81399999999999995,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.6699999999999999,"5min":2.617,"15min":2.617},"last":1.288}]},{"osd":4,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3460000000000001,"15min":1.3799999999999999},"min":{"1min":1.0580000000000001,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.6619999999999999,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2370000000000001,"15min":1.2509999999999999},"min":{"1min":0.86199999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.6830000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":1.248}]},{"osd":5,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.3129999999999999,"15min":1.343},"min":{"1min":0.93999999999999995,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.6759999999999999,"5min":2.738,"15min":2.738},"last":1.345},{"interface":"front","average":{"1min":1.288,"5min":1.4570000000000001,"15min":1.5349999999999999},"min":{"1min":0.92100000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.7350000000000001,"5min":4.0309999999999997,"15min":4.0309999999999997},"last":1.3260000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.5289999999999999,"15min":1.593},"min":{"1min":1.0529999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.8,"5min":4.2240000000000002,"15min":4.2240000000000002},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.363,"5min":1.4770000000000001,"15min":1.534},"min":{"1min":1.0600000000000001,"5min":0.755,"15min":0.755},"max":{"1min":1.7430000000000001,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":1.1319999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.413,"15min":1.4490000000000001},"min":{"1min":0.90200000000000002,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.776,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.153},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.591,"15min":1.653},"min":{"1min":1.01,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.8460000000000001,"5min":4.3570000000000002,"15min":4.3570000000000002},"last":1.4019999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542187,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10980,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":94360860,"statfs":{"total":96636764160,"available":96625520640,"internally_reserved":0,"allocated":1404928,"data_stored":966352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.85999999999999999,"15min":0.875},"min":{"1min":0.54500000000000004,"5min":0.439,"15min":0.439},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.997,"5min":0.99299999999999999,"15min":1.0089999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.5569999999999999,"5min":1.7,"15min":1.7},"last":0.81999999999999995}]},{"osd":2,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":1.0109999999999999,"15min":1.0409999999999999},"min":{"1min":0.61899999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2929999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.91800000000000004,"15min":0.92200000000000004},"min":{"1min":0.59399999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.444,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.872}]},{"osd":3,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.046,"15min":1.0700000000000001},"min":{"1min":0.68000000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.5940000000000001,"5min":1.645,"15min":1.645},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.093,"5min":1.208,"15min":1.2310000000000001},"min":{"1min":0.77100000000000002,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.403,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.341}]},{"osd":4,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.294,"15min":1.3320000000000001},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.5,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.149,"5min":1.3240000000000001,"15min":1.383},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.3899999999999999,"5min":3.1629999999999998,"15min":3.1629999999999998},"last":1.3049999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.331,"15min":1.353},"min":{"1min":0.91300000000000003,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.583,"5min":2.23,"15min":2.23},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.363,"15min":1.407},"min":{"1min":0.97199999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.494,"5min":2.266,"15min":2.266},"last":1.1919999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.4530000000000001,"15min":1.5009999999999999},"min":{"1min":0.99299999999999999,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.7629999999999999,"5min":2.4060000000000001,"15min":2.4060000000000001},"last":1.115},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.4470000000000001,"15min":1.488},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.752,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":1.1339999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.4810000000000001,"15min":1.5109999999999999},"min":{"1min":1.0800000000000001,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.869,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.411},{"interface":"front","average":{"1min":1.331,"5min":1.5029999999999999,"15min":1.556},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":1.663,"5min":2.6040000000000001,"15min":2.6040000000000001},"last":1.27}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:59:49.695 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:59:49.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.918+0000 7f8d4f59e700 1 Processor -- start 2023-11-28T11:59:49.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.918+0000 7f8d4f59e700 1 -- start start 2023-11-28T11:59:49.924 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.918+0000 7f8d4f59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d5006bed0 0x7f8d5006c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:49.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.922+0000 7f8d4f59e700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d5006c870 con 0x7f8d5015c650 2023-11-28T11:59:49.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.922+0000 7f8d4f59e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d500c9d40 con 0x7f8d500cd0d0 2023-11-28T11:59:49.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.922+0000 7f8d4f59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5006b140 con 0x7f8d5006bed0 2023-11-28T11:59:49.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.922+0000 7f8d4e59c700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f8d5015c650 0x7f8d5006b2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42284/0 (socket says 172.21.15.39:42284) 2023-11-28T11:59:49.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.922+0000 7f8d4e59c700 1 -- 172.21.15.39:0/839554547 learned_addr learned my addr 172.21.15.39:0/839554547 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:59:49.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.922+0000 7f8d4ed9d700 1 --2- 172.21.15.39:0/839554547 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d5006bed0 0x7f8d5006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:49.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.922+0000 7f8d4d59a700 1 -- 172.21.15.39:0/839554547 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3578866444 0 0) 0x7f8d5006c870 con 0x7f8d5015c650 2023-11-28T11:59:49.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.922+0000 7f8d4d59a700 1 -- 172.21.15.39:0/839554547 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d380035d0 con 0x7f8d5015c650 2023-11-28T11:59:49.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.922+0000 7f8d4d59a700 1 -- 172.21.15.39:0/839554547 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3371975810 0 0) 0x7f8d500c9d40 con 0x7f8d500cd0d0 2023-11-28T11:59:49.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.922+0000 7f8d4d59a700 1 -- 172.21.15.39:0/839554547 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d5006c870 con 0x7f8d500cd0d0 2023-11-28T11:59:49.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.922+0000 7f8d4d59a700 1 -- 172.21.15.39:0/839554547 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3563558210 0 0) 0x7f8d380035d0 con 0x7f8d5015c650 2023-11-28T11:59:49.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.922+0000 7f8d4d59a700 1 -- 172.21.15.39:0/839554547 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d5006bed0 msgr2=0x7f8d5006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:49.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.922+0000 7f8d4d59a700 1 --2- 172.21.15.39:0/839554547 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d5006bed0 0x7f8d5006c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:49.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.922+0000 7f8d4d59a700 1 -- 172.21.15.39:0/839554547 >> v1:172.21.15.184:6789/0 conn(0x7f8d500cd0d0 legacy=0x7f8d500b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:49.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.922+0000 7f8d4d59a700 1 -- 172.21.15.39:0/839554547 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d500b1d50 con 0x7f8d5015c650 2023-11-28T11:59:49.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.922+0000 7f8d4d59a700 1 -- 172.21.15.39:0/839554547 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4013383302 0 0) 0x7f8d40001670 con 0x7f8d5015c650 2023-11-28T11:59:49.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.922+0000 7f8d4d59a700 1 -- 172.21.15.39:0/839554547 >> v1:172.21.15.39:6789/0 conn(0x7f8d5015c650 legacy=0x7f8d5006b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:49.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.922+0000 7f8d4d59a700 1 --2- 172.21.15.39:0/839554547 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d38003be0 0x7f8d38003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:49.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.922+0000 7f8d4d59a700 1 --2- 172.21.15.39:0/839554547 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d5006bed0 0x7f8d38004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:49.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.922+0000 7f8d4d59a700 1 --2- 172.21.15.39:0/839554547 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8d38004db0 0x7f8d38005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:49.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.922+0000 7f8d4d59a700 1 -- 172.21.15.39:0/839554547 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3800bae0 con 0x7f8d38004db0 2023-11-28T11:59:49.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.922+0000 7f8d4d59a700 1 -- 172.21.15.39:0/839554547 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3800bc20 con 0x7f8d38003be0 2023-11-28T11:59:49.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.922+0000 7f8d4d59a700 1 -- 172.21.15.39:0/839554547 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3800bd90 con 0x7f8d5006bed0 2023-11-28T11:59:49.930 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.922+0000 7f8d4ed9d700 1 --2- 172.21.15.39:0/839554547 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8d38004db0 0x7f8d38005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:49.930 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.922+0000 7f8d4e59c700 1 --2- 172.21.15.39:0/839554547 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d38003be0 0x7f8d38003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:49.930 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.922+0000 7f8d4dd9b700 1 --2- 172.21.15.39:0/839554547 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d5006bed0 0x7f8d38004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:49.930 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.922+0000 7f8d4ed9d700 1 -- 172.21.15.39:0/839554547 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d5006bed0 msgr2=0x7f8d38004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:49.930 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.922+0000 7f8d4ed9d700 1 --2- 172.21.15.39:0/839554547 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d5006bed0 0x7f8d38004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:49.930 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.922+0000 7f8d4ed9d700 1 -- 172.21.15.39:0/839554547 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d38003be0 msgr2=0x7f8d38003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:49.930 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.922+0000 7f8d4ed9d700 1 --2- 172.21.15.39:0/839554547 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d38003be0 0x7f8d38003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:49.930 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.922+0000 7f8d4ed9d700 1 -- 172.21.15.39:0/839554547 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d380035d0 con 0x7f8d38004db0 2023-11-28T11:59:49.931 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.922+0000 7f8d4dd9b700 1 --2- 172.21.15.39:0/839554547 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d5006bed0 0x7f8d38004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:49.931 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.926+0000 7f8d4ed9d700 1 --2- 172.21.15.39:0/839554547 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8d38004db0 0x7f8d38005220 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f8d48009fc0 tx=0x7f8d380058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=458492d16f74f2f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:49.931 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.926+0000 7f8d4d59a700 1 -- 172.21.15.39:0/839554547 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4800ebd0 con 0x7f8d38004db0 2023-11-28T11:59:49.931 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.926+0000 7f8d4d59a700 1 -- 172.21.15.39:0/839554547 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4800f040 con 0x7f8d38004db0 2023-11-28T11:59:49.931 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.926+0000 7f8d4d59a700 1 -- 172.21.15.39:0/839554547 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d48014480 con 0x7f8d38004db0 2023-11-28T11:59:49.931 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.926+0000 7f8d4f59e700 1 -- 172.21.15.39:0/839554547 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8d38004db0 msgr2=0x7f8d38005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:49.931 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.926+0000 7f8d4f59e700 1 --2- 172.21.15.39:0/839554547 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8d38004db0 0x7f8d38005220 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f8d48009fc0 tx=0x7f8d380058a0 comp rx=0 tx=0).stop 2023-11-28T11:59:49.931 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.926+0000 7f8d4ed9d700 1 -- 172.21.15.39:0/839554547 reap_dead start 2023-11-28T11:59:49.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.926+0000 7f8d4f59e700 1 -- 172.21.15.39:0/839554547 shutdown_connections 2023-11-28T11:59:49.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.926+0000 7f8d4f59e700 1 -- 172.21.15.39:0/839554547 >> 172.21.15.39:0/839554547 conn(0x7f8d500b0f80 msgr2=0x7f8d500ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:49.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.926+0000 7f8d4f59e700 1 -- 172.21.15.39:0/839554547 shutdown_connections 2023-11-28T11:59:49.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.926+0000 7f8d4f59e700 1 -- 172.21.15.39:0/839554547 wait complete. 2023-11-28T11:59:49.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.930+0000 7f8d4f59e700 1 Processor -- start 2023-11-28T11:59:49.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.930+0000 7f8d4f59e700 1 -- start start 2023-11-28T11:59:49.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.930+0000 7f8d4f59e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d38004db0 0x7f8d50158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:49.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.934+0000 7f8d4f59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d5014de00 0x7f8d50070080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:49.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.934+0000 7f8d4f59e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8d50159b80 0x7f8d500705c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:49.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.934+0000 7f8d4f59e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d500a8880 con 0x7f8d50159b80 2023-11-28T11:59:49.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.934+0000 7f8d4f59e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d50158b60 con 0x7f8d38004db0 2023-11-28T11:59:49.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.934+0000 7f8d4f59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d50158d90 con 0x7f8d5014de00 2023-11-28T11:59:49.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.934+0000 7f8d4ed9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8d50159b80 0x7f8d500705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:49.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.934+0000 7f8d4ed9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8d50159b80 0x7f8d500705c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38450/0 (socket says 172.21.15.39:38450) 2023-11-28T11:59:49.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.934+0000 7f8d4ed9d700 1 -- 172.21.15.39:0/3167601788 learned_addr learned my addr 172.21.15.39:0/3167601788 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:49.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.934+0000 7f8d4e59c700 1 --2- 172.21.15.39:0/3167601788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d38004db0 0x7f8d50158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:49.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.934+0000 7f8d4dd9b700 1 --2- 172.21.15.39:0/3167601788 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d5014de00 0x7f8d50070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:49.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.934+0000 7f8d4ed9d700 1 -- 172.21.15.39:0/3167601788 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d5014de00 msgr2=0x7f8d50070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:49.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.934+0000 7f8d4ed9d700 1 --2- 172.21.15.39:0/3167601788 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d5014de00 0x7f8d50070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:49.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.934+0000 7f8d4ed9d700 1 -- 172.21.15.39:0/3167601788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d38004db0 msgr2=0x7f8d50158620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:49.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.934+0000 7f8d4ed9d700 1 --2- 172.21.15.39:0/3167601788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d38004db0 0x7f8d50158620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:49.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.934+0000 7f8d4ed9d700 1 -- 172.21.15.39:0/3167601788 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d500cd8b0 con 0x7f8d50159b80 2023-11-28T11:59:49.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.934+0000 7f8d4dd9b700 1 --2- 172.21.15.39:0/3167601788 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d5014de00 0x7f8d50070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:49.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.934+0000 7f8d4e59c700 1 --2- 172.21.15.39:0/3167601788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d38004db0 0x7f8d50158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:49.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.934+0000 7f8d4ed9d700 1 --2- 172.21.15.39:0/3167601788 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8d50159b80 0x7f8d500705c0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f8d48016000 tx=0x7f8d48009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:49.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.934+0000 7f8d3effd700 1 -- 172.21.15.39:0/3167601788 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d48007000 con 0x7f8d50159b80 2023-11-28T11:59:49.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.934+0000 7f8d3effd700 1 -- 172.21.15.39:0/3167601788 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d48022070 con 0x7f8d50159b80 2023-11-28T11:59:49.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.934+0000 7f8d4f59e700 1 -- 172.21.15.39:0/3167601788 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d500cd5d0 con 0x7f8d50159b80 2023-11-28T11:59:49.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.934+0000 7f8d3effd700 1 -- 172.21.15.39:0/3167601788 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d48029480 con 0x7f8d50159b80 2023-11-28T11:59:49.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.934+0000 7f8d4f59e700 1 -- 172.21.15.39:0/3167601788 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d500c99d0 con 0x7f8d50159b80 2023-11-28T11:59:49.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.938+0000 7f8d4f59e700 1 -- 172.21.15.39:0/3167601788 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d50073cb0 con 0x7f8d50159b80 2023-11-28T11:59:49.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.938+0000 7f8d3effd700 1 -- 172.21.15.39:0/3167601788 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8d480295e0 con 0x7f8d50159b80 2023-11-28T11:59:49.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.938+0000 7f8d3effd700 1 --2- 172.21.15.39:0/3167601788 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8d30064ee0 0x7f8d30067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:49.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.938+0000 7f8d3effd700 1 -- 172.21.15.39:0/3167601788 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8d48024070 con 0x7f8d50159b80 2023-11-28T11:59:49.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.938+0000 7f8d4e59c700 1 --2- 172.21.15.39:0/3167601788 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8d30064ee0 0x7f8d30067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:49.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.942+0000 7f8d4e59c700 1 --2- 172.21.15.39:0/3167601788 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8d30064ee0 0x7f8d30067390 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8d40001050 tx=0x7f8d40009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:49.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:49.942+0000 7f8d3effd700 1 -- 172.21.15.39:0/3167601788 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8d48052330 con 0x7f8d50159b80 2023-11-28T11:59:50.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.142+0000 7f8d4f59e700 1 -- 172.21.15.39:0/3167601788 --> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8d500b2ab0 con 0x7f8d30064ee0 2023-11-28T11:59:50.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.158+0000 7f8d3effd700 1 -- 172.21.15.39:0/3167601788 <== mgr.4104 v2:172.21.15.184:6832/36166 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308829 (secure 0 0 0) 0x7f8d500b2ab0 con 0x7f8d30064ee0 2023-11-28T11:59:50.169 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:59:50.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.166+0000 7f8d4f59e700 1 -- 172.21.15.39:0/3167601788 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8d30064ee0 msgr2=0x7f8d30067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:50.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.166+0000 7f8d4f59e700 1 --2- 172.21.15.39:0/3167601788 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8d30064ee0 0x7f8d30067390 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8d40001050 tx=0x7f8d40009040 comp rx=0 tx=0).stop 2023-11-28T11:59:50.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.166+0000 7f8d4f59e700 1 -- 172.21.15.39:0/3167601788 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8d50159b80 msgr2=0x7f8d500705c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:50.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.166+0000 7f8d4f59e700 1 --2- 172.21.15.39:0/3167601788 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8d50159b80 0x7f8d500705c0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f8d48016000 tx=0x7f8d48009750 comp rx=0 tx=0).stop 2023-11-28T11:59:50.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.166+0000 7f8d4f59e700 1 -- 172.21.15.39:0/3167601788 shutdown_connections 2023-11-28T11:59:50.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.166+0000 7f8d4f59e700 1 --2- 172.21.15.39:0/3167601788 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8d50159b80 0x7f8d500705c0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:50.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.166+0000 7f8d4f59e700 1 --2- 172.21.15.39:0/3167601788 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d5014de00 0x7f8d50070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:50.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.166+0000 7f8d4f59e700 1 --2- 172.21.15.39:0/3167601788 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8d30064ee0 0x7f8d30067390 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:50.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.166+0000 7f8d4f59e700 1 --2- 172.21.15.39:0/3167601788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d38004db0 0x7f8d50158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:50.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.166+0000 7f8d4f59e700 1 -- 172.21.15.39:0/3167601788 >> 172.21.15.39:0/3167601788 conn(0x7f8d500b0f80 msgr2=0x7f8d5015bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:50.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.166+0000 7f8d4f59e700 1 -- 172.21.15.39:0/3167601788 shutdown_connections 2023-11-28T11:59:50.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.166+0000 7f8d4f59e700 1 -- 172.21.15.39:0/3167601788 wait complete. 2023-11-28T11:59:50.174 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2023-11-28T11:59:50.195 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":165,"stamp":"2023-11-28T11:59:48.619597+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":67,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":88684,"kb_used_data":7660,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":754886036,"statfs":{"total":773094113280,"available":773003300864,"internally_reserved":0,"allocated":7843840,"data_stored":4249814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.809551"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.400336+0000","last_change":"2023-11-28T11:59:45.336331+0000","last_active":"2023-11-28T11:59:46.400336+0000","last_peered":"2023-11-28T11:59:46.400336+0000","last_clean":"2023-11-28T11:59:46.400336+0000","last_became_active":"2023-11-28T11:59:45.335902+0000","last_became_peered":"2023-11-28T11:59:45.335902+0000","last_unstale":"2023-11-28T11:59:46.400336+0000","last_undegraded":"2023-11-28T11:59:46.400336+0000","last_fullsized":"2023-11-28T11:59:46.400336+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:27:51.533750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.318919+0000","last_change":"2023-11-28T11:59:45.319531+0000","last_active":"2023-11-28T11:59:46.318919+0000","last_peered":"2023-11-28T11:59:46.318919+0000","last_clean":"2023-11-28T11:59:46.318919+0000","last_became_active":"2023-11-28T11:59:45.319222+0000","last_became_peered":"2023-11-28T11:59:45.319222+0000","last_unstale":"2023-11-28T11:59:46.318919+0000","last_undegraded":"2023-11-28T11:59:46.318919+0000","last_fullsized":"2023-11-28T11:59:46.318919+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:59:34.845363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.319963+0000","last_change":"2023-11-28T11:59:45.326792+0000","last_active":"2023-11-28T11:59:46.319963+0000","last_peered":"2023-11-28T11:59:46.319963+0000","last_clean":"2023-11-28T11:59:46.319963+0000","last_became_active":"2023-11-28T11:59:45.326443+0000","last_became_peered":"2023-11-28T11:59:45.326443+0000","last_unstale":"2023-11-28T11:59:46.319963+0000","last_undegraded":"2023-11-28T11:59:46.319963+0000","last_fullsized":"2023-11-28T11:59:46.319963+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:54:36.933079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.336467+0000","last_change":"2023-11-28T11:59:45.329874+0000","last_active":"2023-11-28T11:59:45.336467+0000","last_peered":"2023-11-28T11:59:45.336467+0000","last_clean":"2023-11-28T11:59:45.336467+0000","last_became_active":"2023-11-28T11:59:45.328648+0000","last_became_peered":"2023-11-28T11:59:45.328648+0000","last_unstale":"2023-11-28T11:59:45.336467+0000","last_undegraded":"2023-11-28T11:59:45.336467+0000","last_fullsized":"2023-11-28T11:59:45.336467+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:53:06.623995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.343051+0000","last_change":"2023-11-28T11:59:45.336913+0000","last_active":"2023-11-28T11:59:45.343051+0000","last_peered":"2023-11-28T11:59:45.343051+0000","last_clean":"2023-11-28T11:59:45.343051+0000","last_became_active":"2023-11-28T11:59:45.336585+0000","last_became_peered":"2023-11-28T11:59:45.336585+0000","last_unstale":"2023-11-28T11:59:45.343051+0000","last_undegraded":"2023-11-28T11:59:45.343051+0000","last_fullsized":"2023-11-28T11:59:45.343051+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:07:54.133626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.318414+0000","last_change":"2023-11-28T11:59:45.331171+0000","last_active":"2023-11-28T11:59:46.318414+0000","last_peered":"2023-11-28T11:59:46.318414+0000","last_clean":"2023-11-28T11:59:46.318414+0000","last_became_active":"2023-11-28T11:59:45.330890+0000","last_became_peered":"2023-11-28T11:59:45.330890+0000","last_unstale":"2023-11-28T11:59:46.318414+0000","last_undegraded":"2023-11-28T11:59:46.318414+0000","last_fullsized":"2023-11-28T11:59:46.318414+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:21:19.901080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.340055+0000","last_change":"2023-11-28T11:59:45.328256+0000","last_active":"2023-11-28T11:59:45.340055+0000","last_peered":"2023-11-28T11:59:45.340055+0000","last_clean":"2023-11-28T11:59:45.340055+0000","last_became_active":"2023-11-28T11:59:45.327965+0000","last_became_peered":"2023-11-28T11:59:45.327965+0000","last_unstale":"2023-11-28T11:59:45.340055+0000","last_undegraded":"2023-11-28T11:59:45.340055+0000","last_fullsized":"2023-11-28T11:59:45.340055+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:26:44.696630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.318233+0000","last_change":"2023-11-28T11:59:45.319444+0000","last_active":"2023-11-28T11:59:46.318233+0000","last_peered":"2023-11-28T11:59:46.318233+0000","last_clean":"2023-11-28T11:59:46.318233+0000","last_became_active":"2023-11-28T11:59:45.318937+0000","last_became_peered":"2023-11-28T11:59:45.318937+0000","last_unstale":"2023-11-28T11:59:46.318233+0000","last_undegraded":"2023-11-28T11:59:46.318233+0000","last_fullsized":"2023-11-28T11:59:46.318233+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:46:05.333603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.342560+0000","last_change":"2023-11-28T11:59:45.334195+0000","last_active":"2023-11-28T11:59:45.342560+0000","last_peered":"2023-11-28T11:59:45.342560+0000","last_clean":"2023-11-28T11:59:45.342560+0000","last_became_active":"2023-11-28T11:59:45.333688+0000","last_became_peered":"2023-11-28T11:59:45.333688+0000","last_unstale":"2023-11-28T11:59:45.342560+0000","last_undegraded":"2023-11-28T11:59:45.342560+0000","last_fullsized":"2023-11-28T11:59:45.342560+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:12:39.748235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.343102+0000","last_change":"2023-11-28T11:59:45.339925+0000","last_active":"2023-11-28T11:59:45.343102+0000","last_peered":"2023-11-28T11:59:45.343102+0000","last_clean":"2023-11-28T11:59:45.343102+0000","last_became_active":"2023-11-28T11:59:45.339561+0000","last_became_peered":"2023-11-28T11:59:45.339561+0000","last_unstale":"2023-11-28T11:59:45.343102+0000","last_undegraded":"2023-11-28T11:59:45.343102+0000","last_fullsized":"2023-11-28T11:59:45.343102+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:08:07.726587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.400127+0000","last_change":"2023-11-28T11:59:45.313799+0000","last_active":"2023-11-28T11:59:46.400127+0000","last_peered":"2023-11-28T11:59:46.400127+0000","last_clean":"2023-11-28T11:59:46.400127+0000","last_became_active":"2023-11-28T11:59:45.313537+0000","last_became_peered":"2023-11-28T11:59:45.313537+0000","last_unstale":"2023-11-28T11:59:46.400127+0000","last_undegraded":"2023-11-28T11:59:46.400127+0000","last_fullsized":"2023-11-28T11:59:46.400127+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:43:55.064840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.339977+0000","last_change":"2023-11-28T11:59:45.333586+0000","last_active":"2023-11-28T11:59:45.339977+0000","last_peered":"2023-11-28T11:59:45.339977+0000","last_clean":"2023-11-28T11:59:45.339977+0000","last_became_active":"2023-11-28T11:59:45.332578+0000","last_became_peered":"2023-11-28T11:59:45.332578+0000","last_unstale":"2023-11-28T11:59:45.339977+0000","last_undegraded":"2023-11-28T11:59:45.339977+0000","last_fullsized":"2023-11-28T11:59:45.339977+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:03:48.634313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.339938+0000","last_change":"2023-11-28T11:59:45.334941+0000","last_active":"2023-11-28T11:59:45.339938+0000","last_peered":"2023-11-28T11:59:45.339938+0000","last_clean":"2023-11-28T11:59:45.339938+0000","last_became_active":"2023-11-28T11:59:45.334667+0000","last_became_peered":"2023-11-28T11:59:45.334667+0000","last_unstale":"2023-11-28T11:59:45.339938+0000","last_undegraded":"2023-11-28T11:59:45.339938+0000","last_fullsized":"2023-11-28T11:59:45.339938+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:35:40.695315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.339530+0000","last_change":"2023-11-28T11:59:45.329149+0000","last_active":"2023-11-28T11:59:45.339530+0000","last_peered":"2023-11-28T11:59:45.339530+0000","last_clean":"2023-11-28T11:59:45.339530+0000","last_became_active":"2023-11-28T11:59:45.328800+0000","last_became_peered":"2023-11-28T11:59:45.328800+0000","last_unstale":"2023-11-28T11:59:45.339530+0000","last_undegraded":"2023-11-28T11:59:45.339530+0000","last_fullsized":"2023-11-28T11:59:45.339530+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:47:33.772309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.338290+0000","last_change":"2023-11-28T11:59:45.328267+0000","last_active":"2023-11-28T11:59:45.338290+0000","last_peered":"2023-11-28T11:59:45.338290+0000","last_clean":"2023-11-28T11:59:45.338290+0000","last_became_active":"2023-11-28T11:59:45.327358+0000","last_became_peered":"2023-11-28T11:59:45.327358+0000","last_unstale":"2023-11-28T11:59:45.338290+0000","last_undegraded":"2023-11-28T11:59:45.338290+0000","last_fullsized":"2023-11-28T11:59:45.338290+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:43:42.520383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.335956+0000","last_change":"2023-11-28T11:59:45.323059+0000","last_active":"2023-11-28T11:59:45.335956+0000","last_peered":"2023-11-28T11:59:45.335956+0000","last_clean":"2023-11-28T11:59:45.335956+0000","last_became_active":"2023-11-28T11:59:45.322803+0000","last_became_peered":"2023-11-28T11:59:45.322803+0000","last_unstale":"2023-11-28T11:59:45.335956+0000","last_undegraded":"2023-11-28T11:59:45.335956+0000","last_fullsized":"2023-11-28T11:59:45.335956+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:34:58.375576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.342537+0000","last_change":"2023-11-28T11:59:45.333995+0000","last_active":"2023-11-28T11:59:45.342537+0000","last_peered":"2023-11-28T11:59:45.342537+0000","last_clean":"2023-11-28T11:59:45.342537+0000","last_became_active":"2023-11-28T11:59:45.333435+0000","last_became_peered":"2023-11-28T11:59:45.333435+0000","last_unstale":"2023-11-28T11:59:45.342537+0000","last_undegraded":"2023-11-28T11:59:45.342537+0000","last_fullsized":"2023-11-28T11:59:45.342537+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:34:35.412269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.329887+0000","last_change":"2023-11-28T11:59:45.324124+0000","last_active":"2023-11-28T11:59:45.329887+0000","last_peered":"2023-11-28T11:59:45.329887+0000","last_clean":"2023-11-28T11:59:45.329887+0000","last_became_active":"2023-11-28T11:59:45.323788+0000","last_became_peered":"2023-11-28T11:59:45.323788+0000","last_unstale":"2023-11-28T11:59:45.329887+0000","last_undegraded":"2023-11-28T11:59:45.329887+0000","last_fullsized":"2023-11-28T11:59:45.329887+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:56:45.470631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.318585+0000","last_change":"2023-11-28T11:59:45.328812+0000","last_active":"2023-11-28T11:59:46.318585+0000","last_peered":"2023-11-28T11:59:46.318585+0000","last_clean":"2023-11-28T11:59:46.318585+0000","last_became_active":"2023-11-28T11:59:45.325469+0000","last_became_peered":"2023-11-28T11:59:45.325469+0000","last_unstale":"2023-11-28T11:59:46.318585+0000","last_undegraded":"2023-11-28T11:59:46.318585+0000","last_fullsized":"2023-11-28T11:59:46.318585+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:46:49.485730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.332595+0000","last_change":"2023-11-28T11:59:45.330583+0000","last_active":"2023-11-28T11:59:45.332595+0000","last_peered":"2023-11-28T11:59:45.332595+0000","last_clean":"2023-11-28T11:59:45.332595+0000","last_became_active":"2023-11-28T11:59:45.330283+0000","last_became_peered":"2023-11-28T11:59:45.330283+0000","last_unstale":"2023-11-28T11:59:45.332595+0000","last_undegraded":"2023-11-28T11:59:45.332595+0000","last_fullsized":"2023-11-28T11:59:45.332595+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:13:43.025323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.340173+0000","last_change":"2023-11-28T11:59:45.329546+0000","last_active":"2023-11-28T11:59:45.340173+0000","last_peered":"2023-11-28T11:59:45.340173+0000","last_clean":"2023-11-28T11:59:45.340173+0000","last_became_active":"2023-11-28T11:59:45.329202+0000","last_became_peered":"2023-11-28T11:59:45.329202+0000","last_unstale":"2023-11-28T11:59:45.340173+0000","last_undegraded":"2023-11-28T11:59:45.340173+0000","last_fullsized":"2023-11-28T11:59:45.340173+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:16:51.575130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.340580+0000","last_change":"2023-11-28T11:59:45.330904+0000","last_active":"2023-11-28T11:59:45.340580+0000","last_peered":"2023-11-28T11:59:45.340580+0000","last_clean":"2023-11-28T11:59:45.340580+0000","last_became_active":"2023-11-28T11:59:45.330603+0000","last_became_peered":"2023-11-28T11:59:45.330603+0000","last_unstale":"2023-11-28T11:59:45.340580+0000","last_undegraded":"2023-11-28T11:59:45.340580+0000","last_fullsized":"2023-11-28T11:59:45.340580+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:37:19.019271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.399390+0000","last_change":"2023-11-28T11:59:45.324418+0000","last_active":"2023-11-28T11:59:46.399390+0000","last_peered":"2023-11-28T11:59:46.399390+0000","last_clean":"2023-11-28T11:59:46.399390+0000","last_became_active":"2023-11-28T11:59:45.323851+0000","last_became_peered":"2023-11-28T11:59:45.323851+0000","last_unstale":"2023-11-28T11:59:46.399390+0000","last_undegraded":"2023-11-28T11:59:46.399390+0000","last_fullsized":"2023-11-28T11:59:46.399390+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:18:54.010324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.399219+0000","last_change":"2023-11-28T11:59:45.326044+0000","last_active":"2023-11-28T11:59:46.399219+0000","last_peered":"2023-11-28T11:59:46.399219+0000","last_clean":"2023-11-28T11:59:46.399219+0000","last_became_active":"2023-11-28T11:59:45.325692+0000","last_became_peered":"2023-11-28T11:59:45.325692+0000","last_unstale":"2023-11-28T11:59:46.399219+0000","last_undegraded":"2023-11-28T11:59:46.399219+0000","last_fullsized":"2023-11-28T11:59:46.399219+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:30:52.764137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.336436+0000","last_change":"2023-11-28T11:59:45.325773+0000","last_active":"2023-11-28T11:59:45.336436+0000","last_peered":"2023-11-28T11:59:45.336436+0000","last_clean":"2023-11-28T11:59:45.336436+0000","last_became_active":"2023-11-28T11:59:45.322908+0000","last_became_peered":"2023-11-28T11:59:45.322908+0000","last_unstale":"2023-11-28T11:59:45.336436+0000","last_undegraded":"2023-11-28T11:59:45.336436+0000","last_fullsized":"2023-11-28T11:59:45.336436+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:56.700738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.326557+0000","last_change":"2023-11-28T11:59:45.324363+0000","last_active":"2023-11-28T11:59:45.326557+0000","last_peered":"2023-11-28T11:59:45.326557+0000","last_clean":"2023-11-28T11:59:45.326557+0000","last_became_active":"2023-11-28T11:59:45.324083+0000","last_became_peered":"2023-11-28T11:59:45.324083+0000","last_unstale":"2023-11-28T11:59:45.326557+0000","last_undegraded":"2023-11-28T11:59:45.326557+0000","last_fullsized":"2023-11-28T11:59:45.326557+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:27:51.533750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.320082+0000","last_change":"2023-11-28T11:59:45.310138+0000","last_active":"2023-11-28T11:59:46.320082+0000","last_peered":"2023-11-28T11:59:46.320082+0000","last_clean":"2023-11-28T11:59:46.320082+0000","last_became_active":"2023-11-28T11:59:45.309693+0000","last_became_peered":"2023-11-28T11:59:45.309693+0000","last_unstale":"2023-11-28T11:59:46.320082+0000","last_undegraded":"2023-11-28T11:59:46.320082+0000","last_fullsized":"2023-11-28T11:59:46.320082+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:50:16.031938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.340407+0000","last_change":"2023-11-28T11:59:45.333426+0000","last_active":"2023-11-28T11:59:45.340407+0000","last_peered":"2023-11-28T11:59:45.340407+0000","last_clean":"2023-11-28T11:59:45.340407+0000","last_became_active":"2023-11-28T11:59:45.333154+0000","last_became_peered":"2023-11-28T11:59:45.333154+0000","last_unstale":"2023-11-28T11:59:45.340407+0000","last_undegraded":"2023-11-28T11:59:45.340407+0000","last_fullsized":"2023-11-28T11:59:45.340407+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:22:46.822835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.319726+0000","last_change":"2023-11-28T11:59:45.340592+0000","last_active":"2023-11-28T11:59:46.319726+0000","last_peered":"2023-11-28T11:59:46.319726+0000","last_clean":"2023-11-28T11:59:46.319726+0000","last_became_active":"2023-11-28T11:59:45.340280+0000","last_became_peered":"2023-11-28T11:59:45.340280+0000","last_unstale":"2023-11-28T11:59:46.319726+0000","last_undegraded":"2023-11-28T11:59:46.319726+0000","last_fullsized":"2023-11-28T11:59:46.319726+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:08:58.529379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.340539+0000","last_change":"2023-11-28T11:59:45.333999+0000","last_active":"2023-11-28T11:59:45.340539+0000","last_peered":"2023-11-28T11:59:45.340539+0000","last_clean":"2023-11-28T11:59:45.340539+0000","last_became_active":"2023-11-28T11:59:45.333530+0000","last_became_peered":"2023-11-28T11:59:45.333530+0000","last_unstale":"2023-11-28T11:59:45.340539+0000","last_undegraded":"2023-11-28T11:59:45.340539+0000","last_fullsized":"2023-11-28T11:59:45.340539+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:26.480820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.340073+0000","last_change":"2023-11-28T11:59:45.333402+0000","last_active":"2023-11-28T11:59:45.340073+0000","last_peered":"2023-11-28T11:59:45.340073+0000","last_clean":"2023-11-28T11:59:45.340073+0000","last_became_active":"2023-11-28T11:59:45.333113+0000","last_became_peered":"2023-11-28T11:59:45.333113+0000","last_unstale":"2023-11-28T11:59:45.340073+0000","last_undegraded":"2023-11-28T11:59:45.340073+0000","last_fullsized":"2023-11-28T11:59:45.340073+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:09:08.152387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.318394+0000","last_change":"2023-11-28T11:59:45.319247+0000","last_active":"2023-11-28T11:59:46.318394+0000","last_peered":"2023-11-28T11:59:46.318394+0000","last_clean":"2023-11-28T11:59:46.318394+0000","last_became_active":"2023-11-28T11:59:45.318629+0000","last_became_peered":"2023-11-28T11:59:45.318629+0000","last_unstale":"2023-11-28T11:59:46.318394+0000","last_undegraded":"2023-11-28T11:59:46.318394+0000","last_fullsized":"2023-11-28T11:59:46.318394+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:09:59.189361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.400371+0000","last_change":"2023-11-28T11:59:45.326234+0000","last_active":"2023-11-28T11:59:46.400371+0000","last_peered":"2023-11-28T11:59:46.400371+0000","last_clean":"2023-11-28T11:59:46.400371+0000","last_became_active":"2023-11-28T11:59:45.325896+0000","last_became_peered":"2023-11-28T11:59:45.325896+0000","last_unstale":"2023-11-28T11:59:46.400371+0000","last_undegraded":"2023-11-28T11:59:46.400371+0000","last_fullsized":"2023-11-28T11:59:46.400371+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:34:56.589892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"69'4","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.400587+0000","last_change":"2023-11-28T11:59:44.855245+0000","last_active":"2023-11-28T11:59:46.400587+0000","last_peered":"2023-11-28T11:59:46.400587+0000","last_clean":"2023-11-28T11:59:46.400587+0000","last_became_active":"2023-11-28T11:59:44.854941+0000","last_became_peered":"2023-11-28T11:59:44.854941+0000","last_unstale":"2023-11-28T11:59:46.400587+0000","last_undegraded":"2023-11-28T11:59:46.400587+0000","last_fullsized":"2023-11-28T11:59:46.400587+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:31:48.928068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.342578+0000","last_change":"2023-11-28T11:59:45.334372+0000","last_active":"2023-11-28T11:59:45.342578+0000","last_peered":"2023-11-28T11:59:45.342578+0000","last_clean":"2023-11-28T11:59:45.342578+0000","last_became_active":"2023-11-28T11:59:45.332927+0000","last_became_peered":"2023-11-28T11:59:45.332927+0000","last_unstale":"2023-11-28T11:59:45.342578+0000","last_undegraded":"2023-11-28T11:59:45.342578+0000","last_fullsized":"2023-11-28T11:59:45.342578+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:17:11.307810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"69'1","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.333445+0000","last_change":"2023-11-28T11:59:44.854325+0000","last_active":"2023-11-28T11:59:45.333445+0000","last_peered":"2023-11-28T11:59:45.333445+0000","last_clean":"2023-11-28T11:59:45.333445+0000","last_became_active":"2023-11-28T11:59:44.853467+0000","last_became_peered":"2023-11-28T11:59:44.853467+0000","last_unstale":"2023-11-28T11:59:45.333445+0000","last_undegraded":"2023-11-28T11:59:45.333445+0000","last_fullsized":"2023-11-28T11:59:45.333445+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:55:26.505632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.318642+0000","last_change":"2023-11-28T11:59:45.321270+0000","last_active":"2023-11-28T11:59:46.318642+0000","last_peered":"2023-11-28T11:59:46.318642+0000","last_clean":"2023-11-28T11:59:46.318642+0000","last_became_active":"2023-11-28T11:59:45.320980+0000","last_became_peered":"2023-11-28T11:59:45.320980+0000","last_unstale":"2023-11-28T11:59:46.318642+0000","last_undegraded":"2023-11-28T11:59:46.318642+0000","last_fullsized":"2023-11-28T11:59:46.318642+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:33:28.030587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"69'2","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.341089+0000","last_change":"2023-11-28T11:59:44.852922+0000","last_active":"2023-11-28T11:59:45.341089+0000","last_peered":"2023-11-28T11:59:45.341089+0000","last_clean":"2023-11-28T11:59:45.341089+0000","last_became_active":"2023-11-28T11:59:44.852581+0000","last_became_peered":"2023-11-28T11:59:44.852581+0000","last_unstale":"2023-11-28T11:59:45.341089+0000","last_undegraded":"2023-11-28T11:59:45.341089+0000","last_fullsized":"2023-11-28T11:59:45.341089+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:44:50.583317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.400199+0000","last_change":"2023-11-28T11:59:45.317883+0000","last_active":"2023-11-28T11:59:46.400199+0000","last_peered":"2023-11-28T11:59:46.400199+0000","last_clean":"2023-11-28T11:59:46.400199+0000","last_became_active":"2023-11-28T11:59:45.317626+0000","last_became_peered":"2023-11-28T11:59:45.317626+0000","last_unstale":"2023-11-28T11:59:46.400199+0000","last_undegraded":"2023-11-28T11:59:46.400199+0000","last_fullsized":"2023-11-28T11:59:46.400199+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:26:44.696630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.318765+0000","last_change":"2023-11-28T11:59:44.850372+0000","last_active":"2023-11-28T11:59:46.318765+0000","last_peered":"2023-11-28T11:59:46.318765+0000","last_clean":"2023-11-28T11:59:46.318765+0000","last_became_active":"2023-11-28T11:59:44.850066+0000","last_became_peered":"2023-11-28T11:59:44.850066+0000","last_unstale":"2023-11-28T11:59:46.318765+0000","last_undegraded":"2023-11-28T11:59:46.318765+0000","last_fullsized":"2023-11-28T11:59:46.318765+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:56:44.464532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.340507+0000","last_change":"2023-11-28T11:59:45.333822+0000","last_active":"2023-11-28T11:59:45.340507+0000","last_peered":"2023-11-28T11:59:45.340507+0000","last_clean":"2023-11-28T11:59:45.340507+0000","last_became_active":"2023-11-28T11:59:45.332715+0000","last_became_peered":"2023-11-28T11:59:45.332715+0000","last_unstale":"2023-11-28T11:59:45.340507+0000","last_undegraded":"2023-11-28T11:59:45.340507+0000","last_fullsized":"2023-11-28T11:59:45.340507+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:33:52.102085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"69'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.320141+0000","last_change":"2023-11-28T11:59:44.850288+0000","last_active":"2023-11-28T11:59:46.320141+0000","last_peered":"2023-11-28T11:59:46.320141+0000","last_clean":"2023-11-28T11:59:46.320141+0000","last_became_active":"2023-11-28T11:59:44.849946+0000","last_became_peered":"2023-11-28T11:59:44.849946+0000","last_unstale":"2023-11-28T11:59:46.320141+0000","last_undegraded":"2023-11-28T11:59:46.320141+0000","last_fullsized":"2023-11-28T11:59:46.320141+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:48:14.849203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.332784+0000","last_change":"2023-11-28T11:59:45.323627+0000","last_active":"2023-11-28T11:59:45.332784+0000","last_peered":"2023-11-28T11:59:45.332784+0000","last_clean":"2023-11-28T11:59:45.332784+0000","last_became_active":"2023-11-28T11:59:45.323374+0000","last_became_peered":"2023-11-28T11:59:45.323374+0000","last_unstale":"2023-11-28T11:59:45.332784+0000","last_undegraded":"2023-11-28T11:59:45.332784+0000","last_fullsized":"2023-11-28T11:59:45.332784+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:48:15.855301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"69'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.318478+0000","last_change":"2023-11-28T11:59:44.844405+0000","last_active":"2023-11-28T11:59:46.318478+0000","last_peered":"2023-11-28T11:59:46.318478+0000","last_clean":"2023-11-28T11:59:46.318478+0000","last_became_active":"2023-11-28T11:59:44.844074+0000","last_became_peered":"2023-11-28T11:59:44.844074+0000","last_unstale":"2023-11-28T11:59:46.318478+0000","last_undegraded":"2023-11-28T11:59:46.318478+0000","last_fullsized":"2023-11-28T11:59:46.318478+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:41:36.909694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.339566+0000","last_change":"2023-11-28T11:59:45.331027+0000","last_active":"2023-11-28T11:59:45.339566+0000","last_peered":"2023-11-28T11:59:45.339566+0000","last_clean":"2023-11-28T11:59:45.339566+0000","last_became_active":"2023-11-28T11:59:45.330716+0000","last_became_peered":"2023-11-28T11:59:45.330716+0000","last_unstale":"2023-11-28T11:59:45.339566+0000","last_undegraded":"2023-11-28T11:59:45.339566+0000","last_fullsized":"2023-11-28T11:59:45.339566+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:18:10.782045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.311241+0000","last_change":"2023-11-28T11:59:44.850644+0000","last_active":"2023-11-28T11:59:45.311241+0000","last_peered":"2023-11-28T11:59:45.311241+0000","last_clean":"2023-11-28T11:59:45.311241+0000","last_became_active":"2023-11-28T11:59:44.850365+0000","last_became_peered":"2023-11-28T11:59:44.850365+0000","last_unstale":"2023-11-28T11:59:45.311241+0000","last_undegraded":"2023-11-28T11:59:45.311241+0000","last_fullsized":"2023-11-28T11:59:45.311241+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:02:17.628084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.339730+0000","last_change":"2023-11-28T11:59:45.331709+0000","last_active":"2023-11-28T11:59:45.339730+0000","last_peered":"2023-11-28T11:59:45.339730+0000","last_clean":"2023-11-28T11:59:45.339730+0000","last_became_active":"2023-11-28T11:59:45.327973+0000","last_became_peered":"2023-11-28T11:59:45.327973+0000","last_unstale":"2023-11-28T11:59:45.339730+0000","last_undegraded":"2023-11-28T11:59:45.339730+0000","last_fullsized":"2023-11-28T11:59:45.339730+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:19:14.160813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.320593+0000","last_change":"2023-11-28T11:59:44.847794+0000","last_active":"2023-11-28T11:59:45.320593+0000","last_peered":"2023-11-28T11:59:45.320593+0000","last_clean":"2023-11-28T11:59:45.320593+0000","last_became_active":"2023-11-28T11:59:44.847515+0000","last_became_peered":"2023-11-28T11:59:44.847515+0000","last_unstale":"2023-11-28T11:59:45.320593+0000","last_undegraded":"2023-11-28T11:59:45.320593+0000","last_fullsized":"2023-11-28T11:59:45.320593+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:24:58.202228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.339073+0000","last_change":"2023-11-28T11:59:45.332169+0000","last_active":"2023-11-28T11:59:45.339073+0000","last_peered":"2023-11-28T11:59:45.339073+0000","last_clean":"2023-11-28T11:59:45.339073+0000","last_became_active":"2023-11-28T11:59:45.331881+0000","last_became_peered":"2023-11-28T11:59:45.331881+0000","last_unstale":"2023-11-28T11:59:45.339073+0000","last_undegraded":"2023-11-28T11:59:45.339073+0000","last_fullsized":"2023-11-28T11:59:45.339073+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:21:04.665404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.312319+0000","last_change":"2023-11-28T11:59:44.850504+0000","last_active":"2023-11-28T11:59:45.312319+0000","last_peered":"2023-11-28T11:59:45.312319+0000","last_clean":"2023-11-28T11:59:45.312319+0000","last_became_active":"2023-11-28T11:59:44.850171+0000","last_became_peered":"2023-11-28T11:59:44.850171+0000","last_unstale":"2023-11-28T11:59:45.312319+0000","last_undegraded":"2023-11-28T11:59:45.312319+0000","last_fullsized":"2023-11-28T11:59:45.312319+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:26:43.690531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.400405+0000","last_change":"2023-11-28T11:59:45.326076+0000","last_active":"2023-11-28T11:59:46.400405+0000","last_peered":"2023-11-28T11:59:46.400405+0000","last_clean":"2023-11-28T11:59:46.400405+0000","last_became_active":"2023-11-28T11:59:45.325747+0000","last_became_peered":"2023-11-28T11:59:45.325747+0000","last_unstale":"2023-11-28T11:59:46.400405+0000","last_undegraded":"2023-11-28T11:59:46.400405+0000","last_fullsized":"2023-11-28T11:59:46.400405+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:34:58.375576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.318893+0000","last_change":"2023-11-28T11:59:44.859655+0000","last_active":"2023-11-28T11:59:46.318893+0000","last_peered":"2023-11-28T11:59:46.318893+0000","last_clean":"2023-11-28T11:59:46.318893+0000","last_became_active":"2023-11-28T11:59:44.859281+0000","last_became_peered":"2023-11-28T11:59:44.859281+0000","last_unstale":"2023-11-28T11:59:46.318893+0000","last_undegraded":"2023-11-28T11:59:46.318893+0000","last_fullsized":"2023-11-28T11:59:46.318893+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:53:05.617897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.318690+0000","last_change":"2023-11-28T11:59:45.315393+0000","last_active":"2023-11-28T11:59:46.318690+0000","last_peered":"2023-11-28T11:59:46.318690+0000","last_clean":"2023-11-28T11:59:46.318690+0000","last_became_active":"2023-11-28T11:59:45.314980+0000","last_became_peered":"2023-11-28T11:59:45.314980+0000","last_unstale":"2023-11-28T11:59:46.318690+0000","last_undegraded":"2023-11-28T11:59:46.318690+0000","last_fullsized":"2023-11-28T11:59:46.318690+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:50:46.289212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"69'3","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.320163+0000","last_change":"2023-11-28T11:59:44.859569+0000","last_active":"2023-11-28T11:59:46.320163+0000","last_peered":"2023-11-28T11:59:46.320163+0000","last_clean":"2023-11-28T11:59:46.320163+0000","last_became_active":"2023-11-28T11:59:44.859181+0000","last_became_peered":"2023-11-28T11:59:44.859181+0000","last_unstale":"2023-11-28T11:59:46.320163+0000","last_undegraded":"2023-11-28T11:59:46.320163+0000","last_fullsized":"2023-11-28T11:59:46.320163+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:16:50.569031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.339309+0000","last_change":"2023-11-28T11:59:45.327313+0000","last_active":"2023-11-28T11:59:45.339309+0000","last_peered":"2023-11-28T11:59:45.339309+0000","last_clean":"2023-11-28T11:59:45.339309+0000","last_became_active":"2023-11-28T11:59:45.327015+0000","last_became_peered":"2023-11-28T11:59:45.327015+0000","last_unstale":"2023-11-28T11:59:45.339309+0000","last_undegraded":"2023-11-28T11:59:45.339309+0000","last_fullsized":"2023-11-28T11:59:45.339309+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:32:34.061833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"69'6","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.344957+0000","last_change":"2023-11-28T11:59:44.850184+0000","last_active":"2023-11-28T11:59:45.344957+0000","last_peered":"2023-11-28T11:59:45.344957+0000","last_clean":"2023-11-28T11:59:45.344957+0000","last_became_active":"2023-11-28T11:59:44.849898+0000","last_became_peered":"2023-11-28T11:59:44.849898+0000","last_unstale":"2023-11-28T11:59:45.344957+0000","last_undegraded":"2023-11-28T11:59:45.344957+0000","last_fullsized":"2023-11-28T11:59:45.344957+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:34:36.202514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.399671+0000","last_change":"2023-11-28T11:59:45.336091+0000","last_active":"2023-11-28T11:59:46.399671+0000","last_peered":"2023-11-28T11:59:46.399671+0000","last_clean":"2023-11-28T11:59:46.399671+0000","last_became_active":"2023-11-28T11:59:45.335781+0000","last_became_peered":"2023-11-28T11:59:45.335781+0000","last_unstale":"2023-11-28T11:59:46.399671+0000","last_undegraded":"2023-11-28T11:59:46.399671+0000","last_fullsized":"2023-11-28T11:59:46.399671+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:26.480820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"69'2","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.336612+0000","last_change":"2023-11-28T11:59:44.855935+0000","last_active":"2023-11-28T11:59:45.336612+0000","last_peered":"2023-11-28T11:59:45.336612+0000","last_clean":"2023-11-28T11:59:45.336612+0000","last_became_active":"2023-11-28T11:59:44.855507+0000","last_became_peered":"2023-11-28T11:59:44.855507+0000","last_unstale":"2023-11-28T11:59:45.336612+0000","last_undegraded":"2023-11-28T11:59:45.336612+0000","last_fullsized":"2023-11-28T11:59:45.336612+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:10:08.146459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.335785+0000","last_change":"2023-11-28T11:59:45.326275+0000","last_active":"2023-11-28T11:59:45.335785+0000","last_peered":"2023-11-28T11:59:45.335785+0000","last_clean":"2023-11-28T11:59:45.335785+0000","last_became_active":"2023-11-28T11:59:45.326026+0000","last_became_peered":"2023-11-28T11:59:45.326026+0000","last_unstale":"2023-11-28T11:59:45.335785+0000","last_undegraded":"2023-11-28T11:59:45.335785+0000","last_fullsized":"2023-11-28T11:59:45.335785+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:04:05.709700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.318640+0000","last_change":"2023-11-28T11:59:44.848316+0000","last_active":"2023-11-28T11:59:46.318640+0000","last_peered":"2023-11-28T11:59:46.318640+0000","last_clean":"2023-11-28T11:59:46.318640+0000","last_became_active":"2023-11-28T11:59:44.847558+0000","last_became_peered":"2023-11-28T11:59:44.847558+0000","last_unstale":"2023-11-28T11:59:46.318640+0000","last_undegraded":"2023-11-28T11:59:46.318640+0000","last_fullsized":"2023-11-28T11:59:46.318640+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:54:13.816055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.340033+0000","last_change":"2023-11-28T11:59:45.335815+0000","last_active":"2023-11-28T11:59:45.340033+0000","last_peered":"2023-11-28T11:59:45.340033+0000","last_clean":"2023-11-28T11:59:45.340033+0000","last_became_active":"2023-11-28T11:59:45.335544+0000","last_became_peered":"2023-11-28T11:59:45.335544+0000","last_unstale":"2023-11-28T11:59:45.340033+0000","last_undegraded":"2023-11-28T11:59:45.340033+0000","last_fullsized":"2023-11-28T11:59:45.340033+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:35:33.195316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.311323+0000","last_change":"2023-11-28T11:59:44.862138+0000","last_active":"2023-11-28T11:59:45.311323+0000","last_peered":"2023-11-28T11:59:45.311323+0000","last_clean":"2023-11-28T11:59:45.311323+0000","last_became_active":"2023-11-28T11:59:44.861850+0000","last_became_peered":"2023-11-28T11:59:44.861850+0000","last_unstale":"2023-11-28T11:59:45.311323+0000","last_undegraded":"2023-11-28T11:59:45.311323+0000","last_fullsized":"2023-11-28T11:59:45.311323+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:50:45.283113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.333235+0000","last_change":"2023-11-28T11:59:45.322704+0000","last_active":"2023-11-28T11:59:45.333235+0000","last_peered":"2023-11-28T11:59:45.333235+0000","last_clean":"2023-11-28T11:59:45.333235+0000","last_became_active":"2023-11-28T11:59:45.322425+0000","last_became_peered":"2023-11-28T11:59:45.322425+0000","last_unstale":"2023-11-28T11:59:45.333235+0000","last_undegraded":"2023-11-28T11:59:45.333235+0000","last_fullsized":"2023-11-28T11:59:45.333235+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:37.744607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"69'8","reported_seq":18,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.341986+0000","last_change":"2023-11-28T11:59:44.852787+0000","last_active":"2023-11-28T11:59:45.341986+0000","last_peered":"2023-11-28T11:59:45.341986+0000","last_clean":"2023-11-28T11:59:45.341986+0000","last_became_active":"2023-11-28T11:59:44.852500+0000","last_became_peered":"2023-11-28T11:59:44.852500+0000","last_unstale":"2023-11-28T11:59:45.341986+0000","last_undegraded":"2023-11-28T11:59:45.341986+0000","last_fullsized":"2023-11-28T11:59:45.341986+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:37.132693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.339920+0000","last_change":"2023-11-28T11:59:45.334903+0000","last_active":"2023-11-28T11:59:45.339920+0000","last_peered":"2023-11-28T11:59:45.339920+0000","last_clean":"2023-11-28T11:59:45.339920+0000","last_became_active":"2023-11-28T11:59:45.334633+0000","last_became_peered":"2023-11-28T11:59:45.334633+0000","last_unstale":"2023-11-28T11:59:45.339920+0000","last_undegraded":"2023-11-28T11:59:45.339920+0000","last_fullsized":"2023-11-28T11:59:45.339920+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:58:05.663175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.318970+0000","last_change":"2023-11-28T11:59:44.852068+0000","last_active":"2023-11-28T11:59:46.318970+0000","last_peered":"2023-11-28T11:59:46.318970+0000","last_clean":"2023-11-28T11:59:46.318970+0000","last_became_active":"2023-11-28T11:59:44.851773+0000","last_became_peered":"2023-11-28T11:59:44.851773+0000","last_unstale":"2023-11-28T11:59:46.318970+0000","last_undegraded":"2023-11-28T11:59:46.318970+0000","last_fullsized":"2023-11-28T11:59:46.318970+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:06:51.207895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.336450+0000","last_change":"2023-11-28T11:59:45.328104+0000","last_active":"2023-11-28T11:59:45.336450+0000","last_peered":"2023-11-28T11:59:45.336450+0000","last_clean":"2023-11-28T11:59:45.336450+0000","last_became_active":"2023-11-28T11:59:45.327810+0000","last_became_peered":"2023-11-28T11:59:45.327810+0000","last_unstale":"2023-11-28T11:59:45.336450+0000","last_undegraded":"2023-11-28T11:59:45.336450+0000","last_fullsized":"2023-11-28T11:59:45.336450+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:10:25.194452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.312404+0000","last_change":"2023-11-28T11:59:44.858711+0000","last_active":"2023-11-28T11:59:45.312404+0000","last_peered":"2023-11-28T11:59:45.312404+0000","last_clean":"2023-11-28T11:59:45.312404+0000","last_became_active":"2023-11-28T11:59:44.858274+0000","last_became_peered":"2023-11-28T11:59:44.858274+0000","last_unstale":"2023-11-28T11:59:45.312404+0000","last_undegraded":"2023-11-28T11:59:45.312404+0000","last_fullsized":"2023-11-28T11:59:45.312404+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:48:46.966429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.399907+0000","last_change":"2023-11-28T11:59:45.326400+0000","last_active":"2023-11-28T11:59:46.399907+0000","last_peered":"2023-11-28T11:59:46.399907+0000","last_clean":"2023-11-28T11:59:46.399907+0000","last_became_active":"2023-11-28T11:59:45.324786+0000","last_became_peered":"2023-11-28T11:59:45.324786+0000","last_unstale":"2023-11-28T11:59:46.399907+0000","last_undegraded":"2023-11-28T11:59:46.399907+0000","last_fullsized":"2023-11-28T11:59:46.399907+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:21:04.665404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.321248+0000","last_change":"2023-11-28T11:59:44.853018+0000","last_active":"2023-11-28T11:59:45.321248+0000","last_peered":"2023-11-28T11:59:45.321248+0000","last_clean":"2023-11-28T11:59:45.321248+0000","last_became_active":"2023-11-28T11:59:44.851317+0000","last_became_peered":"2023-11-28T11:59:44.851317+0000","last_unstale":"2023-11-28T11:59:45.321248+0000","last_undegraded":"2023-11-28T11:59:45.321248+0000","last_fullsized":"2023-11-28T11:59:45.321248+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:37:12.464676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.400394+0000","last_change":"2023-11-28T11:59:45.336117+0000","last_active":"2023-11-28T11:59:46.400394+0000","last_peered":"2023-11-28T11:59:46.400394+0000","last_clean":"2023-11-28T11:59:46.400394+0000","last_became_active":"2023-11-28T11:59:45.335763+0000","last_became_peered":"2023-11-28T11:59:45.335763+0000","last_unstale":"2023-11-28T11:59:46.400394+0000","last_undegraded":"2023-11-28T11:59:46.400394+0000","last_fullsized":"2023-11-28T11:59:46.400394+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:33:52.102085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.308773+0000","last_change":"2023-11-28T11:59:44.853153+0000","last_active":"2023-11-28T11:59:45.308773+0000","last_peered":"2023-11-28T11:59:45.308773+0000","last_clean":"2023-11-28T11:59:45.308773+0000","last_became_active":"2023-11-28T11:59:44.852890+0000","last_became_peered":"2023-11-28T11:59:44.852890+0000","last_unstale":"2023-11-28T11:59:45.308773+0000","last_undegraded":"2023-11-28T11:59:45.308773+0000","last_fullsized":"2023-11-28T11:59:45.308773+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:57:36.489047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.342513+0000","last_change":"2023-11-28T11:59:45.332655+0000","last_active":"2023-11-28T11:59:45.342513+0000","last_peered":"2023-11-28T11:59:45.342513+0000","last_clean":"2023-11-28T11:59:45.342513+0000","last_became_active":"2023-11-28T11:59:45.332113+0000","last_became_peered":"2023-11-28T11:59:45.332113+0000","last_unstale":"2023-11-28T11:59:45.342513+0000","last_undegraded":"2023-11-28T11:59:45.342513+0000","last_fullsized":"2023-11-28T11:59:45.342513+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:06.952405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.322092+0000","last_change":"2023-11-28T11:59:44.858349+0000","last_active":"2023-11-28T11:59:45.322092+0000","last_peered":"2023-11-28T11:59:45.322092+0000","last_clean":"2023-11-28T11:59:45.322092+0000","last_became_active":"2023-11-28T11:59:44.858064+0000","last_became_peered":"2023-11-28T11:59:44.858064+0000","last_unstale":"2023-11-28T11:59:45.322092+0000","last_undegraded":"2023-11-28T11:59:45.322092+0000","last_fullsized":"2023-11-28T11:59:45.322092+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:59:42.833606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.318851+0000","last_change":"2023-11-28T11:59:45.323346+0000","last_active":"2023-11-28T11:59:46.318851+0000","last_peered":"2023-11-28T11:59:46.318851+0000","last_clean":"2023-11-28T11:59:46.318851+0000","last_became_active":"2023-11-28T11:59:45.322949+0000","last_became_peered":"2023-11-28T11:59:45.322949+0000","last_unstale":"2023-11-28T11:59:46.318851+0000","last_undegraded":"2023-11-28T11:59:46.318851+0000","last_fullsized":"2023-11-28T11:59:46.318851+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:11:25.876501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.311351+0000","last_change":"2023-11-28T11:59:44.850846+0000","last_active":"2023-11-28T11:59:45.311351+0000","last_peered":"2023-11-28T11:59:45.311351+0000","last_clean":"2023-11-28T11:59:45.311351+0000","last_became_active":"2023-11-28T11:59:44.850564+0000","last_became_peered":"2023-11-28T11:59:44.850564+0000","last_unstale":"2023-11-28T11:59:45.311351+0000","last_undegraded":"2023-11-28T11:59:45.311351+0000","last_fullsized":"2023-11-28T11:59:45.311351+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:17:44.178578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.325019+0000","last_change":"2023-11-28T11:59:45.317595+0000","last_active":"2023-11-28T11:59:45.325019+0000","last_peered":"2023-11-28T11:59:45.325019+0000","last_clean":"2023-11-28T11:59:45.325019+0000","last_became_active":"2023-11-28T11:59:45.317332+0000","last_became_peered":"2023-11-28T11:59:45.317332+0000","last_unstale":"2023-11-28T11:59:45.325019+0000","last_undegraded":"2023-11-28T11:59:45.325019+0000","last_fullsized":"2023-11-28T11:59:45.325019+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:15:48.339649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.309048+0000","last_change":"2023-11-28T11:59:44.853983+0000","last_active":"2023-11-28T11:59:45.309048+0000","last_peered":"2023-11-28T11:59:45.309048+0000","last_clean":"2023-11-28T11:59:45.309048+0000","last_became_active":"2023-11-28T11:59:44.853650+0000","last_became_peered":"2023-11-28T11:59:44.853650+0000","last_unstale":"2023-11-28T11:59:45.309048+0000","last_undegraded":"2023-11-28T11:59:45.309048+0000","last_fullsized":"2023-11-28T11:59:45.309048+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:10:24.188353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.318118+0000","last_change":"2023-11-28T11:59:45.320556+0000","last_active":"2023-11-28T11:59:46.318118+0000","last_peered":"2023-11-28T11:59:46.318118+0000","last_clean":"2023-11-28T11:59:46.318118+0000","last_became_active":"2023-11-28T11:59:45.320108+0000","last_became_peered":"2023-11-28T11:59:45.320108+0000","last_unstale":"2023-11-28T11:59:46.318118+0000","last_undegraded":"2023-11-28T11:59:46.318118+0000","last_fullsized":"2023-11-28T11:59:46.318118+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:49:23.311334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.318457+0000","last_change":"2023-11-28T11:59:44.850243+0000","last_active":"2023-11-28T11:59:46.318457+0000","last_peered":"2023-11-28T11:59:46.318457+0000","last_clean":"2023-11-28T11:59:46.318457+0000","last_became_active":"2023-11-28T11:59:44.849921+0000","last_became_peered":"2023-11-28T11:59:44.849921+0000","last_unstale":"2023-11-28T11:59:46.318457+0000","last_undegraded":"2023-11-28T11:59:46.318457+0000","last_fullsized":"2023-11-28T11:59:46.318457+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:18:27.183843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.340210+0000","last_change":"2023-11-28T11:59:45.328491+0000","last_active":"2023-11-28T11:59:45.340210+0000","last_peered":"2023-11-28T11:59:45.340210+0000","last_clean":"2023-11-28T11:59:45.340210+0000","last_became_active":"2023-11-28T11:59:45.328217+0000","last_became_peered":"2023-11-28T11:59:45.328217+0000","last_unstale":"2023-11-28T11:59:45.340210+0000","last_undegraded":"2023-11-28T11:59:45.340210+0000","last_fullsized":"2023-11-28T11:59:45.340210+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:01:12.958339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"69'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.318966+0000","last_change":"2023-11-28T11:59:44.851554+0000","last_active":"2023-11-28T11:59:46.318966+0000","last_peered":"2023-11-28T11:59:46.318966+0000","last_clean":"2023-11-28T11:59:46.318966+0000","last_became_active":"2023-11-28T11:59:44.851290+0000","last_became_peered":"2023-11-28T11:59:44.851290+0000","last_unstale":"2023-11-28T11:59:46.318966+0000","last_undegraded":"2023-11-28T11:59:46.318966+0000","last_fullsized":"2023-11-28T11:59:46.318966+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:10:23.273392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":60,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.327095+0000","last_change":"2023-11-28T11:56:34.384408+0000","last_active":"2023-11-28T11:59:45.327095+0000","last_peered":"2023-11-28T11:59:45.327095+0000","last_clean":"2023-11-28T11:59:45.327095+0000","last_became_active":"2023-11-28T11:56:34.384036+0000","last_became_peered":"2023-11-28T11:56:34.384036+0000","last_unstale":"2023-11-28T11:59:45.327095+0000","last_undegraded":"2023-11-28T11:59:45.327095+0000","last_fullsized":"2023-11-28T11:59:45.327095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:58:55.003786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.400601+0000","last_change":"2023-11-28T11:59:45.315656+0000","last_active":"2023-11-28T11:59:46.400601+0000","last_peered":"2023-11-28T11:59:46.400601+0000","last_clean":"2023-11-28T11:59:46.400601+0000","last_became_active":"2023-11-28T11:59:45.315345+0000","last_became_peered":"2023-11-28T11:59:45.315345+0000","last_unstale":"2023-11-28T11:59:46.400601+0000","last_undegraded":"2023-11-28T11:59:46.400601+0000","last_fullsized":"2023-11-28T11:59:46.400601+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:09:08.152387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"69'2","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.340259+0000","last_change":"2023-11-28T11:59:44.852912+0000","last_active":"2023-11-28T11:59:45.340259+0000","last_peered":"2023-11-28T11:59:45.340259+0000","last_clean":"2023-11-28T11:59:45.340259+0000","last_became_active":"2023-11-28T11:59:44.852619+0000","last_became_peered":"2023-11-28T11:59:44.852619+0000","last_unstale":"2023-11-28T11:59:45.340259+0000","last_undegraded":"2023-11-28T11:59:45.340259+0000","last_fullsized":"2023-11-28T11:59:45.340259+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:04:04.703601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:59:44.827702+0000","last_change":"2023-11-28T11:56:34.384088+0000","last_active":"2023-11-28T11:59:44.827702+0000","last_peered":"2023-11-28T11:59:44.827702+0000","last_clean":"2023-11-28T11:59:44.827702+0000","last_became_active":"2023-11-28T11:56:34.383631+0000","last_became_peered":"2023-11-28T11:56:34.383631+0000","last_unstale":"2023-11-28T11:59:44.827702+0000","last_undegraded":"2023-11-28T11:59:44.827702+0000","last_fullsized":"2023-11-28T11:59:44.827702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:15:42.772333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.329420+0000","last_change":"2023-11-28T11:59:45.322771+0000","last_active":"2023-11-28T11:59:45.329420+0000","last_peered":"2023-11-28T11:59:45.329420+0000","last_clean":"2023-11-28T11:59:45.329420+0000","last_became_active":"2023-11-28T11:59:45.322447+0000","last_became_peered":"2023-11-28T11:59:45.322447+0000","last_unstale":"2023-11-28T11:59:45.329420+0000","last_undegraded":"2023-11-28T11:59:45.329420+0000","last_fullsized":"2023-11-28T11:59:45.329420+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:20:16.703314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"69'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.318733+0000","last_change":"2023-11-28T11:59:44.852534+0000","last_active":"2023-11-28T11:59:46.318733+0000","last_peered":"2023-11-28T11:59:46.318733+0000","last_clean":"2023-11-28T11:59:46.318733+0000","last_became_active":"2023-11-28T11:59:44.852218+0000","last_became_peered":"2023-11-28T11:59:44.852218+0000","last_unstale":"2023-11-28T11:59:46.318733+0000","last_undegraded":"2023-11-28T11:59:46.318733+0000","last_fullsized":"2023-11-28T11:59:46.318733+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:34:36.202514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.306164+0000","last_change":"2023-11-28T11:56:34.386399+0000","last_active":"2023-11-28T11:59:45.306164+0000","last_peered":"2023-11-28T11:59:45.306164+0000","last_clean":"2023-11-28T11:59:45.306164+0000","last_became_active":"2023-11-28T11:56:34.385994+0000","last_became_peered":"2023-11-28T11:56:34.385994+0000","last_unstale":"2023-11-28T11:59:45.306164+0000","last_undegraded":"2023-11-28T11:59:45.306164+0000","last_fullsized":"2023-11-28T11:59:45.306164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:58:02.172295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.343034+0000","last_change":"2023-11-28T11:59:45.336416+0000","last_active":"2023-11-28T11:59:45.343034+0000","last_peered":"2023-11-28T11:59:45.343034+0000","last_clean":"2023-11-28T11:59:45.343034+0000","last_became_active":"2023-11-28T11:59:45.336153+0000","last_became_peered":"2023-11-28T11:59:45.336153+0000","last_unstale":"2023-11-28T11:59:45.343034+0000","last_undegraded":"2023-11-28T11:59:45.343034+0000","last_fullsized":"2023-11-28T11:59:45.343034+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:08:15.672758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.399937+0000","last_change":"2023-11-28T11:59:44.855744+0000","last_active":"2023-11-28T11:59:46.399937+0000","last_peered":"2023-11-28T11:59:46.399937+0000","last_clean":"2023-11-28T11:59:46.399937+0000","last_became_active":"2023-11-28T11:59:44.855495+0000","last_became_peered":"2023-11-28T11:59:44.855495+0000","last_unstale":"2023-11-28T11:59:46.399937+0000","last_undegraded":"2023-11-28T11:59:46.399937+0000","last_fullsized":"2023-11-28T11:59:46.399937+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:48:46.966429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:59:44.827832+0000","last_change":"2023-11-28T11:56:34.384999+0000","last_active":"2023-11-28T11:59:44.827832+0000","last_peered":"2023-11-28T11:59:44.827832+0000","last_clean":"2023-11-28T11:59:44.827832+0000","last_became_active":"2023-11-28T11:56:34.384531+0000","last_became_peered":"2023-11-28T11:56:34.384531+0000","last_unstale":"2023-11-28T11:59:44.827832+0000","last_undegraded":"2023-11-28T11:59:44.827832+0000","last_fullsized":"2023-11-28T11:59:44.827832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:09:50.083366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.320051+0000","last_change":"2023-11-28T11:59:45.314465+0000","last_active":"2023-11-28T11:59:46.320051+0000","last_peered":"2023-11-28T11:59:46.320051+0000","last_clean":"2023-11-28T11:59:46.320051+0000","last_became_active":"2023-11-28T11:59:45.314220+0000","last_became_peered":"2023-11-28T11:59:45.314220+0000","last_unstale":"2023-11-28T11:59:46.320051+0000","last_undegraded":"2023-11-28T11:59:46.320051+0000","last_fullsized":"2023-11-28T11:59:46.320051+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:59:23.102714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.318835+0000","last_change":"2023-11-28T11:59:44.843953+0000","last_active":"2023-11-28T11:59:46.318835+0000","last_peered":"2023-11-28T11:59:46.318835+0000","last_clean":"2023-11-28T11:59:46.318835+0000","last_became_active":"2023-11-28T11:59:44.843473+0000","last_became_peered":"2023-11-28T11:59:44.843473+0000","last_unstale":"2023-11-28T11:59:46.318835+0000","last_undegraded":"2023-11-28T11:59:46.318835+0000","last_fullsized":"2023-11-28T11:59:46.318835+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:06:03.287232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":50,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:59:44.844687+0000","last_change":"2023-11-28T11:56:34.389076+0000","last_active":"2023-11-28T11:59:44.844687+0000","last_peered":"2023-11-28T11:59:44.844687+0000","last_clean":"2023-11-28T11:59:44.844687+0000","last_became_active":"2023-11-28T11:56:34.388689+0000","last_became_peered":"2023-11-28T11:56:34.388689+0000","last_unstale":"2023-11-28T11:59:44.844687+0000","last_undegraded":"2023-11-28T11:59:44.844687+0000","last_fullsized":"2023-11-28T11:59:44.844687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:20.936349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.319856+0000","last_change":"2023-11-28T11:59:45.325470+0000","last_active":"2023-11-28T11:59:46.319856+0000","last_peered":"2023-11-28T11:59:46.319856+0000","last_clean":"2023-11-28T11:59:46.319856+0000","last_became_active":"2023-11-28T11:59:45.324621+0000","last_became_peered":"2023-11-28T11:59:45.324621+0000","last_unstale":"2023-11-28T11:59:46.319856+0000","last_undegraded":"2023-11-28T11:59:46.319856+0000","last_fullsized":"2023-11-28T11:59:46.319856+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:14:16.432927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.311463+0000","last_change":"2023-11-28T11:59:44.858155+0000","last_active":"2023-11-28T11:59:45.311463+0000","last_peered":"2023-11-28T11:59:45.311463+0000","last_clean":"2023-11-28T11:59:45.311463+0000","last_became_active":"2023-11-28T11:59:44.857663+0000","last_became_peered":"2023-11-28T11:59:44.857663+0000","last_unstale":"2023-11-28T11:59:45.311463+0000","last_undegraded":"2023-11-28T11:59:45.311463+0000","last_fullsized":"2023-11-28T11:59:45.311463+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:31:48.928068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:59:44.847494+0000","last_change":"2023-11-28T11:56:34.486178+0000","last_active":"2023-11-28T11:59:44.847494+0000","last_peered":"2023-11-28T11:59:44.847494+0000","last_clean":"2023-11-28T11:59:44.847494+0000","last_became_active":"2023-11-28T11:56:34.485702+0000","last_became_peered":"2023-11-28T11:56:34.485702+0000","last_unstale":"2023-11-28T11:59:44.847494+0000","last_undegraded":"2023-11-28T11:59:44.847494+0000","last_fullsized":"2023-11-28T11:59:44.847494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:06.323407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.319729+0000","last_change":"2023-11-28T11:59:45.324840+0000","last_active":"2023-11-28T11:59:46.319729+0000","last_peered":"2023-11-28T11:59:46.319729+0000","last_clean":"2023-11-28T11:59:46.319729+0000","last_became_active":"2023-11-28T11:59:45.324405+0000","last_became_peered":"2023-11-28T11:59:45.324405+0000","last_unstale":"2023-11-28T11:59:46.319729+0000","last_undegraded":"2023-11-28T11:59:46.319729+0000","last_fullsized":"2023-11-28T11:59:46.319729+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:05:17.318973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.309626+0000","last_change":"2023-11-28T11:59:44.851549+0000","last_active":"2023-11-28T11:59:45.309626+0000","last_peered":"2023-11-28T11:59:45.309626+0000","last_clean":"2023-11-28T11:59:45.309626+0000","last_became_active":"2023-11-28T11:59:44.851268+0000","last_became_peered":"2023-11-28T11:59:44.851268+0000","last_unstale":"2023-11-28T11:59:45.309626+0000","last_undegraded":"2023-11-28T11:59:45.309626+0000","last_fullsized":"2023-11-28T11:59:45.309626+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:17:43.892118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.303719+0000","last_change":"2023-11-28T11:56:34.387293+0000","last_active":"2023-11-28T11:59:45.303719+0000","last_peered":"2023-11-28T11:59:45.303719+0000","last_clean":"2023-11-28T11:59:45.303719+0000","last_became_active":"2023-11-28T11:56:34.386976+0000","last_became_peered":"2023-11-28T11:56:34.386976+0000","last_unstale":"2023-11-28T11:59:45.303719+0000","last_undegraded":"2023-11-28T11:59:45.303719+0000","last_fullsized":"2023-11-28T11:59:45.303719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:32.704729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.319888+0000","last_change":"2023-11-28T11:59:45.321506+0000","last_active":"2023-11-28T11:59:46.319888+0000","last_peered":"2023-11-28T11:59:46.319888+0000","last_clean":"2023-11-28T11:59:46.319888+0000","last_became_active":"2023-11-28T11:59:45.321281+0000","last_became_peered":"2023-11-28T11:59:45.321281+0000","last_unstale":"2023-11-28T11:59:46.319888+0000","last_undegraded":"2023-11-28T11:59:46.319888+0000","last_fullsized":"2023-11-28T11:59:46.319888+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:44.808559+0000","last_clean_scrub_stamp":"2023-11-28T11:59:44.808559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:54:05.310216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.318301+0000","last_change":"2023-11-28T11:59:44.850456+0000","last_active":"2023-11-28T11:59:46.318301+0000","last_peered":"2023-11-28T11:59:46.318301+0000","last_clean":"2023-11-28T11:59:46.318301+0000","last_became_active":"2023-11-28T11:59:44.850155+0000","last_became_peered":"2023-11-28T11:59:44.850155+0000","last_unstale":"2023-11-28T11:59:46.318301+0000","last_undegraded":"2023-11-28T11:59:46.318301+0000","last_fullsized":"2023-11-28T11:59:46.318301+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:43.802460+0000","last_clean_scrub_stamp":"2023-11-28T11:59:43.802460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:15:47.333550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":50,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:59:44.844199+0000","last_change":"2023-11-28T11:56:34.389222+0000","last_active":"2023-11-28T11:59:44.844199+0000","last_peered":"2023-11-28T11:59:44.844199+0000","last_clean":"2023-11-28T11:59:44.844199+0000","last_became_active":"2023-11-28T11:56:34.388671+0000","last_became_peered":"2023-11-28T11:56:34.388671+0000","last_unstale":"2023-11-28T11:59:44.844199+0000","last_undegraded":"2023-11-28T11:59:44.844199+0000","last_fullsized":"2023-11-28T11:59:44.844199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:32.704729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":205,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.303864+0000","last_change":"2023-11-28T11:56:28.472008+0000","last_active":"2023-11-28T11:59:45.303864+0000","last_peered":"2023-11-28T11:59:45.303864+0000","last_clean":"2023-11-28T11:59:45.303864+0000","last_became_active":"2023-11-28T11:56:28.469273+0000","last_became_peered":"2023-11-28T11:56:28.469273+0000","last_unstale":"2023-11-28T11:59:45.303864+0000","last_undegraded":"2023-11-28T11:59:45.303864+0000","last_fullsized":"2023-11-28T11:59:45.303864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:27.291192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:27.291192+0000","last_clean_scrub_stamp":"2023-11-28T11:56:27.291192+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:14:48.860420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509483,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15036,"kb_used_data":1396,"kb_used_omap":0,"kb_used_meta":13632,"kb_avail":94356804,"statfs":{"total":96636764160,"available":96621367296,"internally_reserved":0,"allocated":1429504,"data_stored":975319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13959168},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.0880000000000001,"15min":1.0960000000000001},"min":{"1min":0.77000000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4379999999999999,"5min":1.468,"15min":1.468},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.101,"5min":1.083,"15min":1.079},"min":{"1min":0.81699999999999995,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.615,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.155}]},{"osd":1,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.1950000000000001,"15min":1.204},"min":{"1min":0.83999999999999997,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.542,"5min":1.71,"15min":1.71},"last":1.028},{"interface":"front","average":{"1min":1.143,"5min":1.1659999999999999,"15min":1.177},"min":{"1min":0.79500000000000004,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.502,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.999}]},{"osd":2,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.165,"15min":1.181},"min":{"1min":0.73099999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.579,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.262},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.2629999999999999,"15min":1.2789999999999999},"min":{"1min":0.82399999999999995,"5min":0.749,"15min":0.749},"max":{"1min":1.5209999999999999,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.123}]},{"osd":3,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2869999999999999,"15min":1.3109999999999999},"min":{"1min":0.872,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.4610000000000001,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.337,"15min":1.355},"min":{"1min":1.006,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.5629999999999999,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.2030000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.244,"15min":1.294},"min":{"1min":0.90000000000000002,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.278,"15min":1.3300000000000001},"min":{"1min":0.92700000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.5129999999999999,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.0600000000000001}]},{"osd":5,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.377,"15min":1.429},"min":{"1min":0.91900000000000004,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.5549999999999999,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.353,"15min":1.391},"min":{"1min":1.145,"5min":0.872,"15min":0.872},"max":{"1min":1.603,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":1.085}]},{"osd":6,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.494,"15min":1.548},"min":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"max":{"1min":1.706,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.319,"5min":1.401,"15min":1.4470000000000001},"min":{"1min":1.0760000000000001,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.5920000000000001,"5min":2.468,"15min":2.468},"last":0.91300000000000003}]}]},{"osd":6,"up_from":15,"seq":64424509483,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9784,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94362056,"statfs":{"total":96636764160,"available":96626745344,"internally_reserved":0,"allocated":835584,"data_stored":384443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.004,"15min":0.99399999999999999},"min":{"1min":0.59899999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.5149999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.119},{"interface":"front","average":{"1min":1.044,"5min":1.1539999999999999,"15min":1.1899999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.5049999999999999,"5min":2.347,"15min":2.347},"last":0.83399999999999996}]},{"osd":1,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1699999999999999,"15min":1.1739999999999999},"min":{"1min":0.79900000000000004,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.137,"5min":1.157,"15min":1.171},"min":{"1min":0.72699999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.454,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":1.212}]},{"osd":2,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.198,"15min":1.242},"min":{"1min":0.754,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4410000000000001,"5min":3.9620000000000002,"15min":3.9620000000000002},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1639999999999999,"15min":1.1679999999999999},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.01}]},{"osd":3,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.258,"15min":1.26},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.496,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.258,"15min":1.268},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.5209999999999999,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.042}]},{"osd":4,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.2050000000000001,"15min":1.232},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.4179999999999999,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.4159999999999999,"15min":1.4670000000000001},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.8540000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.1619999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.2250000000000001,"15min":1.266},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.091},{"interface":"front","average":{"1min":1.175,"5min":1.244,"15min":1.27},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.98799999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.3200000000000001,"15min":1.3360000000000001},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.343,"15min":1.355},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.978,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.1879999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509483,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9652,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":8832,"kb_avail":94362188,"statfs":{"total":96636764160,"available":96626880512,"internally_reserved":0,"allocated":831488,"data_stored":384441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9043968},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.0840000000000001,"15min":1.089},"min":{"1min":0.73899999999999999,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.3500000000000001,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.0900000000000001,"15min":1.0820000000000001},"min":{"1min":0.90400000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.359,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.97699999999999998}]},{"osd":1,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1479999999999999,"15min":1.1519999999999999},"min":{"1min":0.77500000000000002,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.48,"5min":1.843,"15min":1.843},"last":1.036},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.0920000000000001,"15min":1.0900000000000001},"min":{"1min":0.77300000000000002,"5min":0.752,"15min":0.752},"max":{"1min":1.4870000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.3680000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.171,"15min":1.167},"min":{"1min":0.77600000000000002,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.1930000000000001,"15min":1.198},"min":{"1min":0.86899999999999999,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.4990000000000001,"5min":1.79,"15min":1.79},"last":1.242}]},{"osd":3,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.252,"15min":1.2729999999999999},"min":{"1min":0.84099999999999997,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.5649999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.353,"5min":1.365,"15min":1.3919999999999999},"min":{"1min":1.0069999999999999,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.712,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.3180000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.1739999999999999,"15min":1.2090000000000001},"min":{"1min":0.77900000000000003,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.431,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.5469999999999999},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.228,"15min":1.234},"min":{"1min":0.876,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.4770000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.0900000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.2689999999999999,"15min":1.276},"min":{"1min":0.91800000000000004,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.6259999999999999,"5min":1.732,"15min":1.732},"last":1.419},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.2829999999999999,"15min":1.2849999999999999},"min":{"1min":0.99399999999999999,"5min":0.874,"15min":0.874},"max":{"1min":1.4550000000000001,"5min":1.704,"15min":1.704},"last":1.4490000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3520000000000001,"15min":1.3620000000000001},"min":{"1min":0.97499999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.6859999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.446,"15min":1.472},"min":{"1min":1.05,"5min":1.002,"15min":1.002},"max":{"1min":1.762,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.512}]}]},{"osd":4,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9972,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":9152,"kb_avail":94361868,"statfs":{"total":96636764160,"available":96626552832,"internally_reserved":0,"allocated":831488,"data_stored":384421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9371648},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.109,"15min":1.1100000000000001},"min":{"1min":0.76100000000000001,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5429999999999999,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.1279999999999999,"15min":1.1519999999999999},"min":{"1min":0.71699999999999997,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.554,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.1890000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.173,"15min":1.2090000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.496,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.171,"5min":1.1819999999999999,"15min":1.202},"min":{"1min":0.70999999999999996,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.7190000000000001,"5min":2.8860000000000001,"15min":2.8860000000000001},"last":1.371}]},{"osd":2,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.208,"15min":1.238},"min":{"1min":0.81999999999999995,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.589,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.143},{"interface":"front","average":{"1min":1.236,"5min":1.3520000000000001,"15min":1.403},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.5389999999999999,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":1.504}]},{"osd":3,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.282,"15min":1.3160000000000001},"min":{"1min":0.89700000000000002,"5min":0.746,"15min":0.746},"max":{"1min":1.4790000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3560000000000001,"15min":1.3740000000000001},"min":{"1min":1.004,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.877,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.0109999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.3640000000000001,"15min":1.431},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.0139999999999998,"5min":2.972,"15min":2.972},"last":1.226},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.296,"15min":1.353},"min":{"1min":0.78600000000000003,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.2389999999999999,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.323}]},{"osd":6,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3580000000000001,"15min":1.4059999999999999},"min":{"1min":0.96699999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.919,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.3},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.49,"15min":1.542},"min":{"1min":1.0189999999999999,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":2.0790000000000002,"5min":3.133,"15min":3.133},"last":1.4550000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.4570000000000001,"15min":1.5169999999999999},"min":{"1min":0.95199999999999996,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.992,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.474,"5min":1.5369999999999999,"15min":1.5880000000000001},"min":{"1min":1.145,"5min":1.0760000000000001,"15min":1.0760000000000001},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.413}]}]},{"osd":3,"up_from":15,"seq":64424509483,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14020,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":13184,"kb_avail":94357820,"statfs":{"total":96636764160,"available":96622407680,"internally_reserved":0,"allocated":847872,"data_stored":391436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13500416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.82999999999999996,"15min":0.84199999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.292,"5min":1.478,"15min":1.478},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.91900000000000004,"15min":0.91800000000000004},"min":{"1min":0.64200000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.276,"5min":2.177,"15min":2.177},"last":0.93000000000000005}]},{"osd":1,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.86699999999999999,"15min":0.86599999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.468,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.01},{"interface":"front","average":{"1min":1.006,"5min":1.044,"15min":1.0600000000000001},"min":{"1min":0.59099999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4179999999999999,"5min":1.968,"15min":1.968},"last":1.1679999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.109,"15min":1.139},"min":{"1min":0.63700000000000001,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.548,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.171,"15min":1.2070000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.5389999999999999,"5min":2.093,"15min":2.093},"last":1.27}]},{"osd":4,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.1719999999999999,"15min":1.1779999999999999},"min":{"1min":0.84199999999999997,"5min":0.75,"15min":0.75},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":1.5369999999999999},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.294,"15min":1.3320000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.837,"5min":2.8439999999999999,"15min":2.8439999999999999},"last":1.2230000000000001}]},{"osd":5,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.325,"15min":1.359},"min":{"1min":0.85699999999999998,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.6040000000000001,"5min":2.9670000000000001,"15min":2.9670000000000001},"last":1.821},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3999999999999999,"15min":1.444},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.655,"5min":3.7429999999999999,"15min":3.7429999999999999},"last":1.5649999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3360000000000001,"15min":1.3520000000000001},"min":{"1min":0.91700000000000004,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.077,"5min":2.323,"15min":2.323},"last":1.6559999999999999},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.407,"15min":1.444},"min":{"1min":0.93899999999999995,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.7210000000000001,"5min":2.927,"15min":2.927},"last":1.873}]},{"osd":7,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.4570000000000001,"15min":1.498},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.794,"5min":3.5030000000000001,"15min":3.5030000000000001},"last":1.7110000000000001},{"interface":"front","average":{"1min":1.369,"5min":1.4430000000000001,"15min":1.4750000000000001},"min":{"1min":1.0720000000000001,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.1549999999999998,"5min":2.6320000000000001,"15min":2.6320000000000001},"last":1.603}]}]},{"osd":1,"up_from":15,"seq":64424509483,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9732,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362108,"statfs":{"total":96636764160,"available":96626798592,"internally_reserved":0,"allocated":847872,"data_stored":386499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.89300000000000002,"15min":0.93400000000000005},"min":{"1min":0.495,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.3919999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.018,"15min":1.0089999999999999},"min":{"1min":0.67700000000000005,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.5429999999999999,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.67100000000000004}]},{"osd":2,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.069,"15min":1.083},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.6160000000000001,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0860000000000001,"15min":1.1000000000000001},"min":{"1min":0.72599999999999998,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.7769999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.84199999999999997}]},{"osd":3,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.1859999999999999,"15min":1.2030000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.635,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.103,"5min":1.1339999999999999,"15min":1.171},"min":{"1min":0.65600000000000003,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.4670000000000001,"5min":1.8,"15min":1.8},"last":0.78000000000000003}]},{"osd":4,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.353,"15min":1.3720000000000001},"min":{"1min":1.002,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.6890000000000001,"5min":3.411,"15min":3.411},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.3009999999999999,"15min":1.339},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.7969999999999999,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":1.214}]},{"osd":5,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.3799999999999999,"15min":1.423},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.9039999999999999,"5min":3.6869999999999998,"15min":3.6869999999999998},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.284,"5min":1.306,"15min":1.3260000000000001},"min":{"1min":0.97699999999999998,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.736,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.1819999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.4239999999999999,"15min":1.4550000000000001},"min":{"1min":0.99399999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.8899999999999999,"5min":3.5379999999999998,"15min":3.5379999999999998},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.4470000000000001,"15min":1.49},"min":{"1min":0.84099999999999997,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.0259999999999998,"5min":2.5739999999999998,"15min":2.5739999999999998},"last":1.413}]},{"osd":7,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.4510000000000001,"15min":1.4770000000000001},"min":{"1min":1.1040000000000001,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.9490000000000001,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.492,"15min":1.52},"min":{"1min":1.1870000000000001,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.986,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.335}]}]},{"osd":2,"up_from":14,"seq":60129542187,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9508,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362332,"statfs":{"total":96636764160,"available":96627027968,"internally_reserved":0,"allocated":815104,"data_stored":376903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:27 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85499999999999998,"15min":0.86699999999999999},"min":{"1min":0.59999999999999998,"5min":0.497,"15min":0.497},"max":{"1min":1.28,"5min":1.722,"15min":1.722},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.98199999999999998,"15min":1.002},"min":{"1min":0.55800000000000005,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.389,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":0.76800000000000002}]},{"osd":1,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.01,"15min":1.028},"min":{"1min":0.58699999999999997,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.276,"5min":1.754,"15min":1.754},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.92800000000000005,"15min":0.93999999999999995},"min":{"1min":0.627,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2729999999999999,"5min":1.484,"15min":1.484},"last":0.871}]},{"osd":3,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.105,"15min":1.127},"min":{"1min":0.74299999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.5109999999999999,"5min":2.048,"15min":2.048},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.214,"5min":1.2629999999999999,"15min":1.2869999999999999},"min":{"1min":0.81399999999999995,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.6699999999999999,"5min":2.617,"15min":2.617},"last":1.288}]},{"osd":4,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3460000000000001,"15min":1.3799999999999999},"min":{"1min":1.0580000000000001,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.6619999999999999,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2370000000000001,"15min":1.2509999999999999},"min":{"1min":0.86199999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.6830000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":1.248}]},{"osd":5,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.3129999999999999,"15min":1.343},"min":{"1min":0.93999999999999995,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.6759999999999999,"5min":2.738,"15min":2.738},"last":1.345},{"interface":"front","average":{"1min":1.288,"5min":1.4570000000000001,"15min":1.5349999999999999},"min":{"1min":0.92100000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.7350000000000001,"5min":4.0309999999999997,"15min":4.0309999999999997},"last":1.3260000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.5289999999999999,"15min":1.593},"min":{"1min":1.0529999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.8,"5min":4.2240000000000002,"15min":4.2240000000000002},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.363,"5min":1.4770000000000001,"15min":1.534},"min":{"1min":1.0600000000000001,"5min":0.755,"15min":0.755},"max":{"1min":1.7430000000000001,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":1.1319999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.413,"15min":1.4490000000000001},"min":{"1min":0.90200000000000002,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.776,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.153},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.591,"15min":1.653},"min":{"1min":1.01,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.8460000000000001,"5min":4.3570000000000002,"15min":4.3570000000000002},"last":1.4019999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542187,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10980,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":94360860,"statfs":{"total":96636764160,"available":96625520640,"internally_reserved":0,"allocated":1404928,"data_stored":966352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.85999999999999999,"15min":0.875},"min":{"1min":0.54500000000000004,"5min":0.439,"15min":0.439},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.997,"5min":0.99299999999999999,"15min":1.0089999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.5569999999999999,"5min":1.7,"15min":1.7},"last":0.81999999999999995}]},{"osd":2,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":1.0109999999999999,"15min":1.0409999999999999},"min":{"1min":0.61899999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2929999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.91800000000000004,"15min":0.92200000000000004},"min":{"1min":0.59399999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.444,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.872}]},{"osd":3,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.046,"15min":1.0700000000000001},"min":{"1min":0.68000000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.5940000000000001,"5min":1.645,"15min":1.645},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.093,"5min":1.208,"15min":1.2310000000000001},"min":{"1min":0.77100000000000002,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.403,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.341}]},{"osd":4,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.294,"15min":1.3320000000000001},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.5,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.149,"5min":1.3240000000000001,"15min":1.383},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.3899999999999999,"5min":3.1629999999999998,"15min":3.1629999999999998},"last":1.3049999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.331,"15min":1.353},"min":{"1min":0.91300000000000003,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.583,"5min":2.23,"15min":2.23},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.363,"15min":1.407},"min":{"1min":0.97199999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.494,"5min":2.266,"15min":2.266},"last":1.1919999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.4530000000000001,"15min":1.5009999999999999},"min":{"1min":0.99299999999999999,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.7629999999999999,"5min":2.4060000000000001,"15min":2.4060000000000001},"last":1.115},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.4470000000000001,"15min":1.488},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.752,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":1.1339999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.4810000000000001,"15min":1.5109999999999999},"min":{"1min":1.0800000000000001,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.869,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.411},{"interface":"front","average":{"1min":1.331,"5min":1.5029999999999999,"15min":1.556},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":1.663,"5min":2.6040000000000001,"15min":2.6040000000000001},"last":1.27}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:59:50.202 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T11:59:50.202 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2023-11-28T11:59:50.424 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.418+0000 7fdf2dd97700 1 Processor -- start 2023-11-28T11:59:50.424 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.418+0000 7fdf2dd97700 1 -- start start 2023-11-28T11:59:50.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.422+0000 7fdf2dd97700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fdf280b1260 0x7fdf280b1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:50.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.422+0000 7fdf2dd97700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fdf280c9ea0 0x7fdf280ca300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:50.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.422+0000 7fdf2dd97700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf280cabd0 con 0x7fdf2815c8e0 2023-11-28T11:59:50.429 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.422+0000 7fdf2dd97700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf280cb190 con 0x7fdf280b1260 2023-11-28T11:59:50.429 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.422+0000 7fdf2dd97700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf280b1c40 con 0x7fdf280c9ea0 2023-11-28T11:59:50.429 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.422+0000 7fdf27fff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fdf280b1260 0x7fdf280b1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:50.429 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.422+0000 7fdf2cd95700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fdf2815c8e0 0x7fdf2806a040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:47876/0 (socket says 172.21.15.39:47876) 2023-11-28T11:59:50.429 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.422+0000 7fdf2cd95700 1 -- 172.21.15.39:0/1219229799 learned_addr learned my addr 172.21.15.39:0/1219229799 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:59:50.429 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.422+0000 7fdf2d596700 1 --2- 172.21.15.39:0/1219229799 >> v2:172.21.15.184:3300/0 conn(0x7fdf280c9ea0 0x7fdf280ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:50.432 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.426+0000 7fdf277fe700 1 -- 172.21.15.39:0/1219229799 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 544675893 0 0) 0x7fdf280cabd0 con 0x7fdf2815c8e0 2023-11-28T11:59:50.432 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.426+0000 7fdf277fe700 1 -- 172.21.15.39:0/1219229799 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf180035d0 con 0x7fdf2815c8e0 2023-11-28T11:59:50.432 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.426+0000 7fdf27fff700 1 -- 172.21.15.39:0/1219229799 >> v2:172.21.15.184:3300/0 conn(0x7fdf280c9ea0 msgr2=0x7fdf280ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:50.432 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.426+0000 7fdf27fff700 1 --2- 172.21.15.39:0/1219229799 >> v2:172.21.15.184:3300/0 conn(0x7fdf280c9ea0 0x7fdf280ca300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:50.432 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.426+0000 7fdf27fff700 1 -- 172.21.15.39:0/1219229799 >> v1:172.21.15.184:6789/0 conn(0x7fdf2815c8e0 legacy=0x7fdf2806a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:50.433 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.426+0000 7fdf27fff700 1 -- 172.21.15.39:0/1219229799 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf280caeb0 con 0x7fdf280b1260 2023-11-28T11:59:50.433 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.426+0000 7fdf27fff700 1 --2- 172.21.15.39:0/1219229799 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf280b1260 0x7fdf280b1700 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fdf28072240 tx=0x7fdf14009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f661340af5be397 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:50.433 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.426+0000 7fdf277fe700 1 -- 172.21.15.39:0/1219229799 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf14011830 con 0x7fdf280b1260 2023-11-28T11:59:50.433 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.426+0000 7fdf277fe700 1 -- 172.21.15.39:0/1219229799 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf14011990 con 0x7fdf280b1260 2023-11-28T11:59:50.433 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.426+0000 7fdf277fe700 1 -- 172.21.15.39:0/1219229799 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf14011d20 con 0x7fdf280b1260 2023-11-28T11:59:50.433 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.426+0000 7fdf2dd97700 1 -- 172.21.15.39:0/1219229799 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf280b1260 msgr2=0x7fdf280b1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:50.433 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.426+0000 7fdf2dd97700 1 --2- 172.21.15.39:0/1219229799 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf280b1260 0x7fdf280b1700 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fdf28072240 tx=0x7fdf14009b60 comp rx=0 tx=0).stop 2023-11-28T11:59:50.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.426+0000 7fdf2dd97700 1 -- 172.21.15.39:0/1219229799 shutdown_connections 2023-11-28T11:59:50.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.426+0000 7fdf2dd97700 1 --2- 172.21.15.39:0/1219229799 >> v2:172.21.15.184:3300/0 conn(0x7fdf280c9ea0 0x7fdf280ca300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:50.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.426+0000 7fdf2dd97700 1 --2- 172.21.15.39:0/1219229799 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf280b1260 0x7fdf280b1700 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:50.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.426+0000 7fdf2dd97700 1 -- 172.21.15.39:0/1219229799 >> 172.21.15.39:0/1219229799 conn(0x7fdf280cc260 msgr2=0x7fdf280cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:50.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.426+0000 7fdf2dd97700 1 -- 172.21.15.39:0/1219229799 shutdown_connections 2023-11-28T11:59:50.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.426+0000 7fdf2dd97700 1 -- 172.21.15.39:0/1219229799 wait complete. 2023-11-28T11:59:50.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.430+0000 7fdf2dd97700 1 Processor -- start 2023-11-28T11:59:50.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.430+0000 7fdf2dd97700 1 -- start start 2023-11-28T11:59:50.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.434+0000 7fdf2dd97700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf280b1260 0x7fdf2815aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:50.439 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.434+0000 7fdf2dd97700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf280c9ea0 0x7fdf280af7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:50.439 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.434+0000 7fdf2dd97700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf2815c8e0 0x7fdf280c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:50.439 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.434+0000 7fdf2dd97700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2815efa0 con 0x7fdf2815c8e0 2023-11-28T11:59:50.439 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.434+0000 7fdf2dd97700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf280c9370 con 0x7fdf280c9ea0 2023-11-28T11:59:50.439 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.434+0000 7fdf2dd97700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2815e320 con 0x7fdf280b1260 2023-11-28T11:59:50.439 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.434+0000 7fdf2cd95700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf280b1260 0x7fdf2815aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:50.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.434+0000 7fdf27fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf280c9ea0 0x7fdf280af7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:50.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.434+0000 7fdf27fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf280c9ea0 0x7fdf280af7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:57072/0 (socket says 172.21.15.39:57072) 2023-11-28T11:59:50.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.434+0000 7fdf27fff700 1 -- 172.21.15.39:0/1796079389 learned_addr learned my addr 172.21.15.39:0/1796079389 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:50.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.434+0000 7fdf2d596700 1 --2- 172.21.15.39:0/1796079389 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf2815c8e0 0x7fdf280c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:50.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.434+0000 7fdf27fff700 1 -- 172.21.15.39:0/1796079389 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf280b1260 msgr2=0x7fdf2815aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:50.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.434+0000 7fdf27fff700 1 --2- 172.21.15.39:0/1796079389 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf280b1260 0x7fdf2815aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:50.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.434+0000 7fdf27fff700 1 -- 172.21.15.39:0/1796079389 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf2815c8e0 msgr2=0x7fdf280c7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:50.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.434+0000 7fdf27fff700 1 --2- 172.21.15.39:0/1796079389 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf2815c8e0 0x7fdf280c7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:50.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.434+0000 7fdf27fff700 1 -- 172.21.15.39:0/1796079389 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf140094b0 con 0x7fdf280c9ea0 2023-11-28T11:59:50.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.434+0000 7fdf27fff700 1 --2- 172.21.15.39:0/1796079389 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf280c9ea0 0x7fdf280af7e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fdf140090b0 tx=0x7fdf14004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:50.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.434+0000 7fdf257fa700 1 -- 172.21.15.39:0/1796079389 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf14004400 con 0x7fdf280c9ea0 2023-11-28T11:59:50.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.434+0000 7fdf257fa700 1 -- 172.21.15.39:0/1796079389 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1401f070 con 0x7fdf280c9ea0 2023-11-28T11:59:50.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.434+0000 7fdf257fa700 1 -- 172.21.15.39:0/1796079389 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf140036c0 con 0x7fdf280c9ea0 2023-11-28T11:59:50.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.434+0000 7fdf2dd97700 1 -- 172.21.15.39:0/1796079389 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf280ce150 con 0x7fdf280c9ea0 2023-11-28T11:59:50.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.438+0000 7fdf2dd97700 1 -- 172.21.15.39:0/1796079389 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf280cde70 con 0x7fdf280c9ea0 2023-11-28T11:59:50.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.438+0000 7fdf2dd97700 1 -- 172.21.15.39:0/1796079389 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf2815ccb0 con 0x7fdf280c9ea0 2023-11-28T11:59:50.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.438+0000 7fdf257fa700 1 -- 172.21.15.39:0/1796079389 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdf1402a020 con 0x7fdf280c9ea0 2023-11-28T11:59:50.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.442+0000 7fdf257fa700 1 --2- 172.21.15.39:0/1796079389 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fdf0c064ee0 0x7fdf0c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:50.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.442+0000 7fdf257fa700 1 -- 172.21.15.39:0/1796079389 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fdf140834f0 con 0x7fdf280c9ea0 2023-11-28T11:59:50.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.442+0000 7fdf2cd95700 1 --2- 172.21.15.39:0/1796079389 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fdf0c064ee0 0x7fdf0c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:50.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.442+0000 7fdf2cd95700 1 --2- 172.21.15.39:0/1796079389 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fdf0c064ee0 0x7fdf0c067390 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c007fd0 tx=0x7fdf1c007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:50.452 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.446+0000 7fdf257fa700 1 -- 172.21.15.39:0/1796079389 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdf14051460 con 0x7fdf280c9ea0 2023-11-28T11:59:50.691 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.686+0000 7fdf2dd97700 1 -- 172.21.15.39:0/1796079389 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7fdf28073cb0 con 0x7fdf280c9ea0 2023-11-28T11:59:50.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.702+0000 7fdf257fa700 1 -- 172.21.15.39:0/1796079389 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 184+0+0 (secure 0 0 0) 0x7fdf14054a80 con 0x7fdf280c9ea0 2023-11-28T11:59:50.709 INFO:tasks.ceph.mds.c.smithi039.stderr:2023-11-28T11:59:50.706+0000 7ffa4bf34700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T11:59:50.709 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.706+0000 7fdf2dd97700 1 -- 172.21.15.39:0/1796079389 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fdf0c064ee0 msgr2=0x7fdf0c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:50.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.706+0000 7fdf2dd97700 1 --2- 172.21.15.39:0/1796079389 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fdf0c064ee0 0x7fdf0c067390 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c007fd0 tx=0x7fdf1c007de0 comp rx=0 tx=0).stop 2023-11-28T11:59:50.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.706+0000 7fdf2dd97700 1 -- 172.21.15.39:0/1796079389 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf280c9ea0 msgr2=0x7fdf280af7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:50.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.706+0000 7fdf2dd97700 1 --2- 172.21.15.39:0/1796079389 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf280c9ea0 0x7fdf280af7e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fdf140090b0 tx=0x7fdf14004770 comp rx=0 tx=0).stop 2023-11-28T11:59:50.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.706+0000 7fdf2dd97700 1 -- 172.21.15.39:0/1796079389 shutdown_connections 2023-11-28T11:59:50.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.706+0000 7fdf2dd97700 1 --2- 172.21.15.39:0/1796079389 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf2815c8e0 0x7fdf280c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:50.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.706+0000 7fdf2dd97700 1 --2- 172.21.15.39:0/1796079389 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fdf0c064ee0 0x7fdf0c067390 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:50.711 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.706+0000 7fdf2dd97700 1 --2- 172.21.15.39:0/1796079389 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf280c9ea0 0x7fdf280af7e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:50.711 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.706+0000 7fdf2dd97700 1 --2- 172.21.15.39:0/1796079389 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf280b1260 0x7fdf2815aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:50.711 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.706+0000 7fdf2dd97700 1 -- 172.21.15.39:0/1796079389 >> 172.21.15.39:0/1796079389 conn(0x7fdf280cc260 msgr2=0x7fdf280b07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:50.711 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.706+0000 7fdf2dd97700 1 -- 172.21.15.39:0/1796079389 shutdown_connections 2023-11-28T11:59:50.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.706+0000 7fdf2dd97700 1 -- 172.21.15.39:0/1796079389 wait complete. 2023-11-28T11:59:50.713 INFO:teuthology.orchestra.run.smithi039.stderr:updated caps for client.0 2023-11-28T11:59:50.736 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:59:50.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.906+0000 7f423235d700 1 Processor -- start 2023-11-28T11:59:50.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.906+0000 7f423235d700 1 -- start start 2023-11-28T11:59:50.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.906+0000 7f423235d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f422c071aa0 0x7f422c06d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:50.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.906+0000 7f423235d700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f422c06c600 con 0x7f422c069e00 2023-11-28T11:59:50.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.906+0000 7f423235d700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f422c0722f0 con 0x7f422c15c640 2023-11-28T11:59:50.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.906+0000 7f423235d700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f422c06cef0 con 0x7f422c071aa0 2023-11-28T11:59:50.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.906+0000 7f4231b5c700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f422c069e00 0x7f422c0d0580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42296/0 (socket says 172.21.15.39:42296) 2023-11-28T11:59:50.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.906+0000 7f4231b5c700 1 -- 172.21.15.39:0/1250922764 learned_addr learned my addr 172.21.15.39:0/1250922764 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:59:50.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.906+0000 7f4230b5a700 1 --2- 172.21.15.39:0/1250922764 >> v2:172.21.15.184:3300/0 conn(0x7f422c071aa0 0x7f422c06d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:50.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.910+0000 7f4223fff700 1 -- 172.21.15.39:0/1250922764 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4212326483 0 0) 0x7f422c06c600 con 0x7f422c069e00 2023-11-28T11:59:50.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.910+0000 7f4230b5a700 1 -- 172.21.15.39:0/1250922764 >> v1:172.21.15.184:6789/0 conn(0x7f422c15c640 legacy=0x7f422c0d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:50.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.910+0000 7f4230b5a700 1 -- 172.21.15.39:0/1250922764 >> v1:172.21.15.39:6789/0 conn(0x7f422c069e00 legacy=0x7f422c0d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:50.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.910+0000 7f4230b5a700 1 -- 172.21.15.39:0/1250922764 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422c15ca10 con 0x7f422c071aa0 2023-11-28T11:59:50.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.910+0000 7f4230b5a700 1 --2- 172.21.15.39:0/1250922764 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f422c071aa0 0x7f422c06d310 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f421c009850 tx=0x7f421c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a03db195e3cb464 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:50.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.910+0000 7f4223fff700 1 -- 172.21.15.39:0/1250922764 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c011830 con 0x7f422c071aa0 2023-11-28T11:59:50.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.910+0000 7f4223fff700 1 -- 172.21.15.39:0/1250922764 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421c011990 con 0x7f422c071aa0 2023-11-28T11:59:50.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.910+0000 7f4223fff700 1 -- 172.21.15.39:0/1250922764 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c011d20 con 0x7f422c071aa0 2023-11-28T11:59:50.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.910+0000 7f423235d700 1 -- 172.21.15.39:0/1250922764 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f422c071aa0 msgr2=0x7f422c06d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:50.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.910+0000 7f423235d700 1 --2- 172.21.15.39:0/1250922764 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f422c071aa0 0x7f422c06d310 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f421c009850 tx=0x7f421c009b60 comp rx=0 tx=0).stop 2023-11-28T11:59:50.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.910+0000 7f423235d700 1 -- 172.21.15.39:0/1250922764 shutdown_connections 2023-11-28T11:59:50.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.910+0000 7f423235d700 1 --2- 172.21.15.39:0/1250922764 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f422c071aa0 0x7f422c06d310 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:50.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.910+0000 7f423235d700 1 -- 172.21.15.39:0/1250922764 >> 172.21.15.39:0/1250922764 conn(0x7f422c0b6520 msgr2=0x7f422c071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:50.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.910+0000 7f423235d700 1 -- 172.21.15.39:0/1250922764 shutdown_connections 2023-11-28T11:59:50.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.910+0000 7f423235d700 1 -- 172.21.15.39:0/1250922764 wait complete. 2023-11-28T11:59:50.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.914+0000 7f423235d700 1 Processor -- start 2023-11-28T11:59:50.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.914+0000 7f423235d700 1 -- start start 2023-11-28T11:59:50.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.914+0000 7f423235d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f422c069e00 0x7f422c0caa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:50.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.914+0000 7f423235d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f422c071aa0 0x7f422c0cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:50.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.914+0000 7f423235d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f422c15c640 0x7f422c1f4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:50.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.914+0000 7f423235d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422c0d38f0 con 0x7f422c15c640 2023-11-28T11:59:50.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.914+0000 7f423235d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422c0cbe90 con 0x7f422c071aa0 2023-11-28T11:59:50.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.914+0000 7f423235d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f422c0caf60 con 0x7f422c069e00 2023-11-28T11:59:50.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.914+0000 7f4231b5c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f422c15c640 0x7f422c1f4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:50.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.918+0000 7f4231b5c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f422c15c640 0x7f422c1f4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38472/0 (socket says 172.21.15.39:38472) 2023-11-28T11:59:50.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.918+0000 7f4231b5c700 1 -- 172.21.15.39:0/762990002 learned_addr learned my addr 172.21.15.39:0/762990002 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:50.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.918+0000 7f423135b700 1 --2- 172.21.15.39:0/762990002 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f422c069e00 0x7f422c0caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:50.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.918+0000 7f4230b5a700 1 --2- 172.21.15.39:0/762990002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f422c071aa0 0x7f422c0cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:50.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.918+0000 7f4231b5c700 1 -- 172.21.15.39:0/762990002 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f422c069e00 msgr2=0x7f422c0caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:50.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.918+0000 7f4231b5c700 1 --2- 172.21.15.39:0/762990002 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f422c069e00 0x7f422c0caa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:50.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.918+0000 7f4231b5c700 1 -- 172.21.15.39:0/762990002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f422c071aa0 msgr2=0x7f422c0cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:50.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.918+0000 7f4231b5c700 1 --2- 172.21.15.39:0/762990002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f422c071aa0 0x7f422c0cc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:50.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.918+0000 7f4231b5c700 1 -- 172.21.15.39:0/762990002 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f421c0094b0 con 0x7f422c15c640 2023-11-28T11:59:50.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.918+0000 7f4231b5c700 1 --2- 172.21.15.39:0/762990002 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f422c15c640 0x7f422c1f4aa0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f422400cba0 tx=0x7f422400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:50.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.918+0000 7f4221ffb700 1 -- 172.21.15.39:0/762990002 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422400ab80 con 0x7f422c15c640 2023-11-28T11:59:50.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.918+0000 7f4221ffb700 1 -- 172.21.15.39:0/762990002 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422400ad00 con 0x7f422c15c640 2023-11-28T11:59:50.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.918+0000 7f423235d700 1 -- 172.21.15.39:0/762990002 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f422c06c830 con 0x7f422c15c640 2023-11-28T11:59:50.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.918+0000 7f4221ffb700 1 -- 172.21.15.39:0/762990002 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4224007310 con 0x7f422c15c640 2023-11-28T11:59:50.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.918+0000 7f423235d700 1 -- 172.21.15.39:0/762990002 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f422c072010 con 0x7f422c15c640 2023-11-28T11:59:50.924 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.922+0000 7f423235d700 1 -- 172.21.15.39:0/762990002 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f422c06cb10 con 0x7f422c15c640 2023-11-28T11:59:50.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.922+0000 7f4221ffb700 1 -- 172.21.15.39:0/762990002 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f422401a030 con 0x7f422c15c640 2023-11-28T11:59:50.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.922+0000 7f4221ffb700 1 --2- 172.21.15.39:0/762990002 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4210064ee0 0x7f4210067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:50.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.922+0000 7f4221ffb700 1 -- 172.21.15.39:0/762990002 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4224081d10 con 0x7f422c15c640 2023-11-28T11:59:50.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.922+0000 7f423135b700 1 --2- 172.21.15.39:0/762990002 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4210064ee0 0x7f4210067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:50.929 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.926+0000 7f423135b700 1 --2- 172.21.15.39:0/762990002 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4210064ee0 0x7f4210067390 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4228000f60 tx=0x7f4228009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:50.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:50.930+0000 7f4221ffb700 1 -- 172.21.15.39:0/762990002 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f422404fd10 con 0x7f422c15c640 2023-11-28T11:59:51.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.142+0000 7f423235d700 1 -- 172.21.15.39:0/762990002 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f422c0cbfd0 con 0x7f422c15c640 2023-11-28T11:59:51.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.142+0000 7f4221ffb700 1 -- 172.21.15.39:0/762990002 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4653 (secure 0 0 0) 0x7f422c0cbfd0 con 0x7f422c15c640 2023-11-28T11:59:51.145 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:59:51.145 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5645,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/3875262459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3875262459},{"type":"v1","addr":"172.21.15.184:6835","nonce":3875262459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5648,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/3845363738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3845363738},{"type":"v1","addr":"172.21.15.184:6837","nonce":3845363738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6225,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6834/2646905389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6833","nonce":2646905389},{"type":"v1","addr":"172.21.15.39:6834","nonce":2646905389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:59:45.290110+0000","modified":"2023-11-28T11:59:48.326013+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6244":{"gid":6244,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6835/990492858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":990492858},{"type":"v1","addr":"172.21.15.39:6835","nonce":990492858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T11:59:51.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.142+0000 7f423235d700 1 -- 172.21.15.39:0/762990002 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4210064ee0 msgr2=0x7f4210067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:51.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.142+0000 7f423235d700 1 --2- 172.21.15.39:0/762990002 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4210064ee0 0x7f4210067390 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4228000f60 tx=0x7f4228009040 comp rx=0 tx=0).stop 2023-11-28T11:59:51.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.142+0000 7f423235d700 1 -- 172.21.15.39:0/762990002 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f422c15c640 msgr2=0x7f422c1f4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:51.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.142+0000 7f423235d700 1 --2- 172.21.15.39:0/762990002 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f422c15c640 0x7f422c1f4aa0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f422400cba0 tx=0x7f422400cf60 comp rx=0 tx=0).stop 2023-11-28T11:59:51.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.142+0000 7f423235d700 1 -- 172.21.15.39:0/762990002 shutdown_connections 2023-11-28T11:59:51.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.146+0000 7f423235d700 1 --2- 172.21.15.39:0/762990002 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f422c15c640 0x7f422c1f4aa0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:51.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.146+0000 7f423235d700 1 --2- 172.21.15.39:0/762990002 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4210064ee0 0x7f4210067390 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:51.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.146+0000 7f423235d700 1 --2- 172.21.15.39:0/762990002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f422c071aa0 0x7f422c0cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:51.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.146+0000 7f423235d700 1 --2- 172.21.15.39:0/762990002 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f422c069e00 0x7f422c0caa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:51.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.146+0000 7f423235d700 1 -- 172.21.15.39:0/762990002 >> 172.21.15.39:0/762990002 conn(0x7f422c0b6520 msgr2=0x7f422c0b22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:51.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.146+0000 7f423235d700 1 -- 172.21.15.39:0/762990002 shutdown_connections 2023-11-28T11:59:51.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.146+0000 7f423235d700 1 -- 172.21.15.39:0/762990002 wait complete. 2023-11-28T11:59:51.151 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 32 2023-11-28T11:59:51.571 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T11:59:45.290110+0000', 'modified': '2023-11-28T11:59:48.326013+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6244}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6244': {'gid': 6244, 'name': 'c', 'rank': 0, 'incarnation': 28, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.39:6835/990492858', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.39:6832', 'nonce': 990492858}, {'type': 'v1', 'addr': '172.21.15.39:6835', 'nonce': 990492858}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T11:59:51.572 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T11:59:51.572 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-28T11:59:51.755 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.750+0000 7f87ec05b700 1 Processor -- start 2023-11-28T11:59:51.755 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.750+0000 7f87ec05b700 1 -- start start 2023-11-28T11:59:51.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.754+0000 7f87ec05b700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f87e40cdfb0 0x7f87e406cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:51.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.754+0000 7f87ec05b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f87e406d2f0 0x7f87e406a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:51.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.754+0000 7f87ec05b700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e4164080 con 0x7f87e4163cb0 2023-11-28T11:59:51.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.754+0000 7f87ec05b700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e40cc290 con 0x7f87e40cdfb0 2023-11-28T11:59:51.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.754+0000 7f87ec05b700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e406d770 con 0x7f87e406d2f0 2023-11-28T11:59:51.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.754+0000 7f87e95f6700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f87e40cdfb0 0x7f87e406cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:51.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.754+0000 7f87e95f6700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f87e40cdfb0 0x7f87e406cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38476/0 (socket says 172.21.15.39:38476) 2023-11-28T11:59:51.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.754+0000 7f87e95f6700 1 -- 172.21.15.39:0/1310704828 learned_addr learned my addr 172.21.15.39:0/1310704828 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:51.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.754+0000 7f87ea5f8700 1 --2- 172.21.15.39:0/1310704828 >> v2:172.21.15.184:3300/0 conn(0x7f87e406d2f0 0x7f87e406a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:51.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.754+0000 7f87e95f6700 1 -- 172.21.15.39:0/1310704828 >> v2:172.21.15.184:3300/0 conn(0x7f87e406d2f0 msgr2=0x7f87e406a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:51.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.754+0000 7f87e95f6700 1 --2- 172.21.15.39:0/1310704828 >> v2:172.21.15.184:3300/0 conn(0x7f87e406d2f0 0x7f87e406a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:51.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.754+0000 7f87e95f6700 1 -- 172.21.15.39:0/1310704828 >> v1:172.21.15.184:6789/0 conn(0x7f87e4163cb0 legacy=0x7f87e4164cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:51.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.754+0000 7f87e95f6700 1 -- 172.21.15.39:0/1310704828 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e4069bf0 con 0x7f87e40cdfb0 2023-11-28T11:59:51.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.758+0000 7f87e95f6700 1 --2- 172.21.15.39:0/1310704828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f87e40cdfb0 0x7f87e406cdb0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f87e406e520 tx=0x7f87d4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=358cbf60009e2bfa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:51.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.758+0000 7f87e8df5700 1 -- 172.21.15.39:0/1310704828 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d4011830 con 0x7f87e40cdfb0 2023-11-28T11:59:51.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.758+0000 7f87e8df5700 1 -- 172.21.15.39:0/1310704828 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d4011990 con 0x7f87e40cdfb0 2023-11-28T11:59:51.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.758+0000 7f87e8df5700 1 -- 172.21.15.39:0/1310704828 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d4011d20 con 0x7f87e40cdfb0 2023-11-28T11:59:51.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.758+0000 7f87ec05b700 1 -- 172.21.15.39:0/1310704828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f87e40cdfb0 msgr2=0x7f87e406cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:51.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.758+0000 7f87ec05b700 1 --2- 172.21.15.39:0/1310704828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f87e40cdfb0 0x7f87e406cdb0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f87e406e520 tx=0x7f87d4009bf0 comp rx=0 tx=0).stop 2023-11-28T11:59:51.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.758+0000 7f87ec05b700 1 -- 172.21.15.39:0/1310704828 shutdown_connections 2023-11-28T11:59:51.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.758+0000 7f87ec05b700 1 --2- 172.21.15.39:0/1310704828 >> v2:172.21.15.184:3300/0 conn(0x7f87e406d2f0 0x7f87e406a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:51.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.758+0000 7f87ec05b700 1 --2- 172.21.15.39:0/1310704828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f87e40cdfb0 0x7f87e406cdb0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:51.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.758+0000 7f87ec05b700 1 -- 172.21.15.39:0/1310704828 >> 172.21.15.39:0/1310704828 conn(0x7f87e40cf350 msgr2=0x7f87e40b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:51.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.758+0000 7f87ec05b700 1 -- 172.21.15.39:0/1310704828 shutdown_connections 2023-11-28T11:59:51.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.758+0000 7f87ec05b700 1 -- 172.21.15.39:0/1310704828 wait complete. 2023-11-28T11:59:51.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.762+0000 7f87ec05b700 1 Processor -- start 2023-11-28T11:59:51.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.762+0000 7f87ec05b700 1 -- start start 2023-11-28T11:59:51.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.762+0000 7f87ec05b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87e406d2f0 0x7f87e41f9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:51.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.762+0000 7f87ec05b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87e40cdfb0 0x7f87e41f5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:51.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.762+0000 7f87ec05b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f87e4163cb0 0x7f87e40beba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:51.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.762+0000 7f87ec05b700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e4156680 con 0x7f87e4163cb0 2023-11-28T11:59:51.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.762+0000 7f87ec05b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e41fa320 con 0x7f87e406d2f0 2023-11-28T11:59:51.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.762+0000 7f87ec05b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e40bd820 con 0x7f87e40cdfb0 2023-11-28T11:59:51.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.762+0000 7f87ea5f8700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f87e4163cb0 0x7f87e40beba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:51.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.762+0000 7f87ea5f8700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f87e4163cb0 0x7f87e40beba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38478/0 (socket says 172.21.15.39:38478) 2023-11-28T11:59:51.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.762+0000 7f87ea5f8700 1 -- 172.21.15.39:0/756590627 learned_addr learned my addr 172.21.15.39:0/756590627 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:51.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.762+0000 7f87e9df7700 1 --2- 172.21.15.39:0/756590627 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87e406d2f0 0x7f87e41f9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:51.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.762+0000 7f87e95f6700 1 --2- 172.21.15.39:0/756590627 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87e40cdfb0 0x7f87e41f5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:51.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.762+0000 7f87ea5f8700 1 -- 172.21.15.39:0/756590627 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87e40cdfb0 msgr2=0x7f87e41f5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:51.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.762+0000 7f87ea5f8700 1 --2- 172.21.15.39:0/756590627 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87e40cdfb0 0x7f87e41f5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:51.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.762+0000 7f87ea5f8700 1 -- 172.21.15.39:0/756590627 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87e406d2f0 msgr2=0x7f87e41f9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:51.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.762+0000 7f87ea5f8700 1 --2- 172.21.15.39:0/756590627 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87e406d2f0 0x7f87e41f9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:51.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.762+0000 7f87ea5f8700 1 -- 172.21.15.39:0/756590627 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d4009570 con 0x7f87e4163cb0 2023-11-28T11:59:51.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.762+0000 7f87e95f6700 1 --2- 172.21.15.39:0/756590627 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87e40cdfb0 0x7f87e41f5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:51.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.762+0000 7f87ea5f8700 1 --2- 172.21.15.39:0/756590627 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f87e4163cb0 0x7f87e40beba0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f87dc00efc0 tx=0x7f87dc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:51.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.762+0000 7f87da7fc700 1 -- 172.21.15.39:0/756590627 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87dc009ea0 con 0x7f87e4163cb0 2023-11-28T11:59:51.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.762+0000 7f87da7fc700 1 -- 172.21.15.39:0/756590627 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87dc00f040 con 0x7f87e4163cb0 2023-11-28T11:59:51.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.766+0000 7f87ec05b700 1 -- 172.21.15.39:0/756590627 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e40cc780 con 0x7f87e4163cb0 2023-11-28T11:59:51.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.766+0000 7f87da7fc700 1 -- 172.21.15.39:0/756590627 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87dc014480 con 0x7f87e4163cb0 2023-11-28T11:59:51.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.766+0000 7f87ec05b700 1 -- 172.21.15.39:0/756590627 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e40cc4a0 con 0x7f87e4163cb0 2023-11-28T11:59:51.771 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.766+0000 7f87da7fc700 1 -- 172.21.15.39:0/756590627 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f87dc0145e0 con 0x7f87e4163cb0 2023-11-28T11:59:51.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.770+0000 7f87da7fc700 1 --2- 172.21.15.39:0/756590627 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f87c8064ee0 0x7f87c8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:51.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.770+0000 7f87da7fc700 1 -- 172.21.15.39:0/756590627 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f87dc082ab0 con 0x7f87e4163cb0 2023-11-28T11:59:51.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.770+0000 7f87e9df7700 1 --2- 172.21.15.39:0/756590627 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f87c8064ee0 0x7f87c8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:51.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.770+0000 7f87e9df7700 1 --2- 172.21.15.39:0/756590627 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f87c8064ee0 0x7f87c8067390 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f87e0000f60 tx=0x7f87e0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:51.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.770+0000 7f87ef2e3740 1 Processor -- start 2023-11-28T11:59:51.776 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.770+0000 7f87ef2e3740 1 -- start start 2023-11-28T11:59:51.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.774+0000 7f87ef2e3740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1ec9ae0 0x2179e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:51.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.774+0000 7f87ef2e3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1ec9710 0x217a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:51.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.774+0000 7f87ef2e3740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1f14790 0x217a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:51.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.774+0000 7f87ef2e3740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x2038ae0 con 0x1ec9ae0 2023-11-28T11:59:51.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.774+0000 7f87ef2e3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x20a8bd0 con 0x1ec9710 2023-11-28T11:59:51.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.774+0000 7f87ef2e3740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x20a1ed0 con 0x1f14790 2023-11-28T11:59:51.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.774+0000 7f87e9df7700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1ec9ae0 0x2179e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:51.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.774+0000 7f87e9df7700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1ec9ae0 0x2179e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38494/0 (socket says 172.21.15.39:38494) 2023-11-28T11:59:51.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.774+0000 7f87e9df7700 1 -- 172.21.15.39:0/1863769979 learned_addr learned my addr 172.21.15.39:0/1863769979 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:51.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.774+0000 7f87e95f6700 1 --2- 172.21.15.39:0/1863769979 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1ec9710 0x217a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:51.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.774+0000 7f87ea5f8700 1 --2- 172.21.15.39:0/1863769979 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1f14790 0x217a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:51.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.774+0000 7f87e9df7700 1 -- 172.21.15.39:0/1863769979 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1f14790 msgr2=0x217a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:51.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.774+0000 7f87e9df7700 1 --2- 172.21.15.39:0/1863769979 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1f14790 0x217a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:51.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.774+0000 7f87e9df7700 1 -- 172.21.15.39:0/1863769979 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1ec9710 msgr2=0x217a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:51.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.774+0000 7f87e9df7700 1 --2- 172.21.15.39:0/1863769979 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1ec9710 0x217a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:51.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.774+0000 7f87e9df7700 1 -- 172.21.15.39:0/1863769979 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x20c7cc0 con 0x1ec9ae0 2023-11-28T11:59:51.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.774+0000 7f87e95f6700 1 --2- 172.21.15.39:0/1863769979 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1ec9710 0x217a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:51.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.774+0000 7f87e9df7700 1 --2- 172.21.15.39:0/1863769979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1ec9ae0 0x2179e00 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f87e000f750 tx=0x7f87e0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e539bf75cfae35ba server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:51.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.774+0000 7f87c77fe700 1 -- 172.21.15.39:0/1863769979 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e000fed0 con 0x1ec9ae0 2023-11-28T11:59:51.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.774+0000 7f87c77fe700 1 -- 172.21.15.39:0/1863769979 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e0014450 con 0x1ec9ae0 2023-11-28T11:59:51.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.774+0000 7f87c77fe700 1 -- 172.21.15.39:0/1863769979 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e00147c0 con 0x1ec9ae0 2023-11-28T11:59:51.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.778+0000 7f87ef2e3740 1 -- 172.21.15.39:0/1863769979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1ec9ae0 msgr2=0x2179e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:51.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.778+0000 7f87ef2e3740 1 --2- 172.21.15.39:0/1863769979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1ec9ae0 0x2179e00 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f87e000f750 tx=0x7f87e0012000 comp rx=0 tx=0).stop 2023-11-28T11:59:51.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.778+0000 7f87ef2e3740 1 -- 172.21.15.39:0/1863769979 shutdown_connections 2023-11-28T11:59:51.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.778+0000 7f87ef2e3740 1 --2- 172.21.15.39:0/1863769979 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1f14790 0x217a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:51.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.778+0000 7f87ef2e3740 1 --2- 172.21.15.39:0/1863769979 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1ec9710 0x217a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:51.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.778+0000 7f87ef2e3740 1 --2- 172.21.15.39:0/1863769979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1ec9ae0 0x2179e00 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:51.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.778+0000 7f87ef2e3740 1 -- 172.21.15.39:0/1863769979 >> 172.21.15.39:0/1863769979 conn(0x1ec9eb0 msgr2=0x2162700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:51.782 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.778+0000 7f87ef2e3740 1 -- 172.21.15.39:0/1863769979 shutdown_connections 2023-11-28T11:59:51.782 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.778+0000 7f87ef2e3740 1 -- 172.21.15.39:0/1863769979 wait complete. 2023-11-28T11:59:51.782 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.778+0000 7f87ef2e3740 1 -- start start 2023-11-28T11:59:51.782 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.778+0000 7f87ef2e3740 1 Processor -- start 2023-11-28T11:59:51.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.778+0000 7f87ef2e3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1ec9710 0x2160c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:51.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.778+0000 7f87ef2e3740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1ec9ae0 0x213b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:51.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.778+0000 7f87ef2e3740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1f14790 0x213b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:51.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.778+0000 7f87ef2e3740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f4eb20 con 0x1f14790 2023-11-28T11:59:51.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.778+0000 7f87ef2e3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x2139da0 con 0x1ec9710 2023-11-28T11:59:51.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.778+0000 7f87ef2e3740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x213a040 con 0x1ec9ae0 2023-11-28T11:59:51.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.778+0000 7f87ef2e3740 10 client.0 _ll_register_callbacks cb 0x20fe0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:59:51.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.778+0000 7f87e9df7700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1ec9710 0x2160c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:51.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.778+0000 7f87ea5f8700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1f14790 0x213b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:51.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.778+0000 7f87e9df7700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1ec9710 0x2160c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:57138/0 (socket says 172.21.15.39:57138) 2023-11-28T11:59:51.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.778+0000 7f87e9df7700 1 -- 172.21.15.39:0/2460254945 learned_addr learned my addr 172.21.15.39:0/2460254945 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:51.785 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.778+0000 7f87e95f6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1ec9ae0 0x213b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:51.785 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.782+0000 7f87ea5f8700 1 -- 172.21.15.39:0/2460254945 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1ec9ae0 msgr2=0x213b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:51.786 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.782+0000 7f87ea5f8700 1 --2- 172.21.15.39:0/2460254945 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1ec9ae0 0x213b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:51.786 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.782+0000 7f87ea5f8700 1 -- 172.21.15.39:0/2460254945 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1ec9710 msgr2=0x2160c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:51.786 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.782+0000 7f87ea5f8700 1 --2- 172.21.15.39:0/2460254945 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1ec9710 0x2160c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:51.786 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.782+0000 7f87ea5f8700 1 -- 172.21.15.39:0/2460254945 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e4164080 con 0x1f14790 2023-11-28T11:59:51.786 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.782+0000 7f87e9df7700 1 --2- 172.21.15.39:0/2460254945 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1ec9710 0x2160c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:51.786 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.782+0000 7f87ea5f8700 1 --2- 172.21.15.39:0/2460254945 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1f14790 0x213b7a0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f87dc0543e0 tx=0x7f87dc05a390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=419a6081f60373d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:51.786 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.782+0000 7f87c4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-11-28T11:59:51.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.782+0000 7f87c4ff9700 1 -- 172.21.15.39:0/2460254945 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87dc05c5b0 con 0x1f14790 2023-11-28T11:59:51.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.782+0000 7f87c4ff9700 1 -- 172.21.15.39:0/2460254945 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f87dc058350 con 0x1f14790 2023-11-28T11:59:51.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.782+0000 7f87ef2e3740 1 -- 172.21.15.39:0/2460254945 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x209af50 con 0x1f14790 2023-11-28T11:59:51.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.782+0000 7f87c4ff9700 1 -- 172.21.15.39:0/2460254945 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87dc0504d0 con 0x1f14790 2023-11-28T11:59:51.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.782+0000 7f87ef2e3740 10 client.6387 fetch_fsmap learned FSMap version 32 2023-11-28T11:59:51.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.782+0000 7f87ef2e3740 1 -- 172.21.15.39:0/2460254945 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x1f159e0 con 0x1f14790 2023-11-28T11:59:51.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.782+0000 7f87c4ff9700 1 -- 172.21.15.39:0/2460254945 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x209af50 con 0x1f14790 2023-11-28T11:59:51.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.782+0000 7f87c4ff9700 1 -- 172.21.15.39:0/2460254945 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f87dc050630 con 0x1f14790 2023-11-28T11:59:51.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.782+0000 7f87ef2e3740 10 client.6387 fetch_fsmap finished waiting for FSMap version 32 2023-11-28T11:59:51.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.782+0000 7f87ef2e3740 10 client.6387 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-28T11:59:51.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.782+0000 7f87ef2e3740 20 client.6387 populate_metadata read hostname 'smithi039' 2023-11-28T11:59:51.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.782+0000 7f87ef2e3740 1 --2- 172.21.15.39:0/2460254945 >> [v2:172.21.15.39:6832/990492858,v1:172.21.15.39:6835/990492858] conn(0x2163a10 0x21388d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:51.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.782+0000 7f87ef2e3740 4 client.6387 mds_command: new command op to 6244 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T11:59:51.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.782+0000 7f87ef2e3740 1 -- 172.21.15.39:0/2460254945 --> [v2:172.21.15.39:6832/990492858,v1:172.21.15.39:6835/990492858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x209ac70 con 0x2163a10 2023-11-28T11:59:51.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.782+0000 7f87e9df7700 1 --2- 172.21.15.39:0/2460254945 >> [v2:172.21.15.39:6832/990492858,v1:172.21.15.39:6835/990492858] conn(0x2163a10 0x21388d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:51.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.786+0000 7f87c4ff9700 10 client.6387 ms_handle_connect on v2:172.21.15.39:6832/990492858 2023-11-28T11:59:51.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.786+0000 7f87e9df7700 1 --2- 172.21.15.39:0/2460254945 >> [v2:172.21.15.39:6832/990492858,v1:172.21.15.39:6835/990492858] conn(0x2163a10 0x21388d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=769edb5d942e038 server_cookie=9e9ef034aedefc92 in_seq=0 out_seq=0 2023-11-28T11:59:51.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.786+0000 7f87c4ff9700 1 -- 172.21.15.39:0/2460254945 <== mds.0 v2:172.21.15.39:6832/990492858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x209ac70 con 0x2163a10 2023-11-28T11:59:51.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.786+0000 7f87c4ff9700 10 client.6387 handle_command_reply: tid=0 2023-11-28T11:59:51.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.786+0000 7f87ef2e3740 1 client.6387 shutdown 2023-11-28T11:59:51.791 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.786+0000 7f87ef2e3740 1 -- 172.21.15.39:0/2460254945 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1f14790 msgr2=0x213b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:51.791 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.786+0000 7f87ef2e3740 1 --2- 172.21.15.39:0/2460254945 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1f14790 0x213b7a0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f87dc0543e0 tx=0x7f87dc05a390 comp rx=0 tx=0).stop 2023-11-28T11:59:51.791 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.786+0000 7f87ef2e3740 1 -- 172.21.15.39:0/2460254945 shutdown_connections 2023-11-28T11:59:51.792 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.786+0000 7f87ef2e3740 1 --2- 172.21.15.39:0/2460254945 >> [v2:172.21.15.39:6832/990492858,v1:172.21.15.39:6835/990492858] conn(0x2163a10 0x21388d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:51.792 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.786+0000 7f87ef2e3740 1 --2- 172.21.15.39:0/2460254945 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1f14790 0x213b7a0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:51.792 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.786+0000 7f87ef2e3740 1 --2- 172.21.15.39:0/2460254945 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1ec9ae0 0x213b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:51.792 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.786+0000 7f87ef2e3740 1 --2- 172.21.15.39:0/2460254945 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1ec9710 0x2160c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:51.792 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.786+0000 7f87ef2e3740 1 -- 172.21.15.39:0/2460254945 >> 172.21.15.39:0/2460254945 conn(0x1ec9eb0 msgr2=0x21627d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:51.792 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.786+0000 7f87c4ff9700 0 client.6387 ms_handle_reset on v2:172.21.15.39:6832/990492858 2023-11-28T11:59:51.792 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.786+0000 7f87ef2e3740 1 -- 172.21.15.39:0/2460254945 shutdown_connections 2023-11-28T11:59:51.792 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.786+0000 7f87ef2e3740 1 -- 172.21.15.39:0/2460254945 wait complete. 2023-11-28T11:59:51.792 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.790+0000 7f87ef2e3740 20 client.6387 trim_cache size 0 max 16384 2023-11-28T11:59:51.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.810+0000 7f87ef2e3740 1 Processor -- start 2023-11-28T11:59:51.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.810+0000 7f87ef2e3740 1 -- start start 2023-11-28T11:59:51.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.810+0000 7f87ef2e3740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1ec9710 0x2162990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:51.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.810+0000 7f87ef2e3740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1ec9ae0 0x2162ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:51.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.810+0000 7f87ef2e3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1f14790 0x2176fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:51.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.810+0000 7f87ef2e3740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x2137da0 con 0x1ec9ae0 2023-11-28T11:59:51.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.810+0000 7f87ef2e3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x20a4a30 con 0x1f14790 2023-11-28T11:59:51.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.810+0000 7f87ef2e3740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x2072ec0 con 0x1ec9710 2023-11-28T11:59:51.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.810+0000 7f87e95f6700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1ec9ae0 0x2162ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:51.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.810+0000 7f87e95f6700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1ec9ae0 0x2162ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38524/0 (socket says 172.21.15.39:38524) 2023-11-28T11:59:51.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.810+0000 7f87e95f6700 1 -- 172.21.15.39:0/4120026846 learned_addr learned my addr 172.21.15.39:0/4120026846 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:51.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.810+0000 7f87e9df7700 1 --2- 172.21.15.39:0/4120026846 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1ec9710 0x2162990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:51.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.810+0000 7f87ea5f8700 1 --2- 172.21.15.39:0/4120026846 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1f14790 0x2176fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:51.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.810+0000 7f87e95f6700 1 -- 172.21.15.39:0/4120026846 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1ec9710 msgr2=0x2162990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:51.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.810+0000 7f87e95f6700 1 --2- 172.21.15.39:0/4120026846 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1ec9710 0x2162990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:51.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.810+0000 7f87e95f6700 1 -- 172.21.15.39:0/4120026846 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1f14790 msgr2=0x2176fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:51.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.810+0000 7f87e95f6700 1 --2- 172.21.15.39:0/4120026846 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1f14790 0x2176fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:51.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.810+0000 7f87e95f6700 1 -- 172.21.15.39:0/4120026846 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e40bd5e0 con 0x1ec9ae0 2023-11-28T11:59:51.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.814+0000 7f87e95f6700 1 --2- 172.21.15.39:0/4120026846 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1ec9ae0 0x2162ed0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f87d4013000 tx=0x7f87d4010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6c32efe9584cb4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:51.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.814+0000 7f87c7fff700 1 -- 172.21.15.39:0/4120026846 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d4021030 con 0x1ec9ae0 2023-11-28T11:59:51.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.814+0000 7f87c7fff700 1 -- 172.21.15.39:0/4120026846 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d4022040 con 0x1ec9ae0 2023-11-28T11:59:51.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.814+0000 7f87c7fff700 1 -- 172.21.15.39:0/4120026846 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d4004280 con 0x1ec9ae0 2023-11-28T11:59:51.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.814+0000 7f87ef2e3740 1 -- 172.21.15.39:0/4120026846 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1ec9ae0 msgr2=0x2162ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:51.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.814+0000 7f87ef2e3740 1 --2- 172.21.15.39:0/4120026846 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1ec9ae0 0x2162ed0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f87d4013000 tx=0x7f87d4010000 comp rx=0 tx=0).stop 2023-11-28T11:59:51.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.814+0000 7f87ef2e3740 1 -- 172.21.15.39:0/4120026846 shutdown_connections 2023-11-28T11:59:51.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.814+0000 7f87ef2e3740 1 --2- 172.21.15.39:0/4120026846 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1f14790 0x2176fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:51.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.814+0000 7f87ef2e3740 1 --2- 172.21.15.39:0/4120026846 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1ec9ae0 0x2162ed0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:51.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.814+0000 7f87ef2e3740 1 --2- 172.21.15.39:0/4120026846 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1ec9710 0x2162990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:51.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.814+0000 7f87ef2e3740 1 -- 172.21.15.39:0/4120026846 >> 172.21.15.39:0/4120026846 conn(0x1ec9eb0 msgr2=0x218fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:51.819 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.814+0000 7f87ef2e3740 1 -- 172.21.15.39:0/4120026846 shutdown_connections 2023-11-28T11:59:51.819 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.814+0000 7f87ef2e3740 1 -- 172.21.15.39:0/4120026846 wait complete. 2023-11-28T11:59:51.819 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.814+0000 7f87ef2e3740 1 -- start start 2023-11-28T11:59:51.819 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.814+0000 7f87ef2e3740 1 Processor -- start 2023-11-28T11:59:51.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.818+0000 7f87ef2e3740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1ec9710 0x21dd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:51.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.818+0000 7f87ef2e3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1ec9ae0 0x21c31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:51.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.818+0000 7f87ef2e3740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1f14790 0x21c3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:51.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.818+0000 7f87ef2e3740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x209f6e0 con 0x1f14790 2023-11-28T11:59:51.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.818+0000 7f87ef2e3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x2077de0 con 0x1ec9ae0 2023-11-28T11:59:51.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.818+0000 7f87ef2e3740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x20a9e60 con 0x1ec9710 2023-11-28T11:59:51.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.818+0000 7f87ef2e3740 10 client.0 _ll_register_callbacks cb 0x204e2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:59:51.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.818+0000 7f87ea5f8700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1f14790 0x21c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:51.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.818+0000 7f87ea5f8700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1f14790 0x21c3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38532/0 (socket says 172.21.15.39:38532) 2023-11-28T11:59:51.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.818+0000 7f87ea5f8700 1 -- 172.21.15.39:0/1336413195 learned_addr learned my addr 172.21.15.39:0/1336413195 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:51.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.818+0000 7f87e9df7700 1 --2- 172.21.15.39:0/1336413195 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1ec9710 0x21dd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:51.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.818+0000 7f87e95f6700 1 --2- 172.21.15.39:0/1336413195 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1ec9ae0 0x21c31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:51.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.818+0000 7f87ea5f8700 1 -- 172.21.15.39:0/1336413195 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1ec9710 msgr2=0x21dd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:51.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.818+0000 7f87ea5f8700 1 --2- 172.21.15.39:0/1336413195 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1ec9710 0x21dd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:51.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.818+0000 7f87ea5f8700 1 -- 172.21.15.39:0/1336413195 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1ec9ae0 msgr2=0x21c31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:51.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.818+0000 7f87ea5f8700 1 --2- 172.21.15.39:0/1336413195 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1ec9ae0 0x21c31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:51.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.818+0000 7f87ea5f8700 1 -- 172.21.15.39:0/1336413195 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e4069bf0 con 0x1f14790 2023-11-28T11:59:51.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.818+0000 7f87ea5f8700 1 --2- 172.21.15.39:0/1336413195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1f14790 0x21c3710 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f87dc050be0 tx=0x7f87dc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dd0bcc96ef20efb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:51.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.818+0000 7f87c4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-11-28T11:59:51.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.818+0000 7f87c4ff9700 1 -- 172.21.15.39:0/1336413195 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87dc05c5b0 con 0x1f14790 2023-11-28T11:59:51.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.818+0000 7f87c4ff9700 1 -- 172.21.15.39:0/1336413195 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f87dc0536e0 con 0x1f14790 2023-11-28T11:59:51.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.818+0000 7f87ef2e3740 1 -- 172.21.15.39:0/1336413195 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f87e0014450 con 0x1f14790 2023-11-28T11:59:51.825 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.818+0000 7f87c4ff9700 1 -- 172.21.15.39:0/1336413195 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87dc05c770 con 0x1f14790 2023-11-28T11:59:51.825 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.818+0000 7f87ef2e3740 10 client.6393 fetch_fsmap learned FSMap version 32 2023-11-28T11:59:51.825 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.818+0000 7f87ef2e3740 1 -- 172.21.15.39:0/1336413195 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x204ea20 con 0x1f14790 2023-11-28T11:59:51.825 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.818+0000 7f87c4ff9700 1 -- 172.21.15.39:0/1336413195 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e0014450 con 0x1f14790 2023-11-28T11:59:51.825 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.818+0000 7f87c4ff9700 1 -- 172.21.15.39:0/1336413195 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f87dc0538a0 con 0x1f14790 2023-11-28T11:59:51.825 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.818+0000 7f87ef2e3740 10 client.6393 fetch_fsmap finished waiting for FSMap version 32 2023-11-28T11:59:51.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.818+0000 7f87ef2e3740 10 client.6393 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-28T11:59:51.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.818+0000 7f87ef2e3740 20 client.6393 populate_metadata read hostname 'smithi039' 2023-11-28T11:59:51.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.818+0000 7f87ef2e3740 1 --2- 172.21.15.39:0/1336413195 >> [v2:172.21.15.39:6832/990492858,v1:172.21.15.39:6835/990492858] conn(0x2196b30 0x2196f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:51.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.818+0000 7f87ef2e3740 4 client.6393 mds_command: new command op to 6244 tid=0[{"prefix": "status"}] 2023-11-28T11:59:51.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.818+0000 7f87ef2e3740 1 -- 172.21.15.39:0/1336413195 --> [v2:172.21.15.39:6832/990492858,v1:172.21.15.39:6835/990492858] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1f46260 con 0x2196b30 2023-11-28T11:59:51.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.818+0000 7f87e9df7700 1 --2- 172.21.15.39:0/1336413195 >> [v2:172.21.15.39:6832/990492858,v1:172.21.15.39:6835/990492858] conn(0x2196b30 0x2196f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:51.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.822+0000 7f87e9df7700 1 --2- 172.21.15.39:0/1336413195 >> [v2:172.21.15.39:6832/990492858,v1:172.21.15.39:6835/990492858] conn(0x2196b30 0x2196f00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b028e228d78f1cbd server_cookie=1e5de77cd49a41ef in_seq=0 out_seq=0 2023-11-28T11:59:51.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.822+0000 7f87c4ff9700 10 client.6393 ms_handle_connect on v2:172.21.15.39:6832/990492858 2023-11-28T11:59:51.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.822+0000 7f87c4ff9700 1 -- 172.21.15.39:0/1336413195 <== mds.0 v2:172.21.15.39:6832/990492858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x1f46260 con 0x2196b30 2023-11-28T11:59:51.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.822+0000 7f87c4ff9700 10 client.6393 handle_command_reply: tid=0 2023-11-28T11:59:51.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.822+0000 7f87ef2e3740 1 client.6393 shutdown 2023-11-28T11:59:51.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.822+0000 7f87ef2e3740 1 -- 172.21.15.39:0/1336413195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1f14790 msgr2=0x21c3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:51.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.822+0000 7f87ef2e3740 1 --2- 172.21.15.39:0/1336413195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1f14790 0x21c3710 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f87dc050be0 tx=0x7f87dc004af0 comp rx=0 tx=0).stop 2023-11-28T11:59:51.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.822+0000 7f87ef2e3740 1 -- 172.21.15.39:0/1336413195 shutdown_connections 2023-11-28T11:59:51.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.822+0000 7f87ef2e3740 1 --2- 172.21.15.39:0/1336413195 >> [v2:172.21.15.39:6832/990492858,v1:172.21.15.39:6835/990492858] conn(0x2196b30 0x2196f00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:51.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.822+0000 7f87ef2e3740 1 --2- 172.21.15.39:0/1336413195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1f14790 0x21c3710 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:51.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.822+0000 7f87ef2e3740 1 --2- 172.21.15.39:0/1336413195 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1ec9ae0 0x21c31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:51.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.822+0000 7f87c4ff9700 0 client.6393 ms_handle_reset on v2:172.21.15.39:6832/990492858 2023-11-28T11:59:51.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.822+0000 7f87ef2e3740 1 --2- 172.21.15.39:0/1336413195 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1ec9710 0x21dd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:51.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.822+0000 7f87ef2e3740 1 -- 172.21.15.39:0/1336413195 >> 172.21.15.39:0/1336413195 conn(0x1ec9eb0 msgr2=0x2188ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:51.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.822+0000 7f87ef2e3740 1 -- 172.21.15.39:0/1336413195 shutdown_connections 2023-11-28T11:59:51.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.822+0000 7f87ef2e3740 1 -- 172.21.15.39:0/1336413195 wait complete. 2023-11-28T11:59:51.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.822+0000 7f87ef2e3740 20 client.6393 trim_cache size 0 max 16384 2023-11-28T11:59:51.828 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2023-11-28T11:59:51.829 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "67ce95b1-cd7e-4478-b863-c714ef275520", 2023-11-28T11:59:51.829 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 0, 2023-11-28T11:59:51.829 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 6244, 2023-11-28T11:59:51.829 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2023-11-28T11:59:51.829 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2023-11-28T11:59:51.829 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2023-11-28T11:59:51.829 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 6.5267790290000001, 2023-11-28T11:59:51.829 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 32, 2023-11-28T11:59:51.829 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 70, 2023-11-28T11:59:51.829 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 70, 2023-11-28T11:59:51.829 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 11.744708928 2023-11-28T11:59:51.830 INFO:teuthology.orchestra.run.smithi039.stdout:} 2023-11-28T11:59:51.830 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.822+0000 7f87ec05b700 1 -- 172.21.15.39:0/756590627 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f87c8064ee0 msgr2=0x7f87c8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:51.830 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.822+0000 7f87ec05b700 1 --2- 172.21.15.39:0/756590627 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f87c8064ee0 0x7f87c8067390 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f87e0000f60 tx=0x7f87e0009040 comp rx=0 tx=0).stop 2023-11-28T11:59:51.831 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.822+0000 7f87ec05b700 1 -- 172.21.15.39:0/756590627 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f87e4163cb0 msgr2=0x7f87e40beba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:51.831 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.822+0000 7f87ec05b700 1 --2- 172.21.15.39:0/756590627 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f87e4163cb0 0x7f87e40beba0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f87dc00efc0 tx=0x7f87dc00c3a0 comp rx=0 tx=0).stop 2023-11-28T11:59:51.831 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.822+0000 7f87ec05b700 1 -- 172.21.15.39:0/756590627 shutdown_connections 2023-11-28T11:59:51.831 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.822+0000 7f87ec05b700 1 --2- 172.21.15.39:0/756590627 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f87e4163cb0 0x7f87e40beba0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:51.831 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.822+0000 7f87ec05b700 1 --2- 172.21.15.39:0/756590627 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87e40cdfb0 0x7f87e41f5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:51.831 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.822+0000 7f87ec05b700 1 --2- 172.21.15.39:0/756590627 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f87c8064ee0 0x7f87c8067390 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:51.831 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.822+0000 7f87ec05b700 1 --2- 172.21.15.39:0/756590627 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87e406d2f0 0x7f87e41f9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:51.831 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.822+0000 7f87ec05b700 1 -- 172.21.15.39:0/756590627 >> 172.21.15.39:0/756590627 conn(0x7f87e40cf350 msgr2=0x7f87e40ca9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:51.831 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.822+0000 7f87ec05b700 1 -- 172.21.15.39:0/756590627 shutdown_connections 2023-11-28T11:59:51.831 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:51.822+0000 7f87ec05b700 1 -- 172.21.15.39:0/756590627 wait complete. 2023-11-28T11:59:51.849 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T11:59:52.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.034+0000 7fef68cfc700 1 Processor -- start 2023-11-28T11:59:52.038 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.034+0000 7fef68cfc700 1 -- start start 2023-11-28T11:59:52.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.038+0000 7fef68cfc700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fef6415c640 0x7fef640d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:52.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.038+0000 7fef68cfc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef64071aa0 0x7fef6406d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:52.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.038+0000 7fef68cfc700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fef64069e00 0x7fef6406a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:52.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.038+0000 7fef68cfc700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef6406cef0 con 0x7fef6415c640 2023-11-28T11:59:52.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.038+0000 7fef68cfc700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef6406a7c0 con 0x7fef64069e00 2023-11-28T11:59:52.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.038+0000 7fef68cfc700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6406c600 con 0x7fef64071aa0 2023-11-28T11:59:52.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.038+0000 7fef637fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fef6415c640 0x7fef640d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:52.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.038+0000 7fef637fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fef6415c640 0x7fef640d31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38536/0 (socket says 172.21.15.39:38536) 2023-11-28T11:59:52.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.038+0000 7fef637fe700 1 -- 172.21.15.39:0/23155878 learned_addr learned my addr 172.21.15.39:0/23155878 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:52.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.038+0000 7fef63fff700 1 --2- 172.21.15.39:0/23155878 >> v2:172.21.15.184:3300/0 conn(0x7fef64069e00 0x7fef6406a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:52.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.038+0000 7fef62ffd700 1 --2- 172.21.15.39:0/23155878 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef64071aa0 0x7fef6406d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:52.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.038+0000 7fef637fe700 1 -- 172.21.15.39:0/23155878 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef64071aa0 msgr2=0x7fef6406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:52.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.038+0000 7fef637fe700 1 --2- 172.21.15.39:0/23155878 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef64071aa0 0x7fef6406d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:52.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.038+0000 7fef637fe700 1 -- 172.21.15.39:0/23155878 >> v2:172.21.15.184:3300/0 conn(0x7fef64069e00 msgr2=0x7fef6406a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:52.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.038+0000 7fef637fe700 1 --2- 172.21.15.39:0/23155878 >> v2:172.21.15.184:3300/0 conn(0x7fef64069e00 0x7fef6406a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:52.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.038+0000 7fef637fe700 1 -- 172.21.15.39:0/23155878 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef640722f0 con 0x7fef6415c640 2023-11-28T11:59:52.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.038+0000 7fef63fff700 1 --2- 172.21.15.39:0/23155878 >> v2:172.21.15.184:3300/0 conn(0x7fef64069e00 0x7fef6406a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:52.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.038+0000 7fef637fe700 1 --2- 172.21.15.39:0/23155878 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fef6415c640 0x7fef640d31e0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fef6406efb0 tx=0x7fef54009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71cb28945a7f7565 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:52.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.038+0000 7fef627fc700 1 -- 172.21.15.39:0/23155878 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef54011830 con 0x7fef6415c640 2023-11-28T11:59:52.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.038+0000 7fef627fc700 1 -- 172.21.15.39:0/23155878 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef54011990 con 0x7fef6415c640 2023-11-28T11:59:52.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.038+0000 7fef627fc700 1 -- 172.21.15.39:0/23155878 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef54011d20 con 0x7fef6415c640 2023-11-28T11:59:52.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.038+0000 7fef68cfc700 1 -- 172.21.15.39:0/23155878 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fef6415c640 msgr2=0x7fef640d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:52.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.042+0000 7fef68cfc700 1 --2- 172.21.15.39:0/23155878 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fef6415c640 0x7fef640d31e0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fef6406efb0 tx=0x7fef54009bf0 comp rx=0 tx=0).stop 2023-11-28T11:59:52.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.042+0000 7fef68cfc700 1 -- 172.21.15.39:0/23155878 shutdown_connections 2023-11-28T11:59:52.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.042+0000 7fef68cfc700 1 --2- 172.21.15.39:0/23155878 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef64071aa0 0x7fef6406d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:52.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.042+0000 7fef68cfc700 1 --2- 172.21.15.39:0/23155878 >> v2:172.21.15.184:3300/0 conn(0x7fef64069e00 0x7fef6406a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:52.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.042+0000 7fef68cfc700 1 --2- 172.21.15.39:0/23155878 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fef6415c640 0x7fef640d31e0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:52.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.042+0000 7fef68cfc700 1 -- 172.21.15.39:0/23155878 >> 172.21.15.39:0/23155878 conn(0x7fef640b6520 msgr2=0x7fef64071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:52.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.042+0000 7fef68cfc700 1 -- 172.21.15.39:0/23155878 shutdown_connections 2023-11-28T11:59:52.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.042+0000 7fef68cfc700 1 -- 172.21.15.39:0/23155878 wait complete. 2023-11-28T11:59:52.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.042+0000 7fef68cfc700 1 Processor -- start 2023-11-28T11:59:52.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.042+0000 7fef68cfc700 1 -- start start 2023-11-28T11:59:52.050 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.046+0000 7fef68cfc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fef64069e00 0x7fef641f4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:52.050 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.046+0000 7fef68cfc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef64071aa0 0x7fef640cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:52.050 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.046+0000 7fef68cfc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef6415c640 0x7fef640ce060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:52.050 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.046+0000 7fef68cfc700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef640ce5a0 con 0x7fef64069e00 2023-11-28T11:59:52.050 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.046+0000 7fef68cfc700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef641f50d0 con 0x7fef64071aa0 2023-11-28T11:59:52.050 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.046+0000 7fef68cfc700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef640c8800 con 0x7fef6415c640 2023-11-28T11:59:52.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.046+0000 7fef637fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fef64069e00 0x7fef641f4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:52.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.046+0000 7fef637fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fef64069e00 0x7fef641f4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38544/0 (socket says 172.21.15.39:38544) 2023-11-28T11:59:52.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.046+0000 7fef637fe700 1 -- 172.21.15.39:0/4034847492 learned_addr learned my addr 172.21.15.39:0/4034847492 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:52.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.046+0000 7fef63fff700 1 --2- 172.21.15.39:0/4034847492 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef6415c640 0x7fef640ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:52.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.046+0000 7fef62ffd700 1 --2- 172.21.15.39:0/4034847492 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef64071aa0 0x7fef640cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:52.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.046+0000 7fef637fe700 1 -- 172.21.15.39:0/4034847492 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef6415c640 msgr2=0x7fef640ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:52.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.046+0000 7fef637fe700 1 --2- 172.21.15.39:0/4034847492 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef6415c640 0x7fef640ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:52.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.046+0000 7fef637fe700 1 -- 172.21.15.39:0/4034847492 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef64071aa0 msgr2=0x7fef640cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:52.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.046+0000 7fef637fe700 1 --2- 172.21.15.39:0/4034847492 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef64071aa0 0x7fef640cdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:52.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.046+0000 7fef637fe700 1 -- 172.21.15.39:0/4034847492 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5c009a70 con 0x7fef64069e00 2023-11-28T11:59:52.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.046+0000 7fef637fe700 1 --2- 172.21.15.39:0/4034847492 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fef64069e00 0x7fef641f4b90 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fef54009c30 tx=0x7fef54004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:52.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.050+0000 7fef4bfff700 1 -- 172.21.15.39:0/4034847492 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef54004450 con 0x7fef64069e00 2023-11-28T11:59:52.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.050+0000 7fef4bfff700 1 -- 172.21.15.39:0/4034847492 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5401f070 con 0x7fef64069e00 2023-11-28T11:59:52.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.050+0000 7fef68cfc700 1 -- 172.21.15.39:0/4034847492 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef54009570 con 0x7fef64069e00 2023-11-28T11:59:52.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.050+0000 7fef4bfff700 1 -- 172.21.15.39:0/4034847492 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef54003900 con 0x7fef64069e00 2023-11-28T11:59:52.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.050+0000 7fef68cfc700 1 -- 172.21.15.39:0/4034847492 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef64072010 con 0x7fef64069e00 2023-11-28T11:59:52.055 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.050+0000 7fef68cfc700 1 -- 172.21.15.39:0/4034847492 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef6415ca10 con 0x7fef64069e00 2023-11-28T11:59:52.057 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.054+0000 7fef4bfff700 1 -- 172.21.15.39:0/4034847492 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fef5400f050 con 0x7fef64069e00 2023-11-28T11:59:52.058 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.054+0000 7fef4bfff700 1 --2- 172.21.15.39:0/4034847492 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fef50064ee0 0x7fef50067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:52.059 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.054+0000 7fef4bfff700 1 -- 172.21.15.39:0/4034847492 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fef54021070 con 0x7fef64069e00 2023-11-28T11:59:52.059 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.054+0000 7fef62ffd700 1 --2- 172.21.15.39:0/4034847492 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fef50064ee0 0x7fef50067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:52.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.058+0000 7fef62ffd700 1 --2- 172.21.15.39:0/4034847492 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fef50064ee0 0x7fef50067390 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fef640a08d0 tx=0x7fef58009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:52.065 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.062+0000 7fef4bfff700 1 -- 172.21.15.39:0/4034847492 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fef54051630 con 0x7fef64069e00 2023-11-28T11:59:52.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.274+0000 7fef68cfc700 1 -- 172.21.15.39:0/4034847492 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fef6406c830 con 0x7fef64069e00 2023-11-28T11:59:52.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.274+0000 7fef4bfff700 1 -- 172.21.15.39:0/4034847492 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7fef54054c50 con 0x7fef64069e00 2023-11-28T11:59:52.277 INFO:teuthology.orchestra.run.smithi039.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T11:59:52.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.274+0000 7fef68cfc700 1 -- 172.21.15.39:0/4034847492 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fef50064ee0 msgr2=0x7fef50067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:52.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.274+0000 7fef68cfc700 1 --2- 172.21.15.39:0/4034847492 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fef50064ee0 0x7fef50067390 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fef640a08d0 tx=0x7fef58009240 comp rx=0 tx=0).stop 2023-11-28T11:59:52.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.274+0000 7fef68cfc700 1 -- 172.21.15.39:0/4034847492 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fef64069e00 msgr2=0x7fef641f4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:52.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.274+0000 7fef68cfc700 1 --2- 172.21.15.39:0/4034847492 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fef64069e00 0x7fef641f4b90 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fef54009c30 tx=0x7fef54004770 comp rx=0 tx=0).stop 2023-11-28T11:59:52.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.274+0000 7fef68cfc700 1 -- 172.21.15.39:0/4034847492 shutdown_connections 2023-11-28T11:59:52.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.274+0000 7fef68cfc700 1 --2- 172.21.15.39:0/4034847492 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef6415c640 0x7fef640ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:52.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.274+0000 7fef68cfc700 1 --2- 172.21.15.39:0/4034847492 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fef50064ee0 0x7fef50067390 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:52.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.274+0000 7fef68cfc700 1 --2- 172.21.15.39:0/4034847492 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef64071aa0 0x7fef640cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:52.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.278+0000 7fef68cfc700 1 --2- 172.21.15.39:0/4034847492 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fef64069e00 0x7fef641f4b90 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:52.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.278+0000 7fef68cfc700 1 -- 172.21.15.39:0/4034847492 >> 172.21.15.39:0/4034847492 conn(0x7fef640b6520 msgr2=0x7fef6406d310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:52.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.278+0000 7fef68cfc700 1 -- 172.21.15.39:0/4034847492 shutdown_connections 2023-11-28T11:59:52.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:52.278+0000 7fef68cfc700 1 -- 172.21.15.39:0/4034847492 wait complete. 2023-11-28T11:59:52.301 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-28T11:59:52.301 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T11:59:52.302 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi039.front.sepia.ceph.com 2023-11-28T11:59:52.302 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T11:59:52.302 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T11:59:52.302 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-28T11:59:52.302 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T11:59:52.302 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T11:59:52.302 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T11:59:52.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:59:52.302 DEBUG:teuthology.orchestra.run.smithi039:> ip addr 2023-11-28T11:59:52.319 INFO:teuthology.orchestra.run.smithi039.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T11:59:52.319 INFO:teuthology.orchestra.run.smithi039.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T11:59:52.319 INFO:teuthology.orchestra.run.smithi039.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T11:59:52.319 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:59:52.319 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 ::1/128 scope host 2023-11-28T11:59:52.319 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:59:52.319 INFO:teuthology.orchestra.run.smithi039.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:59:52.319 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c6 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:59:52.319 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f0 2023-11-28T11:59:52.319 INFO:teuthology.orchestra.run.smithi039.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T11:59:52.319 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:70 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:59:52.320 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f0 2023-11-28T11:59:52.320 INFO:teuthology.orchestra.run.smithi039.stdout: inet 172.21.15.39/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-28T11:59:52.320 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft 42183sec preferred_lft 42183sec 2023-11-28T11:59:52.320 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::ec4:7aff:febd:1370/64 scope link 2023-11-28T11:59:52.320 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:59:52.320 INFO:teuthology.orchestra.run.smithi039.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:59:52.320 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c7 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:59:52.320 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f1 2023-11-28T11:59:52.320 INFO:teuthology.orchestra.run.smithi039.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:59:52.320 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:71 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:59:52.320 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f1 2023-11-28T11:59:52.320 INFO:teuthology.orchestra.run.smithi039.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T11:59:52.321 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 02:42:df:e8:d2:63 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:59:52.321 INFO:teuthology.orchestra.run.smithi039.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T11:59:52.321 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:59:52.321 INFO:teuthology.orchestra.run.smithi039.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T11:59:52.321 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 82:c4:07:ce:89:23 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:59:52.321 INFO:teuthology.orchestra.run.smithi039.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T11:59:52.321 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:59:52.321 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::48e6:ebff:fe99:9ca6/64 scope link 2023-11-28T11:59:52.321 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:59:52.321 INFO:teuthology.orchestra.run.smithi039.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T11:59:52.321 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 82:c4:07:ce:89:23 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T11:59:52.321 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::80c4:7ff:fece:8923/64 scope link 2023-11-28T11:59:52.321 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:59:52.322 INFO:teuthology.orchestra.run.smithi039.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T11:59:52.322 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 9e:bb:6e:23:db:6b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T11:59:52.322 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::9cbb:6eff:fe23:db6b/64 scope link 2023-11-28T11:59:52.322 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:59:52.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:59:52.323 DEBUG:teuthology.orchestra.run.smithi039:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T11:59:52.401 INFO:teuthology.orchestra.run.smithi039.stdout:1 2023-11-28T11:59:52.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:59:52.404 DEBUG:teuthology.orchestra.run.smithi039:> route 2023-11-28T11:59:52.471 INFO:teuthology.orchestra.run.smithi039.stdout:Kernel IP routing table 2023-11-28T11:59:52.471 INFO:teuthology.orchestra.run.smithi039.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T11:59:52.472 INFO:teuthology.orchestra.run.smithi039.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-28T11:59:52.472 INFO:teuthology.orchestra.run.smithi039.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T11:59:52.472 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-28T11:59:52.472 INFO:teuthology.orchestra.run.smithi039.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T11:59:52.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:59:52.474 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2023-11-28T11:59:52.474 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2023-11-28T11:59:52.474 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-28T11:59:52.474 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-28T11:59:52.474 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-28T11:59:52.474 DEBUG:teuthology.orchestra.run.smithi039:> ') 2023-11-28T11:59:52.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:59:52.619 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2023-11-28T11:59:52.638 INFO:teuthology.orchestra.run.smithi039.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T11:59:52.638 INFO:teuthology.orchestra.run.smithi039.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-28T11:59:52.639 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T11:59:52.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:59:52.639 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set brx.0 up 2023-11-28T11:59:52.719 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:59:52.719 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T11:59:52.782 INFO:teuthology.orchestra.run.smithi039.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T11:59:52.783 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:59:52.783 DEBUG:teuthology.orchestra.run.smithi039:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T11:59:52.842 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-28T11:59:52.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:59:52.842 DEBUG:teuthology.orchestra.run.smithi039:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T11:59:52.983 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T11:59:52.983 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-28T11:59:52.983 INFO:teuthology.orchestra.run.smithi039.stdout:invalid new device string format 2023-11-28T11:59:53.014 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T11:59:53.014 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-28T11:59:53.014 INFO:teuthology.orchestra.run.smithi039.stdout:invalid new device string format 2023-11-28T11:59:53.014 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-11-28T11:59:53.014 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-28T11:59:53.030 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T11:59:53.030 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-28T11:59:53.030 INFO:teuthology.orchestra.run.smithi039.stdout:invalid new device string format 2023-11-28T11:59:53.030 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-11-28T11:59:53.030 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-28T11:59:53.030 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.39:6789,172.21.15.184:6789,172.21.15.184:6790" 2023-11-28T11:59:53.030 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.39:6789,172.21.15.184:6789,172.21.15.184:6790:/ 2023-11-28T11:59:53.031 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=67ce95b1-cd7e-4478-b863-c714ef275520" will pass to kernel 2023-11-28T11:59:53.036 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T11:59:53.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:59:53.036 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T11:59:53.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:59:53.067 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T11:59:53.152 INFO:teuthology.orchestra.run.smithi039.stdout:client6402 2023-11-28T11:59:53.152 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:59:53.153 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:59:53.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:59:53.220 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir_test) 2023-11-28T11:59:53.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:59:53.298 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir_test/file) 2023-11-28T11:59:53.366 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T11:59:53.367 DEBUG:teuthology.orchestra.run.smithi039:> import os 2023-11-28T11:59:53.367 DEBUG:teuthology.orchestra.run.smithi039:> import stat 2023-11-28T11:59:53.367 DEBUG:teuthology.orchestra.run.smithi039:> 2023-11-28T11:59:53.367 DEBUG:teuthology.orchestra.run.smithi039:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir_test/file").st_ino) 2023-11-28T11:59:53.367 DEBUG:teuthology.orchestra.run.smithi039:> ' 2023-11-28T11:59:53.511 INFO:teuthology.orchestra.run.smithi039.stdout:1099511627777 2023-11-28T11:59:53.700 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:59:53.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.937+0000 7f042f445700 1 Processor -- start 2023-11-28T11:59:53.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.937+0000 7f042f445700 1 -- start start 2023-11-28T11:59:53.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.941+0000 7f042f445700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f042815c1a0 0x7f042806c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:53.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.941+0000 7f042f445700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04280cdeb0 0x7f0428070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:53.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.941+0000 7f042f445700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04280adf90 con 0x7f04280705c0 2023-11-28T11:59:53.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.941+0000 7f042f445700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0428069bf0 con 0x7f042815c1a0 2023-11-28T11:59:53.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.941+0000 7f042f445700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0428070a40 con 0x7f04280cdeb0 2023-11-28T11:59:53.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.941+0000 7f042dc42700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04280cdeb0 0x7f0428070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:53.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.941+0000 7f042e443700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f042815c1a0 0x7f042806c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:53.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.941+0000 7f042e443700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f042815c1a0 0x7f042806c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:57192/0 (socket says 172.21.15.39:57192) 2023-11-28T11:59:53.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.941+0000 7f042e443700 1 -- 172.21.15.39:0/3426911369 learned_addr learned my addr 172.21.15.39:0/3426911369 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:53.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.941+0000 7f042dc42700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04280cdeb0 0x7f0428070080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:34490/0 (socket says 172.21.15.39:34490) 2023-11-28T11:59:53.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.941+0000 7f042e443700 1 -- 172.21.15.39:0/3426911369 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04280cdeb0 msgr2=0x7f0428070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:53.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.941+0000 7f042e443700 1 --2- 172.21.15.39:0/3426911369 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04280cdeb0 0x7f0428070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:53.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.941+0000 7f042e443700 1 -- 172.21.15.39:0/3426911369 >> v1:172.21.15.184:6789/0 conn(0x7f04280705c0 legacy=0x7f042815fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:53.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.941+0000 7f042e443700 1 -- 172.21.15.39:0/3426911369 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04280ce370 con 0x7f042815c1a0 2023-11-28T11:59:53.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.945+0000 7f042e443700 1 --2- 172.21.15.39:0/3426911369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f042815c1a0 0x7f042806c8b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0424009910 tx=0x7f0424009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca6f8cdd995770aa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:53.949 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.945+0000 7f042d441700 1 -- 172.21.15.39:0/3426911369 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0424011830 con 0x7f042815c1a0 2023-11-28T11:59:53.949 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.945+0000 7f042d441700 1 -- 172.21.15.39:0/3426911369 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0424011990 con 0x7f042815c1a0 2023-11-28T11:59:53.949 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.945+0000 7f042d441700 1 -- 172.21.15.39:0/3426911369 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0424011d40 con 0x7f042815c1a0 2023-11-28T11:59:53.950 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.945+0000 7f042f445700 1 -- 172.21.15.39:0/3426911369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f042815c1a0 msgr2=0x7f042806c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:53.950 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.945+0000 7f042f445700 1 --2- 172.21.15.39:0/3426911369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f042815c1a0 0x7f042806c8b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0424009910 tx=0x7f0424009c20 comp rx=0 tx=0).stop 2023-11-28T11:59:53.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.945+0000 7f042f445700 1 -- 172.21.15.39:0/3426911369 shutdown_connections 2023-11-28T11:59:53.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.945+0000 7f042f445700 1 --2- 172.21.15.39:0/3426911369 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04280cdeb0 0x7f0428070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:53.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.945+0000 7f042f445700 1 --2- 172.21.15.39:0/3426911369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f042815c1a0 0x7f042806c8b0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:53.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.945+0000 7f042f445700 1 -- 172.21.15.39:0/3426911369 >> 172.21.15.39:0/3426911369 conn(0x7f04280b0f80 msgr2=0x7f04280ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:53.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.945+0000 7f042f445700 1 -- 172.21.15.39:0/3426911369 shutdown_connections 2023-11-28T11:59:53.952 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.945+0000 7f042f445700 1 -- 172.21.15.39:0/3426911369 wait complete. 2023-11-28T11:59:53.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.949+0000 7f042f445700 1 Processor -- start 2023-11-28T11:59:53.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.949+0000 7f042f445700 1 -- start start 2023-11-28T11:59:53.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.949+0000 7f042f445700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04280705c0 0x7f0428153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:53.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.949+0000 7f042f445700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f04280cdeb0 0x7f04280c2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:53.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.949+0000 7f042f445700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f042815c1a0 0x7f04280c32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:53.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.949+0000 7f042f445700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0428154210 con 0x7f04280cdeb0 2023-11-28T11:59:53.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.949+0000 7f042f445700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04281f2bf0 con 0x7f04280705c0 2023-11-28T11:59:53.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.949+0000 7f042f445700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04280c38c0 con 0x7f042815c1a0 2023-11-28T11:59:53.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.953+0000 7f042dc42700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f04280cdeb0 0x7f04280c2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:53.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.953+0000 7f042dc42700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f04280cdeb0 0x7f04280c2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38548/0 (socket says 172.21.15.39:38548) 2023-11-28T11:59:53.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.953+0000 7f042e443700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04280705c0 0x7f0428153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:53.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.953+0000 7f042dc42700 1 -- 172.21.15.39:0/3838446403 learned_addr learned my addr 172.21.15.39:0/3838446403 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:53.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.953+0000 7f042ec44700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f042815c1a0 0x7f04280c32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:53.958 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.953+0000 7f042dc42700 1 -- 172.21.15.39:0/3838446403 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f042815c1a0 msgr2=0x7f04280c32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:53.958 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.953+0000 7f042dc42700 1 --2- 172.21.15.39:0/3838446403 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f042815c1a0 0x7f04280c32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:53.958 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.953+0000 7f042dc42700 1 -- 172.21.15.39:0/3838446403 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04280705c0 msgr2=0x7f0428153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:53.958 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.953+0000 7f042dc42700 1 --2- 172.21.15.39:0/3838446403 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04280705c0 0x7f0428153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:53.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.953+0000 7f042dc42700 1 -- 172.21.15.39:0/3838446403 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0424009570 con 0x7f04280cdeb0 2023-11-28T11:59:53.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.953+0000 7f042dc42700 1 --2- 172.21.15.39:0/3838446403 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f04280cdeb0 0x7f04280c2d90 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f041800e9a0 tx=0x7f041800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:53.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.953+0000 7f041effd700 1 -- 172.21.15.39:0/3838446403 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0418009720 con 0x7f04280cdeb0 2023-11-28T11:59:53.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.953+0000 7f041effd700 1 -- 172.21.15.39:0/3838446403 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041800c690 con 0x7f04280cdeb0 2023-11-28T11:59:53.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.953+0000 7f041effd700 1 -- 172.21.15.39:0/3838446403 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041800ca40 con 0x7f04280cdeb0 2023-11-28T11:59:53.960 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.953+0000 7f042f445700 1 -- 172.21.15.39:0/3838446403 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04280cc780 con 0x7f04280cdeb0 2023-11-28T11:59:53.960 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.953+0000 7f042f445700 1 -- 172.21.15.39:0/3838446403 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04280cc4a0 con 0x7f04280cdeb0 2023-11-28T11:59:53.960 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.957+0000 7f042f445700 1 -- 172.21.15.39:0/3838446403 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f042806cdf0 con 0x7f04280cdeb0 2023-11-28T11:59:53.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.957+0000 7f041effd700 1 -- 172.21.15.39:0/3838446403 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0418019030 con 0x7f04280cdeb0 2023-11-28T11:59:53.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.957+0000 7f041effd700 1 --2- 172.21.15.39:0/3838446403 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f040c064ee0 0x7f040c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:53.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.957+0000 7f041effd700 1 -- 172.21.15.39:0/3838446403 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0418081e40 con 0x7f04280cdeb0 2023-11-28T11:59:53.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.961+0000 7f042e443700 1 --2- 172.21.15.39:0/3838446403 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f040c064ee0 0x7f040c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:53.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.961+0000 7f042e443700 1 --2- 172.21.15.39:0/3838446403 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f040c064ee0 0x7f040c067390 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f0424000c00 tx=0x7f042401d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:53.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:53.965+0000 7f041effd700 1 -- 172.21.15.39:0/3838446403 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f041804fea0 con 0x7f04280cdeb0 2023-11-28T11:59:54.189 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.185+0000 7f042f445700 1 -- 172.21.15.39:0/3838446403 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0428073cb0 con 0x7f04280cdeb0 2023-11-28T11:59:54.190 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.185+0000 7f041effd700 1 -- 172.21.15.39:0/3838446403 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4653 (secure 0 0 0) 0x7f04180534c0 con 0x7f04280cdeb0 2023-11-28T11:59:54.190 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:59:54.191 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5645,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/3875262459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3875262459},{"type":"v1","addr":"172.21.15.184:6835","nonce":3875262459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5648,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/3845363738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3845363738},{"type":"v1","addr":"172.21.15.184:6837","nonce":3845363738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6225,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6834/2646905389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6833","nonce":2646905389},{"type":"v1","addr":"172.21.15.39:6834","nonce":2646905389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:59:45.290110+0000","modified":"2023-11-28T11:59:48.326013+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6244":{"gid":6244,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6835/990492858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":990492858},{"type":"v1","addr":"172.21.15.39:6835","nonce":990492858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T11:59:54.193 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.189+0000 7f042f445700 1 -- 172.21.15.39:0/3838446403 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f040c064ee0 msgr2=0x7f040c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:54.193 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.189+0000 7f042f445700 1 --2- 172.21.15.39:0/3838446403 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f040c064ee0 0x7f040c067390 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f0424000c00 tx=0x7f042401d040 comp rx=0 tx=0).stop 2023-11-28T11:59:54.193 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.189+0000 7f042f445700 1 -- 172.21.15.39:0/3838446403 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f04280cdeb0 msgr2=0x7f04280c2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:54.193 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.189+0000 7f042f445700 1 --2- 172.21.15.39:0/3838446403 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f04280cdeb0 0x7f04280c2d90 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f041800e9a0 tx=0x7f041800ecb0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.189+0000 7f042f445700 1 -- 172.21.15.39:0/3838446403 shutdown_connections 2023-11-28T11:59:54.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.189+0000 7f042f445700 1 --2- 172.21.15.39:0/3838446403 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f042815c1a0 0x7f04280c32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.189+0000 7f042f445700 1 --2- 172.21.15.39:0/3838446403 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f04280cdeb0 0x7f04280c2d90 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.189+0000 7f042f445700 1 --2- 172.21.15.39:0/3838446403 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f040c064ee0 0x7f040c067390 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.189+0000 7f042f445700 1 --2- 172.21.15.39:0/3838446403 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04280705c0 0x7f0428153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.189+0000 7f042f445700 1 -- 172.21.15.39:0/3838446403 >> 172.21.15.39:0/3838446403 conn(0x7f04280b0f80 msgr2=0x7f0428156840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:54.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.189+0000 7f042f445700 1 -- 172.21.15.39:0/3838446403 shutdown_connections 2023-11-28T11:59:54.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.189+0000 7f042f445700 1 -- 172.21.15.39:0/3838446403 wait complete. 2023-11-28T11:59:54.195 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 32 2023-11-28T11:59:54.216 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2023-11-28T11:59:54.426 INFO:teuthology.orchestra.run.smithi039.stdout:{"message":"","return_code":0} 2023-11-28T11:59:54.427 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-11-28T11:59:54.427 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2023-11-28T11:59:54.494 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.489+0000 7f506b560140 1 Processor -- start 2023-11-28T11:59:54.494 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.489+0000 7f506b560140 1 -- start start 2023-11-28T11:59:54.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.489+0000 7f506b560140 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c81e488700 0x55c81e54cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:54.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.489+0000 7f506b560140 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c81e4bb980 0x55c81e5498f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:54.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.489+0000 7f506b560140 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c81e546830 0x55c81e545820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:54.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.489+0000 7f506b560140 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c81e3b0240 con 0x55c81e488700 2023-11-28T11:59:54.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.489+0000 7f506b560140 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c81e54e2f0 con 0x55c81e4bb980 2023-11-28T11:59:54.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.489+0000 7f506b560140 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c81e54bde0 con 0x55c81e546830 2023-11-28T11:59:54.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.489+0000 7f5069095700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c81e488700 0x55c81e54cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:54.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.489+0000 7f5069896700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c81e546830 0x55c81e545820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:54.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.489+0000 7f5069896700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c81e546830 0x55c81e545820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:34514/0 (socket says 172.21.15.39:34514) 2023-11-28T11:59:54.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.489+0000 7f5069896700 1 -- 172.21.15.39:0/2642965607 learned_addr learned my addr 172.21.15.39:0/2642965607 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:54.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.489+0000 7f5068894700 1 --2- 172.21.15.39:0/2642965607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c81e4bb980 0x55c81e5498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:54.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.489+0000 7f5069896700 1 -- 172.21.15.39:0/2642965607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c81e4bb980 msgr2=0x55c81e5498f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:54.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.489+0000 7f5069896700 1 --2- 172.21.15.39:0/2642965607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c81e4bb980 0x55c81e5498f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.489+0000 7f5069896700 1 -- 172.21.15.39:0/2642965607 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c81e488700 msgr2=0x55c81e54cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:54.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.489+0000 7f5069896700 1 --2- 172.21.15.39:0/2642965607 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c81e488700 0x55c81e54cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.489+0000 7f5069896700 1 -- 172.21.15.39:0/2642965607 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5060005de0 con 0x55c81e546830 2023-11-28T11:59:54.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.489+0000 7f5069095700 1 --2- 172.21.15.39:0/2642965607 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c81e488700 0x55c81e54cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:54.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.493+0000 7f5069896700 1 --2- 172.21.15.39:0/2642965607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c81e546830 0x55c81e545820 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5064001400 tx=0x7f5064001710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=776809efc12a721a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:54.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.493+0000 7f505b7fe700 1 -- 172.21.15.39:0/2642965607 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5064011600 con 0x55c81e546830 2023-11-28T11:59:54.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.493+0000 7f505b7fe700 1 -- 172.21.15.39:0/2642965607 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5064011780 con 0x55c81e546830 2023-11-28T11:59:54.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.493+0000 7f505b7fe700 1 -- 172.21.15.39:0/2642965607 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5064011b30 con 0x55c81e546830 2023-11-28T11:59:54.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.493+0000 7f506b560140 1 -- 172.21.15.39:0/2642965607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c81e546830 msgr2=0x55c81e545820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:54.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.493+0000 7f506b560140 1 --2- 172.21.15.39:0/2642965607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c81e546830 0x55c81e545820 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5064001400 tx=0x7f5064001710 comp rx=0 tx=0).stop 2023-11-28T11:59:54.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.493+0000 7f506b560140 1 -- 172.21.15.39:0/2642965607 shutdown_connections 2023-11-28T11:59:54.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.493+0000 7f506b560140 1 --2- 172.21.15.39:0/2642965607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c81e546830 0x55c81e545820 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.493+0000 7f506b560140 1 --2- 172.21.15.39:0/2642965607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c81e4bb980 0x55c81e5498f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.493+0000 7f506b560140 1 --2- 172.21.15.39:0/2642965607 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c81e488700 0x55c81e54cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.493+0000 7f506b560140 1 -- 172.21.15.39:0/2642965607 >> 172.21.15.39:0/2642965607 conn(0x55c81e48ec30 msgr2=0x55c81e548f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:54.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.493+0000 7f506b560140 1 -- 172.21.15.39:0/2642965607 shutdown_connections 2023-11-28T11:59:54.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.493+0000 7f506b560140 1 -- 172.21.15.39:0/2642965607 wait complete. 2023-11-28T11:59:54.500 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.493+0000 7f506b560140 1 Processor -- start 2023-11-28T11:59:54.500 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.493+0000 7f506b560140 1 -- start start 2023-11-28T11:59:54.501 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.497+0000 7f506b560140 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c81e488700 0x55c81e48d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:54.501 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.497+0000 7f506b560140 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c81e4bb980 0x55c81e4b8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:54.501 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.497+0000 7f506b560140 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c81e546830 0x55c81e544c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:54.501 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.497+0000 7f506b560140 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c81e48e750 con 0x55c81e546830 2023-11-28T11:59:54.502 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.497+0000 7f506b560140 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c81e5f2560 con 0x55c81e488700 2023-11-28T11:59:54.502 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.497+0000 7f506b560140 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c81e48df70 con 0x55c81e4bb980 2023-11-28T11:59:54.503 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.497+0000 7f5069896700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c81e546830 0x55c81e544c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:54.503 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.497+0000 7f5069896700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c81e546830 0x55c81e544c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38562/0 (socket says 172.21.15.39:38562) 2023-11-28T11:59:54.503 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.497+0000 7f5069896700 1 -- 172.21.15.39:0/3733162619 learned_addr learned my addr 172.21.15.39:0/3733162619 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:54.503 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.497+0000 7f5068894700 1 --2- 172.21.15.39:0/3733162619 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c81e4bb980 0x55c81e4b8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:54.503 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.497+0000 7f5069095700 1 --2- 172.21.15.39:0/3733162619 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c81e488700 0x55c81e48d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:54.503 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.497+0000 7f5069896700 1 -- 172.21.15.39:0/3733162619 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c81e4bb980 msgr2=0x55c81e4b8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:54.503 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.497+0000 7f5069896700 1 --2- 172.21.15.39:0/3733162619 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c81e4bb980 0x55c81e4b8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.503 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.497+0000 7f5069896700 1 -- 172.21.15.39:0/3733162619 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c81e488700 msgr2=0x55c81e48d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:54.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.497+0000 7f5069896700 1 --2- 172.21.15.39:0/3733162619 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c81e488700 0x55c81e48d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.497+0000 7f5069896700 1 -- 172.21.15.39:0/3733162619 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f505c009430 con 0x55c81e546830 2023-11-28T11:59:54.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.497+0000 7f5069095700 1 --2- 172.21.15.39:0/3733162619 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c81e488700 0x55c81e48d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:54.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.497+0000 7f5069896700 1 --2- 172.21.15.39:0/3733162619 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c81e546830 0x55c81e544c10 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x55c81e54bf20 tx=0x7f5064000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:54.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.497+0000 7f505a7fc700 1 -- 172.21.15.39:0/3733162619 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5064004120 con 0x55c81e546830 2023-11-28T11:59:54.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.497+0000 7f505a7fc700 1 -- 172.21.15.39:0/3733162619 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506401d480 con 0x55c81e546830 2023-11-28T11:59:54.505 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.497+0000 7f506b560140 1 -- 172.21.15.39:0/3733162619 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c81e3bb520 con 0x55c81e546830 2023-11-28T11:59:54.505 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.497+0000 7f505a7fc700 1 -- 172.21.15.39:0/3733162619 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506401d810 con 0x55c81e546830 2023-11-28T11:59:54.505 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.497+0000 7f506b560140 1 -- 172.21.15.39:0/3733162619 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c81e3c8390 con 0x55c81e546830 2023-11-28T11:59:54.507 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.501+0000 7f505a7fc700 1 -- 172.21.15.39:0/3733162619 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f506400f070 con 0x55c81e546830 2023-11-28T11:59:54.508 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.505+0000 7f505a7fc700 1 --2- 172.21.15.39:0/3733162619 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f504c063810 0x7f504c065cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:54.508 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.505+0000 7f505a7fc700 1 -- 172.21.15.39:0/3733162619 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f5064081600 con 0x55c81e546830 2023-11-28T11:59:54.509 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.505+0000 7f506b560140 1 --2- 172.21.15.39:0/3733162619 >> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] conn(0x55c81e5f3db0 0x55c81e5f41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:54.509 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.505+0000 7f506b560140 1 -- 172.21.15.39:0/3733162619 --> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] -- osd_op(unknown.0.0:1 11.7 11:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70) v8 -- 0x55c81e5f46f0 con 0x55c81e5f3db0 2023-11-28T11:59:54.509 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.505+0000 7f5069095700 1 --2- 172.21.15.39:0/3733162619 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f504c063810 0x7f504c065cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:54.509 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.505+0000 7f5068894700 1 --2- 172.21.15.39:0/3733162619 >> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] conn(0x55c81e5f3db0 0x55c81e5f41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:54.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.505+0000 7f5069095700 1 --2- 172.21.15.39:0/3733162619 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f504c063810 0x7f504c065cc0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f505c005fd0 tx=0x7f505c00c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:54.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.505+0000 7f5068894700 1 --2- 172.21.15.39:0/3733162619 >> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] conn(0x55c81e5f3db0 0x55c81e5f41b0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:54.511 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.505+0000 7f5068894700 1 -- 172.21.15.39:0/3733162619 <== osd.5 v2:172.21.15.184:6808/36505 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (94) out=94b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+94 (crc 0 0 0) 0x7f5060019040 con 0x55c81e5f3db0 2023-11-28T11:59:54.511 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.505+0000 7f506b560140 1 -- 172.21.15.39:0/3733162619 >> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] conn(0x55c81e5f3db0 msgr2=0x55c81e5f41b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:54.511 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.505+0000 7f506b560140 1 --2- 172.21.15.39:0/3733162619 >> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] conn(0x55c81e5f3db0 0x55c81e5f41b0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.505+0000 7f506b560140 1 -- 172.21.15.39:0/3733162619 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f504c063810 msgr2=0x7f504c065cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:54.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.505+0000 7f506b560140 1 --2- 172.21.15.39:0/3733162619 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f504c063810 0x7f504c065cc0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f505c005fd0 tx=0x7f505c00c040 comp rx=0 tx=0).stop 2023-11-28T11:59:54.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.505+0000 7f506b560140 1 -- 172.21.15.39:0/3733162619 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c81e546830 msgr2=0x55c81e544c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:54.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.505+0000 7f506b560140 1 --2- 172.21.15.39:0/3733162619 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c81e546830 0x55c81e544c10 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x55c81e54bf20 tx=0x7f5064000f40 comp rx=0 tx=0).stop 2023-11-28T11:59:54.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.505+0000 7f5069896700 1 -- 172.21.15.39:0/3733162619 reap_dead start 2023-11-28T11:59:54.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.505+0000 7f506b560140 1 -- 172.21.15.39:0/3733162619 shutdown_connections 2023-11-28T11:59:54.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.505+0000 7f506b560140 1 -- 172.21.15.39:0/3733162619 >> 172.21.15.39:0/3733162619 conn(0x55c81e48ec30 msgr2=0x55c81e54cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:54.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.505+0000 7f506b560140 1 -- 172.21.15.39:0/3733162619 shutdown_connections 2023-11-28T11:59:54.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.509+0000 7f506b560140 1 -- 172.21.15.39:0/3733162619 wait complete. 2023-11-28T11:59:54.520 INFO:teuthology.orchestra.run.smithi039.stdout:Xfiledir_test 2023-11-28T11:59:54.520 DEBUG:teuthology.orchestra.run.smithi039:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2023-11-28T11:59:54.605 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2023-11-28T11:59:54.605 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511627777, 2023-11-28T11:59:54.605 INFO:teuthology.orchestra.run.smithi039.stdout: "ancestors": [ 2023-11-28T11:59:54.605 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:59:54.605 INFO:teuthology.orchestra.run.smithi039.stdout: "dirino": 1099511627776, 2023-11-28T11:59:54.606 INFO:teuthology.orchestra.run.smithi039.stdout: "dname": "file", 2023-11-28T11:59:54.606 INFO:teuthology.orchestra.run.smithi039.stdout: "version": 2 2023-11-28T11:59:54.606 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-11-28T11:59:54.606 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:59:54.606 INFO:teuthology.orchestra.run.smithi039.stdout: "dirino": 1, 2023-11-28T11:59:54.606 INFO:teuthology.orchestra.run.smithi039.stdout: "dname": "dir_test", 2023-11-28T11:59:54.606 INFO:teuthology.orchestra.run.smithi039.stdout: "version": 4 2023-11-28T11:59:54.606 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:59:54.607 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2023-11-28T11:59:54.607 INFO:teuthology.orchestra.run.smithi039.stdout: "pool": 11, 2023-11-28T11:59:54.607 INFO:teuthology.orchestra.run.smithi039.stdout: "old_pools": [] 2023-11-28T11:59:54.607 INFO:teuthology.orchestra.run.smithi039.stdout:} 2023-11-28T11:59:54.607 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:59:54.612 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'The backtrace is corrupted' 2023-11-28T11:59:54.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.725+0000 7f84897dd140 1 Processor -- start 2023-11-28T11:59:54.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.725+0000 7f84897dd140 1 -- start start 2023-11-28T11:59:54.732 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.725+0000 7f84897dd140 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a17335a710 0x55a1734c02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:54.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.725+0000 7f84897dd140 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a17338d990 0x55a173383fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:54.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.725+0000 7f84897dd140 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a173418f50 0x55a173381e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:54.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.725+0000 7f84897dd140 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a173282240 con 0x55a17338d990 2023-11-28T11:59:54.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.725+0000 7f84897dd140 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a173384860 con 0x55a173418f50 2023-11-28T11:59:54.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.725+0000 7f84897dd140 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a173384b00 con 0x55a17335a710 2023-11-28T11:59:54.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.725+0000 7f8486b11700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a17338d990 0x55a173383fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:54.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.725+0000 7f8486b11700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a17338d990 0x55a173383fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38588/0 (socket says 172.21.15.39:38588) 2023-11-28T11:59:54.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.725+0000 7f8486b11700 1 -- 172.21.15.39:0/1527477056 learned_addr learned my addr 172.21.15.39:0/1527477056 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:54.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.725+0000 7f8487b13700 1 --2- 172.21.15.39:0/1527477056 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a173418f50 0x55a173381e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:54.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.725+0000 7f8487312700 1 --2- 172.21.15.39:0/1527477056 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a17335a710 0x55a1734c02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:54.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.729+0000 7f8486b11700 1 -- 172.21.15.39:0/1527477056 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a17335a710 msgr2=0x55a1734c02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:54.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.729+0000 7f8486b11700 1 --2- 172.21.15.39:0/1527477056 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a17335a710 0x55a1734c02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.729+0000 7f8486b11700 1 -- 172.21.15.39:0/1527477056 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a173418f50 msgr2=0x55a173381e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:54.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.729+0000 7f8486b11700 1 --2- 172.21.15.39:0/1527477056 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a173418f50 0x55a173381e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.729+0000 7f8486b11700 1 -- 172.21.15.39:0/1527477056 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f848000a1c0 con 0x55a17338d990 2023-11-28T11:59:54.737 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.729+0000 7f8486b11700 1 --2- 172.21.15.39:0/1527477056 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a17338d990 0x55a173383fc0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f847c00b2c0 tx=0x7f847c00b5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a436ae8b73395f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:54.737 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.729+0000 7f8485b0f700 1 -- 172.21.15.39:0/1527477056 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f847c014070 con 0x55a17338d990 2023-11-28T11:59:54.737 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.729+0000 7f8485b0f700 1 -- 172.21.15.39:0/1527477056 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f847c00f3f0 con 0x55a17338d990 2023-11-28T11:59:54.737 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.729+0000 7f8485b0f700 1 -- 172.21.15.39:0/1527477056 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f847c00f7a0 con 0x55a17338d990 2023-11-28T11:59:54.737 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.729+0000 7f84897dd140 1 -- 172.21.15.39:0/1527477056 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a17338d990 msgr2=0x55a173383fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:54.737 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.729+0000 7f84897dd140 1 --2- 172.21.15.39:0/1527477056 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a17338d990 0x55a173383fc0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f847c00b2c0 tx=0x7f847c00b5d0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.738 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.729+0000 7f84897dd140 1 -- 172.21.15.39:0/1527477056 shutdown_connections 2023-11-28T11:59:54.738 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.729+0000 7f84897dd140 1 --2- 172.21.15.39:0/1527477056 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a173418f50 0x55a173381e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.738 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.729+0000 7f84897dd140 1 --2- 172.21.15.39:0/1527477056 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a17338d990 0x55a173383fc0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.738 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.729+0000 7f84897dd140 1 --2- 172.21.15.39:0/1527477056 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a17335a710 0x55a1734c02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.738 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.729+0000 7f84897dd140 1 -- 172.21.15.39:0/1527477056 >> 172.21.15.39:0/1527477056 conn(0x55a173360c40 msgr2=0x55a1733a85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:54.738 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.729+0000 7f84897dd140 1 -- 172.21.15.39:0/1527477056 shutdown_connections 2023-11-28T11:59:54.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.729+0000 7f84897dd140 1 -- 172.21.15.39:0/1527477056 wait complete. 2023-11-28T11:59:54.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.729+0000 7f84897dd140 1 Processor -- start 2023-11-28T11:59:54.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.729+0000 7f84897dd140 1 -- start start 2023-11-28T11:59:54.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.733+0000 7f84897dd140 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a17335a710 0x55a1734bafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:54.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.733+0000 7f84897dd140 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a173418f50 0x55a1734bf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:54.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.733+0000 7f84897dd140 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a173388960 0x55a1734177d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:54.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.733+0000 7f84897dd140 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1734bfee0 con 0x55a17335a710 2023-11-28T11:59:54.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.733+0000 7f84897dd140 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1734c1970 con 0x55a173388960 2023-11-28T11:59:54.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.733+0000 7f84897dd140 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a1734c1c10 con 0x55a173418f50 2023-11-28T11:59:54.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.733+0000 7f8487312700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a17335a710 0x55a1734bafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:54.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.733+0000 7f8487312700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a17335a710 0x55a1734bafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38602/0 (socket says 172.21.15.39:38602) 2023-11-28T11:59:54.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.733+0000 7f8487312700 1 -- 172.21.15.39:0/3292500819 learned_addr learned my addr 172.21.15.39:0/3292500819 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:54.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.733+0000 7f8486b11700 1 --2- 172.21.15.39:0/3292500819 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a173418f50 0x55a1734bf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:54.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.733+0000 7f8487b13700 1 --2- 172.21.15.39:0/3292500819 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a173388960 0x55a1734177d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:54.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.733+0000 7f8487312700 1 -- 172.21.15.39:0/3292500819 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a173418f50 msgr2=0x55a1734bf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:54.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.733+0000 7f8487312700 1 --2- 172.21.15.39:0/3292500819 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a173418f50 0x55a1734bf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.733+0000 7f8487312700 1 -- 172.21.15.39:0/3292500819 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a173388960 msgr2=0x55a1734177d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:54.744 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.733+0000 7f8487312700 1 --2- 172.21.15.39:0/3292500819 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a173388960 0x55a1734177d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.744 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.733+0000 7f8487312700 1 -- 172.21.15.39:0/3292500819 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f847c001ba0 con 0x55a17335a710 2023-11-28T11:59:54.744 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.733+0000 7f8486b11700 1 --2- 172.21.15.39:0/3292500819 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a173418f50 0x55a1734bf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:54.744 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.733+0000 7f8487b13700 1 --2- 172.21.15.39:0/3292500819 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a173388960 0x55a1734177d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:54.744 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.733+0000 7f8487312700 1 --2- 172.21.15.39:0/3292500819 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a17335a710 0x55a1734bafe0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f8478008400 tx=0x7f84780087c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:54.744 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.733+0000 7f8484b0d700 1 -- 172.21.15.39:0/3292500819 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f847800f050 con 0x55a17335a710 2023-11-28T11:59:54.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.733+0000 7f8484b0d700 1 -- 172.21.15.39:0/3292500819 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8478010040 con 0x55a17335a710 2023-11-28T11:59:54.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.733+0000 7f8484b0d700 1 -- 172.21.15.39:0/3292500819 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8478014a30 con 0x55a17335a710 2023-11-28T11:59:54.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.733+0000 7f84897dd140 1 -- 172.21.15.39:0/3292500819 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a17329a390 con 0x55a17335a710 2023-11-28T11:59:54.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.733+0000 7f84897dd140 1 -- 172.21.15.39:0/3292500819 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a17328d8b0 con 0x55a17335a710 2023-11-28T11:59:54.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.737+0000 7f8484b0d700 1 -- 172.21.15.39:0/3292500819 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8478014b90 con 0x55a17335a710 2023-11-28T11:59:54.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.741+0000 7f8484b0d700 1 --2- 172.21.15.39:0/3292500819 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8474063810 0x7f8474065cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:54.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.741+0000 7f8484b0d700 1 -- 172.21.15.39:0/3292500819 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8478081410 con 0x55a17335a710 2023-11-28T11:59:54.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.741+0000 7f8486b11700 1 --2- 172.21.15.39:0/3292500819 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8474063810 0x7f8474065cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:54.747 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.741+0000 7f84897dd140 1 --2- 172.21.15.39:0/3292500819 >> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] conn(0x55a173417d10 0x55a1734c25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:54.747 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.741+0000 7f84897dd140 1 -- 172.21.15.39:0/3292500819 --> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] -- osd_op(unknown.0.0:1 11.7 11:e2e07930:::10000000001.00000000:head [setxattr parent (26) in=32b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70) v8 -- 0x55a1734c2b30 con 0x55a173417d10 2023-11-28T11:59:54.747 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.741+0000 7f8487b13700 1 --2- 172.21.15.39:0/3292500819 >> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] conn(0x55a173417d10 0x55a1734c25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:54.748 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.741+0000 7f8486b11700 1 --2- 172.21.15.39:0/3292500819 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8474063810 0x7f8474065cc0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x55a17338f770 tx=0x7f847c009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:54.748 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.741+0000 7f8487b13700 1 --2- 172.21.15.39:0/3292500819 >> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] conn(0x55a173417d10 0x55a1734c25f0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:54.751 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.745+0000 7f8487b13700 1 -- 172.21.15.39:0/3292500819 <== osd.5 v2:172.21.15.184:6808/36505 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (26)] v70'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f8480017040 con 0x55a173417d10 2023-11-28T11:59:54.751 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.745+0000 7f84897dd140 1 -- 172.21.15.39:0/3292500819 >> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] conn(0x55a173417d10 msgr2=0x55a1734c25f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:54.752 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.745+0000 7f84897dd140 1 --2- 172.21.15.39:0/3292500819 >> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] conn(0x55a173417d10 0x55a1734c25f0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.752 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.745+0000 7f84897dd140 1 -- 172.21.15.39:0/3292500819 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8474063810 msgr2=0x7f8474065cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:54.752 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.745+0000 7f84897dd140 1 --2- 172.21.15.39:0/3292500819 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f8474063810 0x7f8474065cc0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x55a17338f770 tx=0x7f847c009000 comp rx=0 tx=0).stop 2023-11-28T11:59:54.752 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.745+0000 7f84897dd140 1 -- 172.21.15.39:0/3292500819 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a17335a710 msgr2=0x55a1734bafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:54.752 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.745+0000 7f84897dd140 1 --2- 172.21.15.39:0/3292500819 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a17335a710 0x55a1734bafe0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f8478008400 tx=0x7f84780087c0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.752 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.745+0000 7f8487b13700 1 -- 172.21.15.39:0/3292500819 reap_dead start 2023-11-28T11:59:54.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.745+0000 7f84897dd140 1 -- 172.21.15.39:0/3292500819 shutdown_connections 2023-11-28T11:59:54.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.745+0000 7f84897dd140 1 -- 172.21.15.39:0/3292500819 >> 172.21.15.39:0/3292500819 conn(0x55a173360c40 msgr2=0x55a173361010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:54.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.745+0000 7f84897dd140 1 -- 172.21.15.39:0/3292500819 shutdown_connections 2023-11-28T11:59:54.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.745+0000 7f84897dd140 1 -- 172.21.15.39:0/3292500819 wait complete. 2023-11-28T11:59:54.758 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub start / recursive 2023-11-28T11:59:54.952 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.945+0000 7fdc649fb700 1 Processor -- start 2023-11-28T11:59:54.952 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.945+0000 7fdc649fb700 1 -- start start 2023-11-28T11:59:54.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.949+0000 7fdc649fb700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fdc600b1da0 0x7fdc600b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:54.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.949+0000 7fdc649fb700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fdc600b3610 0x7fdc600cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:54.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.949+0000 7fdc649fb700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc600cb350 0x7fdc600ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:54.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.949+0000 7fdc649fb700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc600b2170 con 0x7fdc600b1da0 2023-11-28T11:59:54.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.949+0000 7fdc649fb700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc600b4a40 con 0x7fdc600b3610 2023-11-28T11:59:54.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.949+0000 7fdc649fb700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc60061210 con 0x7fdc600cb350 2023-11-28T11:59:54.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.949+0000 7fdc5ed9d700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fdc600b1da0 0x7fdc600b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:54.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.949+0000 7fdc5ed9d700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fdc600b1da0 0x7fdc600b4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38616/0 (socket says 172.21.15.39:38616) 2023-11-28T11:59:54.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.949+0000 7fdc5ed9d700 1 -- 172.21.15.39:0/4234446514 learned_addr learned my addr 172.21.15.39:0/4234446514 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:54.955 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.949+0000 7fdc5e59c700 1 --2- 172.21.15.39:0/4234446514 >> v2:172.21.15.184:3300/0 conn(0x7fdc600b3610 0x7fdc600cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:54.955 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.949+0000 7fdc5f59e700 1 --2- 172.21.15.39:0/4234446514 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc600cb350 0x7fdc600ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:54.955 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.949+0000 7fdc5ed9d700 1 -- 172.21.15.39:0/4234446514 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc600cb350 msgr2=0x7fdc600ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:54.955 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.949+0000 7fdc5ed9d700 1 --2- 172.21.15.39:0/4234446514 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc600cb350 0x7fdc600ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.955 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.949+0000 7fdc5ed9d700 1 -- 172.21.15.39:0/4234446514 >> v2:172.21.15.184:3300/0 conn(0x7fdc600b3610 msgr2=0x7fdc600cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:54.955 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.949+0000 7fdc5ed9d700 1 --2- 172.21.15.39:0/4234446514 >> v2:172.21.15.184:3300/0 conn(0x7fdc600b3610 0x7fdc600cae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.955 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.949+0000 7fdc5ed9d700 1 -- 172.21.15.39:0/4234446514 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6015a7d0 con 0x7fdc600b1da0 2023-11-28T11:59:54.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.949+0000 7fdc5ed9d700 1 --2- 172.21.15.39:0/4234446514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc600b1da0 0x7fdc600b4500 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fdc6006dab0 tx=0x7fdc50009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8216c071bf10064a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:54.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.949+0000 7fdc5dd9b700 1 -- 172.21.15.39:0/4234446514 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5000b8a0 con 0x7fdc600b1da0 2023-11-28T11:59:54.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.949+0000 7fdc5dd9b700 1 -- 172.21.15.39:0/4234446514 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5000ba00 con 0x7fdc600b1da0 2023-11-28T11:59:54.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.949+0000 7fdc5dd9b700 1 -- 172.21.15.39:0/4234446514 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5000bd90 con 0x7fdc600b1da0 2023-11-28T11:59:54.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.953+0000 7fdc649fb700 1 -- 172.21.15.39:0/4234446514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc600b1da0 msgr2=0x7fdc600b4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:54.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.953+0000 7fdc649fb700 1 --2- 172.21.15.39:0/4234446514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc600b1da0 0x7fdc600b4500 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fdc6006dab0 tx=0x7fdc50009bf0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.953+0000 7fdc649fb700 1 -- 172.21.15.39:0/4234446514 shutdown_connections 2023-11-28T11:59:54.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.953+0000 7fdc649fb700 1 --2- 172.21.15.39:0/4234446514 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc600cb350 0x7fdc600ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.953+0000 7fdc649fb700 1 --2- 172.21.15.39:0/4234446514 >> v2:172.21.15.184:3300/0 conn(0x7fdc600b3610 0x7fdc600cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.953+0000 7fdc649fb700 1 --2- 172.21.15.39:0/4234446514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc600b1da0 0x7fdc600b4500 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.958 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.953+0000 7fdc649fb700 1 -- 172.21.15.39:0/4234446514 >> 172.21.15.39:0/4234446514 conn(0x7fdc60089f70 msgr2=0x7fdc600d07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:54.958 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.953+0000 7fdc649fb700 1 -- 172.21.15.39:0/4234446514 shutdown_connections 2023-11-28T11:59:54.958 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.953+0000 7fdc649fb700 1 -- 172.21.15.39:0/4234446514 wait complete. 2023-11-28T11:59:54.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.953+0000 7fdc649fb700 1 Processor -- start 2023-11-28T11:59:54.960 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.953+0000 7fdc649fb700 1 -- start start 2023-11-28T11:59:54.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.957+0000 7fdc649fb700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc600b1da0 0x7fdc601f4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:54.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.957+0000 7fdc649fb700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc600b3610 0x7fdc600c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:54.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.957+0000 7fdc649fb700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc600cb350 0x7fdc6015c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:54.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.957+0000 7fdc649fb700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc600c9930 con 0x7fdc600b3610 2023-11-28T11:59:54.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.957+0000 7fdc649fb700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc600c8d20 con 0x7fdc600b1da0 2023-11-28T11:59:54.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.957+0000 7fdc649fb700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc600c9000 con 0x7fdc600cb350 2023-11-28T11:59:54.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.957+0000 7fdc5e59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc600b3610 0x7fdc600c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:54.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.957+0000 7fdc5e59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc600b3610 0x7fdc600c82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38624/0 (socket says 172.21.15.39:38624) 2023-11-28T11:59:54.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.957+0000 7fdc5e59c700 1 -- 172.21.15.39:0/2661522570 learned_addr learned my addr 172.21.15.39:0/2661522570 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:54.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.957+0000 7fdc5ed9d700 1 --2- 172.21.15.39:0/2661522570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc600b1da0 0x7fdc601f4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:54.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.957+0000 7fdc5f59e700 1 --2- 172.21.15.39:0/2661522570 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc600cb350 0x7fdc6015c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:54.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.957+0000 7fdc5e59c700 1 -- 172.21.15.39:0/2661522570 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc600cb350 msgr2=0x7fdc6015c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:54.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.957+0000 7fdc5e59c700 1 --2- 172.21.15.39:0/2661522570 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc600cb350 0x7fdc6015c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.957+0000 7fdc5e59c700 1 -- 172.21.15.39:0/2661522570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc600b1da0 msgr2=0x7fdc601f4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:54.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.957+0000 7fdc5e59c700 1 --2- 172.21.15.39:0/2661522570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc600b1da0 0x7fdc601f4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.957+0000 7fdc5e59c700 1 -- 172.21.15.39:0/2661522570 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc50009570 con 0x7fdc600b3610 2023-11-28T11:59:54.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.957+0000 7fdc5e59c700 1 --2- 172.21.15.39:0/2661522570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc600b3610 0x7fdc600c82a0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fdc5400e810 tx=0x7fdc5400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:54.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.957+0000 7fdc477fe700 1 -- 172.21.15.39:0/2661522570 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5400c070 con 0x7fdc600b3610 2023-11-28T11:59:54.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.957+0000 7fdc477fe700 1 -- 172.21.15.39:0/2661522570 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc54013610 con 0x7fdc600b3610 2023-11-28T11:59:54.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.957+0000 7fdc649fb700 1 -- 172.21.15.39:0/2661522570 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc600b4f10 con 0x7fdc600b3610 2023-11-28T11:59:54.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.957+0000 7fdc477fe700 1 -- 172.21.15.39:0/2661522570 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc540139a0 con 0x7fdc600b3610 2023-11-28T11:59:54.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.957+0000 7fdc649fb700 1 -- 172.21.15.39:0/2661522570 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc600b4c30 con 0x7fdc600b3610 2023-11-28T11:59:54.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.961+0000 7fdc477fe700 1 -- 172.21.15.39:0/2661522570 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdc54023070 con 0x7fdc600b3610 2023-11-28T11:59:54.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.965+0000 7fdc477fe700 1 --2- 172.21.15.39:0/2661522570 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fdc4c064ee0 0x7fdc4c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:54.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.965+0000 7fdc477fe700 1 -- 172.21.15.39:0/2661522570 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fdc54081d30 con 0x7fdc600b3610 2023-11-28T11:59:54.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.965+0000 7fdc5ed9d700 1 --2- 172.21.15.39:0/2661522570 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fdc4c064ee0 0x7fdc4c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:54.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.965+0000 7fdc5ed9d700 1 --2- 172.21.15.39:0/2661522570 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fdc4c064ee0 0x7fdc4c067390 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fdc50000c00 tx=0x7fdc50008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:54.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.965+0000 7fdc68489740 1 Processor -- start 2023-11-28T11:59:54.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.969+0000 7fdc68489740 1 -- start start 2023-11-28T11:59:54.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.969+0000 7fdc68489740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x2695d10 0x2944690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:54.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.969+0000 7fdc68489740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x2695940 0x2955670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:54.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.969+0000 7fdc68489740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x26e09c0 0x2955bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:54.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.969+0000 7fdc68489740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x2804c00 con 0x2695940 2023-11-28T11:59:54.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.969+0000 7fdc68489740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x2874cf0 con 0x26e09c0 2023-11-28T11:59:54.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.969+0000 7fdc68489740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x286dff0 con 0x2695d10 2023-11-28T11:59:54.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.969+0000 7fdc5ed9d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x2695d10 0x2944690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:54.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.969+0000 7fdc5e59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x2695940 0x2955670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:54.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.969+0000 7fdc5ed9d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x2695d10 0x2944690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:34582/0 (socket says 172.21.15.39:34582) 2023-11-28T11:59:54.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.969+0000 7fdc5ed9d700 1 -- 172.21.15.39:0/1931598712 learned_addr learned my addr 172.21.15.39:0/1931598712 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:54.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.969+0000 7fdc5f59e700 1 --2- 172.21.15.39:0/1931598712 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x26e09c0 0x2955bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:54.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.969+0000 7fdc5e59c700 1 -- 172.21.15.39:0/1931598712 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x2695d10 msgr2=0x2944690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:54.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.969+0000 7fdc5e59c700 1 --2- 172.21.15.39:0/1931598712 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x2695d10 0x2944690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.969+0000 7fdc5e59c700 1 -- 172.21.15.39:0/1931598712 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x26e09c0 msgr2=0x2955bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:54.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.969+0000 7fdc5e59c700 1 --2- 172.21.15.39:0/1931598712 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x26e09c0 0x2955bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.969+0000 7fdc5e59c700 1 -- 172.21.15.39:0/1931598712 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2893ec0 con 0x2695940 2023-11-28T11:59:54.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.969+0000 7fdc5e59c700 1 --2- 172.21.15.39:0/1931598712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x2695940 0x2955670 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fdc5400ee70 tx=0x7fdc5405b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=defb1340ef714900 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:54.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.973+0000 7fdc44ff9700 1 -- 172.21.15.39:0/1931598712 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc54053050 con 0x2695940 2023-11-28T11:59:54.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.973+0000 7fdc44ff9700 1 -- 172.21.15.39:0/1931598712 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc54051b60 con 0x2695940 2023-11-28T11:59:54.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.973+0000 7fdc44ff9700 1 -- 172.21.15.39:0/1931598712 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc54023e10 con 0x2695940 2023-11-28T11:59:54.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.973+0000 7fdc68489740 1 -- 172.21.15.39:0/1931598712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x2695940 msgr2=0x2955670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:54.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.973+0000 7fdc68489740 1 --2- 172.21.15.39:0/1931598712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x2695940 0x2955670 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fdc5400ee70 tx=0x7fdc5405b9f0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.973+0000 7fdc68489740 1 -- 172.21.15.39:0/1931598712 shutdown_connections 2023-11-28T11:59:54.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.973+0000 7fdc68489740 1 --2- 172.21.15.39:0/1931598712 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x26e09c0 0x2955bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.973+0000 7fdc68489740 1 --2- 172.21.15.39:0/1931598712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x2695940 0x2955670 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.973+0000 7fdc68489740 1 --2- 172.21.15.39:0/1931598712 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x2695d10 0x2944690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.973+0000 7fdc68489740 1 -- 172.21.15.39:0/1931598712 >> 172.21.15.39:0/1931598712 conn(0x26960e0 msgr2=0x292e790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:54.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.973+0000 7fdc68489740 1 -- 172.21.15.39:0/1931598712 shutdown_connections 2023-11-28T11:59:54.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.973+0000 7fdc68489740 1 -- 172.21.15.39:0/1931598712 wait complete. 2023-11-28T11:59:54.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.973+0000 7fdc68489740 1 -- start start 2023-11-28T11:59:54.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.973+0000 7fdc68489740 1 Processor -- start 2023-11-28T11:59:54.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.977+0000 7fdc68489740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x2695940 0x2905220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:54.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.977+0000 7fdc68489740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x2695d10 0x292ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:54.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.977+0000 7fdc68489740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x26e09c0 0x2907010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:54.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.977+0000 7fdc68489740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x271ad50 con 0x26e09c0 2023-11-28T11:59:54.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.977+0000 7fdc68489740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x292f1b0 con 0x2695d10 2023-11-28T11:59:54.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.977+0000 7fdc68489740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x2907550 con 0x2695940 2023-11-28T11:59:54.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.977+0000 7fdc68489740 10 client.0 _ll_register_callbacks cb 0x28ca8f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:59:54.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.977+0000 7fdc5f59e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x26e09c0 0x2907010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:54.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.977+0000 7fdc5f59e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x26e09c0 0x2907010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38650/0 (socket says 172.21.15.39:38650) 2023-11-28T11:59:54.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.977+0000 7fdc5f59e700 1 -- 172.21.15.39:0/3433051674 learned_addr learned my addr 172.21.15.39:0/3433051674 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:54.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.977+0000 7fdc5ed9d700 1 --2- 172.21.15.39:0/3433051674 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x2695940 0x2905220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:54.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.977+0000 7fdc5e59c700 1 --2- 172.21.15.39:0/3433051674 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x2695d10 0x292ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:54.984 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.977+0000 7fdc5f59e700 1 -- 172.21.15.39:0/3433051674 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x2695940 msgr2=0x2905220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:54.984 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.977+0000 7fdc5f59e700 1 --2- 172.21.15.39:0/3433051674 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x2695940 0x2905220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.984 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.977+0000 7fdc5f59e700 1 -- 172.21.15.39:0/3433051674 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x2695d10 msgr2=0x292ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:54.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.977+0000 7fdc5f59e700 1 --2- 172.21.15.39:0/3433051674 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x2695d10 0x292ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.977+0000 7fdc5f59e700 1 -- 172.21.15.39:0/3433051674 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc600b4c30 con 0x26e09c0 2023-11-28T11:59:54.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.977+0000 7fdc5f59e700 1 --2- 172.21.15.39:0/3433051674 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x26e09c0 0x2907010 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fdc58004690 tx=0x7fdc580049a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50bab5bde0fa1c54 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:54.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.977+0000 7fdc3dffb700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-11-28T11:59:54.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.981+0000 7fdc3dffb700 1 -- 172.21.15.39:0/3433051674 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc58009e50 con 0x26e09c0 2023-11-28T11:59:54.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.981+0000 7fdc68489740 1 -- 172.21.15.39:0/3433051674 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2867070 con 0x26e09c0 2023-11-28T11:59:54.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.981+0000 7fdc3dffb700 1 -- 172.21.15.39:0/3433051674 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fdc580079b0 con 0x26e09c0 2023-11-28T11:59:54.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.981+0000 7fdc3dffb700 1 -- 172.21.15.39:0/3433051674 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc58007b70 con 0x26e09c0 2023-11-28T11:59:54.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.981+0000 7fdc68489740 10 client.6438 fetch_fsmap learned FSMap version 32 2023-11-28T11:59:54.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.981+0000 7fdc68489740 1 -- 172.21.15.39:0/3433051674 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x26e1c10 con 0x26e09c0 2023-11-28T11:59:54.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.981+0000 7fdc3dffb700 1 -- 172.21.15.39:0/3433051674 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2867070 con 0x26e09c0 2023-11-28T11:59:54.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.981+0000 7fdc3dffb700 1 -- 172.21.15.39:0/3433051674 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fdc58007cd0 con 0x26e09c0 2023-11-28T11:59:54.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.981+0000 7fdc68489740 10 client.6438 fetch_fsmap finished waiting for FSMap version 32 2023-11-28T11:59:54.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.981+0000 7fdc68489740 10 client.6438 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2023-11-28T11:59:54.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.981+0000 7fdc68489740 20 client.6438 populate_metadata read hostname 'smithi039' 2023-11-28T11:59:54.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.981+0000 7fdc68489740 1 --2- 172.21.15.39:0/3433051674 >> [v2:172.21.15.39:6832/990492858,v1:172.21.15.39:6835/990492858] conn(0x2904050 0x2968740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:54.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.981+0000 7fdc68489740 4 client.6438 mds_command: new command op to 6244 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T11:59:54.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.981+0000 7fdc68489740 1 -- 172.21.15.39:0/3433051674 --> [v2:172.21.15.39:6832/990492858,v1:172.21.15.39:6835/990492858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2866d90 con 0x2904050 2023-11-28T11:59:54.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.981+0000 7fdc5ed9d700 1 --2- 172.21.15.39:0/3433051674 >> [v2:172.21.15.39:6832/990492858,v1:172.21.15.39:6835/990492858] conn(0x2904050 0x2968740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:54.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.981+0000 7fdc5ed9d700 1 --2- 172.21.15.39:0/3433051674 >> [v2:172.21.15.39:6832/990492858,v1:172.21.15.39:6835/990492858] conn(0x2904050 0x2968740 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ace7516bd98a8bc4 server_cookie=1595542c273d3082 in_seq=0 out_seq=0 2023-11-28T11:59:54.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.981+0000 7fdc3dffb700 10 client.6438 ms_handle_connect on v2:172.21.15.39:6832/990492858 2023-11-28T11:59:54.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.981+0000 7fdc3dffb700 1 -- 172.21.15.39:0/3433051674 <== mds.0 v2:172.21.15.39:6832/990492858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x2866d90 con 0x2904050 2023-11-28T11:59:54.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.981+0000 7fdc3dffb700 10 client.6438 handle_command_reply: tid=0 2023-11-28T11:59:54.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.985+0000 7fdc68489740 1 client.6438 shutdown 2023-11-28T11:59:54.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.985+0000 7fdc68489740 1 -- 172.21.15.39:0/3433051674 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x26e09c0 msgr2=0x2907010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:54.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.985+0000 7fdc68489740 1 --2- 172.21.15.39:0/3433051674 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x26e09c0 0x2907010 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fdc58004690 tx=0x7fdc580049a0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.985+0000 7fdc68489740 1 -- 172.21.15.39:0/3433051674 shutdown_connections 2023-11-28T11:59:54.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.985+0000 7fdc68489740 1 --2- 172.21.15.39:0/3433051674 >> [v2:172.21.15.39:6832/990492858,v1:172.21.15.39:6835/990492858] conn(0x2904050 0x2968740 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.985+0000 7fdc68489740 1 --2- 172.21.15.39:0/3433051674 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x26e09c0 0x2907010 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.985+0000 7fdc68489740 1 --2- 172.21.15.39:0/3433051674 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x2695d10 0x292ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.985+0000 7fdc3dffb700 0 client.6438 ms_handle_reset on v2:172.21.15.39:6832/990492858 2023-11-28T11:59:54.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.985+0000 7fdc68489740 1 --2- 172.21.15.39:0/3433051674 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x2695940 0x2905220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:54.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.985+0000 7fdc68489740 1 -- 172.21.15.39:0/3433051674 >> 172.21.15.39:0/3433051674 conn(0x26960e0 msgr2=0x292afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:54.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.985+0000 7fdc68489740 1 -- 172.21.15.39:0/3433051674 shutdown_connections 2023-11-28T11:59:54.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.985+0000 7fdc68489740 1 -- 172.21.15.39:0/3433051674 wait complete. 2023-11-28T11:59:54.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:54.985+0000 7fdc68489740 20 client.6438 trim_cache size 0 max 16384 2023-11-28T11:59:55.009 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.005+0000 7fdc68489740 1 Processor -- start 2023-11-28T11:59:55.009 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.005+0000 7fdc68489740 1 -- start start 2023-11-28T11:59:55.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.005+0000 7fdc68489740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x2695940 0x2904450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.005+0000 7fdc68489740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x2695d10 0x2904990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.005+0000 7fdc68489740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x26e09c0 0x295d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.005+0000 7fdc68489740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x2907c20 con 0x2695940 2023-11-28T11:59:55.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.005+0000 7fdc68489740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x28adb10 con 0x26e09c0 2023-11-28T11:59:55.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.005+0000 7fdc68489740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x286b800 con 0x2695d10 2023-11-28T11:59:55.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.005+0000 7fdc5ed9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x2695940 0x2904450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.005+0000 7fdc5ed9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x2695940 0x2904450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38656/0 (socket says 172.21.15.39:38656) 2023-11-28T11:59:55.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.005+0000 7fdc5ed9d700 1 -- 172.21.15.39:0/4248049530 learned_addr learned my addr 172.21.15.39:0/4248049530 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:55.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.005+0000 7fdc5f59e700 1 --2- 172.21.15.39:0/4248049530 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x26e09c0 0x295d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.005+0000 7fdc5e59c700 1 --2- 172.21.15.39:0/4248049530 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x2695d10 0x2904990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.005+0000 7fdc5ed9d700 1 -- 172.21.15.39:0/4248049530 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x2695d10 msgr2=0x2904990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:55.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.005+0000 7fdc5ed9d700 1 --2- 172.21.15.39:0/4248049530 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x2695d10 0x2904990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.005+0000 7fdc5ed9d700 1 -- 172.21.15.39:0/4248049530 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x26e09c0 msgr2=0x295d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:55.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.005+0000 7fdc5ed9d700 1 --2- 172.21.15.39:0/4248049530 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x26e09c0 0x295d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.005+0000 7fdc5ed9d700 1 -- 172.21.15.39:0/4248049530 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6015d270 con 0x2695940 2023-11-28T11:59:55.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.005+0000 7fdc5f59e700 1 --2- 172.21.15.39:0/4248049530 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x26e09c0 0x295d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:55.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.005+0000 7fdc5ed9d700 1 --2- 172.21.15.39:0/4248049530 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x2695940 0x2904450 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fdc5000b0e0 tx=0x7fdc50010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e8cdbabe922f1e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:55.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.005+0000 7fdc457fa700 1 -- 172.21.15.39:0/4248049530 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5002c070 con 0x2695940 2023-11-28T11:59:55.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.005+0000 7fdc457fa700 1 -- 172.21.15.39:0/4248049530 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5002d040 con 0x2695940 2023-11-28T11:59:55.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.005+0000 7fdc457fa700 1 -- 172.21.15.39:0/4248049530 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5001f070 con 0x2695940 2023-11-28T11:59:55.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.009+0000 7fdc68489740 1 -- 172.21.15.39:0/4248049530 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x2695940 msgr2=0x2904450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:55.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.009+0000 7fdc68489740 1 --2- 172.21.15.39:0/4248049530 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x2695940 0x2904450 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fdc5000b0e0 tx=0x7fdc50010000 comp rx=0 tx=0).stop 2023-11-28T11:59:55.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.009+0000 7fdc68489740 1 -- 172.21.15.39:0/4248049530 shutdown_connections 2023-11-28T11:59:55.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.009+0000 7fdc68489740 1 --2- 172.21.15.39:0/4248049530 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x26e09c0 0x295d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.009+0000 7fdc68489740 1 --2- 172.21.15.39:0/4248049530 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x2695d10 0x2904990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.009+0000 7fdc68489740 1 --2- 172.21.15.39:0/4248049530 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x2695940 0x2904450 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.009+0000 7fdc68489740 1 -- 172.21.15.39:0/4248049530 >> 172.21.15.39:0/4248049530 conn(0x26960e0 msgr2=0x2964dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:55.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.009+0000 7fdc68489740 1 -- 172.21.15.39:0/4248049530 shutdown_connections 2023-11-28T11:59:55.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.009+0000 7fdc68489740 1 -- 172.21.15.39:0/4248049530 wait complete. 2023-11-28T11:59:55.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.009+0000 7fdc68489740 1 -- start start 2023-11-28T11:59:55.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.009+0000 7fdc68489740 1 Processor -- start 2023-11-28T11:59:55.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.009+0000 7fdc68489740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x2695d10 0x29b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.009+0000 7fdc68489740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x26e09c0 0x29b2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.009+0000 7fdc68489740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x292d380 0x292d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.009+0000 7fdc68489740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x2871ff0 con 0x2695d10 2023-11-28T11:59:55.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.009+0000 7fdc68489740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x28cb9c0 con 0x292d380 2023-11-28T11:59:55.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.009+0000 7fdc68489740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x2843f00 con 0x26e09c0 2023-11-28T11:59:55.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.009+0000 7fdc68489740 10 client.0 _ll_register_callbacks cb 0x2838a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:59:55.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.009+0000 7fdc5ed9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x2695d10 0x29b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.009+0000 7fdc5ed9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x2695d10 0x29b1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38664/0 (socket says 172.21.15.39:38664) 2023-11-28T11:59:55.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.009+0000 7fdc5ed9d700 1 -- 172.21.15.39:0/1083300114 learned_addr learned my addr 172.21.15.39:0/1083300114 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:55.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.009+0000 7fdc5f59e700 1 --2- 172.21.15.39:0/1083300114 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x292d380 0x292d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.009+0000 7fdc5e59c700 1 --2- 172.21.15.39:0/1083300114 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x26e09c0 0x29b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.009+0000 7fdc5ed9d700 1 -- 172.21.15.39:0/1083300114 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x26e09c0 msgr2=0x29b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:55.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.009+0000 7fdc5ed9d700 1 --2- 172.21.15.39:0/1083300114 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x26e09c0 0x29b2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.009+0000 7fdc5ed9d700 1 -- 172.21.15.39:0/1083300114 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x292d380 msgr2=0x292d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:55.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.009+0000 7fdc5ed9d700 1 --2- 172.21.15.39:0/1083300114 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x292d380 0x292d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.009+0000 7fdc5ed9d700 1 -- 172.21.15.39:0/1083300114 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc6015a7d0 con 0x2695d10 2023-11-28T11:59:55.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.013+0000 7fdc5ed9d700 1 --2- 172.21.15.39:0/1083300114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x2695d10 0x29b1ee0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fdc50034000 tx=0x7fdc500047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=681afb99e68e3b8c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:55.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.013+0000 7fdc3dffb700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-11-28T11:59:55.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.013+0000 7fdc3dffb700 1 -- 172.21.15.39:0/1083300114 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5002c030 con 0x2695d10 2023-11-28T11:59:55.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.013+0000 7fdc3dffb700 1 -- 172.21.15.39:0/1083300114 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fdc50034310 con 0x2695d10 2023-11-28T11:59:55.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.013+0000 7fdc68489740 1 -- 172.21.15.39:0/1083300114 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x289be30 con 0x2695d10 2023-11-28T11:59:55.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.013+0000 7fdc3dffb700 1 -- 172.21.15.39:0/1083300114 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc5001f070 con 0x2695d10 2023-11-28T11:59:55.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.013+0000 7fdc68489740 10 client.6444 fetch_fsmap learned FSMap version 32 2023-11-28T11:59:55.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.013+0000 7fdc68489740 1 -- 172.21.15.39:0/1083300114 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x281ab70 con 0x2695d10 2023-11-28T11:59:55.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.013+0000 7fdc3dffb700 1 -- 172.21.15.39:0/1083300114 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x289be30 con 0x2695d10 2023-11-28T11:59:55.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.013+0000 7fdc3dffb700 1 -- 172.21.15.39:0/1083300114 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fdc500036c0 con 0x2695d10 2023-11-28T11:59:55.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.013+0000 7fdc68489740 10 client.6444 fetch_fsmap finished waiting for FSMap version 32 2023-11-28T11:59:55.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.013+0000 7fdc68489740 10 client.6444 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2023-11-28T11:59:55.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.013+0000 7fdc68489740 20 client.6444 populate_metadata read hostname 'smithi039' 2023-11-28T11:59:55.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.013+0000 7fdc68489740 1 --2- 172.21.15.39:0/1083300114 >> [v2:172.21.15.39:6832/990492858,v1:172.21.15.39:6835/990492858] conn(0x292dc90 0x292b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.013+0000 7fdc68489740 4 client.6444 mds_command: new command op to 6244 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}] 2023-11-28T11:59:55.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.013+0000 7fdc68489740 1 -- 172.21.15.39:0/1083300114 --> [v2:172.21.15.39:6832/990492858,v1:172.21.15.39:6835/990492858] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}) v1 -- 0x2712490 con 0x292dc90 2023-11-28T11:59:55.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.013+0000 7fdc5e59c700 1 --2- 172.21.15.39:0/1083300114 >> [v2:172.21.15.39:6832/990492858,v1:172.21.15.39:6835/990492858] conn(0x292dc90 0x292b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.013+0000 7fdc5e59c700 1 --2- 172.21.15.39:0/1083300114 >> [v2:172.21.15.39:6832/990492858,v1:172.21.15.39:6835/990492858] conn(0x292dc90 0x292b350 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1150923f3c4d33d server_cookie=4c40b77b289a4f5e in_seq=0 out_seq=0 2023-11-28T11:59:55.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.013+0000 7fdc3dffb700 10 client.6444 ms_handle_connect on v2:172.21.15.39:6832/990492858 2023-11-28T11:59:55.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.017+0000 7fdc3dffb700 1 -- 172.21.15.39:0/1083300114 <== mds.0 v2:172.21.15.39:6832/990492858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x2712490 con 0x292dc90 2023-11-28T11:59:55.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.017+0000 7fdc3dffb700 10 client.6444 handle_command_reply: tid=0 2023-11-28T11:59:55.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.017+0000 7fdc68489740 1 client.6444 shutdown 2023-11-28T11:59:55.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.017+0000 7fdc68489740 1 -- 172.21.15.39:0/1083300114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x2695d10 msgr2=0x29b1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:55.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.017+0000 7fdc68489740 1 --2- 172.21.15.39:0/1083300114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x2695d10 0x29b1ee0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fdc50034000 tx=0x7fdc500047e0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.017+0000 7fdc68489740 1 -- 172.21.15.39:0/1083300114 shutdown_connections 2023-11-28T11:59:55.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.017+0000 7fdc68489740 1 --2- 172.21.15.39:0/1083300114 >> [v2:172.21.15.39:6832/990492858,v1:172.21.15.39:6835/990492858] conn(0x292dc90 0x292b350 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.017+0000 7fdc68489740 1 --2- 172.21.15.39:0/1083300114 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x292d380 0x292d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.017+0000 7fdc68489740 1 --2- 172.21.15.39:0/1083300114 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x26e09c0 0x29b2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.017+0000 7fdc68489740 1 --2- 172.21.15.39:0/1083300114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x2695d10 0x29b1ee0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.017+0000 7fdc68489740 1 -- 172.21.15.39:0/1083300114 >> 172.21.15.39:0/1083300114 conn(0x26960e0 msgr2=0x29427d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:55.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.017+0000 7fdc3dffb700 0 client.6444 ms_handle_reset on v2:172.21.15.39:6832/990492858 2023-11-28T11:59:55.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.017+0000 7fdc68489740 1 -- 172.21.15.39:0/1083300114 shutdown_connections 2023-11-28T11:59:55.026 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.017+0000 7fdc68489740 1 -- 172.21.15.39:0/1083300114 wait complete. 2023-11-28T11:59:55.026 INFO:tasks.ceph.mds.c.smithi039.stderr:2023-11-28T11:59:55.017+0000 7ffa4872d700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={6402=0-4194304@1} caps={6402=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=6402 | request=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x5591a267fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(11)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-11-28T11:59:55.027 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.017+0000 7fdc68489740 20 client.6444 trim_cache size 0 max 16384 2023-11-28T11:59:55.027 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2023-11-28T11:59:55.027 INFO:teuthology.orchestra.run.smithi039.stdout: "return_code": 0, 2023-11-28T11:59:55.028 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_tag": "97285534-365f-4c60-83c6-aaf94906ae6c", 2023-11-28T11:59:55.028 INFO:teuthology.orchestra.run.smithi039.stdout: "mode": "asynchronous" 2023-11-28T11:59:55.028 INFO:teuthology.orchestra.run.smithi039.stdout:} 2023-11-28T11:59:55.028 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.017+0000 7fdc649fb700 1 -- 172.21.15.39:0/2661522570 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fdc4c064ee0 msgr2=0x7fdc4c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:55.029 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.017+0000 7fdc649fb700 1 --2- 172.21.15.39:0/2661522570 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fdc4c064ee0 0x7fdc4c067390 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fdc50000c00 tx=0x7fdc50008030 comp rx=0 tx=0).stop 2023-11-28T11:59:55.029 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.017+0000 7fdc649fb700 1 -- 172.21.15.39:0/2661522570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc600b3610 msgr2=0x7fdc600c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:55.029 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.017+0000 7fdc649fb700 1 --2- 172.21.15.39:0/2661522570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc600b3610 0x7fdc600c82a0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fdc5400e810 tx=0x7fdc5400eb20 comp rx=0 tx=0).stop 2023-11-28T11:59:55.029 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.017+0000 7fdc649fb700 1 -- 172.21.15.39:0/2661522570 shutdown_connections 2023-11-28T11:59:55.029 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.017+0000 7fdc649fb700 1 --2- 172.21.15.39:0/2661522570 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc600cb350 0x7fdc6015c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.029 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.017+0000 7fdc649fb700 1 --2- 172.21.15.39:0/2661522570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc600b3610 0x7fdc600c82a0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.029 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.017+0000 7fdc649fb700 1 --2- 172.21.15.39:0/2661522570 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fdc4c064ee0 0x7fdc4c067390 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.029 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.017+0000 7fdc649fb700 1 --2- 172.21.15.39:0/2661522570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc600b1da0 0x7fdc601f4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.030 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.017+0000 7fdc649fb700 1 -- 172.21.15.39:0/2661522570 >> 172.21.15.39:0/2661522570 conn(0x7fdc60089f70 msgr2=0x7fdc600ccca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:55.030 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.017+0000 7fdc649fb700 1 -- 172.21.15.39:0/2661522570 shutdown_connections 2023-11-28T11:59:55.030 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.017+0000 7fdc649fb700 1 -- 172.21.15.39:0/2661522570 wait complete. 2023-11-28T11:59:55.046 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub status 2023-11-28T11:59:55.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.233+0000 7fd460992700 1 Processor -- start 2023-11-28T11:59:55.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.233+0000 7fd460992700 1 -- start start 2023-11-28T11:59:55.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.237+0000 7fd460992700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd45c06c2b0 0x7fd45c165080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.237+0000 7fd460992700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd45c06c680 0x7fd45c0adfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.237+0000 7fd460992700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd45c06afb0 con 0x7fd45c0aed60 2023-11-28T11:59:55.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.237+0000 7fd460992700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd45c0ca750 con 0x7fd45c06c2b0 2023-11-28T11:59:55.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.237+0000 7fd460992700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd45c06b290 con 0x7fd45c06c680 2023-11-28T11:59:55.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.237+0000 7fd45a59c700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd45c06c2b0 0x7fd45c165080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.237+0000 7fd45a59c700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd45c06c2b0 0x7fd45c165080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38668/0 (socket says 172.21.15.39:38668) 2023-11-28T11:59:55.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.237+0000 7fd45a59c700 1 -- 172.21.15.39:0/4002041519 learned_addr learned my addr 172.21.15.39:0/4002041519 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:55.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.237+0000 7fd45ad9d700 1 --2- 172.21.15.39:0/4002041519 >> v2:172.21.15.184:3300/0 conn(0x7fd45c06c680 0x7fd45c0adfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.237+0000 7fd45a59c700 1 -- 172.21.15.39:0/4002041519 >> v2:172.21.15.184:3300/0 conn(0x7fd45c06c680 msgr2=0x7fd45c0adfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:55.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.237+0000 7fd45a59c700 1 --2- 172.21.15.39:0/4002041519 >> v2:172.21.15.184:3300/0 conn(0x7fd45c06c680 0x7fd45c0adfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.237+0000 7fd45a59c700 1 -- 172.21.15.39:0/4002041519 >> v1:172.21.15.184:6789/0 conn(0x7fd45c0aed60 legacy=0x7fd45c1639d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:55.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.241+0000 7fd45a59c700 1 -- 172.21.15.39:0/4002041519 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd45c0c8f40 con 0x7fd45c06c2b0 2023-11-28T11:59:55.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.241+0000 7fd45a59c700 1 --2- 172.21.15.39:0/4002041519 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd45c06c2b0 0x7fd45c165080 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fd45c073190 tx=0x7fd44c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffc38e12803e6155 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:55.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.241+0000 7fd45959a700 1 -- 172.21.15.39:0/4002041519 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c004230 con 0x7fd45c06c2b0 2023-11-28T11:59:55.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.241+0000 7fd45959a700 1 -- 172.21.15.39:0/4002041519 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44c004390 con 0x7fd45c06c2b0 2023-11-28T11:59:55.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.241+0000 7fd45959a700 1 -- 172.21.15.39:0/4002041519 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c0036c0 con 0x7fd45c06c2b0 2023-11-28T11:59:55.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.241+0000 7fd460992700 1 -- 172.21.15.39:0/4002041519 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd45c06c2b0 msgr2=0x7fd45c165080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:55.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.241+0000 7fd460992700 1 --2- 172.21.15.39:0/4002041519 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd45c06c2b0 0x7fd45c165080 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fd45c073190 tx=0x7fd44c009bf0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.241+0000 7fd460992700 1 -- 172.21.15.39:0/4002041519 shutdown_connections 2023-11-28T11:59:55.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.241+0000 7fd460992700 1 --2- 172.21.15.39:0/4002041519 >> v2:172.21.15.184:3300/0 conn(0x7fd45c06c680 0x7fd45c0adfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.241+0000 7fd460992700 1 --2- 172.21.15.39:0/4002041519 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd45c06c2b0 0x7fd45c165080 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.241+0000 7fd460992700 1 -- 172.21.15.39:0/4002041519 >> 172.21.15.39:0/4002041519 conn(0x7fd45c0cf580 msgr2=0x7fd45c0cb370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:55.247 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.241+0000 7fd460992700 1 -- 172.21.15.39:0/4002041519 shutdown_connections 2023-11-28T11:59:55.247 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.241+0000 7fd460992700 1 -- 172.21.15.39:0/4002041519 wait complete. 2023-11-28T11:59:55.249 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.245+0000 7fd460992700 1 Processor -- start 2023-11-28T11:59:55.249 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.245+0000 7fd460992700 1 -- start start 2023-11-28T11:59:55.252 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.245+0000 7fd460992700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd45c06c2b0 0x7fd45c0c2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.252 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.245+0000 7fd460992700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd45c06c680 0x7fd45c1f62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.252 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.245+0000 7fd460992700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd45c0aed60 0x7fd45c0c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.252 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.245+0000 7fd460992700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45c0c5b60 con 0x7fd45c06c680 2023-11-28T11:59:55.252 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.245+0000 7fd460992700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45c1f67e0 con 0x7fd45c06c2b0 2023-11-28T11:59:55.252 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.245+0000 7fd460992700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd45c0c7330 con 0x7fd45c0aed60 2023-11-28T11:59:55.252 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.245+0000 7fd459d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd45c06c680 0x7fd45c1f62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.252 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.245+0000 7fd459d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd45c06c680 0x7fd45c1f62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38684/0 (socket says 172.21.15.39:38684) 2023-11-28T11:59:55.252 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.245+0000 7fd45a59c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd45c06c2b0 0x7fd45c0c2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.252 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.245+0000 7fd459d9b700 1 -- 172.21.15.39:0/2293116022 learned_addr learned my addr 172.21.15.39:0/2293116022 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:55.252 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.245+0000 7fd45ad9d700 1 --2- 172.21.15.39:0/2293116022 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd45c0aed60 0x7fd45c0c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.253 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.249+0000 7fd459d9b700 1 -- 172.21.15.39:0/2293116022 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd45c0aed60 msgr2=0x7fd45c0c6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:55.254 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.249+0000 7fd459d9b700 1 --2- 172.21.15.39:0/2293116022 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd45c0aed60 0x7fd45c0c6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.254 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.249+0000 7fd459d9b700 1 -- 172.21.15.39:0/2293116022 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd45c06c2b0 msgr2=0x7fd45c0c2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:55.254 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.249+0000 7fd459d9b700 1 --2- 172.21.15.39:0/2293116022 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd45c06c2b0 0x7fd45c0c2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.254 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.249+0000 7fd459d9b700 1 -- 172.21.15.39:0/2293116022 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd44c009570 con 0x7fd45c06c680 2023-11-28T11:59:55.254 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.249+0000 7fd459d9b700 1 --2- 172.21.15.39:0/2293116022 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd45c06c680 0x7fd45c1f62a0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fd45000b480 tx=0x7fd45000b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:55.254 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.249+0000 7fd44affd700 1 -- 172.21.15.39:0/2293116022 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45000be50 con 0x7fd45c06c680 2023-11-28T11:59:55.254 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.249+0000 7fd44affd700 1 -- 172.21.15.39:0/2293116022 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd450004020 con 0x7fd45c06c680 2023-11-28T11:59:55.254 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.249+0000 7fd460992700 1 -- 172.21.15.39:0/2293116022 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd45c0ad800 con 0x7fd45c06c680 2023-11-28T11:59:55.254 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.249+0000 7fd44affd700 1 -- 172.21.15.39:0/2293116022 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4500043d0 con 0x7fd45c06c680 2023-11-28T11:59:55.255 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.249+0000 7fd460992700 1 -- 172.21.15.39:0/2293116022 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd45c0c9220 con 0x7fd45c06c680 2023-11-28T11:59:55.257 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.253+0000 7fd44affd700 1 -- 172.21.15.39:0/2293116022 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd45000f050 con 0x7fd45c06c680 2023-11-28T11:59:55.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.257+0000 7fd44affd700 1 --2- 172.21.15.39:0/2293116022 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd43c064ee0 0x7fd43c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.257+0000 7fd44affd700 1 -- 172.21.15.39:0/2293116022 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd450081a50 con 0x7fd45c06c680 2023-11-28T11:59:55.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.257+0000 7fd45a59c700 1 --2- 172.21.15.39:0/2293116022 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd43c064ee0 0x7fd43c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.262 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.257+0000 7fd463c1e740 1 Processor -- start 2023-11-28T11:59:55.262 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.257+0000 7fd463c1e740 1 -- start start 2023-11-28T11:59:55.262 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.257+0000 7fd45a59c700 1 --2- 172.21.15.39:0/2293116022 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd43c064ee0 0x7fd43c067390 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd45c073190 tx=0x7fd44c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:55.263 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.257+0000 7fd463c1e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x210ac10 0x23c1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.257+0000 7fd463c1e740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x210a840 0x23c20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.257+0000 7fd463c1e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x21558c0 0x23be2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.257+0000 7fd463c1e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x2279d20 con 0x210ac10 2023-11-28T11:59:55.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.257+0000 7fd463c1e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x22e9d60 con 0x21558c0 2023-11-28T11:59:55.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.257+0000 7fd463c1e740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x22e3060 con 0x210a840 2023-11-28T11:59:55.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.257+0000 7fd459d9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x210a840 0x23c20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.261+0000 7fd45a59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x210ac10 0x23c1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.261+0000 7fd459d9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x210a840 0x23c20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:34628/0 (socket says 172.21.15.39:34628) 2023-11-28T11:59:55.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.261+0000 7fd459d9b700 1 -- 172.21.15.39:0/1578914461 learned_addr learned my addr 172.21.15.39:0/1578914461 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:55.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.261+0000 7fd45ad9d700 1 --2- 172.21.15.39:0/1578914461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x21558c0 0x23be2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.261+0000 7fd459d9b700 1 -- 172.21.15.39:0/1578914461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x21558c0 msgr2=0x23be2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:55.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.261+0000 7fd459d9b700 1 --2- 172.21.15.39:0/1578914461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x21558c0 0x23be2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.261+0000 7fd459d9b700 1 -- 172.21.15.39:0/1578914461 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x210ac10 msgr2=0x23c1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:55.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.261+0000 7fd459d9b700 1 --2- 172.21.15.39:0/1578914461 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x210ac10 0x23c1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.261+0000 7fd459d9b700 1 -- 172.21.15.39:0/1578914461 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x23090a0 con 0x210a840 2023-11-28T11:59:55.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.261+0000 7fd459d9b700 1 --2- 172.21.15.39:0/1578914461 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x210a840 0x23c20a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd45005b1e0 tx=0x7fd45005b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b79b4b078a6536b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:55.267 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.261+0000 7fd43bfff700 1 -- 172.21.15.39:0/1578914461 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4500590d0 con 0x210a840 2023-11-28T11:59:55.267 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.261+0000 7fd43bfff700 1 -- 172.21.15.39:0/1578914461 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd450059230 con 0x210a840 2023-11-28T11:59:55.267 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.261+0000 7fd43bfff700 1 -- 172.21.15.39:0/1578914461 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd450057360 con 0x210a840 2023-11-28T11:59:55.267 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.261+0000 7fd463c1e740 1 -- 172.21.15.39:0/1578914461 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x210a840 msgr2=0x23c20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:55.267 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.261+0000 7fd463c1e740 1 --2- 172.21.15.39:0/1578914461 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x210a840 0x23c20a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd45005b1e0 tx=0x7fd45005b790 comp rx=0 tx=0).stop 2023-11-28T11:59:55.267 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.261+0000 7fd463c1e740 1 -- 172.21.15.39:0/1578914461 shutdown_connections 2023-11-28T11:59:55.267 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.261+0000 7fd463c1e740 1 --2- 172.21.15.39:0/1578914461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x21558c0 0x23be2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.267 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.261+0000 7fd463c1e740 1 --2- 172.21.15.39:0/1578914461 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x210a840 0x23c20a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.261+0000 7fd463c1e740 1 --2- 172.21.15.39:0/1578914461 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x210ac10 0x23c1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.261+0000 7fd463c1e740 1 -- 172.21.15.39:0/1578914461 >> 172.21.15.39:0/1578914461 conn(0x210afe0 msgr2=0x23a3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:55.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.261+0000 7fd463c1e740 1 -- 172.21.15.39:0/1578914461 shutdown_connections 2023-11-28T11:59:55.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.261+0000 7fd463c1e740 1 -- 172.21.15.39:0/1578914461 wait complete. 2023-11-28T11:59:55.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.261+0000 7fd463c1e740 1 -- start start 2023-11-28T11:59:55.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.265+0000 7fd463c1e740 1 Processor -- start 2023-11-28T11:59:55.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.265+0000 7fd463c1e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x210a840 0x23c7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.265+0000 7fd463c1e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x210ac10 0x23ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.265+0000 7fd463c1e740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x21558c0 0x23a3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.265+0000 7fd463c1e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x218fc50 con 0x210ac10 2023-11-28T11:59:55.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.265+0000 7fd463c1e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x2377eb0 con 0x210a840 2023-11-28T11:59:55.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.265+0000 7fd463c1e740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x2378110 con 0x21558c0 2023-11-28T11:59:55.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.265+0000 7fd463c1e740 10 client.0 _ll_register_callbacks cb 0x22dc9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:59:55.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.265+0000 7fd45ad9d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x21558c0 0x23a3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.265+0000 7fd45ad9d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x21558c0 0x23a3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:34634/0 (socket says 172.21.15.39:34634) 2023-11-28T11:59:55.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.265+0000 7fd45ad9d700 1 -- 172.21.15.39:0/524577900 learned_addr learned my addr 172.21.15.39:0/524577900 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:55.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.265+0000 7fd459d9b700 1 --2- 172.21.15.39:0/524577900 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x210ac10 0x23ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.265+0000 7fd45a59c700 1 --2- 172.21.15.39:0/524577900 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x210a840 0x23c7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.265+0000 7fd45ad9d700 1 -- 172.21.15.39:0/524577900 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x210a840 msgr2=0x23c7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:55.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.265+0000 7fd45ad9d700 1 --2- 172.21.15.39:0/524577900 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x210a840 0x23c7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.265+0000 7fd45ad9d700 1 -- 172.21.15.39:0/524577900 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x210ac10 msgr2=0x23ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:55.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.265+0000 7fd45ad9d700 1 --2- 172.21.15.39:0/524577900 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x210ac10 0x23ca3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.265+0000 7fd45ad9d700 1 -- 172.21.15.39:0/524577900 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd45c0c9220 con 0x21558c0 2023-11-28T11:59:55.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.265+0000 7fd45ad9d700 1 --2- 172.21.15.39:0/524577900 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x21558c0 0x23a3d10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd454004630 tx=0x7fd454004940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fe2f4757ab4857a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:55.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.265+0000 7fd4397fa700 10 client.0 ms_handle_connect on v2:172.21.15.184:3301/0 2023-11-28T11:59:55.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.265+0000 7fd4397fa700 1 -- 172.21.15.39:0/524577900 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4540138d0 con 0x21558c0 2023-11-28T11:59:55.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.269+0000 7fd4397fa700 1 -- 172.21.15.39:0/524577900 <== mon.2 v2:172.21.15.184:3301/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd454013a30 con 0x21558c0 2023-11-28T11:59:55.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.269+0000 7fd463c1e740 1 -- 172.21.15.39:0/524577900 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x22dc0e0 con 0x21558c0 2023-11-28T11:59:55.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.269+0000 7fd4397fa700 1 -- 172.21.15.39:0/524577900 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd454013bf0 con 0x21558c0 2023-11-28T11:59:55.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.269+0000 7fd463c1e740 10 client.5804 fetch_fsmap learned FSMap version 32 2023-11-28T11:59:55.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.269+0000 7fd463c1e740 1 -- 172.21.15.39:0/524577900 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x2156b10 con 0x21558c0 2023-11-28T11:59:55.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.269+0000 7fd4397fa700 1 -- 172.21.15.39:0/524577900 <== mon.2 v2:172.21.15.184:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x22dc0e0 con 0x21558c0 2023-11-28T11:59:55.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.269+0000 7fd4397fa700 1 -- 172.21.15.39:0/524577900 <== mon.2 v2:172.21.15.184:3301/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fd454013d50 con 0x21558c0 2023-11-28T11:59:55.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.269+0000 7fd463c1e740 10 client.5804 fetch_fsmap finished waiting for FSMap version 32 2023-11-28T11:59:55.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.269+0000 7fd463c1e740 10 client.5804 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2023-11-28T11:59:55.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.269+0000 7fd463c1e740 20 client.5804 populate_metadata read hostname 'smithi039' 2023-11-28T11:59:55.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.269+0000 7fd463c1e740 1 --2- 172.21.15.39:0/524577900 >> [v2:172.21.15.39:6832/990492858,v1:172.21.15.39:6835/990492858] conn(0x237d220 0x2379030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.269+0000 7fd463c1e740 4 client.5804 mds_command: new command op to 6244 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T11:59:55.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.269+0000 7fd463c1e740 1 -- 172.21.15.39:0/524577900 --> [v2:172.21.15.39:6832/990492858,v1:172.21.15.39:6835/990492858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x22dbe00 con 0x237d220 2023-11-28T11:59:55.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.269+0000 7fd45a59c700 1 --2- 172.21.15.39:0/524577900 >> [v2:172.21.15.39:6832/990492858,v1:172.21.15.39:6835/990492858] conn(0x237d220 0x2379030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.269+0000 7fd45a59c700 1 --2- 172.21.15.39:0/524577900 >> [v2:172.21.15.39:6832/990492858,v1:172.21.15.39:6835/990492858] conn(0x237d220 0x2379030 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4a892949bbfb6a3 server_cookie=e21c7a0aeeb2609a in_seq=0 out_seq=0 2023-11-28T11:59:55.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.269+0000 7fd4397fa700 10 client.5804 ms_handle_connect on v2:172.21.15.39:6832/990492858 2023-11-28T11:59:55.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.269+0000 7fd4397fa700 1 -- 172.21.15.39:0/524577900 <== mds.0 v2:172.21.15.39:6832/990492858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x22dbe00 con 0x237d220 2023-11-28T11:59:55.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.269+0000 7fd4397fa700 10 client.5804 handle_command_reply: tid=0 2023-11-28T11:59:55.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.269+0000 7fd463c1e740 1 client.5804 shutdown 2023-11-28T11:59:55.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.269+0000 7fd463c1e740 1 -- 172.21.15.39:0/524577900 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x21558c0 msgr2=0x23a3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:55.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.269+0000 7fd463c1e740 1 --2- 172.21.15.39:0/524577900 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x21558c0 0x23a3d10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd454004630 tx=0x7fd454004940 comp rx=0 tx=0).stop 2023-11-28T11:59:55.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.273+0000 7fd463c1e740 1 -- 172.21.15.39:0/524577900 shutdown_connections 2023-11-28T11:59:55.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.273+0000 7fd463c1e740 1 --2- 172.21.15.39:0/524577900 >> [v2:172.21.15.39:6832/990492858,v1:172.21.15.39:6835/990492858] conn(0x237d220 0x2379030 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.273+0000 7fd463c1e740 1 --2- 172.21.15.39:0/524577900 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x21558c0 0x23a3d10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.273+0000 7fd463c1e740 1 --2- 172.21.15.39:0/524577900 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x210ac10 0x23ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.273+0000 7fd463c1e740 1 --2- 172.21.15.39:0/524577900 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x210a840 0x23c7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.273+0000 7fd463c1e740 1 -- 172.21.15.39:0/524577900 >> 172.21.15.39:0/524577900 conn(0x210afe0 msgr2=0x239d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:55.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.273+0000 7fd4397fa700 0 client.5804 ms_handle_reset on v2:172.21.15.39:6832/990492858 2023-11-28T11:59:55.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.273+0000 7fd463c1e740 1 -- 172.21.15.39:0/524577900 shutdown_connections 2023-11-28T11:59:55.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.273+0000 7fd463c1e740 1 -- 172.21.15.39:0/524577900 wait complete. 2023-11-28T11:59:55.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.273+0000 7fd463c1e740 20 client.5804 trim_cache size 0 max 16384 2023-11-28T11:59:55.294 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.289+0000 7fd463c1e740 1 Processor -- start 2023-11-28T11:59:55.294 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.289+0000 7fd463c1e740 1 -- start start 2023-11-28T11:59:55.295 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.289+0000 7fd463c1e740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x210a840 0x23c0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.295 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.289+0000 7fd463c1e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x210ac10 0x237a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.295 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.289+0000 7fd463c1e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x21558c0 0x237acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.295 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.289+0000 7fd463c1e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x2282510 con 0x210ac10 2023-11-28T11:59:55.295 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.289+0000 7fd463c1e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x22e2870 con 0x21558c0 2023-11-28T11:59:55.295 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.289+0000 7fd463c1e740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x2371ee0 con 0x210a840 2023-11-28T11:59:55.296 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.289+0000 7fd459d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x210ac10 0x237a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.296 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.289+0000 7fd459d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x210ac10 0x237a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38720/0 (socket says 172.21.15.39:38720) 2023-11-28T11:59:55.296 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.289+0000 7fd459d9b700 1 -- 172.21.15.39:0/1218523915 learned_addr learned my addr 172.21.15.39:0/1218523915 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:55.296 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.289+0000 7fd45ad9d700 1 --2- 172.21.15.39:0/1218523915 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x21558c0 0x237acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.296 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.289+0000 7fd45a59c700 1 --2- 172.21.15.39:0/1218523915 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x210a840 0x23c0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.297 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.293+0000 7fd45ad9d700 1 -- 172.21.15.39:0/1218523915 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x210a840 msgr2=0x23c0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:55.297 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.293+0000 7fd45ad9d700 1 --2- 172.21.15.39:0/1218523915 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x210a840 0x23c0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.297 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.293+0000 7fd45ad9d700 1 -- 172.21.15.39:0/1218523915 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x210ac10 msgr2=0x237a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:55.297 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.293+0000 7fd45ad9d700 1 --2- 172.21.15.39:0/1218523915 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x210ac10 0x237a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.297 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.293+0000 7fd45ad9d700 1 -- 172.21.15.39:0/1218523915 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd45c1f3ac0 con 0x21558c0 2023-11-28T11:59:55.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.293+0000 7fd459d9b700 1 --2- 172.21.15.39:0/1218523915 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x210ac10 0x237a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:55.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.293+0000 7fd45ad9d700 1 --2- 172.21.15.39:0/1218523915 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x21558c0 0x237acc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd454020460 tx=0x7fd454016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c91378101614435e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:55.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.293+0000 7fd448ff9700 1 -- 172.21.15.39:0/1218523915 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4540204e0 con 0x21558c0 2023-11-28T11:59:55.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.293+0000 7fd448ff9700 1 -- 172.21.15.39:0/1218523915 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4540138d0 con 0x21558c0 2023-11-28T11:59:55.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.293+0000 7fd448ff9700 1 -- 172.21.15.39:0/1218523915 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd454013c80 con 0x21558c0 2023-11-28T11:59:55.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.293+0000 7fd463c1e740 1 -- 172.21.15.39:0/1218523915 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x21558c0 msgr2=0x237acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:55.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.293+0000 7fd463c1e740 1 --2- 172.21.15.39:0/1218523915 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x21558c0 0x237acc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd454020460 tx=0x7fd454016000 comp rx=0 tx=0).stop 2023-11-28T11:59:55.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.293+0000 7fd463c1e740 1 -- 172.21.15.39:0/1218523915 shutdown_connections 2023-11-28T11:59:55.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.293+0000 7fd463c1e740 1 --2- 172.21.15.39:0/1218523915 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x21558c0 0x237acc0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.293+0000 7fd463c1e740 1 --2- 172.21.15.39:0/1218523915 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x210ac10 0x237a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.293+0000 7fd463c1e740 1 --2- 172.21.15.39:0/1218523915 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x210a840 0x23c0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.293+0000 7fd463c1e740 1 -- 172.21.15.39:0/1218523915 >> 172.21.15.39:0/1218523915 conn(0x210afe0 msgr2=0x239bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:55.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.293+0000 7fd463c1e740 1 -- 172.21.15.39:0/1218523915 shutdown_connections 2023-11-28T11:59:55.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.293+0000 7fd463c1e740 1 -- 172.21.15.39:0/1218523915 wait complete. 2023-11-28T11:59:55.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.297+0000 7fd463c1e740 1 -- start start 2023-11-28T11:59:55.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.297+0000 7fd463c1e740 1 Processor -- start 2023-11-28T11:59:55.304 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.297+0000 7fd463c1e740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x210a840 0x241e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.304 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.297+0000 7fd463c1e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x210ac10 0x239c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.304 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.297+0000 7fd463c1e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x21558c0 0x239e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.304 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.297+0000 7fd463c1e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x23c0820 con 0x210ac10 2023-11-28T11:59:55.304 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.297+0000 7fd463c1e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x23bfda0 con 0x21558c0 2023-11-28T11:59:55.304 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.297+0000 7fd463c1e740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x23c0580 con 0x210a840 2023-11-28T11:59:55.304 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.297+0000 7fd463c1e740 10 client.0 _ll_register_callbacks cb 0x7fd450053470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:59:55.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.297+0000 7fd459d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x210ac10 0x239c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.301+0000 7fd459d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x210ac10 0x239c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38726/0 (socket says 172.21.15.39:38726) 2023-11-28T11:59:55.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.301+0000 7fd459d9b700 1 -- 172.21.15.39:0/180967884 learned_addr learned my addr 172.21.15.39:0/180967884 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:55.306 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.301+0000 7fd45ad9d700 1 --2- 172.21.15.39:0/180967884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x21558c0 0x239e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.306 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.301+0000 7fd45a59c700 1 --2- 172.21.15.39:0/180967884 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x210a840 0x241e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.306 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.301+0000 7fd459d9b700 1 -- 172.21.15.39:0/180967884 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x210a840 msgr2=0x241e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:55.306 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.301+0000 7fd459d9b700 1 --2- 172.21.15.39:0/180967884 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x210a840 0x241e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.306 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.301+0000 7fd459d9b700 1 -- 172.21.15.39:0/180967884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x21558c0 msgr2=0x239e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:55.307 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.301+0000 7fd459d9b700 1 --2- 172.21.15.39:0/180967884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x21558c0 0x239e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.307 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.301+0000 7fd459d9b700 1 -- 172.21.15.39:0/180967884 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x23090a0 con 0x210ac10 2023-11-28T11:59:55.307 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.301+0000 7fd45a59c700 1 --2- 172.21.15.39:0/180967884 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x210a840 0x241e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:55.307 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.301+0000 7fd45ad9d700 1 --2- 172.21.15.39:0/180967884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x21558c0 0x239e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:55.307 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.301+0000 7fd459d9b700 1 --2- 172.21.15.39:0/180967884 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x210ac10 0x239c110 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fd450053380 tx=0x7fd450009340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72998cb2b363c0e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:55.307 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.301+0000 7fd4397fa700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-11-28T11:59:55.307 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.301+0000 7fd4397fa700 1 -- 172.21.15.39:0/180967884 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd450060040 con 0x210ac10 2023-11-28T11:59:55.307 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.301+0000 7fd4397fa700 1 -- 172.21.15.39:0/180967884 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd45005b280 con 0x210ac10 2023-11-28T11:59:55.307 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.301+0000 7fd463c1e740 1 -- 172.21.15.39:0/180967884 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x237c750 con 0x210ac10 2023-11-28T11:59:55.307 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.301+0000 7fd4397fa700 1 -- 172.21.15.39:0/180967884 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd45005b460 con 0x210ac10 2023-11-28T11:59:55.307 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.301+0000 7fd463c1e740 10 client.6462 fetch_fsmap learned FSMap version 32 2023-11-28T11:59:55.308 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.301+0000 7fd463c1e740 1 -- 172.21.15.39:0/180967884 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x2156b10 con 0x210ac10 2023-11-28T11:59:55.309 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.301+0000 7fd4397fa700 1 -- 172.21.15.39:0/180967884 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x237c750 con 0x210ac10 2023-11-28T11:59:55.309 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.301+0000 7fd4397fa700 1 -- 172.21.15.39:0/180967884 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fd45006ab90 con 0x210ac10 2023-11-28T11:59:55.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.301+0000 7fd463c1e740 10 client.6462 fetch_fsmap finished waiting for FSMap version 32 2023-11-28T11:59:55.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.301+0000 7fd463c1e740 10 client.6462 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2023-11-28T11:59:55.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.301+0000 7fd463c1e740 20 client.6462 populate_metadata read hostname 'smithi039' 2023-11-28T11:59:55.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.301+0000 7fd463c1e740 1 --2- 172.21.15.39:0/180967884 >> [v2:172.21.15.39:6832/990492858,v1:172.21.15.39:6835/990492858] conn(0x239ee80 0x23a15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.301+0000 7fd463c1e740 4 client.6462 mds_command: new command op to 6244 tid=0[{"prefix": "scrub status"}] 2023-11-28T11:59:55.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.301+0000 7fd463c1e740 1 -- 172.21.15.39:0/180967884 --> [v2:172.21.15.39:6832/990492858,v1:172.21.15.39:6835/990492858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x7fd450059230 con 0x239ee80 2023-11-28T11:59:55.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.301+0000 7fd45a59c700 1 --2- 172.21.15.39:0/180967884 >> [v2:172.21.15.39:6832/990492858,v1:172.21.15.39:6835/990492858] conn(0x239ee80 0x23a15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.301+0000 7fd45a59c700 1 --2- 172.21.15.39:0/180967884 >> [v2:172.21.15.39:6832/990492858,v1:172.21.15.39:6835/990492858] conn(0x239ee80 0x23a15d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9531a70288d2f2cd server_cookie=33e600a5b2d25de in_seq=0 out_seq=0 2023-11-28T11:59:55.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.301+0000 7fd4397fa700 10 client.6462 ms_handle_connect on v2:172.21.15.39:6832/990492858 2023-11-28T11:59:55.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.305+0000 7fd4397fa700 1 -- 172.21.15.39:0/180967884 <== mds.0 v2:172.21.15.39:6832/990492858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x7fd450059230 con 0x239ee80 2023-11-28T11:59:55.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.305+0000 7fd4397fa700 10 client.6462 handle_command_reply: tid=0 2023-11-28T11:59:55.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.305+0000 7fd463c1e740 1 client.6462 shutdown 2023-11-28T11:59:55.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.305+0000 7fd463c1e740 1 -- 172.21.15.39:0/180967884 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x210ac10 msgr2=0x239c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:55.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.305+0000 7fd463c1e740 1 --2- 172.21.15.39:0/180967884 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x210ac10 0x239c110 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fd450053380 tx=0x7fd450009340 comp rx=0 tx=0).stop 2023-11-28T11:59:55.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.305+0000 7fd463c1e740 1 -- 172.21.15.39:0/180967884 shutdown_connections 2023-11-28T11:59:55.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.305+0000 7fd463c1e740 1 --2- 172.21.15.39:0/180967884 >> [v2:172.21.15.39:6832/990492858,v1:172.21.15.39:6835/990492858] conn(0x239ee80 0x23a15d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.305+0000 7fd463c1e740 1 --2- 172.21.15.39:0/180967884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x21558c0 0x239e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.305+0000 7fd463c1e740 1 --2- 172.21.15.39:0/180967884 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x210ac10 0x239c110 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.305+0000 7fd4397fa700 0 client.6462 ms_handle_reset on v2:172.21.15.39:6832/990492858 2023-11-28T11:59:55.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.305+0000 7fd463c1e740 1 --2- 172.21.15.39:0/180967884 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x210a840 0x241e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.305+0000 7fd463c1e740 1 -- 172.21.15.39:0/180967884 >> 172.21.15.39:0/180967884 conn(0x210afe0 msgr2=0x23c98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:55.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.305+0000 7fd463c1e740 1 -- 172.21.15.39:0/180967884 shutdown_connections 2023-11-28T11:59:55.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.305+0000 7fd463c1e740 1 -- 172.21.15.39:0/180967884 wait complete. 2023-11-28T11:59:55.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.305+0000 7fd463c1e740 20 client.6462 trim_cache size 0 max 16384 2023-11-28T11:59:55.312 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2023-11-28T11:59:55.312 INFO:teuthology.orchestra.run.smithi039.stdout: "status": "no active scrubs running", 2023-11-28T11:59:55.312 INFO:teuthology.orchestra.run.smithi039.stdout: "scrubs": {} 2023-11-28T11:59:55.312 INFO:teuthology.orchestra.run.smithi039.stdout:} 2023-11-28T11:59:55.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.305+0000 7fd460992700 1 -- 172.21.15.39:0/2293116022 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd43c064ee0 msgr2=0x7fd43c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:55.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.305+0000 7fd460992700 1 --2- 172.21.15.39:0/2293116022 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd43c064ee0 0x7fd43c067390 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd45c073190 tx=0x7fd44c008030 comp rx=0 tx=0).stop 2023-11-28T11:59:55.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.305+0000 7fd460992700 1 -- 172.21.15.39:0/2293116022 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd45c06c680 msgr2=0x7fd45c1f62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:55.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.305+0000 7fd460992700 1 --2- 172.21.15.39:0/2293116022 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd45c06c680 0x7fd45c1f62a0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fd45000b480 tx=0x7fd45000b790 comp rx=0 tx=0).stop 2023-11-28T11:59:55.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.305+0000 7fd460992700 1 -- 172.21.15.39:0/2293116022 shutdown_connections 2023-11-28T11:59:55.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.305+0000 7fd460992700 1 --2- 172.21.15.39:0/2293116022 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd45c0aed60 0x7fd45c0c6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.305+0000 7fd460992700 1 --2- 172.21.15.39:0/2293116022 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd45c06c680 0x7fd45c1f62a0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.305+0000 7fd460992700 1 --2- 172.21.15.39:0/2293116022 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd43c064ee0 0x7fd43c067390 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.305+0000 7fd460992700 1 --2- 172.21.15.39:0/2293116022 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd45c06c2b0 0x7fd45c0c2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.305+0000 7fd460992700 1 -- 172.21.15.39:0/2293116022 >> 172.21.15.39:0/2293116022 conn(0x7fd45c0cf580 msgr2=0x7fd45c0af2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:55.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.305+0000 7fd460992700 1 -- 172.21.15.39:0/2293116022 shutdown_connections 2023-11-28T11:59:55.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.305+0000 7fd460992700 1 -- 172.21.15.39:0/2293116022 wait complete. 2023-11-28T11:59:55.334 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-11-28T11:59:55.334 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:59:55.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.505+0000 7fe589ab8700 1 Processor -- start 2023-11-28T11:59:55.511 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.505+0000 7fe589ab8700 1 -- start start 2023-11-28T11:59:55.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.505+0000 7fe589ab8700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe5840cdeb0 0x7fe584070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.509+0000 7fe589ab8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5840705c0 0x7fe58406a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.509+0000 7fe589ab8700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe584070a20 con 0x7fe58415c1a0 2023-11-28T11:59:55.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.509+0000 7fe589ab8700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe584069bf0 con 0x7fe5840cdeb0 2023-11-28T11:59:55.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.509+0000 7fe589ab8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5840adf90 con 0x7fe5840705c0 2023-11-28T11:59:55.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.509+0000 7fe57bfff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe5840cdeb0 0x7fe584070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.509+0000 7fe588ab6700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fe58415c1a0 0x7fe58406c8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42318/0 (socket says 172.21.15.39:42318) 2023-11-28T11:59:55.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.509+0000 7fe588ab6700 1 -- 172.21.15.39:0/4239938713 learned_addr learned my addr 172.21.15.39:0/4239938713 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:59:55.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.509+0000 7fe5892b7700 1 --2- 172.21.15.39:0/4239938713 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5840705c0 0x7fe58406a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.514 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.509+0000 7fe57bfff700 1 -- 172.21.15.39:0/4239938713 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5840705c0 msgr2=0x7fe58406a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:55.514 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.509+0000 7fe57bfff700 1 --2- 172.21.15.39:0/4239938713 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5840705c0 0x7fe58406a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.514 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.509+0000 7fe57bfff700 1 -- 172.21.15.39:0/4239938713 >> v1:172.21.15.39:6789/0 conn(0x7fe58415c1a0 legacy=0x7fe58406c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:55.514 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.509+0000 7fe57bfff700 1 -- 172.21.15.39:0/4239938713 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5840ce370 con 0x7fe5840cdeb0 2023-11-28T11:59:55.514 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.509+0000 7fe57b7fe700 1 -- 172.21.15.39:0/4239938713 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2742705781 0 0) 0x7fe584070a20 con 0x7fe58415c1a0 2023-11-28T11:59:55.515 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.509+0000 7fe57bfff700 1 --2- 172.21.15.39:0/4239938713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5840cdeb0 0x7fe584070080 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe574009850 tx=0x7fe574009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28574d2f55bc0943 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:55.515 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.509+0000 7fe57b7fe700 1 -- 172.21.15.39:0/4239938713 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe574011830 con 0x7fe5840cdeb0 2023-11-28T11:59:55.515 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.509+0000 7fe57b7fe700 1 -- 172.21.15.39:0/4239938713 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe574011990 con 0x7fe5840cdeb0 2023-11-28T11:59:55.515 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.509+0000 7fe57b7fe700 1 -- 172.21.15.39:0/4239938713 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe574011d40 con 0x7fe5840cdeb0 2023-11-28T11:59:55.516 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.513+0000 7fe589ab8700 1 -- 172.21.15.39:0/4239938713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5840cdeb0 msgr2=0x7fe584070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:55.517 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.513+0000 7fe589ab8700 1 --2- 172.21.15.39:0/4239938713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5840cdeb0 0x7fe584070080 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe574009850 tx=0x7fe574009b60 comp rx=0 tx=0).stop 2023-11-28T11:59:55.518 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.513+0000 7fe589ab8700 1 -- 172.21.15.39:0/4239938713 shutdown_connections 2023-11-28T11:59:55.518 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.513+0000 7fe589ab8700 1 --2- 172.21.15.39:0/4239938713 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5840705c0 0x7fe58406a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.518 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.513+0000 7fe589ab8700 1 --2- 172.21.15.39:0/4239938713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5840cdeb0 0x7fe584070080 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.518 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.513+0000 7fe589ab8700 1 -- 172.21.15.39:0/4239938713 >> 172.21.15.39:0/4239938713 conn(0x7fe5840b0f80 msgr2=0x7fe5840ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:55.518 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.513+0000 7fe589ab8700 1 -- 172.21.15.39:0/4239938713 shutdown_connections 2023-11-28T11:59:55.518 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.513+0000 7fe589ab8700 1 -- 172.21.15.39:0/4239938713 wait complete. 2023-11-28T11:59:55.519 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.513+0000 7fe589ab8700 1 Processor -- start 2023-11-28T11:59:55.519 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.513+0000 7fe589ab8700 1 -- start start 2023-11-28T11:59:55.521 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.517+0000 7fe589ab8700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe5840705c0 0x7fe58415f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.521 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.517+0000 7fe589ab8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5840cdeb0 0x7fe58414caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.521 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.517+0000 7fe589ab8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe58415c1a0 0x7fe5840b2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.522 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.517+0000 7fe589ab8700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5840b2bd0 con 0x7fe5840705c0 2023-11-28T11:59:55.522 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.517+0000 7fe589ab8700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5840b2610 con 0x7fe58415c1a0 2023-11-28T11:59:55.522 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.517+0000 7fe589ab8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5840b28f0 con 0x7fe5840cdeb0 2023-11-28T11:59:55.523 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.517+0000 7fe588ab6700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe5840705c0 0x7fe58415f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.523 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.517+0000 7fe588ab6700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe5840705c0 0x7fe58415f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38738/0 (socket says 172.21.15.39:38738) 2023-11-28T11:59:55.523 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.517+0000 7fe588ab6700 1 -- 172.21.15.39:0/3564351095 learned_addr learned my addr 172.21.15.39:0/3564351095 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:55.524 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.517+0000 7fe57bfff700 1 --2- 172.21.15.39:0/3564351095 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5840cdeb0 0x7fe58414caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.524 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.517+0000 7fe5892b7700 1 --2- 172.21.15.39:0/3564351095 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe58415c1a0 0x7fe5840b2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.524 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.517+0000 7fe588ab6700 1 -- 172.21.15.39:0/3564351095 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5840cdeb0 msgr2=0x7fe58414caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:55.524 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.517+0000 7fe588ab6700 1 --2- 172.21.15.39:0/3564351095 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5840cdeb0 0x7fe58414caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.524 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.517+0000 7fe588ab6700 1 -- 172.21.15.39:0/3564351095 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe58415c1a0 msgr2=0x7fe5840b2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:55.524 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.517+0000 7fe588ab6700 1 --2- 172.21.15.39:0/3564351095 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe58415c1a0 0x7fe5840b2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.524 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.517+0000 7fe588ab6700 1 -- 172.21.15.39:0/3564351095 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5740094b0 con 0x7fe5840705c0 2023-11-28T11:59:55.524 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.517+0000 7fe588ab6700 1 --2- 172.21.15.39:0/3564351095 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe5840705c0 0x7fe58415f0c0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fe58000c4b0 tx=0x7fe58000c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:55.524 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.517+0000 7fe5797fa700 1 -- 172.21.15.39:0/3564351095 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe580005d90 con 0x7fe5840705c0 2023-11-28T11:59:55.524 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.517+0000 7fe5797fa700 1 -- 172.21.15.39:0/3564351095 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5800070d0 con 0x7fe5840705c0 2023-11-28T11:59:55.524 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.517+0000 7fe5797fa700 1 -- 172.21.15.39:0/3564351095 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe580007460 con 0x7fe5840705c0 2023-11-28T11:59:55.524 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.517+0000 7fe589ab8700 1 -- 172.21.15.39:0/3564351095 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5840cc780 con 0x7fe5840705c0 2023-11-28T11:59:55.525 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.517+0000 7fe589ab8700 1 -- 172.21.15.39:0/3564351095 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5840cc4a0 con 0x7fe5840705c0 2023-11-28T11:59:55.525 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.521+0000 7fe589ab8700 1 -- 172.21.15.39:0/3564351095 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe58415c570 con 0x7fe5840705c0 2023-11-28T11:59:55.527 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.521+0000 7fe5797fa700 1 -- 172.21.15.39:0/3564351095 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe580019030 con 0x7fe5840705c0 2023-11-28T11:59:55.528 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.521+0000 7fe5797fa700 1 --2- 172.21.15.39:0/3564351095 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe570064ee0 0x7fe570067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.528 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.521+0000 7fe5797fa700 1 -- 172.21.15.39:0/3564351095 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe580081230 con 0x7fe5840705c0 2023-11-28T11:59:55.528 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.525+0000 7fe57bfff700 1 --2- 172.21.15.39:0/3564351095 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe570064ee0 0x7fe570067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.525+0000 7fe57bfff700 1 --2- 172.21.15.39:0/3564351095 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe570064ee0 0x7fe570067390 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe5840ce2a0 tx=0x7fe574008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:55.535 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.529+0000 7fe5797fa700 1 -- 172.21.15.39:0/3564351095 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe58004f290 con 0x7fe5840705c0 2023-11-28T11:59:55.748 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.741+0000 7fe589ab8700 1 -- 172.21.15.39:0/3564351095 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe584073cb0 con 0x7fe5840705c0 2023-11-28T11:59:55.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.745+0000 7fe5797fa700 1 -- 172.21.15.39:0/3564351095 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4653 (secure 0 0 0) 0x7fe5800528b0 con 0x7fe5840705c0 2023-11-28T11:59:55.749 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:59:55.749 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5645,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/3875262459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3875262459},{"type":"v1","addr":"172.21.15.184:6835","nonce":3875262459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5648,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/3845363738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3845363738},{"type":"v1","addr":"172.21.15.184:6837","nonce":3845363738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6225,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6834/2646905389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6833","nonce":2646905389},{"type":"v1","addr":"172.21.15.39:6834","nonce":2646905389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:59:45.290110+0000","modified":"2023-11-28T11:59:48.326013+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6244":{"gid":6244,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6835/990492858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":990492858},{"type":"v1","addr":"172.21.15.39:6835","nonce":990492858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T11:59:55.751 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.745+0000 7fe589ab8700 1 -- 172.21.15.39:0/3564351095 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe570064ee0 msgr2=0x7fe570067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:55.751 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.745+0000 7fe589ab8700 1 --2- 172.21.15.39:0/3564351095 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe570064ee0 0x7fe570067390 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe5840ce2a0 tx=0x7fe574008030 comp rx=0 tx=0).stop 2023-11-28T11:59:55.751 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.745+0000 7fe589ab8700 1 -- 172.21.15.39:0/3564351095 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe5840705c0 msgr2=0x7fe58415f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:55.752 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.745+0000 7fe589ab8700 1 --2- 172.21.15.39:0/3564351095 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe5840705c0 0x7fe58415f0c0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fe58000c4b0 tx=0x7fe58000c7c0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.752 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.745+0000 7fe589ab8700 1 -- 172.21.15.39:0/3564351095 shutdown_connections 2023-11-28T11:59:55.752 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.745+0000 7fe589ab8700 1 --2- 172.21.15.39:0/3564351095 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe570064ee0 0x7fe570067390 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.752 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.745+0000 7fe589ab8700 1 --2- 172.21.15.39:0/3564351095 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe58415c1a0 0x7fe5840b2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.752 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.745+0000 7fe589ab8700 1 --2- 172.21.15.39:0/3564351095 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5840cdeb0 0x7fe58414caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.752 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.745+0000 7fe589ab8700 1 --2- 172.21.15.39:0/3564351095 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe5840705c0 0x7fe58415f0c0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.752 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.745+0000 7fe589ab8700 1 -- 172.21.15.39:0/3564351095 >> 172.21.15.39:0/3564351095 conn(0x7fe5840b0f80 msgr2=0x7fe5840cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:55.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.745+0000 7fe589ab8700 1 -- 172.21.15.39:0/3564351095 shutdown_connections 2023-11-28T11:59:55.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.745+0000 7fe589ab8700 1 -- 172.21.15.39:0/3564351095 wait complete. 2023-11-28T11:59:55.754 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 32 2023-11-28T11:59:55.773 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2023-11-28T11:59:55.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.949+0000 7f9d6f59e700 1 Processor -- start 2023-11-28T11:59:55.955 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.949+0000 7f9d6f59e700 1 -- start start 2023-11-28T11:59:55.958 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.953+0000 7f9d6f59e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9d700b1b30 0x7f9d700cca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.958 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.953+0000 7f9d6f59e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9d700cd950 0x7f9d700b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.958 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.953+0000 7f9d6f59e700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d700cb9c0 con 0x7f9d700b3b30 2023-11-28T11:59:55.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.953+0000 7f9d6f59e700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d700cadf0 con 0x7f9d700b1b30 2023-11-28T11:59:55.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.953+0000 7f9d6f59e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d700cb090 con 0x7f9d700cd950 2023-11-28T11:59:55.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.953+0000 7f9d6e59c700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9d700b1b30 0x7f9d700cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.953+0000 7f9d6ed9d700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f9d700b3b30 0x7f9d700ce370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42334/0 (socket says 172.21.15.39:42334) 2023-11-28T11:59:55.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.953+0000 7f9d6ed9d700 1 -- 172.21.15.39:0/830968631 learned_addr learned my addr 172.21.15.39:0/830968631 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:59:55.960 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.953+0000 7f9d6dd9b700 1 --2- 172.21.15.39:0/830968631 >> v2:172.21.15.184:3300/0 conn(0x7f9d700cd950 0x7f9d700b35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.960 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.953+0000 7f9d6d59a700 1 -- 172.21.15.39:0/830968631 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1037642163 0 0) 0x7f9d700cb9c0 con 0x7f9d700b3b30 2023-11-28T11:59:55.960 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.953+0000 7f9d6e59c700 1 -- 172.21.15.39:0/830968631 >> v2:172.21.15.184:3300/0 conn(0x7f9d700cd950 msgr2=0x7f9d700b35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:55.960 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.953+0000 7f9d6e59c700 1 --2- 172.21.15.39:0/830968631 >> v2:172.21.15.184:3300/0 conn(0x7f9d700cd950 0x7f9d700b35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.960 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.953+0000 7f9d6e59c700 1 -- 172.21.15.39:0/830968631 >> v1:172.21.15.39:6789/0 conn(0x7f9d700b3b30 legacy=0x7f9d700ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:55.960 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.953+0000 7f9d6e59c700 1 -- 172.21.15.39:0/830968631 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d700cb370 con 0x7f9d700b1b30 2023-11-28T11:59:55.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.957+0000 7f9d6e59c700 1 --2- 172.21.15.39:0/830968631 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d700b1b30 0x7f9d700cca20 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f9d70072db0 tx=0x7f9d60009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=358a7d8ad8472566 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:55.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.957+0000 7f9d6d59a700 1 -- 172.21.15.39:0/830968631 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d60005e50 con 0x7f9d700b1b30 2023-11-28T11:59:55.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.957+0000 7f9d6d59a700 1 -- 172.21.15.39:0/830968631 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d60006030 con 0x7f9d700b1b30 2023-11-28T11:59:55.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.957+0000 7f9d6d59a700 1 -- 172.21.15.39:0/830968631 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d600063c0 con 0x7f9d700b1b30 2023-11-28T11:59:55.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.957+0000 7f9d6f59e700 1 -- 172.21.15.39:0/830968631 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d700b1b30 msgr2=0x7f9d700cca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:55.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.957+0000 7f9d6f59e700 1 --2- 172.21.15.39:0/830968631 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d700b1b30 0x7f9d700cca20 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f9d70072db0 tx=0x7f9d60009b20 comp rx=0 tx=0).stop 2023-11-28T11:59:55.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.957+0000 7f9d6f59e700 1 -- 172.21.15.39:0/830968631 shutdown_connections 2023-11-28T11:59:55.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.957+0000 7f9d6f59e700 1 --2- 172.21.15.39:0/830968631 >> v2:172.21.15.184:3300/0 conn(0x7f9d700cd950 0x7f9d700b35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.957+0000 7f9d6f59e700 1 --2- 172.21.15.39:0/830968631 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d700b1b30 0x7f9d700cca20 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.957+0000 7f9d6f59e700 1 -- 172.21.15.39:0/830968631 >> 172.21.15.39:0/830968631 conn(0x7f9d70099af0 msgr2=0x7f9d700d07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:55.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.957+0000 7f9d6f59e700 1 -- 172.21.15.39:0/830968631 shutdown_connections 2023-11-28T11:59:55.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.957+0000 7f9d6f59e700 1 -- 172.21.15.39:0/830968631 wait complete. 2023-11-28T11:59:55.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.961+0000 7f9d6f59e700 1 Processor -- start 2023-11-28T11:59:55.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.961+0000 7f9d6f59e700 1 -- start start 2023-11-28T11:59:55.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.961+0000 7f9d6f59e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d700b1b30 0x7f9d7015bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.961+0000 7f9d6f59e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d700b3b30 0x7f9d7015c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.961+0000 7f9d6f59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d700cd950 0x7f9d700ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.961+0000 7f9d6f59e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7015ce00 con 0x7f9d700b1b30 2023-11-28T11:59:55.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.961+0000 7f9d6f59e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7015b6e0 con 0x7f9d700b3b30 2023-11-28T11:59:55.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.961+0000 7f9d6f59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7015db70 con 0x7f9d700cd950 2023-11-28T11:59:55.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.965+0000 7f9d6e59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d700b1b30 0x7f9d7015bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.965+0000 7f9d6e59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d700b1b30 0x7f9d7015bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38756/0 (socket says 172.21.15.39:38756) 2023-11-28T11:59:55.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.965+0000 7f9d6e59c700 1 -- 172.21.15.39:0/3445997122 learned_addr learned my addr 172.21.15.39:0/3445997122 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:55.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.965+0000 7f9d6dd9b700 1 --2- 172.21.15.39:0/3445997122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d700b3b30 0x7f9d7015c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.965+0000 7f9d6ed9d700 1 --2- 172.21.15.39:0/3445997122 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d700cd950 0x7f9d700ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.965+0000 7f9d6e59c700 1 -- 172.21.15.39:0/3445997122 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d700cd950 msgr2=0x7f9d700ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:55.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.965+0000 7f9d6e59c700 1 --2- 172.21.15.39:0/3445997122 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d700cd950 0x7f9d700ca2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.965+0000 7f9d6e59c700 1 -- 172.21.15.39:0/3445997122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d700b3b30 msgr2=0x7f9d7015c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:55.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.965+0000 7f9d6e59c700 1 --2- 172.21.15.39:0/3445997122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d700b3b30 0x7f9d7015c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.965+0000 7f9d6e59c700 1 -- 172.21.15.39:0/3445997122 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d60009450 con 0x7f9d700b1b30 2023-11-28T11:59:55.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.965+0000 7f9d6e59c700 1 --2- 172.21.15.39:0/3445997122 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d700b1b30 0x7f9d7015bb00 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f9d60000c00 tx=0x7f9d60004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:55.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.965+0000 7f9d5effd700 1 -- 172.21.15.39:0/3445997122 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d600038c0 con 0x7f9d700b1b30 2023-11-28T11:59:55.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.965+0000 7f9d5effd700 1 -- 172.21.15.39:0/3445997122 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d60020070 con 0x7f9d700b1b30 2023-11-28T11:59:55.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.965+0000 7f9d6f59e700 1 -- 172.21.15.39:0/3445997122 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d700cddc0 con 0x7f9d700b1b30 2023-11-28T11:59:55.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.965+0000 7f9d5effd700 1 -- 172.21.15.39:0/3445997122 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d60003c60 con 0x7f9d700b1b30 2023-11-28T11:59:55.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.965+0000 7f9d6f59e700 1 -- 172.21.15.39:0/3445997122 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d700cb650 con 0x7f9d700b1b30 2023-11-28T11:59:55.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.969+0000 7f9d5effd700 1 -- 172.21.15.39:0/3445997122 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9d6002b020 con 0x7f9d700b1b30 2023-11-28T11:59:55.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.969+0000 7f9d5effd700 1 --2- 172.21.15.39:0/3445997122 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9d50064f30 0x7f9d500673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.969+0000 7f9d5effd700 1 -- 172.21.15.39:0/3445997122 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f9d600836f0 con 0x7f9d700b1b30 2023-11-28T11:59:55.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.969+0000 7f9d6dd9b700 1 --2- 172.21.15.39:0/3445997122 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9d50064f30 0x7f9d500673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.973+0000 7f9d6dd9b700 1 --2- 172.21.15.39:0/3445997122 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9d50064f30 0x7f9d500673e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9d7006f370 tx=0x7f9d64009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:55.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.973+0000 7f9d77cd4740 1 Processor -- start 2023-11-28T11:59:55.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.973+0000 7f9d77cd4740 1 -- start start 2023-11-28T11:59:55.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.973+0000 7f9d77cd4740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1917d20 0x1bd6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.973+0000 7f9d77cd4740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1917950 0x1bd73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.973+0000 7f9d77cd4740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x19629d0 0x1b85280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.973+0000 7f9d77cd4740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a86dc0 con 0x19629d0 2023-11-28T11:59:55.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.973+0000 7f9d77cd4740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x1af6e20 con 0x1917d20 2023-11-28T11:59:55.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.973+0000 7f9d77cd4740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x1af0120 con 0x1917950 2023-11-28T11:59:55.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.973+0000 7f9d6ed9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x19629d0 0x1b85280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.973+0000 7f9d6ed9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x19629d0 0x1b85280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38768/0 (socket says 172.21.15.39:38768) 2023-11-28T11:59:55.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.973+0000 7f9d6ed9d700 1 -- 172.21.15.39:0/1248246810 learned_addr learned my addr 172.21.15.39:0/1248246810 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:55.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.973+0000 7f9d6e59c700 1 --2- 172.21.15.39:0/1248246810 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1917d20 0x1bd6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.973+0000 7f9d6dd9b700 1 --2- 172.21.15.39:0/1248246810 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1917950 0x1bd73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.973+0000 7f9d6ed9d700 1 -- 172.21.15.39:0/1248246810 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1917950 msgr2=0x1bd73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:55.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.973+0000 7f9d6ed9d700 1 --2- 172.21.15.39:0/1248246810 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1917950 0x1bd73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.973+0000 7f9d6ed9d700 1 -- 172.21.15.39:0/1248246810 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1917d20 msgr2=0x1bd6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:55.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.973+0000 7f9d6ed9d700 1 --2- 172.21.15.39:0/1248246810 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1917d20 0x1bd6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.973+0000 7f9d6ed9d700 1 -- 172.21.15.39:0/1248246810 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1b169b0 con 0x19629d0 2023-11-28T11:59:55.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.973+0000 7f9d6e59c700 1 --2- 172.21.15.39:0/1248246810 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1917d20 0x1bd6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:55.994 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.977+0000 7f9d6ed9d700 1 --2- 172.21.15.39:0/1248246810 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x19629d0 0x1b85280 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f9d68002160 tx=0x7f9d68007330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c12a6f790d527a9b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:55.994 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.977+0000 7f9d4ffff700 1 -- 172.21.15.39:0/1248246810 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d68007aa0 con 0x19629d0 2023-11-28T11:59:55.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.977+0000 7f9d4ffff700 1 -- 172.21.15.39:0/1248246810 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d68014480 con 0x19629d0 2023-11-28T11:59:55.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.977+0000 7f9d4ffff700 1 -- 172.21.15.39:0/1248246810 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d680147f0 con 0x19629d0 2023-11-28T11:59:55.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.977+0000 7f9d77cd4740 1 -- 172.21.15.39:0/1248246810 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x19629d0 msgr2=0x1b85280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:55.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.977+0000 7f9d77cd4740 1 --2- 172.21.15.39:0/1248246810 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x19629d0 0x1b85280 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f9d68002160 tx=0x7f9d68007330 comp rx=0 tx=0).stop 2023-11-28T11:59:55.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.977+0000 7f9d77cd4740 1 -- 172.21.15.39:0/1248246810 shutdown_connections 2023-11-28T11:59:55.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.977+0000 7f9d77cd4740 1 --2- 172.21.15.39:0/1248246810 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x19629d0 0x1b85280 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.977+0000 7f9d77cd4740 1 --2- 172.21.15.39:0/1248246810 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1917950 0x1bd73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.977+0000 7f9d77cd4740 1 --2- 172.21.15.39:0/1248246810 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1917d20 0x1bd6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.977+0000 7f9d77cd4740 1 -- 172.21.15.39:0/1248246810 >> 172.21.15.39:0/1248246810 conn(0x19180f0 msgr2=0x1bb0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:55.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.977+0000 7f9d77cd4740 1 -- 172.21.15.39:0/1248246810 shutdown_connections 2023-11-28T11:59:55.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.977+0000 7f9d77cd4740 1 -- 172.21.15.39:0/1248246810 wait complete. 2023-11-28T11:59:55.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.977+0000 7f9d77cd4740 1 -- start start 2023-11-28T11:59:55.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.981+0000 7f9d77cd4740 1 Processor -- start 2023-11-28T11:59:55.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.981+0000 7f9d77cd4740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1917950 0x1bd2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.981+0000 7f9d77cd4740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1917d20 0x1bcf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.981+0000 7f9d77cd4740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x19629d0 0x1bcf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.981+0000 7f9d77cd4740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x199cd60 con 0x1917950 2023-11-28T11:59:55.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.981+0000 7f9d77cd4740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b85cd0 con 0x1917d20 2023-11-28T11:59:55.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.981+0000 7f9d77cd4740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b86980 con 0x19629d0 2023-11-28T11:59:55.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.981+0000 7f9d77cd4740 10 client.0 _ll_register_callbacks cb 0x1ae9a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:59:55.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.981+0000 7f9d6e59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1917950 0x1bd2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.981+0000 7f9d6e59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1917950 0x1bd2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38782/0 (socket says 172.21.15.39:38782) 2023-11-28T11:59:55.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.981+0000 7f9d6e59c700 1 -- 172.21.15.39:0/3676091018 learned_addr learned my addr 172.21.15.39:0/3676091018 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:55.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.981+0000 7f9d6ed9d700 1 --2- 172.21.15.39:0/3676091018 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x19629d0 0x1bcf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.981+0000 7f9d6dd9b700 1 --2- 172.21.15.39:0/3676091018 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1917d20 0x1bcf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.981+0000 7f9d6e59c700 1 -- 172.21.15.39:0/3676091018 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x19629d0 msgr2=0x1bcf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:55.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.981+0000 7f9d6e59c700 1 --2- 172.21.15.39:0/3676091018 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x19629d0 0x1bcf940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.981+0000 7f9d6e59c700 1 -- 172.21.15.39:0/3676091018 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1917d20 msgr2=0x1bcf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:55.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.981+0000 7f9d6e59c700 1 --2- 172.21.15.39:0/3676091018 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1917d20 0x1bcf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.981+0000 7f9d6e59c700 1 -- 172.21.15.39:0/3676091018 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d6800f040 con 0x1917950 2023-11-28T11:59:55.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.981+0000 7f9d6dd9b700 1 --2- 172.21.15.39:0/3676091018 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1917d20 0x1bcf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:55.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.981+0000 7f9d6e59c700 1 --2- 172.21.15.39:0/3676091018 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1917950 0x1bd2de0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f9d60009320 tx=0x7f9d60054df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3da3a72890031dc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:55.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.981+0000 7f9d4d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-11-28T11:59:55.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.985+0000 7f9d4d7fa700 1 -- 172.21.15.39:0/3676091018 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d60024eb0 con 0x1917950 2023-11-28T11:59:55.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.985+0000 7f9d4d7fa700 1 -- 172.21.15.39:0/3676091018 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f9d6006c030 con 0x1917950 2023-11-28T11:59:55.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.985+0000 7f9d77cd4740 1 -- 172.21.15.39:0/3676091018 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1ae91a0 con 0x1917950 2023-11-28T11:59:55.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.985+0000 7f9d4d7fa700 1 -- 172.21.15.39:0/3676091018 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d60054890 con 0x1917950 2023-11-28T11:59:55.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.985+0000 7f9d77cd4740 10 client.6483 fetch_fsmap learned FSMap version 32 2023-11-28T11:59:55.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.985+0000 7f9d77cd4740 1 -- 172.21.15.39:0/3676091018 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x1963c20 con 0x1917950 2023-11-28T11:59:55.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.985+0000 7f9d4d7fa700 1 -- 172.21.15.39:0/3676091018 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1ae91a0 con 0x1917950 2023-11-28T11:59:55.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.985+0000 7f9d4d7fa700 1 -- 172.21.15.39:0/3676091018 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f9d6005cfa0 con 0x1917950 2023-11-28T11:59:55.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.985+0000 7f9d77cd4740 10 client.6483 fetch_fsmap finished waiting for FSMap version 32 2023-11-28T11:59:55.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.985+0000 7f9d77cd4740 10 client.6483 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-28T11:59:55.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.985+0000 7f9d77cd4740 20 client.6483 populate_metadata read hostname 'smithi039' 2023-11-28T11:59:55.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.985+0000 7f9d77cd4740 1 --2- 172.21.15.39:0/3676091018 >> [v2:172.21.15.39:6832/990492858,v1:172.21.15.39:6835/990492858] conn(0x1b87600 0x1b885b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:55.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.985+0000 7f9d77cd4740 4 client.6483 mds_command: new command op to 6244 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T11:59:55.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.985+0000 7f9d77cd4740 1 -- 172.21.15.39:0/3676091018 --> [v2:172.21.15.39:6832/990492858,v1:172.21.15.39:6835/990492858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1ae8ec0 con 0x1b87600 2023-11-28T11:59:55.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.985+0000 7f9d6dd9b700 1 --2- 172.21.15.39:0/3676091018 >> [v2:172.21.15.39:6832/990492858,v1:172.21.15.39:6835/990492858] conn(0x1b87600 0x1b885b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:55.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.985+0000 7f9d4d7fa700 10 client.6483 ms_handle_connect on v2:172.21.15.39:6832/990492858 2023-11-28T11:59:55.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.985+0000 7f9d6dd9b700 1 --2- 172.21.15.39:0/3676091018 >> [v2:172.21.15.39:6832/990492858,v1:172.21.15.39:6835/990492858] conn(0x1b87600 0x1b885b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=124d607362b95050 server_cookie=825b6678f3dd9996 in_seq=0 out_seq=0 2023-11-28T11:59:55.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.985+0000 7f9d4d7fa700 1 -- 172.21.15.39:0/3676091018 <== mds.0 v2:172.21.15.39:6832/990492858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x1ae8ec0 con 0x1b87600 2023-11-28T11:59:55.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.985+0000 7f9d4d7fa700 10 client.6483 handle_command_reply: tid=0 2023-11-28T11:59:55.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.985+0000 7f9d77cd4740 1 client.6483 shutdown 2023-11-28T11:59:55.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.989+0000 7f9d77cd4740 1 -- 172.21.15.39:0/3676091018 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1917950 msgr2=0x1bd2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:55.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.989+0000 7f9d77cd4740 1 --2- 172.21.15.39:0/3676091018 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1917950 0x1bd2de0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f9d60009320 tx=0x7f9d60054df0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.989+0000 7f9d77cd4740 1 -- 172.21.15.39:0/3676091018 shutdown_connections 2023-11-28T11:59:55.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.989+0000 7f9d77cd4740 1 --2- 172.21.15.39:0/3676091018 >> [v2:172.21.15.39:6832/990492858,v1:172.21.15.39:6835/990492858] conn(0x1b87600 0x1b885b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.989+0000 7f9d77cd4740 1 --2- 172.21.15.39:0/3676091018 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x19629d0 0x1bcf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.989+0000 7f9d77cd4740 1 --2- 172.21.15.39:0/3676091018 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1917d20 0x1bcf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.989+0000 7f9d77cd4740 1 --2- 172.21.15.39:0/3676091018 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1917950 0x1bd2de0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:55.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.989+0000 7f9d4d7fa700 0 client.6483 ms_handle_reset on v2:172.21.15.39:6832/990492858 2023-11-28T11:59:55.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.989+0000 7f9d77cd4740 1 -- 172.21.15.39:0/3676091018 >> 172.21.15.39:0/3676091018 conn(0x19180f0 msgr2=0x1b8a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:55.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.989+0000 7f9d77cd4740 1 -- 172.21.15.39:0/3676091018 shutdown_connections 2023-11-28T11:59:56.000 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.989+0000 7f9d77cd4740 1 -- 172.21.15.39:0/3676091018 wait complete. 2023-11-28T11:59:56.000 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:55.989+0000 7f9d77cd4740 20 client.6483 trim_cache size 0 max 16384 2023-11-28T11:59:56.008 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.001+0000 7f9d77cd4740 1 Processor -- start 2023-11-28T11:59:56.009 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.001+0000 7f9d77cd4740 1 -- start start 2023-11-28T11:59:56.009 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.005+0000 7f9d77cd4740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1917950 0x1b849f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:56.009 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.005+0000 7f9d77cd4740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1917d20 0x1b84f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:56.009 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.005+0000 7f9d77cd4740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x19629d0 0x1b85470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:56.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.005+0000 7f9d77cd4740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a8e8e0 con 0x1917d20 2023-11-28T11:59:56.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.005+0000 7f9d77cd4740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x1aed520 con 0x1917950 2023-11-28T11:59:56.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.005+0000 7f9d77cd4740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x1aeba90 con 0x19629d0 2023-11-28T11:59:56.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.005+0000 7f9d6dd9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1917d20 0x1b84f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:56.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.005+0000 7f9d6dd9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1917d20 0x1b84f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38786/0 (socket says 172.21.15.39:38786) 2023-11-28T11:59:56.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.005+0000 7f9d6dd9b700 1 -- 172.21.15.39:0/872261000 learned_addr learned my addr 172.21.15.39:0/872261000 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:56.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.005+0000 7f9d6e59c700 1 --2- 172.21.15.39:0/872261000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1917950 0x1b849f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:56.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.005+0000 7f9d6ed9d700 1 --2- 172.21.15.39:0/872261000 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x19629d0 0x1b85470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:56.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.005+0000 7f9d6dd9b700 1 -- 172.21.15.39:0/872261000 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x19629d0 msgr2=0x1b85470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:56.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.005+0000 7f9d6dd9b700 1 --2- 172.21.15.39:0/872261000 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x19629d0 0x1b85470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:56.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.005+0000 7f9d6dd9b700 1 -- 172.21.15.39:0/872261000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1917950 msgr2=0x1b849f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:56.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.005+0000 7f9d6dd9b700 1 --2- 172.21.15.39:0/872261000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1917950 0x1b849f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:56.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.005+0000 7f9d6dd9b700 1 -- 172.21.15.39:0/872261000 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1ab6a10 con 0x1917d20 2023-11-28T11:59:56.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.005+0000 7f9d6dd9b700 1 --2- 172.21.15.39:0/872261000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1917d20 0x1b84f30 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x1bcff70 tx=0x7f9d64018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7500a9b52942135 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:56.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.005+0000 7f9d5cff9700 1 -- 172.21.15.39:0/872261000 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d64029070 con 0x1917d20 2023-11-28T11:59:56.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.005+0000 7f9d5cff9700 1 -- 172.21.15.39:0/872261000 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6402a250 con 0x1917d20 2023-11-28T11:59:56.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.005+0000 7f9d5cff9700 1 -- 172.21.15.39:0/872261000 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6401c040 con 0x1917d20 2023-11-28T11:59:56.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.005+0000 7f9d77cd4740 1 -- 172.21.15.39:0/872261000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1917d20 msgr2=0x1b84f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:56.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.005+0000 7f9d77cd4740 1 --2- 172.21.15.39:0/872261000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1917d20 0x1b84f30 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x1bcff70 tx=0x7f9d64018000 comp rx=0 tx=0).stop 2023-11-28T11:59:56.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.005+0000 7f9d77cd4740 1 -- 172.21.15.39:0/872261000 shutdown_connections 2023-11-28T11:59:56.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.005+0000 7f9d77cd4740 1 --2- 172.21.15.39:0/872261000 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x19629d0 0x1b85470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:56.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.005+0000 7f9d77cd4740 1 --2- 172.21.15.39:0/872261000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x1917d20 0x1b84f30 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:56.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.005+0000 7f9d77cd4740 1 --2- 172.21.15.39:0/872261000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1917950 0x1b849f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:56.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.005+0000 7f9d77cd4740 1 -- 172.21.15.39:0/872261000 >> 172.21.15.39:0/872261000 conn(0x19180f0 msgr2=0x1bafd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:56.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.009+0000 7f9d77cd4740 1 -- 172.21.15.39:0/872261000 shutdown_connections 2023-11-28T11:59:56.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.009+0000 7f9d77cd4740 1 -- 172.21.15.39:0/872261000 wait complete. 2023-11-28T11:59:56.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.009+0000 7f9d77cd4740 1 -- start start 2023-11-28T11:59:56.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.009+0000 7f9d77cd4740 1 Processor -- start 2023-11-28T11:59:56.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.009+0000 7f9d77cd4740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1917950 0x1bea140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:56.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.009+0000 7f9d77cd4740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1917d20 0x1bea680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:56.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.009+0000 7f9d77cd4740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x19629d0 0x1beabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:56.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.009+0000 7f9d77cd4740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a8f6b0 con 0x19629d0 2023-11-28T11:59:56.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.009+0000 7f9d77cd4740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x1aeea70 con 0x1917950 2023-11-28T11:59:56.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.009+0000 7f9d77cd4740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ab3e40 con 0x1917d20 2023-11-28T11:59:56.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.009+0000 7f9d77cd4740 10 client.0 _ll_register_callbacks cb 0x7f9d68001ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:59:56.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.009+0000 7f9d6ed9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x19629d0 0x1beabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:56.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.009+0000 7f9d6ed9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x19629d0 0x1beabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38800/0 (socket says 172.21.15.39:38800) 2023-11-28T11:59:56.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.009+0000 7f9d6ed9d700 1 -- 172.21.15.39:0/2930643811 learned_addr learned my addr 172.21.15.39:0/2930643811 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:56.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.009+0000 7f9d6dd9b700 1 --2- 172.21.15.39:0/2930643811 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1917d20 0x1bea680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:56.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.009+0000 7f9d6e59c700 1 --2- 172.21.15.39:0/2930643811 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1917950 0x1bea140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:56.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.013+0000 7f9d6dd9b700 1 -- 172.21.15.39:0/2930643811 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1917950 msgr2=0x1bea140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:56.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.013+0000 7f9d6dd9b700 1 --2- 172.21.15.39:0/2930643811 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1917950 0x1bea140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:56.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.013+0000 7f9d6dd9b700 1 -- 172.21.15.39:0/2930643811 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x19629d0 msgr2=0x1beabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:56.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.013+0000 7f9d6dd9b700 1 --2- 172.21.15.39:0/2930643811 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x19629d0 0x1beabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:56.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.013+0000 7f9d6dd9b700 1 -- 172.21.15.39:0/2930643811 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d64004250 con 0x1917d20 2023-11-28T11:59:56.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.013+0000 7f9d6ed9d700 1 --2- 172.21.15.39:0/2930643811 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x19629d0 0x1beabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:56.018 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.013+0000 7f9d6dd9b700 1 --2- 172.21.15.39:0/2930643811 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1917d20 0x1bea680 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x1bcff40 tx=0x7f9d640047e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ffddfd2a8ed150e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:56.018 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.013+0000 7f9d4d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.184:3301/0 2023-11-28T11:59:56.018 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.013+0000 7f9d4d7fa700 1 -- 172.21.15.39:0/2930643811 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d64003ad0 con 0x1917d20 2023-11-28T11:59:56.018 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.013+0000 7f9d4d7fa700 1 -- 172.21.15.39:0/2930643811 <== mon.2 v2:172.21.15.184:3301/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f9d64003c30 con 0x1917d20 2023-11-28T11:59:56.018 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.013+0000 7f9d77cd4740 1 -- 172.21.15.39:0/2930643811 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9d68014480 con 0x1917d20 2023-11-28T11:59:56.018 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.013+0000 7f9d4d7fa700 1 -- 172.21.15.39:0/2930643811 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d6402a0d0 con 0x1917d20 2023-11-28T11:59:56.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.013+0000 7f9d77cd4740 10 client.5831 fetch_fsmap learned FSMap version 32 2023-11-28T11:59:56.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.013+0000 7f9d77cd4740 1 -- 172.21.15.39:0/2930643811 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x1a9c4f0 con 0x1917d20 2023-11-28T11:59:56.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.013+0000 7f9d4d7fa700 1 -- 172.21.15.39:0/2930643811 <== mon.2 v2:172.21.15.184:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d68014480 con 0x1917d20 2023-11-28T11:59:56.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.013+0000 7f9d4d7fa700 1 -- 172.21.15.39:0/2930643811 <== mon.2 v2:172.21.15.184:3301/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f9d6402a660 con 0x1917d20 2023-11-28T11:59:56.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.013+0000 7f9d77cd4740 10 client.5831 fetch_fsmap finished waiting for FSMap version 32 2023-11-28T11:59:56.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.013+0000 7f9d77cd4740 10 client.5831 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-28T11:59:56.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.013+0000 7f9d77cd4740 20 client.5831 populate_metadata read hostname 'smithi039' 2023-11-28T11:59:56.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.013+0000 7f9d77cd4740 1 --2- 172.21.15.39:0/2930643811 >> [v2:172.21.15.39:6832/990492858,v1:172.21.15.39:6835/990492858] conn(0x1bed2e0 0x1bed6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:56.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.013+0000 7f9d77cd4740 4 client.5831 mds_command: new command op to 6244 tid=0[{"prefix": "damage ls", "format": "json-pretty"}] 2023-11-28T11:59:56.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.013+0000 7f9d77cd4740 1 -- 172.21.15.39:0/2930643811 --> [v2:172.21.15.39:6832/990492858,v1:172.21.15.39:6835/990492858] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x19944a0 con 0x1bed2e0 2023-11-28T11:59:56.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.013+0000 7f9d6e59c700 1 --2- 172.21.15.39:0/2930643811 >> [v2:172.21.15.39:6832/990492858,v1:172.21.15.39:6835/990492858] conn(0x1bed2e0 0x1bed6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:56.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.017+0000 7f9d6e59c700 1 --2- 172.21.15.39:0/2930643811 >> [v2:172.21.15.39:6832/990492858,v1:172.21.15.39:6835/990492858] conn(0x1bed2e0 0x1bed6b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a8aa851a03a501 server_cookie=cd78caa7b4a1ae2b in_seq=0 out_seq=0 2023-11-28T11:59:56.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.017+0000 7f9d4d7fa700 10 client.5831 ms_handle_connect on v2:172.21.15.39:6832/990492858 2023-11-28T11:59:56.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.017+0000 7f9d4d7fa700 1 -- 172.21.15.39:0/2930643811 <== mds.0 v2:172.21.15.39:6832/990492858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+140 (crc 0 0 0) 0x19944a0 con 0x1bed2e0 2023-11-28T11:59:56.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.017+0000 7f9d4d7fa700 10 client.5831 handle_command_reply: tid=0 2023-11-28T11:59:56.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.017+0000 7f9d77cd4740 1 client.5831 shutdown 2023-11-28T11:59:56.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.017+0000 7f9d77cd4740 1 -- 172.21.15.39:0/2930643811 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1917d20 msgr2=0x1bea680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:56.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.017+0000 7f9d77cd4740 1 --2- 172.21.15.39:0/2930643811 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1917d20 0x1bea680 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x1bcff40 tx=0x7f9d640047e0 comp rx=0 tx=0).stop 2023-11-28T11:59:56.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.017+0000 7f9d77cd4740 1 -- 172.21.15.39:0/2930643811 shutdown_connections 2023-11-28T11:59:56.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.017+0000 7f9d77cd4740 1 --2- 172.21.15.39:0/2930643811 >> [v2:172.21.15.39:6832/990492858,v1:172.21.15.39:6835/990492858] conn(0x1bed2e0 0x1bed6b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:56.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.017+0000 7f9d77cd4740 1 --2- 172.21.15.39:0/2930643811 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x19629d0 0x1beabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:56.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.017+0000 7f9d77cd4740 1 --2- 172.21.15.39:0/2930643811 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1917d20 0x1bea680 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:56.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.017+0000 7f9d77cd4740 1 --2- 172.21.15.39:0/2930643811 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1917950 0x1bea140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:56.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.017+0000 7f9d77cd4740 1 -- 172.21.15.39:0/2930643811 >> 172.21.15.39:0/2930643811 conn(0x19180f0 msgr2=0x1b84270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:56.023 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.017+0000 7f9d4d7fa700 0 client.5831 ms_handle_reset on v2:172.21.15.39:6832/990492858 2023-11-28T11:59:56.023 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.017+0000 7f9d77cd4740 1 -- 172.21.15.39:0/2930643811 shutdown_connections 2023-11-28T11:59:56.023 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.017+0000 7f9d77cd4740 1 -- 172.21.15.39:0/2930643811 wait complete. 2023-11-28T11:59:56.023 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.017+0000 7f9d77cd4740 20 client.5831 trim_cache size 0 max 16384 2023-11-28T11:59:56.023 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:59:56.023 INFO:teuthology.orchestra.run.smithi039.stdout:[ 2023-11-28T11:59:56.023 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-11-28T11:59:56.023 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2023-11-28T11:59:56.024 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 906621303, 2023-11-28T11:59:56.024 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511627777, 2023-11-28T11:59:56.024 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/dir_test/file" 2023-11-28T11:59:56.024 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-11-28T11:59:56.024 INFO:teuthology.orchestra.run.smithi039.stdout:] 2023-11-28T11:59:56.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.017+0000 7f9d6f59e700 1 -- 172.21.15.39:0/3445997122 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9d50064f30 msgr2=0x7f9d500673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:56.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.017+0000 7f9d6f59e700 1 --2- 172.21.15.39:0/3445997122 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9d50064f30 0x7f9d500673e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9d7006f370 tx=0x7f9d64009240 comp rx=0 tx=0).stop 2023-11-28T11:59:56.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.017+0000 7f9d6f59e700 1 -- 172.21.15.39:0/3445997122 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d700b1b30 msgr2=0x7f9d7015bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:56.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.017+0000 7f9d6f59e700 1 --2- 172.21.15.39:0/3445997122 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d700b1b30 0x7f9d7015bb00 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f9d60000c00 tx=0x7f9d60004770 comp rx=0 tx=0).stop 2023-11-28T11:59:56.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.017+0000 7f9d6f59e700 1 -- 172.21.15.39:0/3445997122 shutdown_connections 2023-11-28T11:59:56.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.017+0000 7f9d6f59e700 1 --2- 172.21.15.39:0/3445997122 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d700cd950 0x7f9d700ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:56.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.017+0000 7f9d6f59e700 1 --2- 172.21.15.39:0/3445997122 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9d50064f30 0x7f9d500673e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:56.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.017+0000 7f9d6f59e700 1 --2- 172.21.15.39:0/3445997122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d700b3b30 0x7f9d7015c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:56.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.017+0000 7f9d6f59e700 1 --2- 172.21.15.39:0/3445997122 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d700b1b30 0x7f9d7015bb00 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:56.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.017+0000 7f9d6f59e700 1 -- 172.21.15.39:0/3445997122 >> 172.21.15.39:0/3445997122 conn(0x7f9d70099af0 msgr2=0x7f9d7006ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:56.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.017+0000 7f9d6f59e700 1 -- 172.21.15.39:0/3445997122 shutdown_connections 2023-11-28T11:59:56.026 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.017+0000 7f9d6f59e700 1 -- 172.21.15.39:0/3445997122 wait complete. 2023-11-28T11:59:56.047 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T11:59:56.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.217+0000 7f00baf3e700 1 Processor -- start 2023-11-28T11:59:56.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.221+0000 7f00baf3e700 1 -- start start 2023-11-28T11:59:56.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.221+0000 7f00baf3e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f00b40c1d50 0x7f00b40b36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:56.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.221+0000 7f00baf3e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00b406b240 0x7f00b40cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:56.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.221+0000 7f00baf3e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b4069bf0 con 0x7f00b40ca8e0 2023-11-28T11:59:56.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.221+0000 7f00baf3e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00b40b3c00 con 0x7f00b40c1d50 2023-11-28T11:59:56.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.221+0000 7f00baf3e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b4069e40 con 0x7f00b406b240 2023-11-28T11:59:56.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.225+0000 7f00b9f3c700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f00b40ca8e0 0x7f00b40c1640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:47952/0 (socket says 172.21.15.39:47952) 2023-11-28T11:59:56.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.225+0000 7f00b9f3c700 1 -- 172.21.15.39:0/4186352679 learned_addr learned my addr 172.21.15.39:0/4186352679 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:59:56.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.225+0000 7f00b973b700 1 --2- 172.21.15.39:0/4186352679 >> v2:172.21.15.184:3300/0 conn(0x7f00b40c1d50 0x7f00b40b36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:56.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.225+0000 7f00ba73d700 1 --2- 172.21.15.39:0/4186352679 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00b406b240 0x7f00b40cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:56.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.225+0000 7f00b8f3a700 1 -- 172.21.15.39:0/4186352679 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1961496987 0 0) 0x7f00b4069bf0 con 0x7f00b40ca8e0 2023-11-28T11:59:56.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.225+0000 7f00b8f3a700 1 -- 172.21.15.39:0/4186352679 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00a00035d0 con 0x7f00b40ca8e0 2023-11-28T11:59:56.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.225+0000 7f00b973b700 1 -- 172.21.15.39:0/4186352679 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00b406b240 msgr2=0x7f00b40cb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:56.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.225+0000 7f00b973b700 1 --2- 172.21.15.39:0/4186352679 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00b406b240 0x7f00b40cb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:56.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.225+0000 7f00b973b700 1 -- 172.21.15.39:0/4186352679 >> v1:172.21.15.184:6789/0 conn(0x7f00b40ca8e0 legacy=0x7f00b40c1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:56.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.225+0000 7f00b973b700 1 -- 172.21.15.39:0/4186352679 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b406a120 con 0x7f00b40c1d50 2023-11-28T11:59:56.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.225+0000 7f00b973b700 1 --2- 172.21.15.39:0/4186352679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00b40c1d50 0x7f00b40b36c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f00a4009850 tx=0x7f00a4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51e1f5c54c16762e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:56.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.225+0000 7f00b8f3a700 1 -- 172.21.15.39:0/4186352679 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a4011830 con 0x7f00b40c1d50 2023-11-28T11:59:56.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.225+0000 7f00b8f3a700 1 -- 172.21.15.39:0/4186352679 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a4011990 con 0x7f00b40c1d50 2023-11-28T11:59:56.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.225+0000 7f00b8f3a700 1 -- 172.21.15.39:0/4186352679 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a4011d40 con 0x7f00b40c1d50 2023-11-28T11:59:56.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.225+0000 7f00baf3e700 1 -- 172.21.15.39:0/4186352679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00b40c1d50 msgr2=0x7f00b40b36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:56.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.225+0000 7f00baf3e700 1 --2- 172.21.15.39:0/4186352679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00b40c1d50 0x7f00b40b36c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f00a4009850 tx=0x7f00a4009b60 comp rx=0 tx=0).stop 2023-11-28T11:59:56.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.225+0000 7f00baf3e700 1 -- 172.21.15.39:0/4186352679 shutdown_connections 2023-11-28T11:59:56.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.225+0000 7f00baf3e700 1 --2- 172.21.15.39:0/4186352679 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00b406b240 0x7f00b40cb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:56.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.225+0000 7f00baf3e700 1 --2- 172.21.15.39:0/4186352679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00b40c1d50 0x7f00b40b36c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:56.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.225+0000 7f00baf3e700 1 -- 172.21.15.39:0/4186352679 >> 172.21.15.39:0/4186352679 conn(0x7f00b40ce670 msgr2=0x7f00b40cea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:56.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.229+0000 7f00baf3e700 1 -- 172.21.15.39:0/4186352679 shutdown_connections 2023-11-28T11:59:56.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.229+0000 7f00baf3e700 1 -- 172.21.15.39:0/4186352679 wait complete. 2023-11-28T11:59:56.236 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.229+0000 7f00baf3e700 1 Processor -- start 2023-11-28T11:59:56.236 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.233+0000 7f00baf3e700 1 -- start start 2023-11-28T11:59:56.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.233+0000 7f00baf3e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00b406b240 0x7f00b4097930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:56.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.233+0000 7f00baf3e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00b40c1d50 0x7f00b40b0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:56.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.233+0000 7f00baf3e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00b40ca8e0 0x7f00b40c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:56.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.233+0000 7f00baf3e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b41f68c0 con 0x7f00b406b240 2023-11-28T11:59:56.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.233+0000 7f00baf3e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b40af7d0 con 0x7f00b40c1d50 2023-11-28T11:59:56.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.233+0000 7f00baf3e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b40afa70 con 0x7f00b40ca8e0 2023-11-28T11:59:56.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.233+0000 7f00b9f3c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00b406b240 0x7f00b4097930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:56.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.233+0000 7f00b9f3c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00b406b240 0x7f00b4097930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38812/0 (socket says 172.21.15.39:38812) 2023-11-28T11:59:56.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.233+0000 7f00b9f3c700 1 -- 172.21.15.39:0/2924283782 learned_addr learned my addr 172.21.15.39:0/2924283782 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:56.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.233+0000 7f00ba73d700 1 --2- 172.21.15.39:0/2924283782 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00b40ca8e0 0x7f00b40c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:56.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.233+0000 7f00b973b700 1 --2- 172.21.15.39:0/2924283782 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00b40c1d50 0x7f00b40b0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:56.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.233+0000 7f00b9f3c700 1 -- 172.21.15.39:0/2924283782 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00b40ca8e0 msgr2=0x7f00b40c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:56.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.233+0000 7f00b9f3c700 1 --2- 172.21.15.39:0/2924283782 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00b40ca8e0 0x7f00b40c6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:56.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.233+0000 7f00b9f3c700 1 -- 172.21.15.39:0/2924283782 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00b40c1d50 msgr2=0x7f00b40b0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:56.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.233+0000 7f00b9f3c700 1 --2- 172.21.15.39:0/2924283782 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00b40c1d50 0x7f00b40b0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:56.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.233+0000 7f00b9f3c700 1 -- 172.21.15.39:0/2924283782 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a40094b0 con 0x7f00b406b240 2023-11-28T11:59:56.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.233+0000 7f00ba73d700 1 --2- 172.21.15.39:0/2924283782 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00b40ca8e0 0x7f00b40c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:56.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.233+0000 7f00b9f3c700 1 --2- 172.21.15.39:0/2924283782 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00b406b240 0x7f00b4097930 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f00b000c4d0 tx=0x7f00b000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:56.241 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.233+0000 7f00aa7fc700 1 -- 172.21.15.39:0/2924283782 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b0005d90 con 0x7f00b406b240 2023-11-28T11:59:56.241 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.233+0000 7f00aa7fc700 1 -- 172.21.15.39:0/2924283782 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b00070d0 con 0x7f00b406b240 2023-11-28T11:59:56.241 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.233+0000 7f00aa7fc700 1 -- 172.21.15.39:0/2924283782 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b0007480 con 0x7f00b406b240 2023-11-28T11:59:56.241 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.233+0000 7f00baf3e700 1 -- 172.21.15.39:0/2924283782 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b406a6e0 con 0x7f00b406b240 2023-11-28T11:59:56.241 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.233+0000 7f00baf3e700 1 -- 172.21.15.39:0/2924283782 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b406a400 con 0x7f00b406b240 2023-11-28T11:59:56.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.237+0000 7f00baf3e700 1 -- 172.21.15.39:0/2924283782 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00b406a9c0 con 0x7f00b406b240 2023-11-28T11:59:56.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.237+0000 7f00aa7fc700 1 -- 172.21.15.39:0/2924283782 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f00b0019030 con 0x7f00b406b240 2023-11-28T11:59:56.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.241+0000 7f00aa7fc700 1 --2- 172.21.15.39:0/2924283782 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0098064ee0 0x7f0098067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:56.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.241+0000 7f00aa7fc700 1 -- 172.21.15.39:0/2924283782 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f00b00812e0 con 0x7f00b406b240 2023-11-28T11:59:56.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.241+0000 7f00b973b700 1 --2- 172.21.15.39:0/2924283782 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0098064ee0 0x7f0098067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:56.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.241+0000 7f00b973b700 1 --2- 172.21.15.39:0/2924283782 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0098064ee0 0x7f0098067390 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f00b40c2140 tx=0x7f00a4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:56.251 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.245+0000 7f00aa7fc700 1 -- 172.21.15.39:0/2924283782 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f00b004f340 con 0x7f00b406b240 2023-11-28T11:59:56.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.457+0000 7f00baf3e700 1 -- 172.21.15.39:0/2924283782 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f00b4073cb0 con 0x7f00b406b240 2023-11-28T11:59:56.464 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.457+0000 7f00aa7fc700 1 -- 172.21.15.39:0/2924283782 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f00b0052960 con 0x7f00b406b240 2023-11-28T11:59:56.464 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:59:56.464 INFO:teuthology.orchestra.run.smithi039.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-28T11:59:56.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.461+0000 7f00baf3e700 1 -- 172.21.15.39:0/2924283782 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0098064ee0 msgr2=0x7f0098067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:56.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.461+0000 7f00baf3e700 1 --2- 172.21.15.39:0/2924283782 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0098064ee0 0x7f0098067390 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f00b40c2140 tx=0x7f00a4008030 comp rx=0 tx=0).stop 2023-11-28T11:59:56.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.461+0000 7f00baf3e700 1 -- 172.21.15.39:0/2924283782 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00b406b240 msgr2=0x7f00b4097930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:56.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.461+0000 7f00baf3e700 1 --2- 172.21.15.39:0/2924283782 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00b406b240 0x7f00b4097930 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f00b000c4d0 tx=0x7f00b000c7e0 comp rx=0 tx=0).stop 2023-11-28T11:59:56.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.461+0000 7f00baf3e700 1 -- 172.21.15.39:0/2924283782 shutdown_connections 2023-11-28T11:59:56.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.461+0000 7f00baf3e700 1 --2- 172.21.15.39:0/2924283782 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00b40ca8e0 0x7f00b40c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:56.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.461+0000 7f00baf3e700 1 --2- 172.21.15.39:0/2924283782 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0098064ee0 0x7f0098067390 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:56.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.461+0000 7f00baf3e700 1 --2- 172.21.15.39:0/2924283782 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00b40c1d50 0x7f00b40b0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:56.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.461+0000 7f00baf3e700 1 --2- 172.21.15.39:0/2924283782 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00b406b240 0x7f00b4097930 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:56.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.461+0000 7f00baf3e700 1 -- 172.21.15.39:0/2924283782 >> 172.21.15.39:0/2924283782 conn(0x7f00b40ce670 msgr2=0x7f00b40cea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:56.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.461+0000 7f00baf3e700 1 -- 172.21.15.39:0/2924283782 shutdown_connections 2023-11-28T11:59:56.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.461+0000 7f00baf3e700 1 -- 172.21.15.39:0/2924283782 wait complete. 2023-11-28T11:59:56.489 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T11:59:56.489 DEBUG:teuthology.orchestra.run.smithi039:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T11:59:56.533 DEBUG:teuthology.orchestra.run.smithi184:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T11:59:56.579 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T11:59:56.579 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:59:56.579 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:59:56.599 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:59:56.599 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:59:56.665 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:59:56.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.885+0000 7f1a4932d700 1 Processor -- start 2023-11-28T11:59:56.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.885+0000 7f1a4932d700 1 -- start start 2023-11-28T11:59:56.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.889+0000 7f1a4932d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1a4415c640 0x7f1a440d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:56.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.889+0000 7f1a4932d700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1a44071aa0 0x7f1a4406d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:56.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.889+0000 7f1a4932d700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a4406c600 con 0x7f1a44069e00 2023-11-28T11:59:56.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.889+0000 7f1a4932d700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a4406cef0 con 0x7f1a44071aa0 2023-11-28T11:59:56.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.889+0000 7f1a4932d700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a440722f0 con 0x7f1a4415c640 2023-11-28T11:59:56.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.889+0000 7f1a427fc700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1a44071aa0 0x7f1a4406d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:56.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.889+0000 7f1a427fc700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1a44071aa0 0x7f1a4406d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38826/0 (socket says 172.21.15.39:38826) 2023-11-28T11:59:56.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.889+0000 7f1a437fe700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f1a44069e00 0x7f1a440d0580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42340/0 (socket says 172.21.15.39:42340) 2023-11-28T11:59:56.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.889+0000 7f1a427fc700 1 -- 172.21.15.39:0/2788461608 learned_addr learned my addr 172.21.15.39:0/2788461608 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:56.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.889+0000 7f1a42ffd700 1 --2- 172.21.15.39:0/2788461608 >> v2:172.21.15.184:3300/0 conn(0x7f1a4415c640 0x7f1a440d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:56.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.893+0000 7f1a427fc700 1 -- 172.21.15.39:0/2788461608 >> v2:172.21.15.184:3300/0 conn(0x7f1a4415c640 msgr2=0x7f1a440d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:56.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.893+0000 7f1a427fc700 1 --2- 172.21.15.39:0/2788461608 >> v2:172.21.15.184:3300/0 conn(0x7f1a4415c640 0x7f1a440d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:56.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.893+0000 7f1a427fc700 1 -- 172.21.15.39:0/2788461608 >> v1:172.21.15.39:6789/0 conn(0x7f1a44069e00 legacy=0x7f1a440d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:56.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.893+0000 7f1a427fc700 1 -- 172.21.15.39:0/2788461608 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4415ca10 con 0x7f1a44071aa0 2023-11-28T11:59:56.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.893+0000 7f1a42ffd700 1 --2- 172.21.15.39:0/2788461608 >> v2:172.21.15.184:3300/0 conn(0x7f1a4415c640 0x7f1a440d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:56.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.893+0000 7f1a41ffb700 1 -- 172.21.15.39:0/2788461608 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1161279172 0 0) 0x7f1a4406c600 con 0x7f1a44069e00 2023-11-28T11:59:56.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.893+0000 7f1a427fc700 1 --2- 172.21.15.39:0/2788461608 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a44071aa0 0x7f1a4406d310 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f1a4406e290 tx=0x7f1a38009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a2f6d6656b2763c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:56.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.893+0000 7f1a41ffb700 1 -- 172.21.15.39:0/2788461608 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3800b8a0 con 0x7f1a44071aa0 2023-11-28T11:59:56.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.893+0000 7f1a41ffb700 1 -- 172.21.15.39:0/2788461608 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3800ba00 con 0x7f1a44071aa0 2023-11-28T11:59:56.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.893+0000 7f1a41ffb700 1 -- 172.21.15.39:0/2788461608 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3800bd90 con 0x7f1a44071aa0 2023-11-28T11:59:56.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.893+0000 7f1a4932d700 1 -- 172.21.15.39:0/2788461608 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a44071aa0 msgr2=0x7f1a4406d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:56.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.893+0000 7f1a4932d700 1 --2- 172.21.15.39:0/2788461608 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a44071aa0 0x7f1a4406d310 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f1a4406e290 tx=0x7f1a38009bf0 comp rx=0 tx=0).stop 2023-11-28T11:59:56.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.893+0000 7f1a4932d700 1 -- 172.21.15.39:0/2788461608 shutdown_connections 2023-11-28T11:59:56.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.893+0000 7f1a4932d700 1 --2- 172.21.15.39:0/2788461608 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a44071aa0 0x7f1a4406d310 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:56.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.893+0000 7f1a4932d700 1 --2- 172.21.15.39:0/2788461608 >> v2:172.21.15.184:3300/0 conn(0x7f1a4415c640 0x7f1a440d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:56.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.893+0000 7f1a4932d700 1 -- 172.21.15.39:0/2788461608 >> 172.21.15.39:0/2788461608 conn(0x7f1a440b6520 msgr2=0x7f1a44071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:56.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.893+0000 7f1a4932d700 1 -- 172.21.15.39:0/2788461608 shutdown_connections 2023-11-28T11:59:56.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.893+0000 7f1a4932d700 1 -- 172.21.15.39:0/2788461608 wait complete. 2023-11-28T11:59:56.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.897+0000 7f1a4932d700 1 Processor -- start 2023-11-28T11:59:56.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.897+0000 7f1a4932d700 1 -- start start 2023-11-28T11:59:56.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.897+0000 7f1a4932d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a44069e00 0x7f1a440cb490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:56.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.897+0000 7f1a4932d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a44071aa0 0x7f1a440c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:56.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.897+0000 7f1a4932d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a4415c640 0x7f1a440c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:56.904 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.897+0000 7f1a4932d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a440ca3f0 con 0x7f1a44071aa0 2023-11-28T11:59:56.904 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.897+0000 7f1a4932d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a440ca6d0 con 0x7f1a44069e00 2023-11-28T11:59:56.904 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.897+0000 7f1a4932d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a440ca9b0 con 0x7f1a4415c640 2023-11-28T11:59:56.904 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.897+0000 7f1a427fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a44071aa0 0x7f1a440c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:56.904 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.897+0000 7f1a427fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a44071aa0 0x7f1a440c82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38840/0 (socket says 172.21.15.39:38840) 2023-11-28T11:59:56.904 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.897+0000 7f1a427fc700 1 -- 172.21.15.39:0/349708980 learned_addr learned my addr 172.21.15.39:0/349708980 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:56.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.897+0000 7f1a42ffd700 1 --2- 172.21.15.39:0/349708980 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a44069e00 0x7f1a440cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:56.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.897+0000 7f1a437fe700 1 --2- 172.21.15.39:0/349708980 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a4415c640 0x7f1a440c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:56.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.897+0000 7f1a427fc700 1 -- 172.21.15.39:0/349708980 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a4415c640 msgr2=0x7f1a440c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:56.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.897+0000 7f1a427fc700 1 --2- 172.21.15.39:0/349708980 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a4415c640 0x7f1a440c9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:56.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.897+0000 7f1a427fc700 1 -- 172.21.15.39:0/349708980 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a44069e00 msgr2=0x7f1a440cb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:56.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.897+0000 7f1a427fc700 1 --2- 172.21.15.39:0/349708980 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a44069e00 0x7f1a440cb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:56.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.897+0000 7f1a427fc700 1 -- 172.21.15.39:0/349708980 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a38009570 con 0x7f1a44071aa0 2023-11-28T11:59:56.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.901+0000 7f1a427fc700 1 --2- 172.21.15.39:0/349708980 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a44071aa0 0x7f1a440c82f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f1a4406f090 tx=0x7f1a38004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:56.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.901+0000 7f1a2b7fe700 1 -- 172.21.15.39:0/349708980 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a380036c0 con 0x7f1a44071aa0 2023-11-28T11:59:56.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.901+0000 7f1a2b7fe700 1 -- 172.21.15.39:0/349708980 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3801f070 con 0x7f1a44071aa0 2023-11-28T11:59:56.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.901+0000 7f1a2b7fe700 1 -- 172.21.15.39:0/349708980 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a38003a80 con 0x7f1a44071aa0 2023-11-28T11:59:56.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.901+0000 7f1a4932d700 1 -- 172.21.15.39:0/349708980 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a4406c830 con 0x7f1a44071aa0 2023-11-28T11:59:56.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.901+0000 7f1a4932d700 1 -- 172.21.15.39:0/349708980 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a44072010 con 0x7f1a44071aa0 2023-11-28T11:59:56.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.901+0000 7f1a4932d700 1 -- 172.21.15.39:0/349708980 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a4406cb10 con 0x7f1a44071aa0 2023-11-28T11:59:56.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.905+0000 7f1a2b7fe700 1 -- 172.21.15.39:0/349708980 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1a3802a020 con 0x7f1a44071aa0 2023-11-28T11:59:56.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.905+0000 7f1a2b7fe700 1 --2- 172.21.15.39:0/349708980 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1a30064ee0 0x7f1a30067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:56.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.905+0000 7f1a2b7fe700 1 -- 172.21.15.39:0/349708980 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1a38083920 con 0x7f1a44071aa0 2023-11-28T11:59:56.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.905+0000 7f1a42ffd700 1 --2- 172.21.15.39:0/349708980 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1a30064ee0 0x7f1a30067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:56.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.905+0000 7f1a42ffd700 1 --2- 172.21.15.39:0/349708980 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1a30064ee0 0x7f1a30067390 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1a34009950 tx=0x7f1a34008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:56.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:56.913+0000 7f1a2b7fe700 1 -- 172.21.15.39:0/349708980 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1a38051890 con 0x7f1a44071aa0 2023-11-28T11:59:57.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.085+0000 7f1a4932d700 1 -- 172.21.15.39:0/349708980 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a440b4270 con 0x7f1a44071aa0 2023-11-28T11:59:57.094 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.089+0000 7f1a2b7fe700 1 -- 172.21.15.39:0/349708980 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+18087 (secure 0 0 0) 0x7f1a38054eb0 con 0x7f1a44071aa0 2023-11-28T11:59:57.095 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:59:57.095 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":70,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:59:46.296300+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:59:43.752184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-28T11:59:44.294885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:59:57.097 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.093+0000 7f1a4932d700 1 -- 172.21.15.39:0/349708980 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1a30064ee0 msgr2=0x7f1a30067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:57.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.093+0000 7f1a4932d700 1 --2- 172.21.15.39:0/349708980 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1a30064ee0 0x7f1a30067390 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1a34009950 tx=0x7f1a34008040 comp rx=0 tx=0).stop 2023-11-28T11:59:57.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.093+0000 7f1a4932d700 1 -- 172.21.15.39:0/349708980 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a44071aa0 msgr2=0x7f1a440c82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:57.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.093+0000 7f1a4932d700 1 --2- 172.21.15.39:0/349708980 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a44071aa0 0x7f1a440c82f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f1a4406f090 tx=0x7f1a38004770 comp rx=0 tx=0).stop 2023-11-28T11:59:57.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.093+0000 7f1a4932d700 1 -- 172.21.15.39:0/349708980 shutdown_connections 2023-11-28T11:59:57.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.093+0000 7f1a4932d700 1 --2- 172.21.15.39:0/349708980 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a4415c640 0x7f1a440c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:57.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.093+0000 7f1a4932d700 1 --2- 172.21.15.39:0/349708980 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a44071aa0 0x7f1a440c82f0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:57.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.093+0000 7f1a4932d700 1 --2- 172.21.15.39:0/349708980 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f1a30064ee0 0x7f1a30067390 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:57.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.093+0000 7f1a4932d700 1 --2- 172.21.15.39:0/349708980 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a44069e00 0x7f1a440cb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:57.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.093+0000 7f1a4932d700 1 -- 172.21.15.39:0/349708980 >> 172.21.15.39:0/349708980 conn(0x7f1a440b6520 msgr2=0x7f1a440c90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:57.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.093+0000 7f1a4932d700 1 -- 172.21.15.39:0/349708980 shutdown_connections 2023-11-28T11:59:57.099 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.093+0000 7f1a4932d700 1 -- 172.21.15.39:0/349708980 wait complete. 2023-11-28T11:59:57.119 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:56:26.631457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:56:33.242202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:59:43.752184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:59:44.294885+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:59:57.119 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:59:57.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.293+0000 7fe2dd061700 1 Processor -- start 2023-11-28T11:59:57.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.293+0000 7fe2dd061700 1 -- start start 2023-11-28T11:59:57.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.297+0000 7fe2dd061700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe2d815e190 0x7fe2d80cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:57.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.297+0000 7fe2dd061700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe2d806ff10 0x7fe2d8070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:57.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.297+0000 7fe2dd061700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d80708b0 con 0x7fe2d8161560 2023-11-28T11:59:57.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.297+0000 7fe2dd061700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2d815e560 con 0x7fe2d806ff10 2023-11-28T11:59:57.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.297+0000 7fe2dd061700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2d806be80 con 0x7fe2d815e190 2023-11-28T11:59:57.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.297+0000 7fe2dc860700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe2d806ff10 0x7fe2d8070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:57.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.297+0000 7fe2dc860700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe2d806ff10 0x7fe2d8070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38842/0 (socket says 172.21.15.39:38842) 2023-11-28T11:59:57.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.297+0000 7fe2dc860700 1 -- 172.21.15.39:0/2440293424 learned_addr learned my addr 172.21.15.39:0/2440293424 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:57.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.297+0000 7fe2d7fff700 1 --2- 172.21.15.39:0/2440293424 >> v2:172.21.15.184:3300/0 conn(0x7fe2d815e190 0x7fe2d80cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:57.304 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.297+0000 7fe2dc860700 1 -- 172.21.15.39:0/2440293424 >> v2:172.21.15.184:3300/0 conn(0x7fe2d815e190 msgr2=0x7fe2d80cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:57.304 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.297+0000 7fe2dc860700 1 --2- 172.21.15.39:0/2440293424 >> v2:172.21.15.184:3300/0 conn(0x7fe2d815e190 0x7fe2d80cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:57.304 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.297+0000 7fe2dc860700 1 -- 172.21.15.39:0/2440293424 >> v1:172.21.15.184:6789/0 conn(0x7fe2d8161560 legacy=0x7fe2d8069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:57.304 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.297+0000 7fe2dc860700 1 -- 172.21.15.39:0/2440293424 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d80ce330 con 0x7fe2d806ff10 2023-11-28T11:59:57.304 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.297+0000 7fe2dc860700 1 --2- 172.21.15.39:0/2440293424 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2d806ff10 0x7fe2d8070370 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80cb9b0 tx=0x7fe2d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26d5ba47981b1a4d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:57.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.301+0000 7fe2d6ffd700 1 -- 172.21.15.39:0/2440293424 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d000e070 con 0x7fe2d806ff10 2023-11-28T11:59:57.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.301+0000 7fe2d6ffd700 1 -- 172.21.15.39:0/2440293424 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d000b910 con 0x7fe2d806ff10 2023-11-28T11:59:57.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.301+0000 7fe2d6ffd700 1 -- 172.21.15.39:0/2440293424 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d000bcc0 con 0x7fe2d806ff10 2023-11-28T11:59:57.306 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.301+0000 7fe2dd061700 1 -- 172.21.15.39:0/2440293424 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2d806ff10 msgr2=0x7fe2d8070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:57.306 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.301+0000 7fe2dd061700 1 --2- 172.21.15.39:0/2440293424 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2d806ff10 0x7fe2d8070370 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80cb9b0 tx=0x7fe2d000b330 comp rx=0 tx=0).stop 2023-11-28T11:59:57.306 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.301+0000 7fe2dd061700 1 -- 172.21.15.39:0/2440293424 shutdown_connections 2023-11-28T11:59:57.306 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.301+0000 7fe2dd061700 1 --2- 172.21.15.39:0/2440293424 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2d806ff10 0x7fe2d8070370 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:57.306 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.301+0000 7fe2dd061700 1 --2- 172.21.15.39:0/2440293424 >> v2:172.21.15.184:3300/0 conn(0x7fe2d815e190 0x7fe2d80cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:57.306 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.301+0000 7fe2dd061700 1 -- 172.21.15.39:0/2440293424 >> 172.21.15.39:0/2440293424 conn(0x7fe2d80cf280 msgr2=0x7fe2d80cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:57.306 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.301+0000 7fe2dd061700 1 -- 172.21.15.39:0/2440293424 shutdown_connections 2023-11-28T11:59:57.306 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.301+0000 7fe2dd061700 1 -- 172.21.15.39:0/2440293424 wait complete. 2023-11-28T11:59:57.308 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.301+0000 7fe2dd061700 1 Processor -- start 2023-11-28T11:59:57.308 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.305+0000 7fe2dd061700 1 -- start start 2023-11-28T11:59:57.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.305+0000 7fe2dd061700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2d806ff10 0x7fe2d8162ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:57.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.305+0000 7fe2dd061700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2d815e190 0x7fe2d8153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:57.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.305+0000 7fe2dd061700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2d8161560 0x7fe2d8162350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:57.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.305+0000 7fe2dd061700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d8163b20 con 0x7fe2d8161560 2023-11-28T11:59:57.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.305+0000 7fe2dd061700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d8162890 con 0x7fe2d806ff10 2023-11-28T11:59:57.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.305+0000 7fe2dd061700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d8154d00 con 0x7fe2d815e190 2023-11-28T11:59:57.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.305+0000 7fe2dc860700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2d8161560 0x7fe2d8162350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:57.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.305+0000 7fe2d77fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2d815e190 0x7fe2d8153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:57.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.305+0000 7fe2dc860700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2d8161560 0x7fe2d8162350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38858/0 (socket says 172.21.15.39:38858) 2023-11-28T11:59:57.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.305+0000 7fe2dc860700 1 -- 172.21.15.39:0/769462498 learned_addr learned my addr 172.21.15.39:0/769462498 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:57.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.305+0000 7fe2d7fff700 1 --2- 172.21.15.39:0/769462498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2d806ff10 0x7fe2d8162ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:57.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.305+0000 7fe2d77fe700 1 -- 172.21.15.39:0/769462498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2d806ff10 msgr2=0x7fe2d8162ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:57.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.305+0000 7fe2d77fe700 1 --2- 172.21.15.39:0/769462498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2d806ff10 0x7fe2d8162ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:57.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.305+0000 7fe2d77fe700 1 -- 172.21.15.39:0/769462498 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2d8161560 msgr2=0x7fe2d8162350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:57.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.305+0000 7fe2d77fe700 1 --2- 172.21.15.39:0/769462498 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2d8161560 0x7fe2d8162350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:57.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.305+0000 7fe2d77fe700 1 -- 172.21.15.39:0/769462498 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d0009b30 con 0x7fe2d815e190 2023-11-28T11:59:57.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.305+0000 7fe2d77fe700 1 --2- 172.21.15.39:0/769462498 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2d815e190 0x7fe2d8153eb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000c480 tx=0x7fe2c000c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:57.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.309+0000 7fe2d4ff9700 1 -- 172.21.15.39:0/769462498 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c00052d0 con 0x7fe2d815e190 2023-11-28T11:59:57.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.309+0000 7fe2d4ff9700 1 -- 172.21.15.39:0/769462498 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c0005430 con 0x7fe2d815e190 2023-11-28T11:59:57.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.309+0000 7fe2dd061700 1 -- 172.21.15.39:0/769462498 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2d80afc70 con 0x7fe2d815e190 2023-11-28T11:59:57.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.309+0000 7fe2d4ff9700 1 -- 172.21.15.39:0/769462498 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c00055a0 con 0x7fe2d815e190 2023-11-28T11:59:57.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.309+0000 7fe2dd061700 1 -- 172.21.15.39:0/769462498 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2d80af990 con 0x7fe2d815e190 2023-11-28T11:59:57.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.309+0000 7fe2dd061700 1 -- 172.21.15.39:0/769462498 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2d80aff50 con 0x7fe2d815e190 2023-11-28T11:59:57.315 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.309+0000 7fe2d4ff9700 1 -- 172.21.15.39:0/769462498 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe2c0019030 con 0x7fe2d815e190 2023-11-28T11:59:57.317 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.313+0000 7fe2d4ff9700 1 --2- 172.21.15.39:0/769462498 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe2bc064ee0 0x7fe2bc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:57.317 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.313+0000 7fe2d4ff9700 1 -- 172.21.15.39:0/769462498 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe2c0081290 con 0x7fe2d815e190 2023-11-28T11:59:57.318 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.313+0000 7fe2d7fff700 1 --2- 172.21.15.39:0/769462498 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe2bc064ee0 0x7fe2bc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:57.319 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.313+0000 7fe2d7fff700 1 --2- 172.21.15.39:0/769462498 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe2bc064ee0 0x7fe2bc067390 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe2d81f94f0 tx=0x7fe2c8009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:57.326 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.321+0000 7fe2d4ff9700 1 -- 172.21.15.39:0/769462498 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe2c004f280 con 0x7fe2d815e190 2023-11-28T11:59:57.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.493+0000 7fe2dd061700 1 -- 172.21.15.39:0/769462498 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe2d8073d20 con 0x7fe2d815e190 2023-11-28T11:59:57.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.493+0000 7fe2d4ff9700 1 -- 172.21.15.39:0/769462498 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v70) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe2c00528a0 con 0x7fe2d815e190 2023-11-28T11:59:57.499 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-11-28T11:59:57.503 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.497+0000 7fe2dd061700 1 -- 172.21.15.39:0/769462498 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe2bc064ee0 msgr2=0x7fe2bc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:57.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.497+0000 7fe2dd061700 1 --2- 172.21.15.39:0/769462498 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe2bc064ee0 0x7fe2bc067390 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe2d81f94f0 tx=0x7fe2c8009240 comp rx=0 tx=0).stop 2023-11-28T11:59:57.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.497+0000 7fe2dd061700 1 -- 172.21.15.39:0/769462498 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2d815e190 msgr2=0x7fe2d8153eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:57.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.497+0000 7fe2dd061700 1 --2- 172.21.15.39:0/769462498 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2d815e190 0x7fe2d8153eb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000c480 tx=0x7fe2c000c790 comp rx=0 tx=0).stop 2023-11-28T11:59:57.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.497+0000 7fe2dd061700 1 -- 172.21.15.39:0/769462498 shutdown_connections 2023-11-28T11:59:57.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.497+0000 7fe2dd061700 1 --2- 172.21.15.39:0/769462498 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2d8161560 0x7fe2d8162350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:57.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.497+0000 7fe2dd061700 1 --2- 172.21.15.39:0/769462498 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2d815e190 0x7fe2d8153eb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:57.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.497+0000 7fe2dd061700 1 --2- 172.21.15.39:0/769462498 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe2bc064ee0 0x7fe2bc067390 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:57.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.497+0000 7fe2dd061700 1 --2- 172.21.15.39:0/769462498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2d806ff10 0x7fe2d8162ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:57.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.497+0000 7fe2dd061700 1 -- 172.21.15.39:0/769462498 >> 172.21.15.39:0/769462498 conn(0x7fe2d80cf280 msgr2=0x7fe2d806caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:57.505 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.497+0000 7fe2dd061700 1 -- 172.21.15.39:0/769462498 shutdown_connections 2023-11-28T11:59:57.505 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.501+0000 7fe2dd061700 1 -- 172.21.15.39:0/769462498 wait complete. 2023-11-28T11:59:57.528 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:59:57.720 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.713+0000 7fb836f5d700 1 Processor -- start 2023-11-28T11:59:57.720 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.717+0000 7fb836f5d700 1 -- start start 2023-11-28T11:59:57.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.717+0000 7fb836f5d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb83015c150 0x7fb8300b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:57.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.717+0000 7fb836f5d700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb830070360 0x7fb830160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:57.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.717+0000 7fb836f5d700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb83015c520 con 0x7fb83006ff10 2023-11-28T11:59:57.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.717+0000 7fb836f5d700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8300b4240 con 0x7fb830070360 2023-11-28T11:59:57.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.717+0000 7fb836f5d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb83006ac00 con 0x7fb83015c150 2023-11-28T11:59:57.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.717+0000 7fb83675c700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb830070360 0x7fb830160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:57.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.717+0000 7fb835f5b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb83015c150 0x7fb8300b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:57.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.717+0000 7fb83575a700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fb83006ff10 0x7fb83015fc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:47976/0 (socket says 172.21.15.39:47976) 2023-11-28T11:59:57.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.717+0000 7fb83575a700 1 -- 172.21.15.39:0/1235398061 learned_addr learned my addr 172.21.15.39:0/1235398061 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:59:57.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.717+0000 7fb83675c700 1 -- 172.21.15.39:0/1235398061 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb83015c150 msgr2=0x7fb8300b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:57.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.717+0000 7fb83675c700 1 --2- 172.21.15.39:0/1235398061 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb83015c150 0x7fb8300b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:57.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.717+0000 7fb83675c700 1 -- 172.21.15.39:0/1235398061 >> v1:172.21.15.184:6789/0 conn(0x7fb83006ff10 legacy=0x7fb83015fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:57.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.717+0000 7fb83675c700 1 -- 172.21.15.39:0/1235398061 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83006cc50 con 0x7fb830070360 2023-11-28T11:59:57.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.717+0000 7fb834f59700 1 -- 172.21.15.39:0/1235398061 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1874512358 0 0) 0x7fb83015c520 con 0x7fb83006ff10 2023-11-28T11:59:57.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.721+0000 7fb83675c700 1 --2- 172.21.15.39:0/1235398061 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb830070360 0x7fb830160340 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fb828009d90 tx=0x7fb82800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6843871bb1a9d3a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:57.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.721+0000 7fb834f59700 1 -- 172.21.15.39:0/1235398061 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82800e070 con 0x7fb830070360 2023-11-28T11:59:57.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.721+0000 7fb834f59700 1 -- 172.21.15.39:0/1235398061 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82800bb20 con 0x7fb830070360 2023-11-28T11:59:57.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.721+0000 7fb834f59700 1 -- 172.21.15.39:0/1235398061 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb828012430 con 0x7fb830070360 2023-11-28T11:59:57.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.721+0000 7fb836f5d700 1 -- 172.21.15.39:0/1235398061 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb830070360 msgr2=0x7fb830160340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:57.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.721+0000 7fb836f5d700 1 --2- 172.21.15.39:0/1235398061 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb830070360 0x7fb830160340 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fb828009d90 tx=0x7fb82800b330 comp rx=0 tx=0).stop 2023-11-28T11:59:57.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.721+0000 7fb836f5d700 1 -- 172.21.15.39:0/1235398061 shutdown_connections 2023-11-28T11:59:57.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.721+0000 7fb836f5d700 1 --2- 172.21.15.39:0/1235398061 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb830070360 0x7fb830160340 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:57.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.721+0000 7fb836f5d700 1 --2- 172.21.15.39:0/1235398061 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb83015c150 0x7fb8300b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:57.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.721+0000 7fb836f5d700 1 -- 172.21.15.39:0/1235398061 >> 172.21.15.39:0/1235398061 conn(0x7fb8300d3680 msgr2=0x7fb8300cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:57.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.721+0000 7fb836f5d700 1 -- 172.21.15.39:0/1235398061 shutdown_connections 2023-11-28T11:59:57.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.721+0000 7fb836f5d700 1 -- 172.21.15.39:0/1235398061 wait complete. 2023-11-28T11:59:57.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.725+0000 7fb836f5d700 1 Processor -- start 2023-11-28T11:59:57.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.725+0000 7fb836f5d700 1 -- start start 2023-11-28T11:59:57.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.729+0000 7fb836f5d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb83006ff10 0x7fb8300cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:57.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.729+0000 7fb836f5d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb830070360 0x7fb8300ceda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:57.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.729+0000 7fb836f5d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb83015c150 0x7fb8301f0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:57.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.729+0000 7fb836f5d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8301403b0 con 0x7fb830070360 2023-11-28T11:59:57.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.729+0000 7fb836f5d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8300cf880 con 0x7fb83006ff10 2023-11-28T11:59:57.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.729+0000 7fb836f5d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8300cfb60 con 0x7fb83015c150 2023-11-28T11:59:57.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.729+0000 7fb83575a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb830070360 0x7fb8300ceda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:57.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.729+0000 7fb83575a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb830070360 0x7fb8300ceda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38864/0 (socket says 172.21.15.39:38864) 2023-11-28T11:59:57.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.729+0000 7fb83575a700 1 -- 172.21.15.39:0/210786529 learned_addr learned my addr 172.21.15.39:0/210786529 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:57.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.729+0000 7fb835f5b700 1 --2- 172.21.15.39:0/210786529 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb83006ff10 0x7fb8300cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:57.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.729+0000 7fb83675c700 1 --2- 172.21.15.39:0/210786529 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb83015c150 0x7fb8301f0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:57.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.729+0000 7fb83575a700 1 -- 172.21.15.39:0/210786529 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb83015c150 msgr2=0x7fb8301f0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:57.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.729+0000 7fb83575a700 1 --2- 172.21.15.39:0/210786529 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb83015c150 0x7fb8301f0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:57.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.729+0000 7fb83575a700 1 -- 172.21.15.39:0/210786529 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb83006ff10 msgr2=0x7fb8300cc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:57.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.729+0000 7fb83575a700 1 --2- 172.21.15.39:0/210786529 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb83006ff10 0x7fb8300cc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:57.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.729+0000 7fb83575a700 1 -- 172.21.15.39:0/210786529 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb828009a70 con 0x7fb830070360 2023-11-28T11:59:57.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.729+0000 7fb83575a700 1 --2- 172.21.15.39:0/210786529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb830070360 0x7fb8300ceda0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fb82000c780 tx=0x7fb82000ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:57.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.729+0000 7fb8267fc700 1 -- 172.21.15.39:0/210786529 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb820004cf0 con 0x7fb830070360 2023-11-28T11:59:57.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.729+0000 7fb8267fc700 1 -- 172.21.15.39:0/210786529 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb820004e50 con 0x7fb830070360 2023-11-28T11:59:57.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.729+0000 7fb8267fc700 1 -- 172.21.15.39:0/210786529 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb820007310 con 0x7fb830070360 2023-11-28T11:59:57.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.729+0000 7fb836f5d700 1 -- 172.21.15.39:0/210786529 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8300d2730 con 0x7fb830070360 2023-11-28T11:59:57.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.729+0000 7fb836f5d700 1 -- 172.21.15.39:0/210786529 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8300d2450 con 0x7fb830070360 2023-11-28T11:59:57.737 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.733+0000 7fb836f5d700 1 -- 172.21.15.39:0/210786529 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8300d05e0 con 0x7fb830070360 2023-11-28T11:59:57.737 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.733+0000 7fb8267fc700 1 -- 172.21.15.39:0/210786529 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb82001a020 con 0x7fb830070360 2023-11-28T11:59:57.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.733+0000 7fb8267fc700 1 --2- 172.21.15.39:0/210786529 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb814064ee0 0x7fb814067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:57.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.733+0000 7fb8267fc700 1 -- 172.21.15.39:0/210786529 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb820081a40 con 0x7fb830070360 2023-11-28T11:59:57.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.737+0000 7fb835f5b700 1 --2- 172.21.15.39:0/210786529 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb814064ee0 0x7fb814067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:57.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.737+0000 7fb835f5b700 1 --2- 172.21.15.39:0/210786529 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb814064ee0 0x7fb814067390 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb82c009b50 tx=0x7fb82c009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:57.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.737+0000 7fb8267fc700 1 -- 172.21.15.39:0/210786529 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb82004fa40 con 0x7fb830070360 2023-11-28T11:59:57.793 INFO:tasks.ceph.mon.a.smithi039.stderr:2023-11-28T11:59:57.789+0000 7ff4e35f9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-11-28T11:59:57.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.917+0000 7fb836f5d700 1 -- 172.21.15.39:0/210786529 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb830073d20 con 0x7fb830070360 2023-11-28T11:59:57.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.917+0000 7fb8267fc700 1 -- 172.21.15.39:0/210786529 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v70) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb820053060 con 0x7fb830070360 2023-11-28T11:59:57.923 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-11-28T11:59:57.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.921+0000 7fb836f5d700 1 -- 172.21.15.39:0/210786529 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb814064ee0 msgr2=0x7fb814067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:57.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.921+0000 7fb836f5d700 1 --2- 172.21.15.39:0/210786529 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb814064ee0 0x7fb814067390 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb82c009b50 tx=0x7fb82c009240 comp rx=0 tx=0).stop 2023-11-28T11:59:57.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.921+0000 7fb836f5d700 1 -- 172.21.15.39:0/210786529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb830070360 msgr2=0x7fb8300ceda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:57.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.921+0000 7fb836f5d700 1 --2- 172.21.15.39:0/210786529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb830070360 0x7fb8300ceda0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fb82000c780 tx=0x7fb82000ca90 comp rx=0 tx=0).stop 2023-11-28T11:59:57.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.921+0000 7fb836f5d700 1 -- 172.21.15.39:0/210786529 shutdown_connections 2023-11-28T11:59:57.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.921+0000 7fb836f5d700 1 --2- 172.21.15.39:0/210786529 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb83015c150 0x7fb8301f0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:57.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.921+0000 7fb836f5d700 1 --2- 172.21.15.39:0/210786529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb830070360 0x7fb8300ceda0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:57.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.921+0000 7fb836f5d700 1 --2- 172.21.15.39:0/210786529 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb814064ee0 0x7fb814067390 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:57.929 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.921+0000 7fb836f5d700 1 --2- 172.21.15.39:0/210786529 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb83006ff10 0x7fb8300cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:57.929 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.921+0000 7fb836f5d700 1 -- 172.21.15.39:0/210786529 >> 172.21.15.39:0/210786529 conn(0x7fb8300d3680 msgr2=0x7fb8300d09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:57.929 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.921+0000 7fb836f5d700 1 -- 172.21.15.39:0/210786529 shutdown_connections 2023-11-28T11:59:57.929 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:57.921+0000 7fb836f5d700 1 -- 172.21.15.39:0/210786529 wait complete. 2023-11-28T11:59:57.951 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:59:58.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.129+0000 7fcd788ce700 1 Processor -- start 2023-11-28T11:59:58.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.129+0000 7fcd788ce700 1 -- start start 2023-11-28T11:59:58.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.133+0000 7fcd788ce700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd740d1af0 0x7fcd7406aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:58.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.133+0000 7fcd788ce700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd7406b570 con 0x7fcd74069f50 2023-11-28T11:59:58.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.133+0000 7fcd788ce700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd7415c750 con 0x7fcd7415c380 2023-11-28T11:59:58.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.133+0000 7fcd788ce700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd740b5360 con 0x7fcd740d1af0 2023-11-28T11:59:58.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.133+0000 7fcd72d9d700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fcd7415c380 0x7fcd740d13e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:47342/0 (socket says 172.21.15.39:47342) 2023-11-28T11:59:58.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.133+0000 7fcd72d9d700 1 -- 172.21.15.39:0/2895843563 learned_addr learned my addr 172.21.15.39:0/2895843563 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:59:58.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.133+0000 7fcd7259c700 1 --2- 172.21.15.39:0/2895843563 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd740d1af0 0x7fcd7406aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:58.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.133+0000 7fcd71d9b700 1 -- 172.21.15.39:0/2895843563 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4162972781 0 0) 0x7fcd7415c750 con 0x7fcd7415c380 2023-11-28T11:59:58.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.133+0000 7fcd71d9b700 1 -- 172.21.15.39:0/2895843563 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd5c0035d0 con 0x7fcd7415c380 2023-11-28T11:59:58.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.133+0000 7fcd7259c700 1 -- 172.21.15.39:0/2895843563 >> v1:172.21.15.184:6789/0 conn(0x7fcd7415c380 legacy=0x7fcd740d13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:58.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.133+0000 7fcd7259c700 1 -- 172.21.15.39:0/2895843563 >> v1:172.21.15.39:6789/0 conn(0x7fcd74069f50 legacy=0x7fcd740ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:58.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.133+0000 7fcd71d9b700 1 -- 172.21.15.39:0/2895843563 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1794688249 0 0) 0x7fcd7406b570 con 0x7fcd74069f50 2023-11-28T11:59:58.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.133+0000 7fcd7259c700 1 -- 172.21.15.39:0/2895843563 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd740d0810 con 0x7fcd740d1af0 2023-11-28T11:59:58.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.133+0000 7fcd7259c700 1 --2- 172.21.15.39:0/2895843563 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd740d1af0 0x7fcd7406aeb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcd68009880 tx=0x7fcd68009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccbe5a379733dd0c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:58.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.133+0000 7fcd71d9b700 1 -- 172.21.15.39:0/2895843563 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd68011830 con 0x7fcd740d1af0 2023-11-28T11:59:58.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.133+0000 7fcd71d9b700 1 -- 172.21.15.39:0/2895843563 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd68011990 con 0x7fcd740d1af0 2023-11-28T11:59:58.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.133+0000 7fcd71d9b700 1 -- 172.21.15.39:0/2895843563 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd68011d20 con 0x7fcd740d1af0 2023-11-28T11:59:58.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.137+0000 7fcd788ce700 1 -- 172.21.15.39:0/2895843563 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd740d1af0 msgr2=0x7fcd7406aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:58.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.137+0000 7fcd788ce700 1 --2- 172.21.15.39:0/2895843563 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd740d1af0 0x7fcd7406aeb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcd68009880 tx=0x7fcd68009b90 comp rx=0 tx=0).stop 2023-11-28T11:59:58.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.137+0000 7fcd788ce700 1 -- 172.21.15.39:0/2895843563 shutdown_connections 2023-11-28T11:59:58.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.137+0000 7fcd788ce700 1 --2- 172.21.15.39:0/2895843563 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd740d1af0 0x7fcd7406aeb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:58.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.137+0000 7fcd788ce700 1 -- 172.21.15.39:0/2895843563 >> 172.21.15.39:0/2895843563 conn(0x7fcd7406cb80 msgr2=0x7fcd740d2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:58.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.137+0000 7fcd788ce700 1 -- 172.21.15.39:0/2895843563 shutdown_connections 2023-11-28T11:59:58.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.137+0000 7fcd788ce700 1 -- 172.21.15.39:0/2895843563 wait complete. 2023-11-28T11:59:58.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.137+0000 7fcd788ce700 1 Processor -- start 2023-11-28T11:59:58.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.137+0000 7fcd788ce700 1 -- start start 2023-11-28T11:59:58.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.141+0000 7fcd788ce700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd74069f50 0x7fcd7415f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:58.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.141+0000 7fcd788ce700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd740d1af0 0x7fcd74153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:58.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.141+0000 7fcd788ce700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd7415c380 0x7fcd74070cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:58.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.141+0000 7fcd788ce700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd74153190 con 0x7fcd7415c380 2023-11-28T11:59:58.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.141+0000 7fcd788ce700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd740b6640 con 0x7fcd740d1af0 2023-11-28T11:59:58.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.141+0000 7fcd788ce700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd740b6920 con 0x7fcd74069f50 2023-11-28T11:59:58.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.141+0000 7fcd7359e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd7415c380 0x7fcd74070cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:58.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.141+0000 7fcd72d9d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd74069f50 0x7fcd7415f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:58.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.141+0000 7fcd7359e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd7415c380 0x7fcd74070cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55538/0 (socket says 172.21.15.39:55538) 2023-11-28T11:59:58.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.141+0000 7fcd7259c700 1 --2- 172.21.15.39:0/387002400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd740d1af0 0x7fcd74153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:58.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.141+0000 7fcd7359e700 1 -- 172.21.15.39:0/387002400 learned_addr learned my addr 172.21.15.39:0/387002400 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:58.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.141+0000 7fcd7259c700 1 -- 172.21.15.39:0/387002400 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd74069f50 msgr2=0x7fcd7415f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:58.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.141+0000 7fcd7259c700 1 --2- 172.21.15.39:0/387002400 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd74069f50 0x7fcd7415f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:58.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.141+0000 7fcd7259c700 1 -- 172.21.15.39:0/387002400 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd7415c380 msgr2=0x7fcd74070cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:58.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.141+0000 7fcd7259c700 1 --2- 172.21.15.39:0/387002400 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd7415c380 0x7fcd74070cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:58.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.141+0000 7fcd7259c700 1 -- 172.21.15.39:0/387002400 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd680094b0 con 0x7fcd740d1af0 2023-11-28T11:59:58.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.141+0000 7fcd7359e700 1 --2- 172.21.15.39:0/387002400 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd7415c380 0x7fcd74070cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:58.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.141+0000 7fcd7259c700 1 --2- 172.21.15.39:0/387002400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd740d1af0 0x7fcd74153520 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fcd68015000 tx=0x7fcd68004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:58.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.141+0000 7fcd5b7fe700 1 -- 172.21.15.39:0/387002400 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd68019950 con 0x7fcd740d1af0 2023-11-28T11:59:58.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.141+0000 7fcd5b7fe700 1 -- 172.21.15.39:0/387002400 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6801e070 con 0x7fcd740d1af0 2023-11-28T11:59:58.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.141+0000 7fcd5b7fe700 1 -- 172.21.15.39:0/387002400 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd68019d30 con 0x7fcd740d1af0 2023-11-28T11:59:58.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.141+0000 7fcd788ce700 1 -- 172.21.15.39:0/387002400 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd740d0dd0 con 0x7fcd740d1af0 2023-11-28T11:59:58.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.141+0000 7fcd788ce700 1 -- 172.21.15.39:0/387002400 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd740d0af0 con 0x7fcd740d1af0 2023-11-28T11:59:58.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.145+0000 7fcd788ce700 1 -- 172.21.15.39:0/387002400 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd740cdb40 con 0x7fcd740d1af0 2023-11-28T11:59:58.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.145+0000 7fcd5b7fe700 1 -- 172.21.15.39:0/387002400 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fcd6800f050 con 0x7fcd740d1af0 2023-11-28T11:59:58.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.149+0000 7fcd5b7fe700 1 --2- 172.21.15.39:0/387002400 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcd60064ee0 0x7fcd60067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:58.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.149+0000 7fcd5b7fe700 1 -- 172.21.15.39:0/387002400 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fcd68082b40 con 0x7fcd740d1af0 2023-11-28T11:59:58.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.149+0000 7fcd72d9d700 1 --2- 172.21.15.39:0/387002400 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcd60064ee0 0x7fcd60067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:58.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.149+0000 7fcd72d9d700 1 --2- 172.21.15.39:0/387002400 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcd60064ee0 0x7fcd60067390 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fcd64007fd0 tx=0x7fcd64007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:58.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.157+0000 7fcd5b7fe700 1 -- 172.21.15.39:0/387002400 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcd68050b20 con 0x7fcd740d1af0 2023-11-28T11:59:58.339 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.333+0000 7fcd788ce700 1 -- 172.21.15.39:0/387002400 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcd74073d20 con 0x7fcd740d1af0 2023-11-28T11:59:58.340 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.337+0000 7fcd5b7fe700 1 -- 172.21.15.39:0/387002400 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v70) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcd680200a0 con 0x7fcd740d1af0 2023-11-28T11:59:58.340 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-11-28T11:59:58.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.337+0000 7fcd788ce700 1 -- 172.21.15.39:0/387002400 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcd60064ee0 msgr2=0x7fcd60067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:58.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.337+0000 7fcd788ce700 1 --2- 172.21.15.39:0/387002400 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcd60064ee0 0x7fcd60067390 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fcd64007fd0 tx=0x7fcd64007de0 comp rx=0 tx=0).stop 2023-11-28T11:59:58.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.337+0000 7fcd788ce700 1 -- 172.21.15.39:0/387002400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd740d1af0 msgr2=0x7fcd74153520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:58.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.337+0000 7fcd788ce700 1 --2- 172.21.15.39:0/387002400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd740d1af0 0x7fcd74153520 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fcd68015000 tx=0x7fcd68004770 comp rx=0 tx=0).stop 2023-11-28T11:59:58.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.337+0000 7fcd788ce700 1 -- 172.21.15.39:0/387002400 shutdown_connections 2023-11-28T11:59:58.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.337+0000 7fcd788ce700 1 --2- 172.21.15.39:0/387002400 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd7415c380 0x7fcd74070cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:58.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.337+0000 7fcd788ce700 1 --2- 172.21.15.39:0/387002400 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fcd60064ee0 0x7fcd60067390 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:58.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.337+0000 7fcd788ce700 1 --2- 172.21.15.39:0/387002400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd740d1af0 0x7fcd74153520 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:58.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.337+0000 7fcd788ce700 1 --2- 172.21.15.39:0/387002400 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd74069f50 0x7fcd7415f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:58.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.337+0000 7fcd788ce700 1 -- 172.21.15.39:0/387002400 >> 172.21.15.39:0/387002400 conn(0x7fcd7406cb80 msgr2=0x7fcd740d13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:58.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.337+0000 7fcd788ce700 1 -- 172.21.15.39:0/387002400 shutdown_connections 2023-11-28T11:59:58.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.337+0000 7fcd788ce700 1 -- 172.21.15.39:0/387002400 wait complete. 2023-11-28T11:59:58.364 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:59:58.552 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.545+0000 7fc78ea62700 1 Processor -- start 2023-11-28T11:59:58.552 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.545+0000 7fc78ea62700 1 -- start start 2023-11-28T11:59:58.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.549+0000 7fc78ea62700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc7880af650 0x7fc78806c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:58.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.549+0000 7fc78ea62700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7880adb20 0x7fc78806ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:58.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.549+0000 7fc78ea62700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc78806c040 con 0x7fc7880b4280 2023-11-28T11:59:58.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.549+0000 7fc78ea62700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc78815a920 con 0x7fc7880af650 2023-11-28T11:59:58.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.549+0000 7fc78ea62700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78815eac0 con 0x7fc7880adb20 2023-11-28T11:59:58.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.549+0000 7fc77f7fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc7880af650 0x7fc78806c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:58.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.549+0000 7fc77f7fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc7880af650 0x7fc78806c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55542/0 (socket says 172.21.15.39:55542) 2023-11-28T11:59:58.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.549+0000 7fc77f7fe700 1 -- 172.21.15.39:0/2755998023 learned_addr learned my addr 172.21.15.39:0/2755998023 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:58.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.549+0000 7fc78cfff700 1 --2- 172.21.15.39:0/2755998023 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7880adb20 0x7fc78806ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:58.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.549+0000 7fc77f7fe700 1 -- 172.21.15.39:0/2755998023 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7880adb20 msgr2=0x7fc78806ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:58.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.549+0000 7fc77f7fe700 1 --2- 172.21.15.39:0/2755998023 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7880adb20 0x7fc78806ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:58.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.549+0000 7fc77f7fe700 1 -- 172.21.15.39:0/2755998023 >> v1:172.21.15.184:6789/0 conn(0x7fc7880b4280 legacy=0x7fc7880aef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:58.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.549+0000 7fc77f7fe700 1 -- 172.21.15.39:0/2755998023 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7880b4650 con 0x7fc7880af650 2023-11-28T11:59:58.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.549+0000 7fc78cfff700 1 --2- 172.21.15.39:0/2755998023 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7880adb20 0x7fc78806ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:59:58.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.549+0000 7fc77f7fe700 1 --2- 172.21.15.39:0/2755998023 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7880af650 0x7fc78806c4d0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fc770009e50 tx=0x7fc77000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e6e955be266a80e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:58.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.549+0000 7fc7877fe700 1 -- 172.21.15.39:0/2755998023 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77000e070 con 0x7fc7880af650 2023-11-28T11:59:58.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.549+0000 7fc7877fe700 1 -- 172.21.15.39:0/2755998023 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc77000b9c0 con 0x7fc7880af650 2023-11-28T11:59:58.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.549+0000 7fc7877fe700 1 -- 172.21.15.39:0/2755998023 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77000bd70 con 0x7fc7880af650 2023-11-28T11:59:58.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.549+0000 7fc78ea62700 1 -- 172.21.15.39:0/2755998023 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7880af650 msgr2=0x7fc78806c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:58.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.549+0000 7fc78ea62700 1 --2- 172.21.15.39:0/2755998023 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7880af650 0x7fc78806c4d0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fc770009e50 tx=0x7fc77000b330 comp rx=0 tx=0).stop 2023-11-28T11:59:58.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.553+0000 7fc78ea62700 1 -- 172.21.15.39:0/2755998023 shutdown_connections 2023-11-28T11:59:58.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.553+0000 7fc78ea62700 1 --2- 172.21.15.39:0/2755998023 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7880adb20 0x7fc78806ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:58.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.553+0000 7fc78ea62700 1 --2- 172.21.15.39:0/2755998023 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7880af650 0x7fc78806c4d0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:58.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.553+0000 7fc78ea62700 1 -- 172.21.15.39:0/2755998023 >> 172.21.15.39:0/2755998023 conn(0x7fc7880cf580 msgr2=0x7fc7880cb370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:58.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.553+0000 7fc78ea62700 1 -- 172.21.15.39:0/2755998023 shutdown_connections 2023-11-28T11:59:58.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.553+0000 7fc78ea62700 1 -- 172.21.15.39:0/2755998023 wait complete. 2023-11-28T11:59:58.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.553+0000 7fc78ea62700 1 Processor -- start 2023-11-28T11:59:58.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.553+0000 7fc78ea62700 1 -- start start 2023-11-28T11:59:58.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.553+0000 7fc78ea62700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7880adb20 0x7fc78815d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:58.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.553+0000 7fc78ea62700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7880af650 0x7fc7880c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:58.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.553+0000 7fc78ea62700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7880b4280 0x7fc788147bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:58.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.553+0000 7fc78ea62700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7880c60c0 con 0x7fc7880b4280 2023-11-28T11:59:58.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.553+0000 7fc78ea62700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7880c8200 con 0x7fc7880adb20 2023-11-28T11:59:58.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.553+0000 7fc78ea62700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7880c84e0 con 0x7fc7880af650 2023-11-28T11:59:58.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.553+0000 7fc78cfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7880b4280 0x7fc788147bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:58.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.553+0000 7fc787fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7880adb20 0x7fc78815d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:58.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.553+0000 7fc78cfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7880b4280 0x7fc788147bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55554/0 (socket says 172.21.15.39:55554) 2023-11-28T11:59:58.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.553+0000 7fc78cfff700 1 -- 172.21.15.39:0/1249269353 learned_addr learned my addr 172.21.15.39:0/1249269353 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:58.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.557+0000 7fc77f7fe700 1 --2- 172.21.15.39:0/1249269353 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7880af650 0x7fc7880c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:58.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.557+0000 7fc78cfff700 1 -- 172.21.15.39:0/1249269353 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7880af650 msgr2=0x7fc7880c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:58.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.557+0000 7fc78cfff700 1 --2- 172.21.15.39:0/1249269353 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7880af650 0x7fc7880c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:58.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.557+0000 7fc78cfff700 1 -- 172.21.15.39:0/1249269353 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7880adb20 msgr2=0x7fc78815d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:58.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.557+0000 7fc78cfff700 1 --2- 172.21.15.39:0/1249269353 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7880adb20 0x7fc78815d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:58.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.557+0000 7fc78cfff700 1 -- 172.21.15.39:0/1249269353 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc770009b30 con 0x7fc7880b4280 2023-11-28T11:59:58.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.557+0000 7fc787fff700 1 --2- 172.21.15.39:0/1249269353 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7880adb20 0x7fc78815d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:58.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.557+0000 7fc78cfff700 1 --2- 172.21.15.39:0/1249269353 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7880b4280 0x7fc788147bf0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fc78000c7f0 tx=0x7fc78000cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:58.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.557+0000 7fc7857fa700 1 -- 172.21.15.39:0/1249269353 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc780011800 con 0x7fc7880b4280 2023-11-28T11:59:58.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.557+0000 7fc7857fa700 1 -- 172.21.15.39:0/1249269353 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc780011980 con 0x7fc7880b4280 2023-11-28T11:59:58.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.557+0000 7fc7857fa700 1 -- 172.21.15.39:0/1249269353 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc780011d30 con 0x7fc7880b4280 2023-11-28T11:59:58.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.557+0000 7fc78ea62700 1 -- 172.21.15.39:0/1249269353 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7880b1350 con 0x7fc7880b4280 2023-11-28T11:59:58.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.557+0000 7fc78ea62700 1 -- 172.21.15.39:0/1249269353 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc78815ed60 con 0x7fc7880b4280 2023-11-28T11:59:58.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.557+0000 7fc78ea62700 1 -- 172.21.15.39:0/1249269353 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7880b17e0 con 0x7fc7880b4280 2023-11-28T11:59:58.616 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.561+0000 7fc7857fa700 1 -- 172.21.15.39:0/1249269353 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc780021070 con 0x7fc7880b4280 2023-11-28T11:59:58.616 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.561+0000 7fc7857fa700 1 --2- 172.21.15.39:0/1249269353 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc768064ee0 0x7fc768067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:58.616 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.561+0000 7fc7857fa700 1 -- 172.21.15.39:0/1249269353 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc780081db0 con 0x7fc7880b4280 2023-11-28T11:59:58.617 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.561+0000 7fc787fff700 1 --2- 172.21.15.39:0/1249269353 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc768064ee0 0x7fc768067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:58.617 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.565+0000 7fc787fff700 1 --2- 172.21.15.39:0/1249269353 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc768064ee0 0x7fc768067390 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc778000f60 tx=0x7fc778009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:58.617 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.569+0000 7fc7857fa700 1 -- 172.21.15.39:0/1249269353 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc780086070 con 0x7fc7880b4280 2023-11-28T11:59:58.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.757+0000 7fc78ea62700 1 -- 172.21.15.39:0/1249269353 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc7880726c0 con 0x7fc7880b4280 2023-11-28T11:59:58.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.757+0000 7fc7857fa700 1 -- 172.21.15.39:0/1249269353 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v70) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc78004fd20 con 0x7fc7880b4280 2023-11-28T11:59:58.764 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2023-11-28T11:59:58.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.761+0000 7fc78ea62700 1 -- 172.21.15.39:0/1249269353 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc768064ee0 msgr2=0x7fc768067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:58.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.761+0000 7fc78ea62700 1 --2- 172.21.15.39:0/1249269353 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc768064ee0 0x7fc768067390 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc778000f60 tx=0x7fc778009040 comp rx=0 tx=0).stop 2023-11-28T11:59:58.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.761+0000 7fc78ea62700 1 -- 172.21.15.39:0/1249269353 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7880b4280 msgr2=0x7fc788147bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:58.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.761+0000 7fc78ea62700 1 --2- 172.21.15.39:0/1249269353 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7880b4280 0x7fc788147bf0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fc78000c7f0 tx=0x7fc78000cb00 comp rx=0 tx=0).stop 2023-11-28T11:59:58.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.761+0000 7fc78ea62700 1 -- 172.21.15.39:0/1249269353 shutdown_connections 2023-11-28T11:59:58.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.761+0000 7fc78ea62700 1 --2- 172.21.15.39:0/1249269353 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7880b4280 0x7fc788147bf0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:58.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.761+0000 7fc78ea62700 1 --2- 172.21.15.39:0/1249269353 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7880af650 0x7fc7880c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:58.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.761+0000 7fc78ea62700 1 --2- 172.21.15.39:0/1249269353 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc768064ee0 0x7fc768067390 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:58.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.761+0000 7fc78ea62700 1 --2- 172.21.15.39:0/1249269353 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7880adb20 0x7fc78815d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:58.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.761+0000 7fc78ea62700 1 -- 172.21.15.39:0/1249269353 >> 172.21.15.39:0/1249269353 conn(0x7fc7880cf580 msgr2=0x7fc7880ae070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:58.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.761+0000 7fc78ea62700 1 -- 172.21.15.39:0/1249269353 shutdown_connections 2023-11-28T11:59:58.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.761+0000 7fc78ea62700 1 -- 172.21.15.39:0/1249269353 wait complete. 2023-11-28T11:59:58.789 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T11:59:58.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.969+0000 7fa32d7d2700 1 Processor -- start 2023-11-28T11:59:58.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.969+0000 7fa32d7d2700 1 -- start start 2023-11-28T11:59:58.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.973+0000 7fa32d7d2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3280cca20 0x7fa3280b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:58.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.973+0000 7fa32d7d2700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa3280b3b30 0x7fa3280ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:58.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.973+0000 7fa32d7d2700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3280cb9c0 con 0x7fa3280b1b30 2023-11-28T11:59:58.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.973+0000 7fa32d7d2700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3280cadf0 con 0x7fa3280b3b30 2023-11-28T11:59:58.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.973+0000 7fa32d7d2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3280cb090 con 0x7fa3280cca20 2023-11-28T11:59:58.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.973+0000 7fa32cfd1700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa3280b3b30 0x7fa3280ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:58.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.973+0000 7fa32cfd1700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa3280b3b30 0x7fa3280ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55562/0 (socket says 172.21.15.39:55562) 2023-11-28T11:59:58.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.973+0000 7fa32cfd1700 1 -- 172.21.15.39:0/696705534 learned_addr learned my addr 172.21.15.39:0/696705534 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:58.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.973+0000 7fa31ffff700 1 --2- 172.21.15.39:0/696705534 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3280cca20 0x7fa3280b35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:58.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.973+0000 7fa32cfd1700 1 -- 172.21.15.39:0/696705534 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3280cca20 msgr2=0x7fa3280b35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:58.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.973+0000 7fa32cfd1700 1 --2- 172.21.15.39:0/696705534 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3280cca20 0x7fa3280b35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:58.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.973+0000 7fa32cfd1700 1 -- 172.21.15.39:0/696705534 >> v1:172.21.15.184:6789/0 conn(0x7fa3280b1b30 legacy=0x7fa3280cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:58.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.973+0000 7fa32cfd1700 1 -- 172.21.15.39:0/696705534 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3280cb370 con 0x7fa3280b3b30 2023-11-28T11:59:58.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.973+0000 7fa32cfd1700 1 --2- 172.21.15.39:0/696705534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3280b3b30 0x7fa3280ce370 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fa320009e50 tx=0x7fa32000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc254064b2e6d37 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:58.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.973+0000 7fa3277fe700 1 -- 172.21.15.39:0/696705534 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32000e070 con 0x7fa3280b3b30 2023-11-28T11:59:58.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.973+0000 7fa3277fe700 1 -- 172.21.15.39:0/696705534 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32000b910 con 0x7fa3280b3b30 2023-11-28T11:59:58.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.973+0000 7fa3277fe700 1 -- 172.21.15.39:0/696705534 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32000bcc0 con 0x7fa3280b3b30 2023-11-28T11:59:58.984 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.977+0000 7fa32d7d2700 1 -- 172.21.15.39:0/696705534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3280b3b30 msgr2=0x7fa3280ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:58.984 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.977+0000 7fa32d7d2700 1 --2- 172.21.15.39:0/696705534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3280b3b30 0x7fa3280ce370 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fa320009e50 tx=0x7fa32000b330 comp rx=0 tx=0).stop 2023-11-28T11:59:58.984 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.977+0000 7fa32d7d2700 1 -- 172.21.15.39:0/696705534 shutdown_connections 2023-11-28T11:59:58.984 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.977+0000 7fa32d7d2700 1 --2- 172.21.15.39:0/696705534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3280b3b30 0x7fa3280ce370 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:58.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.977+0000 7fa32d7d2700 1 --2- 172.21.15.39:0/696705534 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3280cca20 0x7fa3280b35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:58.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.977+0000 7fa32d7d2700 1 -- 172.21.15.39:0/696705534 >> 172.21.15.39:0/696705534 conn(0x7fa328099af0 msgr2=0x7fa3280d07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:58.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.977+0000 7fa32d7d2700 1 -- 172.21.15.39:0/696705534 shutdown_connections 2023-11-28T11:59:58.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.977+0000 7fa32d7d2700 1 -- 172.21.15.39:0/696705534 wait complete. 2023-11-28T11:59:58.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.977+0000 7fa32d7d2700 1 Processor -- start 2023-11-28T11:59:58.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.977+0000 7fa32d7d2700 1 -- start start 2023-11-28T11:59:58.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.981+0000 7fa32d7d2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3280b1b30 0x7fa328151df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:58.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.981+0000 7fa32d7d2700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3280b3b30 0x7fa3280c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:58.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.981+0000 7fa32d7d2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3280cca20 0x7fa3280ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:58.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.981+0000 7fa32d7d2700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3281f6050 con 0x7fa3280b3b30 2023-11-28T11:59:58.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.981+0000 7fa32d7d2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3281f1cd0 con 0x7fa3280cca20 2023-11-28T11:59:58.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.981+0000 7fa32d7d2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3281f1fb0 con 0x7fa3280b1b30 2023-11-28T11:59:58.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.981+0000 7fa31ffff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3280b3b30 0x7fa3280c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:58.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.981+0000 7fa31ffff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3280b3b30 0x7fa3280c9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55570/0 (socket says 172.21.15.39:55570) 2023-11-28T11:59:58.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.981+0000 7fa31ffff700 1 -- 172.21.15.39:0/3586863538 learned_addr learned my addr 172.21.15.39:0/3586863538 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:58.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.981+0000 7fa327fff700 1 --2- 172.21.15.39:0/3586863538 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3280b1b30 0x7fa328151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:58.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.981+0000 7fa32cfd1700 1 --2- 172.21.15.39:0/3586863538 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3280cca20 0x7fa3280ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:58.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.981+0000 7fa31ffff700 1 -- 172.21.15.39:0/3586863538 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3280b1b30 msgr2=0x7fa328151df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:58.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.981+0000 7fa31ffff700 1 --2- 172.21.15.39:0/3586863538 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3280b1b30 0x7fa328151df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:58.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.981+0000 7fa31ffff700 1 -- 172.21.15.39:0/3586863538 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3280cca20 msgr2=0x7fa3280ca3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:58.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.981+0000 7fa31ffff700 1 --2- 172.21.15.39:0/3586863538 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3280cca20 0x7fa3280ca3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:58.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.981+0000 7fa31ffff700 1 -- 172.21.15.39:0/3586863538 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa320009b30 con 0x7fa3280b3b30 2023-11-28T11:59:58.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.981+0000 7fa32cfd1700 1 --2- 172.21.15.39:0/3586863538 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3280cca20 0x7fa3280ca3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:58.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.981+0000 7fa31ffff700 1 --2- 172.21.15.39:0/3586863538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3280b3b30 0x7fa3280c9eb0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fa31000e9d0 tx=0x7fa31000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:58.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.981+0000 7fa3257fa700 1 -- 172.21.15.39:0/3586863538 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa310009720 con 0x7fa3280b3b30 2023-11-28T11:59:58.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.981+0000 7fa3257fa700 1 -- 172.21.15.39:0/3586863538 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31000c850 con 0x7fa3280b3b30 2023-11-28T11:59:58.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.981+0000 7fa3257fa700 1 -- 172.21.15.39:0/3586863538 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31000cbc0 con 0x7fa3280b3b30 2023-11-28T11:59:58.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.981+0000 7fa32d7d2700 1 -- 172.21.15.39:0/3586863538 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3280b1f00 con 0x7fa3280b3b30 2023-11-28T11:59:58.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.981+0000 7fa32d7d2700 1 -- 172.21.15.39:0/3586863538 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3280cb650 con 0x7fa3280b3b30 2023-11-28T11:59:58.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.985+0000 7fa32d7d2700 1 -- 172.21.15.39:0/3586863538 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3280b2090 con 0x7fa3280b3b30 2023-11-28T11:59:58.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.985+0000 7fa3257fa700 1 -- 172.21.15.39:0/3586863538 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa310019030 con 0x7fa3280b3b30 2023-11-28T11:59:58.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.989+0000 7fa3257fa700 1 --2- 172.21.15.39:0/3586863538 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa308064ee0 0x7fa308067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:58.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.989+0000 7fa3257fa700 1 -- 172.21.15.39:0/3586863538 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa310081f30 con 0x7fa3280b3b30 2023-11-28T11:59:58.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.989+0000 7fa327fff700 1 --2- 172.21.15.39:0/3586863538 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa308064ee0 0x7fa308067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:58.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.989+0000 7fa327fff700 1 --2- 172.21.15.39:0/3586863538 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa308064ee0 0x7fa308067390 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa318000fb0 tx=0x7fa318009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:58.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:58.993+0000 7fa3257fa700 1 -- 172.21.15.39:0/3586863538 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa31004ff90 con 0x7fa3280b3b30 2023-11-28T11:59:59.188 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.181+0000 7fa32d7d2700 1 -- 172.21.15.39:0/3586863538 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa328073cb0 con 0x7fa3280b3b30 2023-11-28T11:59:59.188 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.185+0000 7fa3257fa700 1 -- 172.21.15.39:0/3586863538 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v70) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa3100535b0 con 0x7fa3280b3b30 2023-11-28T11:59:59.192 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.185+0000 7fa32d7d2700 1 -- 172.21.15.39:0/3586863538 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa308064ee0 msgr2=0x7fa308067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:59.192 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.185+0000 7fa32d7d2700 1 --2- 172.21.15.39:0/3586863538 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa308064ee0 0x7fa308067390 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa318000fb0 tx=0x7fa318009040 comp rx=0 tx=0).stop 2023-11-28T11:59:59.192 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.185+0000 7fa32d7d2700 1 -- 172.21.15.39:0/3586863538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3280b3b30 msgr2=0x7fa3280c9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:59.192 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.185+0000 7fa32d7d2700 1 --2- 172.21.15.39:0/3586863538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3280b3b30 0x7fa3280c9eb0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fa31000e9d0 tx=0x7fa31000ece0 comp rx=0 tx=0).stop 2023-11-28T11:59:59.192 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.185+0000 7fa32d7d2700 1 -- 172.21.15.39:0/3586863538 shutdown_connections 2023-11-28T11:59:59.192 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.185+0000 7fa32d7d2700 1 --2- 172.21.15.39:0/3586863538 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fa308064ee0 0x7fa308067390 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:59.192 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.185+0000 7fa32d7d2700 1 --2- 172.21.15.39:0/3586863538 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3280cca20 0x7fa3280ca3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:59.193 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.185+0000 7fa32d7d2700 1 --2- 172.21.15.39:0/3586863538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3280b3b30 0x7fa3280c9eb0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:59.193 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.185+0000 7fa32d7d2700 1 --2- 172.21.15.39:0/3586863538 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3280b1b30 0x7fa328151df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:59.193 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.185+0000 7fa32d7d2700 1 -- 172.21.15.39:0/3586863538 >> 172.21.15.39:0/3586863538 conn(0x7fa328099af0 msgr2=0x7fa32806f810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:59.193 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.185+0000 7fa32d7d2700 1 -- 172.21.15.39:0/3586863538 shutdown_connections 2023-11-28T11:59:59.193 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.185+0000 7fa32d7d2700 1 -- 172.21.15.39:0/3586863538 wait complete. 2023-11-28T11:59:59.195 INFO:teuthology.orchestra.run.smithi039.stderr:listed 0 entries 2023-11-28T11:59:59.214 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-28T11:59:59.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:59:59.214 DEBUG:teuthology.orchestra.run.smithi039:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-28T11:59:59.285 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi039.front.sepia.ceph.com 2023-11-28T11:59:59.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:59:59.285 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T11:59:59.301 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:59:59.301 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:59:59.318 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352324k,nr_inodes=4088081,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9254 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T11:59:59.318 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T11:59:59.318 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:59:59.361 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352324k,nr_inodes=4088081,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6229 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T11:59:59.361 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T11:59:59.362 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:59:59.381 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352324k,nr_inodes=4088081,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9254 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T11:59:59.381 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:59:59.592 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.585+0000 7f6f7e93e700 1 Processor -- start 2023-11-28T11:59:59.593 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.589+0000 7f6f7e93e700 1 -- start start 2023-11-28T11:59:59.596 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.589+0000 7f6f7e93e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f78070080 0x7f6f780704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:59.596 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.589+0000 7f6f7e93e700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f780ad6c0 con 0x7f6f78164250 2023-11-28T11:59:59.596 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.589+0000 7f6f7e93e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f780adc60 con 0x7f6f78160710 2023-11-28T11:59:59.596 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.589+0000 7f6f7e93e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7806b1c0 con 0x7f6f78070080 2023-11-28T11:59:59.597 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.593+0000 7f6f7e13d700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f6f78164250 0x7f6f781646d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42636/0 (socket says 172.21.15.39:42636) 2023-11-28T11:59:59.597 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.593+0000 7f6f7e13d700 1 -- 172.21.15.39:0/3760479614 learned_addr learned my addr 172.21.15.39:0/3760479614 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T11:59:59.597 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.593+0000 7f6f7d13b700 1 --2- 172.21.15.39:0/3760479614 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f78070080 0x7f6f780704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:59.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.593+0000 7f6f7c93a700 1 -- 172.21.15.39:0/3760479614 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2946368139 0 0) 0x7f6f780ad6c0 con 0x7f6f78164250 2023-11-28T11:59:59.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.593+0000 7f6f7c93a700 1 -- 172.21.15.39:0/3760479614 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f640035d0 con 0x7f6f78164250 2023-11-28T11:59:59.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.593+0000 7f6f7c93a700 1 -- 172.21.15.39:0/3760479614 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4207416315 0 0) 0x7f6f640035d0 con 0x7f6f78164250 2023-11-28T11:59:59.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.593+0000 7f6f7c93a700 1 -- 172.21.15.39:0/3760479614 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f78070080 msgr2=0x7f6f780704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:59.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.593+0000 7f6f7c93a700 1 --2- 172.21.15.39:0/3760479614 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f78070080 0x7f6f780704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:59.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.593+0000 7f6f7c93a700 1 -- 172.21.15.39:0/3760479614 >> v1:172.21.15.184:6789/0 conn(0x7f6f78160710 legacy=0x7f6f780cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:59.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.593+0000 7f6f7c93a700 1 -- 172.21.15.39:0/3760479614 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f780709f0 con 0x7f6f78164250 2023-11-28T11:59:59.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.593+0000 7f6f7c93a700 1 -- 172.21.15.39:0/3760479614 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4013383302 0 0) 0x7f6f700019f0 con 0x7f6f78164250 2023-11-28T11:59:59.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.593+0000 7f6f7c93a700 1 -- 172.21.15.39:0/3760479614 >> v1:172.21.15.39:6789/0 conn(0x7f6f78164250 legacy=0x7f6f781646d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:59.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.593+0000 7f6f7c93a700 1 --2- 172.21.15.39:0/3760479614 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f64003a50 0x7f6f64003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:59.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.593+0000 7f6f7c93a700 1 --2- 172.21.15.39:0/3760479614 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f640043f0 0x7f6f640048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:59.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.593+0000 7f6f7c93a700 1 --2- 172.21.15.39:0/3760479614 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f78070080 0x7f6f64005110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:59.600 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.593+0000 7f6f7c93a700 1 -- 172.21.15.39:0/3760479614 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7806b1c0 con 0x7f6f64003a50 2023-11-28T11:59:59.600 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.593+0000 7f6f7c93a700 1 -- 172.21.15.39:0/3760479614 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6400ba30 con 0x7f6f640043f0 2023-11-28T11:59:59.600 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.593+0000 7f6f7c93a700 1 -- 172.21.15.39:0/3760479614 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6400bbc0 con 0x7f6f78070080 2023-11-28T11:59:59.600 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.593+0000 7f6f7d93c700 1 --2- 172.21.15.39:0/3760479614 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f64003a50 0x7f6f64003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:59.600 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.593+0000 7f6f7e13d700 1 --2- 172.21.15.39:0/3760479614 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f78070080 0x7f6f64005110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:59.600 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.593+0000 7f6f7d13b700 1 --2- 172.21.15.39:0/3760479614 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f640043f0 0x7f6f640048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:59.601 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.593+0000 7f6f7d93c700 1 -- 172.21.15.39:0/3760479614 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f78070080 msgr2=0x7f6f64005110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:59.601 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.593+0000 7f6f7d93c700 1 --2- 172.21.15.39:0/3760479614 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f78070080 0x7f6f64005110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:59.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.593+0000 7f6f7d93c700 1 -- 172.21.15.39:0/3760479614 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f640043f0 msgr2=0x7f6f640048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:59.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.593+0000 7f6f7d93c700 1 --2- 172.21.15.39:0/3760479614 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f640043f0 0x7f6f640048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:59.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.593+0000 7f6f7d93c700 1 -- 172.21.15.39:0/3760479614 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f640035d0 con 0x7f6f64003a50 2023-11-28T11:59:59.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.593+0000 7f6f7d13b700 1 --2- 172.21.15.39:0/3760479614 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f640043f0 0x7f6f640048b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:59.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.593+0000 7f6f7d93c700 1 --2- 172.21.15.39:0/3760479614 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f64003a50 0x7f6f64003e20 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f6f740019a0 tx=0x7f6f640058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a77da016333e415a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:59.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.597+0000 7f6f7c93a700 1 -- 172.21.15.39:0/3760479614 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f74016070 con 0x7f6f64003a50 2023-11-28T11:59:59.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.597+0000 7f6f7c93a700 1 -- 172.21.15.39:0/3760479614 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f74006880 con 0x7f6f64003a50 2023-11-28T11:59:59.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.597+0000 7f6f7c93a700 1 -- 172.21.15.39:0/3760479614 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f74001440 con 0x7f6f64003a50 2023-11-28T11:59:59.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.597+0000 7f6f7e93e700 1 -- 172.21.15.39:0/3760479614 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f64003a50 msgr2=0x7f6f64003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:59.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.597+0000 7f6f7e93e700 1 --2- 172.21.15.39:0/3760479614 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f64003a50 0x7f6f64003e20 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f6f740019a0 tx=0x7f6f640058a0 comp rx=0 tx=0).stop 2023-11-28T11:59:59.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.597+0000 7f6f7e13d700 1 -- 172.21.15.39:0/3760479614 reap_dead start 2023-11-28T11:59:59.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.597+0000 7f6f7e93e700 1 -- 172.21.15.39:0/3760479614 shutdown_connections 2023-11-28T11:59:59.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.597+0000 7f6f7e93e700 1 -- 172.21.15.39:0/3760479614 >> 172.21.15.39:0/3760479614 conn(0x7f6f780b0f80 msgr2=0x7f6f780ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:59.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.597+0000 7f6f7e93e700 1 -- 172.21.15.39:0/3760479614 shutdown_connections 2023-11-28T11:59:59.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.597+0000 7f6f7e93e700 1 -- 172.21.15.39:0/3760479614 wait complete. 2023-11-28T11:59:59.604 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.601+0000 7f6f7e93e700 1 Processor -- start 2023-11-28T11:59:59.605 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.601+0000 7f6f7e93e700 1 -- start start 2023-11-28T11:59:59.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.601+0000 7f6f7e93e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f64003a50 0x7f6f7815f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:59.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.601+0000 7f6f7e93e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f78162da0 0x7f6f780af760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:59.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.601+0000 7f6f7e93e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f781588f0 0x7f6f78158d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:59.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.601+0000 7f6f7e93e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7815c1b0 con 0x7f6f78162da0 2023-11-28T11:59:59.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.601+0000 7f6f7e93e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f781f6180 con 0x7f6f64003a50 2023-11-28T11:59:59.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.601+0000 7f6f7e93e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f781592b0 con 0x7f6f781588f0 2023-11-28T11:59:59.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.601+0000 7f6f7d13b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f78162da0 0x7f6f780af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:59.608 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.601+0000 7f6f7d13b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f78162da0 0x7f6f780af760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55590/0 (socket says 172.21.15.39:55590) 2023-11-28T11:59:59.608 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.601+0000 7f6f7d13b700 1 -- 172.21.15.39:0/2742466153 learned_addr learned my addr 172.21.15.39:0/2742466153 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T11:59:59.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.601+0000 7f6f7d93c700 1 --2- 172.21.15.39:0/2742466153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f64003a50 0x7f6f7815f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:59.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.601+0000 7f6f7e13d700 1 --2- 172.21.15.39:0/2742466153 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f781588f0 0x7f6f78158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:59.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.601+0000 7f6f7d13b700 1 -- 172.21.15.39:0/2742466153 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f781588f0 msgr2=0x7f6f78158d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:59.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.601+0000 7f6f7d13b700 1 --2- 172.21.15.39:0/2742466153 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f781588f0 0x7f6f78158d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:59.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.601+0000 7f6f7d13b700 1 -- 172.21.15.39:0/2742466153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f64003a50 msgr2=0x7f6f7815f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:59.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.601+0000 7f6f7d13b700 1 --2- 172.21.15.39:0/2742466153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f64003a50 0x7f6f7815f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:59.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.601+0000 7f6f7d13b700 1 -- 172.21.15.39:0/2742466153 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7806b3d0 con 0x7f6f78162da0 2023-11-28T11:59:59.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.605+0000 7f6f7d13b700 1 --2- 172.21.15.39:0/2742466153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f78162da0 0x7f6f780af760 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f6f680108c0 tx=0x7f6f68010bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:59.610 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.605+0000 7f6f6e7fc700 1 -- 172.21.15.39:0/2742466153 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f68004020 con 0x7f6f78162da0 2023-11-28T11:59:59.610 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.605+0000 7f6f6e7fc700 1 -- 172.21.15.39:0/2742466153 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f68004180 con 0x7f6f78162da0 2023-11-28T11:59:59.610 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.605+0000 7f6f7e93e700 1 -- 172.21.15.39:0/2742466153 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f780cca30 con 0x7f6f78162da0 2023-11-28T11:59:59.610 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.605+0000 7f6f6e7fc700 1 -- 172.21.15.39:0/2742466153 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f68004530 con 0x7f6f78162da0 2023-11-28T11:59:59.610 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.605+0000 7f6f7e93e700 1 -- 172.21.15.39:0/2742466153 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f7806b6b0 con 0x7f6f78162da0 2023-11-28T11:59:59.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.605+0000 7f6f7e93e700 1 -- 172.21.15.39:0/2742466153 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f7815c2f0 con 0x7f6f78162da0 2023-11-28T11:59:59.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.609+0000 7f6f6e7fc700 1 -- 172.21.15.39:0/2742466153 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6f680036c0 con 0x7f6f78162da0 2023-11-28T11:59:59.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.609+0000 7f6f6e7fc700 1 --2- 172.21.15.39:0/2742466153 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6f5c064f10 0x7f6f5c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:59.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.609+0000 7f6f6e7fc700 1 -- 172.21.15.39:0/2742466153 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6f68081f40 con 0x7f6f78162da0 2023-11-28T11:59:59.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.609+0000 7f6f7d93c700 1 --2- 172.21.15.39:0/2742466153 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6f5c064f10 0x7f6f5c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:59.616 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.609+0000 7f6f7d93c700 1 --2- 172.21.15.39:0/2742466153 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6f5c064f10 0x7f6f5c0673c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f6f740018f0 tx=0x7f6f74009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:59.619 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.613+0000 7f6f6e7fc700 1 -- 172.21.15.39:0/2742466153 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6f680b2400 con 0x7f6f78162da0 2023-11-28T11:59:59.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.821+0000 7f6f7e93e700 1 -- 172.21.15.39:0/2742466153 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f78073cb0 con 0x7f6f78162da0 2023-11-28T11:59:59.833 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.829+0000 7f6f6e7fc700 1 -- 172.21.15.39:0/2742466153 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4653 (secure 0 0 0) 0x7f6f7815c2f0 con 0x7f6f78162da0 2023-11-28T11:59:59.833 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T11:59:59.833 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5645,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/3875262459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3875262459},{"type":"v1","addr":"172.21.15.184:6835","nonce":3875262459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5648,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/3845363738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3845363738},{"type":"v1","addr":"172.21.15.184:6837","nonce":3845363738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6225,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6834/2646905389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6833","nonce":2646905389},{"type":"v1","addr":"172.21.15.39:6834","nonce":2646905389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:59:45.290110+0000","modified":"2023-11-28T11:59:57.792347+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6244":{"gid":6244,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6835/990492858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":990492858},{"type":"v1","addr":"172.21.15.39:6835","nonce":990492858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T11:59:59.836 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.829+0000 7f6f7e93e700 1 -- 172.21.15.39:0/2742466153 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6f5c064f10 msgr2=0x7f6f5c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:59.837 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.829+0000 7f6f7e93e700 1 --2- 172.21.15.39:0/2742466153 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6f5c064f10 0x7f6f5c0673c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f6f740018f0 tx=0x7f6f74009030 comp rx=0 tx=0).stop 2023-11-28T11:59:59.837 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.829+0000 7f6f7e93e700 1 -- 172.21.15.39:0/2742466153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f78162da0 msgr2=0x7f6f780af760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:59.837 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.829+0000 7f6f7e93e700 1 --2- 172.21.15.39:0/2742466153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f78162da0 0x7f6f780af760 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f6f680108c0 tx=0x7f6f68010bd0 comp rx=0 tx=0).stop 2023-11-28T11:59:59.837 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.833+0000 7f6f7e93e700 1 -- 172.21.15.39:0/2742466153 shutdown_connections 2023-11-28T11:59:59.837 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.833+0000 7f6f7e93e700 1 --2- 172.21.15.39:0/2742466153 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f781588f0 0x7f6f78158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:59.837 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.833+0000 7f6f7e93e700 1 --2- 172.21.15.39:0/2742466153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f78162da0 0x7f6f780af760 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:59.837 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.833+0000 7f6f7e93e700 1 --2- 172.21.15.39:0/2742466153 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6f5c064f10 0x7f6f5c0673c0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:59.837 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.833+0000 7f6f7e93e700 1 --2- 172.21.15.39:0/2742466153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f64003a50 0x7f6f7815f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:59.837 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.833+0000 7f6f7e93e700 1 -- 172.21.15.39:0/2742466153 >> 172.21.15.39:0/2742466153 conn(0x7f6f780b0f80 msgr2=0x7f6f7815ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:59.837 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.833+0000 7f6f7e93e700 1 -- 172.21.15.39:0/2742466153 shutdown_connections 2023-11-28T11:59:59.837 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T11:59:59.833+0000 7f6f7e93e700 1 -- 172.21.15.39:0/2742466153 wait complete. 2023-11-28T11:59:59.838 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 33 2023-11-28T11:59:59.857 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:00:00.000 INFO:tasks.ceph.mon.a.smithi039.stderr:2023-11-28T11:59:59.997+0000 7ff4e35f9700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 MDSs report damaged metadata 2023-11-28T12:00:00.036 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.033+0000 7f19cd825700 1 Processor -- start 2023-11-28T12:00:00.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.033+0000 7f19cd825700 1 -- start start 2023-11-28T12:00:00.038 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.033+0000 7f19cd825700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f19c815c640 0x7f19c80d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:00.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.033+0000 7f19cd825700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19c8069e00 0x7f19c806a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:00.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.033+0000 7f19cd825700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c806c600 con 0x7f19c8071aa0 2023-11-28T12:00:00.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.033+0000 7f19cd825700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19c806cef0 con 0x7f19c815c640 2023-11-28T12:00:00.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.033+0000 7f19cd825700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c806a7c0 con 0x7f19c8069e00 2023-11-28T12:00:00.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.033+0000 7f19c67fc700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f19c8071aa0 0x7f19c806d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42644/0 (socket says 172.21.15.39:42644) 2023-11-28T12:00:00.040 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.033+0000 7f19c6ffd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f19c815c640 0x7f19c80d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:00.040 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.033+0000 7f19c67fc700 1 -- 172.21.15.39:0/1911586715 learned_addr learned my addr 172.21.15.39:0/1911586715 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T12:00:00.040 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.033+0000 7f19c77fe700 1 --2- 172.21.15.39:0/1911586715 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19c8069e00 0x7f19c806a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:00.040 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.033+0000 7f19c6ffd700 1 -- 172.21.15.39:0/1911586715 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19c8069e00 msgr2=0x7f19c806a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:00.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.033+0000 7f19c6ffd700 1 --2- 172.21.15.39:0/1911586715 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19c8069e00 0x7f19c806a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:00.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.033+0000 7f19c6ffd700 1 -- 172.21.15.39:0/1911586715 >> v1:172.21.15.39:6789/0 conn(0x7f19c8071aa0 legacy=0x7f19c806d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:00.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.033+0000 7f19c5ffb700 1 -- 172.21.15.39:0/1911586715 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4230067831 0 0) 0x7f19c806c600 con 0x7f19c8071aa0 2023-11-28T12:00:00.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.033+0000 7f19c6ffd700 1 -- 172.21.15.39:0/1911586715 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c80722f0 con 0x7f19c815c640 2023-11-28T12:00:00.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.037+0000 7f19c6ffd700 1 --2- 172.21.15.39:0/1911586715 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19c815c640 0x7f19c80d31e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f19b8009850 tx=0x7f19b8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2619a15620f84f3d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:00.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.037+0000 7f19c5ffb700 1 -- 172.21.15.39:0/1911586715 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b8011830 con 0x7f19c815c640 2023-11-28T12:00:00.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.037+0000 7f19c5ffb700 1 -- 172.21.15.39:0/1911586715 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b8011990 con 0x7f19c815c640 2023-11-28T12:00:00.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.037+0000 7f19c5ffb700 1 -- 172.21.15.39:0/1911586715 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b8011d40 con 0x7f19c815c640 2023-11-28T12:00:00.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.037+0000 7f19cd825700 1 -- 172.21.15.39:0/1911586715 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19c815c640 msgr2=0x7f19c80d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:00.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.037+0000 7f19cd825700 1 --2- 172.21.15.39:0/1911586715 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19c815c640 0x7f19c80d31e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f19b8009850 tx=0x7f19b8009b60 comp rx=0 tx=0).stop 2023-11-28T12:00:00.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.037+0000 7f19cd825700 1 -- 172.21.15.39:0/1911586715 shutdown_connections 2023-11-28T12:00:00.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.037+0000 7f19cd825700 1 --2- 172.21.15.39:0/1911586715 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19c8069e00 0x7f19c806a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:00.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.037+0000 7f19cd825700 1 --2- 172.21.15.39:0/1911586715 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19c815c640 0x7f19c80d31e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:00.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.037+0000 7f19cd825700 1 -- 172.21.15.39:0/1911586715 >> 172.21.15.39:0/1911586715 conn(0x7f19c80b6520 msgr2=0x7f19c8071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:00.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.037+0000 7f19cd825700 1 -- 172.21.15.39:0/1911586715 shutdown_connections 2023-11-28T12:00:00.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.037+0000 7f19cd825700 1 -- 172.21.15.39:0/1911586715 wait complete. 2023-11-28T12:00:00.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.041+0000 7f19cd825700 1 Processor -- start 2023-11-28T12:00:00.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.041+0000 7f19cd825700 1 -- start start 2023-11-28T12:00:00.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.041+0000 7f19cd825700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19c8069e00 0x7f19c81f4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:00.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.041+0000 7f19cd825700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19c8071aa0 0x7f19c815e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:00.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.041+0000 7f19cd825700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19c815c640 0x7f19c80c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:00.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.041+0000 7f19cd825700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c815dca0 con 0x7f19c8069e00 2023-11-28T12:00:00.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.041+0000 7f19cd825700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c80cb980 con 0x7f19c8071aa0 2023-11-28T12:00:00.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.041+0000 7f19cd825700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c81f4db0 con 0x7f19c815c640 2023-11-28T12:00:00.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.041+0000 7f19c6ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19c8069e00 0x7f19c81f4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:00.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.041+0000 7f19c6ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19c8069e00 0x7f19c81f4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55596/0 (socket says 172.21.15.39:55596) 2023-11-28T12:00:00.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.041+0000 7f19c6ffd700 1 -- 172.21.15.39:0/4073092052 learned_addr learned my addr 172.21.15.39:0/4073092052 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:00.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.041+0000 7f19c77fe700 1 --2- 172.21.15.39:0/4073092052 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19c815c640 0x7f19c80c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:00.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.041+0000 7f19c67fc700 1 --2- 172.21.15.39:0/4073092052 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19c8071aa0 0x7f19c815e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:00.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.041+0000 7f19c6ffd700 1 -- 172.21.15.39:0/4073092052 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19c815c640 msgr2=0x7f19c80c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:00.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.041+0000 7f19c6ffd700 1 --2- 172.21.15.39:0/4073092052 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19c815c640 0x7f19c80c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:00.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.041+0000 7f19c6ffd700 1 -- 172.21.15.39:0/4073092052 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19c8071aa0 msgr2=0x7f19c815e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:00.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.041+0000 7f19c6ffd700 1 --2- 172.21.15.39:0/4073092052 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19c8071aa0 0x7f19c815e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:00.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.041+0000 7f19c6ffd700 1 -- 172.21.15.39:0/4073092052 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b80094b0 con 0x7f19c8069e00 2023-11-28T12:00:00.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.041+0000 7f19c6ffd700 1 --2- 172.21.15.39:0/4073092052 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19c8069e00 0x7f19c81f4870 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f19b8000c00 tx=0x7f19b8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:00.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.045+0000 7f19affff700 1 -- 172.21.15.39:0/4073092052 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b801a840 con 0x7f19c8069e00 2023-11-28T12:00:00.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.045+0000 7f19affff700 1 -- 172.21.15.39:0/4073092052 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b801f070 con 0x7f19c8069e00 2023-11-28T12:00:00.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.045+0000 7f19affff700 1 -- 172.21.15.39:0/4073092052 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b801abe0 con 0x7f19c8069e00 2023-11-28T12:00:00.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.045+0000 7f19cd825700 1 -- 172.21.15.39:0/4073092052 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c815ca10 con 0x7f19c8069e00 2023-11-28T12:00:00.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.045+0000 7f19cd825700 1 -- 172.21.15.39:0/4073092052 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c806da20 con 0x7f19c8069e00 2023-11-28T12:00:00.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.045+0000 7f19cd825700 1 -- 172.21.15.39:0/4073092052 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c8072010 con 0x7f19c8069e00 2023-11-28T12:00:00.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.049+0000 7f19affff700 1 -- 172.21.15.39:0/4073092052 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f19b802d070 con 0x7f19c8069e00 2023-11-28T12:00:00.054 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.049+0000 7f19affff700 1 --2- 172.21.15.39:0/4073092052 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f19b4064f10 0x7f19b40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:00.054 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.049+0000 7f19affff700 1 -- 172.21.15.39:0/4073092052 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f19b8021070 con 0x7f19c8069e00 2023-11-28T12:00:00.055 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.049+0000 7f19c67fc700 1 --2- 172.21.15.39:0/4073092052 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f19b4064f10 0x7f19b40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:00.056 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.049+0000 7f19c67fc700 1 --2- 172.21.15.39:0/4073092052 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f19b4064f10 0x7f19b40673c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f19c815b170 tx=0x7f19bc007e00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:00.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.057+0000 7f19affff700 1 -- 172.21.15.39:0/4073092052 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f19b8051460 con 0x7f19c8069e00 2023-11-28T12:00:00.211 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:00:00.217 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:00:00.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.233+0000 7f19cd825700 1 -- 172.21.15.39:0/4073092052 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19c8073cb0 con 0x7f19c8069e00 2023-11-28T12:00:00.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.237+0000 7f19affff700 1 -- 172.21.15.39:0/4073092052 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+18087 (secure 0 0 0) 0x7f19b8015090 con 0x7f19c8069e00 2023-11-28T12:00:00.243 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T12:00:00.243 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":70,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:59:46.296300+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:59:43.752184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-28T11:59:44.294885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:00:00.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.241+0000 7f19cd825700 1 -- 172.21.15.39:0/4073092052 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f19b4064f10 msgr2=0x7f19b40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:00.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.241+0000 7f19cd825700 1 --2- 172.21.15.39:0/4073092052 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f19b4064f10 0x7f19b40673c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f19c815b170 tx=0x7f19bc007e00 comp rx=0 tx=0).stop 2023-11-28T12:00:00.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.241+0000 7f19cd825700 1 -- 172.21.15.39:0/4073092052 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19c8069e00 msgr2=0x7f19c81f4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:00.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.241+0000 7f19cd825700 1 --2- 172.21.15.39:0/4073092052 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19c8069e00 0x7f19c81f4870 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f19b8000c00 tx=0x7f19b8004770 comp rx=0 tx=0).stop 2023-11-28T12:00:00.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.241+0000 7f19cd825700 1 -- 172.21.15.39:0/4073092052 shutdown_connections 2023-11-28T12:00:00.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.241+0000 7f19cd825700 1 --2- 172.21.15.39:0/4073092052 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19c815c640 0x7f19c80c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:00.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.241+0000 7f19cd825700 1 --2- 172.21.15.39:0/4073092052 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f19b4064f10 0x7f19b40673c0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:00.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.241+0000 7f19cd825700 1 --2- 172.21.15.39:0/4073092052 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19c8071aa0 0x7f19c815e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:00.247 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.241+0000 7f19cd825700 1 --2- 172.21.15.39:0/4073092052 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19c8069e00 0x7f19c81f4870 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:00.247 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.241+0000 7f19cd825700 1 -- 172.21.15.39:0/4073092052 >> 172.21.15.39:0/4073092052 conn(0x7f19c80b6520 msgr2=0x7f19c806d160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:00.247 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.241+0000 7f19cd825700 1 -- 172.21.15.39:0/4073092052 shutdown_connections 2023-11-28T12:00:00.247 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.241+0000 7f19cd825700 1 -- 172.21.15.39:0/4073092052 wait complete. 2023-11-28T12:00:00.267 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:56:26.631457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:56:33.242202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:59:43.752184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:59:44.294885+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T12:00:00.268 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T12:00:00.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.509+0000 7fab1f59e700 1 Processor -- start 2023-11-28T12:00:00.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.509+0000 7fab1f59e700 1 -- start start 2023-11-28T12:00:00.515 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.509+0000 7fab1f59e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fab20159f10 0x7fab20070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:00.515 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.509+0000 7fab1f59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab2015a9f0 0x7fab2006b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:00.515 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.509+0000 7fab1f59e700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab20070600 con 0x7fab200c8c90 2023-11-28T12:00:00.515 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.509+0000 7fab1f59e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab200c9130 con 0x7fab20159f10 2023-11-28T12:00:00.515 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.509+0000 7fab1f59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab2006b840 con 0x7fab2015a9f0 2023-11-28T12:00:00.516 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.509+0000 7fab1dd9b700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fab200c8c90 0x7fab2015a2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42646/0 (socket says 172.21.15.39:42646) 2023-11-28T12:00:00.516 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.509+0000 7fab1dd9b700 1 -- 172.21.15.39:0/191089564 learned_addr learned my addr 172.21.15.39:0/191089564 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T12:00:00.516 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.509+0000 7fab1ed9d700 1 --2- 172.21.15.39:0/191089564 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab2015a9f0 0x7fab2006b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:00.516 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.509+0000 7fab1e59c700 1 --2- 172.21.15.39:0/191089564 >> v2:172.21.15.184:3300/0 conn(0x7fab20159f10 0x7fab20070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:00.517 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.513+0000 7fab1d59a700 1 -- 172.21.15.39:0/191089564 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3837244479 0 0) 0x7fab20070600 con 0x7fab200c8c90 2023-11-28T12:00:00.517 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.513+0000 7fab1d59a700 1 -- 172.21.15.39:0/191089564 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab080035d0 con 0x7fab200c8c90 2023-11-28T12:00:00.517 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.513+0000 7fab1ed9d700 1 -- 172.21.15.39:0/191089564 >> v2:172.21.15.184:3300/0 conn(0x7fab20159f10 msgr2=0x7fab20070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:00.517 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.513+0000 7fab1ed9d700 1 --2- 172.21.15.39:0/191089564 >> v2:172.21.15.184:3300/0 conn(0x7fab20159f10 0x7fab20070a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:00.517 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.513+0000 7fab1ed9d700 1 -- 172.21.15.39:0/191089564 >> v1:172.21.15.39:6789/0 conn(0x7fab200c8c90 legacy=0x7fab2015a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:00.517 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.513+0000 7fab1ed9d700 1 -- 172.21.15.39:0/191089564 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab2015ae10 con 0x7fab2015a9f0 2023-11-28T12:00:00.518 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.513+0000 7fab1ed9d700 1 --2- 172.21.15.39:0/191089564 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab2015a9f0 0x7fab2006b300 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fab18009850 tx=0x7fab18009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=347ccb9808425b13 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:00.518 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.513+0000 7fab1d59a700 1 -- 172.21.15.39:0/191089564 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab18011830 con 0x7fab2015a9f0 2023-11-28T12:00:00.518 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.513+0000 7fab1d59a700 1 -- 172.21.15.39:0/191089564 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab18011990 con 0x7fab2015a9f0 2023-11-28T12:00:00.519 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.513+0000 7fab1d59a700 1 -- 172.21.15.39:0/191089564 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab18011d40 con 0x7fab2015a9f0 2023-11-28T12:00:00.519 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.513+0000 7fab1f59e700 1 -- 172.21.15.39:0/191089564 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab2015a9f0 msgr2=0x7fab2006b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:00.519 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.513+0000 7fab1f59e700 1 --2- 172.21.15.39:0/191089564 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab2015a9f0 0x7fab2006b300 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fab18009850 tx=0x7fab18009b60 comp rx=0 tx=0).stop 2023-11-28T12:00:00.520 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.513+0000 7fab1f59e700 1 -- 172.21.15.39:0/191089564 shutdown_connections 2023-11-28T12:00:00.520 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.513+0000 7fab1f59e700 1 --2- 172.21.15.39:0/191089564 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab2015a9f0 0x7fab2006b300 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:00.520 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.513+0000 7fab1f59e700 1 --2- 172.21.15.39:0/191089564 >> v2:172.21.15.184:3300/0 conn(0x7fab20159f10 0x7fab20070a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:00.520 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.513+0000 7fab1f59e700 1 -- 172.21.15.39:0/191089564 >> 172.21.15.39:0/191089564 conn(0x7fab200cf280 msgr2=0x7fab200cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:00.520 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.513+0000 7fab1f59e700 1 -- 172.21.15.39:0/191089564 shutdown_connections 2023-11-28T12:00:00.520 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.513+0000 7fab1f59e700 1 -- 172.21.15.39:0/191089564 wait complete. 2023-11-28T12:00:00.523 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.517+0000 7fab1f59e700 1 Processor -- start 2023-11-28T12:00:00.523 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.517+0000 7fab1f59e700 1 -- start start 2023-11-28T12:00:00.525 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.521+0000 7fab1f59e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab200c8c90 0x7fab2015d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:00.525 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.521+0000 7fab1f59e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab20159f10 0x7fab2015be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:00.525 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.521+0000 7fab1f59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab2015a9f0 0x7fab200aff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:00.525 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.521+0000 7fab1f59e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab201f13e0 con 0x7fab200c8c90 2023-11-28T12:00:00.525 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.521+0000 7fab1f59e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab201541d0 con 0x7fab20159f10 2023-11-28T12:00:00.525 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.521+0000 7fab1f59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab201544b0 con 0x7fab2015a9f0 2023-11-28T12:00:00.526 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.521+0000 7fab1e59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab200c8c90 0x7fab2015d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:00.526 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.521+0000 7fab1e59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab200c8c90 0x7fab2015d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55600/0 (socket says 172.21.15.39:55600) 2023-11-28T12:00:00.527 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.521+0000 7fab1e59c700 1 -- 172.21.15.39:0/2234878695 learned_addr learned my addr 172.21.15.39:0/2234878695 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:00.527 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.521+0000 7fab1ed9d700 1 --2- 172.21.15.39:0/2234878695 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab2015a9f0 0x7fab200aff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:00.527 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.521+0000 7fab1dd9b700 1 --2- 172.21.15.39:0/2234878695 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab20159f10 0x7fab2015be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:00.527 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.521+0000 7fab1e59c700 1 -- 172.21.15.39:0/2234878695 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab2015a9f0 msgr2=0x7fab200aff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:00.527 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.521+0000 7fab1e59c700 1 --2- 172.21.15.39:0/2234878695 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab2015a9f0 0x7fab200aff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:00.527 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.521+0000 7fab1e59c700 1 -- 172.21.15.39:0/2234878695 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab20159f10 msgr2=0x7fab2015be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:00.527 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.521+0000 7fab1e59c700 1 --2- 172.21.15.39:0/2234878695 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab20159f10 0x7fab2015be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:00.527 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.521+0000 7fab1e59c700 1 -- 172.21.15.39:0/2234878695 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab180094b0 con 0x7fab200c8c90 2023-11-28T12:00:00.527 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.521+0000 7fab1e59c700 1 --2- 172.21.15.39:0/2234878695 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab200c8c90 0x7fab2015d0c0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fab1000efc0 tx=0x7fab1000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:00.528 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.521+0000 7fab0effd700 1 -- 172.21.15.39:0/2234878695 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1000cd10 con 0x7fab200c8c90 2023-11-28T12:00:00.528 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.521+0000 7fab0effd700 1 -- 172.21.15.39:0/2234878695 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1000f040 con 0x7fab200c8c90 2023-11-28T12:00:00.528 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.521+0000 7fab1f59e700 1 -- 172.21.15.39:0/2234878695 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab2006ffb0 con 0x7fab200c8c90 2023-11-28T12:00:00.528 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.521+0000 7fab0effd700 1 -- 172.21.15.39:0/2234878695 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab100146a0 con 0x7fab200c8c90 2023-11-28T12:00:00.528 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.521+0000 7fab1f59e700 1 -- 172.21.15.39:0/2234878695 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab200afcc0 con 0x7fab200c8c90 2023-11-28T12:00:00.529 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.525+0000 7fab1f59e700 1 -- 172.21.15.39:0/2234878695 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab20070290 con 0x7fab200c8c90 2023-11-28T12:00:00.531 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.525+0000 7fab0effd700 1 -- 172.21.15.39:0/2234878695 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fab10014800 con 0x7fab200c8c90 2023-11-28T12:00:00.533 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.529+0000 7fab0effd700 1 --2- 172.21.15.39:0/2234878695 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fab00064ee0 0x7fab00067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:00.533 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.529+0000 7fab0effd700 1 -- 172.21.15.39:0/2234878695 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fab10082960 con 0x7fab200c8c90 2023-11-28T12:00:00.534 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.529+0000 7fab1dd9b700 1 --2- 172.21.15.39:0/2234878695 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fab00064ee0 0x7fab00067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:00.535 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.529+0000 7fab1dd9b700 1 --2- 172.21.15.39:0/2234878695 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fab00064ee0 0x7fab00067390 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fab2015c930 tx=0x7fab14007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:00.538 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.533+0000 7fab0effd700 1 -- 172.21.15.39:0/2234878695 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fab10050960 con 0x7fab200c8c90 2023-11-28T12:00:00.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.705+0000 7fab1f59e700 1 -- 172.21.15.39:0/2234878695 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fab2006cf30 con 0x7fab200c8c90 2023-11-28T12:00:00.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.705+0000 7fab0effd700 1 -- 172.21.15.39:0/2234878695 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v70) v1 ==== 93+0+10 (secure 0 0 0) 0x7fab10053f80 con 0x7fab200c8c90 2023-11-28T12:00:00.711 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-11-28T12:00:00.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.709+0000 7fab1f59e700 1 -- 172.21.15.39:0/2234878695 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fab00064ee0 msgr2=0x7fab00067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:00.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.709+0000 7fab1f59e700 1 --2- 172.21.15.39:0/2234878695 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fab00064ee0 0x7fab00067390 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fab2015c930 tx=0x7fab14007de0 comp rx=0 tx=0).stop 2023-11-28T12:00:00.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.709+0000 7fab1f59e700 1 -- 172.21.15.39:0/2234878695 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab200c8c90 msgr2=0x7fab2015d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:00.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.709+0000 7fab1f59e700 1 --2- 172.21.15.39:0/2234878695 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab200c8c90 0x7fab2015d0c0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fab1000efc0 tx=0x7fab1000c3a0 comp rx=0 tx=0).stop 2023-11-28T12:00:00.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.709+0000 7fab1f59e700 1 -- 172.21.15.39:0/2234878695 shutdown_connections 2023-11-28T12:00:00.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.709+0000 7fab1f59e700 1 --2- 172.21.15.39:0/2234878695 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab2015a9f0 0x7fab200aff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:00.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.709+0000 7fab1f59e700 1 --2- 172.21.15.39:0/2234878695 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fab00064ee0 0x7fab00067390 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:00.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.709+0000 7fab1f59e700 1 --2- 172.21.15.39:0/2234878695 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab20159f10 0x7fab2015be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:00.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.709+0000 7fab1f59e700 1 --2- 172.21.15.39:0/2234878695 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab200c8c90 0x7fab2015d0c0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:00.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.709+0000 7fab1f59e700 1 -- 172.21.15.39:0/2234878695 >> 172.21.15.39:0/2234878695 conn(0x7fab200cf280 msgr2=0x7fab2014ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:00.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.709+0000 7fab1f59e700 1 -- 172.21.15.39:0/2234878695 shutdown_connections 2023-11-28T12:00:00.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.709+0000 7fab1f59e700 1 -- 172.21.15.39:0/2234878695 wait complete. 2023-11-28T12:00:00.735 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T12:00:00.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.929+0000 7fd7ed8fc700 1 Processor -- start 2023-11-28T12:00:00.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.929+0000 7fd7ed8fc700 1 -- start start 2023-11-28T12:00:00.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.929+0000 7fd7ed8fc700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd7e8070a90 0x7fd7e80c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:00.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.929+0000 7fd7ed8fc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7e815a9f0 0x7fd7e806b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:00.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.929+0000 7fd7ed8fc700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e8070600 con 0x7fd7e8159f10 2023-11-28T12:00:00.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.929+0000 7fd7ed8fc700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e806b840 con 0x7fd7e8070a90 2023-11-28T12:00:00.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.929+0000 7fd7ed8fc700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e815ae10 con 0x7fd7e815a9f0 2023-11-28T12:00:00.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.929+0000 7fd7dffff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd7e8070a90 0x7fd7e80c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:00.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.929+0000 7fd7dffff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd7e8070a90 0x7fd7e80c8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55606/0 (socket says 172.21.15.39:55606) 2023-11-28T12:00:00.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.929+0000 7fd7dffff700 1 -- 172.21.15.39:0/2165739988 learned_addr learned my addr 172.21.15.39:0/2165739988 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:00.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.929+0000 7fd7ec8fa700 1 --1- 172.21.15.39:0/2165739988 >> v1:172.21.15.184:6789/0 conn(0x7fd7e8159f10 0x7fd7e815a2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:47396/0 (socket says 172.21.15.39:47396) 2023-11-28T12:00:00.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.929+0000 7fd7ed0fb700 1 --2- 172.21.15.39:0/2165739988 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7e815a9f0 0x7fd7e806b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:00.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.929+0000 7fd7ed0fb700 1 -- 172.21.15.39:0/2165739988 >> v2:172.21.15.39:3300/0 conn(0x7fd7e8070a90 msgr2=0x7fd7e80c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:00.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.929+0000 7fd7ed0fb700 1 --2- 172.21.15.39:0/2165739988 >> v2:172.21.15.39:3300/0 conn(0x7fd7e8070a90 0x7fd7e80c8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:00.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.929+0000 7fd7ed0fb700 1 -- 172.21.15.39:0/2165739988 >> v1:172.21.15.184:6789/0 conn(0x7fd7e8159f10 legacy=0x7fd7e815a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:00.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.929+0000 7fd7ed0fb700 1 -- 172.21.15.39:0/2165739988 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e80afcc0 con 0x7fd7e815a9f0 2023-11-28T12:00:00.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.933+0000 7fd7ed0fb700 1 --2- 172.21.15.39:0/2165739988 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7e815a9f0 0x7fd7e806b300 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0009d90 tx=0x7fd7e000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c087e0a32f48f6a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:00.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.933+0000 7fd7df7fe700 1 -- 172.21.15.39:0/2165739988 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e000e070 con 0x7fd7e815a9f0 2023-11-28T12:00:00.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.933+0000 7fd7df7fe700 1 -- 172.21.15.39:0/2165739988 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e000bb20 con 0x7fd7e815a9f0 2023-11-28T12:00:00.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.933+0000 7fd7df7fe700 1 -- 172.21.15.39:0/2165739988 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e0012430 con 0x7fd7e815a9f0 2023-11-28T12:00:00.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.933+0000 7fd7ed8fc700 1 -- 172.21.15.39:0/2165739988 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7e815a9f0 msgr2=0x7fd7e806b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:00.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.933+0000 7fd7ed8fc700 1 --2- 172.21.15.39:0/2165739988 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7e815a9f0 0x7fd7e806b300 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0009d90 tx=0x7fd7e000b330 comp rx=0 tx=0).stop 2023-11-28T12:00:00.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.933+0000 7fd7ed8fc700 1 -- 172.21.15.39:0/2165739988 shutdown_connections 2023-11-28T12:00:00.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.933+0000 7fd7ed8fc700 1 --2- 172.21.15.39:0/2165739988 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7e815a9f0 0x7fd7e806b300 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:00.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.933+0000 7fd7ed8fc700 1 --2- 172.21.15.39:0/2165739988 >> v2:172.21.15.39:3300/0 conn(0x7fd7e8070a90 0x7fd7e80c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:00.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.933+0000 7fd7ed8fc700 1 -- 172.21.15.39:0/2165739988 >> 172.21.15.39:0/2165739988 conn(0x7fd7e80cf280 msgr2=0x7fd7e80cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:00.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.933+0000 7fd7ed8fc700 1 -- 172.21.15.39:0/2165739988 shutdown_connections 2023-11-28T12:00:00.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.933+0000 7fd7ed8fc700 1 -- 172.21.15.39:0/2165739988 wait complete. 2023-11-28T12:00:00.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.937+0000 7fd7ed8fc700 1 Processor -- start 2023-11-28T12:00:00.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.937+0000 7fd7ed8fc700 1 -- start start 2023-11-28T12:00:00.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.937+0000 7fd7ed8fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7e8070a90 0x7fd7e8144170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:00.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.937+0000 7fd7ed8fc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7e8159f10 0x7fd7e8152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:00.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.937+0000 7fd7ed8fc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7e815a9f0 0x7fd7e80ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:00.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.937+0000 7fd7ed8fc700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e81531a0 con 0x7fd7e8070a90 2023-11-28T12:00:00.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.937+0000 7fd7ed8fc700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e8153480 con 0x7fd7e8159f10 2023-11-28T12:00:00.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.937+0000 7fd7ed8fc700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e8153760 con 0x7fd7e815a9f0 2023-11-28T12:00:00.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.937+0000 7fd7ec8fa700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7e8070a90 0x7fd7e8144170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:00.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.937+0000 7fd7ec8fa700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7e8070a90 0x7fd7e8144170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55612/0 (socket says 172.21.15.39:55612) 2023-11-28T12:00:00.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.937+0000 7fd7ec8fa700 1 -- 172.21.15.39:0/1862628918 learned_addr learned my addr 172.21.15.39:0/1862628918 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:00.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.941+0000 7fd7ed0fb700 1 --2- 172.21.15.39:0/1862628918 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7e815a9f0 0x7fd7e80ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:00.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.941+0000 7fd7dffff700 1 --2- 172.21.15.39:0/1862628918 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7e8159f10 0x7fd7e8152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:00.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.941+0000 7fd7ec8fa700 1 -- 172.21.15.39:0/1862628918 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7e815a9f0 msgr2=0x7fd7e80ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:00.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.941+0000 7fd7ec8fa700 1 --2- 172.21.15.39:0/1862628918 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7e815a9f0 0x7fd7e80ccc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:00.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.941+0000 7fd7ec8fa700 1 -- 172.21.15.39:0/1862628918 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7e8159f10 msgr2=0x7fd7e8152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:00.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.941+0000 7fd7ec8fa700 1 --2- 172.21.15.39:0/1862628918 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7e8159f10 0x7fd7e8152750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:00.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.941+0000 7fd7ec8fa700 1 -- 172.21.15.39:0/1862628918 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e0009a70 con 0x7fd7e8070a90 2023-11-28T12:00:00.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.941+0000 7fd7ec8fa700 1 --2- 172.21.15.39:0/1862628918 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7e8070a90 0x7fd7e8144170 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fd7e400c700 tx=0x7fd7e400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:00.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.941+0000 7fd7dd7fa700 1 -- 172.21.15.39:0/1862628918 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e4005cd0 con 0x7fd7e8070a90 2023-11-28T12:00:00.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.941+0000 7fd7dd7fa700 1 -- 172.21.15.39:0/1862628918 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e4005e30 con 0x7fd7e8070a90 2023-11-28T12:00:00.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.941+0000 7fd7dd7fa700 1 -- 172.21.15.39:0/1862628918 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e40072d0 con 0x7fd7e8070a90 2023-11-28T12:00:00.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.941+0000 7fd7ed8fc700 1 -- 172.21.15.39:0/1862628918 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e8070290 con 0x7fd7e8070a90 2023-11-28T12:00:00.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.941+0000 7fd7ed8fc700 1 -- 172.21.15.39:0/1862628918 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e806ffb0 con 0x7fd7e8070a90 2023-11-28T12:00:00.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.941+0000 7fd7ed8fc700 1 -- 172.21.15.39:0/1862628918 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7e80affa0 con 0x7fd7e8070a90 2023-11-28T12:00:00.949 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.945+0000 7fd7dd7fa700 1 -- 172.21.15.39:0/1862628918 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd7e4019030 con 0x7fd7e8070a90 2023-11-28T12:00:00.952 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.949+0000 7fd7dd7fa700 1 --2- 172.21.15.39:0/1862628918 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd7d4064ee0 0x7fd7d4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:00.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.949+0000 7fd7dd7fa700 1 -- 172.21.15.39:0/1862628918 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd7e40812e0 con 0x7fd7e8070a90 2023-11-28T12:00:00.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.949+0000 7fd7dffff700 1 --2- 172.21.15.39:0/1862628918 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd7d4064ee0 0x7fd7d4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:00.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.949+0000 7fd7dffff700 1 --2- 172.21.15.39:0/1862628918 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd7d4064ee0 0x7fd7d4067390 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd7e80c81e0 tx=0x7fd7d8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:00.958 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:00.953+0000 7fd7dd7fa700 1 -- 172.21.15.39:0/1862628918 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd7e404a400 con 0x7fd7e8070a90 2023-11-28T12:00:01.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.129+0000 7fd7ed8fc700 1 -- 172.21.15.39:0/1862628918 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd7e806cf30 con 0x7fd7e8070a90 2023-11-28T12:00:01.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.129+0000 7fd7dd7fa700 1 -- 172.21.15.39:0/1862628918 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v70) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd7e40170a0 con 0x7fd7e8070a90 2023-11-28T12:00:01.134 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-11-28T12:00:01.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.129+0000 7fd7ed8fc700 1 -- 172.21.15.39:0/1862628918 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd7d4064ee0 msgr2=0x7fd7d4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:01.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.129+0000 7fd7ed8fc700 1 --2- 172.21.15.39:0/1862628918 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd7d4064ee0 0x7fd7d4067390 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd7e80c81e0 tx=0x7fd7d8008040 comp rx=0 tx=0).stop 2023-11-28T12:00:01.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.129+0000 7fd7ed8fc700 1 -- 172.21.15.39:0/1862628918 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7e8070a90 msgr2=0x7fd7e8144170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:01.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.129+0000 7fd7ed8fc700 1 --2- 172.21.15.39:0/1862628918 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7e8070a90 0x7fd7e8144170 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fd7e400c700 tx=0x7fd7e400cac0 comp rx=0 tx=0).stop 2023-11-28T12:00:01.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.133+0000 7fd7ed8fc700 1 -- 172.21.15.39:0/1862628918 shutdown_connections 2023-11-28T12:00:01.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.133+0000 7fd7ed8fc700 1 --2- 172.21.15.39:0/1862628918 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7e815a9f0 0x7fd7e80ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:01.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.133+0000 7fd7ed8fc700 1 --2- 172.21.15.39:0/1862628918 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd7d4064ee0 0x7fd7d4067390 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:01.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.133+0000 7fd7ed8fc700 1 --2- 172.21.15.39:0/1862628918 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7e8159f10 0x7fd7e8152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:01.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.133+0000 7fd7ed8fc700 1 --2- 172.21.15.39:0/1862628918 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7e8070a90 0x7fd7e8144170 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:01.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.133+0000 7fd7ed8fc700 1 -- 172.21.15.39:0/1862628918 >> 172.21.15.39:0/1862628918 conn(0x7fd7e80cf280 msgr2=0x7fd7e815a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:01.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.133+0000 7fd7ed8fc700 1 -- 172.21.15.39:0/1862628918 shutdown_connections 2023-11-28T12:00:01.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.133+0000 7fd7ed8fc700 1 -- 172.21.15.39:0/1862628918 wait complete. 2023-11-28T12:00:01.158 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T12:00:01.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.337+0000 7f5fb59ba700 1 Processor -- start 2023-11-28T12:00:01.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.341+0000 7f5fb59ba700 1 -- start start 2023-11-28T12:00:01.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.341+0000 7f5fb59ba700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5fb0070620 0x7f5fb00b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:01.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.341+0000 7f5fb59ba700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5fb0069bf0 0x7f5fb006a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:01.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.341+0000 7f5fb59ba700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb015c520 con 0x7f5fb015c150 2023-11-28T12:00:01.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.341+0000 7f5fb59ba700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fb00b4240 con 0x7f5fb0069bf0 2023-11-28T12:00:01.348 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.341+0000 7f5fb59ba700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb006cc50 con 0x7f5fb0070620 2023-11-28T12:00:01.348 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.341+0000 7f5faeffd700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f5fb015c150 0x7f5fb006ff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42658/0 (socket says 172.21.15.39:42658) 2023-11-28T12:00:01.348 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.341+0000 7f5faeffd700 1 -- 172.21.15.39:0/414646630 learned_addr learned my addr 172.21.15.39:0/414646630 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T12:00:01.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.341+0000 7f5faf7fe700 1 --2- 172.21.15.39:0/414646630 >> v2:172.21.15.39:3300/0 conn(0x7f5fb0069bf0 0x7f5fb006a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:01.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.341+0000 7f5fae7fc700 1 --2- 172.21.15.39:0/414646630 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5fb0070620 0x7f5fb00b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:01.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.345+0000 7f5fadffb700 1 -- 172.21.15.39:0/414646630 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3289172766 0 0) 0x7f5fb015c520 con 0x7f5fb015c150 2023-11-28T12:00:01.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.345+0000 7f5fadffb700 1 -- 172.21.15.39:0/414646630 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f980035d0 con 0x7f5fb015c150 2023-11-28T12:00:01.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.345+0000 7f5faf7fe700 1 -- 172.21.15.39:0/414646630 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5fb0070620 msgr2=0x7f5fb00b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:01.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.345+0000 7f5faf7fe700 1 --2- 172.21.15.39:0/414646630 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5fb0070620 0x7f5fb00b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:01.350 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.345+0000 7f5faf7fe700 1 -- 172.21.15.39:0/414646630 >> v1:172.21.15.39:6789/0 conn(0x7f5fb015c150 legacy=0x7f5fb006ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:01.350 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.345+0000 7f5faf7fe700 1 -- 172.21.15.39:0/414646630 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb00d2450 con 0x7f5fb0069bf0 2023-11-28T12:00:01.350 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.345+0000 7f5faf7fe700 1 --2- 172.21.15.39:0/414646630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5fb0069bf0 0x7f5fb006a050 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8009d90 tx=0x7f5fa800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c63dea54fcd6b1d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:01.350 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.345+0000 7f5fadffb700 1 -- 172.21.15.39:0/414646630 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa800e070 con 0x7f5fb0069bf0 2023-11-28T12:00:01.351 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.345+0000 7f5fadffb700 1 -- 172.21.15.39:0/414646630 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa800bb20 con 0x7f5fb0069bf0 2023-11-28T12:00:01.351 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.345+0000 7f5fadffb700 1 -- 172.21.15.39:0/414646630 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa8012430 con 0x7f5fb0069bf0 2023-11-28T12:00:01.351 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.345+0000 7f5fb59ba700 1 -- 172.21.15.39:0/414646630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5fb0069bf0 msgr2=0x7f5fb006a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:01.351 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.345+0000 7f5fb59ba700 1 --2- 172.21.15.39:0/414646630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5fb0069bf0 0x7f5fb006a050 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8009d90 tx=0x7f5fa800b330 comp rx=0 tx=0).stop 2023-11-28T12:00:01.351 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.345+0000 7f5fb59ba700 1 -- 172.21.15.39:0/414646630 shutdown_connections 2023-11-28T12:00:01.352 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.345+0000 7f5fb59ba700 1 --2- 172.21.15.39:0/414646630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5fb0069bf0 0x7f5fb006a050 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:01.352 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.345+0000 7f5fb59ba700 1 --2- 172.21.15.39:0/414646630 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5fb0070620 0x7f5fb00b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:01.352 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.345+0000 7f5fb59ba700 1 -- 172.21.15.39:0/414646630 >> 172.21.15.39:0/414646630 conn(0x7f5fb00d3680 msgr2=0x7f5fb00cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:01.352 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.345+0000 7f5fb59ba700 1 -- 172.21.15.39:0/414646630 shutdown_connections 2023-11-28T12:00:01.352 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.345+0000 7f5fb59ba700 1 -- 172.21.15.39:0/414646630 wait complete. 2023-11-28T12:00:01.353 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.349+0000 7f5fb59ba700 1 Processor -- start 2023-11-28T12:00:01.353 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.349+0000 7f5fb59ba700 1 -- start start 2023-11-28T12:00:01.356 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.349+0000 7f5fb59ba700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5fb0069bf0 0x7f5fb0158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:01.356 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.349+0000 7f5fb59ba700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5fb0070620 0x7f5fb015a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:01.356 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.349+0000 7f5fb59ba700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5fb015c150 0x7f5fb015a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:01.356 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.349+0000 7f5fb59ba700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb0158680 con 0x7f5fb0070620 2023-11-28T12:00:01.356 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.349+0000 7f5fb59ba700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb0158960 con 0x7f5fb015c150 2023-11-28T12:00:01.356 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.349+0000 7f5fb59ba700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb0158c40 con 0x7f5fb0069bf0 2023-11-28T12:00:01.357 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.349+0000 7f5fae7fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5fb0070620 0x7f5fb015a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:01.357 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.349+0000 7f5fae7fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5fb0070620 0x7f5fb015a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55634/0 (socket says 172.21.15.39:55634) 2023-11-28T12:00:01.357 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.349+0000 7f5fae7fc700 1 -- 172.21.15.39:0/2221783691 learned_addr learned my addr 172.21.15.39:0/2221783691 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:01.358 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.353+0000 7f5faf7fe700 1 --2- 172.21.15.39:0/2221783691 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5fb015c150 0x7f5fb015a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:01.358 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.349+0000 7f5faeffd700 1 --2- 172.21.15.39:0/2221783691 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5fb0069bf0 0x7f5fb0158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:01.358 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.353+0000 7f5fae7fc700 1 -- 172.21.15.39:0/2221783691 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5fb0069bf0 msgr2=0x7f5fb0158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:01.359 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.353+0000 7f5fae7fc700 1 --2- 172.21.15.39:0/2221783691 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5fb0069bf0 0x7f5fb0158080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:01.359 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.353+0000 7f5fae7fc700 1 -- 172.21.15.39:0/2221783691 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5fb015c150 msgr2=0x7f5fb015a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:01.359 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.353+0000 7f5fae7fc700 1 --2- 172.21.15.39:0/2221783691 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5fb015c150 0x7f5fb015a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:01.359 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.353+0000 7f5fae7fc700 1 -- 172.21.15.39:0/2221783691 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa8009a70 con 0x7f5fb0070620 2023-11-28T12:00:01.359 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.353+0000 7f5faeffd700 1 --2- 172.21.15.39:0/2221783691 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5fb0069bf0 0x7f5fb0158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:00:01.359 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.353+0000 7f5fae7fc700 1 --2- 172.21.15.39:0/2221783691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5fb0070620 0x7f5fb015a0f0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f5fa400e980 tx=0x7f5fa400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:01.359 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.353+0000 7f5f97fff700 1 -- 172.21.15.39:0/2221783691 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa4009710 con 0x7f5fb0070620 2023-11-28T12:00:01.359 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.353+0000 7f5f97fff700 1 -- 172.21.15.39:0/2221783691 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa400eed0 con 0x7f5fb0070620 2023-11-28T12:00:01.359 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.353+0000 7f5f97fff700 1 -- 172.21.15.39:0/2221783691 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa400ca90 con 0x7f5fb0070620 2023-11-28T12:00:01.359 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.353+0000 7f5fb59ba700 1 -- 172.21.15.39:0/2221783691 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fb00d05e0 con 0x7f5fb0070620 2023-11-28T12:00:01.360 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.353+0000 7f5fb59ba700 1 -- 172.21.15.39:0/2221783691 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb00d2730 con 0x7f5fb0070620 2023-11-28T12:00:01.360 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.353+0000 7f5fb59ba700 1 -- 172.21.15.39:0/2221783691 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fb00d2140 con 0x7f5fb0070620 2023-11-28T12:00:01.360 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.353+0000 7f5f97fff700 1 -- 172.21.15.39:0/2221783691 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5fa4023070 con 0x7f5fb0070620 2023-11-28T12:00:01.362 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.357+0000 7f5f97fff700 1 --2- 172.21.15.39:0/2221783691 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5f9c064ee0 0x7f5f9c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:01.363 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.357+0000 7f5f97fff700 1 -- 172.21.15.39:0/2221783691 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f5fa4082260 con 0x7f5fb0070620 2023-11-28T12:00:01.363 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.357+0000 7f5faeffd700 1 --2- 172.21.15.39:0/2221783691 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5f9c064ee0 0x7f5f9c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:01.365 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.361+0000 7f5faeffd700 1 --2- 172.21.15.39:0/2221783691 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5f9c064ee0 0x7f5f9c067390 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5fa00011e0 tx=0x7f5fa0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:01.368 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.365+0000 7f5f97fff700 1 -- 172.21.15.39:0/2221783691 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5fa40502c0 con 0x7f5fb0070620 2023-11-28T12:00:01.540 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.533+0000 7f5fb59ba700 1 -- 172.21.15.39:0/2221783691 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5fb0073d20 con 0x7f5fb0070620 2023-11-28T12:00:01.541 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.537+0000 7f5f97fff700 1 -- 172.21.15.39:0/2221783691 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v70) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5fa40538e0 con 0x7f5fb0070620 2023-11-28T12:00:01.541 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-11-28T12:00:01.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.537+0000 7f5fb59ba700 1 -- 172.21.15.39:0/2221783691 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5f9c064ee0 msgr2=0x7f5f9c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:01.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.537+0000 7f5fb59ba700 1 --2- 172.21.15.39:0/2221783691 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5f9c064ee0 0x7f5f9c067390 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5fa00011e0 tx=0x7f5fa0009040 comp rx=0 tx=0).stop 2023-11-28T12:00:01.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.537+0000 7f5fb59ba700 1 -- 172.21.15.39:0/2221783691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5fb0070620 msgr2=0x7f5fb015a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:01.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.537+0000 7f5fb59ba700 1 --2- 172.21.15.39:0/2221783691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5fb0070620 0x7f5fb015a0f0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f5fa400e980 tx=0x7f5fa400ec90 comp rx=0 tx=0).stop 2023-11-28T12:00:01.544 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.537+0000 7f5fb59ba700 1 -- 172.21.15.39:0/2221783691 shutdown_connections 2023-11-28T12:00:01.544 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.537+0000 7f5fb59ba700 1 --2- 172.21.15.39:0/2221783691 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f5f9c064ee0 0x7f5f9c067390 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:01.544 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.537+0000 7f5fb59ba700 1 --2- 172.21.15.39:0/2221783691 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5fb015c150 0x7f5fb015a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:01.544 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.537+0000 7f5fb59ba700 1 --2- 172.21.15.39:0/2221783691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5fb0070620 0x7f5fb015a0f0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:01.544 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.537+0000 7f5fb59ba700 1 --2- 172.21.15.39:0/2221783691 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5fb0069bf0 0x7f5fb0158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:01.544 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.537+0000 7f5fb59ba700 1 -- 172.21.15.39:0/2221783691 >> 172.21.15.39:0/2221783691 conn(0x7f5fb00d3680 msgr2=0x7f5fb0156f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:01.544 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.537+0000 7f5fb59ba700 1 -- 172.21.15.39:0/2221783691 shutdown_connections 2023-11-28T12:00:01.545 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.537+0000 7f5fb59ba700 1 -- 172.21.15.39:0/2221783691 wait complete. 2023-11-28T12:00:01.565 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T12:00:01.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.745+0000 7ff4ab245700 1 Processor -- start 2023-11-28T12:00:01.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.745+0000 7ff4ab245700 1 -- start start 2023-11-28T12:00:01.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.749+0000 7ff4ab245700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff4a41585b0 0x7ff4a40c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:01.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.749+0000 7ff4ab245700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff4a40cb780 0x7ff4a406ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:01.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.749+0000 7ff4ab245700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4a40c90f0 con 0x7ff4a40cbbe0 2023-11-28T12:00:01.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.749+0000 7ff4ab245700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4a40cd0b0 con 0x7ff4a41585b0 2023-11-28T12:00:01.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.749+0000 7ff4ab245700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4a4069bf0 con 0x7ff4a40cb780 2023-11-28T12:00:01.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.749+0000 7ff4aa243700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff4a41585b0 0x7ff4a40c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:01.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.749+0000 7ff4aa243700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff4a41585b0 0x7ff4a40c8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55638/0 (socket says 172.21.15.39:55638) 2023-11-28T12:00:01.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.749+0000 7ff4aa243700 1 -- 172.21.15.39:0/1516154024 learned_addr learned my addr 172.21.15.39:0/1516154024 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:01.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.749+0000 7ff4a9a42700 1 --2- 172.21.15.39:0/1516154024 >> v2:172.21.15.184:3300/0 conn(0x7ff4a40cb780 0x7ff4a406ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:01.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.749+0000 7ff4aaa44700 1 --1- 172.21.15.39:0/1516154024 >> v1:172.21.15.39:6789/0 conn(0x7ff4a40cbbe0 0x7ff4a40cc340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42668/0 (socket says 172.21.15.39:42668) 2023-11-28T12:00:01.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.749+0000 7ff4aa243700 1 -- 172.21.15.39:0/1516154024 >> v2:172.21.15.184:3300/0 conn(0x7ff4a40cb780 msgr2=0x7ff4a406ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:01.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.749+0000 7ff4aa243700 1 --2- 172.21.15.39:0/1516154024 >> v2:172.21.15.184:3300/0 conn(0x7ff4a40cb780 0x7ff4a406ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:01.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.749+0000 7ff4aa243700 1 -- 172.21.15.39:0/1516154024 >> v1:172.21.15.39:6789/0 conn(0x7ff4a40cbbe0 legacy=0x7ff4a40cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:01.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.749+0000 7ff4aa243700 1 -- 172.21.15.39:0/1516154024 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a4069e00 con 0x7ff4a41585b0 2023-11-28T12:00:01.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.749+0000 7ff4aa243700 1 --2- 172.21.15.39:0/1516154024 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4a41585b0 0x7ff4a40c8bb0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7ff4a406bc00 tx=0x7ff4a000be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b55198352a7b624 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:01.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.749+0000 7ff4a9241700 1 -- 172.21.15.39:0/1516154024 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a000dd30 con 0x7ff4a41585b0 2023-11-28T12:00:01.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.749+0000 7ff4a9241700 1 -- 172.21.15.39:0/1516154024 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a000de90 con 0x7ff4a41585b0 2023-11-28T12:00:01.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.749+0000 7ff4a9241700 1 -- 172.21.15.39:0/1516154024 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a0010690 con 0x7ff4a41585b0 2023-11-28T12:00:01.758 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.753+0000 7ff4ab245700 1 -- 172.21.15.39:0/1516154024 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4a41585b0 msgr2=0x7ff4a40c8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:01.758 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.753+0000 7ff4ab245700 1 --2- 172.21.15.39:0/1516154024 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4a41585b0 0x7ff4a40c8bb0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7ff4a406bc00 tx=0x7ff4a000be90 comp rx=0 tx=0).stop 2023-11-28T12:00:01.758 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.753+0000 7ff4ab245700 1 -- 172.21.15.39:0/1516154024 shutdown_connections 2023-11-28T12:00:01.758 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.753+0000 7ff4ab245700 1 --2- 172.21.15.39:0/1516154024 >> v2:172.21.15.184:3300/0 conn(0x7ff4a40cb780 0x7ff4a406ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:01.758 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.753+0000 7ff4ab245700 1 --2- 172.21.15.39:0/1516154024 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4a41585b0 0x7ff4a40c8bb0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:01.758 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.753+0000 7ff4ab245700 1 -- 172.21.15.39:0/1516154024 >> 172.21.15.39:0/1516154024 conn(0x7ff4a40cf280 msgr2=0x7ff4a40cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:01.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.753+0000 7ff4ab245700 1 -- 172.21.15.39:0/1516154024 shutdown_connections 2023-11-28T12:00:01.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.753+0000 7ff4ab245700 1 -- 172.21.15.39:0/1516154024 wait complete. 2023-11-28T12:00:01.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.753+0000 7ff4ab245700 1 Processor -- start 2023-11-28T12:00:01.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.757+0000 7ff4ab245700 1 -- start start 2023-11-28T12:00:01.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.757+0000 7ff4ab245700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4a40cb780 0x7ff4a41e4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:01.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.757+0000 7ff4ab245700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4a40cbbe0 0x7ff4a414bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:01.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.757+0000 7ff4ab245700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4a41585b0 0x7ff4a414cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:01.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.757+0000 7ff4ab245700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a41e5ff0 con 0x7ff4a41585b0 2023-11-28T12:00:01.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.757+0000 7ff4ab245700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a414c300 con 0x7ff4a40cb780 2023-11-28T12:00:01.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.757+0000 7ff4ab245700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a41e0da0 con 0x7ff4a40cbbe0 2023-11-28T12:00:01.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.757+0000 7ff4aaa44700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4a41585b0 0x7ff4a414cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:01.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.757+0000 7ff4aaa44700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4a41585b0 0x7ff4a414cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55644/0 (socket says 172.21.15.39:55644) 2023-11-28T12:00:01.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.757+0000 7ff4aaa44700 1 -- 172.21.15.39:0/2150421936 learned_addr learned my addr 172.21.15.39:0/2150421936 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:01.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.757+0000 7ff4a9a42700 1 --2- 172.21.15.39:0/2150421936 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4a40cbbe0 0x7ff4a414bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:01.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.757+0000 7ff4aa243700 1 --2- 172.21.15.39:0/2150421936 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4a40cb780 0x7ff4a41e4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:01.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.757+0000 7ff4aaa44700 1 -- 172.21.15.39:0/2150421936 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4a40cbbe0 msgr2=0x7ff4a414bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:01.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.757+0000 7ff4aaa44700 1 --2- 172.21.15.39:0/2150421936 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4a40cbbe0 0x7ff4a414bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:01.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.757+0000 7ff4aaa44700 1 -- 172.21.15.39:0/2150421936 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4a40cb780 msgr2=0x7ff4a41e4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:01.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.757+0000 7ff4aaa44700 1 --2- 172.21.15.39:0/2150421936 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4a40cb780 0x7ff4a41e4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:01.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.757+0000 7ff4aaa44700 1 -- 172.21.15.39:0/2150421936 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a000b810 con 0x7ff4a41585b0 2023-11-28T12:00:01.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.757+0000 7ff4a9a42700 1 --2- 172.21.15.39:0/2150421936 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4a40cbbe0 0x7ff4a414bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:00:01.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.757+0000 7ff4aaa44700 1 --2- 172.21.15.39:0/2150421936 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4a41585b0 0x7ff4a414cd30 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7ff49c00cbd0 tx=0x7ff49c00cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:01.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.761+0000 7ff49affd700 1 -- 172.21.15.39:0/2150421936 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49c00aa60 con 0x7ff4a41585b0 2023-11-28T12:00:01.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.761+0000 7ff49affd700 1 -- 172.21.15.39:0/2150421936 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff49c00abc0 con 0x7ff4a41585b0 2023-11-28T12:00:01.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.761+0000 7ff49affd700 1 -- 172.21.15.39:0/2150421936 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49c007070 con 0x7ff4a41585b0 2023-11-28T12:00:01.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.761+0000 7ff4ab245700 1 -- 172.21.15.39:0/2150421936 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4a406a3c0 con 0x7ff4a41585b0 2023-11-28T12:00:01.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.761+0000 7ff4ab245700 1 -- 172.21.15.39:0/2150421936 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4a406a0e0 con 0x7ff4a41585b0 2023-11-28T12:00:01.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.761+0000 7ff4ab245700 1 -- 172.21.15.39:0/2150421936 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4a406a6a0 con 0x7ff4a41585b0 2023-11-28T12:00:01.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.765+0000 7ff49affd700 1 -- 172.21.15.39:0/2150421936 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff49c019030 con 0x7ff4a41585b0 2023-11-28T12:00:01.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.765+0000 7ff49affd700 1 --2- 172.21.15.39:0/2150421936 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff488064f10 0x7ff4880673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:01.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.765+0000 7ff49affd700 1 -- 172.21.15.39:0/2150421936 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff49c081b50 con 0x7ff4a41585b0 2023-11-28T12:00:01.771 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.765+0000 7ff4aa243700 1 --2- 172.21.15.39:0/2150421936 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff488064f10 0x7ff4880673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:01.772 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.769+0000 7ff4aa243700 1 --2- 172.21.15.39:0/2150421936 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff488064f10 0x7ff4880673c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0000c00 tx=0x7ff4a001b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:01.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.773+0000 7ff49affd700 1 -- 172.21.15.39:0/2150421936 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff49c04a400 con 0x7ff4a41585b0 2023-11-28T12:00:01.952 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.945+0000 7ff4ab245700 1 -- 172.21.15.39:0/2150421936 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff4a406d2c0 con 0x7ff4a41585b0 2023-11-28T12:00:01.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.949+0000 7ff49affd700 1 -- 172.21.15.39:0/2150421936 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v70) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff49c017020 con 0x7ff4a41585b0 2023-11-28T12:00:01.953 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2023-11-28T12:00:01.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.953+0000 7ff4ab245700 1 -- 172.21.15.39:0/2150421936 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff488064f10 msgr2=0x7ff4880673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:01.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.953+0000 7ff4ab245700 1 --2- 172.21.15.39:0/2150421936 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff488064f10 0x7ff4880673c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0000c00 tx=0x7ff4a001b040 comp rx=0 tx=0).stop 2023-11-28T12:00:01.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.953+0000 7ff4ab245700 1 -- 172.21.15.39:0/2150421936 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4a41585b0 msgr2=0x7ff4a414cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:01.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.953+0000 7ff4ab245700 1 --2- 172.21.15.39:0/2150421936 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4a41585b0 0x7ff4a414cd30 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7ff49c00cbd0 tx=0x7ff49c00cee0 comp rx=0 tx=0).stop 2023-11-28T12:00:01.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.953+0000 7ff4ab245700 1 -- 172.21.15.39:0/2150421936 shutdown_connections 2023-11-28T12:00:01.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.953+0000 7ff4ab245700 1 --2- 172.21.15.39:0/2150421936 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4a41585b0 0x7ff4a414cd30 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:01.958 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.953+0000 7ff4ab245700 1 --2- 172.21.15.39:0/2150421936 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4a40cbbe0 0x7ff4a414bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:01.958 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.953+0000 7ff4ab245700 1 --2- 172.21.15.39:0/2150421936 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff488064f10 0x7ff4880673c0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:01.958 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.953+0000 7ff4ab245700 1 --2- 172.21.15.39:0/2150421936 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4a40cb780 0x7ff4a41e4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:01.958 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.953+0000 7ff4ab245700 1 -- 172.21.15.39:0/2150421936 >> 172.21.15.39:0/2150421936 conn(0x7ff4a40cf280 msgr2=0x7ff4a40c4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:01.958 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.953+0000 7ff4ab245700 1 -- 172.21.15.39:0/2150421936 shutdown_connections 2023-11-28T12:00:01.958 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:01.953+0000 7ff4ab245700 1 -- 172.21.15.39:0/2150421936 wait complete. 2023-11-28T12:00:01.978 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T12:00:02.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.137+0000 7f07fb0c7700 1 Processor -- start 2023-11-28T12:00:02.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.137+0000 7f07fb0c7700 1 -- start start 2023-11-28T12:00:02.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.141+0000 7f07fb0c7700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f07f40b43a0 0x7f07f415e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:02.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.141+0000 7f07fb0c7700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f07f4070790 0x7f07f406bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:02.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.141+0000 7f07fb0c7700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f415a550 con 0x7f07f40b1640 2023-11-28T12:00:02.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.141+0000 7f07fb0c7700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f406b0a0 con 0x7f07f40b43a0 2023-11-28T12:00:02.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.141+0000 7f07fb0c7700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f40caac0 con 0x7f07f4070790 2023-11-28T12:00:02.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.141+0000 7f07fa0c5700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f07f40b43a0 0x7f07f415e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:02.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.141+0000 7f07f98c4700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f07f40b1640 0x7f07f4070080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42672/0 (socket says 172.21.15.39:42672) 2023-11-28T12:00:02.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.141+0000 7f07f98c4700 1 -- 172.21.15.39:0/1766751977 learned_addr learned my addr 172.21.15.39:0/1766751977 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T12:00:02.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.141+0000 7f07fa8c6700 1 --2- 172.21.15.39:0/1766751977 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f07f4070790 0x7f07f406bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:02.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.141+0000 7f07fa0c5700 1 -- 172.21.15.39:0/1766751977 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f07f4070790 msgr2=0x7f07f406bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:02.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.141+0000 7f07fa0c5700 1 --2- 172.21.15.39:0/1766751977 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f07f4070790 0x7f07f406bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:02.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.141+0000 7f07fa0c5700 1 -- 172.21.15.39:0/1766751977 >> v1:172.21.15.39:6789/0 conn(0x7f07f40b1640 legacy=0x7f07f4070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:02.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.141+0000 7f07fa0c5700 1 -- 172.21.15.39:0/1766751977 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f40cada0 con 0x7f07f40b43a0 2023-11-28T12:00:02.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.141+0000 7f07fa0c5700 1 --2- 172.21.15.39:0/1766751977 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07f40b43a0 0x7f07f415e5d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f07f0009850 tx=0x7f07f0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=849b18c7b28593bb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:02.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.141+0000 7f07f90c3700 1 -- 172.21.15.39:0/1766751977 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f0011830 con 0x7f07f40b43a0 2023-11-28T12:00:02.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.145+0000 7f07f90c3700 1 -- 172.21.15.39:0/1766751977 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f0011990 con 0x7f07f40b43a0 2023-11-28T12:00:02.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.145+0000 7f07f90c3700 1 -- 172.21.15.39:0/1766751977 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f0011d40 con 0x7f07f40b43a0 2023-11-28T12:00:02.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.145+0000 7f07fb0c7700 1 -- 172.21.15.39:0/1766751977 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07f40b43a0 msgr2=0x7f07f415e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:02.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.145+0000 7f07fb0c7700 1 --2- 172.21.15.39:0/1766751977 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07f40b43a0 0x7f07f415e5d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f07f0009850 tx=0x7f07f0009b60 comp rx=0 tx=0).stop 2023-11-28T12:00:02.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.145+0000 7f07fb0c7700 1 -- 172.21.15.39:0/1766751977 shutdown_connections 2023-11-28T12:00:02.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.145+0000 7f07fb0c7700 1 --2- 172.21.15.39:0/1766751977 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f07f4070790 0x7f07f406bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:02.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.145+0000 7f07fb0c7700 1 --2- 172.21.15.39:0/1766751977 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07f40b43a0 0x7f07f415e5d0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:02.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.145+0000 7f07fb0c7700 1 -- 172.21.15.39:0/1766751977 >> 172.21.15.39:0/1766751977 conn(0x7f07f40b0f80 msgr2=0x7f07f40ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:02.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.145+0000 7f07fb0c7700 1 -- 172.21.15.39:0/1766751977 shutdown_connections 2023-11-28T12:00:02.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.145+0000 7f07fb0c7700 1 -- 172.21.15.39:0/1766751977 wait complete. 2023-11-28T12:00:02.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.145+0000 7f07fb0c7700 1 Processor -- start 2023-11-28T12:00:02.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.145+0000 7f07fb0c7700 1 -- start start 2023-11-28T12:00:02.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.149+0000 7f07fb0c7700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07f4070790 0x7f07f40c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:02.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.149+0000 7f07fb0c7700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07f40b1640 0x7f07f4148060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:02.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.149+0000 7f07fb0c7700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f07f40b43a0 0x7f07f40c29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:02.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.149+0000 7f07fb0c7700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f41485a0 con 0x7f07f40b1640 2023-11-28T12:00:02.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.149+0000 7f07fb0c7700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f415a6f0 con 0x7f07f4070790 2023-11-28T12:00:02.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.149+0000 7f07fb0c7700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f40c2f20 con 0x7f07f40b43a0 2023-11-28T12:00:02.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.149+0000 7f07f98c4700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07f40b1640 0x7f07f4148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:02.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.149+0000 7f07f98c4700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07f40b1640 0x7f07f4148060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55660/0 (socket says 172.21.15.39:55660) 2023-11-28T12:00:02.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.149+0000 7f07f98c4700 1 -- 172.21.15.39:0/2683082560 learned_addr learned my addr 172.21.15.39:0/2683082560 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:02.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.149+0000 7f07fa0c5700 1 --2- 172.21.15.39:0/2683082560 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07f4070790 0x7f07f40c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:02.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.149+0000 7f07fa8c6700 1 --2- 172.21.15.39:0/2683082560 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f07f40b43a0 0x7f07f40c29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:02.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.149+0000 7f07f98c4700 1 -- 172.21.15.39:0/2683082560 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f07f40b43a0 msgr2=0x7f07f40c29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:02.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.149+0000 7f07f98c4700 1 --2- 172.21.15.39:0/2683082560 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f07f40b43a0 0x7f07f40c29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:02.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.149+0000 7f07f98c4700 1 -- 172.21.15.39:0/2683082560 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07f4070790 msgr2=0x7f07f40c78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:02.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.149+0000 7f07f98c4700 1 --2- 172.21.15.39:0/2683082560 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07f4070790 0x7f07f40c78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:02.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.149+0000 7f07f98c4700 1 -- 172.21.15.39:0/2683082560 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f00094b0 con 0x7f07f40b1640 2023-11-28T12:00:02.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.149+0000 7f07fa0c5700 1 --2- 172.21.15.39:0/2683082560 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07f4070790 0x7f07f40c78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:00:02.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.149+0000 7f07f98c4700 1 --2- 172.21.15.39:0/2683082560 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07f40b1640 0x7f07f4148060 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f07e400c700 tx=0x7f07e400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:02.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.149+0000 7f07eaffd700 1 -- 172.21.15.39:0/2683082560 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e4005d90 con 0x7f07f40b1640 2023-11-28T12:00:02.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.149+0000 7f07fb0c7700 1 -- 172.21.15.39:0/2683082560 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f406b5d0 con 0x7f07f40b1640 2023-11-28T12:00:02.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.149+0000 7f07eaffd700 1 -- 172.21.15.39:0/2683082560 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e40070d0 con 0x7f07f40b1640 2023-11-28T12:00:02.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.149+0000 7f07eaffd700 1 -- 172.21.15.39:0/2683082560 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e4007440 con 0x7f07f40b1640 2023-11-28T12:00:02.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.149+0000 7f07fb0c7700 1 -- 172.21.15.39:0/2683082560 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f406b2f0 con 0x7f07f40b1640 2023-11-28T12:00:02.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.153+0000 7f07fb0c7700 1 -- 172.21.15.39:0/2683082560 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f415eb10 con 0x7f07f40b1640 2023-11-28T12:00:02.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.153+0000 7f07eaffd700 1 -- 172.21.15.39:0/2683082560 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f07e4019030 con 0x7f07f40b1640 2023-11-28T12:00:02.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.153+0000 7f07eaffd700 1 --2- 172.21.15.39:0/2683082560 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f07d8064ee0 0x7f07d8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:02.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.153+0000 7f07eaffd700 1 -- 172.21.15.39:0/2683082560 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f07e4081240 con 0x7f07f40b1640 2023-11-28T12:00:02.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.153+0000 7f07fa0c5700 1 --2- 172.21.15.39:0/2683082560 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f07d8064ee0 0x7f07d8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:02.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.157+0000 7f07fa0c5700 1 --2- 172.21.15.39:0/2683082560 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f07d8064ee0 0x7f07d8067390 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f07f00090b0 tx=0x7f07f0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:02.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.157+0000 7f07eaffd700 1 -- 172.21.15.39:0/2683082560 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f07e404a400 con 0x7f07f40b1640 2023-11-28T12:00:02.369 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.365+0000 7f07fb0c7700 1 -- 172.21.15.39:0/2683082560 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07f415a530 con 0x7f07f40b1640 2023-11-28T12:00:02.370 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.365+0000 7f07eaffd700 1 -- 172.21.15.39:0/2683082560 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4653 (secure 0 0 0) 0x7f07e404f2d0 con 0x7f07f40b1640 2023-11-28T12:00:02.370 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T12:00:02.371 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5645,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/3875262459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3875262459},{"type":"v1","addr":"172.21.15.184:6835","nonce":3875262459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5648,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/3845363738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3845363738},{"type":"v1","addr":"172.21.15.184:6837","nonce":3845363738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6225,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6834/2646905389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6833","nonce":2646905389},{"type":"v1","addr":"172.21.15.39:6834","nonce":2646905389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:59:45.290110+0000","modified":"2023-11-28T11:59:57.792347+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6244":{"gid":6244,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6835/990492858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":990492858},{"type":"v1","addr":"172.21.15.39:6835","nonce":990492858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T12:00:02.373 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.369+0000 7f07fb0c7700 1 -- 172.21.15.39:0/2683082560 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f07d8064ee0 msgr2=0x7f07d8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:02.373 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.369+0000 7f07fb0c7700 1 --2- 172.21.15.39:0/2683082560 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f07d8064ee0 0x7f07d8067390 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f07f00090b0 tx=0x7f07f0008030 comp rx=0 tx=0).stop 2023-11-28T12:00:02.373 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.369+0000 7f07fb0c7700 1 -- 172.21.15.39:0/2683082560 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07f40b1640 msgr2=0x7f07f4148060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:02.373 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.369+0000 7f07fb0c7700 1 --2- 172.21.15.39:0/2683082560 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07f40b1640 0x7f07f4148060 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f07e400c700 tx=0x7f07e400cac0 comp rx=0 tx=0).stop 2023-11-28T12:00:02.374 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.369+0000 7f07fb0c7700 1 -- 172.21.15.39:0/2683082560 shutdown_connections 2023-11-28T12:00:02.374 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.369+0000 7f07fb0c7700 1 --2- 172.21.15.39:0/2683082560 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f07f40b43a0 0x7f07f40c29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:02.374 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.369+0000 7f07fb0c7700 1 --2- 172.21.15.39:0/2683082560 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07f40b1640 0x7f07f4148060 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:02.374 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.369+0000 7f07fb0c7700 1 --2- 172.21.15.39:0/2683082560 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f07d8064ee0 0x7f07d8067390 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:02.374 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.369+0000 7f07fb0c7700 1 --2- 172.21.15.39:0/2683082560 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07f4070790 0x7f07f40c78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:02.374 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.369+0000 7f07fb0c7700 1 -- 172.21.15.39:0/2683082560 >> 172.21.15.39:0/2683082560 conn(0x7f07f40b0f80 msgr2=0x7f07f40ad950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:02.374 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.369+0000 7f07fb0c7700 1 -- 172.21.15.39:0/2683082560 shutdown_connections 2023-11-28T12:00:02.374 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.369+0000 7f07fb0c7700 1 -- 172.21.15.39:0/2683082560 wait complete. 2023-11-28T12:00:02.376 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 33 2023-11-28T12:00:02.400 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:00:02.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.565+0000 7f9b71f29700 1 Processor -- start 2023-11-28T12:00:03.690 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.569+0000 7f9b71f29700 1 -- start start 2023-11-28T12:00:03.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.569+0000 7f9b71f29700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9b6c0b1640 0x7f9b6c070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:03.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.569+0000 7f9b71f29700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b6c15a550 con 0x7f9b6c0c9040 2023-11-28T12:00:03.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.569+0000 7f9b71f29700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b6c06b0a0 con 0x7f9b6c0b43a0 2023-11-28T12:00:03.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.569+0000 7f9b71f29700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b6c0caac0 con 0x7f9b6c0b1640 2023-11-28T12:00:03.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.569+0000 7f9b71728700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f9b6c0c9040 0x7f9b6c06bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42682/0 (socket says 172.21.15.39:42682) 2023-11-28T12:00:03.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.569+0000 7f9b71728700 1 -- 172.21.15.39:0/1771095856 learned_addr learned my addr 172.21.15.39:0/1771095856 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T12:00:03.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.569+0000 7f9b63fff700 1 --2- 172.21.15.39:0/1771095856 >> v2:172.21.15.184:3300/0 conn(0x7f9b6c0b1640 0x7f9b6c070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:03.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.573+0000 7f9b637fe700 1 -- 172.21.15.39:0/1771095856 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 816165233 0 0) 0x7f9b64001110 con 0x7f9b6c0c9040 2023-11-28T12:00:03.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.573+0000 7f9b637fe700 1 -- 172.21.15.39:0/1771095856 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b540035d0 con 0x7f9b6c0c9040 2023-11-28T12:00:03.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.573+0000 7f9b637fe700 1 -- 172.21.15.39:0/1771095856 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 804023396 0 0) 0x7f9b6c06b0a0 con 0x7f9b6c0b43a0 2023-11-28T12:00:03.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.573+0000 7f9b63fff700 1 -- 172.21.15.39:0/1771095856 >> v1:172.21.15.184:6789/0 conn(0x7f9b6c0b43a0 legacy=0x7f9b6c15e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:03.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.573+0000 7f9b63fff700 1 -- 172.21.15.39:0/1771095856 >> v1:172.21.15.39:6789/0 conn(0x7f9b6c0c9040 legacy=0x7f9b6c06bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:03.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.573+0000 7f9b63fff700 1 -- 172.21.15.39:0/1771095856 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b6c0cada0 con 0x7f9b6c0b1640 2023-11-28T12:00:03.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.573+0000 7f9b63fff700 1 --2- 172.21.15.39:0/1771095856 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b6c0b1640 0x7f9b6c070080 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c009850 tx=0x7f9b5c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=498a77a11d3f4992 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:03.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.573+0000 7f9b637fe700 1 -- 172.21.15.39:0/1771095856 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c011830 con 0x7f9b6c0b1640 2023-11-28T12:00:03.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.573+0000 7f9b637fe700 1 -- 172.21.15.39:0/1771095856 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5c011990 con 0x7f9b6c0b1640 2023-11-28T12:00:03.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.573+0000 7f9b637fe700 1 -- 172.21.15.39:0/1771095856 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c011d40 con 0x7f9b6c0b1640 2023-11-28T12:00:03.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.573+0000 7f9b71f29700 1 -- 172.21.15.39:0/1771095856 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b6c0b1640 msgr2=0x7f9b6c070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:03.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.573+0000 7f9b71f29700 1 --2- 172.21.15.39:0/1771095856 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b6c0b1640 0x7f9b6c070080 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c009850 tx=0x7f9b5c009b60 comp rx=0 tx=0).stop 2023-11-28T12:00:03.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.573+0000 7f9b71f29700 1 -- 172.21.15.39:0/1771095856 shutdown_connections 2023-11-28T12:00:03.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.573+0000 7f9b71f29700 1 --2- 172.21.15.39:0/1771095856 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b6c0b1640 0x7f9b6c070080 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:03.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.573+0000 7f9b71f29700 1 -- 172.21.15.39:0/1771095856 >> 172.21.15.39:0/1771095856 conn(0x7f9b6c0b0f80 msgr2=0x7f9b6c0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:03.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.573+0000 7f9b71f29700 1 -- 172.21.15.39:0/1771095856 shutdown_connections 2023-11-28T12:00:03.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.573+0000 7f9b71f29700 1 -- 172.21.15.39:0/1771095856 wait complete. 2023-11-28T12:00:03.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.577+0000 7f9b71f29700 1 Processor -- start 2023-11-28T12:00:03.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.577+0000 7f9b71f29700 1 -- start start 2023-11-28T12:00:03.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.577+0000 7f9b71f29700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9b6c0b1640 0x7f9b6c0c4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:03.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.577+0000 7f9b71f29700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b6c0b43a0 0x7f9b6c155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:03.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.577+0000 7f9b71f29700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b6c0c9040 0x7f9b6c1f2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:03.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.577+0000 7f9b71f29700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6c0c3c90 con 0x7f9b6c0c9040 2023-11-28T12:00:03.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.577+0000 7f9b71f29700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6c1561a0 con 0x7f9b6c0b43a0 2023-11-28T12:00:03.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.577+0000 7f9b71f29700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6c0c3010 con 0x7f9b6c0b1640 2023-11-28T12:00:03.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.577+0000 7f9b71728700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b6c0c9040 0x7f9b6c1f2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:03.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.577+0000 7f9b71728700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b6c0c9040 0x7f9b6c1f2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55666/0 (socket says 172.21.15.39:55666) 2023-11-28T12:00:03.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.577+0000 7f9b71728700 1 -- 172.21.15.39:0/2958236551 learned_addr learned my addr 172.21.15.39:0/2958236551 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:03.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.581+0000 7f9b63fff700 1 --2- 172.21.15.39:0/2958236551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b6c0b43a0 0x7f9b6c155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:03.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.581+0000 7f9b70f27700 1 --2- 172.21.15.39:0/2958236551 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9b6c0b1640 0x7f9b6c0c4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:03.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.581+0000 7f9b71728700 1 -- 172.21.15.39:0/2958236551 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9b6c0b1640 msgr2=0x7f9b6c0c4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:03.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.581+0000 7f9b71728700 1 --2- 172.21.15.39:0/2958236551 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9b6c0b1640 0x7f9b6c0c4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:03.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.581+0000 7f9b71728700 1 -- 172.21.15.39:0/2958236551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b6c0b43a0 msgr2=0x7f9b6c155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:03.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.581+0000 7f9b71728700 1 --2- 172.21.15.39:0/2958236551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b6c0b43a0 0x7f9b6c155c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:03.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.581+0000 7f9b71728700 1 -- 172.21.15.39:0/2958236551 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b5c0094b0 con 0x7f9b6c0c9040 2023-11-28T12:00:03.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.581+0000 7f9b71728700 1 --2- 172.21.15.39:0/2958236551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b6c0c9040 0x7f9b6c1f2b60 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f9b6400c700 tx=0x7f9b6400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:03.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.581+0000 7f9b617fa700 1 -- 172.21.15.39:0/2958236551 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b64005d90 con 0x7f9b6c0c9040 2023-11-28T12:00:03.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.581+0000 7f9b617fa700 1 -- 172.21.15.39:0/2958236551 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b640070d0 con 0x7f9b6c0c9040 2023-11-28T12:00:03.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.581+0000 7f9b71f29700 1 -- 172.21.15.39:0/2958236551 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b6c06b5d0 con 0x7f9b6c0c9040 2023-11-28T12:00:03.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.581+0000 7f9b617fa700 1 -- 172.21.15.39:0/2958236551 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b64007480 con 0x7f9b6c0c9040 2023-11-28T12:00:03.701 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.581+0000 7f9b71f29700 1 -- 172.21.15.39:0/2958236551 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b6c06b2f0 con 0x7f9b6c0c9040 2023-11-28T12:00:03.701 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.585+0000 7f9b71f29700 1 -- 172.21.15.39:0/2958236551 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b6c0ca7b0 con 0x7f9b6c0c9040 2023-11-28T12:00:03.701 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.585+0000 7f9b617fa700 1 -- 172.21.15.39:0/2958236551 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9b64019030 con 0x7f9b6c0c9040 2023-11-28T12:00:03.701 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.585+0000 7f9b617fa700 1 --2- 172.21.15.39:0/2958236551 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9b58064ee0 0x7f9b58067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:03.701 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.585+0000 7f9b617fa700 1 -- 172.21.15.39:0/2958236551 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f9b64081120 con 0x7f9b6c0c9040 2023-11-28T12:00:03.701 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.589+0000 7f9b70f27700 1 --2- 172.21.15.39:0/2958236551 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9b58064ee0 0x7f9b58067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:03.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.589+0000 7f9b70f27700 1 --2- 172.21.15.39:0/2958236551 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9b58064ee0 0x7f9b58067390 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9b680012e0 tx=0x7f9b68009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:03.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.593+0000 7f9b617fa700 1 -- 172.21.15.39:0/2958236551 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9b6404f180 con 0x7f9b6c0c9040 2023-11-28T12:00:03.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.769+0000 7f9b71f29700 1 -- 172.21.15.39:0/2958236551 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b6c06aea0 con 0x7f9b6c0c9040 2023-11-28T12:00:03.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.773+0000 7f9b617fa700 1 -- 172.21.15.39:0/2958236551 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+18087 (secure 0 0 0) 0x7f9b64017090 con 0x7f9b6c0c9040 2023-11-28T12:00:03.716 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T12:00:03.716 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":70,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:59:46.296300+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:59:43.752184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-28T11:59:44.294885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:00:03.718 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.777+0000 7f9b71f29700 1 -- 172.21.15.39:0/2958236551 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9b58064ee0 msgr2=0x7f9b58067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:03.718 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.777+0000 7f9b71f29700 1 --2- 172.21.15.39:0/2958236551 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9b58064ee0 0x7f9b58067390 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9b680012e0 tx=0x7f9b68009040 comp rx=0 tx=0).stop 2023-11-28T12:00:03.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.777+0000 7f9b71f29700 1 -- 172.21.15.39:0/2958236551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b6c0c9040 msgr2=0x7f9b6c1f2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:03.720 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.777+0000 7f9b71f29700 1 --2- 172.21.15.39:0/2958236551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b6c0c9040 0x7f9b6c1f2b60 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f9b6400c700 tx=0x7f9b6400ca10 comp rx=0 tx=0).stop 2023-11-28T12:00:03.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.777+0000 7f9b71f29700 1 -- 172.21.15.39:0/2958236551 shutdown_connections 2023-11-28T12:00:03.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.777+0000 7f9b71f29700 1 --2- 172.21.15.39:0/2958236551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b6c0c9040 0x7f9b6c1f2b60 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:03.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.777+0000 7f9b71f29700 1 --2- 172.21.15.39:0/2958236551 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9b58064ee0 0x7f9b58067390 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:03.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.777+0000 7f9b71f29700 1 --2- 172.21.15.39:0/2958236551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b6c0b43a0 0x7f9b6c155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:03.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.777+0000 7f9b71f29700 1 --2- 172.21.15.39:0/2958236551 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9b6c0b1640 0x7f9b6c0c4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:03.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.777+0000 7f9b71f29700 1 -- 172.21.15.39:0/2958236551 >> 172.21.15.39:0/2958236551 conn(0x7f9b6c0b0f80 msgr2=0x7f9b6c159900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:03.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.777+0000 7f9b71f29700 1 -- 172.21.15.39:0/2958236551 shutdown_connections 2023-11-28T12:00:03.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:02.777+0000 7f9b71f29700 1 -- 172.21.15.39:0/2958236551 wait complete. 2023-11-28T12:00:03.722 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T12:00:03.722 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T12:00:03.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.917+0000 7f0282524700 1 Processor -- start 2023-11-28T12:00:03.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.917+0000 7f0282524700 1 -- start start 2023-11-28T12:00:03.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.921+0000 7f0282524700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f027c070080 0x7f027c0704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:03.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.921+0000 7f0282524700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f027c164250 0x7f027c1646d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:03.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.921+0000 7f0282524700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f027c0ad6c0 con 0x7f027c160710 2023-11-28T12:00:03.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.921+0000 7f0282524700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f027c06b1c0 con 0x7f027c070080 2023-11-28T12:00:03.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.921+0000 7f0282524700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f027c0adc60 con 0x7f027c164250 2023-11-28T12:00:03.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.921+0000 7f0281522700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f027c160710 0x7f027c0cc320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42692/0 (socket says 172.21.15.39:42692) 2023-11-28T12:00:03.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.921+0000 7f0281522700 1 -- 172.21.15.39:0/1405330273 learned_addr learned my addr 172.21.15.39:0/1405330273 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T12:00:03.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.921+0000 7f0281d23700 1 --2- 172.21.15.39:0/1405330273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f027c164250 0x7f027c1646d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:03.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.921+0000 7f0280d21700 1 --2- 172.21.15.39:0/1405330273 >> v2:172.21.15.184:3300/0 conn(0x7f027c070080 0x7f027c0704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:03.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.921+0000 7f0273fff700 1 -- 172.21.15.39:0/1405330273 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 574687126 0 0) 0x7f027c0ad6c0 con 0x7f027c160710 2023-11-28T12:00:03.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.921+0000 7f0273fff700 1 -- 172.21.15.39:0/1405330273 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02680035d0 con 0x7f027c160710 2023-11-28T12:00:03.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.921+0000 7f0281d23700 1 -- 172.21.15.39:0/1405330273 >> v2:172.21.15.184:3300/0 conn(0x7f027c070080 msgr2=0x7f027c0704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:03.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.921+0000 7f0281d23700 1 --2- 172.21.15.39:0/1405330273 >> v2:172.21.15.184:3300/0 conn(0x7f027c070080 0x7f027c0704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:03.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.921+0000 7f0281d23700 1 -- 172.21.15.39:0/1405330273 >> v1:172.21.15.39:6789/0 conn(0x7f027c160710 legacy=0x7f027c0cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:03.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.921+0000 7f0281d23700 1 -- 172.21.15.39:0/1405330273 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f027c0709f0 con 0x7f027c164250 2023-11-28T12:00:03.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.921+0000 7f0281d23700 1 --2- 172.21.15.39:0/1405330273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f027c164250 0x7f027c1646d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0274009850 tx=0x7f0274009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93257efd38d4d042 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:03.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.921+0000 7f0273fff700 1 -- 172.21.15.39:0/1405330273 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0274011830 con 0x7f027c164250 2023-11-28T12:00:03.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.921+0000 7f0273fff700 1 -- 172.21.15.39:0/1405330273 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0274011990 con 0x7f027c164250 2023-11-28T12:00:03.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.921+0000 7f0273fff700 1 -- 172.21.15.39:0/1405330273 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0274011d40 con 0x7f027c164250 2023-11-28T12:00:03.929 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.925+0000 7f0282524700 1 -- 172.21.15.39:0/1405330273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f027c164250 msgr2=0x7f027c1646d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:03.929 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.925+0000 7f0282524700 1 --2- 172.21.15.39:0/1405330273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f027c164250 0x7f027c1646d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0274009850 tx=0x7f0274009b60 comp rx=0 tx=0).stop 2023-11-28T12:00:03.929 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.925+0000 7f0282524700 1 -- 172.21.15.39:0/1405330273 shutdown_connections 2023-11-28T12:00:03.930 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.925+0000 7f0282524700 1 --2- 172.21.15.39:0/1405330273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f027c164250 0x7f027c1646d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:03.930 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.925+0000 7f0282524700 1 --2- 172.21.15.39:0/1405330273 >> v2:172.21.15.184:3300/0 conn(0x7f027c070080 0x7f027c0704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:03.930 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.925+0000 7f0282524700 1 -- 172.21.15.39:0/1405330273 >> 172.21.15.39:0/1405330273 conn(0x7f027c0b0f80 msgr2=0x7f027c0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:03.930 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.925+0000 7f0282524700 1 -- 172.21.15.39:0/1405330273 shutdown_connections 2023-11-28T12:00:03.930 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.925+0000 7f0282524700 1 -- 172.21.15.39:0/1405330273 wait complete. 2023-11-28T12:00:03.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.929+0000 7f0282524700 1 Processor -- start 2023-11-28T12:00:03.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.929+0000 7f0282524700 1 -- start start 2023-11-28T12:00:03.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.929+0000 7f0282524700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f027c070080 0x7f027c15bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:03.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.929+0000 7f0282524700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f027c160710 0x7f027c1f5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:03.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.929+0000 7f0282524700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f027c164250 0x7f027c0af230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:03.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.929+0000 7f0282524700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027c1f6550 con 0x7f027c070080 2023-11-28T12:00:03.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.929+0000 7f0282524700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027c1f6830 con 0x7f027c160710 2023-11-28T12:00:03.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.929+0000 7f0282524700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f027c1f6b10 con 0x7f027c164250 2023-11-28T12:00:03.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.929+0000 7f0281522700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f027c070080 0x7f027c15bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:03.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.929+0000 7f0281522700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f027c070080 0x7f027c15bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55682/0 (socket says 172.21.15.39:55682) 2023-11-28T12:00:03.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.929+0000 7f0281522700 1 -- 172.21.15.39:0/2783491 learned_addr learned my addr 172.21.15.39:0/2783491 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:03.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.929+0000 7f0280d21700 1 --2- 172.21.15.39:0/2783491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f027c160710 0x7f027c1f5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:03.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.929+0000 7f0281d23700 1 --2- 172.21.15.39:0/2783491 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f027c164250 0x7f027c0af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:03.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.929+0000 7f0281522700 1 -- 172.21.15.39:0/2783491 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f027c164250 msgr2=0x7f027c0af230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:03.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.929+0000 7f0281522700 1 --2- 172.21.15.39:0/2783491 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f027c164250 0x7f027c0af230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:03.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.929+0000 7f0281522700 1 -- 172.21.15.39:0/2783491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f027c160710 msgr2=0x7f027c1f5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:03.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.929+0000 7f0281522700 1 --2- 172.21.15.39:0/2783491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f027c160710 0x7f027c1f5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:03.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.929+0000 7f0281522700 1 -- 172.21.15.39:0/2783491 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02740094b0 con 0x7f027c070080 2023-11-28T12:00:03.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.929+0000 7f0280d21700 1 --2- 172.21.15.39:0/2783491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f027c160710 0x7f027c1f5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:00:03.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.929+0000 7f0281522700 1 --2- 172.21.15.39:0/2783491 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f027c070080 0x7f027c15bcc0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f027800cbc0 tx=0x7f027800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:03.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.929+0000 7f0271ffb700 1 -- 172.21.15.39:0/2783491 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027800a770 con 0x7f027c070080 2023-11-28T12:00:03.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.933+0000 7f0271ffb700 1 -- 172.21.15.39:0/2783491 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027800a8d0 con 0x7f027c070080 2023-11-28T12:00:03.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.933+0000 7f0282524700 1 -- 172.21.15.39:0/2783491 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f027c06b3d0 con 0x7f027c070080 2023-11-28T12:00:03.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.933+0000 7f0271ffb700 1 -- 172.21.15.39:0/2783491 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027800ac60 con 0x7f027c070080 2023-11-28T12:00:03.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.933+0000 7f0282524700 1 -- 172.21.15.39:0/2783491 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f027c0cca30 con 0x7f027c070080 2023-11-28T12:00:03.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.933+0000 7f0282524700 1 -- 172.21.15.39:0/2783491 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f027c06b6b0 con 0x7f027c070080 2023-11-28T12:00:03.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.933+0000 7f0271ffb700 1 -- 172.21.15.39:0/2783491 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0278019030 con 0x7f027c070080 2023-11-28T12:00:03.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.937+0000 7f0271ffb700 1 --2- 172.21.15.39:0/2783491 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0260064ee0 0x7f0260067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:03.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.937+0000 7f0271ffb700 1 -- 172.21.15.39:0/2783491 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f02780819c0 con 0x7f027c070080 2023-11-28T12:00:03.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.937+0000 7f0280d21700 1 --2- 172.21.15.39:0/2783491 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0260064ee0 0x7f0260067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:03.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.937+0000 7f0280d21700 1 --2- 172.21.15.39:0/2783491 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0260064ee0 0x7f0260067390 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f027c162550 tx=0x7f026c009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:03.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:03.945+0000 7f0271ffb700 1 -- 172.21.15.39:0/2783491 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f027804f930 con 0x7f027c070080 2023-11-28T12:00:04.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.157+0000 7f0282524700 1 -- 172.21.15.39:0/2783491 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f027c073cb0 con 0x7f027c070080 2023-11-28T12:00:04.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.161+0000 7f0271ffb700 1 -- 172.21.15.39:0/2783491 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4653 (secure 0 0 0) 0x7f0278052f50 con 0x7f027c070080 2023-11-28T12:00:04.165 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T12:00:04.165 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5645,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/3875262459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3875262459},{"type":"v1","addr":"172.21.15.184:6835","nonce":3875262459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5648,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/3845363738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3845363738},{"type":"v1","addr":"172.21.15.184:6837","nonce":3845363738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6225,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6834/2646905389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6833","nonce":2646905389},{"type":"v1","addr":"172.21.15.39:6834","nonce":2646905389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:59:45.290110+0000","modified":"2023-11-28T11:59:57.792347+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6244":{"gid":6244,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6835/990492858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":990492858},{"type":"v1","addr":"172.21.15.39:6835","nonce":990492858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T12:00:04.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.165+0000 7f0282524700 1 -- 172.21.15.39:0/2783491 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0260064ee0 msgr2=0x7f0260067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:04.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.165+0000 7f0282524700 1 --2- 172.21.15.39:0/2783491 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0260064ee0 0x7f0260067390 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f027c162550 tx=0x7f026c009240 comp rx=0 tx=0).stop 2023-11-28T12:00:04.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.165+0000 7f0282524700 1 -- 172.21.15.39:0/2783491 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f027c070080 msgr2=0x7f027c15bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:04.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.165+0000 7f0282524700 1 --2- 172.21.15.39:0/2783491 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f027c070080 0x7f027c15bcc0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f027800cbc0 tx=0x7f027800cbf0 comp rx=0 tx=0).stop 2023-11-28T12:00:04.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.165+0000 7f0282524700 1 -- 172.21.15.39:0/2783491 shutdown_connections 2023-11-28T12:00:04.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.165+0000 7f0282524700 1 --2- 172.21.15.39:0/2783491 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f027c164250 0x7f027c0af230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:04.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.165+0000 7f0282524700 1 --2- 172.21.15.39:0/2783491 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0260064ee0 0x7f0260067390 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:04.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.165+0000 7f0282524700 1 --2- 172.21.15.39:0/2783491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f027c160710 0x7f027c1f5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:04.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.165+0000 7f0282524700 1 --2- 172.21.15.39:0/2783491 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f027c070080 0x7f027c15bcc0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:04.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.165+0000 7f0282524700 1 -- 172.21.15.39:0/2783491 >> 172.21.15.39:0/2783491 conn(0x7f027c0b0f80 msgr2=0x7f027c060660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:04.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.165+0000 7f0282524700 1 -- 172.21.15.39:0/2783491 shutdown_connections 2023-11-28T12:00:04.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.165+0000 7f0282524700 1 -- 172.21.15.39:0/2783491 wait complete. 2023-11-28T12:00:04.173 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 33 2023-11-28T12:00:04.198 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T12:00:04.385 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.381+0000 7f0781a34700 1 Processor -- start 2023-11-28T12:00:04.385 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.381+0000 7f0781a34700 1 -- start start 2023-11-28T12:00:04.386 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.381+0000 7f0781a34700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f077c15a480 0x7f077c0cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:04.386 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.381+0000 7f0781a34700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f077c069d60 0x7f077c06a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:04.387 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.381+0000 7f0781a34700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077c15a850 con 0x7f077c0c8d10 2023-11-28T12:00:04.387 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.381+0000 7f0781a34700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f077c0ce060 con 0x7f077c15a480 2023-11-28T12:00:04.387 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.381+0000 7f0781a34700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f077c0ce300 con 0x7f077c069d60 2023-11-28T12:00:04.387 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.381+0000 7f0773fff700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f077c0c8d10 0x7f077c0cc7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42704/0 (socket says 172.21.15.39:42704) 2023-11-28T12:00:04.387 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.381+0000 7f0773fff700 1 -- 172.21.15.39:0/2146627959 learned_addr learned my addr 172.21.15.39:0/2146627959 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T12:00:04.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.381+0000 7f077affd700 1 --2- 172.21.15.39:0/2146627959 >> v2:172.21.15.39:3300/0 conn(0x7f077c15a480 0x7f077c0cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:04.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.381+0000 7f077b7fe700 1 --2- 172.21.15.39:0/2146627959 >> v2:172.21.15.184:3300/0 conn(0x7f077c069d60 0x7f077c06a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:04.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.381+0000 7f077a7fc700 1 -- 172.21.15.39:0/2146627959 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3192459332 0 0) 0x7f077c15a850 con 0x7f077c0c8d10 2023-11-28T12:00:04.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.381+0000 7f077affd700 1 -- 172.21.15.39:0/2146627959 >> v2:172.21.15.184:3300/0 conn(0x7f077c069d60 msgr2=0x7f077c06a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:04.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.381+0000 7f077affd700 1 --2- 172.21.15.39:0/2146627959 >> v2:172.21.15.184:3300/0 conn(0x7f077c069d60 0x7f077c06a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:04.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.381+0000 7f077affd700 1 -- 172.21.15.39:0/2146627959 >> v1:172.21.15.39:6789/0 conn(0x7f077c0c8d10 legacy=0x7f077c0cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:04.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.381+0000 7f077affd700 1 -- 172.21.15.39:0/2146627959 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077c0cada0 con 0x7f077c15a480 2023-11-28T12:00:04.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.385+0000 7f077affd700 1 --2- 172.21.15.39:0/2146627959 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f077c15a480 0x7f077c0cc290 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f077c0c9340 tx=0x7f076c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b321b75b0895563d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:04.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.385+0000 7f077a7fc700 1 -- 172.21.15.39:0/2146627959 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c011830 con 0x7f077c15a480 2023-11-28T12:00:04.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.385+0000 7f077a7fc700 1 -- 172.21.15.39:0/2146627959 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076c011990 con 0x7f077c15a480 2023-11-28T12:00:04.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.385+0000 7f077a7fc700 1 -- 172.21.15.39:0/2146627959 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c011d20 con 0x7f077c15a480 2023-11-28T12:00:04.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.385+0000 7f0781a34700 1 -- 172.21.15.39:0/2146627959 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f077c15a480 msgr2=0x7f077c0cc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:04.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.385+0000 7f0781a34700 1 --2- 172.21.15.39:0/2146627959 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f077c15a480 0x7f077c0cc290 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f077c0c9340 tx=0x7f076c009b30 comp rx=0 tx=0).stop 2023-11-28T12:00:04.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.385+0000 7f0781a34700 1 -- 172.21.15.39:0/2146627959 shutdown_connections 2023-11-28T12:00:04.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.385+0000 7f0781a34700 1 --2- 172.21.15.39:0/2146627959 >> v2:172.21.15.184:3300/0 conn(0x7f077c069d60 0x7f077c06a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:04.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.385+0000 7f0781a34700 1 --2- 172.21.15.39:0/2146627959 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f077c15a480 0x7f077c0cc290 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:04.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.385+0000 7f0781a34700 1 -- 172.21.15.39:0/2146627959 >> 172.21.15.39:0/2146627959 conn(0x7f077c0cf350 msgr2=0x7f077c0b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:04.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.385+0000 7f0781a34700 1 -- 172.21.15.39:0/2146627959 shutdown_connections 2023-11-28T12:00:04.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.385+0000 7f0781a34700 1 -- 172.21.15.39:0/2146627959 wait complete. 2023-11-28T12:00:04.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.389+0000 7f0781a34700 1 Processor -- start 2023-11-28T12:00:04.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.389+0000 7f0781a34700 1 -- start start 2023-11-28T12:00:04.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.389+0000 7f0781a34700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f077c069d60 0x7f077c0c7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:04.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.389+0000 7f0781a34700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f077c0c8d10 0x7f077c1ef9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:04.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.389+0000 7f0781a34700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f077c15a480 0x7f077c0ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:04.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.389+0000 7f0781a34700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077c15b800 con 0x7f077c15a480 2023-11-28T12:00:04.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.389+0000 7f0781a34700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077c15ab80 con 0x7f077c069d60 2023-11-28T12:00:04.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.389+0000 7f0781a34700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077c15ae60 con 0x7f077c0c8d10 2023-11-28T12:00:04.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.389+0000 7f077b7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f077c15a480 0x7f077c0ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:04.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.389+0000 7f077b7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f077c15a480 0x7f077c0ccec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55694/0 (socket says 172.21.15.39:55694) 2023-11-28T12:00:04.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.389+0000 7f077b7fe700 1 -- 172.21.15.39:0/2226958490 learned_addr learned my addr 172.21.15.39:0/2226958490 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:04.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.389+0000 7f077affd700 1 --2- 172.21.15.39:0/2226958490 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f077c069d60 0x7f077c0c7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:04.397 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.389+0000 7f0773fff700 1 --2- 172.21.15.39:0/2226958490 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f077c0c8d10 0x7f077c1ef9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:04.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.393+0000 7f077b7fe700 1 -- 172.21.15.39:0/2226958490 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f077c0c8d10 msgr2=0x7f077c1ef9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:04.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.393+0000 7f077b7fe700 1 --2- 172.21.15.39:0/2226958490 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f077c0c8d10 0x7f077c1ef9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:04.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.393+0000 7f077b7fe700 1 -- 172.21.15.39:0/2226958490 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f077c069d60 msgr2=0x7f077c0c7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:04.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.393+0000 7f077b7fe700 1 --2- 172.21.15.39:0/2226958490 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f077c069d60 0x7f077c0c7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:04.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.393+0000 7f077b7fe700 1 -- 172.21.15.39:0/2226958490 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f076c0094b0 con 0x7f077c15a480 2023-11-28T12:00:04.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.393+0000 7f077b7fe700 1 --2- 172.21.15.39:0/2226958490 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f077c15a480 0x7f077c0ccec0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f077400efc0 tx=0x7f077400c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:04.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.393+0000 7f0778ff9700 1 -- 172.21.15.39:0/2226958490 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077400cb80 con 0x7f077c15a480 2023-11-28T12:00:04.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.393+0000 7f0778ff9700 1 -- 172.21.15.39:0/2226958490 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077400f040 con 0x7f077c15a480 2023-11-28T12:00:04.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.393+0000 7f0778ff9700 1 -- 172.21.15.39:0/2226958490 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0774014480 con 0x7f077c15a480 2023-11-28T12:00:04.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.393+0000 7f0781a34700 1 -- 172.21.15.39:0/2226958490 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f077c0add50 con 0x7f077c15a480 2023-11-28T12:00:04.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.393+0000 7f0781a34700 1 -- 172.21.15.39:0/2226958490 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f077c0caa30 con 0x7f077c15a480 2023-11-28T12:00:04.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.393+0000 7f0781a34700 1 -- 172.21.15.39:0/2226958490 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f077c0ca6e0 con 0x7f077c15a480 2023-11-28T12:00:04.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.397+0000 7f0778ff9700 1 -- 172.21.15.39:0/2226958490 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f07740145e0 con 0x7f077c15a480 2023-11-28T12:00:04.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.397+0000 7f0778ff9700 1 --2- 172.21.15.39:0/2226958490 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f075c064ee0 0x7f075c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:04.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.397+0000 7f0778ff9700 1 -- 172.21.15.39:0/2226958490 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f07740829d0 con 0x7f077c15a480 2023-11-28T12:00:04.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.397+0000 7f077affd700 1 --2- 172.21.15.39:0/2226958490 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f075c064ee0 0x7f075c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:04.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.397+0000 7f077affd700 1 --2- 172.21.15.39:0/2226958490 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f075c064ee0 0x7f075c067390 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f076c009fd0 tx=0x7f076c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:04.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.405+0000 7f0778ff9700 1 -- 172.21.15.39:0/2226958490 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0774050940 con 0x7f077c15a480 2023-11-28T12:00:04.620 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.613+0000 7f0781a34700 1 -- 172.21.15.39:0/2226958490 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f077c0726c0 con 0x7f077c15a480 2023-11-28T12:00:04.621 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.617+0000 7f0778ff9700 1 -- 172.21.15.39:0/2226958490 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4653 (secure 0 0 0) 0x7f0774053f60 con 0x7f077c15a480 2023-11-28T12:00:04.621 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T12:00:04.621 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5645,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/3875262459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3875262459},{"type":"v1","addr":"172.21.15.184:6835","nonce":3875262459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5648,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/3845363738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3845363738},{"type":"v1","addr":"172.21.15.184:6837","nonce":3845363738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6225,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6834/2646905389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6833","nonce":2646905389},{"type":"v1","addr":"172.21.15.39:6834","nonce":2646905389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:59:45.290110+0000","modified":"2023-11-28T11:59:57.792347+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6244":{"gid":6244,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":6,"addr":"172.21.15.39:6835/990492858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":990492858},{"type":"v1","addr":"172.21.15.39:6835","nonce":990492858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T12:00:04.624 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.617+0000 7f0781a34700 1 -- 172.21.15.39:0/2226958490 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f075c064ee0 msgr2=0x7f075c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:04.624 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.617+0000 7f0781a34700 1 --2- 172.21.15.39:0/2226958490 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f075c064ee0 0x7f075c067390 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f076c009fd0 tx=0x7f076c008030 comp rx=0 tx=0).stop 2023-11-28T12:00:04.624 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.617+0000 7f0781a34700 1 -- 172.21.15.39:0/2226958490 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f077c15a480 msgr2=0x7f077c0ccec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:04.624 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.617+0000 7f0781a34700 1 --2- 172.21.15.39:0/2226958490 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f077c15a480 0x7f077c0ccec0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f077400efc0 tx=0x7f077400c0c0 comp rx=0 tx=0).stop 2023-11-28T12:00:04.624 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.617+0000 7f0781a34700 1 -- 172.21.15.39:0/2226958490 shutdown_connections 2023-11-28T12:00:04.624 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.617+0000 7f0781a34700 1 --2- 172.21.15.39:0/2226958490 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f077c15a480 0x7f077c0ccec0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:04.625 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.617+0000 7f0781a34700 1 --2- 172.21.15.39:0/2226958490 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f077c0c8d10 0x7f077c1ef9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:04.625 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.617+0000 7f0781a34700 1 --2- 172.21.15.39:0/2226958490 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f075c064ee0 0x7f075c067390 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:04.625 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.617+0000 7f0781a34700 1 --2- 172.21.15.39:0/2226958490 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f077c069d60 0x7f077c0c7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:04.625 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.617+0000 7f0781a34700 1 -- 172.21.15.39:0/2226958490 >> 172.21.15.39:0/2226958490 conn(0x7f077c0cf350 msgr2=0x7f077c154c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:04.625 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.617+0000 7f0781a34700 1 -- 172.21.15.39:0/2226958490 shutdown_connections 2023-11-28T12:00:04.625 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.617+0000 7f0781a34700 1 -- 172.21.15.39:0/2226958490 wait complete. 2023-11-28T12:00:04.626 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 33 2023-11-28T12:00:04.644 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:00:04.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.817+0000 7ff241e20700 1 Processor -- start 2023-11-28T12:00:04.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.817+0000 7ff241e20700 1 -- start start 2023-11-28T12:00:04.824 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.817+0000 7ff241e20700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff23c0cd0d0 0x7ff23c0b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:04.824 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.821+0000 7ff241e20700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff23c0b1b80 0x7ff23c06bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:04.825 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.821+0000 7ff241e20700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff23c0c9d40 con 0x7ff23c15c650 2023-11-28T12:00:04.825 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.821+0000 7ff241e20700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff23c06b140 con 0x7ff23c0cd0d0 2023-11-28T12:00:04.825 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.821+0000 7ff241e20700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff23c0cd5d0 con 0x7ff23c0b1b80 2023-11-28T12:00:04.825 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.821+0000 7ff23bfff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff23c0cd0d0 0x7ff23c0b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:04.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.821+0000 7ff23bfff700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff23c0cd0d0 0x7ff23c0b1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55706/0 (socket says 172.21.15.39:55706) 2023-11-28T12:00:04.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.821+0000 7ff23bfff700 1 -- 172.21.15.39:0/3186456228 learned_addr learned my addr 172.21.15.39:0/3186456228 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:04.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.821+0000 7ff24161f700 1 --2- 172.21.15.39:0/3186456228 >> v2:172.21.15.184:3300/0 conn(0x7ff23c0b1b80 0x7ff23c06bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:04.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.821+0000 7ff23bfff700 1 -- 172.21.15.39:0/3186456228 >> v2:172.21.15.184:3300/0 conn(0x7ff23c0b1b80 msgr2=0x7ff23c06bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:04.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.821+0000 7ff23bfff700 1 --2- 172.21.15.39:0/3186456228 >> v2:172.21.15.184:3300/0 conn(0x7ff23c0b1b80 0x7ff23c06bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:04.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.821+0000 7ff23bfff700 1 -- 172.21.15.39:0/3186456228 >> v1:172.21.15.184:6789/0 conn(0x7ff23c15c650 legacy=0x7ff23c06b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:04.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.821+0000 7ff23bfff700 1 -- 172.21.15.39:0/3186456228 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff23c0cd8b0 con 0x7ff23c0cd0d0 2023-11-28T12:00:04.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.821+0000 7ff23bfff700 1 --2- 172.21.15.39:0/3186456228 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff23c0cd0d0 0x7ff23c0b1640 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7ff23c06fe30 tx=0x7ff22800be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22afd311ffd5e015 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:04.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.821+0000 7ff23b7fe700 1 -- 172.21.15.39:0/3186456228 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22800dd90 con 0x7ff23c0cd0d0 2023-11-28T12:00:04.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.821+0000 7ff23b7fe700 1 -- 172.21.15.39:0/3186456228 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff228010470 con 0x7ff23c0cd0d0 2023-11-28T12:00:04.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.821+0000 7ff23b7fe700 1 -- 172.21.15.39:0/3186456228 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff228010800 con 0x7ff23c0cd0d0 2023-11-28T12:00:04.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.821+0000 7ff241e20700 1 -- 172.21.15.39:0/3186456228 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff23c0cd0d0 msgr2=0x7ff23c0b1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:04.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.821+0000 7ff241e20700 1 --2- 172.21.15.39:0/3186456228 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff23c0cd0d0 0x7ff23c0b1640 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7ff23c06fe30 tx=0x7ff22800be90 comp rx=0 tx=0).stop 2023-11-28T12:00:04.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.825+0000 7ff241e20700 1 -- 172.21.15.39:0/3186456228 shutdown_connections 2023-11-28T12:00:04.829 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.825+0000 7ff241e20700 1 --2- 172.21.15.39:0/3186456228 >> v2:172.21.15.184:3300/0 conn(0x7ff23c0b1b80 0x7ff23c06bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:04.829 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.825+0000 7ff241e20700 1 --2- 172.21.15.39:0/3186456228 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff23c0cd0d0 0x7ff23c0b1640 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:04.829 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.825+0000 7ff241e20700 1 -- 172.21.15.39:0/3186456228 >> 172.21.15.39:0/3186456228 conn(0x7ff23c0b0f80 msgr2=0x7ff23c0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:04.829 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.825+0000 7ff241e20700 1 -- 172.21.15.39:0/3186456228 shutdown_connections 2023-11-28T12:00:04.829 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.825+0000 7ff241e20700 1 -- 172.21.15.39:0/3186456228 wait complete. 2023-11-28T12:00:04.832 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.825+0000 7ff241e20700 1 Processor -- start 2023-11-28T12:00:04.832 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.825+0000 7ff241e20700 1 -- start start 2023-11-28T12:00:04.834 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.829+0000 7ff241e20700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff23c0b1b80 0x7ff23c0c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:04.835 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.829+0000 7ff241e20700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff23c0cd0d0 0x7ff23c0ac9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:04.835 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.829+0000 7ff241e20700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff23c15c650 0x7ff23c14a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:04.835 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.829+0000 7ff241e20700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c0c6500 con 0x7ff23c15c650 2023-11-28T12:00:04.835 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.829+0000 7ff241e20700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c0ab900 con 0x7ff23c0b1b80 2023-11-28T12:00:04.835 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.829+0000 7ff241e20700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c0abbe0 con 0x7ff23c0cd0d0 2023-11-28T12:00:04.836 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.829+0000 7ff24161f700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff23c15c650 0x7ff23c14a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:04.836 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.829+0000 7ff24161f700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff23c15c650 0x7ff23c14a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55708/0 (socket says 172.21.15.39:55708) 2023-11-28T12:00:04.836 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.829+0000 7ff24161f700 1 -- 172.21.15.39:0/3187360575 learned_addr learned my addr 172.21.15.39:0/3187360575 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:04.836 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.829+0000 7ff240e1e700 1 --2- 172.21.15.39:0/3187360575 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff23c0b1b80 0x7ff23c0c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:04.836 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.829+0000 7ff23bfff700 1 --2- 172.21.15.39:0/3187360575 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff23c0cd0d0 0x7ff23c0ac9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:04.837 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.829+0000 7ff24161f700 1 -- 172.21.15.39:0/3187360575 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff23c0cd0d0 msgr2=0x7ff23c0ac9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:04.837 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.829+0000 7ff24161f700 1 --2- 172.21.15.39:0/3187360575 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff23c0cd0d0 0x7ff23c0ac9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:04.837 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.829+0000 7ff24161f700 1 -- 172.21.15.39:0/3187360575 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff23c0b1b80 msgr2=0x7ff23c0c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:04.837 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.829+0000 7ff24161f700 1 --2- 172.21.15.39:0/3187360575 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff23c0b1b80 0x7ff23c0c5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:04.837 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.829+0000 7ff24161f700 1 -- 172.21.15.39:0/3187360575 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff22800b810 con 0x7ff23c15c650 2023-11-28T12:00:04.837 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.829+0000 7ff240e1e700 1 --2- 172.21.15.39:0/3187360575 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff23c0b1b80 0x7ff23c0c5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:00:04.837 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.833+0000 7ff24161f700 1 --2- 172.21.15.39:0/3187360575 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff23c15c650 0x7ff23c14a9a0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7ff234007e40 tx=0x7ff23400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:04.838 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.833+0000 7ff2397fa700 1 -- 172.21.15.39:0/3187360575 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23400ed30 con 0x7ff23c15c650 2023-11-28T12:00:04.838 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.833+0000 7ff2397fa700 1 -- 172.21.15.39:0/3187360575 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff234014420 con 0x7ff23c15c650 2023-11-28T12:00:04.838 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.833+0000 7ff241e20700 1 -- 172.21.15.39:0/3187360575 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff23c0c9680 con 0x7ff23c15c650 2023-11-28T12:00:04.838 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.833+0000 7ff2397fa700 1 -- 172.21.15.39:0/3187360575 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2340147d0 con 0x7ff23c15c650 2023-11-28T12:00:04.838 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.833+0000 7ff241e20700 1 -- 172.21.15.39:0/3187360575 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff23c0c99d0 con 0x7ff23c15c650 2023-11-28T12:00:04.839 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.833+0000 7ff241e20700 1 -- 172.21.15.39:0/3187360575 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff23c06c410 con 0x7ff23c15c650 2023-11-28T12:00:04.840 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.837+0000 7ff2397fa700 1 -- 172.21.15.39:0/3187360575 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff234012050 con 0x7ff23c15c650 2023-11-28T12:00:04.842 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.837+0000 7ff2397fa700 1 --2- 172.21.15.39:0/3187360575 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff220064ee0 0x7ff220067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:04.842 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.837+0000 7ff2397fa700 1 -- 172.21.15.39:0/3187360575 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff234082650 con 0x7ff23c15c650 2023-11-28T12:00:04.843 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.837+0000 7ff240e1e700 1 --2- 172.21.15.39:0/3187360575 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff220064ee0 0x7ff220067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:04.844 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.841+0000 7ff240e1e700 1 --2- 172.21.15.39:0/3187360575 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff220064ee0 0x7ff220067390 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff230000f60 tx=0x7ff230009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:04.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:04.841+0000 7ff2397fa700 1 -- 172.21.15.39:0/3187360575 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff2340505c0 con 0x7ff23c15c650 2023-11-28T12:00:05.028 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.025+0000 7ff241e20700 1 -- 172.21.15.39:0/3187360575 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff23c073cb0 con 0x7ff23c15c650 2023-11-28T12:00:05.031 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.025+0000 7ff2397fa700 1 -- 172.21.15.39:0/3187360575 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+18087 (secure 0 0 0) 0x7ff234053be0 con 0x7ff23c15c650 2023-11-28T12:00:05.032 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T12:00:05.032 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":70,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T11:59:46.296300+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:59:43.752184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-28T11:59:44.294885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:00:05.035 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.029+0000 7ff241e20700 1 -- 172.21.15.39:0/3187360575 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff220064ee0 msgr2=0x7ff220067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:05.035 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.029+0000 7ff241e20700 1 --2- 172.21.15.39:0/3187360575 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff220064ee0 0x7ff220067390 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff230000f60 tx=0x7ff230009040 comp rx=0 tx=0).stop 2023-11-28T12:00:05.035 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.029+0000 7ff241e20700 1 -- 172.21.15.39:0/3187360575 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff23c15c650 msgr2=0x7ff23c14a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:05.035 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.029+0000 7ff241e20700 1 --2- 172.21.15.39:0/3187360575 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff23c15c650 0x7ff23c14a9a0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7ff234007e40 tx=0x7ff23400e3c0 comp rx=0 tx=0).stop 2023-11-28T12:00:05.035 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.029+0000 7ff241e20700 1 -- 172.21.15.39:0/3187360575 shutdown_connections 2023-11-28T12:00:05.035 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.029+0000 7ff241e20700 1 --2- 172.21.15.39:0/3187360575 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff23c15c650 0x7ff23c14a9a0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:05.035 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.029+0000 7ff241e20700 1 --2- 172.21.15.39:0/3187360575 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff23c0cd0d0 0x7ff23c0ac9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:05.035 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.029+0000 7ff241e20700 1 --2- 172.21.15.39:0/3187360575 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7ff220064ee0 0x7ff220067390 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:05.035 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.029+0000 7ff241e20700 1 --2- 172.21.15.39:0/3187360575 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff23c0b1b80 0x7ff23c0c5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:05.035 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.029+0000 7ff241e20700 1 -- 172.21.15.39:0/3187360575 >> 172.21.15.39:0/3187360575 conn(0x7ff23c0b0f80 msgr2=0x7ff23c15bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:05.035 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.029+0000 7ff241e20700 1 -- 172.21.15.39:0/3187360575 shutdown_connections 2023-11-28T12:00:05.036 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.029+0000 7ff241e20700 1 -- 172.21.15.39:0/3187360575 wait complete. 2023-11-28T12:00:05.062 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T12:00:05.253 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.249+0000 7f7ec9d5d700 1 Processor -- start 2023-11-28T12:00:05.253 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.249+0000 7f7ec9d5d700 1 -- start start 2023-11-28T12:00:05.255 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.249+0000 7f7ec9d5d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7ec4071aa0 0x7f7ec406d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:05.256 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.249+0000 7f7ec9d5d700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ec406c600 con 0x7f7ec4069e00 2023-11-28T12:00:05.256 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.249+0000 7f7ec9d5d700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ec40722f0 con 0x7f7ec415c640 2023-11-28T12:00:05.256 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.249+0000 7f7ec9d5d700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ec406cef0 con 0x7f7ec4071aa0 2023-11-28T12:00:05.256 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.249+0000 7f7ec955c700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f7ec4069e00 0x7f7ec40d0580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42718/0 (socket says 172.21.15.39:42718) 2023-11-28T12:00:05.256 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.249+0000 7f7ec955c700 1 -- 172.21.15.39:0/441943377 learned_addr learned my addr 172.21.15.39:0/441943377 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T12:00:05.256 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.253+0000 7f7ebbfff700 1 --2- 172.21.15.39:0/441943377 >> v2:172.21.15.184:3300/0 conn(0x7f7ec4071aa0 0x7f7ec406d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:05.257 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.253+0000 7f7ebb7fe700 1 -- 172.21.15.39:0/441943377 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4177281282 0 0) 0x7f7ec406c600 con 0x7f7ec4069e00 2023-11-28T12:00:05.257 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.253+0000 7f7ebb7fe700 1 -- 172.21.15.39:0/441943377 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7eac0035d0 con 0x7f7ec4069e00 2023-11-28T12:00:05.258 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.253+0000 7f7ebbfff700 1 -- 172.21.15.39:0/441943377 >> v1:172.21.15.184:6789/0 conn(0x7f7ec415c640 legacy=0x7f7ec40d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:05.258 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.253+0000 7f7ebb7fe700 1 -- 172.21.15.39:0/441943377 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1596900361 0 0) 0x7f7ec40722f0 con 0x7f7ec415c640 2023-11-28T12:00:05.258 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.253+0000 7f7ebbfff700 1 -- 172.21.15.39:0/441943377 >> v1:172.21.15.39:6789/0 conn(0x7f7ec4069e00 legacy=0x7f7ec40d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:05.258 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.253+0000 7f7ebbfff700 1 -- 172.21.15.39:0/441943377 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec415ca10 con 0x7f7ec4071aa0 2023-11-28T12:00:05.258 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.253+0000 7f7ebbfff700 1 --2- 172.21.15.39:0/441943377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ec4071aa0 0x7f7ec406d310 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4009850 tx=0x7f7eb4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=668a2ad757de1892 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:05.259 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.253+0000 7f7ebb7fe700 1 -- 172.21.15.39:0/441943377 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb4011830 con 0x7f7ec4071aa0 2023-11-28T12:00:05.259 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.253+0000 7f7ebb7fe700 1 -- 172.21.15.39:0/441943377 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb4011990 con 0x7f7ec4071aa0 2023-11-28T12:00:05.259 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.253+0000 7f7ebb7fe700 1 -- 172.21.15.39:0/441943377 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb4011d40 con 0x7f7ec4071aa0 2023-11-28T12:00:05.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.257+0000 7f7ec9d5d700 1 -- 172.21.15.39:0/441943377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ec4071aa0 msgr2=0x7f7ec406d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:05.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.257+0000 7f7ec9d5d700 1 --2- 172.21.15.39:0/441943377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ec4071aa0 0x7f7ec406d310 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4009850 tx=0x7f7eb4009b60 comp rx=0 tx=0).stop 2023-11-28T12:00:05.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.257+0000 7f7ec9d5d700 1 -- 172.21.15.39:0/441943377 shutdown_connections 2023-11-28T12:00:05.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.257+0000 7f7ec9d5d700 1 --2- 172.21.15.39:0/441943377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ec4071aa0 0x7f7ec406d310 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:05.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.257+0000 7f7ec9d5d700 1 -- 172.21.15.39:0/441943377 >> 172.21.15.39:0/441943377 conn(0x7f7ec40b6520 msgr2=0x7f7ec4071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:05.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.257+0000 7f7ec9d5d700 1 -- 172.21.15.39:0/441943377 shutdown_connections 2023-11-28T12:00:05.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.257+0000 7f7ec9d5d700 1 -- 172.21.15.39:0/441943377 wait complete. 2023-11-28T12:00:05.263 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.257+0000 7f7ec9d5d700 1 Processor -- start 2023-11-28T12:00:05.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.257+0000 7f7ec9d5d700 1 -- start start 2023-11-28T12:00:05.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.261+0000 7f7ec9d5d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ec4069e00 0x7f7ec40ce930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:05.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.261+0000 7f7ec9d5d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ec4071aa0 0x7f7ec41f18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:05.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.261+0000 7f7ec9d5d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ec415c640 0x7f7ec40cb710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:05.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.261+0000 7f7ec9d5d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec40d38f0 con 0x7f7ec4071aa0 2023-11-28T12:00:05.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.261+0000 7f7ec9d5d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec40cd890 con 0x7f7ec4069e00 2023-11-28T12:00:05.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.261+0000 7f7ec9d5d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec40cdb70 con 0x7f7ec415c640 2023-11-28T12:00:05.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.261+0000 7f7ebbfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ec4071aa0 0x7f7ec41f18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:05.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.261+0000 7f7ebbfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ec4071aa0 0x7f7ec41f18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55714/0 (socket says 172.21.15.39:55714) 2023-11-28T12:00:05.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.261+0000 7f7ebbfff700 1 -- 172.21.15.39:0/2655179083 learned_addr learned my addr 172.21.15.39:0/2655179083 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:05.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.261+0000 7f7ec8d5b700 1 --2- 172.21.15.39:0/2655179083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ec4069e00 0x7f7ec40ce930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:05.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.261+0000 7f7ec955c700 1 --2- 172.21.15.39:0/2655179083 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ec415c640 0x7f7ec40cb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:05.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.261+0000 7f7ebbfff700 1 -- 172.21.15.39:0/2655179083 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ec415c640 msgr2=0x7f7ec40cb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:05.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.261+0000 7f7ebbfff700 1 --2- 172.21.15.39:0/2655179083 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ec415c640 0x7f7ec40cb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:05.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.261+0000 7f7ebbfff700 1 -- 172.21.15.39:0/2655179083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ec4069e00 msgr2=0x7f7ec40ce930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:05.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.261+0000 7f7ebbfff700 1 --2- 172.21.15.39:0/2655179083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ec4069e00 0x7f7ec40ce930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:05.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.261+0000 7f7ebbfff700 1 -- 172.21.15.39:0/2655179083 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb40094b0 con 0x7f7ec4071aa0 2023-11-28T12:00:05.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.261+0000 7f7ec955c700 1 --2- 172.21.15.39:0/2655179083 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ec415c640 0x7f7ec40cb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:00:05.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.265+0000 7f7ebbfff700 1 --2- 172.21.15.39:0/2655179083 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ec4071aa0 0x7f7ec41f18c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f7eb40090b0 tx=0x7f7eb4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:05.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.265+0000 7f7eb97fa700 1 -- 172.21.15.39:0/2655179083 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb401aa00 con 0x7f7ec4071aa0 2023-11-28T12:00:05.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.265+0000 7f7eb97fa700 1 -- 172.21.15.39:0/2655179083 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb401f070 con 0x7f7ec4071aa0 2023-11-28T12:00:05.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.265+0000 7f7eb97fa700 1 -- 172.21.15.39:0/2655179083 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb401adc0 con 0x7f7ec4071aa0 2023-11-28T12:00:05.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.265+0000 7f7ec9d5d700 1 -- 172.21.15.39:0/2655179083 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec406c830 con 0x7f7ec4071aa0 2023-11-28T12:00:05.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.265+0000 7f7ec9d5d700 1 -- 172.21.15.39:0/2655179083 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec4072010 con 0x7f7ec4071aa0 2023-11-28T12:00:05.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.265+0000 7f7ec9d5d700 1 -- 172.21.15.39:0/2655179083 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ec406cb10 con 0x7f7ec4071aa0 2023-11-28T12:00:05.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.269+0000 7f7eb97fa700 1 -- 172.21.15.39:0/2655179083 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7eb400f050 con 0x7f7ec4071aa0 2023-11-28T12:00:05.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.269+0000 7f7eb97fa700 1 --2- 172.21.15.39:0/2655179083 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7eb0064ee0 0x7f7eb0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:05.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.269+0000 7f7eb97fa700 1 -- 172.21.15.39:0/2655179083 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7eb4083280 con 0x7f7ec4071aa0 2023-11-28T12:00:05.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.269+0000 7f7ec8d5b700 1 --2- 172.21.15.39:0/2655179083 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7eb0064ee0 0x7f7eb0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:05.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.269+0000 7f7ec8d5b700 1 --2- 172.21.15.39:0/2655179083 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7eb0064ee0 0x7f7eb0067390 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0007fd0 tx=0x7f7ec0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:05.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.277+0000 7f7eb97fa700 1 -- 172.21.15.39:0/2655179083 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7eb4051170 con 0x7f7ec4071aa0 2023-11-28T12:00:05.488 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.481+0000 7f7ec9d5d700 1 -- 172.21.15.39:0/2655179083 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7ec4073cb0 con 0x7f7ec4071aa0 2023-11-28T12:00:05.874 INFO:tasks.ceph.mon.a.smithi039.stderr:2023-11-28T12:00:05.869+0000 7ff4e35f9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T12:00:05.885 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.877+0000 7f7eb97fa700 1 -- 172.21.15.39:0/2655179083 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v34) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7eb4021090 con 0x7f7ec4071aa0 2023-11-28T12:00:05.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.881+0000 7f7ec9d5d700 1 -- 172.21.15.39:0/2655179083 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7eb0064ee0 msgr2=0x7f7eb0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:05.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.881+0000 7f7ec9d5d700 1 --2- 172.21.15.39:0/2655179083 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7eb0064ee0 0x7f7eb0067390 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0007fd0 tx=0x7f7ec0009040 comp rx=0 tx=0).stop 2023-11-28T12:00:05.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.881+0000 7f7ec9d5d700 1 -- 172.21.15.39:0/2655179083 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ec4071aa0 msgr2=0x7f7ec41f18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:05.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.881+0000 7f7ec9d5d700 1 --2- 172.21.15.39:0/2655179083 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ec4071aa0 0x7f7ec41f18c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f7eb40090b0 tx=0x7f7eb4004770 comp rx=0 tx=0).stop 2023-11-28T12:00:05.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.885+0000 7f7ec9d5d700 1 -- 172.21.15.39:0/2655179083 shutdown_connections 2023-11-28T12:00:05.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.885+0000 7f7ec9d5d700 1 --2- 172.21.15.39:0/2655179083 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ec415c640 0x7f7ec40cb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:05.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.885+0000 7f7ec9d5d700 1 --2- 172.21.15.39:0/2655179083 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ec4071aa0 0x7f7ec41f18c0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:05.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.885+0000 7f7ec9d5d700 1 --2- 172.21.15.39:0/2655179083 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7eb0064ee0 0x7f7eb0067390 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:05.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.885+0000 7f7ec9d5d700 1 --2- 172.21.15.39:0/2655179083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ec4069e00 0x7f7ec40ce930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:05.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.885+0000 7f7ec9d5d700 1 -- 172.21.15.39:0/2655179083 >> 172.21.15.39:0/2655179083 conn(0x7f7ec40b6520 msgr2=0x7f7ec40b22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:05.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.885+0000 7f7ec9d5d700 1 -- 172.21.15.39:0/2655179083 shutdown_connections 2023-11-28T12:00:05.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:05.885+0000 7f7ec9d5d700 1 -- 172.21.15.39:0/2655179083 wait complete. 2023-11-28T12:00:05.892 INFO:teuthology.orchestra.run.smithi039.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T12:00:05.903 INFO:tasks.ceph.mds.c.smithi039.stderr: -4186> 2023-11-28T11:59:50.706+0000 7ffa4bf34700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T12:00:05.914 INFO:tasks.ceph.mds.c.smithi039.stderr: -1784> 2023-11-28T11:59:55.017+0000 7ffa4872d700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={6402=0-4194304@1} caps={6402=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=6402 | request=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x5591a267fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(11)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-11-28T12:00:05.921 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-28T12:00:05.970 INFO:tasks.ceph.mds.c.smithi039.stdout:starting mds.c at 2023-11-28T12:00:06.104 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.097+0000 7f62bb020700 1 Processor -- start 2023-11-28T12:00:06.104 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.097+0000 7f62bb020700 1 -- start start 2023-11-28T12:00:06.106 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.101+0000 7f62bb020700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f62b40b43a0 0x7f62b415e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:06.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.101+0000 7f62bb020700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f62b40b1640 0x7f62b4070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:06.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.101+0000 7f62bb020700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62b415a550 con 0x7f62b40c9040 2023-11-28T12:00:06.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.101+0000 7f62bb020700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62b406b0a0 con 0x7f62b40b43a0 2023-11-28T12:00:06.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.101+0000 7f62bb020700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62b40caac0 con 0x7f62b40b1640 2023-11-28T12:00:06.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.101+0000 7f62ba01e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f62b40b43a0 0x7f62b415e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:06.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.101+0000 7f62ba81f700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f62b40c9040 0x7f62b4069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42720/0 (socket says 172.21.15.39:42720) 2023-11-28T12:00:06.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.101+0000 7f62ba01e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f62b40b43a0 0x7f62b415e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55746/0 (socket says 172.21.15.39:55746) 2023-11-28T12:00:06.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.101+0000 7f62ba81f700 1 -- 172.21.15.39:0/1891166895 learned_addr learned my addr 172.21.15.39:0/1891166895 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T12:00:06.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.101+0000 7f62b981d700 1 --2- 172.21.15.39:0/1891166895 >> v2:172.21.15.184:3300/0 conn(0x7f62b40b1640 0x7f62b4070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:06.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.101+0000 7f62ba01e700 1 -- 172.21.15.39:0/1891166895 >> v2:172.21.15.184:3300/0 conn(0x7f62b40b1640 msgr2=0x7f62b4070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:06.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.101+0000 7f62ba01e700 1 --2- 172.21.15.39:0/1891166895 >> v2:172.21.15.184:3300/0 conn(0x7f62b40b1640 0x7f62b4070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:06.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.101+0000 7f62ba01e700 1 -- 172.21.15.39:0/1891166895 >> v1:172.21.15.39:6789/0 conn(0x7f62b40c9040 legacy=0x7f62b4069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:06.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.101+0000 7f62ba01e700 1 -- 172.21.15.39:0/1891166895 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b40cada0 con 0x7f62b40b43a0 2023-11-28T12:00:06.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.101+0000 7f62ba01e700 1 --2- 172.21.15.39:0/1891166895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62b40b43a0 0x7f62b415e5d0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f62b4072d40 tx=0x7f62b0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a79921fdceafa0f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:06.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.105+0000 7f62b901c700 1 -- 172.21.15.39:0/1891166895 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b0011830 con 0x7f62b40b43a0 2023-11-28T12:00:06.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.105+0000 7f62b901c700 1 -- 172.21.15.39:0/1891166895 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b0011990 con 0x7f62b40b43a0 2023-11-28T12:00:06.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.105+0000 7f62b901c700 1 -- 172.21.15.39:0/1891166895 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b0011d20 con 0x7f62b40b43a0 2023-11-28T12:00:06.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.105+0000 7f62bb020700 1 -- 172.21.15.39:0/1891166895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62b40b43a0 msgr2=0x7f62b415e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:06.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.105+0000 7f62bb020700 1 --2- 172.21.15.39:0/1891166895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62b40b43a0 0x7f62b415e5d0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f62b4072d40 tx=0x7f62b0009b30 comp rx=0 tx=0).stop 2023-11-28T12:00:06.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.105+0000 7f62bb020700 1 -- 172.21.15.39:0/1891166895 shutdown_connections 2023-11-28T12:00:06.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.105+0000 7f62bb020700 1 --2- 172.21.15.39:0/1891166895 >> v2:172.21.15.184:3300/0 conn(0x7f62b40b1640 0x7f62b4070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:06.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.105+0000 7f62bb020700 1 --2- 172.21.15.39:0/1891166895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62b40b43a0 0x7f62b415e5d0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:06.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.105+0000 7f62bb020700 1 -- 172.21.15.39:0/1891166895 >> 172.21.15.39:0/1891166895 conn(0x7f62b40b0f80 msgr2=0x7f62b40ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:06.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.105+0000 7f62bb020700 1 -- 172.21.15.39:0/1891166895 shutdown_connections 2023-11-28T12:00:06.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.105+0000 7f62bb020700 1 -- 172.21.15.39:0/1891166895 wait complete. 2023-11-28T12:00:06.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.105+0000 7f62bb020700 1 Processor -- start 2023-11-28T12:00:06.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.105+0000 7f62bb020700 1 -- start start 2023-11-28T12:00:06.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.109+0000 7f62bb020700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62b40b1640 0x7f62b41f5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:06.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.109+0000 7f62bb020700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62b40b43a0 0x7f62b40c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:06.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.109+0000 7f62bb020700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62b40c9040 0x7f62b40c7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:06.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.109+0000 7f62bb020700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b41f2a00 con 0x7f62b40b43a0 2023-11-28T12:00:06.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.109+0000 7f62bb020700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b41f5e90 con 0x7f62b40b1640 2023-11-28T12:00:06.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.109+0000 7f62bb020700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b40c8110 con 0x7f62b40c9040 2023-11-28T12:00:06.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.109+0000 7f62b981d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62b40b43a0 0x7f62b40c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:06.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.109+0000 7f62b981d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62b40b43a0 0x7f62b40c7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55752/0 (socket says 172.21.15.39:55752) 2023-11-28T12:00:06.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.109+0000 7f62b981d700 1 -- 172.21.15.39:0/1523418525 learned_addr learned my addr 172.21.15.39:0/1523418525 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:06.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.109+0000 7f62ba01e700 1 --2- 172.21.15.39:0/1523418525 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62b40b1640 0x7f62b41f5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:06.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.109+0000 7f62ba81f700 1 --2- 172.21.15.39:0/1523418525 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62b40c9040 0x7f62b40c7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:06.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.109+0000 7f62b981d700 1 -- 172.21.15.39:0/1523418525 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62b40c9040 msgr2=0x7f62b40c7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:06.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.109+0000 7f62b981d700 1 --2- 172.21.15.39:0/1523418525 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62b40c9040 0x7f62b40c7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:06.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.109+0000 7f62b981d700 1 -- 172.21.15.39:0/1523418525 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62b40b1640 msgr2=0x7f62b41f5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:06.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.109+0000 7f62b981d700 1 --2- 172.21.15.39:0/1523418525 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62b40b1640 0x7f62b41f5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:06.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.109+0000 7f62b981d700 1 -- 172.21.15.39:0/1523418525 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b00094b0 con 0x7f62b40b43a0 2023-11-28T12:00:06.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.109+0000 7f62b981d700 1 --2- 172.21.15.39:0/1523418525 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62b40b43a0 0x7f62b40c7bd0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f62a400e870 tx=0x7f62a400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:06.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.109+0000 7f62aaffd700 1 -- 172.21.15.39:0/1523418525 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a40095a0 con 0x7f62b40b43a0 2023-11-28T12:00:06.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.109+0000 7f62aaffd700 1 -- 172.21.15.39:0/1523418525 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a4013680 con 0x7f62b40b43a0 2023-11-28T12:00:06.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.109+0000 7f62aaffd700 1 -- 172.21.15.39:0/1523418525 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a40139f0 con 0x7f62b40b43a0 2023-11-28T12:00:06.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.109+0000 7f62bb020700 1 -- 172.21.15.39:0/1523418525 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b406b5d0 con 0x7f62b40b43a0 2023-11-28T12:00:06.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.109+0000 7f62bb020700 1 -- 172.21.15.39:0/1523418525 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b406b2f0 con 0x7f62b40b43a0 2023-11-28T12:00:06.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.113+0000 7f62bb020700 1 -- 172.21.15.39:0/1523418525 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62b415eb10 con 0x7f62b40b43a0 2023-11-28T12:00:06.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.113+0000 7f62aaffd700 1 -- 172.21.15.39:0/1523418525 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f62a4019030 con 0x7f62b40b43a0 2023-11-28T12:00:06.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.117+0000 7f62aaffd700 1 --2- 172.21.15.39:0/1523418525 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6298064f10 0x7f62980673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:06.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.117+0000 7f62aaffd700 1 -- 172.21.15.39:0/1523418525 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f62a4081e50 con 0x7f62b40b43a0 2023-11-28T12:00:06.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.117+0000 7f62ba01e700 1 --2- 172.21.15.39:0/1523418525 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6298064f10 0x7f62980673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:06.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.117+0000 7f62ba01e700 1 --2- 172.21.15.39:0/1523418525 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6298064f10 0x7f62980673c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f62b0000c00 tx=0x7f62b0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:06.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.121+0000 7f62aaffd700 1 -- 172.21.15.39:0/1523418525 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f62a404fd60 con 0x7f62b40b43a0 2023-11-28T12:00:06.340 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.333+0000 7f62bb020700 1 -- 172.21.15.39:0/1523418525 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f62b40b1aa0 con 0x7f62b40b43a0 2023-11-28T12:00:06.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.901+0000 7f62aaffd700 1 -- 172.21.15.39:0/1523418525 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v35) v1 ==== 104+0+0 (secure 0 0 0) 0x7f62b40b1aa0 con 0x7f62b40b43a0 2023-11-28T12:00:06.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.905+0000 7f62bb020700 1 -- 172.21.15.39:0/1523418525 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6298064f10 msgr2=0x7f62980673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:06.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.905+0000 7f62bb020700 1 --2- 172.21.15.39:0/1523418525 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6298064f10 0x7f62980673c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f62b0000c00 tx=0x7f62b0008030 comp rx=0 tx=0).stop 2023-11-28T12:00:06.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.905+0000 7f62bb020700 1 -- 172.21.15.39:0/1523418525 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62b40b43a0 msgr2=0x7f62b40c7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:06.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.905+0000 7f62bb020700 1 --2- 172.21.15.39:0/1523418525 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62b40b43a0 0x7f62b40c7bd0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f62a400e870 tx=0x7f62a400eb80 comp rx=0 tx=0).stop 2023-11-28T12:00:06.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.905+0000 7f62bb020700 1 -- 172.21.15.39:0/1523418525 shutdown_connections 2023-11-28T12:00:06.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.905+0000 7f62bb020700 1 --2- 172.21.15.39:0/1523418525 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62b40c9040 0x7f62b40c7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:06.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.905+0000 7f62bb020700 1 --2- 172.21.15.39:0/1523418525 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62b40b43a0 0x7f62b40c7bd0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:06.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.905+0000 7f62bb020700 1 --2- 172.21.15.39:0/1523418525 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f6298064f10 0x7f62980673c0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:06.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.905+0000 7f62bb020700 1 --2- 172.21.15.39:0/1523418525 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62b40b1640 0x7f62b41f5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:06.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.905+0000 7f62bb020700 1 -- 172.21.15.39:0/1523418525 >> 172.21.15.39:0/1523418525 conn(0x7f62b40b0f80 msgr2=0x7f62b40ab860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:06.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.905+0000 7f62bb020700 1 -- 172.21.15.39:0/1523418525 shutdown_connections 2023-11-28T12:00:06.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:06.905+0000 7f62bb020700 1 -- 172.21.15.39:0/1523418525 wait complete. 2023-11-28T12:00:06.937 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-28T12:00:07.177 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.173+0000 7f923111d700 1 Processor -- start 2023-11-28T12:00:07.177 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.173+0000 7f923111d700 1 -- start start 2023-11-28T12:00:07.178 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.173+0000 7f923111d700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f922c15c6e0 0x7f922c071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:07.178 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.173+0000 7f923111d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f922c071fe0 0x7f922c069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:07.179 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.173+0000 7f923111d700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f922c06a790 con 0x7f922c06a340 2023-11-28T12:00:07.179 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.173+0000 7f923111d700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f922c0d2800 con 0x7f922c15c6e0 2023-11-28T12:00:07.179 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.173+0000 7f923111d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f922c15cab0 con 0x7f922c071fe0 2023-11-28T12:00:07.179 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.173+0000 7f923091c700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f922c06a340 0x7f922c0b79a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:42730/0 (socket says 172.21.15.39:42730) 2023-11-28T12:00:07.179 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.173+0000 7f923091c700 1 -- 172.21.15.39:0/3766556065 learned_addr learned my addr 172.21.15.39:0/3766556065 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T12:00:07.180 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.173+0000 7f922bfff700 1 --2- 172.21.15.39:0/3766556065 >> v2:172.21.15.39:3300/0 conn(0x7f922c15c6e0 0x7f922c071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:07.180 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.173+0000 7f922b7fe700 1 --2- 172.21.15.39:0/3766556065 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f922c071fe0 0x7f922c069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:07.180 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.173+0000 7f922affd700 1 -- 172.21.15.39:0/3766556065 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1854172667 0 0) 0x7f9224001490 con 0x7f922c06a340 2023-11-28T12:00:07.181 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.173+0000 7f922affd700 1 -- 172.21.15.39:0/3766556065 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92140035d0 con 0x7f922c06a340 2023-11-28T12:00:07.181 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.173+0000 7f922b7fe700 1 -- 172.21.15.39:0/3766556065 >> v2:172.21.15.39:3300/0 conn(0x7f922c15c6e0 msgr2=0x7f922c071aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:07.181 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.173+0000 7f922b7fe700 1 --2- 172.21.15.39:0/3766556065 >> v2:172.21.15.39:3300/0 conn(0x7f922c15c6e0 0x7f922c071aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:07.181 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.173+0000 7f922b7fe700 1 -- 172.21.15.39:0/3766556065 >> v1:172.21.15.39:6789/0 conn(0x7f922c06a340 legacy=0x7f922c0b79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:07.181 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.177+0000 7f922b7fe700 1 -- 172.21.15.39:0/3766556065 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f922c0702d0 con 0x7f922c071fe0 2023-11-28T12:00:07.181 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.177+0000 7f922bfff700 1 --2- 172.21.15.39:0/3766556065 >> v2:172.21.15.39:3300/0 conn(0x7f922c15c6e0 0x7f922c071aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:00:07.181 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.177+0000 7f922b7fe700 1 --2- 172.21.15.39:0/3766556065 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f922c071fe0 0x7f922c069e00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9220009850 tx=0x7f9220009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a8ce21d846f3462 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:07.182 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.177+0000 7f922affd700 1 -- 172.21.15.39:0/3766556065 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9220011830 con 0x7f922c071fe0 2023-11-28T12:00:07.182 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.177+0000 7f922affd700 1 -- 172.21.15.39:0/3766556065 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9220011990 con 0x7f922c071fe0 2023-11-28T12:00:07.182 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.177+0000 7f922affd700 1 -- 172.21.15.39:0/3766556065 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9220011d40 con 0x7f922c071fe0 2023-11-28T12:00:07.183 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.177+0000 7f923111d700 1 -- 172.21.15.39:0/3766556065 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f922c071fe0 msgr2=0x7f922c069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:07.183 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.177+0000 7f923111d700 1 --2- 172.21.15.39:0/3766556065 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f922c071fe0 0x7f922c069e00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9220009850 tx=0x7f9220009b60 comp rx=0 tx=0).stop 2023-11-28T12:00:07.183 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.177+0000 7f923111d700 1 -- 172.21.15.39:0/3766556065 shutdown_connections 2023-11-28T12:00:07.183 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.177+0000 7f923111d700 1 --2- 172.21.15.39:0/3766556065 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f922c071fe0 0x7f922c069e00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:07.184 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.177+0000 7f923111d700 1 --2- 172.21.15.39:0/3766556065 >> v2:172.21.15.39:3300/0 conn(0x7f922c15c6e0 0x7f922c071aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:07.184 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.177+0000 7f923111d700 1 -- 172.21.15.39:0/3766556065 >> 172.21.15.39:0/3766556065 conn(0x7f922c0b65b0 msgr2=0x7f922c071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:07.184 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.177+0000 7f923111d700 1 -- 172.21.15.39:0/3766556065 shutdown_connections 2023-11-28T12:00:07.184 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.177+0000 7f923111d700 1 -- 172.21.15.39:0/3766556065 wait complete. 2023-11-28T12:00:07.186 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.181+0000 7f923111d700 1 Processor -- start 2023-11-28T12:00:07.186 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.181+0000 7f923111d700 1 -- start start 2023-11-28T12:00:07.188 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.181+0000 7f923111d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f922c06a340 0x7f922c157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:07.188 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.181+0000 7f923111d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f922c071fe0 0x7f922c1550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:07.188 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.181+0000 7f923111d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f922c15c6e0 0x7f922c0c55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:07.189 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.181+0000 7f923111d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922c155620 con 0x7f922c06a340 2023-11-28T12:00:07.189 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.181+0000 7f923111d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922c1e4ea0 con 0x7f922c071fe0 2023-11-28T12:00:07.189 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.181+0000 7f923111d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f922c1e5110 con 0x7f922c15c6e0 2023-11-28T12:00:07.189 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.185+0000 7f922bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f922c06a340 0x7f922c157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:07.189 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.185+0000 7f922bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f922c06a340 0x7f922c157760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55778/0 (socket says 172.21.15.39:55778) 2023-11-28T12:00:07.189 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.185+0000 7f922bfff700 1 -- 172.21.15.39:0/3181512075 learned_addr learned my addr 172.21.15.39:0/3181512075 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:07.190 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.185+0000 7f923091c700 1 --2- 172.21.15.39:0/3181512075 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f922c15c6e0 0x7f922c0c55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:07.190 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.185+0000 7f922b7fe700 1 --2- 172.21.15.39:0/3181512075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f922c071fe0 0x7f922c1550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:07.190 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.185+0000 7f922bfff700 1 -- 172.21.15.39:0/3181512075 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f922c15c6e0 msgr2=0x7f922c0c55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:07.191 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.185+0000 7f922bfff700 1 --2- 172.21.15.39:0/3181512075 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f922c15c6e0 0x7f922c0c55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:07.191 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.185+0000 7f922bfff700 1 -- 172.21.15.39:0/3181512075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f922c071fe0 msgr2=0x7f922c1550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:07.191 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.185+0000 7f922bfff700 1 --2- 172.21.15.39:0/3181512075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f922c071fe0 0x7f922c1550e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:07.191 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.185+0000 7f922bfff700 1 -- 172.21.15.39:0/3181512075 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f921c0094b0 con 0x7f922c06a340 2023-11-28T12:00:07.191 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.185+0000 7f923091c700 1 --2- 172.21.15.39:0/3181512075 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f922c15c6e0 0x7f922c0c55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:00:07.191 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.185+0000 7f922bfff700 1 --2- 172.21.15.39:0/3181512075 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f922c06a340 0x7f922c157760 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f921c00ebe0 tx=0x7f921c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:07.191 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.185+0000 7f9228ff9700 1 -- 172.21.15.39:0/3181512075 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c00c8b0 con 0x7f922c06a340 2023-11-28T12:00:07.191 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.185+0000 7f9228ff9700 1 -- 172.21.15.39:0/3181512075 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921c00ca10 con 0x7f922c06a340 2023-11-28T12:00:07.191 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.185+0000 7f9228ff9700 1 -- 172.21.15.39:0/3181512075 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c00cda0 con 0x7f922c06a340 2023-11-28T12:00:07.191 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.185+0000 7f923111d700 1 -- 172.21.15.39:0/3181512075 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92200094b0 con 0x7f922c06a340 2023-11-28T12:00:07.192 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.185+0000 7f923111d700 1 -- 172.21.15.39:0/3181512075 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f922c0d2cf0 con 0x7f922c06a340 2023-11-28T12:00:07.192 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.185+0000 7f923111d700 1 -- 172.21.15.39:0/3181512075 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f922c0d2a10 con 0x7f922c06a340 2023-11-28T12:00:07.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.189+0000 7f9228ff9700 1 -- 172.21.15.39:0/3181512075 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f921c019030 con 0x7f922c06a340 2023-11-28T12:00:07.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.189+0000 7f9228ff9700 1 --2- 172.21.15.39:0/3181512075 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9218064f10 0x7f92180673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:07.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.193+0000 7f9228ff9700 1 -- 172.21.15.39:0/3181512075 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f921c082130 con 0x7f922c06a340 2023-11-28T12:00:07.197 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.193+0000 7f922b7fe700 1 --2- 172.21.15.39:0/3181512075 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9218064f10 0x7f92180673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:07.198 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.193+0000 7f922b7fe700 1 --2- 172.21.15.39:0/3181512075 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9218064f10 0x7f92180673c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f92200090b0 tx=0x7f9220008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:07.201 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.197+0000 7f9228ff9700 1 -- 172.21.15.39:0/3181512075 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f921c050040 con 0x7f922c06a340 2023-11-28T12:00:07.378 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:07.373+0000 7f923111d700 1 -- 172.21.15.39:0/3181512075 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f922c0d2fd0 con 0x7f922c06a340 2023-11-28T12:00:08.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.001+0000 7f9228ff9700 1 -- 172.21.15.39:0/3181512075 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v72) v1 ==== 181+0+0 (secure 0 0 0) 0x7f921c053660 con 0x7f922c06a340 2023-11-28T12:00:08.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.005+0000 7f923111d700 1 -- 172.21.15.39:0/3181512075 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9218064f10 msgr2=0x7f92180673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:08.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.005+0000 7f923111d700 1 --2- 172.21.15.39:0/3181512075 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9218064f10 0x7f92180673c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f92200090b0 tx=0x7f9220008030 comp rx=0 tx=0).stop 2023-11-28T12:00:08.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.005+0000 7f923111d700 1 -- 172.21.15.39:0/3181512075 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f922c06a340 msgr2=0x7f922c157760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:08.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.005+0000 7f923111d700 1 --2- 172.21.15.39:0/3181512075 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f922c06a340 0x7f922c157760 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f921c00ebe0 tx=0x7f921c009e30 comp rx=0 tx=0).stop 2023-11-28T12:00:08.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.005+0000 7f923111d700 1 -- 172.21.15.39:0/3181512075 shutdown_connections 2023-11-28T12:00:08.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.005+0000 7f923111d700 1 --2- 172.21.15.39:0/3181512075 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f922c15c6e0 0x7f922c0c55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:08.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.005+0000 7f923111d700 1 --2- 172.21.15.39:0/3181512075 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f9218064f10 0x7f92180673c0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:08.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.005+0000 7f923111d700 1 --2- 172.21.15.39:0/3181512075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f922c071fe0 0x7f922c1550e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:08.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.005+0000 7f923111d700 1 --2- 172.21.15.39:0/3181512075 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f922c06a340 0x7f922c157760 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:08.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.005+0000 7f923111d700 1 -- 172.21.15.39:0/3181512075 >> 172.21.15.39:0/3181512075 conn(0x7f922c0b65b0 msgr2=0x7f922c09bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:08.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.005+0000 7f923111d700 1 -- 172.21.15.39:0/3181512075 shutdown_connections 2023-11-28T12:00:08.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.005+0000 7f923111d700 1 -- 172.21.15.39:0/3181512075 wait complete. 2023-11-28T12:00:08.016 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_metadata' removed 2023-11-28T12:00:08.037 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-28T12:00:08.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.229+0000 7fdbe9a1e700 1 Processor -- start 2023-11-28T12:00:08.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.229+0000 7fdbe9a1e700 1 -- start start 2023-11-28T12:00:08.236 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.229+0000 7fdbe9a1e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbe41535f0 0x7fdbe415d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:08.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.233+0000 7fdbe9a1e700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbe415d270 con 0x7fdbe406b0e0 2023-11-28T12:00:08.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.233+0000 7fdbe9a1e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbe406b530 con 0x7fdbe40cc8c0 2023-11-28T12:00:08.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.233+0000 7fdbe9a1e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe40ce7c0 con 0x7fdbe41535f0 2023-11-28T12:00:08.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.233+0000 7fdbe27fc700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fdbe406b0e0 0x7fdbe40cc1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56056/0 (socket says 172.21.15.39:56056) 2023-11-28T12:00:08.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.233+0000 7fdbe27fc700 1 -- 172.21.15.39:0/629325298 learned_addr learned my addr 172.21.15.39:0/629325298 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T12:00:08.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.233+0000 7fdbe2ffd700 1 --2- 172.21.15.39:0/629325298 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbe41535f0 0x7fdbe415d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:08.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.233+0000 7fdbe1ffb700 1 -- 172.21.15.39:0/629325298 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3860379314 0 0) 0x7fdbe415d270 con 0x7fdbe406b0e0 2023-11-28T12:00:08.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.233+0000 7fdbe1ffb700 1 -- 172.21.15.39:0/629325298 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbcc0057e0 con 0x7fdbe406b0e0 2023-11-28T12:00:08.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.233+0000 7fdbe2ffd700 1 -- 172.21.15.39:0/629325298 >> v1:172.21.15.184:6789/0 conn(0x7fdbe40cc8c0 legacy=0x7fdbe4159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:08.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.233+0000 7fdbe2ffd700 1 -- 172.21.15.39:0/629325298 >> v1:172.21.15.39:6789/0 conn(0x7fdbe406b0e0 legacy=0x7fdbe40cc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:08.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.233+0000 7fdbe1ffb700 1 -- 172.21.15.39:0/629325298 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1359457201 0 0) 0x7fdbe406b530 con 0x7fdbe40cc8c0 2023-11-28T12:00:08.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.233+0000 7fdbe2ffd700 1 -- 172.21.15.39:0/629325298 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe415cc20 con 0x7fdbe41535f0 2023-11-28T12:00:08.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.233+0000 7fdbe2ffd700 1 --2- 172.21.15.39:0/629325298 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbe41535f0 0x7fdbe415d700 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4009880 tx=0x7fdbd4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed5dc52e9905908e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:08.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.233+0000 7fdbe1ffb700 1 -- 172.21.15.39:0/629325298 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd4011830 con 0x7fdbe41535f0 2023-11-28T12:00:08.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.233+0000 7fdbe1ffb700 1 -- 172.21.15.39:0/629325298 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd4011990 con 0x7fdbe41535f0 2023-11-28T12:00:08.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.233+0000 7fdbe1ffb700 1 -- 172.21.15.39:0/629325298 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd4011d20 con 0x7fdbe41535f0 2023-11-28T12:00:08.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.233+0000 7fdbe9a1e700 1 -- 172.21.15.39:0/629325298 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbe41535f0 msgr2=0x7fdbe415d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:08.241 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.233+0000 7fdbe9a1e700 1 --2- 172.21.15.39:0/629325298 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbe41535f0 0x7fdbe415d700 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4009880 tx=0x7fdbd4009b90 comp rx=0 tx=0).stop 2023-11-28T12:00:08.241 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.237+0000 7fdbe9a1e700 1 -- 172.21.15.39:0/629325298 shutdown_connections 2023-11-28T12:00:08.241 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.237+0000 7fdbe9a1e700 1 --2- 172.21.15.39:0/629325298 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbe41535f0 0x7fdbe415d700 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:08.241 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.237+0000 7fdbe9a1e700 1 -- 172.21.15.39:0/629325298 >> 172.21.15.39:0/629325298 conn(0x7fdbe40b12e0 msgr2=0x7fdbe40b16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:08.241 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.237+0000 7fdbe9a1e700 1 -- 172.21.15.39:0/629325298 shutdown_connections 2023-11-28T12:00:08.241 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.237+0000 7fdbe9a1e700 1 -- 172.21.15.39:0/629325298 wait complete. 2023-11-28T12:00:08.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.237+0000 7fdbe9a1e700 1 Processor -- start 2023-11-28T12:00:08.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.237+0000 7fdbe9a1e700 1 -- start start 2023-11-28T12:00:08.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.241+0000 7fdbe9a1e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbe406b0e0 0x7fdbe40711c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:08.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.241+0000 7fdbe9a1e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbe40cc8c0 0x7fdbe4158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:08.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.241+0000 7fdbe9a1e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdbe41535f0 0x7fdbe4158990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:08.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.241+0000 7fdbe9a1e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe41580c0 con 0x7fdbe41535f0 2023-11-28T12:00:08.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.241+0000 7fdbe9a1e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe4157c30 con 0x7fdbe406b0e0 2023-11-28T12:00:08.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.241+0000 7fdbe9a1e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe41555e0 con 0x7fdbe40cc8c0 2023-11-28T12:00:08.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.241+0000 7fdbe37fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdbe41535f0 0x7fdbe4158990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:08.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.241+0000 7fdbe37fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdbe41535f0 0x7fdbe4158990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40540/0 (socket says 172.21.15.39:40540) 2023-11-28T12:00:08.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.241+0000 7fdbe37fe700 1 -- 172.21.15.39:0/1729089371 learned_addr learned my addr 172.21.15.39:0/1729089371 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:08.247 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.241+0000 7fdbe27fc700 1 --2- 172.21.15.39:0/1729089371 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbe40cc8c0 0x7fdbe4158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:08.247 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.241+0000 7fdbe2ffd700 1 --2- 172.21.15.39:0/1729089371 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbe406b0e0 0x7fdbe40711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:08.247 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.241+0000 7fdbe37fe700 1 -- 172.21.15.39:0/1729089371 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbe40cc8c0 msgr2=0x7fdbe4158450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:08.247 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.241+0000 7fdbe37fe700 1 --2- 172.21.15.39:0/1729089371 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbe40cc8c0 0x7fdbe4158450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:08.247 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.241+0000 7fdbe37fe700 1 -- 172.21.15.39:0/1729089371 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbe406b0e0 msgr2=0x7fdbe40711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:08.247 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.241+0000 7fdbe37fe700 1 --2- 172.21.15.39:0/1729089371 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbe406b0e0 0x7fdbe40711c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:08.247 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.241+0000 7fdbe37fe700 1 -- 172.21.15.39:0/1729089371 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd40094b0 con 0x7fdbe41535f0 2023-11-28T12:00:08.247 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.241+0000 7fdbe2ffd700 1 --2- 172.21.15.39:0/1729089371 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbe406b0e0 0x7fdbe40711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:00:08.248 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.241+0000 7fdbe37fe700 1 --2- 172.21.15.39:0/1729089371 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdbe41535f0 0x7fdbe4158990 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc00cc40 tx=0x7fdbdc00cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:08.248 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.241+0000 7fdbcbfff700 1 -- 172.21.15.39:0/1729089371 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc003e50 con 0x7fdbe41535f0 2023-11-28T12:00:08.248 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.241+0000 7fdbcbfff700 1 -- 172.21.15.39:0/1729089371 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbdc00a760 con 0x7fdbe41535f0 2023-11-28T12:00:08.248 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.241+0000 7fdbcbfff700 1 -- 172.21.15.39:0/1729089371 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc00ab10 con 0x7fdbe41535f0 2023-11-28T12:00:08.248 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.241+0000 7fdbe9a1e700 1 -- 172.21.15.39:0/1729089371 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbe41539c0 con 0x7fdbe41535f0 2023-11-28T12:00:08.248 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.241+0000 7fdbe9a1e700 1 -- 172.21.15.39:0/1729089371 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe415cf00 con 0x7fdbe41535f0 2023-11-28T12:00:08.249 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.245+0000 7fdbe9a1e700 1 -- 172.21.15.39:0/1729089371 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbe40ceaa0 con 0x7fdbe41535f0 2023-11-28T12:00:08.251 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.245+0000 7fdbcbfff700 1 -- 172.21.15.39:0/1729089371 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdbdc019030 con 0x7fdbe41535f0 2023-11-28T12:00:08.252 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.249+0000 7fdbcbfff700 1 --2- 172.21.15.39:0/1729089371 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fdbd0064ee0 0x7fdbd0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:08.252 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.249+0000 7fdbcbfff700 1 -- 172.21.15.39:0/1729089371 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6030+0+0 (secure 0 0 0) 0x7fdbdc081970 con 0x7fdbe41535f0 2023-11-28T12:00:08.253 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.249+0000 7fdbe2ffd700 1 --2- 172.21.15.39:0/1729089371 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fdbd0064ee0 0x7fdbd0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:08.254 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.249+0000 7fdbe2ffd700 1 --2- 172.21.15.39:0/1729089371 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fdbd0064ee0 0x7fdbd0067390 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fdbd40090b0 tx=0x7fdbd401c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:08.259 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.253+0000 7fdbcbfff700 1 -- 172.21.15.39:0/1729089371 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdbdc04f950 con 0x7fdbe41535f0 2023-11-28T12:00:08.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:08.429+0000 7fdbe9a1e700 1 -- 172.21.15.39:0/1729089371 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdbe4157da0 con 0x7fdbe41535f0 2023-11-28T12:00:09.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.005+0000 7fdbcbfff700 1 -- 172.21.15.39:0/1729089371 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v73) v1 ==== 169+0+0 (secure 0 0 0) 0x7fdbdc017070 con 0x7fdbe41535f0 2023-11-28T12:00:09.018 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.013+0000 7fdbe9a1e700 1 -- 172.21.15.39:0/1729089371 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fdbd0064ee0 msgr2=0x7fdbd0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:09.018 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.013+0000 7fdbe9a1e700 1 --2- 172.21.15.39:0/1729089371 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fdbd0064ee0 0x7fdbd0067390 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fdbd40090b0 tx=0x7fdbd401c040 comp rx=0 tx=0).stop 2023-11-28T12:00:09.018 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.013+0000 7fdbe9a1e700 1 -- 172.21.15.39:0/1729089371 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdbe41535f0 msgr2=0x7fdbe4158990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:09.018 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.013+0000 7fdbe9a1e700 1 --2- 172.21.15.39:0/1729089371 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdbe41535f0 0x7fdbe4158990 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc00cc40 tx=0x7fdbdc00cf50 comp rx=0 tx=0).stop 2023-11-28T12:00:09.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.013+0000 7fdbe9a1e700 1 -- 172.21.15.39:0/1729089371 shutdown_connections 2023-11-28T12:00:09.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.013+0000 7fdbe9a1e700 1 --2- 172.21.15.39:0/1729089371 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdbe41535f0 0x7fdbe4158990 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:09.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.013+0000 7fdbe9a1e700 1 --2- 172.21.15.39:0/1729089371 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbe40cc8c0 0x7fdbe4158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:09.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.013+0000 7fdbe9a1e700 1 --2- 172.21.15.39:0/1729089371 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fdbd0064ee0 0x7fdbd0067390 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:09.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.013+0000 7fdbe9a1e700 1 --2- 172.21.15.39:0/1729089371 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbe406b0e0 0x7fdbe40711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:09.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.013+0000 7fdbe9a1e700 1 -- 172.21.15.39:0/1729089371 >> 172.21.15.39:0/1729089371 conn(0x7fdbe40b12e0 msgr2=0x7fdbe40af250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:09.023 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.017+0000 7fdbe9a1e700 1 -- 172.21.15.39:0/1729089371 shutdown_connections 2023-11-28T12:00:09.023 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.017+0000 7fdbe9a1e700 1 -- 172.21.15.39:0/1729089371 wait complete. 2023-11-28T12:00:09.028 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_data' removed 2023-11-28T12:00:09.049 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-28T12:00:09.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.233+0000 7f12109e8700 1 Processor -- start 2023-11-28T12:00:09.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.233+0000 7f12109e8700 1 -- start start 2023-11-28T12:00:09.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.237+0000 7f12109e8700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f120c15c650 0x7f120c06b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:09.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.237+0000 7f12109e8700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f120c0cd0d0 0x7f120c0b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:09.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.237+0000 7f12109e8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f120c0b1b80 0x7f120c06bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:09.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.237+0000 7f12109e8700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f120c06b140 con 0x7f120c0cd0d0 2023-11-28T12:00:09.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.237+0000 7f12109e8700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f120c0c9d40 con 0x7f120c15c650 2023-11-28T12:00:09.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.237+0000 7f12109e8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f120c06b820 con 0x7f120c0b1b80 2023-11-28T12:00:09.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.237+0000 7f120affd700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f120c0cd0d0 0x7f120c0b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:09.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.237+0000 7f120affd700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f120c0cd0d0 0x7f120c0b1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40546/0 (socket says 172.21.15.39:40546) 2023-11-28T12:00:09.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.237+0000 7f120affd700 1 -- 172.21.15.39:0/353238572 learned_addr learned my addr 172.21.15.39:0/353238572 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:09.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.237+0000 7f120b7fe700 1 --2- 172.21.15.39:0/353238572 >> v2:172.21.15.184:3300/0 conn(0x7f120c15c650 0x7f120c06b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:09.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.237+0000 7f120bfff700 1 --2- 172.21.15.39:0/353238572 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f120c0b1b80 0x7f120c06bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:09.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.237+0000 7f120affd700 1 -- 172.21.15.39:0/353238572 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f120c0b1b80 msgr2=0x7f120c06bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:09.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.237+0000 7f120affd700 1 --2- 172.21.15.39:0/353238572 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f120c0b1b80 0x7f120c06bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:09.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.237+0000 7f120affd700 1 -- 172.21.15.39:0/353238572 >> v2:172.21.15.184:3300/0 conn(0x7f120c15c650 msgr2=0x7f120c06b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:09.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.237+0000 7f120affd700 1 --2- 172.21.15.39:0/353238572 >> v2:172.21.15.184:3300/0 conn(0x7f120c15c650 0x7f120c06b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:09.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.237+0000 7f120affd700 1 -- 172.21.15.39:0/353238572 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f120c0cd5d0 con 0x7f120c0cd0d0 2023-11-28T12:00:09.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.237+0000 7f120b7fe700 1 --2- 172.21.15.39:0/353238572 >> v2:172.21.15.184:3300/0 conn(0x7f120c15c650 0x7f120c06b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:00:09.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.237+0000 7f120affd700 1 --2- 172.21.15.39:0/353238572 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f120c0cd0d0 0x7f120c0b1640 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f120c0cc1e0 tx=0x7f1200009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d978bc11a52702c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:09.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.237+0000 7f120a7fc700 1 -- 172.21.15.39:0/353238572 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120000b8a0 con 0x7f120c0cd0d0 2023-11-28T12:00:09.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.241+0000 7f120a7fc700 1 -- 172.21.15.39:0/353238572 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f120000ba00 con 0x7f120c0cd0d0 2023-11-28T12:00:09.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.241+0000 7f120a7fc700 1 -- 172.21.15.39:0/353238572 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120000bd90 con 0x7f120c0cd0d0 2023-11-28T12:00:09.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.241+0000 7f12109e8700 1 -- 172.21.15.39:0/353238572 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f120c0cd0d0 msgr2=0x7f120c0b1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:09.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.241+0000 7f12109e8700 1 --2- 172.21.15.39:0/353238572 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f120c0cd0d0 0x7f120c0b1640 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f120c0cc1e0 tx=0x7f1200009bf0 comp rx=0 tx=0).stop 2023-11-28T12:00:09.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.241+0000 7f12109e8700 1 -- 172.21.15.39:0/353238572 shutdown_connections 2023-11-28T12:00:09.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.241+0000 7f12109e8700 1 --2- 172.21.15.39:0/353238572 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f120c0b1b80 0x7f120c06bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:09.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.241+0000 7f12109e8700 1 --2- 172.21.15.39:0/353238572 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f120c0cd0d0 0x7f120c0b1640 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:09.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.241+0000 7f12109e8700 1 --2- 172.21.15.39:0/353238572 >> v2:172.21.15.184:3300/0 conn(0x7f120c15c650 0x7f120c06b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:09.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.241+0000 7f12109e8700 1 -- 172.21.15.39:0/353238572 >> 172.21.15.39:0/353238572 conn(0x7f120c0b0f80 msgr2=0x7f120c0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:09.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.241+0000 7f12109e8700 1 -- 172.21.15.39:0/353238572 shutdown_connections 2023-11-28T12:00:09.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.241+0000 7f12109e8700 1 -- 172.21.15.39:0/353238572 wait complete. 2023-11-28T12:00:09.248 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.241+0000 7f12109e8700 1 Processor -- start 2023-11-28T12:00:09.248 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.245+0000 7f12109e8700 1 -- start start 2023-11-28T12:00:09.250 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.245+0000 7f12109e8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f120c0b1b80 0x7f120c1e3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:09.250 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.245+0000 7f12109e8700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f120c0cd0d0 0x7f120c1efbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:09.250 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.245+0000 7f12109e8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f120c15c650 0x7f120c1f0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:09.250 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.245+0000 7f12109e8700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f120c0c6460 con 0x7f120c0cd0d0 2023-11-28T12:00:09.250 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.245+0000 7f12109e8700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f120c0c58c0 con 0x7f120c15c650 2023-11-28T12:00:09.251 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.245+0000 7f12109e8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f120c0c5b30 con 0x7f120c0b1b80 2023-11-28T12:00:09.251 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.245+0000 7f120affd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f120c0cd0d0 0x7f120c1efbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:09.251 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.245+0000 7f120b7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f120c0b1b80 0x7f120c1e3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:09.251 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.245+0000 7f120bfff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f120c15c650 0x7f120c1f0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:09.251 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.245+0000 7f120b7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f120c0b1b80 0x7f120c1e3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:39752/0 (socket says 172.21.15.39:39752) 2023-11-28T12:00:09.251 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.245+0000 7f120b7fe700 1 -- 172.21.15.39:0/493377569 learned_addr learned my addr 172.21.15.39:0/493377569 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:09.252 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.245+0000 7f120b7fe700 1 -- 172.21.15.39:0/493377569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f120c15c650 msgr2=0x7f120c1f0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:09.252 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.245+0000 7f120b7fe700 1 --2- 172.21.15.39:0/493377569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f120c15c650 0x7f120c1f0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:09.252 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.245+0000 7f120b7fe700 1 -- 172.21.15.39:0/493377569 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f120c0cd0d0 msgr2=0x7f120c1efbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:09.252 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.245+0000 7f120b7fe700 1 --2- 172.21.15.39:0/493377569 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f120c0cd0d0 0x7f120c1efbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:09.252 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.245+0000 7f120b7fe700 1 -- 172.21.15.39:0/493377569 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1200009570 con 0x7f120c0b1b80 2023-11-28T12:00:09.252 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.245+0000 7f120affd700 1 --2- 172.21.15.39:0/493377569 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f120c0cd0d0 0x7f120c1efbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:00:09.252 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.245+0000 7f120b7fe700 1 --2- 172.21.15.39:0/493377569 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f120c0b1b80 0x7f120c1e3d80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f11fc00e810 tx=0x7f11fc00eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:09.253 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.249+0000 7f11f3fff700 1 -- 172.21.15.39:0/493377569 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc004230 con 0x7f120c0b1b80 2023-11-28T12:00:09.253 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.249+0000 7f12109e8700 1 -- 172.21.15.39:0/493377569 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f120c0c99d0 con 0x7f120c0b1b80 2023-11-28T12:00:09.253 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.249+0000 7f11f3fff700 1 -- 172.21.15.39:0/493377569 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11fc004390 con 0x7f120c0b1b80 2023-11-28T12:00:09.253 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.249+0000 7f11f3fff700 1 -- 172.21.15.39:0/493377569 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc0036c0 con 0x7f120c0b1b80 2023-11-28T12:00:09.253 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.249+0000 7f12109e8700 1 -- 172.21.15.39:0/493377569 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f120c0cd8b0 con 0x7f120c0b1b80 2023-11-28T12:00:09.254 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.249+0000 7f12109e8700 1 -- 172.21.15.39:0/493377569 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f120c0c9680 con 0x7f120c0b1b80 2023-11-28T12:00:09.256 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.249+0000 7f11f3fff700 1 -- 172.21.15.39:0/493377569 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f11fc022070 con 0x7f120c0b1b80 2023-11-28T12:00:09.257 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.253+0000 7f11f3fff700 1 --2- 172.21.15.39:0/493377569 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f11f8064ee0 0x7f11f8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:09.258 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.253+0000 7f11f3fff700 1 -- 172.21.15.39:0/493377569 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f11fc081700 con 0x7f120c0b1b80 2023-11-28T12:00:09.258 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.253+0000 7f120affd700 1 --2- 172.21.15.39:0/493377569 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f11f8064ee0 0x7f11f8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:09.259 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.253+0000 7f120affd700 1 --2- 172.21.15.39:0/493377569 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f11f8064ee0 0x7f11f8067390 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1200000c00 tx=0x7f1200008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:09.267 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.261+0000 7f11f3fff700 1 -- 172.21.15.39:0/493377569 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f11fc04f910 con 0x7f120c0b1b80 2023-11-28T12:00:09.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.449+0000 7f12109e8700 1 -- 172.21.15.39:0/493377569 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f120c073cb0 con 0x7f120c0b1b80 2023-11-28T12:00:09.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.461+0000 7f11f3fff700 1 -- 172.21.15.39:0/493377569 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f11fc052f30 con 0x7f120c0b1b80 2023-11-28T12:00:09.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.465+0000 7f12109e8700 1 -- 172.21.15.39:0/493377569 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f11f8064ee0 msgr2=0x7f11f8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:09.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.465+0000 7f12109e8700 1 --2- 172.21.15.39:0/493377569 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f11f8064ee0 0x7f11f8067390 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1200000c00 tx=0x7f1200008030 comp rx=0 tx=0).stop 2023-11-28T12:00:09.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.465+0000 7f12109e8700 1 -- 172.21.15.39:0/493377569 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f120c0b1b80 msgr2=0x7f120c1e3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:09.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.465+0000 7f12109e8700 1 --2- 172.21.15.39:0/493377569 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f120c0b1b80 0x7f120c1e3d80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f11fc00e810 tx=0x7f11fc00eb20 comp rx=0 tx=0).stop 2023-11-28T12:00:09.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.465+0000 7f12109e8700 1 -- 172.21.15.39:0/493377569 shutdown_connections 2023-11-28T12:00:09.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.465+0000 7f12109e8700 1 --2- 172.21.15.39:0/493377569 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f11f8064ee0 0x7f11f8067390 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:09.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.465+0000 7f12109e8700 1 --2- 172.21.15.39:0/493377569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f120c15c650 0x7f120c1f0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:09.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.465+0000 7f12109e8700 1 --2- 172.21.15.39:0/493377569 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f120c0cd0d0 0x7f120c1efbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:09.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.465+0000 7f12109e8700 1 --2- 172.21.15.39:0/493377569 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f120c0b1b80 0x7f120c1e3d80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:09.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.465+0000 7f12109e8700 1 -- 172.21.15.39:0/493377569 >> 172.21.15.39:0/493377569 conn(0x7f120c0b0f80 msgr2=0x7f120c15ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:09.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.465+0000 7f12109e8700 1 -- 172.21.15.39:0/493377569 shutdown_connections 2023-11-28T12:00:09.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.465+0000 7f12109e8700 1 -- 172.21.15.39:0/493377569 wait complete. 2023-11-28T12:00:09.495 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair' 2023-11-28T12:00:09.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.665+0000 7fc4bd262700 1 Processor -- start 2023-11-28T12:00:09.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.669+0000 7fc4bd262700 1 -- start start 2023-11-28T12:00:09.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.669+0000 7fc4bd262700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc4b8071aa0 0x7fc4b806d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:09.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.669+0000 7fc4bd262700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc4b8069e00 0x7fc4b806a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:09.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.669+0000 7fc4bd262700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4b806c600 con 0x7fc4b815c640 2023-11-28T12:00:09.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.669+0000 7fc4bd262700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4b806cef0 con 0x7fc4b8069e00 2023-11-28T12:00:09.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.669+0000 7fc4bd262700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b80d38f0 con 0x7fc4b8071aa0 2023-11-28T12:00:09.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.669+0000 7fc4b6ffd700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fc4b815c640 0x7fc4b80d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56060/0 (socket says 172.21.15.39:56060) 2023-11-28T12:00:09.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.669+0000 7fc4b6ffd700 1 -- 172.21.15.39:0/3995666745 learned_addr learned my addr 172.21.15.39:0/3995666745 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T12:00:09.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.673+0000 7fc4b67fc700 1 --2- 172.21.15.39:0/3995666745 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc4b8071aa0 0x7fc4b806d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:09.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.673+0000 7fc4b77fe700 1 --2- 172.21.15.39:0/3995666745 >> v2:172.21.15.184:3300/0 conn(0x7fc4b8069e00 0x7fc4b806a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:09.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.673+0000 7fc4b5ffb700 1 -- 172.21.15.39:0/3995666745 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3717728253 0 0) 0x7fc4b806c600 con 0x7fc4b815c640 2023-11-28T12:00:09.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.673+0000 7fc4b5ffb700 1 -- 172.21.15.39:0/3995666745 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4a00035d0 con 0x7fc4b815c640 2023-11-28T12:00:09.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.673+0000 7fc4b67fc700 1 -- 172.21.15.39:0/3995666745 >> v2:172.21.15.184:3300/0 conn(0x7fc4b8069e00 msgr2=0x7fc4b806a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:09.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.673+0000 7fc4b67fc700 1 --2- 172.21.15.39:0/3995666745 >> v2:172.21.15.184:3300/0 conn(0x7fc4b8069e00 0x7fc4b806a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:09.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.673+0000 7fc4b67fc700 1 -- 172.21.15.39:0/3995666745 >> v1:172.21.15.39:6789/0 conn(0x7fc4b815c640 legacy=0x7fc4b80d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:09.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.673+0000 7fc4b67fc700 1 -- 172.21.15.39:0/3995666745 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b80722f0 con 0x7fc4b8071aa0 2023-11-28T12:00:09.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.673+0000 7fc4b67fc700 1 --2- 172.21.15.39:0/3995666745 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc4b8071aa0 0x7fc4b806d310 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac009850 tx=0x7fc4ac009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acb9240caaf94de server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:09.679 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.673+0000 7fc4b5ffb700 1 -- 172.21.15.39:0/3995666745 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac011830 con 0x7fc4b8071aa0 2023-11-28T12:00:09.679 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.673+0000 7fc4b5ffb700 1 -- 172.21.15.39:0/3995666745 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ac011990 con 0x7fc4b8071aa0 2023-11-28T12:00:09.679 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.673+0000 7fc4b5ffb700 1 -- 172.21.15.39:0/3995666745 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac011d40 con 0x7fc4b8071aa0 2023-11-28T12:00:09.679 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.673+0000 7fc4bd262700 1 -- 172.21.15.39:0/3995666745 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc4b8071aa0 msgr2=0x7fc4b806d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:09.679 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.673+0000 7fc4bd262700 1 --2- 172.21.15.39:0/3995666745 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc4b8071aa0 0x7fc4b806d310 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac009850 tx=0x7fc4ac009b60 comp rx=0 tx=0).stop 2023-11-28T12:00:09.680 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.673+0000 7fc4bd262700 1 -- 172.21.15.39:0/3995666745 shutdown_connections 2023-11-28T12:00:09.680 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.673+0000 7fc4bd262700 1 --2- 172.21.15.39:0/3995666745 >> v2:172.21.15.184:3300/0 conn(0x7fc4b8069e00 0x7fc4b806a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:09.680 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.673+0000 7fc4bd262700 1 --2- 172.21.15.39:0/3995666745 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc4b8071aa0 0x7fc4b806d310 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:09.680 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.673+0000 7fc4bd262700 1 -- 172.21.15.39:0/3995666745 >> 172.21.15.39:0/3995666745 conn(0x7fc4b80b6520 msgr2=0x7fc4b8071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:09.680 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.673+0000 7fc4bd262700 1 -- 172.21.15.39:0/3995666745 shutdown_connections 2023-11-28T12:00:09.680 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.673+0000 7fc4bd262700 1 -- 172.21.15.39:0/3995666745 wait complete. 2023-11-28T12:00:09.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.677+0000 7fc4bd262700 1 Processor -- start 2023-11-28T12:00:09.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.677+0000 7fc4bd262700 1 -- start start 2023-11-28T12:00:09.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.681+0000 7fc4bd262700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4b8069e00 0x7fc4b81f4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:09.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.681+0000 7fc4bd262700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc4b8071aa0 0x7fc4b815e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:09.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.681+0000 7fc4bd262700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4b815c640 0x7fc4b815e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:09.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.681+0000 7fc4bd262700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b80c82d0 con 0x7fc4b815c640 2023-11-28T12:00:09.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.681+0000 7fc4bd262700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b815f9d0 con 0x7fc4b8069e00 2023-11-28T12:00:09.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.681+0000 7fc4bd262700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b815f6f0 con 0x7fc4b8071aa0 2023-11-28T12:00:09.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.681+0000 7fc4b77fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4b815c640 0x7fc4b815e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:09.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.681+0000 7fc4b6ffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4b8069e00 0x7fc4b81f4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:09.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.681+0000 7fc4b77fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4b815c640 0x7fc4b815e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40562/0 (socket says 172.21.15.39:40562) 2023-11-28T12:00:09.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.681+0000 7fc4b77fe700 1 -- 172.21.15.39:0/4188596884 learned_addr learned my addr 172.21.15.39:0/4188596884 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:09.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.681+0000 7fc4b67fc700 1 --2- 172.21.15.39:0/4188596884 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc4b8071aa0 0x7fc4b815e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:09.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.681+0000 7fc4b6ffd700 1 -- 172.21.15.39:0/4188596884 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc4b8071aa0 msgr2=0x7fc4b815e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:09.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.681+0000 7fc4b6ffd700 1 --2- 172.21.15.39:0/4188596884 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc4b8071aa0 0x7fc4b815e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:09.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.681+0000 7fc4b6ffd700 1 -- 172.21.15.39:0/4188596884 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4b815c640 msgr2=0x7fc4b815e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:09.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.681+0000 7fc4b6ffd700 1 --2- 172.21.15.39:0/4188596884 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4b815c640 0x7fc4b815e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:09.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.681+0000 7fc4b6ffd700 1 -- 172.21.15.39:0/4188596884 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ac0094b0 con 0x7fc4b8069e00 2023-11-28T12:00:09.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.681+0000 7fc4b67fc700 1 --2- 172.21.15.39:0/4188596884 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc4b8071aa0 0x7fc4b815e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:00:09.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.681+0000 7fc4b6ffd700 1 --2- 172.21.15.39:0/4188596884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4b8069e00 0x7fc4b81f4bc0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc4a800c410 tx=0x7fc4a800c720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:09.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.681+0000 7fc49f7fe700 1 -- 172.21.15.39:0/4188596884 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8005d90 con 0x7fc4b8069e00 2023-11-28T12:00:09.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.681+0000 7fc49f7fe700 1 -- 172.21.15.39:0/4188596884 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a800ce20 con 0x7fc4b8069e00 2023-11-28T12:00:09.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.681+0000 7fc49f7fe700 1 -- 172.21.15.39:0/4188596884 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a80072d0 con 0x7fc4b8069e00 2023-11-28T12:00:09.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.681+0000 7fc4bd262700 1 -- 172.21.15.39:0/4188596884 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4b8072010 con 0x7fc4b8069e00 2023-11-28T12:00:09.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.681+0000 7fc4bd262700 1 -- 172.21.15.39:0/4188596884 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4b815ca10 con 0x7fc4b8069e00 2023-11-28T12:00:09.689 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.685+0000 7fc4bd262700 1 -- 172.21.15.39:0/4188596884 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4b806c830 con 0x7fc4b8069e00 2023-11-28T12:00:09.691 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.685+0000 7fc49f7fe700 1 -- 172.21.15.39:0/4188596884 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc4a8010070 con 0x7fc4b8069e00 2023-11-28T12:00:09.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.689+0000 7fc49f7fe700 1 --2- 172.21.15.39:0/4188596884 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc4a4064ee0 0x7fc4a4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:09.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.689+0000 7fc49f7fe700 1 -- 172.21.15.39:0/4188596884 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fc4a8080b00 con 0x7fc4b8069e00 2023-11-28T12:00:09.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.689+0000 7fc4b67fc700 1 --2- 172.21.15.39:0/4188596884 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc4a4064ee0 0x7fc4a4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:09.695 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.689+0000 7fc4b67fc700 1 --2- 172.21.15.39:0/4188596884 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc4a4064ee0 0x7fc4a4067390 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac0090b0 tx=0x7fc4ac01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:09.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.697+0000 7fc49f7fe700 1 -- 172.21.15.39:0/4188596884 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc4a8049400 con 0x7fc4b8069e00 2023-11-28T12:00:09.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:09.929+0000 7fc4bd262700 1 -- 172.21.15.39:0/4188596884 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]} v 0) v1 -- 0x7fc4b8073cb0 con 0x7fc4b8069e00 2023-11-28T12:00:10.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:10.017+0000 7fc49f7fe700 1 -- 172.21.15.39:0/4188596884 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]}]=0 v210) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc4a8082e60 con 0x7fc4b8069e00 2023-11-28T12:00:10.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:10.021+0000 7fc4bd262700 1 -- 172.21.15.39:0/4188596884 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc4a4064ee0 msgr2=0x7fc4a4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:10.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:10.021+0000 7fc4bd262700 1 --2- 172.21.15.39:0/4188596884 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc4a4064ee0 0x7fc4a4067390 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac0090b0 tx=0x7fc4ac01c040 comp rx=0 tx=0).stop 2023-11-28T12:00:10.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:10.021+0000 7fc4bd262700 1 -- 172.21.15.39:0/4188596884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4b8069e00 msgr2=0x7fc4b81f4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:10.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:10.021+0000 7fc4bd262700 1 --2- 172.21.15.39:0/4188596884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4b8069e00 0x7fc4b81f4bc0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc4a800c410 tx=0x7fc4a800c720 comp rx=0 tx=0).stop 2023-11-28T12:00:10.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:10.021+0000 7fc4bd262700 1 -- 172.21.15.39:0/4188596884 shutdown_connections 2023-11-28T12:00:10.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:10.021+0000 7fc4bd262700 1 --2- 172.21.15.39:0/4188596884 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4b815c640 0x7fc4b815e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:10.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:10.021+0000 7fc4bd262700 1 --2- 172.21.15.39:0/4188596884 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc4b8071aa0 0x7fc4b815e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:10.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:10.021+0000 7fc4bd262700 1 --2- 172.21.15.39:0/4188596884 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fc4a4064ee0 0x7fc4a4067390 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:10.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:10.021+0000 7fc4bd262700 1 --2- 172.21.15.39:0/4188596884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4b8069e00 0x7fc4b81f4bc0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:10.026 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:10.021+0000 7fc4bd262700 1 -- 172.21.15.39:0/4188596884 >> 172.21.15.39:0/4188596884 conn(0x7fc4b80b6520 msgr2=0x7fc4b806d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:10.026 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:10.021+0000 7fc4bd262700 1 -- 172.21.15.39:0/4188596884 shutdown_connections 2023-11-28T12:00:10.026 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:10.021+0000 7fc4bd262700 1 -- 172.21.15.39:0/4188596884 wait complete. 2023-11-28T12:00:10.047 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... FAIL 2023-11-28T12:00:10.048 INFO:tasks.cephfs_test_runner: 2023-11-28T12:00:10.048 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-28T12:00:10.048 INFO:tasks.cephfs_test_runner:FAIL: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-28T12:00:10.048 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared 2023-11-28T12:00:10.048 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-28T12:00:10.048 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-28T12:00:10.048 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_neesingh-rh_ceph_17c45c858c4cb3105f973d12c6c74f8d5037aa89/qa/tasks/cephfs/test_forward_scrub.py", line 500, in test_health_status_after_backtrace_repair 2023-11-28T12:00:10.048 INFO:tasks.cephfs_test_runner: self.wait_until_true(lambda: self._check_for_presence_of_MDS_damage(), timeout=100) 2023-11-28T12:00:10.048 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_neesingh-rh_ceph_17c45c858c4cb3105f973d12c6c74f8d5037aa89/qa/tasks/ceph_test_case.py", line 202, in wait_until_true 2023-11-28T12:00:10.048 INFO:tasks.cephfs_test_runner: if condition(): 2023-11-28T12:00:10.049 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_neesingh-rh_ceph_17c45c858c4cb3105f973d12c6c74f8d5037aa89/qa/tasks/cephfs/test_forward_scrub.py", line 500, in 2023-11-28T12:00:10.049 INFO:tasks.cephfs_test_runner: self.wait_until_true(lambda: self._check_for_presence_of_MDS_damage(), timeout=100) 2023-11-28T12:00:10.049 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_neesingh-rh_ceph_17c45c858c4cb3105f973d12c6c74f8d5037aa89/qa/tasks/cephfs/test_forward_scrub.py", line 51, in _check_for_presence_of_MDS_damage 2023-11-28T12:00:10.049 INFO:tasks.cephfs_test_runner: return self.assertIn("MDS_DAMAGE", self.mds_cluster.mon_manager.get_mon_health()['checks']) 2023-11-28T12:00:10.049 INFO:tasks.cephfs_test_runner:AssertionError: 'MDS_DAMAGE' not found in {} 2023-11-28T12:00:10.049 INFO:tasks.cephfs_test_runner: 2023-11-28T12:00:10.049 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-28T12:00:10.049 INFO:tasks.cephfs_test_runner:Ran 3 tests in 160.248s 2023-11-28T12:00:10.049 INFO:tasks.cephfs_test_runner: 2023-11-28T12:00:10.049 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2023-11-28T12:00:10.050 INFO:tasks.cephfs_test_runner: 2023-11-28T12:00:10.050 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-28T12:00:10.050 INFO:tasks.cephfs_test_runner:FAIL: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-28T12:00:10.050 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared 2023-11-28T12:00:10.050 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-28T12:00:10.050 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-28T12:00:10.050 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_neesingh-rh_ceph_17c45c858c4cb3105f973d12c6c74f8d5037aa89/qa/tasks/cephfs/test_forward_scrub.py", line 500, in test_health_status_after_backtrace_repair 2023-11-28T12:00:10.050 INFO:tasks.cephfs_test_runner: self.wait_until_true(lambda: self._check_for_presence_of_MDS_damage(), timeout=100) 2023-11-28T12:00:10.050 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_neesingh-rh_ceph_17c45c858c4cb3105f973d12c6c74f8d5037aa89/qa/tasks/ceph_test_case.py", line 202, in wait_until_true 2023-11-28T12:00:10.050 INFO:tasks.cephfs_test_runner: if condition(): 2023-11-28T12:00:10.050 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_neesingh-rh_ceph_17c45c858c4cb3105f973d12c6c74f8d5037aa89/qa/tasks/cephfs/test_forward_scrub.py", line 500, in 2023-11-28T12:00:10.050 INFO:tasks.cephfs_test_runner: self.wait_until_true(lambda: self._check_for_presence_of_MDS_damage(), timeout=100) 2023-11-28T12:00:10.051 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_neesingh-rh_ceph_17c45c858c4cb3105f973d12c6c74f8d5037aa89/qa/tasks/cephfs/test_forward_scrub.py", line 51, in _check_for_presence_of_MDS_damage 2023-11-28T12:00:10.051 INFO:tasks.cephfs_test_runner: return self.assertIn("MDS_DAMAGE", self.mds_cluster.mon_manager.get_mon_health()['checks']) 2023-11-28T12:00:10.051 INFO:tasks.cephfs_test_runner:AssertionError: 'MDS_DAMAGE' not found in {} 2023-11-28T12:00:10.051 INFO:tasks.cephfs_test_runner: 2023-11-28T12:00:10.051 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_neesingh-rh_ceph_17c45c858c4cb3105f973d12c6c74f8d5037aa89/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-28T12:00:10.153 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=428dbe41923e490cb793aa43fee9b553 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_neesingh-rh_ceph_17c45c858c4cb3105f973d12c6c74f8d5037aa89/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-28T12:00:10.155 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-28T12:00:10.164 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-11-28T12:00:10.217 INFO:tasks.kclient:Unmounting kernel clients... 2023-11-28T12:00:10.217 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T12:00:10.217 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:00:10.239 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352324k,nr_inodes=4088081,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6229 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T12:00:10.239 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-11-28T12:00:10.240 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:00:10.302 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352324k,nr_inodes=4088081,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6229 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T12:00:10.302 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T12:00:10.302 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:00:10.320 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352324k,nr_inodes=4088081,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9254 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T12:00:10.321 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-11-28T12:00:10.321 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:00:10.384 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352324k,nr_inodes=4088081,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9254 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T12:00:10.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:00:10.384 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2023-11-28T12:00:10.406 INFO:teuthology.orchestra.run.smithi039.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T12:00:10.407 INFO:teuthology.orchestra.run.smithi039.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-28T12:00:10.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:00:10.407 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T12:00:10.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:00:10.486 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T12:00:10.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:00:10.577 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link delete ceph-brx 2023-11-28T12:00:10.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:00:10.787 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2023-11-28T12:00:10.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:00:10.801 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link delete ceph-brx 2023-11-28T12:00:10.884 INFO:teuthology.orchestra.run.smithi039.stderr:Cannot find device "ceph-brx" 2023-11-28T12:00:10.887 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T12:00:10.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:00:10.888 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-11-28T12:00:10.907 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-28T12:00:10.907 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-28T12:00:10.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:00:10.908 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T12:00:10.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:00:10.988 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-28T12:00:11.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:00:11.070 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link delete ceph-brx 2023-11-28T12:00:11.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:00:11.284 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-11-28T12:00:11.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:00:11.302 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link delete ceph-brx 2023-11-28T12:00:11.391 INFO:teuthology.orchestra.run.smithi184.stderr:Cannot find device "ceph-brx" 2023-11-28T12:00:11.394 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T12:00:11.395 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-28T12:00:11.407 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-28T12:00:11.407 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T12:00:11.588 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.585+0000 7f817595d700 1 Processor -- start 2023-11-28T12:00:11.589 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.585+0000 7f817595d700 1 -- start start 2023-11-28T12:00:11.592 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.585+0000 7f817595d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f81700b1640 0x7f8170070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:11.592 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.585+0000 7f817595d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f81700c9040 0x7f81700705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:11.592 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.585+0000 7f817595d700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f817015a550 con 0x7f81700b43a0 2023-11-28T12:00:11.592 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.585+0000 7f817595d700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f817006b0a0 con 0x7f81700b1640 2023-11-28T12:00:11.592 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.585+0000 7f817595d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81700caac0 con 0x7f81700c9040 2023-11-28T12:00:11.593 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.589+0000 7f817495b700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f81700b43a0 0x7f817015e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:37932/0 (socket says 172.21.15.39:37932) 2023-11-28T12:00:11.593 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.589+0000 7f817495b700 1 -- 172.21.15.39:0/688983577 learned_addr learned my addr 172.21.15.39:0/688983577 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T12:00:11.593 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.589+0000 7f8167fff700 1 --2- 172.21.15.39:0/688983577 >> v2:172.21.15.184:3300/0 conn(0x7f81700b1640 0x7f8170070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:11.593 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.589+0000 7f817515c700 1 --2- 172.21.15.39:0/688983577 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f81700c9040 0x7f81700705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:11.594 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.589+0000 7f81677fe700 1 -- 172.21.15.39:0/688983577 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2242191725 0 0) 0x7f816c001110 con 0x7f81700b43a0 2023-11-28T12:00:11.594 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.589+0000 7f81677fe700 1 -- 172.21.15.39:0/688983577 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81580035d0 con 0x7f81700b43a0 2023-11-28T12:00:11.594 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.589+0000 7f817515c700 1 -- 172.21.15.39:0/688983577 >> v2:172.21.15.184:3300/0 conn(0x7f81700b1640 msgr2=0x7f8170070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:11.595 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.589+0000 7f817515c700 1 --2- 172.21.15.39:0/688983577 >> v2:172.21.15.184:3300/0 conn(0x7f81700b1640 0x7f8170070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:11.595 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.589+0000 7f817515c700 1 -- 172.21.15.39:0/688983577 >> v1:172.21.15.184:6789/0 conn(0x7f81700b43a0 legacy=0x7f817015e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:11.595 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.589+0000 7f817515c700 1 -- 172.21.15.39:0/688983577 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81700cada0 con 0x7f81700c9040 2023-11-28T12:00:11.595 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.589+0000 7f8167fff700 1 --2- 172.21.15.39:0/688983577 >> v2:172.21.15.184:3300/0 conn(0x7f81700b1640 0x7f8170070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:00:11.595 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.589+0000 7f817515c700 1 --2- 172.21.15.39:0/688983577 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f81700c9040 0x7f81700705c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8168009d90 tx=0x7f816800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca0a99ded3d0b58c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:11.596 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.589+0000 7f81677fe700 1 -- 172.21.15.39:0/688983577 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816800e070 con 0x7f81700c9040 2023-11-28T12:00:11.597 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.589+0000 7f81677fe700 1 -- 172.21.15.39:0/688983577 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816800bb20 con 0x7f81700c9040 2023-11-28T12:00:11.597 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.589+0000 7f81677fe700 1 -- 172.21.15.39:0/688983577 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8168012430 con 0x7f81700c9040 2023-11-28T12:00:11.597 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.589+0000 7f817595d700 1 -- 172.21.15.39:0/688983577 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f81700c9040 msgr2=0x7f81700705c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:11.597 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.589+0000 7f817595d700 1 --2- 172.21.15.39:0/688983577 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f81700c9040 0x7f81700705c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8168009d90 tx=0x7f816800b330 comp rx=0 tx=0).stop 2023-11-28T12:00:11.597 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.589+0000 7f817595d700 1 -- 172.21.15.39:0/688983577 shutdown_connections 2023-11-28T12:00:11.597 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.589+0000 7f817595d700 1 --2- 172.21.15.39:0/688983577 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f81700c9040 0x7f81700705c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:11.597 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.589+0000 7f817595d700 1 --2- 172.21.15.39:0/688983577 >> v2:172.21.15.184:3300/0 conn(0x7f81700b1640 0x7f8170070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:11.597 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.589+0000 7f817595d700 1 -- 172.21.15.39:0/688983577 >> 172.21.15.39:0/688983577 conn(0x7f81700b0f80 msgr2=0x7f81700ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:11.598 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.589+0000 7f817595d700 1 -- 172.21.15.39:0/688983577 shutdown_connections 2023-11-28T12:00:11.598 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.589+0000 7f817595d700 1 -- 172.21.15.39:0/688983577 wait complete. 2023-11-28T12:00:11.598 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.593+0000 7f817595d700 1 Processor -- start 2023-11-28T12:00:11.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.593+0000 7f817595d700 1 -- start start 2023-11-28T12:00:11.600 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.593+0000 7f817595d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f81700b1640 0x7f817015d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:11.600 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.593+0000 7f817595d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81700b43a0 0x7f81700c2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:11.601 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.593+0000 7f817595d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81700c9040 0x7f81700c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:11.601 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.597+0000 7f817595d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81700c2760 con 0x7f81700c9040 2023-11-28T12:00:11.601 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.597+0000 7f817595d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81700c4850 con 0x7f81700b43a0 2023-11-28T12:00:11.601 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.597+0000 7f817595d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81700c4b30 con 0x7f81700b1640 2023-11-28T12:00:11.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.597+0000 7f817515c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81700c9040 0x7f81700c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:11.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.597+0000 7f817495b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f81700b1640 0x7f817015d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:11.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.597+0000 7f8167fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81700b43a0 0x7f81700c2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:11.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.597+0000 7f817515c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81700c9040 0x7f81700c3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40576/0 (socket says 172.21.15.39:40576) 2023-11-28T12:00:11.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.597+0000 7f817495b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f81700b1640 0x7f817015d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:39790/0 (socket says 172.21.15.39:39790) 2023-11-28T12:00:11.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.597+0000 7f817515c700 1 -- 172.21.15.39:0/4001411221 learned_addr learned my addr 172.21.15.39:0/4001411221 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:11.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.597+0000 7f817495b700 1 -- 172.21.15.39:0/4001411221 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81700b43a0 msgr2=0x7f81700c2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:11.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.597+0000 7f817495b700 1 --2- 172.21.15.39:0/4001411221 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81700b43a0 0x7f81700c2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:11.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.597+0000 7f817495b700 1 -- 172.21.15.39:0/4001411221 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81700c9040 msgr2=0x7f81700c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:11.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.597+0000 7f817495b700 1 --2- 172.21.15.39:0/4001411221 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81700c9040 0x7f81700c3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:11.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.597+0000 7f817495b700 1 -- 172.21.15.39:0/4001411221 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81600094b0 con 0x7f81700b1640 2023-11-28T12:00:11.604 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.597+0000 7f8167fff700 1 --2- 172.21.15.39:0/4001411221 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81700b43a0 0x7f81700c2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:00:11.604 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.597+0000 7f817495b700 1 --2- 172.21.15.39:0/4001411221 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f81700b1640 0x7f817015d290 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f816c00c730 tx=0x7f816c00ca40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:11.604 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.597+0000 7f81657fa700 1 -- 172.21.15.39:0/4001411221 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c005d90 con 0x7f81700b1640 2023-11-28T12:00:11.605 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.597+0000 7f81657fa700 1 -- 172.21.15.39:0/4001411221 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816c0070d0 con 0x7f81700b1640 2023-11-28T12:00:11.605 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.597+0000 7f817595d700 1 -- 172.21.15.39:0/4001411221 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8168009a70 con 0x7f81700b1640 2023-11-28T12:00:11.605 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.597+0000 7f81657fa700 1 -- 172.21.15.39:0/4001411221 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c007460 con 0x7f81700b1640 2023-11-28T12:00:11.605 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.597+0000 7f817595d700 1 -- 172.21.15.39:0/4001411221 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f817006b5d0 con 0x7f81700b1640 2023-11-28T12:00:11.605 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.601+0000 7f817595d700 1 -- 172.21.15.39:0/4001411221 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f817006b2f0 con 0x7f81700b1640 2023-11-28T12:00:11.606 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.601+0000 7f81657fa700 1 -- 172.21.15.39:0/4001411221 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f816c010070 con 0x7f81700b1640 2023-11-28T12:00:11.608 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.601+0000 7f81657fa700 1 --2- 172.21.15.39:0/4001411221 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f815c064ee0 0x7f815c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:11.608 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.605+0000 7f81657fa700 1 -- 172.21.15.39:0/4001411221 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f816c080a40 con 0x7f81700b1640 2023-11-28T12:00:11.608 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.605+0000 7f8167fff700 1 --2- 172.21.15.39:0/4001411221 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f815c064ee0 0x7f815c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:11.610 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.605+0000 7f8167fff700 1 --2- 172.21.15.39:0/4001411221 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f815c064ee0 0x7f815c067390 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f817015d910 tx=0x7f8160009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:11.615 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.609+0000 7f81657fa700 1 -- 172.21.15.39:0/4001411221 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f816c04ecf0 con 0x7f81700b1640 2023-11-28T12:00:11.786 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.781+0000 7f817595d700 1 -- 172.21.15.39:0/4001411221 --> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f81700ca7b0 con 0x7f815c064ee0 2023-11-28T12:00:11.794 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.789+0000 7f81657fa700 1 -- 172.21.15.39:0/4001411221 <== mgr.4104 v2:172.21.15.184:6832/36166 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70294 (secure 0 0 0) 0x7f81700ca7b0 con 0x7f815c064ee0 2023-11-28T12:00:11.796 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T12:00:11.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.793+0000 7f817595d700 1 -- 172.21.15.39:0/4001411221 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f815c064ee0 msgr2=0x7f815c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:11.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.793+0000 7f817595d700 1 --2- 172.21.15.39:0/4001411221 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f815c064ee0 0x7f815c067390 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f817015d910 tx=0x7f8160009240 comp rx=0 tx=0).stop 2023-11-28T12:00:11.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.793+0000 7f817595d700 1 -- 172.21.15.39:0/4001411221 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f81700b1640 msgr2=0x7f817015d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:11.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.793+0000 7f817595d700 1 --2- 172.21.15.39:0/4001411221 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f81700b1640 0x7f817015d290 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f816c00c730 tx=0x7f816c00ca40 comp rx=0 tx=0).stop 2023-11-28T12:00:11.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.793+0000 7f817595d700 1 -- 172.21.15.39:0/4001411221 shutdown_connections 2023-11-28T12:00:11.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.793+0000 7f817595d700 1 --2- 172.21.15.39:0/4001411221 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f81700c9040 0x7f81700c3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:11.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.793+0000 7f817595d700 1 --2- 172.21.15.39:0/4001411221 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f815c064ee0 0x7f815c067390 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:11.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.793+0000 7f817595d700 1 --2- 172.21.15.39:0/4001411221 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81700b43a0 0x7f81700c2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:11.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.793+0000 7f817595d700 1 --2- 172.21.15.39:0/4001411221 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f81700b1640 0x7f817015d290 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:11.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.793+0000 7f817595d700 1 -- 172.21.15.39:0/4001411221 >> 172.21.15.39:0/4001411221 conn(0x7f81700b0f80 msgr2=0x7f8170159c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:11.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.793+0000 7f817595d700 1 -- 172.21.15.39:0/4001411221 shutdown_connections 2023-11-28T12:00:11.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.793+0000 7f817595d700 1 -- 172.21.15.39:0/4001411221 wait complete. 2023-11-28T12:00:11.800 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2023-11-28T12:00:11.820 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2023-11-28T12:00:10.627967+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":97840,"kb_used_data":7856,"kb_used_omap":0,"kb_used_meta":89920,"kb_avail":754876880,"statfs":{"total":773094113280,"available":772993925120,"internally_reserved":0,"allocated":8044544,"data_stored":4368743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":92078080},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12282,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-6,"num_read_kb":-5,"num_write":-73,"num_write_kb":-36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001963"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.319093+0000","last_change":"2023-11-28T11:56:34.384408+0000","last_active":"2023-11-28T11:59:46.319093+0000","last_peered":"2023-11-28T11:59:46.319093+0000","last_clean":"2023-11-28T11:59:46.319093+0000","last_became_active":"2023-11-28T11:56:34.384036+0000","last_became_peered":"2023-11-28T11:56:34.384036+0000","last_unstale":"2023-11-28T11:59:46.319093+0000","last_undegraded":"2023-11-28T11:59:46.319093+0000","last_fullsized":"2023-11-28T11:59:46.319093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:58:55.003786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.939248+0000","last_change":"2023-11-28T11:56:34.384088+0000","last_active":"2023-11-28T11:59:46.939248+0000","last_peered":"2023-11-28T11:59:46.939248+0000","last_clean":"2023-11-28T11:59:46.939248+0000","last_became_active":"2023-11-28T11:56:34.383631+0000","last_became_peered":"2023-11-28T11:56:34.383631+0000","last_unstale":"2023-11-28T11:59:46.939248+0000","last_undegraded":"2023-11-28T11:59:46.939248+0000","last_fullsized":"2023-11-28T11:59:46.939248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:15:42.772333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":53,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.400542+0000","last_change":"2023-11-28T11:56:34.386399+0000","last_active":"2023-11-28T11:59:46.400542+0000","last_peered":"2023-11-28T11:59:46.400542+0000","last_clean":"2023-11-28T11:59:46.400542+0000","last_became_active":"2023-11-28T11:56:34.385994+0000","last_became_peered":"2023-11-28T11:56:34.385994+0000","last_unstale":"2023-11-28T11:59:46.400542+0000","last_undegraded":"2023-11-28T11:59:46.400542+0000","last_fullsized":"2023-11-28T11:59:46.400542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:58:02.172295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.941175+0000","last_change":"2023-11-28T11:56:34.384999+0000","last_active":"2023-11-28T11:59:46.941175+0000","last_peered":"2023-11-28T11:59:46.941175+0000","last_clean":"2023-11-28T11:59:46.941175+0000","last_became_active":"2023-11-28T11:56:34.384531+0000","last_became_peered":"2023-11-28T11:56:34.384531+0000","last_unstale":"2023-11-28T11:59:46.941175+0000","last_undegraded":"2023-11-28T11:59:46.941175+0000","last_fullsized":"2023-11-28T11:59:46.941175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:09:50.083366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":52,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.938906+0000","last_change":"2023-11-28T11:56:34.389076+0000","last_active":"2023-11-28T11:59:46.938906+0000","last_peered":"2023-11-28T11:59:46.938906+0000","last_clean":"2023-11-28T11:59:46.938906+0000","last_became_active":"2023-11-28T11:56:34.388689+0000","last_became_peered":"2023-11-28T11:56:34.388689+0000","last_unstale":"2023-11-28T11:59:46.938906+0000","last_undegraded":"2023-11-28T11:59:46.938906+0000","last_fullsized":"2023-11-28T11:59:46.938906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:20.936349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.321952+0000","last_change":"2023-11-28T11:56:34.486178+0000","last_active":"2023-11-28T11:59:45.321952+0000","last_peered":"2023-11-28T11:59:45.321952+0000","last_clean":"2023-11-28T11:59:45.321952+0000","last_became_active":"2023-11-28T11:56:34.485702+0000","last_became_peered":"2023-11-28T11:56:34.485702+0000","last_unstale":"2023-11-28T11:59:45.321952+0000","last_undegraded":"2023-11-28T11:59:45.321952+0000","last_fullsized":"2023-11-28T11:59:45.321952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:06.323407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":53,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.399325+0000","last_change":"2023-11-28T11:56:34.387293+0000","last_active":"2023-11-28T11:59:46.399325+0000","last_peered":"2023-11-28T11:59:46.399325+0000","last_clean":"2023-11-28T11:59:46.399325+0000","last_became_active":"2023-11-28T11:56:34.386976+0000","last_became_peered":"2023-11-28T11:56:34.386976+0000","last_unstale":"2023-11-28T11:59:46.399325+0000","last_undegraded":"2023-11-28T11:59:46.399325+0000","last_fullsized":"2023-11-28T11:59:46.399325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:32.704729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":52,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.938247+0000","last_change":"2023-11-28T11:56:34.389222+0000","last_active":"2023-11-28T11:59:46.938247+0000","last_peered":"2023-11-28T11:59:46.938247+0000","last_clean":"2023-11-28T11:59:46.938247+0000","last_became_active":"2023-11-28T11:56:34.388671+0000","last_became_peered":"2023-11-28T11:56:34.388671+0000","last_unstale":"2023-11-28T11:59:46.938247+0000","last_undegraded":"2023-11-28T11:59:46.938247+0000","last_fullsized":"2023-11-28T11:59:46.938247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:32.704729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":206,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.399602+0000","last_change":"2023-11-28T11:56:28.472008+0000","last_active":"2023-11-28T11:59:46.399602+0000","last_peered":"2023-11-28T11:59:46.399602+0000","last_clean":"2023-11-28T11:59:46.399602+0000","last_became_active":"2023-11-28T11:56:28.469273+0000","last_became_peered":"2023-11-28T11:56:28.469273+0000","last_unstale":"2023-11-28T11:59:46.399602+0000","last_undegraded":"2023-11-28T11:59:46.399602+0000","last_fullsized":"2023-11-28T11:59:46.399602+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:27.291192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:27.291192+0000","last_clean_scrub_stamp":"2023-11-28T11:56:27.291192+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:14:48.860420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509487,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15124,"kb_used_data":1420,"kb_used_omap":0,"kb_used_meta":13696,"kb_avail":94356716,"statfs":{"total":96636764160,"available":96621277184,"internally_reserved":0,"allocated":1454080,"data_stored":989046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14024704},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.0880000000000001,"15min":1.0960000000000001},"min":{"1min":0.77000000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4379999999999999,"5min":1.468,"15min":1.468},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.083,"15min":1.079},"min":{"1min":0.81699999999999995,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.615,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.2330000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.1950000000000001,"15min":1.204},"min":{"1min":0.83999999999999997,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.542,"5min":1.71,"15min":1.71},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.143,"5min":1.1659999999999999,"15min":1.177},"min":{"1min":0.79500000000000004,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.502,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.86799999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.165,"15min":1.181},"min":{"1min":0.73099999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.579,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.2629999999999999,"15min":1.2789999999999999},"min":{"1min":0.82399999999999995,"5min":0.749,"15min":0.749},"max":{"1min":1.5209999999999999,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.175}]},{"osd":3,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2869999999999999,"15min":1.3109999999999999},"min":{"1min":0.872,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.4610000000000001,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.611},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.337,"15min":1.355},"min":{"1min":1.006,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.5629999999999999,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.476}]},{"osd":4,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.244,"15min":1.294},"min":{"1min":0.90000000000000002,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.278,"15min":1.3300000000000001},"min":{"1min":0.92700000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.5129999999999999,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.107}]},{"osd":5,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.377,"15min":1.429},"min":{"1min":0.91900000000000004,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.5549999999999999,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.552},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.353,"15min":1.391},"min":{"1min":1.145,"5min":0.872,"15min":0.872},"max":{"1min":1.603,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":1.524}]},{"osd":6,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.494,"15min":1.548},"min":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"max":{"1min":1.706,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.589},{"interface":"front","average":{"1min":1.319,"5min":1.401,"15min":1.4470000000000001},"min":{"1min":1.0760000000000001,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.5920000000000001,"5min":2.468,"15min":2.468},"last":1.7909999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509487,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9872,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":9024,"kb_avail":94361968,"statfs":{"total":96636764160,"available":96626655232,"internally_reserved":0,"allocated":860160,"data_stored":398170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9240576},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.004,"15min":0.99399999999999999},"min":{"1min":0.59899999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.5149999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.044,"5min":1.1539999999999999,"15min":1.1899999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.5049999999999999,"5min":2.347,"15min":2.347},"last":1.0389999999999999}]},{"osd":1,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1699999999999999,"15min":1.1739999999999999},"min":{"1min":0.79900000000000004,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.137,"5min":1.157,"15min":1.171},"min":{"1min":0.72699999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.454,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":1.2170000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.198,"15min":1.242},"min":{"1min":0.754,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4410000000000001,"5min":3.9620000000000002,"15min":3.9620000000000002},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1639999999999999,"15min":1.1679999999999999},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.302}]},{"osd":3,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.258,"15min":1.26},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.496,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.518},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.258,"15min":1.268},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.5209999999999999,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.3320000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.2050000000000001,"15min":1.232},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.4179999999999999,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.877},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.4159999999999999,"15min":1.4670000000000001},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.8540000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.1779999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.2250000000000001,"15min":1.266},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.175,"5min":1.244,"15min":1.27},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.98499999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.3200000000000001,"15min":1.3360000000000001},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.343,"15min":1.355},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.978,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.4570000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509487,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9740,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362100,"statfs":{"total":96636764160,"available":96626790400,"internally_reserved":0,"allocated":856064,"data_stored":398168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.0840000000000001,"15min":1.089},"min":{"1min":0.73899999999999999,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.3500000000000001,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.0900000000000001,"15min":1.0820000000000001},"min":{"1min":0.90400000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.359,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.161}]},{"osd":1,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1479999999999999,"15min":1.1519999999999999},"min":{"1min":0.77500000000000002,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.48,"5min":1.843,"15min":1.843},"last":1.206},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.0920000000000001,"15min":1.0900000000000001},"min":{"1min":0.77300000000000002,"5min":0.752,"15min":0.752},"max":{"1min":1.4870000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.97399999999999998}]},{"osd":2,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.171,"15min":1.167},"min":{"1min":0.77600000000000002,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":1.262},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.1930000000000001,"15min":1.198},"min":{"1min":0.86899999999999999,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.4990000000000001,"5min":1.79,"15min":1.79},"last":1.4139999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.252,"15min":1.2729999999999999},"min":{"1min":0.84099999999999997,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.5649999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.03},{"interface":"front","average":{"1min":1.353,"5min":1.365,"15min":1.3919999999999999},"min":{"1min":1.0069999999999999,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.712,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.4890000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.1739999999999999,"15min":1.2090000000000001},"min":{"1min":0.77900000000000003,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.431,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.228,"15min":1.234},"min":{"1min":0.876,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.4770000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.5109999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.2689999999999999,"15min":1.276},"min":{"1min":0.91800000000000004,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.6259999999999999,"5min":1.732,"15min":1.732},"last":1.583},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.2829999999999999,"15min":1.2849999999999999},"min":{"1min":0.99399999999999999,"5min":0.874,"15min":0.874},"max":{"1min":1.4550000000000001,"5min":1.704,"15min":1.704},"last":1.3049999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3520000000000001,"15min":1.3620000000000001},"min":{"1min":0.97499999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.6859999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.7410000000000001},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.446,"15min":1.472},"min":{"1min":1.05,"5min":1.002,"15min":1.002},"max":{"1min":1.762,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.6519999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509487,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14156,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":13312,"kb_avail":94357684,"statfs":{"total":96636764160,"available":96622268416,"internally_reserved":0,"allocated":856064,"data_stored":398148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13631488},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.109,"15min":1.1100000000000001},"min":{"1min":0.76100000000000001,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5429999999999999,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.1279999999999999,"15min":1.1519999999999999},"min":{"1min":0.71699999999999997,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.554,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.70099999999999996}]},{"osd":1,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.173,"15min":1.2090000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.496,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.1819999999999999,"15min":1.202},"min":{"1min":0.70999999999999996,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.7190000000000001,"5min":2.8860000000000001,"15min":2.8860000000000001},"last":1.052}]},{"osd":2,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.208,"15min":1.238},"min":{"1min":0.81999999999999995,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.589,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.377},{"interface":"front","average":{"1min":1.236,"5min":1.3520000000000001,"15min":1.403},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.5389999999999999,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":0.877}]},{"osd":3,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.282,"15min":1.3160000000000001},"min":{"1min":0.89700000000000002,"5min":0.746,"15min":0.746},"max":{"1min":1.4790000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3560000000000001,"15min":1.3740000000000001},"min":{"1min":1.004,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.877,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.5489999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.3640000000000001,"15min":1.431},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.0139999999999998,"5min":2.972,"15min":2.972},"last":1.5149999999999999},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.296,"15min":1.353},"min":{"1min":0.78600000000000003,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.2389999999999999,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.121}]},{"osd":6,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3580000000000001,"15min":1.4059999999999999},"min":{"1min":0.96699999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.919,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.431},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.49,"15min":1.542},"min":{"1min":1.0189999999999999,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":2.0790000000000002,"5min":3.133,"15min":3.133},"last":1.405}]},{"osd":7,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.4570000000000001,"15min":1.5169999999999999},"min":{"1min":0.95199999999999996,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.992,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.337},{"interface":"front","average":{"1min":1.474,"5min":1.5369999999999999,"15min":1.5880000000000001},"min":{"1min":1.145,"5min":1.0760000000000001,"15min":1.0760000000000001},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.607}]}]},{"osd":3,"up_from":15,"seq":64424509487,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14084,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":13248,"kb_avail":94357756,"statfs":{"total":96636764160,"available":96622342144,"internally_reserved":0,"allocated":847872,"data_stored":391436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13565952},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.82999999999999996,"15min":0.84199999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.292,"5min":1.478,"15min":1.478},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.91900000000000004,"15min":0.91800000000000004},"min":{"1min":0.64200000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.276,"5min":2.177,"15min":2.177},"last":0.96099999999999997}]},{"osd":1,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.86699999999999999,"15min":0.86599999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.468,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":1.006,"5min":1.044,"15min":1.0600000000000001},"min":{"1min":0.59099999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4179999999999999,"5min":1.968,"15min":1.968},"last":0.82499999999999996}]},{"osd":2,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.109,"15min":1.139},"min":{"1min":0.63700000000000001,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.548,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.093},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.171,"15min":1.2070000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.5389999999999999,"5min":2.093,"15min":2.093},"last":1.1439999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.1719999999999999,"15min":1.1779999999999999},"min":{"1min":0.84199999999999997,"5min":0.75,"15min":0.75},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.294,"15min":1.3320000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.837,"5min":2.8439999999999999,"15min":2.8439999999999999},"last":1.3149999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.325,"15min":1.359},"min":{"1min":0.85699999999999998,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.6040000000000001,"5min":2.9670000000000001,"15min":2.9670000000000001},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3999999999999999,"15min":1.444},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.655,"5min":3.7429999999999999,"15min":3.7429999999999999},"last":1.258}]},{"osd":6,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3360000000000001,"15min":1.3520000000000001},"min":{"1min":0.91700000000000004,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.077,"5min":2.323,"15min":2.323},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.407,"15min":1.444},"min":{"1min":0.93899999999999995,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.7210000000000001,"5min":2.927,"15min":2.927},"last":1.508}]},{"osd":7,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.4570000000000001,"15min":1.498},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.794,"5min":3.5030000000000001,"15min":3.5030000000000001},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.369,"5min":1.4430000000000001,"15min":1.4750000000000001},"min":{"1min":1.0720000000000001,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.1549999999999998,"5min":2.6320000000000001,"15min":2.6320000000000001},"last":1.3620000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509487,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13988,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":13120,"kb_avail":94357852,"statfs":{"total":96636764160,"available":96622440448,"internally_reserved":0,"allocated":880640,"data_stored":410178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13434880},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.89300000000000002,"15min":0.93400000000000005},"min":{"1min":0.495,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.3919999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.018,"15min":1.0089999999999999},"min":{"1min":0.67700000000000005,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.5429999999999999,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":1.649}]},{"osd":2,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.069,"15min":1.083},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.6160000000000001,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0860000000000001,"15min":1.1000000000000001},"min":{"1min":0.72599999999999998,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.7769999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.0620000000000001}]},{"osd":3,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.1859999999999999,"15min":1.2030000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.635,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.103,"5min":1.1339999999999999,"15min":1.171},"min":{"1min":0.65600000000000003,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.4670000000000001,"5min":1.8,"15min":1.8},"last":1.103}]},{"osd":4,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.353,"15min":1.3720000000000001},"min":{"1min":1.002,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.6890000000000001,"5min":3.411,"15min":3.411},"last":1.282},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.3009999999999999,"15min":1.339},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.7969999999999999,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":1.3819999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.3799999999999999,"15min":1.423},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.9039999999999999,"5min":3.6869999999999998,"15min":3.6869999999999998},"last":1.528},{"interface":"front","average":{"1min":1.284,"5min":1.306,"15min":1.3260000000000001},"min":{"1min":0.97699999999999998,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.736,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.1870000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.4239999999999999,"15min":1.4550000000000001},"min":{"1min":0.99399999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.8899999999999999,"5min":3.5379999999999998,"15min":3.5379999999999998},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.4470000000000001,"15min":1.49},"min":{"1min":0.84099999999999997,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.0259999999999998,"5min":2.5739999999999998,"15min":2.5739999999999998},"last":1.7210000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.4510000000000001,"15min":1.4770000000000001},"min":{"1min":1.1040000000000001,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.9490000000000001,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.5640000000000001},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.492,"15min":1.52},"min":{"1min":1.1870000000000001,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.986,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.7490000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542191,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9808,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94362032,"statfs":{"total":96636764160,"available":96626720768,"internally_reserved":0,"allocated":860160,"data_stored":402824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:27 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85499999999999998,"15min":0.86699999999999999},"min":{"1min":0.59999999999999998,"5min":0.497,"15min":0.497},"max":{"1min":1.28,"5min":1.722,"15min":1.722},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.98199999999999998,"15min":1.002},"min":{"1min":0.55800000000000005,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.389,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":0.81100000000000005}]},{"osd":1,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.01,"15min":1.028},"min":{"1min":0.58699999999999997,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.276,"5min":1.754,"15min":1.754},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.92800000000000005,"15min":0.93999999999999995},"min":{"1min":0.627,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2729999999999999,"5min":1.484,"15min":1.484},"last":0.83899999999999997}]},{"osd":3,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.105,"15min":1.127},"min":{"1min":0.74299999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.5109999999999999,"5min":2.048,"15min":2.048},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.214,"5min":1.2629999999999999,"15min":1.2869999999999999},"min":{"1min":0.81399999999999995,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.6699999999999999,"5min":2.617,"15min":2.617},"last":1.0820000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3460000000000001,"15min":1.3799999999999999},"min":{"1min":1.0580000000000001,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.6619999999999999,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2370000000000001,"15min":1.2509999999999999},"min":{"1min":0.86199999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.6830000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":1.476}]},{"osd":5,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.3129999999999999,"15min":1.343},"min":{"1min":0.93999999999999995,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.6759999999999999,"5min":2.738,"15min":2.738},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.288,"5min":1.4570000000000001,"15min":1.5349999999999999},"min":{"1min":0.92100000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.7350000000000001,"5min":4.0309999999999997,"15min":4.0309999999999997},"last":1.4410000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.5289999999999999,"15min":1.593},"min":{"1min":1.0529999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.8,"5min":4.2240000000000002,"15min":4.2240000000000002},"last":1.518},{"interface":"front","average":{"1min":1.363,"5min":1.4770000000000001,"15min":1.534},"min":{"1min":1.0600000000000001,"5min":0.755,"15min":0.755},"max":{"1min":1.7430000000000001,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":1.3200000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.413,"15min":1.4490000000000001},"min":{"1min":0.90200000000000002,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.776,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.381},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.591,"15min":1.653},"min":{"1min":1.01,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.8460000000000001,"5min":4.3570000000000002,"15min":4.3570000000000002},"last":1.575}]}]},{"osd":0,"up_from":14,"seq":60129542191,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11068,"kb_used_data":1396,"kb_used_omap":0,"kb_used_meta":9664,"kb_avail":94360772,"statfs":{"total":96636764160,"available":96625430528,"internally_reserved":0,"allocated":1429504,"data_stored":980773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9895936},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.85999999999999999,"15min":0.875},"min":{"1min":0.54500000000000004,"5min":0.439,"15min":0.439},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.1220000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.99299999999999999,"15min":1.0089999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.5569999999999999,"5min":1.7,"15min":1.7},"last":0.68600000000000005}]},{"osd":2,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":1.0109999999999999,"15min":1.0409999999999999},"min":{"1min":0.61899999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2929999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.91800000000000004,"15min":0.92200000000000004},"min":{"1min":0.59399999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.444,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.78600000000000003}]},{"osd":3,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.046,"15min":1.0700000000000001},"min":{"1min":0.68000000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.5940000000000001,"5min":1.645,"15min":1.645},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.093,"5min":1.208,"15min":1.2310000000000001},"min":{"1min":0.77100000000000002,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.403,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.1699999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.294,"15min":1.3320000000000001},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.5,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.014},{"interface":"front","average":{"1min":1.149,"5min":1.3240000000000001,"15min":1.383},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.3899999999999999,"5min":3.1629999999999998,"15min":3.1629999999999998},"last":1.3500000000000001}]},{"osd":5,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.331,"15min":1.353},"min":{"1min":0.91300000000000003,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.583,"5min":2.23,"15min":2.23},"last":1.105},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.363,"15min":1.407},"min":{"1min":0.97199999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.494,"5min":2.266,"15min":2.266},"last":1.222}]},{"osd":6,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.4530000000000001,"15min":1.5009999999999999},"min":{"1min":0.99299999999999999,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.7629999999999999,"5min":2.4060000000000001,"15min":2.4060000000000001},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.4470000000000001,"15min":1.488},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.752,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":1.419}]},{"osd":7,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.4810000000000001,"15min":1.5109999999999999},"min":{"1min":1.0800000000000001,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.869,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.391},{"interface":"front","average":{"1min":1.331,"5min":1.5029999999999999,"15min":1.556},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":1.663,"5min":2.6040000000000001,"15min":2.6040000000000001},"last":1.335}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T12:00:11.823 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T12:00:12.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.997+0000 7fb81cf9a700 1 Processor -- start 2023-11-28T12:00:12.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.997+0000 7fb81cf9a700 1 -- start start 2023-11-28T12:00:12.008 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.997+0000 7fb81cf9a700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb81815c650 0x7fb81806b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:12.008 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.997+0000 7fb81cf9a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8180cd0d0 0x7fb8180b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:12.008 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.997+0000 7fb81cf9a700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb8180b1b80 0x7fb81806bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:12.008 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.997+0000 7fb81cf9a700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb81806b140 con 0x7fb81815c650 2023-11-28T12:00:12.008 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.997+0000 7fb81cf9a700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8180c9d40 con 0x7fb8180b1b80 2023-11-28T12:00:12.008 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.997+0000 7fb81cf9a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb81806b820 con 0x7fb8180cd0d0 2023-11-28T12:00:12.009 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.997+0000 7fb80effd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8180cd0d0 0x7fb8180b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:12.009 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.997+0000 7fb80effd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8180cd0d0 0x7fb8180b1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:39804/0 (socket says 172.21.15.39:39804) 2023-11-28T12:00:12.009 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.997+0000 7fb817fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb8180b1b80 0x7fb81806bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:12.009 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.997+0000 7fb80effd700 1 -- 172.21.15.39:0/3595345769 learned_addr learned my addr 172.21.15.39:0/3595345769 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:12.009 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:11.997+0000 7fb8177fe700 1 --2- 172.21.15.39:0/3595345769 >> v2:172.21.15.39:3300/0 conn(0x7fb81815c650 0x7fb81806b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:12.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.001+0000 7fb80effd700 1 -- 172.21.15.39:0/3595345769 >> v2:172.21.15.184:3300/0 conn(0x7fb8180b1b80 msgr2=0x7fb81806bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:12.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.001+0000 7fb80effd700 1 --2- 172.21.15.39:0/3595345769 >> v2:172.21.15.184:3300/0 conn(0x7fb8180b1b80 0x7fb81806bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:12.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.001+0000 7fb80effd700 1 -- 172.21.15.39:0/3595345769 >> v2:172.21.15.39:3300/0 conn(0x7fb81815c650 msgr2=0x7fb81806b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:12.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.001+0000 7fb80effd700 1 --2- 172.21.15.39:0/3595345769 >> v2:172.21.15.39:3300/0 conn(0x7fb81815c650 0x7fb81806b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:12.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.001+0000 7fb80effd700 1 -- 172.21.15.39:0/3595345769 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8180cd5d0 con 0x7fb8180cd0d0 2023-11-28T12:00:12.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.001+0000 7fb80effd700 1 --2- 172.21.15.39:0/3595345769 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8180cd0d0 0x7fb8180b1640 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb818072d70 tx=0x7fb800009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dc184b980dca07a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:12.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.001+0000 7fb816ffd700 1 -- 172.21.15.39:0/3595345769 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb800011830 con 0x7fb8180cd0d0 2023-11-28T12:00:12.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.001+0000 7fb816ffd700 1 -- 172.21.15.39:0/3595345769 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb800011990 con 0x7fb8180cd0d0 2023-11-28T12:00:12.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.001+0000 7fb816ffd700 1 -- 172.21.15.39:0/3595345769 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb800011d20 con 0x7fb8180cd0d0 2023-11-28T12:00:12.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.001+0000 7fb81cf9a700 1 -- 172.21.15.39:0/3595345769 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8180cd0d0 msgr2=0x7fb8180b1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:12.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.001+0000 7fb81cf9a700 1 --2- 172.21.15.39:0/3595345769 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8180cd0d0 0x7fb8180b1640 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb818072d70 tx=0x7fb800009bf0 comp rx=0 tx=0).stop 2023-11-28T12:00:12.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.001+0000 7fb81cf9a700 1 -- 172.21.15.39:0/3595345769 shutdown_connections 2023-11-28T12:00:12.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.001+0000 7fb81cf9a700 1 --2- 172.21.15.39:0/3595345769 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8180cd0d0 0x7fb8180b1640 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:12.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.001+0000 7fb81cf9a700 1 --2- 172.21.15.39:0/3595345769 >> v2:172.21.15.184:3300/0 conn(0x7fb8180b1b80 0x7fb81806bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:12.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.001+0000 7fb81cf9a700 1 --2- 172.21.15.39:0/3595345769 >> v2:172.21.15.39:3300/0 conn(0x7fb81815c650 0x7fb81806b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:12.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.001+0000 7fb81cf9a700 1 -- 172.21.15.39:0/3595345769 >> 172.21.15.39:0/3595345769 conn(0x7fb8180b0f80 msgr2=0x7fb8180ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:12.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.001+0000 7fb81cf9a700 1 -- 172.21.15.39:0/3595345769 shutdown_connections 2023-11-28T12:00:12.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.001+0000 7fb81cf9a700 1 -- 172.21.15.39:0/3595345769 wait complete. 2023-11-28T12:00:12.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.005+0000 7fb81cf9a700 1 Processor -- start 2023-11-28T12:00:12.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.005+0000 7fb81cf9a700 1 -- start start 2023-11-28T12:00:12.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.005+0000 7fb81cf9a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8180b1b80 0x7fb81814e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:12.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.005+0000 7fb81cf9a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8180cd0d0 0x7fb8181515d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:12.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.005+0000 7fb81cf9a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb81815c650 0x7fb818153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:12.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.005+0000 7fb81cf9a700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb818154340 con 0x7fb8180cd0d0 2023-11-28T12:00:12.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.005+0000 7fb81cf9a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81814eab0 con 0x7fb81815c650 2023-11-28T12:00:12.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.005+0000 7fb81cf9a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb818151140 con 0x7fb8180b1b80 2023-11-28T12:00:12.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.005+0000 7fb80effd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8180cd0d0 0x7fb8181515d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:12.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.005+0000 7fb80effd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8180cd0d0 0x7fb8181515d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40596/0 (socket says 172.21.15.39:40596) 2023-11-28T12:00:12.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.005+0000 7fb80effd700 1 -- 172.21.15.39:0/2214531333 learned_addr learned my addr 172.21.15.39:0/2214531333 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:12.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.005+0000 7fb8177fe700 1 --2- 172.21.15.39:0/2214531333 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8180b1b80 0x7fb81814e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:12.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.005+0000 7fb817fff700 1 --2- 172.21.15.39:0/2214531333 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb81815c650 0x7fb818153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:12.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.005+0000 7fb80effd700 1 -- 172.21.15.39:0/2214531333 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8180b1b80 msgr2=0x7fb81814e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:12.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.005+0000 7fb80effd700 1 --2- 172.21.15.39:0/2214531333 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8180b1b80 0x7fb81814e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:12.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.005+0000 7fb80effd700 1 -- 172.21.15.39:0/2214531333 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb81815c650 msgr2=0x7fb818153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:12.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.005+0000 7fb80effd700 1 --2- 172.21.15.39:0/2214531333 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb81815c650 0x7fb818153230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:12.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.005+0000 7fb80effd700 1 -- 172.21.15.39:0/2214531333 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb800009570 con 0x7fb8180cd0d0 2023-11-28T12:00:12.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.005+0000 7fb80effd700 1 --2- 172.21.15.39:0/2214531333 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8180cd0d0 0x7fb8181515d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fb800013000 tx=0x7fb800004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:12.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.009+0000 7fb814ff9700 1 -- 172.21.15.39:0/2214531333 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb800004240 con 0x7fb8180cd0d0 2023-11-28T12:00:12.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.009+0000 7fb814ff9700 1 -- 172.21.15.39:0/2214531333 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb80001f070 con 0x7fb8180cd0d0 2023-11-28T12:00:12.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.009+0000 7fb81cf9a700 1 -- 172.21.15.39:0/2214531333 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8180c99d0 con 0x7fb8180cd0d0 2023-11-28T12:00:12.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.009+0000 7fb814ff9700 1 -- 172.21.15.39:0/2214531333 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb800004600 con 0x7fb8180cd0d0 2023-11-28T12:00:12.018 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.009+0000 7fb81cf9a700 1 -- 172.21.15.39:0/2214531333 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8180cd8b0 con 0x7fb8180cd0d0 2023-11-28T12:00:12.018 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.009+0000 7fb81cf9a700 1 -- 172.21.15.39:0/2214531333 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8180c9680 con 0x7fb8180cd0d0 2023-11-28T12:00:12.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.009+0000 7fb814ff9700 1 -- 172.21.15.39:0/2214531333 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb80000f050 con 0x7fb8180cd0d0 2023-11-28T12:00:12.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.013+0000 7fb814ff9700 1 --2- 172.21.15.39:0/2214531333 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb7f8064f10 0x7fb7f80673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:12.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.013+0000 7fb814ff9700 1 -- 172.21.15.39:0/2214531333 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fb800082d90 con 0x7fb8180cd0d0 2023-11-28T12:00:12.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.013+0000 7fb8177fe700 1 --2- 172.21.15.39:0/2214531333 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb7f8064f10 0x7fb7f80673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:12.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.013+0000 7fb8177fe700 1 --2- 172.21.15.39:0/2214531333 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb7f8064f10 0x7fb7f80673c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fb808009b50 tx=0x7fb808009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:12.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.017+0000 7fb814ff9700 1 -- 172.21.15.39:0/2214531333 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb8000510e0 con 0x7fb8180cd0d0 2023-11-28T12:00:12.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.189+0000 7fb81cf9a700 1 -- 172.21.15.39:0/2214531333 --> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb818073cb0 con 0x7fb7f8064f10 2023-11-28T12:00:12.201 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.197+0000 7fb814ff9700 1 -- 172.21.15.39:0/2214531333 <== mgr.4104 v2:172.21.15.184:6832/36166 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70294 (secure 0 0 0) 0x7fb818073cb0 con 0x7fb7f8064f10 2023-11-28T12:00:12.202 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T12:00:12.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.197+0000 7fb81cf9a700 1 -- 172.21.15.39:0/2214531333 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb7f8064f10 msgr2=0x7fb7f80673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:12.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.197+0000 7fb81cf9a700 1 --2- 172.21.15.39:0/2214531333 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb7f8064f10 0x7fb7f80673c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fb808009b50 tx=0x7fb808009240 comp rx=0 tx=0).stop 2023-11-28T12:00:12.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.197+0000 7fb81cf9a700 1 -- 172.21.15.39:0/2214531333 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8180cd0d0 msgr2=0x7fb8181515d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:12.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.197+0000 7fb81cf9a700 1 --2- 172.21.15.39:0/2214531333 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8180cd0d0 0x7fb8181515d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fb800013000 tx=0x7fb800004770 comp rx=0 tx=0).stop 2023-11-28T12:00:12.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.197+0000 7fb81cf9a700 1 -- 172.21.15.39:0/2214531333 shutdown_connections 2023-11-28T12:00:12.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.197+0000 7fb81cf9a700 1 --2- 172.21.15.39:0/2214531333 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fb7f8064f10 0x7fb7f80673c0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:12.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.197+0000 7fb81cf9a700 1 --2- 172.21.15.39:0/2214531333 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb81815c650 0x7fb818153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:12.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.197+0000 7fb81cf9a700 1 --2- 172.21.15.39:0/2214531333 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8180cd0d0 0x7fb8181515d0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:12.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.197+0000 7fb81cf9a700 1 --2- 172.21.15.39:0/2214531333 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8180b1b80 0x7fb81814e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:12.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.197+0000 7fb81cf9a700 1 -- 172.21.15.39:0/2214531333 >> 172.21.15.39:0/2214531333 conn(0x7fb8180b0f80 msgr2=0x7fb81806bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:12.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.197+0000 7fb81cf9a700 1 -- 172.21.15.39:0/2214531333 shutdown_connections 2023-11-28T12:00:12.206 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.201+0000 7fb81cf9a700 1 -- 172.21.15.39:0/2214531333 wait complete. 2023-11-28T12:00:12.207 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2023-11-28T12:00:12.228 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2023-11-28T12:00:10.627967+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":97840,"kb_used_data":7856,"kb_used_omap":0,"kb_used_meta":89920,"kb_avail":754876880,"statfs":{"total":773094113280,"available":772993925120,"internally_reserved":0,"allocated":8044544,"data_stored":4368743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":92078080},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12282,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-6,"num_read_kb":-5,"num_write":-73,"num_write_kb":-36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001963"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.319093+0000","last_change":"2023-11-28T11:56:34.384408+0000","last_active":"2023-11-28T11:59:46.319093+0000","last_peered":"2023-11-28T11:59:46.319093+0000","last_clean":"2023-11-28T11:59:46.319093+0000","last_became_active":"2023-11-28T11:56:34.384036+0000","last_became_peered":"2023-11-28T11:56:34.384036+0000","last_unstale":"2023-11-28T11:59:46.319093+0000","last_undegraded":"2023-11-28T11:59:46.319093+0000","last_fullsized":"2023-11-28T11:59:46.319093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:58:55.003786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.939248+0000","last_change":"2023-11-28T11:56:34.384088+0000","last_active":"2023-11-28T11:59:46.939248+0000","last_peered":"2023-11-28T11:59:46.939248+0000","last_clean":"2023-11-28T11:59:46.939248+0000","last_became_active":"2023-11-28T11:56:34.383631+0000","last_became_peered":"2023-11-28T11:56:34.383631+0000","last_unstale":"2023-11-28T11:59:46.939248+0000","last_undegraded":"2023-11-28T11:59:46.939248+0000","last_fullsized":"2023-11-28T11:59:46.939248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:15:42.772333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":53,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.400542+0000","last_change":"2023-11-28T11:56:34.386399+0000","last_active":"2023-11-28T11:59:46.400542+0000","last_peered":"2023-11-28T11:59:46.400542+0000","last_clean":"2023-11-28T11:59:46.400542+0000","last_became_active":"2023-11-28T11:56:34.385994+0000","last_became_peered":"2023-11-28T11:56:34.385994+0000","last_unstale":"2023-11-28T11:59:46.400542+0000","last_undegraded":"2023-11-28T11:59:46.400542+0000","last_fullsized":"2023-11-28T11:59:46.400542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:58:02.172295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.941175+0000","last_change":"2023-11-28T11:56:34.384999+0000","last_active":"2023-11-28T11:59:46.941175+0000","last_peered":"2023-11-28T11:59:46.941175+0000","last_clean":"2023-11-28T11:59:46.941175+0000","last_became_active":"2023-11-28T11:56:34.384531+0000","last_became_peered":"2023-11-28T11:56:34.384531+0000","last_unstale":"2023-11-28T11:59:46.941175+0000","last_undegraded":"2023-11-28T11:59:46.941175+0000","last_fullsized":"2023-11-28T11:59:46.941175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:09:50.083366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":52,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.938906+0000","last_change":"2023-11-28T11:56:34.389076+0000","last_active":"2023-11-28T11:59:46.938906+0000","last_peered":"2023-11-28T11:59:46.938906+0000","last_clean":"2023-11-28T11:59:46.938906+0000","last_became_active":"2023-11-28T11:56:34.388689+0000","last_became_peered":"2023-11-28T11:56:34.388689+0000","last_unstale":"2023-11-28T11:59:46.938906+0000","last_undegraded":"2023-11-28T11:59:46.938906+0000","last_fullsized":"2023-11-28T11:59:46.938906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:20.936349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.321952+0000","last_change":"2023-11-28T11:56:34.486178+0000","last_active":"2023-11-28T11:59:45.321952+0000","last_peered":"2023-11-28T11:59:45.321952+0000","last_clean":"2023-11-28T11:59:45.321952+0000","last_became_active":"2023-11-28T11:56:34.485702+0000","last_became_peered":"2023-11-28T11:56:34.485702+0000","last_unstale":"2023-11-28T11:59:45.321952+0000","last_undegraded":"2023-11-28T11:59:45.321952+0000","last_fullsized":"2023-11-28T11:59:45.321952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:06.323407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":53,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.399325+0000","last_change":"2023-11-28T11:56:34.387293+0000","last_active":"2023-11-28T11:59:46.399325+0000","last_peered":"2023-11-28T11:59:46.399325+0000","last_clean":"2023-11-28T11:59:46.399325+0000","last_became_active":"2023-11-28T11:56:34.386976+0000","last_became_peered":"2023-11-28T11:56:34.386976+0000","last_unstale":"2023-11-28T11:59:46.399325+0000","last_undegraded":"2023-11-28T11:59:46.399325+0000","last_fullsized":"2023-11-28T11:59:46.399325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:32.704729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":52,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.938247+0000","last_change":"2023-11-28T11:56:34.389222+0000","last_active":"2023-11-28T11:59:46.938247+0000","last_peered":"2023-11-28T11:59:46.938247+0000","last_clean":"2023-11-28T11:59:46.938247+0000","last_became_active":"2023-11-28T11:56:34.388671+0000","last_became_peered":"2023-11-28T11:56:34.388671+0000","last_unstale":"2023-11-28T11:59:46.938247+0000","last_undegraded":"2023-11-28T11:59:46.938247+0000","last_fullsized":"2023-11-28T11:59:46.938247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:32.704729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":206,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.399602+0000","last_change":"2023-11-28T11:56:28.472008+0000","last_active":"2023-11-28T11:59:46.399602+0000","last_peered":"2023-11-28T11:59:46.399602+0000","last_clean":"2023-11-28T11:59:46.399602+0000","last_became_active":"2023-11-28T11:56:28.469273+0000","last_became_peered":"2023-11-28T11:56:28.469273+0000","last_unstale":"2023-11-28T11:59:46.399602+0000","last_undegraded":"2023-11-28T11:59:46.399602+0000","last_fullsized":"2023-11-28T11:59:46.399602+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:27.291192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:27.291192+0000","last_clean_scrub_stamp":"2023-11-28T11:56:27.291192+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:14:48.860420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509487,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15124,"kb_used_data":1420,"kb_used_omap":0,"kb_used_meta":13696,"kb_avail":94356716,"statfs":{"total":96636764160,"available":96621277184,"internally_reserved":0,"allocated":1454080,"data_stored":989046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14024704},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.0880000000000001,"15min":1.0960000000000001},"min":{"1min":0.77000000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4379999999999999,"5min":1.468,"15min":1.468},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.083,"15min":1.079},"min":{"1min":0.81699999999999995,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.615,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.2330000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.1950000000000001,"15min":1.204},"min":{"1min":0.83999999999999997,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.542,"5min":1.71,"15min":1.71},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.143,"5min":1.1659999999999999,"15min":1.177},"min":{"1min":0.79500000000000004,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.502,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.86799999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.165,"15min":1.181},"min":{"1min":0.73099999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.579,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.2629999999999999,"15min":1.2789999999999999},"min":{"1min":0.82399999999999995,"5min":0.749,"15min":0.749},"max":{"1min":1.5209999999999999,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.175}]},{"osd":3,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2869999999999999,"15min":1.3109999999999999},"min":{"1min":0.872,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.4610000000000001,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.611},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.337,"15min":1.355},"min":{"1min":1.006,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.5629999999999999,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.476}]},{"osd":4,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.244,"15min":1.294},"min":{"1min":0.90000000000000002,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.278,"15min":1.3300000000000001},"min":{"1min":0.92700000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.5129999999999999,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.107}]},{"osd":5,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.377,"15min":1.429},"min":{"1min":0.91900000000000004,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.5549999999999999,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.552},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.353,"15min":1.391},"min":{"1min":1.145,"5min":0.872,"15min":0.872},"max":{"1min":1.603,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":1.524}]},{"osd":6,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.494,"15min":1.548},"min":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"max":{"1min":1.706,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.589},{"interface":"front","average":{"1min":1.319,"5min":1.401,"15min":1.4470000000000001},"min":{"1min":1.0760000000000001,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.5920000000000001,"5min":2.468,"15min":2.468},"last":1.7909999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509487,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9872,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":9024,"kb_avail":94361968,"statfs":{"total":96636764160,"available":96626655232,"internally_reserved":0,"allocated":860160,"data_stored":398170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9240576},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.004,"15min":0.99399999999999999},"min":{"1min":0.59899999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.5149999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.044,"5min":1.1539999999999999,"15min":1.1899999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.5049999999999999,"5min":2.347,"15min":2.347},"last":1.0389999999999999}]},{"osd":1,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1699999999999999,"15min":1.1739999999999999},"min":{"1min":0.79900000000000004,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.137,"5min":1.157,"15min":1.171},"min":{"1min":0.72699999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.454,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":1.2170000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.198,"15min":1.242},"min":{"1min":0.754,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4410000000000001,"5min":3.9620000000000002,"15min":3.9620000000000002},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1639999999999999,"15min":1.1679999999999999},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.302}]},{"osd":3,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.258,"15min":1.26},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.496,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.518},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.258,"15min":1.268},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.5209999999999999,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.3320000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.2050000000000001,"15min":1.232},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.4179999999999999,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.877},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.4159999999999999,"15min":1.4670000000000001},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.8540000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.1779999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.2250000000000001,"15min":1.266},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.175,"5min":1.244,"15min":1.27},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.98499999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.3200000000000001,"15min":1.3360000000000001},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.343,"15min":1.355},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.978,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.4570000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509487,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9740,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362100,"statfs":{"total":96636764160,"available":96626790400,"internally_reserved":0,"allocated":856064,"data_stored":398168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.0840000000000001,"15min":1.089},"min":{"1min":0.73899999999999999,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.3500000000000001,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.0900000000000001,"15min":1.0820000000000001},"min":{"1min":0.90400000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.359,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.161}]},{"osd":1,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1479999999999999,"15min":1.1519999999999999},"min":{"1min":0.77500000000000002,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.48,"5min":1.843,"15min":1.843},"last":1.206},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.0920000000000001,"15min":1.0900000000000001},"min":{"1min":0.77300000000000002,"5min":0.752,"15min":0.752},"max":{"1min":1.4870000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.97399999999999998}]},{"osd":2,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.171,"15min":1.167},"min":{"1min":0.77600000000000002,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":1.262},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.1930000000000001,"15min":1.198},"min":{"1min":0.86899999999999999,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.4990000000000001,"5min":1.79,"15min":1.79},"last":1.4139999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.252,"15min":1.2729999999999999},"min":{"1min":0.84099999999999997,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.5649999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.03},{"interface":"front","average":{"1min":1.353,"5min":1.365,"15min":1.3919999999999999},"min":{"1min":1.0069999999999999,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.712,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.4890000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.1739999999999999,"15min":1.2090000000000001},"min":{"1min":0.77900000000000003,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.431,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.228,"15min":1.234},"min":{"1min":0.876,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.4770000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.5109999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.2689999999999999,"15min":1.276},"min":{"1min":0.91800000000000004,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.6259999999999999,"5min":1.732,"15min":1.732},"last":1.583},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.2829999999999999,"15min":1.2849999999999999},"min":{"1min":0.99399999999999999,"5min":0.874,"15min":0.874},"max":{"1min":1.4550000000000001,"5min":1.704,"15min":1.704},"last":1.3049999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3520000000000001,"15min":1.3620000000000001},"min":{"1min":0.97499999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.6859999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.7410000000000001},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.446,"15min":1.472},"min":{"1min":1.05,"5min":1.002,"15min":1.002},"max":{"1min":1.762,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.6519999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509487,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14156,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":13312,"kb_avail":94357684,"statfs":{"total":96636764160,"available":96622268416,"internally_reserved":0,"allocated":856064,"data_stored":398148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13631488},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.109,"15min":1.1100000000000001},"min":{"1min":0.76100000000000001,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5429999999999999,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.1279999999999999,"15min":1.1519999999999999},"min":{"1min":0.71699999999999997,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.554,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.70099999999999996}]},{"osd":1,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.173,"15min":1.2090000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.496,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.1819999999999999,"15min":1.202},"min":{"1min":0.70999999999999996,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.7190000000000001,"5min":2.8860000000000001,"15min":2.8860000000000001},"last":1.052}]},{"osd":2,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.208,"15min":1.238},"min":{"1min":0.81999999999999995,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.589,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.377},{"interface":"front","average":{"1min":1.236,"5min":1.3520000000000001,"15min":1.403},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.5389999999999999,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":0.877}]},{"osd":3,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.282,"15min":1.3160000000000001},"min":{"1min":0.89700000000000002,"5min":0.746,"15min":0.746},"max":{"1min":1.4790000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3560000000000001,"15min":1.3740000000000001},"min":{"1min":1.004,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.877,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.5489999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.3640000000000001,"15min":1.431},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.0139999999999998,"5min":2.972,"15min":2.972},"last":1.5149999999999999},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.296,"15min":1.353},"min":{"1min":0.78600000000000003,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.2389999999999999,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.121}]},{"osd":6,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3580000000000001,"15min":1.4059999999999999},"min":{"1min":0.96699999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.919,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.431},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.49,"15min":1.542},"min":{"1min":1.0189999999999999,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":2.0790000000000002,"5min":3.133,"15min":3.133},"last":1.405}]},{"osd":7,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.4570000000000001,"15min":1.5169999999999999},"min":{"1min":0.95199999999999996,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.992,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.337},{"interface":"front","average":{"1min":1.474,"5min":1.5369999999999999,"15min":1.5880000000000001},"min":{"1min":1.145,"5min":1.0760000000000001,"15min":1.0760000000000001},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.607}]}]},{"osd":3,"up_from":15,"seq":64424509487,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14084,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":13248,"kb_avail":94357756,"statfs":{"total":96636764160,"available":96622342144,"internally_reserved":0,"allocated":847872,"data_stored":391436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13565952},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.82999999999999996,"15min":0.84199999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.292,"5min":1.478,"15min":1.478},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.91900000000000004,"15min":0.91800000000000004},"min":{"1min":0.64200000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.276,"5min":2.177,"15min":2.177},"last":0.96099999999999997}]},{"osd":1,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.86699999999999999,"15min":0.86599999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.468,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":1.006,"5min":1.044,"15min":1.0600000000000001},"min":{"1min":0.59099999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4179999999999999,"5min":1.968,"15min":1.968},"last":0.82499999999999996}]},{"osd":2,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.109,"15min":1.139},"min":{"1min":0.63700000000000001,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.548,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.093},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.171,"15min":1.2070000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.5389999999999999,"5min":2.093,"15min":2.093},"last":1.1439999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.1719999999999999,"15min":1.1779999999999999},"min":{"1min":0.84199999999999997,"5min":0.75,"15min":0.75},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.294,"15min":1.3320000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.837,"5min":2.8439999999999999,"15min":2.8439999999999999},"last":1.3149999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.325,"15min":1.359},"min":{"1min":0.85699999999999998,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.6040000000000001,"5min":2.9670000000000001,"15min":2.9670000000000001},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3999999999999999,"15min":1.444},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.655,"5min":3.7429999999999999,"15min":3.7429999999999999},"last":1.258}]},{"osd":6,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3360000000000001,"15min":1.3520000000000001},"min":{"1min":0.91700000000000004,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.077,"5min":2.323,"15min":2.323},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.407,"15min":1.444},"min":{"1min":0.93899999999999995,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.7210000000000001,"5min":2.927,"15min":2.927},"last":1.508}]},{"osd":7,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.4570000000000001,"15min":1.498},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.794,"5min":3.5030000000000001,"15min":3.5030000000000001},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.369,"5min":1.4430000000000001,"15min":1.4750000000000001},"min":{"1min":1.0720000000000001,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.1549999999999998,"5min":2.6320000000000001,"15min":2.6320000000000001},"last":1.3620000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509487,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13988,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":13120,"kb_avail":94357852,"statfs":{"total":96636764160,"available":96622440448,"internally_reserved":0,"allocated":880640,"data_stored":410178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13434880},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.89300000000000002,"15min":0.93400000000000005},"min":{"1min":0.495,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.3919999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.018,"15min":1.0089999999999999},"min":{"1min":0.67700000000000005,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.5429999999999999,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":1.649}]},{"osd":2,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.069,"15min":1.083},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.6160000000000001,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0860000000000001,"15min":1.1000000000000001},"min":{"1min":0.72599999999999998,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.7769999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.0620000000000001}]},{"osd":3,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.1859999999999999,"15min":1.2030000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.635,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.103,"5min":1.1339999999999999,"15min":1.171},"min":{"1min":0.65600000000000003,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.4670000000000001,"5min":1.8,"15min":1.8},"last":1.103}]},{"osd":4,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.353,"15min":1.3720000000000001},"min":{"1min":1.002,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.6890000000000001,"5min":3.411,"15min":3.411},"last":1.282},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.3009999999999999,"15min":1.339},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.7969999999999999,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":1.3819999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.3799999999999999,"15min":1.423},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.9039999999999999,"5min":3.6869999999999998,"15min":3.6869999999999998},"last":1.528},{"interface":"front","average":{"1min":1.284,"5min":1.306,"15min":1.3260000000000001},"min":{"1min":0.97699999999999998,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.736,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.1870000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.4239999999999999,"15min":1.4550000000000001},"min":{"1min":0.99399999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.8899999999999999,"5min":3.5379999999999998,"15min":3.5379999999999998},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.4470000000000001,"15min":1.49},"min":{"1min":0.84099999999999997,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.0259999999999998,"5min":2.5739999999999998,"15min":2.5739999999999998},"last":1.7210000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.4510000000000001,"15min":1.4770000000000001},"min":{"1min":1.1040000000000001,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.9490000000000001,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.5640000000000001},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.492,"15min":1.52},"min":{"1min":1.1870000000000001,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.986,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.7490000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542191,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9808,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94362032,"statfs":{"total":96636764160,"available":96626720768,"internally_reserved":0,"allocated":860160,"data_stored":402824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:27 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85499999999999998,"15min":0.86699999999999999},"min":{"1min":0.59999999999999998,"5min":0.497,"15min":0.497},"max":{"1min":1.28,"5min":1.722,"15min":1.722},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.98199999999999998,"15min":1.002},"min":{"1min":0.55800000000000005,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.389,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":0.81100000000000005}]},{"osd":1,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.01,"15min":1.028},"min":{"1min":0.58699999999999997,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.276,"5min":1.754,"15min":1.754},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.92800000000000005,"15min":0.93999999999999995},"min":{"1min":0.627,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2729999999999999,"5min":1.484,"15min":1.484},"last":0.83899999999999997}]},{"osd":3,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.105,"15min":1.127},"min":{"1min":0.74299999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.5109999999999999,"5min":2.048,"15min":2.048},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.214,"5min":1.2629999999999999,"15min":1.2869999999999999},"min":{"1min":0.81399999999999995,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.6699999999999999,"5min":2.617,"15min":2.617},"last":1.0820000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3460000000000001,"15min":1.3799999999999999},"min":{"1min":1.0580000000000001,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.6619999999999999,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2370000000000001,"15min":1.2509999999999999},"min":{"1min":0.86199999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.6830000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":1.476}]},{"osd":5,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.3129999999999999,"15min":1.343},"min":{"1min":0.93999999999999995,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.6759999999999999,"5min":2.738,"15min":2.738},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.288,"5min":1.4570000000000001,"15min":1.5349999999999999},"min":{"1min":0.92100000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.7350000000000001,"5min":4.0309999999999997,"15min":4.0309999999999997},"last":1.4410000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.5289999999999999,"15min":1.593},"min":{"1min":1.0529999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.8,"5min":4.2240000000000002,"15min":4.2240000000000002},"last":1.518},{"interface":"front","average":{"1min":1.363,"5min":1.4770000000000001,"15min":1.534},"min":{"1min":1.0600000000000001,"5min":0.755,"15min":0.755},"max":{"1min":1.7430000000000001,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":1.3200000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.413,"15min":1.4490000000000001},"min":{"1min":0.90200000000000002,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.776,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.381},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.591,"15min":1.653},"min":{"1min":1.01,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.8460000000000001,"5min":4.3570000000000002,"15min":4.3570000000000002},"last":1.575}]}]},{"osd":0,"up_from":14,"seq":60129542191,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11068,"kb_used_data":1396,"kb_used_omap":0,"kb_used_meta":9664,"kb_avail":94360772,"statfs":{"total":96636764160,"available":96625430528,"internally_reserved":0,"allocated":1429504,"data_stored":980773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9895936},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.85999999999999999,"15min":0.875},"min":{"1min":0.54500000000000004,"5min":0.439,"15min":0.439},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.1220000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.99299999999999999,"15min":1.0089999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.5569999999999999,"5min":1.7,"15min":1.7},"last":0.68600000000000005}]},{"osd":2,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":1.0109999999999999,"15min":1.0409999999999999},"min":{"1min":0.61899999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2929999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.91800000000000004,"15min":0.92200000000000004},"min":{"1min":0.59399999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.444,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.78600000000000003}]},{"osd":3,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.046,"15min":1.0700000000000001},"min":{"1min":0.68000000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.5940000000000001,"5min":1.645,"15min":1.645},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.093,"5min":1.208,"15min":1.2310000000000001},"min":{"1min":0.77100000000000002,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.403,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.1699999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.294,"15min":1.3320000000000001},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.5,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.014},{"interface":"front","average":{"1min":1.149,"5min":1.3240000000000001,"15min":1.383},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.3899999999999999,"5min":3.1629999999999998,"15min":3.1629999999999998},"last":1.3500000000000001}]},{"osd":5,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.331,"15min":1.353},"min":{"1min":0.91300000000000003,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.583,"5min":2.23,"15min":2.23},"last":1.105},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.363,"15min":1.407},"min":{"1min":0.97199999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.494,"5min":2.266,"15min":2.266},"last":1.222}]},{"osd":6,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.4530000000000001,"15min":1.5009999999999999},"min":{"1min":0.99299999999999999,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.7629999999999999,"5min":2.4060000000000001,"15min":2.4060000000000001},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.4470000000000001,"15min":1.488},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.752,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":1.419}]},{"osd":7,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.4810000000000001,"15min":1.5109999999999999},"min":{"1min":1.0800000000000001,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.869,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.391},{"interface":"front","average":{"1min":1.331,"5min":1.5029999999999999,"15min":1.556},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":1.663,"5min":2.6040000000000001,"15min":2.6040000000000001},"last":1.335}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T12:00:12.231 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-28T12:00:12.231 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T12:00:12.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.397+0000 7f91c265e700 1 Processor -- start 2023-11-28T12:00:12.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.397+0000 7f91c265e700 1 -- start start 2023-11-28T12:00:12.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.401+0000 7f91c265e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91bc0cdfb0 0x7f91bc06cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:12.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.401+0000 7f91c265e700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91bc164080 con 0x7f91bc163cb0 2023-11-28T12:00:12.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.401+0000 7f91c265e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91bc069bf0 con 0x7f91bc06d2f0 2023-11-28T12:00:12.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.401+0000 7f91c265e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc0cc290 con 0x7f91bc0cdfb0 2023-11-28T12:00:12.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.401+0000 7f91bbfff700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f91bc163cb0 0x7f91bc164cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56064/0 (socket says 172.21.15.39:56064) 2023-11-28T12:00:12.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.401+0000 7f91bbfff700 1 -- 172.21.15.39:0/879444434 learned_addr learned my addr 172.21.15.39:0/879444434 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T12:00:12.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.401+0000 7f91bb7fe700 1 --2- 172.21.15.39:0/879444434 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91bc0cdfb0 0x7f91bc06cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:12.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.401+0000 7f91baffd700 1 -- 172.21.15.39:0/879444434 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 978015763 0 0) 0x7f91bc164080 con 0x7f91bc163cb0 2023-11-28T12:00:12.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.401+0000 7f91baffd700 1 -- 172.21.15.39:0/879444434 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91a40035d0 con 0x7f91bc163cb0 2023-11-28T12:00:12.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.401+0000 7f91baffd700 1 -- 172.21.15.39:0/879444434 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3181295763 0 0) 0x7f91bc069bf0 con 0x7f91bc06d2f0 2023-11-28T12:00:12.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.401+0000 7f91bb7fe700 1 -- 172.21.15.39:0/879444434 >> v1:172.21.15.184:6789/0 conn(0x7f91bc06d2f0 legacy=0x7f91bc06a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:12.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.401+0000 7f91bb7fe700 1 -- 172.21.15.39:0/879444434 >> v1:172.21.15.39:6789/0 conn(0x7f91bc163cb0 legacy=0x7f91bc164cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:12.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.401+0000 7f91bb7fe700 1 -- 172.21.15.39:0/879444434 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91bc0cc4a0 con 0x7f91bc0cdfb0 2023-11-28T12:00:12.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.405+0000 7f91bb7fe700 1 --2- 172.21.15.39:0/879444434 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91bc0cdfb0 0x7f91bc06cdb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f91b00098b0 tx=0x7f91b0009bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9a90b68abb6d2fc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:12.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.405+0000 7f91baffd700 1 -- 172.21.15.39:0/879444434 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b0011830 con 0x7f91bc0cdfb0 2023-11-28T12:00:12.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.405+0000 7f91baffd700 1 -- 172.21.15.39:0/879444434 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b0011990 con 0x7f91bc0cdfb0 2023-11-28T12:00:12.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.405+0000 7f91baffd700 1 -- 172.21.15.39:0/879444434 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b0011d20 con 0x7f91bc0cdfb0 2023-11-28T12:00:12.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.405+0000 7f91c265e700 1 -- 172.21.15.39:0/879444434 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91bc0cdfb0 msgr2=0x7f91bc06cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:12.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.405+0000 7f91c265e700 1 --2- 172.21.15.39:0/879444434 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91bc0cdfb0 0x7f91bc06cdb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f91b00098b0 tx=0x7f91b0009bc0 comp rx=0 tx=0).stop 2023-11-28T12:00:12.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.405+0000 7f91c265e700 1 -- 172.21.15.39:0/879444434 shutdown_connections 2023-11-28T12:00:12.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.405+0000 7f91c265e700 1 --2- 172.21.15.39:0/879444434 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91bc0cdfb0 0x7f91bc06cdb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:12.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.405+0000 7f91c265e700 1 -- 172.21.15.39:0/879444434 >> 172.21.15.39:0/879444434 conn(0x7f91bc0cf350 msgr2=0x7f91bc0b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:12.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.405+0000 7f91c265e700 1 -- 172.21.15.39:0/879444434 shutdown_connections 2023-11-28T12:00:12.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.405+0000 7f91c265e700 1 -- 172.21.15.39:0/879444434 wait complete. 2023-11-28T12:00:12.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.409+0000 7f91c265e700 1 Processor -- start 2023-11-28T12:00:12.414 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.409+0000 7f91c265e700 1 -- start start 2023-11-28T12:00:12.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.409+0000 7f91c265e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91bc06d2f0 0x7f91bc15b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:12.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.409+0000 7f91c265e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91bc0cdfb0 0x7f91bc0ca270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:12.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.409+0000 7f91c265e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91bc163cb0 0x7f91bc0ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:12.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.409+0000 7f91c265e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc0c21b0 con 0x7f91bc163cb0 2023-11-28T12:00:12.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.409+0000 7f91c265e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc0c2a50 con 0x7f91bc06d2f0 2023-11-28T12:00:12.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.409+0000 7f91c265e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc0c4650 con 0x7f91bc0cdfb0 2023-11-28T12:00:12.417 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.409+0000 7f91c0bfb700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91bc163cb0 0x7f91bc0ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:12.417 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.413+0000 7f91c0bfb700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91bc163cb0 0x7f91bc0ca7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40612/0 (socket says 172.21.15.39:40612) 2023-11-28T12:00:12.418 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.413+0000 7f91c0bfb700 1 -- 172.21.15.39:0/176801143 learned_addr learned my addr 172.21.15.39:0/176801143 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:12.418 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.413+0000 7f91bb7fe700 1 --2- 172.21.15.39:0/176801143 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91bc0cdfb0 0x7f91bc0ca270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:12.418 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.413+0000 7f91bbfff700 1 --2- 172.21.15.39:0/176801143 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91bc06d2f0 0x7f91bc15b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:12.418 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.413+0000 7f91c0bfb700 1 -- 172.21.15.39:0/176801143 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91bc0cdfb0 msgr2=0x7f91bc0ca270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:12.418 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.413+0000 7f91c0bfb700 1 --2- 172.21.15.39:0/176801143 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91bc0cdfb0 0x7f91bc0ca270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:12.418 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.413+0000 7f91c0bfb700 1 -- 172.21.15.39:0/176801143 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91bc06d2f0 msgr2=0x7f91bc15b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:12.418 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.413+0000 7f91c0bfb700 1 --2- 172.21.15.39:0/176801143 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91bc06d2f0 0x7f91bc15b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:12.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.413+0000 7f91c0bfb700 1 -- 172.21.15.39:0/176801143 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b00094b0 con 0x7f91bc163cb0 2023-11-28T12:00:12.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.413+0000 7f91bb7fe700 1 --2- 172.21.15.39:0/176801143 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91bc0cdfb0 0x7f91bc0ca270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:00:12.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.413+0000 7f91c0bfb700 1 --2- 172.21.15.39:0/176801143 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91bc163cb0 0x7f91bc0ca7b0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f91b400cc10 tx=0x7f91b400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:12.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.413+0000 7f91b8ff9700 1 -- 172.21.15.39:0/176801143 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b4003e50 con 0x7f91bc163cb0 2023-11-28T12:00:12.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.413+0000 7f91b8ff9700 1 -- 172.21.15.39:0/176801143 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b400a650 con 0x7f91bc163cb0 2023-11-28T12:00:12.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.413+0000 7f91b8ff9700 1 -- 172.21.15.39:0/176801143 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b400aa00 con 0x7f91bc163cb0 2023-11-28T12:00:12.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.413+0000 7f91c265e700 1 -- 172.21.15.39:0/176801143 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91bc069e40 con 0x7f91bc163cb0 2023-11-28T12:00:12.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.413+0000 7f91c265e700 1 -- 172.21.15.39:0/176801143 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91bc0cc780 con 0x7f91bc163cb0 2023-11-28T12:00:12.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.417+0000 7f91c265e700 1 -- 172.21.15.39:0/176801143 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91bc06a120 con 0x7f91bc163cb0 2023-11-28T12:00:12.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.417+0000 7f91b8ff9700 1 -- 172.21.15.39:0/176801143 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f91b4019030 con 0x7f91bc163cb0 2023-11-28T12:00:12.422 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.417+0000 7f91b8ff9700 1 --2- 172.21.15.39:0/176801143 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f91a8064ee0 0x7f91a8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:12.423 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.417+0000 7f91b8ff9700 1 -- 172.21.15.39:0/176801143 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f91b4081550 con 0x7f91bc163cb0 2023-11-28T12:00:12.423 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.417+0000 7f91bbfff700 1 --2- 172.21.15.39:0/176801143 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f91a8064ee0 0x7f91a8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:12.425 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.421+0000 7f91bbfff700 1 --2- 172.21.15.39:0/176801143 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f91a8064ee0 0x7f91a8067390 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f91ac007fd0 tx=0x7f91ac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:12.429 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.421+0000 7f91b8ff9700 1 -- 172.21.15.39:0/176801143 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f91b404f850 con 0x7f91bc163cb0 2023-11-28T12:00:12.594 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.589+0000 7f91c265e700 1 -- 172.21.15.39:0/176801143 --> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f91bc0c2bc0 con 0x7f91a8064ee0 2023-11-28T12:00:12.601 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.597+0000 7f91b8ff9700 1 -- 172.21.15.39:0/176801143 <== mgr.4104 v2:172.21.15.184:6832/36166 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70294 (secure 0 0 0) 0x7f91bc0c2bc0 con 0x7f91a8064ee0 2023-11-28T12:00:12.602 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T12:00:12.606 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.601+0000 7f91c265e700 1 -- 172.21.15.39:0/176801143 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f91a8064ee0 msgr2=0x7f91a8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:12.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.601+0000 7f91c265e700 1 --2- 172.21.15.39:0/176801143 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f91a8064ee0 0x7f91a8067390 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f91ac007fd0 tx=0x7f91ac009040 comp rx=0 tx=0).stop 2023-11-28T12:00:12.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.601+0000 7f91c265e700 1 -- 172.21.15.39:0/176801143 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91bc163cb0 msgr2=0x7f91bc0ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:12.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.601+0000 7f91c265e700 1 --2- 172.21.15.39:0/176801143 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91bc163cb0 0x7f91bc0ca7b0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f91b400cc10 tx=0x7f91b400cf20 comp rx=0 tx=0).stop 2023-11-28T12:00:12.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.601+0000 7f91c265e700 1 -- 172.21.15.39:0/176801143 shutdown_connections 2023-11-28T12:00:12.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.601+0000 7f91c265e700 1 --2- 172.21.15.39:0/176801143 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91bc163cb0 0x7f91bc0ca7b0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:12.608 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.601+0000 7f91c265e700 1 --2- 172.21.15.39:0/176801143 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91bc0cdfb0 0x7f91bc0ca270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:12.608 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.601+0000 7f91c265e700 1 --2- 172.21.15.39:0/176801143 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f91a8064ee0 0x7f91a8067390 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:12.608 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.601+0000 7f91c265e700 1 --2- 172.21.15.39:0/176801143 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91bc06d2f0 0x7f91bc15b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:12.608 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.601+0000 7f91c265e700 1 -- 172.21.15.39:0/176801143 >> 172.21.15.39:0/176801143 conn(0x7f91bc0cf350 msgr2=0x7f91bc161fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:12.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.601+0000 7f91c265e700 1 -- 172.21.15.39:0/176801143 shutdown_connections 2023-11-28T12:00:12.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.601+0000 7f91c265e700 1 -- 172.21.15.39:0/176801143 wait complete. 2023-11-28T12:00:12.610 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2023-11-28T12:00:12.629 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2023-11-28T12:00:10.627967+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":97840,"kb_used_data":7856,"kb_used_omap":0,"kb_used_meta":89920,"kb_avail":754876880,"statfs":{"total":773094113280,"available":772993925120,"internally_reserved":0,"allocated":8044544,"data_stored":4368743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":92078080},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12282,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-6,"num_read_kb":-5,"num_write":-73,"num_write_kb":-36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001963"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.319093+0000","last_change":"2023-11-28T11:56:34.384408+0000","last_active":"2023-11-28T11:59:46.319093+0000","last_peered":"2023-11-28T11:59:46.319093+0000","last_clean":"2023-11-28T11:59:46.319093+0000","last_became_active":"2023-11-28T11:56:34.384036+0000","last_became_peered":"2023-11-28T11:56:34.384036+0000","last_unstale":"2023-11-28T11:59:46.319093+0000","last_undegraded":"2023-11-28T11:59:46.319093+0000","last_fullsized":"2023-11-28T11:59:46.319093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:58:55.003786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.939248+0000","last_change":"2023-11-28T11:56:34.384088+0000","last_active":"2023-11-28T11:59:46.939248+0000","last_peered":"2023-11-28T11:59:46.939248+0000","last_clean":"2023-11-28T11:59:46.939248+0000","last_became_active":"2023-11-28T11:56:34.383631+0000","last_became_peered":"2023-11-28T11:56:34.383631+0000","last_unstale":"2023-11-28T11:59:46.939248+0000","last_undegraded":"2023-11-28T11:59:46.939248+0000","last_fullsized":"2023-11-28T11:59:46.939248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:15:42.772333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":53,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.400542+0000","last_change":"2023-11-28T11:56:34.386399+0000","last_active":"2023-11-28T11:59:46.400542+0000","last_peered":"2023-11-28T11:59:46.400542+0000","last_clean":"2023-11-28T11:59:46.400542+0000","last_became_active":"2023-11-28T11:56:34.385994+0000","last_became_peered":"2023-11-28T11:56:34.385994+0000","last_unstale":"2023-11-28T11:59:46.400542+0000","last_undegraded":"2023-11-28T11:59:46.400542+0000","last_fullsized":"2023-11-28T11:59:46.400542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:58:02.172295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.941175+0000","last_change":"2023-11-28T11:56:34.384999+0000","last_active":"2023-11-28T11:59:46.941175+0000","last_peered":"2023-11-28T11:59:46.941175+0000","last_clean":"2023-11-28T11:59:46.941175+0000","last_became_active":"2023-11-28T11:56:34.384531+0000","last_became_peered":"2023-11-28T11:56:34.384531+0000","last_unstale":"2023-11-28T11:59:46.941175+0000","last_undegraded":"2023-11-28T11:59:46.941175+0000","last_fullsized":"2023-11-28T11:59:46.941175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:09:50.083366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":52,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.938906+0000","last_change":"2023-11-28T11:56:34.389076+0000","last_active":"2023-11-28T11:59:46.938906+0000","last_peered":"2023-11-28T11:59:46.938906+0000","last_clean":"2023-11-28T11:59:46.938906+0000","last_became_active":"2023-11-28T11:56:34.388689+0000","last_became_peered":"2023-11-28T11:56:34.388689+0000","last_unstale":"2023-11-28T11:59:46.938906+0000","last_undegraded":"2023-11-28T11:59:46.938906+0000","last_fullsized":"2023-11-28T11:59:46.938906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:20.936349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.321952+0000","last_change":"2023-11-28T11:56:34.486178+0000","last_active":"2023-11-28T11:59:45.321952+0000","last_peered":"2023-11-28T11:59:45.321952+0000","last_clean":"2023-11-28T11:59:45.321952+0000","last_became_active":"2023-11-28T11:56:34.485702+0000","last_became_peered":"2023-11-28T11:56:34.485702+0000","last_unstale":"2023-11-28T11:59:45.321952+0000","last_undegraded":"2023-11-28T11:59:45.321952+0000","last_fullsized":"2023-11-28T11:59:45.321952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:06.323407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":53,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.399325+0000","last_change":"2023-11-28T11:56:34.387293+0000","last_active":"2023-11-28T11:59:46.399325+0000","last_peered":"2023-11-28T11:59:46.399325+0000","last_clean":"2023-11-28T11:59:46.399325+0000","last_became_active":"2023-11-28T11:56:34.386976+0000","last_became_peered":"2023-11-28T11:56:34.386976+0000","last_unstale":"2023-11-28T11:59:46.399325+0000","last_undegraded":"2023-11-28T11:59:46.399325+0000","last_fullsized":"2023-11-28T11:59:46.399325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:32.704729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":52,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.938247+0000","last_change":"2023-11-28T11:56:34.389222+0000","last_active":"2023-11-28T11:59:46.938247+0000","last_peered":"2023-11-28T11:59:46.938247+0000","last_clean":"2023-11-28T11:59:46.938247+0000","last_became_active":"2023-11-28T11:56:34.388671+0000","last_became_peered":"2023-11-28T11:56:34.388671+0000","last_unstale":"2023-11-28T11:59:46.938247+0000","last_undegraded":"2023-11-28T11:59:46.938247+0000","last_fullsized":"2023-11-28T11:59:46.938247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:32.704729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":206,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:46.399602+0000","last_change":"2023-11-28T11:56:28.472008+0000","last_active":"2023-11-28T11:59:46.399602+0000","last_peered":"2023-11-28T11:59:46.399602+0000","last_clean":"2023-11-28T11:59:46.399602+0000","last_became_active":"2023-11-28T11:56:28.469273+0000","last_became_peered":"2023-11-28T11:56:28.469273+0000","last_unstale":"2023-11-28T11:59:46.399602+0000","last_undegraded":"2023-11-28T11:59:46.399602+0000","last_fullsized":"2023-11-28T11:59:46.399602+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:27.291192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:27.291192+0000","last_clean_scrub_stamp":"2023-11-28T11:56:27.291192+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:14:48.860420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509487,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15124,"kb_used_data":1420,"kb_used_omap":0,"kb_used_meta":13696,"kb_avail":94356716,"statfs":{"total":96636764160,"available":96621277184,"internally_reserved":0,"allocated":1454080,"data_stored":989046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14024704},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.0880000000000001,"15min":1.0960000000000001},"min":{"1min":0.77000000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4379999999999999,"5min":1.468,"15min":1.468},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.083,"15min":1.079},"min":{"1min":0.81699999999999995,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.615,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.2330000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.1950000000000001,"15min":1.204},"min":{"1min":0.83999999999999997,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.542,"5min":1.71,"15min":1.71},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.143,"5min":1.1659999999999999,"15min":1.177},"min":{"1min":0.79500000000000004,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.502,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.86799999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.165,"15min":1.181},"min":{"1min":0.73099999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.579,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.2629999999999999,"15min":1.2789999999999999},"min":{"1min":0.82399999999999995,"5min":0.749,"15min":0.749},"max":{"1min":1.5209999999999999,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.175}]},{"osd":3,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2869999999999999,"15min":1.3109999999999999},"min":{"1min":0.872,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.4610000000000001,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.611},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.337,"15min":1.355},"min":{"1min":1.006,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.5629999999999999,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.476}]},{"osd":4,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.244,"15min":1.294},"min":{"1min":0.90000000000000002,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.278,"15min":1.3300000000000001},"min":{"1min":0.92700000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.5129999999999999,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.107}]},{"osd":5,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.377,"15min":1.429},"min":{"1min":0.91900000000000004,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.5549999999999999,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.552},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.353,"15min":1.391},"min":{"1min":1.145,"5min":0.872,"15min":0.872},"max":{"1min":1.603,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":1.524}]},{"osd":6,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.494,"15min":1.548},"min":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"max":{"1min":1.706,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.589},{"interface":"front","average":{"1min":1.319,"5min":1.401,"15min":1.4470000000000001},"min":{"1min":1.0760000000000001,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.5920000000000001,"5min":2.468,"15min":2.468},"last":1.7909999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509487,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9872,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":9024,"kb_avail":94361968,"statfs":{"total":96636764160,"available":96626655232,"internally_reserved":0,"allocated":860160,"data_stored":398170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9240576},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.004,"15min":0.99399999999999999},"min":{"1min":0.59899999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.5149999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.044,"5min":1.1539999999999999,"15min":1.1899999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.5049999999999999,"5min":2.347,"15min":2.347},"last":1.0389999999999999}]},{"osd":1,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1699999999999999,"15min":1.1739999999999999},"min":{"1min":0.79900000000000004,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.137,"5min":1.157,"15min":1.171},"min":{"1min":0.72699999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.454,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":1.2170000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.198,"15min":1.242},"min":{"1min":0.754,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4410000000000001,"5min":3.9620000000000002,"15min":3.9620000000000002},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1639999999999999,"15min":1.1679999999999999},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.302}]},{"osd":3,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.258,"15min":1.26},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.496,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.518},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.258,"15min":1.268},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.5209999999999999,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.3320000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.2050000000000001,"15min":1.232},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.4179999999999999,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.877},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.4159999999999999,"15min":1.4670000000000001},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.8540000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.1779999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.2250000000000001,"15min":1.266},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.175,"5min":1.244,"15min":1.27},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.98499999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.3200000000000001,"15min":1.3360000000000001},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.343,"15min":1.355},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.978,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.4570000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509487,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9740,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362100,"statfs":{"total":96636764160,"available":96626790400,"internally_reserved":0,"allocated":856064,"data_stored":398168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.0840000000000001,"15min":1.089},"min":{"1min":0.73899999999999999,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.3500000000000001,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.0900000000000001,"15min":1.0820000000000001},"min":{"1min":0.90400000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.359,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.161}]},{"osd":1,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1479999999999999,"15min":1.1519999999999999},"min":{"1min":0.77500000000000002,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.48,"5min":1.843,"15min":1.843},"last":1.206},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.0920000000000001,"15min":1.0900000000000001},"min":{"1min":0.77300000000000002,"5min":0.752,"15min":0.752},"max":{"1min":1.4870000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.97399999999999998}]},{"osd":2,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.171,"15min":1.167},"min":{"1min":0.77600000000000002,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":1.262},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.1930000000000001,"15min":1.198},"min":{"1min":0.86899999999999999,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.4990000000000001,"5min":1.79,"15min":1.79},"last":1.4139999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.252,"15min":1.2729999999999999},"min":{"1min":0.84099999999999997,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.5649999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.03},{"interface":"front","average":{"1min":1.353,"5min":1.365,"15min":1.3919999999999999},"min":{"1min":1.0069999999999999,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.712,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.4890000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.1739999999999999,"15min":1.2090000000000001},"min":{"1min":0.77900000000000003,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.431,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.228,"15min":1.234},"min":{"1min":0.876,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.4770000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.5109999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.2689999999999999,"15min":1.276},"min":{"1min":0.91800000000000004,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.6259999999999999,"5min":1.732,"15min":1.732},"last":1.583},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.2829999999999999,"15min":1.2849999999999999},"min":{"1min":0.99399999999999999,"5min":0.874,"15min":0.874},"max":{"1min":1.4550000000000001,"5min":1.704,"15min":1.704},"last":1.3049999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3520000000000001,"15min":1.3620000000000001},"min":{"1min":0.97499999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.6859999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.7410000000000001},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.446,"15min":1.472},"min":{"1min":1.05,"5min":1.002,"15min":1.002},"max":{"1min":1.762,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.6519999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509487,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14156,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":13312,"kb_avail":94357684,"statfs":{"total":96636764160,"available":96622268416,"internally_reserved":0,"allocated":856064,"data_stored":398148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13631488},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.109,"15min":1.1100000000000001},"min":{"1min":0.76100000000000001,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5429999999999999,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.1279999999999999,"15min":1.1519999999999999},"min":{"1min":0.71699999999999997,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.554,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.70099999999999996}]},{"osd":1,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.173,"15min":1.2090000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.496,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.1819999999999999,"15min":1.202},"min":{"1min":0.70999999999999996,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.7190000000000001,"5min":2.8860000000000001,"15min":2.8860000000000001},"last":1.052}]},{"osd":2,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.208,"15min":1.238},"min":{"1min":0.81999999999999995,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.589,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.377},{"interface":"front","average":{"1min":1.236,"5min":1.3520000000000001,"15min":1.403},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.5389999999999999,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":0.877}]},{"osd":3,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.282,"15min":1.3160000000000001},"min":{"1min":0.89700000000000002,"5min":0.746,"15min":0.746},"max":{"1min":1.4790000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3560000000000001,"15min":1.3740000000000001},"min":{"1min":1.004,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.877,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.5489999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.3640000000000001,"15min":1.431},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.0139999999999998,"5min":2.972,"15min":2.972},"last":1.5149999999999999},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.296,"15min":1.353},"min":{"1min":0.78600000000000003,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.2389999999999999,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.121}]},{"osd":6,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3580000000000001,"15min":1.4059999999999999},"min":{"1min":0.96699999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.919,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.431},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.49,"15min":1.542},"min":{"1min":1.0189999999999999,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":2.0790000000000002,"5min":3.133,"15min":3.133},"last":1.405}]},{"osd":7,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.4570000000000001,"15min":1.5169999999999999},"min":{"1min":0.95199999999999996,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.992,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.337},{"interface":"front","average":{"1min":1.474,"5min":1.5369999999999999,"15min":1.5880000000000001},"min":{"1min":1.145,"5min":1.0760000000000001,"15min":1.0760000000000001},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.607}]}]},{"osd":3,"up_from":15,"seq":64424509487,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14084,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":13248,"kb_avail":94357756,"statfs":{"total":96636764160,"available":96622342144,"internally_reserved":0,"allocated":847872,"data_stored":391436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13565952},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.82999999999999996,"15min":0.84199999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.292,"5min":1.478,"15min":1.478},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.91900000000000004,"15min":0.91800000000000004},"min":{"1min":0.64200000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.276,"5min":2.177,"15min":2.177},"last":0.96099999999999997}]},{"osd":1,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.86699999999999999,"15min":0.86599999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.468,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":1.006,"5min":1.044,"15min":1.0600000000000001},"min":{"1min":0.59099999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4179999999999999,"5min":1.968,"15min":1.968},"last":0.82499999999999996}]},{"osd":2,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.109,"15min":1.139},"min":{"1min":0.63700000000000001,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.548,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.093},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.171,"15min":1.2070000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.5389999999999999,"5min":2.093,"15min":2.093},"last":1.1439999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.1719999999999999,"15min":1.1779999999999999},"min":{"1min":0.84199999999999997,"5min":0.75,"15min":0.75},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.294,"15min":1.3320000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.837,"5min":2.8439999999999999,"15min":2.8439999999999999},"last":1.3149999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.325,"15min":1.359},"min":{"1min":0.85699999999999998,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.6040000000000001,"5min":2.9670000000000001,"15min":2.9670000000000001},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3999999999999999,"15min":1.444},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.655,"5min":3.7429999999999999,"15min":3.7429999999999999},"last":1.258}]},{"osd":6,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3360000000000001,"15min":1.3520000000000001},"min":{"1min":0.91700000000000004,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.077,"5min":2.323,"15min":2.323},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.407,"15min":1.444},"min":{"1min":0.93899999999999995,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.7210000000000001,"5min":2.927,"15min":2.927},"last":1.508}]},{"osd":7,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.4570000000000001,"15min":1.498},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.794,"5min":3.5030000000000001,"15min":3.5030000000000001},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.369,"5min":1.4430000000000001,"15min":1.4750000000000001},"min":{"1min":1.0720000000000001,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.1549999999999998,"5min":2.6320000000000001,"15min":2.6320000000000001},"last":1.3620000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509487,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13988,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":13120,"kb_avail":94357852,"statfs":{"total":96636764160,"available":96622440448,"internally_reserved":0,"allocated":880640,"data_stored":410178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13434880},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.89300000000000002,"15min":0.93400000000000005},"min":{"1min":0.495,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.3919999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.018,"15min":1.0089999999999999},"min":{"1min":0.67700000000000005,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.5429999999999999,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":1.649}]},{"osd":2,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.069,"15min":1.083},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.6160000000000001,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0860000000000001,"15min":1.1000000000000001},"min":{"1min":0.72599999999999998,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.7769999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.0620000000000001}]},{"osd":3,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.1859999999999999,"15min":1.2030000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.635,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.103,"5min":1.1339999999999999,"15min":1.171},"min":{"1min":0.65600000000000003,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.4670000000000001,"5min":1.8,"15min":1.8},"last":1.103}]},{"osd":4,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.353,"15min":1.3720000000000001},"min":{"1min":1.002,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.6890000000000001,"5min":3.411,"15min":3.411},"last":1.282},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.3009999999999999,"15min":1.339},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.7969999999999999,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":1.3819999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.3799999999999999,"15min":1.423},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.9039999999999999,"5min":3.6869999999999998,"15min":3.6869999999999998},"last":1.528},{"interface":"front","average":{"1min":1.284,"5min":1.306,"15min":1.3260000000000001},"min":{"1min":0.97699999999999998,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.736,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.1870000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.4239999999999999,"15min":1.4550000000000001},"min":{"1min":0.99399999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.8899999999999999,"5min":3.5379999999999998,"15min":3.5379999999999998},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.4470000000000001,"15min":1.49},"min":{"1min":0.84099999999999997,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.0259999999999998,"5min":2.5739999999999998,"15min":2.5739999999999998},"last":1.7210000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.4510000000000001,"15min":1.4770000000000001},"min":{"1min":1.1040000000000001,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.9490000000000001,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.5640000000000001},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.492,"15min":1.52},"min":{"1min":1.1870000000000001,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.986,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.7490000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542191,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9808,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94362032,"statfs":{"total":96636764160,"available":96626720768,"internally_reserved":0,"allocated":860160,"data_stored":402824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:27 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85499999999999998,"15min":0.86699999999999999},"min":{"1min":0.59999999999999998,"5min":0.497,"15min":0.497},"max":{"1min":1.28,"5min":1.722,"15min":1.722},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.98199999999999998,"15min":1.002},"min":{"1min":0.55800000000000005,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.389,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":0.81100000000000005}]},{"osd":1,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.01,"15min":1.028},"min":{"1min":0.58699999999999997,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.276,"5min":1.754,"15min":1.754},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.92800000000000005,"15min":0.93999999999999995},"min":{"1min":0.627,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2729999999999999,"5min":1.484,"15min":1.484},"last":0.83899999999999997}]},{"osd":3,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.105,"15min":1.127},"min":{"1min":0.74299999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.5109999999999999,"5min":2.048,"15min":2.048},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.214,"5min":1.2629999999999999,"15min":1.2869999999999999},"min":{"1min":0.81399999999999995,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.6699999999999999,"5min":2.617,"15min":2.617},"last":1.0820000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3460000000000001,"15min":1.3799999999999999},"min":{"1min":1.0580000000000001,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.6619999999999999,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2370000000000001,"15min":1.2509999999999999},"min":{"1min":0.86199999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.6830000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":1.476}]},{"osd":5,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.3129999999999999,"15min":1.343},"min":{"1min":0.93999999999999995,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.6759999999999999,"5min":2.738,"15min":2.738},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.288,"5min":1.4570000000000001,"15min":1.5349999999999999},"min":{"1min":0.92100000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.7350000000000001,"5min":4.0309999999999997,"15min":4.0309999999999997},"last":1.4410000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.5289999999999999,"15min":1.593},"min":{"1min":1.0529999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.8,"5min":4.2240000000000002,"15min":4.2240000000000002},"last":1.518},{"interface":"front","average":{"1min":1.363,"5min":1.4770000000000001,"15min":1.534},"min":{"1min":1.0600000000000001,"5min":0.755,"15min":0.755},"max":{"1min":1.7430000000000001,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":1.3200000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.413,"15min":1.4490000000000001},"min":{"1min":0.90200000000000002,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.776,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.381},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.591,"15min":1.653},"min":{"1min":1.01,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.8460000000000001,"5min":4.3570000000000002,"15min":4.3570000000000002},"last":1.575}]}]},{"osd":0,"up_from":14,"seq":60129542191,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11068,"kb_used_data":1396,"kb_used_omap":0,"kb_used_meta":9664,"kb_avail":94360772,"statfs":{"total":96636764160,"available":96625430528,"internally_reserved":0,"allocated":1429504,"data_stored":980773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9895936},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.85999999999999999,"15min":0.875},"min":{"1min":0.54500000000000004,"5min":0.439,"15min":0.439},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.1220000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.99299999999999999,"15min":1.0089999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.5569999999999999,"5min":1.7,"15min":1.7},"last":0.68600000000000005}]},{"osd":2,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":1.0109999999999999,"15min":1.0409999999999999},"min":{"1min":0.61899999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2929999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.91800000000000004,"15min":0.92200000000000004},"min":{"1min":0.59399999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.444,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.78600000000000003}]},{"osd":3,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.046,"15min":1.0700000000000001},"min":{"1min":0.68000000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.5940000000000001,"5min":1.645,"15min":1.645},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.093,"5min":1.208,"15min":1.2310000000000001},"min":{"1min":0.77100000000000002,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.403,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.1699999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.294,"15min":1.3320000000000001},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.5,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.014},{"interface":"front","average":{"1min":1.149,"5min":1.3240000000000001,"15min":1.383},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.3899999999999999,"5min":3.1629999999999998,"15min":3.1629999999999998},"last":1.3500000000000001}]},{"osd":5,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.331,"15min":1.353},"min":{"1min":0.91300000000000003,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.583,"5min":2.23,"15min":2.23},"last":1.105},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.363,"15min":1.407},"min":{"1min":0.97199999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.494,"5min":2.266,"15min":2.266},"last":1.222}]},{"osd":6,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.4530000000000001,"15min":1.5009999999999999},"min":{"1min":0.99299999999999999,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.7629999999999999,"5min":2.4060000000000001,"15min":2.4060000000000001},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.4470000000000001,"15min":1.488},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.752,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":1.419}]},{"osd":7,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.4810000000000001,"15min":1.5109999999999999},"min":{"1min":1.0800000000000001,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.869,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.391},{"interface":"front","average":{"1min":1.331,"5min":1.5029999999999999,"15min":1.556},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":1.663,"5min":2.6040000000000001,"15min":2.6040000000000001},"last":1.335}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T12:00:12.633 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:00:12.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.809+0000 7f28434fc700 1 Processor -- start 2023-11-28T12:00:12.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.809+0000 7f28434fc700 1 -- start start 2023-11-28T12:00:12.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.809+0000 7f28434fc700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f283c0b43a0 0x7f283c15e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:12.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.813+0000 7f28434fc700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f283c15a550 con 0x7f283c0b1640 2023-11-28T12:00:12.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.813+0000 7f28434fc700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f283c06b0a0 con 0x7f283c070790 2023-11-28T12:00:12.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.813+0000 7f28434fc700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f283c0caac0 con 0x7f283c0b43a0 2023-11-28T12:00:12.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.813+0000 7f2841cf9700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f283c0b1640 0x7f283c070080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56072/0 (socket says 172.21.15.39:56072) 2023-11-28T12:00:12.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.813+0000 7f2841cf9700 1 -- 172.21.15.39:0/1422613996 learned_addr learned my addr 172.21.15.39:0/1422613996 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T12:00:12.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.813+0000 7f28424fa700 1 --2- 172.21.15.39:0/1422613996 >> v2:172.21.15.184:3300/0 conn(0x7f283c0b43a0 0x7f283c15e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:12.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.813+0000 7f28424fa700 1 -- 172.21.15.39:0/1422613996 >> v1:172.21.15.184:6789/0 conn(0x7f283c070790 legacy=0x7f283c06bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:12.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.813+0000 7f28424fa700 1 -- 172.21.15.39:0/1422613996 >> v1:172.21.15.39:6789/0 conn(0x7f283c0b1640 legacy=0x7f283c070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:12.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.813+0000 7f28424fa700 1 -- 172.21.15.39:0/1422613996 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f283c0cada0 con 0x7f283c0b43a0 2023-11-28T12:00:12.819 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.813+0000 7f28424fa700 1 --2- 172.21.15.39:0/1422613996 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f283c0b43a0 0x7f283c15e5d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2838009850 tx=0x7f2838009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8c1e5bae09e87e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:12.819 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.813+0000 7f28414f8700 1 -- 172.21.15.39:0/1422613996 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2838011830 con 0x7f283c0b43a0 2023-11-28T12:00:12.819 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.813+0000 7f28414f8700 1 -- 172.21.15.39:0/1422613996 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2838011990 con 0x7f283c0b43a0 2023-11-28T12:00:12.819 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.813+0000 7f28414f8700 1 -- 172.21.15.39:0/1422613996 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2838011d20 con 0x7f283c0b43a0 2023-11-28T12:00:12.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.813+0000 7f28434fc700 1 -- 172.21.15.39:0/1422613996 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f283c0b43a0 msgr2=0x7f283c15e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:12.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.813+0000 7f28434fc700 1 --2- 172.21.15.39:0/1422613996 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f283c0b43a0 0x7f283c15e5d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2838009850 tx=0x7f2838009b60 comp rx=0 tx=0).stop 2023-11-28T12:00:12.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.817+0000 7f28434fc700 1 -- 172.21.15.39:0/1422613996 shutdown_connections 2023-11-28T12:00:12.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.817+0000 7f28434fc700 1 --2- 172.21.15.39:0/1422613996 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f283c0b43a0 0x7f283c15e5d0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:12.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.817+0000 7f28434fc700 1 -- 172.21.15.39:0/1422613996 >> 172.21.15.39:0/1422613996 conn(0x7f283c0b0f80 msgr2=0x7f283c0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:12.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.817+0000 7f28434fc700 1 -- 172.21.15.39:0/1422613996 shutdown_connections 2023-11-28T12:00:12.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.817+0000 7f28434fc700 1 -- 172.21.15.39:0/1422613996 wait complete. 2023-11-28T12:00:12.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.817+0000 7f28434fc700 1 Processor -- start 2023-11-28T12:00:12.824 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.817+0000 7f28434fc700 1 -- start start 2023-11-28T12:00:12.825 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.821+0000 7f28434fc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f283c070790 0x7f283c0c4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:12.825 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.821+0000 7f28434fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f283c0b1640 0x7f283c0aed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:12.825 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.821+0000 7f28434fc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f283c0b43a0 0x7f283c155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:12.825 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.821+0000 7f28434fc700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283c0c55a0 con 0x7f283c0b1640 2023-11-28T12:00:12.825 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.821+0000 7f28434fc700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283c1579f0 con 0x7f283c070790 2023-11-28T12:00:12.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.821+0000 7f28434fc700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f283c1f5b30 con 0x7f283c0b43a0 2023-11-28T12:00:12.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.821+0000 7f2841cf9700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f283c0b1640 0x7f283c0aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:12.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.821+0000 7f2841cf9700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f283c0b1640 0x7f283c0aed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40626/0 (socket says 172.21.15.39:40626) 2023-11-28T12:00:12.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.821+0000 7f2841cf9700 1 -- 172.21.15.39:0/2685837386 learned_addr learned my addr 172.21.15.39:0/2685837386 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:12.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.821+0000 7f28424fa700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f283c070790 0x7f283c0c4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:12.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.821+0000 7f2842cfb700 1 --2- 172.21.15.39:0/2685837386 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f283c0b43a0 0x7f283c155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:12.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.821+0000 7f2841cf9700 1 -- 172.21.15.39:0/2685837386 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f283c0b43a0 msgr2=0x7f283c155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:12.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.821+0000 7f2841cf9700 1 --2- 172.21.15.39:0/2685837386 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f283c0b43a0 0x7f283c155bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:12.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.821+0000 7f2841cf9700 1 -- 172.21.15.39:0/2685837386 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f283c070790 msgr2=0x7f283c0c4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:12.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.821+0000 7f2841cf9700 1 --2- 172.21.15.39:0/2685837386 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f283c070790 0x7f283c0c4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:12.829 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.821+0000 7f2841cf9700 1 -- 172.21.15.39:0/2685837386 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28380094b0 con 0x7f283c0b1640 2023-11-28T12:00:12.829 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.821+0000 7f2841cf9700 1 --2- 172.21.15.39:0/2685837386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f283c0b1640 0x7f283c0aed50 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f282c00c700 tx=0x7f282c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:12.829 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.821+0000 7f2832ffd700 1 -- 172.21.15.39:0/2685837386 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c005d90 con 0x7f283c0b1640 2023-11-28T12:00:12.829 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.821+0000 7f2832ffd700 1 -- 172.21.15.39:0/2685837386 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f282c0070d0 con 0x7f283c0b1640 2023-11-28T12:00:12.829 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.821+0000 7f2832ffd700 1 -- 172.21.15.39:0/2685837386 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c007440 con 0x7f283c0b1640 2023-11-28T12:00:12.829 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.821+0000 7f28434fc700 1 -- 172.21.15.39:0/2685837386 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f283c06b5d0 con 0x7f283c0b1640 2023-11-28T12:00:12.830 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.821+0000 7f28434fc700 1 -- 172.21.15.39:0/2685837386 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f283c06b2f0 con 0x7f283c0b1640 2023-11-28T12:00:12.830 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.825+0000 7f28434fc700 1 -- 172.21.15.39:0/2685837386 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f283c15eb10 con 0x7f283c0b1640 2023-11-28T12:00:12.831 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.825+0000 7f2832ffd700 1 -- 172.21.15.39:0/2685837386 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f282c019030 con 0x7f283c0b1640 2023-11-28T12:00:12.832 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.825+0000 7f2832ffd700 1 --2- 172.21.15.39:0/2685837386 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2820064f10 0x7f28200673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:12.832 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.829+0000 7f2832ffd700 1 -- 172.21.15.39:0/2685837386 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f282c080be0 con 0x7f283c0b1640 2023-11-28T12:00:12.833 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.829+0000 7f28424fa700 1 --2- 172.21.15.39:0/2685837386 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2820064f10 0x7f28200673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:12.834 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.829+0000 7f28424fa700 1 --2- 172.21.15.39:0/2685837386 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2820064f10 0x7f28200673c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2838014040 tx=0x7f283801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:12.838 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:12.833+0000 7f2832ffd700 1 -- 172.21.15.39:0/2685837386 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f282c04a400 con 0x7f283c0b1640 2023-11-28T12:00:13.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:13.005+0000 7f28434fc700 1 -- 172.21.15.39:0/2685837386 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f283c157b30 con 0x7f283c0b1640 2023-11-28T12:00:13.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:13.009+0000 7f2832ffd700 1 -- 172.21.15.39:0/2685837386 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+14504 (secure 0 0 0) 0x7f283c157b30 con 0x7f283c0b1640 2023-11-28T12:00:13.013 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T12:00:13.014 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":73,"fsid":"67ce95b1-cd7e-4478-b863-c714ef275520","created":"2023-11-28T11:56:13.869187+0000","modified":"2023-11-28T12:00:08.997667+0000","last_up_change":"2023-11-28T11:56:26.284992+0000","last_in_change":"2023-11-28T11:56:16.925470+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T11:56:26.631457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-28T11:56:33.242202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ab7b9010-d38f-4f91-ab43-344fd159f42c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":36179},{"type":"v1","addr":"172.21.15.39:6801","nonce":36179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":36179},{"type":"v1","addr":"172.21.15.39:6803","nonce":36179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":36179},{"type":"v1","addr":"172.21.15.39:6807","nonce":36179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":36179},{"type":"v1","addr":"172.21.15.39:6805","nonce":36179}]},"public_addr":"172.21.15.39:6801/36179","cluster_addr":"172.21.15.39:6803/36179","heartbeat_back_addr":"172.21.15.39:6807/36179","heartbeat_front_addr":"172.21.15.39:6805/36179","state":["exists","up"]},{"osd":1,"uuid":"0d5b9166-b139-4326-a47b-a482226648f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6823","nonce":36182},{"type":"v1","addr":"172.21.15.39:6825","nonce":36182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":36182},{"type":"v1","addr":"172.21.15.39:6827","nonce":36182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":36182},{"type":"v1","addr":"172.21.15.39:6831","nonce":36182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":36182},{"type":"v1","addr":"172.21.15.39:6829","nonce":36182}]},"public_addr":"172.21.15.39:6825/36182","cluster_addr":"172.21.15.39:6827/36182","heartbeat_back_addr":"172.21.15.39:6831/36182","heartbeat_front_addr":"172.21.15.39:6829/36182","state":["exists","up"]},{"osd":2,"uuid":"1492ac7a-e277-401c-877e-632f589a2d19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":36183},{"type":"v1","addr":"172.21.15.39:6810","nonce":36183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":36183},{"type":"v1","addr":"172.21.15.39:6813","nonce":36183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":36183},{"type":"v1","addr":"172.21.15.39:6819","nonce":36183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6815","nonce":36183},{"type":"v1","addr":"172.21.15.39:6816","nonce":36183}]},"public_addr":"172.21.15.39:6810/36183","cluster_addr":"172.21.15.39:6813/36183","heartbeat_back_addr":"172.21.15.39:6819/36183","heartbeat_front_addr":"172.21.15.39:6816/36183","state":["exists","up"]},{"osd":3,"uuid":"4f2be9a8-314a-4e1b-bf5e-600081a01c21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6809","nonce":36181},{"type":"v1","addr":"172.21.15.39:6811","nonce":36181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":36181},{"type":"v1","addr":"172.21.15.39:6817","nonce":36181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":36181},{"type":"v1","addr":"172.21.15.39:6824","nonce":36181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":36181},{"type":"v1","addr":"172.21.15.39:6821","nonce":36181}]},"public_addr":"172.21.15.39:6811/36181","cluster_addr":"172.21.15.39:6817/36181","heartbeat_back_addr":"172.21.15.39:6824/36181","heartbeat_front_addr":"172.21.15.39:6821/36181","state":["exists","up"]},{"osd":4,"uuid":"22505471-2a47-4f4e-a1ab-e765cc32fb45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":36504},{"type":"v1","addr":"172.21.15.184:6801","nonce":36504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":36504},{"type":"v1","addr":"172.21.15.184:6803","nonce":36504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":36504},{"type":"v1","addr":"172.21.15.184:6807","nonce":36504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":36504},{"type":"v1","addr":"172.21.15.184:6805","nonce":36504}]},"public_addr":"172.21.15.184:6801/36504","cluster_addr":"172.21.15.184:6803/36504","heartbeat_back_addr":"172.21.15.184:6807/36504","heartbeat_front_addr":"172.21.15.184:6805/36504","state":["exists","up"]},{"osd":5,"uuid":"ea08d2ab-2eca-4dc9-88e8-c965d07f6d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":36505},{"type":"v1","addr":"172.21.15.184:6810","nonce":36505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":36505},{"type":"v1","addr":"172.21.15.184:6813","nonce":36505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":36505},{"type":"v1","addr":"172.21.15.184:6820","nonce":36505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6815","nonce":36505},{"type":"v1","addr":"172.21.15.184:6816","nonce":36505}]},"public_addr":"172.21.15.184:6810/36505","cluster_addr":"172.21.15.184:6813/36505","heartbeat_back_addr":"172.21.15.184:6820/36505","heartbeat_front_addr":"172.21.15.184:6816/36505","state":["exists","up"]},{"osd":6,"uuid":"52838753-04a9-417b-95df-6fbe87b817c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":36507},{"type":"v1","addr":"172.21.15.184:6824","nonce":36507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":36507},{"type":"v1","addr":"172.21.15.184:6827","nonce":36507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":36507},{"type":"v1","addr":"172.21.15.184:6831","nonce":36507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":36507},{"type":"v1","addr":"172.21.15.184:6829","nonce":36507}]},"public_addr":"172.21.15.184:6824/36507","cluster_addr":"172.21.15.184:6827/36507","heartbeat_back_addr":"172.21.15.184:6831/36507","heartbeat_front_addr":"172.21.15.184:6829/36507","state":["exists","up"]},{"osd":7,"uuid":"7dd4385b-724d-40dd-84cd-31bab39d1bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":36506},{"type":"v1","addr":"172.21.15.184:6811","nonce":36506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":36506},{"type":"v1","addr":"172.21.15.184:6817","nonce":36506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6823","nonce":36506},{"type":"v1","addr":"172.21.15.184:6825","nonce":36506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6819","nonce":36506},{"type":"v1","addr":"172.21.15.184:6822","nonce":36506}]},"public_addr":"172.21.15.184:6811/36506","cluster_addr":"172.21.15.184:6817/36506","heartbeat_back_addr":"172.21.15.184:6825/36506","heartbeat_front_addr":"172.21.15.184:6822/36506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.465682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.746843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.527762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.642652+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.773911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.821065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.853636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:56:22.633861+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:6835/990492858":"2023-11-29T12:00:05.488583+0000","172.21.15.39:6832/990492858":"2023-11-29T12:00:05.488583+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:00:13.018 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:13.013+0000 7f28434fc700 1 -- 172.21.15.39:0/2685837386 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2820064f10 msgr2=0x7f28200673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:13.018 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:13.013+0000 7f28434fc700 1 --2- 172.21.15.39:0/2685837386 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2820064f10 0x7f28200673c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2838014040 tx=0x7f283801c040 comp rx=0 tx=0).stop 2023-11-28T12:00:13.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:13.013+0000 7f28434fc700 1 -- 172.21.15.39:0/2685837386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f283c0b1640 msgr2=0x7f283c0aed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:13.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:13.013+0000 7f28434fc700 1 --2- 172.21.15.39:0/2685837386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f283c0b1640 0x7f283c0aed50 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f282c00c700 tx=0x7f282c00ca10 comp rx=0 tx=0).stop 2023-11-28T12:00:13.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:13.013+0000 7f28434fc700 1 -- 172.21.15.39:0/2685837386 shutdown_connections 2023-11-28T12:00:13.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:13.013+0000 7f28434fc700 1 --2- 172.21.15.39:0/2685837386 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f283c0b43a0 0x7f283c155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:13.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:13.013+0000 7f28434fc700 1 --2- 172.21.15.39:0/2685837386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f283c0b1640 0x7f283c0aed50 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:13.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:13.013+0000 7f28434fc700 1 --2- 172.21.15.39:0/2685837386 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2820064f10 0x7f28200673c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:13.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:13.013+0000 7f28434fc700 1 --2- 172.21.15.39:0/2685837386 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f283c070790 0x7f283c0c4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:13.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:13.013+0000 7f28434fc700 1 -- 172.21.15.39:0/2685837386 >> 172.21.15.39:0/2685837386 conn(0x7f283c0b0f80 msgr2=0x7f283c06bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:13.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:13.013+0000 7f28434fc700 1 -- 172.21.15.39:0/2685837386 shutdown_connections 2023-11-28T12:00:13.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:13.013+0000 7f28434fc700 1 -- 172.21.15.39:0/2685837386 wait complete. 2023-11-28T12:00:14.041 INFO:tasks.ceph:Scrubbing osd.0 2023-11-28T12:00:14.042 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-28T12:00:14.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.221+0000 7f7a31913700 1 Processor -- start 2023-11-28T12:00:14.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.221+0000 7f7a31913700 1 -- start start 2023-11-28T12:00:14.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.225+0000 7f7a31913700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7a2c0b2240 0x7f7a2c160780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:14.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.225+0000 7f7a31913700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7a2c06f200 0x7f7a2c0b2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:14.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.225+0000 7f7a31913700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7a2c06fc00 0x7f7a2c070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:14.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.225+0000 7f7a31913700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a2c0cfe80 con 0x7f7a2c0b2240 2023-11-28T12:00:14.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.225+0000 7f7a31913700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a2c0ce390 con 0x7f7a2c06fc00 2023-11-28T12:00:14.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.225+0000 7f7a31913700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c160cc0 con 0x7f7a2c06f200 2023-11-28T12:00:14.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.225+0000 7f7a2affd700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7a2c0b2240 0x7f7a2c160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:14.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.225+0000 7f7a2affd700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7a2c0b2240 0x7f7a2c160780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40642/0 (socket says 172.21.15.39:40642) 2023-11-28T12:00:14.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.225+0000 7f7a2affd700 1 -- 172.21.15.39:0/3505364148 learned_addr learned my addr 172.21.15.39:0/3505364148 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:14.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.225+0000 7f7a2a7fc700 1 --2- 172.21.15.39:0/3505364148 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7a2c06f200 0x7f7a2c0b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:14.234 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.225+0000 7f7a2b7fe700 1 --2- 172.21.15.39:0/3505364148 >> v2:172.21.15.184:3300/0 conn(0x7f7a2c06fc00 0x7f7a2c070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:14.234 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.225+0000 7f7a2affd700 1 -- 172.21.15.39:0/3505364148 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7a2c06f200 msgr2=0x7f7a2c0b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:14.234 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.225+0000 7f7a2affd700 1 --2- 172.21.15.39:0/3505364148 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7a2c06f200 0x7f7a2c0b2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:14.234 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.229+0000 7f7a2affd700 1 -- 172.21.15.39:0/3505364148 >> v2:172.21.15.184:3300/0 conn(0x7f7a2c06fc00 msgr2=0x7f7a2c070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:14.234 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.229+0000 7f7a2affd700 1 --2- 172.21.15.39:0/3505364148 >> v2:172.21.15.184:3300/0 conn(0x7f7a2c06fc00 0x7f7a2c070080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:14.234 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.229+0000 7f7a2affd700 1 -- 172.21.15.39:0/3505364148 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a2c0b2b50 con 0x7f7a2c0b2240 2023-11-28T12:00:14.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.229+0000 7f7a2affd700 1 --2- 172.21.15.39:0/3505364148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a2c0b2240 0x7f7a2c160780 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c06e4c0 tx=0x7f7a1c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4dde42bd3e93f6f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:14.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.229+0000 7f7a29ffb700 1 -- 172.21.15.39:0/3505364148 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c00b8a0 con 0x7f7a2c0b2240 2023-11-28T12:00:14.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.229+0000 7f7a29ffb700 1 -- 172.21.15.39:0/3505364148 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1c00ba00 con 0x7f7a2c0b2240 2023-11-28T12:00:14.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.229+0000 7f7a29ffb700 1 -- 172.21.15.39:0/3505364148 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c00bd90 con 0x7f7a2c0b2240 2023-11-28T12:00:14.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.229+0000 7f7a31913700 1 -- 172.21.15.39:0/3505364148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a2c0b2240 msgr2=0x7f7a2c160780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:14.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.229+0000 7f7a31913700 1 --2- 172.21.15.39:0/3505364148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a2c0b2240 0x7f7a2c160780 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c06e4c0 tx=0x7f7a1c009bf0 comp rx=0 tx=0).stop 2023-11-28T12:00:14.236 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.229+0000 7f7a31913700 1 -- 172.21.15.39:0/3505364148 shutdown_connections 2023-11-28T12:00:14.236 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.229+0000 7f7a31913700 1 --2- 172.21.15.39:0/3505364148 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7a2c06f200 0x7f7a2c0b2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:14.236 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.229+0000 7f7a31913700 1 --2- 172.21.15.39:0/3505364148 >> v2:172.21.15.184:3300/0 conn(0x7f7a2c06fc00 0x7f7a2c070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:14.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.229+0000 7f7a31913700 1 --2- 172.21.15.39:0/3505364148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a2c0b2240 0x7f7a2c160780 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:14.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.229+0000 7f7a31913700 1 -- 172.21.15.39:0/3505364148 >> 172.21.15.39:0/3505364148 conn(0x7f7a2c0cd240 msgr2=0x7f7a2c0cd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:14.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.229+0000 7f7a31913700 1 -- 172.21.15.39:0/3505364148 shutdown_connections 2023-11-28T12:00:14.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.229+0000 7f7a31913700 1 -- 172.21.15.39:0/3505364148 wait complete. 2023-11-28T12:00:14.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.233+0000 7f7a31913700 1 Processor -- start 2023-11-28T12:00:14.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.233+0000 7f7a31913700 1 -- start start 2023-11-28T12:00:14.241 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.237+0000 7f7a31913700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a2c06f200 0x7f7a2c1f57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:14.241 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.237+0000 7f7a31913700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a2c06fc00 0x7f7a2c0b4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:14.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.237+0000 7f7a31913700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7a2c0b2240 0x7f7a2c0b4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:14.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.237+0000 7f7a31913700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c0c4420 con 0x7f7a2c06fc00 2023-11-28T12:00:14.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.237+0000 7f7a31913700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c1581a0 con 0x7f7a2c06f200 2023-11-28T12:00:14.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.237+0000 7f7a31913700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c1f6340 con 0x7f7a2c0b2240 2023-11-28T12:00:14.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.237+0000 7f7a2a7fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a2c06fc00 0x7f7a2c0b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:14.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.237+0000 7f7a2a7fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a2c06fc00 0x7f7a2c0b4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40654/0 (socket says 172.21.15.39:40654) 2023-11-28T12:00:14.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.237+0000 7f7a2a7fc700 1 -- 172.21.15.39:0/4089678418 learned_addr learned my addr 172.21.15.39:0/4089678418 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:14.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.237+0000 7f7a2affd700 1 --2- 172.21.15.39:0/4089678418 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a2c06f200 0x7f7a2c1f57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:14.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.237+0000 7f7a2b7fe700 1 --2- 172.21.15.39:0/4089678418 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7a2c0b2240 0x7f7a2c0b4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:14.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.237+0000 7f7a2a7fc700 1 -- 172.21.15.39:0/4089678418 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7a2c0b2240 msgr2=0x7f7a2c0b4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:14.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.237+0000 7f7a2a7fc700 1 --2- 172.21.15.39:0/4089678418 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7a2c0b2240 0x7f7a2c0b4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:14.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.237+0000 7f7a2a7fc700 1 -- 172.21.15.39:0/4089678418 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a2c06f200 msgr2=0x7f7a2c1f57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:14.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.237+0000 7f7a2a7fc700 1 --2- 172.21.15.39:0/4089678418 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a2c06f200 0x7f7a2c1f57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:14.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.237+0000 7f7a2a7fc700 1 -- 172.21.15.39:0/4089678418 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1c009570 con 0x7f7a2c06fc00 2023-11-28T12:00:14.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.237+0000 7f7a2b7fe700 1 --2- 172.21.15.39:0/4089678418 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7a2c0b2240 0x7f7a2c0b4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:00:14.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.237+0000 7f7a2a7fc700 1 --2- 172.21.15.39:0/4089678418 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a2c06fc00 0x7f7a2c0b4000 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f7a2000d800 tx=0x7f7a2000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:14.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.237+0000 7f7a13fff700 1 -- 172.21.15.39:0/4089678418 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a200125f0 con 0x7f7a2c06fc00 2023-11-28T12:00:14.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.237+0000 7f7a13fff700 1 -- 172.21.15.39:0/4089678418 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a20012750 con 0x7f7a2c06fc00 2023-11-28T12:00:14.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.237+0000 7f7a31913700 1 -- 172.21.15.39:0/4089678418 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a2c0d0370 con 0x7f7a2c06fc00 2023-11-28T12:00:14.247 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.237+0000 7f7a13fff700 1 -- 172.21.15.39:0/4089678418 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a20012b00 con 0x7f7a2c06fc00 2023-11-28T12:00:14.247 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.237+0000 7f7a31913700 1 -- 172.21.15.39:0/4089678418 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a2c0d0090 con 0x7f7a2c06fc00 2023-11-28T12:00:14.247 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.241+0000 7f7a31913700 1 -- 172.21.15.39:0/4089678418 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7a2c0ce5a0 con 0x7f7a2c06fc00 2023-11-28T12:00:14.247 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.241+0000 7f7a13fff700 1 -- 172.21.15.39:0/4089678418 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7a20012c60 con 0x7f7a2c06fc00 2023-11-28T12:00:14.249 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.245+0000 7f7a13fff700 1 --2- 172.21.15.39:0/4089678418 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7a18064ee0 0x7f7a18067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:14.249 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.245+0000 7f7a13fff700 1 -- 172.21.15.39:0/4089678418 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f7a20082320 con 0x7f7a2c06fc00 2023-11-28T12:00:14.249 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.245+0000 7f7a13fff700 1 --2- 172.21.15.39:0/4089678418 >> [v2:172.21.15.39:6800/36179,v1:172.21.15.39:6801/36179] conn(0x7f7a1806b7f0 0x7f7a1806dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:14.249 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.245+0000 7f7a13fff700 1 -- 172.21.15.39:0/4089678418 --> [v2:172.21.15.39:6800/36179,v1:172.21.15.39:6801/36179] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7a1806e2f0 con 0x7f7a1806b7f0 2023-11-28T12:00:14.250 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.245+0000 7f7a13fff700 1 -- 172.21.15.39:0/4089678418 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a20084900 con 0x7f7a2c06fc00 2023-11-28T12:00:14.250 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.245+0000 7f7a2affd700 1 --2- 172.21.15.39:0/4089678418 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7a18064ee0 0x7f7a18067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:14.250 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.245+0000 7f7a2b7fe700 1 --2- 172.21.15.39:0/4089678418 >> [v2:172.21.15.39:6800/36179,v1:172.21.15.39:6801/36179] conn(0x7f7a1806b7f0 0x7f7a1806dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:14.251 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.245+0000 7f7a2affd700 1 --2- 172.21.15.39:0/4089678418 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7a18064ee0 0x7f7a18067390 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c014040 tx=0x7f7a1c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:14.251 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.245+0000 7f7a2b7fe700 1 --2- 172.21.15.39:0/4089678418 >> [v2:172.21.15.39:6800/36179,v1:172.21.15.39:6801/36179] conn(0x7f7a1806b7f0 0x7f7a1806dc20 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:14.252 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.245+0000 7f7a13fff700 1 -- 172.21.15.39:0/4089678418 <== osd.0 v2:172.21.15.39:6800/36179 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f7a1806e2f0 con 0x7f7a1806b7f0 2023-11-28T12:00:14.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.265+0000 7f7a31913700 1 -- 172.21.15.39:0/4089678418 --> [v2:172.21.15.39:6800/36179,v1:172.21.15.39:6801/36179] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7a2c073cb0 con 0x7f7a1806b7f0 2023-11-28T12:00:14.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.265+0000 7f7a13fff700 1 -- 172.21.15.39:0/4089678418 <== osd.0 v2:172.21.15.39:6800/36179 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f7a2c073cb0 con 0x7f7a1806b7f0 2023-11-28T12:00:14.270 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2023-11-28T12:00:14.270 INFO:teuthology.orchestra.run.smithi039.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-28T12:00:14.271 INFO:teuthology.orchestra.run.smithi039.stdout:} 2023-11-28T12:00:14.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.265+0000 7f7a31913700 1 -- 172.21.15.39:0/4089678418 >> [v2:172.21.15.39:6800/36179,v1:172.21.15.39:6801/36179] conn(0x7f7a1806b7f0 msgr2=0x7f7a1806dc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:14.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.265+0000 7f7a31913700 1 --2- 172.21.15.39:0/4089678418 >> [v2:172.21.15.39:6800/36179,v1:172.21.15.39:6801/36179] conn(0x7f7a1806b7f0 0x7f7a1806dc20 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:14.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.265+0000 7f7a31913700 1 -- 172.21.15.39:0/4089678418 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7a18064ee0 msgr2=0x7f7a18067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:14.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.265+0000 7f7a31913700 1 --2- 172.21.15.39:0/4089678418 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7a18064ee0 0x7f7a18067390 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c014040 tx=0x7f7a1c008030 comp rx=0 tx=0).stop 2023-11-28T12:00:14.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.265+0000 7f7a31913700 1 -- 172.21.15.39:0/4089678418 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a2c06fc00 msgr2=0x7f7a2c0b4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:14.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.265+0000 7f7a31913700 1 --2- 172.21.15.39:0/4089678418 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7a2c06fc00 0x7f7a2c0b4000 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f7a2000d800 tx=0x7f7a2000db10 comp rx=0 tx=0).stop 2023-11-28T12:00:14.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.265+0000 7f7a2b7fe700 1 -- 172.21.15.39:0/4089678418 reap_dead start 2023-11-28T12:00:14.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.265+0000 7f7a31913700 1 -- 172.21.15.39:0/4089678418 shutdown_connections 2023-11-28T12:00:14.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.265+0000 7f7a31913700 1 -- 172.21.15.39:0/4089678418 >> 172.21.15.39:0/4089678418 conn(0x7f7a2c0cd240 msgr2=0x7f7a2c06ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:14.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.265+0000 7f7a31913700 1 -- 172.21.15.39:0/4089678418 shutdown_connections 2023-11-28T12:00:14.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.265+0000 7f7a31913700 1 -- 172.21.15.39:0/4089678418 wait complete. 2023-11-28T12:00:14.296 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-28T12:00:14.475 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.469+0000 7fd67b59e700 1 Processor -- start 2023-11-28T12:00:14.476 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.469+0000 7fd67b59e700 1 -- start start 2023-11-28T12:00:14.477 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.473+0000 7fd67b59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd67c0b1640 0x7fd67c070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:14.477 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.473+0000 7fd67b59e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd67c0c9040 0x7fd67c0705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:14.477 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.473+0000 7fd67b59e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd67c15a550 con 0x7fd67c0b43a0 2023-11-28T12:00:14.478 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.473+0000 7fd67b59e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd67c06b0a0 con 0x7fd67c0c9040 2023-11-28T12:00:14.478 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.473+0000 7fd67b59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c0caac0 con 0x7fd67c0b1640 2023-11-28T12:00:14.478 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.473+0000 7fd67a59c700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fd67c0b43a0 0x7fd67c15e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:37970/0 (socket says 172.21.15.39:37970) 2023-11-28T12:00:14.478 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.473+0000 7fd67a59c700 1 -- 172.21.15.39:0/1925812811 learned_addr learned my addr 172.21.15.39:0/1925812811 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T12:00:14.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.473+0000 7fd679d9b700 1 --2- 172.21.15.39:0/1925812811 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd67c0b1640 0x7fd67c070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:14.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.473+0000 7fd67ad9d700 1 --2- 172.21.15.39:0/1925812811 >> v2:172.21.15.184:3300/0 conn(0x7fd67c0c9040 0x7fd67c0705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:14.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.473+0000 7fd679d9b700 1 -- 172.21.15.39:0/1925812811 >> v2:172.21.15.184:3300/0 conn(0x7fd67c0c9040 msgr2=0x7fd67c0705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:14.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.473+0000 7fd679d9b700 1 --2- 172.21.15.39:0/1925812811 >> v2:172.21.15.184:3300/0 conn(0x7fd67c0c9040 0x7fd67c0705c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:14.480 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.473+0000 7fd67959a700 1 -- 172.21.15.39:0/1925812811 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2557563477 0 0) 0x7fd66c001110 con 0x7fd67c0b43a0 2023-11-28T12:00:14.480 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.473+0000 7fd679d9b700 1 -- 172.21.15.39:0/1925812811 >> v1:172.21.15.184:6789/0 conn(0x7fd67c0b43a0 legacy=0x7fd67c15e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:14.480 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.473+0000 7fd679d9b700 1 -- 172.21.15.39:0/1925812811 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd67c0cada0 con 0x7fd67c0b1640 2023-11-28T12:00:14.480 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.473+0000 7fd679d9b700 1 --2- 172.21.15.39:0/1925812811 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd67c0b1640 0x7fd67c070080 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd670009850 tx=0x7fd670009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3baac974a475db53 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:14.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.473+0000 7fd67959a700 1 -- 172.21.15.39:0/1925812811 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd670011830 con 0x7fd67c0b1640 2023-11-28T12:00:14.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.473+0000 7fd67959a700 1 -- 172.21.15.39:0/1925812811 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd670011990 con 0x7fd67c0b1640 2023-11-28T12:00:14.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.473+0000 7fd67959a700 1 -- 172.21.15.39:0/1925812811 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd670011d40 con 0x7fd67c0b1640 2023-11-28T12:00:14.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.477+0000 7fd67b59e700 1 -- 172.21.15.39:0/1925812811 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd67c0b1640 msgr2=0x7fd67c070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:14.483 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.477+0000 7fd67b59e700 1 --2- 172.21.15.39:0/1925812811 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd67c0b1640 0x7fd67c070080 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd670009850 tx=0x7fd670009b60 comp rx=0 tx=0).stop 2023-11-28T12:00:14.483 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.477+0000 7fd67b59e700 1 -- 172.21.15.39:0/1925812811 shutdown_connections 2023-11-28T12:00:14.483 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.477+0000 7fd67b59e700 1 --2- 172.21.15.39:0/1925812811 >> v2:172.21.15.184:3300/0 conn(0x7fd67c0c9040 0x7fd67c0705c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:14.483 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.477+0000 7fd67b59e700 1 --2- 172.21.15.39:0/1925812811 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd67c0b1640 0x7fd67c070080 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:14.483 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.477+0000 7fd67b59e700 1 -- 172.21.15.39:0/1925812811 >> 172.21.15.39:0/1925812811 conn(0x7fd67c0b0f80 msgr2=0x7fd67c0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:14.483 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.477+0000 7fd67b59e700 1 -- 172.21.15.39:0/1925812811 shutdown_connections 2023-11-28T12:00:14.483 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.477+0000 7fd67b59e700 1 -- 172.21.15.39:0/1925812811 wait complete. 2023-11-28T12:00:14.485 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.481+0000 7fd67b59e700 1 Processor -- start 2023-11-28T12:00:14.485 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.481+0000 7fd67b59e700 1 -- start start 2023-11-28T12:00:14.487 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.481+0000 7fd67b59e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd67c0b1640 0x7fd67c149ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:14.487 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.481+0000 7fd67b59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd67c0b43a0 0x7fd67c0c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:14.487 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.481+0000 7fd67b59e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd67c0c9040 0x7fd67c14c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:14.487 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.481+0000 7fd67b59e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c14d140 con 0x7fd67c0c9040 2023-11-28T12:00:14.488 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.481+0000 7fd67b59e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c14d420 con 0x7fd67c0b1640 2023-11-28T12:00:14.488 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.481+0000 7fd67b59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c0c41c0 con 0x7fd67c0b43a0 2023-11-28T12:00:14.488 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.481+0000 7fd67ad9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd67c0c9040 0x7fd67c14c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:14.489 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.481+0000 7fd67a59c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd67c0b1640 0x7fd67c149ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:14.489 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.481+0000 7fd679d9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd67c0b43a0 0x7fd67c0c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:14.489 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.481+0000 7fd67ad9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd67c0c9040 0x7fd67c14c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40666/0 (socket says 172.21.15.39:40666) 2023-11-28T12:00:14.489 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.481+0000 7fd67ad9d700 1 -- 172.21.15.39:0/3120941977 learned_addr learned my addr 172.21.15.39:0/3120941977 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:14.489 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.481+0000 7fd67a59c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd67c0b1640 0x7fd67c149ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:43414/0 (socket says 172.21.15.39:43414) 2023-11-28T12:00:14.489 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.485+0000 7fd67ad9d700 1 -- 172.21.15.39:0/3120941977 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd67c0b43a0 msgr2=0x7fd67c0c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:14.489 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.485+0000 7fd67ad9d700 1 --2- 172.21.15.39:0/3120941977 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd67c0b43a0 0x7fd67c0c49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:14.490 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.485+0000 7fd67ad9d700 1 -- 172.21.15.39:0/3120941977 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd67c0b1640 msgr2=0x7fd67c149ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:14.490 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.485+0000 7fd67ad9d700 1 --2- 172.21.15.39:0/3120941977 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd67c0b1640 0x7fd67c149ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:14.490 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.485+0000 7fd67ad9d700 1 -- 172.21.15.39:0/3120941977 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6700094b0 con 0x7fd67c0c9040 2023-11-28T12:00:14.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.485+0000 7fd67ad9d700 1 --2- 172.21.15.39:0/3120941977 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd67c0c9040 0x7fd67c14c680 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fd67400efc0 tx=0x7fd67400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:14.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.485+0000 7fd66affd700 1 -- 172.21.15.39:0/3120941977 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd674009ea0 con 0x7fd67c0c9040 2023-11-28T12:00:14.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.485+0000 7fd66affd700 1 -- 172.21.15.39:0/3120941977 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67400f040 con 0x7fd67c0c9040 2023-11-28T12:00:14.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.485+0000 7fd67b59e700 1 -- 172.21.15.39:0/3120941977 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd67c06b5d0 con 0x7fd67c0c9040 2023-11-28T12:00:14.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.485+0000 7fd66affd700 1 -- 172.21.15.39:0/3120941977 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67400ced0 con 0x7fd67c0c9040 2023-11-28T12:00:14.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.485+0000 7fd67b59e700 1 -- 172.21.15.39:0/3120941977 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd67c06b2f0 con 0x7fd67c0c9040 2023-11-28T12:00:14.492 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.485+0000 7fd67b59e700 1 -- 172.21.15.39:0/3120941977 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd67c0ca7b0 con 0x7fd67c0c9040 2023-11-28T12:00:14.493 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.489+0000 7fd66affd700 1 -- 172.21.15.39:0/3120941977 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd674014480 con 0x7fd67c0c9040 2023-11-28T12:00:14.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.489+0000 7fd66affd700 1 --2- 172.21.15.39:0/3120941977 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd65c064ee0 0x7fd65c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:14.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.489+0000 7fd66affd700 1 -- 172.21.15.39:0/3120941977 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fd6740826e0 con 0x7fd67c0c9040 2023-11-28T12:00:14.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.489+0000 7fd67a59c700 1 --2- 172.21.15.39:0/3120941977 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd65c064ee0 0x7fd65c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:14.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.493+0000 7fd67a59c700 1 --2- 172.21.15.39:0/3120941977 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd65c064ee0 0x7fd65c067390 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd66c000f60 tx=0x7fd66c007e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:14.503 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.497+0000 7fd66affd700 1 -- 172.21.15.39:0/3120941977 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd674050910 con 0x7fd67c0c9040 2023-11-28T12:00:14.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.673+0000 7fd67b59e700 1 -- 172.21.15.39:0/3120941977 --> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fd67c073200 con 0x7fd65c064ee0 2023-11-28T12:00:14.679 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.673+0000 7fd66affd700 1 -- 172.21.15.39:0/3120941977 <== mgr.4104 v2:172.21.15.184:6832/36166 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd67c073200 con 0x7fd65c064ee0 2023-11-28T12:00:14.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.677+0000 7fd67b59e700 1 -- 172.21.15.39:0/3120941977 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd65c064ee0 msgr2=0x7fd65c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:14.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.677+0000 7fd67b59e700 1 --2- 172.21.15.39:0/3120941977 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd65c064ee0 0x7fd65c067390 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd66c000f60 tx=0x7fd66c007e90 comp rx=0 tx=0).stop 2023-11-28T12:00:14.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.677+0000 7fd67b59e700 1 -- 172.21.15.39:0/3120941977 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd67c0c9040 msgr2=0x7fd67c14c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:14.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.677+0000 7fd67b59e700 1 --2- 172.21.15.39:0/3120941977 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd67c0c9040 0x7fd67c14c680 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fd67400efc0 tx=0x7fd67400c3a0 comp rx=0 tx=0).stop 2023-11-28T12:00:14.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.677+0000 7fd67b59e700 1 -- 172.21.15.39:0/3120941977 shutdown_connections 2023-11-28T12:00:14.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.677+0000 7fd67b59e700 1 --2- 172.21.15.39:0/3120941977 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd67c0c9040 0x7fd67c14c680 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:14.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.677+0000 7fd67b59e700 1 --2- 172.21.15.39:0/3120941977 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd67c0b43a0 0x7fd67c0c49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:14.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.677+0000 7fd67b59e700 1 --2- 172.21.15.39:0/3120941977 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd65c064ee0 0x7fd65c067390 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:14.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.677+0000 7fd67b59e700 1 --2- 172.21.15.39:0/3120941977 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd67c0b1640 0x7fd67c149ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:14.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.677+0000 7fd67b59e700 1 -- 172.21.15.39:0/3120941977 >> 172.21.15.39:0/3120941977 conn(0x7fd67c0b0f80 msgr2=0x7fd67c0ad740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:14.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.677+0000 7fd67b59e700 1 -- 172.21.15.39:0/3120941977 shutdown_connections 2023-11-28T12:00:14.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.677+0000 7fd67b59e700 1 -- 172.21.15.39:0/3120941977 wait complete. 2023-11-28T12:00:14.689 INFO:teuthology.orchestra.run.smithi039.stderr:instructed osd(s) 0 to deep-scrub 2023-11-28T12:00:14.705 INFO:tasks.ceph:Scrubbing osd.1 2023-11-28T12:00:14.705 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-28T12:00:14.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.885+0000 7fe2493d9700 1 Processor -- start 2023-11-28T12:00:14.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.885+0000 7fe2493d9700 1 -- start start 2023-11-28T12:00:14.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.889+0000 7fe2493d9700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe2440cd9d0 0x7fe24406a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:14.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.889+0000 7fe2493d9700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe244145fb0 0x7fe2440ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:14.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.889+0000 7fe2493d9700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2441601d0 con 0x7fe2440cea60 2023-11-28T12:00:14.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.889+0000 7fe2493d9700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe24415cb90 con 0x7fe2440cd9d0 2023-11-28T12:00:14.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.889+0000 7fe2493d9700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2440ceea0 con 0x7fe244145fb0 2023-11-28T12:00:14.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.889+0000 7fe242ffd700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe2440cd9d0 0x7fe24406a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:14.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.889+0000 7fe2427fc700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe244145fb0 0x7fe2440ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:14.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.889+0000 7fe242ffd700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe2440cd9d0 0x7fe24406a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40676/0 (socket says 172.21.15.39:40676) 2023-11-28T12:00:14.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.889+0000 7fe242ffd700 1 -- 172.21.15.39:0/1601815011 learned_addr learned my addr 172.21.15.39:0/1601815011 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:14.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.889+0000 7fe242ffd700 1 -- 172.21.15.39:0/1601815011 >> v2:172.21.15.184:3300/0 conn(0x7fe244145fb0 msgr2=0x7fe2440ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:14.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.889+0000 7fe242ffd700 1 --2- 172.21.15.39:0/1601815011 >> v2:172.21.15.184:3300/0 conn(0x7fe244145fb0 0x7fe2440ce520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:14.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.893+0000 7fe242ffd700 1 -- 172.21.15.39:0/1601815011 >> v1:172.21.15.184:6789/0 conn(0x7fe2440cea60 legacy=0x7fe2440b23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:14.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.893+0000 7fe242ffd700 1 -- 172.21.15.39:0/1601815011 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe244160420 con 0x7fe2440cd9d0 2023-11-28T12:00:14.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.893+0000 7fe2427fc700 1 --2- 172.21.15.39:0/1601815011 >> v2:172.21.15.184:3300/0 conn(0x7fe244145fb0 0x7fe2440ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:00:14.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.893+0000 7fe242ffd700 1 --2- 172.21.15.39:0/1601815011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2440cd9d0 0x7fe24406a640 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fe24406e1e0 tx=0x7fe234009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45df1849dbebf003 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:14.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.893+0000 7fe241ffb700 1 -- 172.21.15.39:0/1601815011 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe234011830 con 0x7fe2440cd9d0 2023-11-28T12:00:14.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.893+0000 7fe241ffb700 1 -- 172.21.15.39:0/1601815011 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe234011990 con 0x7fe2440cd9d0 2023-11-28T12:00:14.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.893+0000 7fe241ffb700 1 -- 172.21.15.39:0/1601815011 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe234011d20 con 0x7fe2440cd9d0 2023-11-28T12:00:14.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.893+0000 7fe2493d9700 1 -- 172.21.15.39:0/1601815011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2440cd9d0 msgr2=0x7fe24406a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:14.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.893+0000 7fe2493d9700 1 --2- 172.21.15.39:0/1601815011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2440cd9d0 0x7fe24406a640 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fe24406e1e0 tx=0x7fe234009bf0 comp rx=0 tx=0).stop 2023-11-28T12:00:14.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.893+0000 7fe2493d9700 1 -- 172.21.15.39:0/1601815011 shutdown_connections 2023-11-28T12:00:14.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.893+0000 7fe2493d9700 1 --2- 172.21.15.39:0/1601815011 >> v2:172.21.15.184:3300/0 conn(0x7fe244145fb0 0x7fe2440ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:14.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.893+0000 7fe2493d9700 1 --2- 172.21.15.39:0/1601815011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2440cd9d0 0x7fe24406a640 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:14.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.893+0000 7fe2493d9700 1 -- 172.21.15.39:0/1601815011 >> 172.21.15.39:0/1601815011 conn(0x7fe24406f1e0 msgr2=0x7fe244069bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:14.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.893+0000 7fe2493d9700 1 -- 172.21.15.39:0/1601815011 shutdown_connections 2023-11-28T12:00:14.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.893+0000 7fe2493d9700 1 -- 172.21.15.39:0/1601815011 wait complete. 2023-11-28T12:00:14.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.897+0000 7fe2493d9700 1 Processor -- start 2023-11-28T12:00:14.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.897+0000 7fe2493d9700 1 -- start start 2023-11-28T12:00:14.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.897+0000 7fe2493d9700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2440cd9d0 0x7fe2440c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:14.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.897+0000 7fe2493d9700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2440cea60 0x7fe244157e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:14.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.897+0000 7fe2493d9700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe244145fb0 0x7fe2440b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:14.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.897+0000 7fe2493d9700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2440b3ad0 con 0x7fe2440cd9d0 2023-11-28T12:00:14.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.897+0000 7fe2493d9700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2440b5430 con 0x7fe2440cea60 2023-11-28T12:00:14.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.897+0000 7fe2493d9700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2440b3780 con 0x7fe244145fb0 2023-11-28T12:00:14.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.901+0000 7fe242ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2440cd9d0 0x7fe2440c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:14.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.901+0000 7fe242ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2440cd9d0 0x7fe2440c6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40682/0 (socket says 172.21.15.39:40682) 2023-11-28T12:00:14.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.901+0000 7fe242ffd700 1 -- 172.21.15.39:0/3662466971 learned_addr learned my addr 172.21.15.39:0/3662466971 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:14.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.901+0000 7fe2427fc700 1 --2- 172.21.15.39:0/3662466971 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2440cea60 0x7fe244157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:14.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.901+0000 7fe2437fe700 1 --2- 172.21.15.39:0/3662466971 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe244145fb0 0x7fe2440b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:14.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.901+0000 7fe242ffd700 1 -- 172.21.15.39:0/3662466971 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe244145fb0 msgr2=0x7fe2440b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:14.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.901+0000 7fe242ffd700 1 --2- 172.21.15.39:0/3662466971 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe244145fb0 0x7fe2440b5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:14.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.901+0000 7fe242ffd700 1 -- 172.21.15.39:0/3662466971 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2440cea60 msgr2=0x7fe244157e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:14.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.901+0000 7fe242ffd700 1 --2- 172.21.15.39:0/3662466971 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2440cea60 0x7fe244157e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:14.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.901+0000 7fe242ffd700 1 -- 172.21.15.39:0/3662466971 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2380094b0 con 0x7fe2440cd9d0 2023-11-28T12:00:14.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.901+0000 7fe2427fc700 1 --2- 172.21.15.39:0/3662466971 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2440cea60 0x7fe244157e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:00:14.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.901+0000 7fe2437fe700 1 --2- 172.21.15.39:0/3662466971 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe244145fb0 0x7fe2440b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:00:14.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.901+0000 7fe242ffd700 1 --2- 172.21.15.39:0/3662466971 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2440cd9d0 0x7fe2440c6eb0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fe24406de50 tx=0x7fe234004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:14.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.901+0000 7fe22b7fe700 1 -- 172.21.15.39:0/3662466971 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe234004550 con 0x7fe2440cd9d0 2023-11-28T12:00:14.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.901+0000 7fe22b7fe700 1 -- 172.21.15.39:0/3662466971 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23401f070 con 0x7fe2440cd9d0 2023-11-28T12:00:14.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.901+0000 7fe2493d9700 1 -- 172.21.15.39:0/3662466971 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe234009570 con 0x7fe2440cd9d0 2023-11-28T12:00:14.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.901+0000 7fe22b7fe700 1 -- 172.21.15.39:0/3662466971 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe234003900 con 0x7fe2440cd9d0 2023-11-28T12:00:14.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.901+0000 7fe2493d9700 1 -- 172.21.15.39:0/3662466971 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2441609e0 con 0x7fe2440cd9d0 2023-11-28T12:00:14.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.901+0000 7fe2493d9700 1 -- 172.21.15.39:0/3662466971 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe244160700 con 0x7fe2440cd9d0 2023-11-28T12:00:14.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.905+0000 7fe22b7fe700 1 -- 172.21.15.39:0/3662466971 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe23400f050 con 0x7fe2440cd9d0 2023-11-28T12:00:14.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.905+0000 7fe22b7fe700 1 --2- 172.21.15.39:0/3662466971 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe230064ee0 0x7fe230067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:14.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.909+0000 7fe22b7fe700 1 -- 172.21.15.39:0/3662466971 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fe234021070 con 0x7fe2440cd9d0 2023-11-28T12:00:14.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.909+0000 7fe22b7fe700 1 --2- 172.21.15.39:0/3662466971 >> [v2:172.21.15.39:6823/36182,v1:172.21.15.39:6825/36182] conn(0x7fe23006b7f0 0x7fe23006dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:14.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.909+0000 7fe22b7fe700 1 -- 172.21.15.39:0/3662466971 --> [v2:172.21.15.39:6823/36182,v1:172.21.15.39:6825/36182] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe23006e2f0 con 0x7fe23006b7f0 2023-11-28T12:00:14.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.909+0000 7fe22b7fe700 1 -- 172.21.15.39:0/3662466971 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe234083690 con 0x7fe2440cd9d0 2023-11-28T12:00:14.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.909+0000 7fe2427fc700 1 --2- 172.21.15.39:0/3662466971 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe230064ee0 0x7fe230067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:14.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.909+0000 7fe2437fe700 1 --2- 172.21.15.39:0/3662466971 >> [v2:172.21.15.39:6823/36182,v1:172.21.15.39:6825/36182] conn(0x7fe23006b7f0 0x7fe23006dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:14.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.909+0000 7fe2427fc700 1 --2- 172.21.15.39:0/3662466971 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe230064ee0 0x7fe230067390 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe244071d10 tx=0x7fe238008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:14.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.909+0000 7fe2437fe700 1 --2- 172.21.15.39:0/3662466971 >> [v2:172.21.15.39:6823/36182,v1:172.21.15.39:6825/36182] conn(0x7fe23006b7f0 0x7fe23006dc20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:14.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.909+0000 7fe22b7fe700 1 -- 172.21.15.39:0/3662466971 <== osd.1 v2:172.21.15.39:6823/36182 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe23006e2f0 con 0x7fe23006b7f0 2023-11-28T12:00:14.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.929+0000 7fe2493d9700 1 -- 172.21.15.39:0/3662466971 --> [v2:172.21.15.39:6823/36182,v1:172.21.15.39:6825/36182] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe244160cc0 con 0x7fe23006b7f0 2023-11-28T12:00:14.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.929+0000 7fe22b7fe700 1 -- 172.21.15.39:0/3662466971 <== osd.1 v2:172.21.15.39:6823/36182 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe244160cc0 con 0x7fe23006b7f0 2023-11-28T12:00:14.935 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2023-11-28T12:00:14.936 INFO:teuthology.orchestra.run.smithi039.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-28T12:00:14.936 INFO:teuthology.orchestra.run.smithi039.stdout:} 2023-11-28T12:00:14.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.929+0000 7fe2493d9700 1 -- 172.21.15.39:0/3662466971 >> [v2:172.21.15.39:6823/36182,v1:172.21.15.39:6825/36182] conn(0x7fe23006b7f0 msgr2=0x7fe23006dc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:14.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.929+0000 7fe2493d9700 1 --2- 172.21.15.39:0/3662466971 >> [v2:172.21.15.39:6823/36182,v1:172.21.15.39:6825/36182] conn(0x7fe23006b7f0 0x7fe23006dc20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:14.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.929+0000 7fe2493d9700 1 -- 172.21.15.39:0/3662466971 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe230064ee0 msgr2=0x7fe230067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:14.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.929+0000 7fe2493d9700 1 --2- 172.21.15.39:0/3662466971 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fe230064ee0 0x7fe230067390 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe244071d10 tx=0x7fe238008040 comp rx=0 tx=0).stop 2023-11-28T12:00:14.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.929+0000 7fe2493d9700 1 -- 172.21.15.39:0/3662466971 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2440cd9d0 msgr2=0x7fe2440c6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:14.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.929+0000 7fe2493d9700 1 --2- 172.21.15.39:0/3662466971 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2440cd9d0 0x7fe2440c6eb0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fe24406de50 tx=0x7fe234004770 comp rx=0 tx=0).stop 2023-11-28T12:00:14.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.929+0000 7fe2437fe700 1 -- 172.21.15.39:0/3662466971 reap_dead start 2023-11-28T12:00:14.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.933+0000 7fe2493d9700 1 -- 172.21.15.39:0/3662466971 shutdown_connections 2023-11-28T12:00:14.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.933+0000 7fe2493d9700 1 -- 172.21.15.39:0/3662466971 >> 172.21.15.39:0/3662466971 conn(0x7fe24406f1e0 msgr2=0x7fe24406c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:14.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.933+0000 7fe2493d9700 1 -- 172.21.15.39:0/3662466971 shutdown_connections 2023-11-28T12:00:14.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:14.933+0000 7fe2493d9700 1 -- 172.21.15.39:0/3662466971 wait complete. 2023-11-28T12:00:14.962 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-28T12:00:15.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.137+0000 7fd9c4999700 1 Processor -- start 2023-11-28T12:00:15.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.137+0000 7fd9c4999700 1 -- start start 2023-11-28T12:00:15.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.137+0000 7fd9c4999700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd9c00c8d10 0x7fd9c00cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:15.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.137+0000 7fd9c4999700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9c0069d60 0x7fd9c006a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:15.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.137+0000 7fd9c4999700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9c015a850 con 0x7fd9c015a480 2023-11-28T12:00:15.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.137+0000 7fd9c4999700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9c00ce060 con 0x7fd9c00c8d10 2023-11-28T12:00:15.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.137+0000 7fd9c4999700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c00ce300 con 0x7fd9c0069d60 2023-11-28T12:00:15.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.137+0000 7fd9be59c700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fd9c015a480 0x7fd9c00cc290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56086/0 (socket says 172.21.15.39:56086) 2023-11-28T12:00:15.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.137+0000 7fd9be59c700 1 -- 172.21.15.39:0/2738717977 learned_addr learned my addr 172.21.15.39:0/2738717977 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T12:00:15.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.137+0000 7fd9b5d9b700 1 --2- 172.21.15.39:0/2738717977 >> v2:172.21.15.39:3300/0 conn(0x7fd9c00c8d10 0x7fd9c00cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:15.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.137+0000 7fd9bed9d700 1 --2- 172.21.15.39:0/2738717977 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9c0069d60 0x7fd9c006a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:15.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.137+0000 7fd9bdd9b700 1 -- 172.21.15.39:0/2738717977 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 392193748 0 0) 0x7fd9c015a850 con 0x7fd9c015a480 2023-11-28T12:00:15.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.137+0000 7fd9bdd9b700 1 -- 172.21.15.39:0/2738717977 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9ac0035d0 con 0x7fd9c015a480 2023-11-28T12:00:15.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.141+0000 7fd9bed9d700 1 -- 172.21.15.39:0/2738717977 >> v2:172.21.15.39:3300/0 conn(0x7fd9c00c8d10 msgr2=0x7fd9c00cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:15.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.141+0000 7fd9bed9d700 1 --2- 172.21.15.39:0/2738717977 >> v2:172.21.15.39:3300/0 conn(0x7fd9c00c8d10 0x7fd9c00cc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:15.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.141+0000 7fd9bed9d700 1 -- 172.21.15.39:0/2738717977 >> v1:172.21.15.39:6789/0 conn(0x7fd9c015a480 legacy=0x7fd9c00cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:15.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.141+0000 7fd9bed9d700 1 -- 172.21.15.39:0/2738717977 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c00cada0 con 0x7fd9c0069d60 2023-11-28T12:00:15.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.141+0000 7fd9b5d9b700 1 --2- 172.21.15.39:0/2738717977 >> v2:172.21.15.39:3300/0 conn(0x7fd9c00c8d10 0x7fd9c00cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:00:15.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.141+0000 7fd9bed9d700 1 --2- 172.21.15.39:0/2738717977 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9c0069d60 0x7fd9c006a1e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8009d90 tx=0x7fd9b800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca2b4fa39a490fa0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:15.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.141+0000 7fd9bdd9b700 1 -- 172.21.15.39:0/2738717977 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b800e070 con 0x7fd9c0069d60 2023-11-28T12:00:15.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.141+0000 7fd9bdd9b700 1 -- 172.21.15.39:0/2738717977 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b800bb20 con 0x7fd9c0069d60 2023-11-28T12:00:15.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.141+0000 7fd9bdd9b700 1 -- 172.21.15.39:0/2738717977 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8012430 con 0x7fd9c0069d60 2023-11-28T12:00:15.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.141+0000 7fd9c4999700 1 -- 172.21.15.39:0/2738717977 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9c0069d60 msgr2=0x7fd9c006a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:15.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.141+0000 7fd9c4999700 1 --2- 172.21.15.39:0/2738717977 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9c0069d60 0x7fd9c006a1e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8009d90 tx=0x7fd9b800b330 comp rx=0 tx=0).stop 2023-11-28T12:00:15.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.141+0000 7fd9c4999700 1 -- 172.21.15.39:0/2738717977 shutdown_connections 2023-11-28T12:00:15.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.141+0000 7fd9c4999700 1 --2- 172.21.15.39:0/2738717977 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9c0069d60 0x7fd9c006a1e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:15.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.141+0000 7fd9c4999700 1 --2- 172.21.15.39:0/2738717977 >> v2:172.21.15.39:3300/0 conn(0x7fd9c00c8d10 0x7fd9c00cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:15.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.141+0000 7fd9c4999700 1 -- 172.21.15.39:0/2738717977 >> 172.21.15.39:0/2738717977 conn(0x7fd9c00cf350 msgr2=0x7fd9c00b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:15.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.141+0000 7fd9c4999700 1 -- 172.21.15.39:0/2738717977 shutdown_connections 2023-11-28T12:00:15.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.141+0000 7fd9c4999700 1 -- 172.21.15.39:0/2738717977 wait complete. 2023-11-28T12:00:15.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.145+0000 7fd9c4999700 1 Processor -- start 2023-11-28T12:00:15.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.145+0000 7fd9c4999700 1 -- start start 2023-11-28T12:00:15.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.145+0000 7fd9c4999700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9c0069d60 0x7fd9c00c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:15.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.145+0000 7fd9c4999700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9c00c8d10 0x7fd9c006bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:15.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.145+0000 7fd9c4999700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9c015a480 0x7fd9c015cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:15.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.145+0000 7fd9c4999700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c00ab860 con 0x7fd9c015a480 2023-11-28T12:00:15.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.145+0000 7fd9c4999700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c006c040 con 0x7fd9c0069d60 2023-11-28T12:00:15.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.145+0000 7fd9c4999700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c006c310 con 0x7fd9c00c8d10 2023-11-28T12:00:15.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.145+0000 7fd9bed9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9c015a480 0x7fd9c015cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:15.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.149+0000 7fd9bed9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9c015a480 0x7fd9c015cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40712/0 (socket says 172.21.15.39:40712) 2023-11-28T12:00:15.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.149+0000 7fd9bed9d700 1 -- 172.21.15.39:0/3938356358 learned_addr learned my addr 172.21.15.39:0/3938356358 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:15.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.149+0000 7fd9b5d9b700 1 --2- 172.21.15.39:0/3938356358 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9c00c8d10 0x7fd9c006bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:15.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.149+0000 7fd9be59c700 1 --2- 172.21.15.39:0/3938356358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9c0069d60 0x7fd9c00c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:15.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.149+0000 7fd9bed9d700 1 -- 172.21.15.39:0/3938356358 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9c00c8d10 msgr2=0x7fd9c006bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:15.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.149+0000 7fd9bed9d700 1 --2- 172.21.15.39:0/3938356358 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9c00c8d10 0x7fd9c006bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:15.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.149+0000 7fd9bed9d700 1 -- 172.21.15.39:0/3938356358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9c0069d60 msgr2=0x7fd9c00c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:15.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.149+0000 7fd9bed9d700 1 --2- 172.21.15.39:0/3938356358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9c0069d60 0x7fd9c00c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:15.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.149+0000 7fd9bed9d700 1 -- 172.21.15.39:0/3938356358 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a80094b0 con 0x7fd9c015a480 2023-11-28T12:00:15.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.149+0000 7fd9b5d9b700 1 --2- 172.21.15.39:0/3938356358 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9c00c8d10 0x7fd9c006bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:00:15.158 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.149+0000 7fd9bed9d700 1 --2- 172.21.15.39:0/3938356358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9c015a480 0x7fd9c015cc90 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8014040 tx=0x7fd9b8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:15.158 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.149+0000 7fd9b77fe700 1 -- 172.21.15.39:0/3938356358 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8004800 con 0x7fd9c015a480 2023-11-28T12:00:15.158 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.149+0000 7fd9b77fe700 1 -- 172.21.15.39:0/3938356358 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b8020070 con 0x7fd9c015a480 2023-11-28T12:00:15.158 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.149+0000 7fd9b77fe700 1 -- 172.21.15.39:0/3938356358 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b80276c0 con 0x7fd9c015a480 2023-11-28T12:00:15.158 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.149+0000 7fd9c4999700 1 -- 172.21.15.39:0/3938356358 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b8009a70 con 0x7fd9c015a480 2023-11-28T12:00:15.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.149+0000 7fd9c4999700 1 -- 172.21.15.39:0/3938356358 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c00add50 con 0x7fd9c015a480 2023-11-28T12:00:15.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.153+0000 7fd9c4999700 1 -- 172.21.15.39:0/3938356358 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9c00caa30 con 0x7fd9c015a480 2023-11-28T12:00:15.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.153+0000 7fd9b77fe700 1 -- 172.21.15.39:0/3938356358 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd9b802e070 con 0x7fd9c015a480 2023-11-28T12:00:15.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.153+0000 7fd9b77fe700 1 --2- 172.21.15.39:0/3938356358 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd9a0064ee0 0x7fd9a0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:15.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.153+0000 7fd9b77fe700 1 -- 172.21.15.39:0/3938356358 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fd9b8022070 con 0x7fd9c015a480 2023-11-28T12:00:15.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.153+0000 7fd9be59c700 1 --2- 172.21.15.39:0/3938356358 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd9a0064ee0 0x7fd9a0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:15.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.157+0000 7fd9be59c700 1 --2- 172.21.15.39:0/3938356358 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd9a0064ee0 0x7fd9a0067390 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0007fd0 tx=0x7fd9b0007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:15.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.161+0000 7fd9b77fe700 1 -- 172.21.15.39:0/3938356358 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd9b8051b50 con 0x7fd9c015a480 2023-11-28T12:00:15.339 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.333+0000 7fd9c4999700 1 -- 172.21.15.39:0/3938356358 --> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9c00ca6e0 con 0x7fd9a0064ee0 2023-11-28T12:00:15.339 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.333+0000 7fd9b77fe700 1 -- 172.21.15.39:0/3938356358 <== mgr.4104 v2:172.21.15.184:6832/36166 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd9c00ca6e0 con 0x7fd9a0064ee0 2023-11-28T12:00:15.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.341+0000 7fd9c4999700 1 -- 172.21.15.39:0/3938356358 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd9a0064ee0 msgr2=0x7fd9a0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:15.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.341+0000 7fd9c4999700 1 --2- 172.21.15.39:0/3938356358 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd9a0064ee0 0x7fd9a0067390 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0007fd0 tx=0x7fd9b0007de0 comp rx=0 tx=0).stop 2023-11-28T12:00:15.346 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.341+0000 7fd9c4999700 1 -- 172.21.15.39:0/3938356358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9c015a480 msgr2=0x7fd9c015cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:15.346 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.341+0000 7fd9c4999700 1 --2- 172.21.15.39:0/3938356358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9c015a480 0x7fd9c015cc90 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8014040 tx=0x7fd9b8004af0 comp rx=0 tx=0).stop 2023-11-28T12:00:15.346 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.341+0000 7fd9c4999700 1 -- 172.21.15.39:0/3938356358 shutdown_connections 2023-11-28T12:00:15.346 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.341+0000 7fd9c4999700 1 --2- 172.21.15.39:0/3938356358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9c015a480 0x7fd9c015cc90 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:15.346 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.341+0000 7fd9c4999700 1 --2- 172.21.15.39:0/3938356358 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9c00c8d10 0x7fd9c006bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:15.346 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.341+0000 7fd9c4999700 1 --2- 172.21.15.39:0/3938356358 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd9a0064ee0 0x7fd9a0067390 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:15.346 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.341+0000 7fd9c4999700 1 --2- 172.21.15.39:0/3938356358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9c0069d60 0x7fd9c00c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:15.346 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.341+0000 7fd9c4999700 1 -- 172.21.15.39:0/3938356358 >> 172.21.15.39:0/3938356358 conn(0x7fd9c00cf350 msgr2=0x7fd9c00b38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:15.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.341+0000 7fd9c4999700 1 -- 172.21.15.39:0/3938356358 shutdown_connections 2023-11-28T12:00:15.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.341+0000 7fd9c4999700 1 -- 172.21.15.39:0/3938356358 wait complete. 2023-11-28T12:00:15.348 INFO:teuthology.orchestra.run.smithi039.stderr:instructed osd(s) 1 to deep-scrub 2023-11-28T12:00:15.368 INFO:tasks.ceph:Scrubbing osd.2 2023-11-28T12:00:15.368 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-28T12:00:15.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.545+0000 7f20ed485700 1 Processor -- start 2023-11-28T12:00:15.552 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.545+0000 7f20ed485700 1 -- start start 2023-11-28T12:00:15.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.549+0000 7f20ed485700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f20e80cb640 0x7f20e80ad6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:15.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.549+0000 7f20ed485700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20e80ab510 0x7f20e80ab9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:15.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.549+0000 7f20ed485700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e80c9460 con 0x7f20e8159150 2023-11-28T12:00:15.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.549+0000 7f20ed485700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20e80c8c00 con 0x7f20e80cb640 2023-11-28T12:00:15.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.549+0000 7f20ed485700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e80adc00 con 0x7f20e80ab510 2023-11-28T12:00:15.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.549+0000 7f20e7fff700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f20e8159150 0x7f20e80caf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56090/0 (socket says 172.21.15.39:56090) 2023-11-28T12:00:15.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.549+0000 7f20e7fff700 1 -- 172.21.15.39:0/232479507 learned_addr learned my addr 172.21.15.39:0/232479507 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T12:00:15.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.549+0000 7f20ecc84700 1 --2- 172.21.15.39:0/232479507 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20e80ab510 0x7f20e80ab9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:15.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.549+0000 7f20df7fe700 1 --2- 172.21.15.39:0/232479507 >> v2:172.21.15.184:3300/0 conn(0x7f20e80cb640 0x7f20e80ad6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:15.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.549+0000 7f20e77fe700 1 -- 172.21.15.39:0/232479507 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1986218771 0 0) 0x7f20e80c9460 con 0x7f20e8159150 2023-11-28T12:00:15.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.549+0000 7f20e77fe700 1 -- 172.21.15.39:0/232479507 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20d40035d0 con 0x7f20e8159150 2023-11-28T12:00:15.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.549+0000 7f20ecc84700 1 -- 172.21.15.39:0/232479507 >> v2:172.21.15.184:3300/0 conn(0x7f20e80cb640 msgr2=0x7f20e80ad6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:15.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.549+0000 7f20ecc84700 1 --2- 172.21.15.39:0/232479507 >> v2:172.21.15.184:3300/0 conn(0x7f20e80cb640 0x7f20e80ad6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:15.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.549+0000 7f20ecc84700 1 -- 172.21.15.39:0/232479507 >> v1:172.21.15.39:6789/0 conn(0x7f20e8159150 legacy=0x7f20e80caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:15.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.549+0000 7f20ecc84700 1 -- 172.21.15.39:0/232479507 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e806a9c0 con 0x7f20e80ab510 2023-11-28T12:00:15.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.549+0000 7f20ecc84700 1 --2- 172.21.15.39:0/232479507 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20e80ab510 0x7f20e80ab9b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f20e0009d90 tx=0x7f20e000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40a5def011088a49 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:15.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.549+0000 7f20e77fe700 1 -- 172.21.15.39:0/232479507 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e000bd20 con 0x7f20e80ab510 2023-11-28T12:00:15.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.549+0000 7f20e77fe700 1 -- 172.21.15.39:0/232479507 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e000be80 con 0x7f20e80ab510 2023-11-28T12:00:15.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.549+0000 7f20e77fe700 1 -- 172.21.15.39:0/232479507 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e00116a0 con 0x7f20e80ab510 2023-11-28T12:00:15.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.549+0000 7f20ed485700 1 -- 172.21.15.39:0/232479507 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20e80ab510 msgr2=0x7f20e80ab9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:15.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.549+0000 7f20ed485700 1 --2- 172.21.15.39:0/232479507 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20e80ab510 0x7f20e80ab9b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f20e0009d90 tx=0x7f20e000b330 comp rx=0 tx=0).stop 2023-11-28T12:00:15.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.553+0000 7f20ed485700 1 -- 172.21.15.39:0/232479507 shutdown_connections 2023-11-28T12:00:15.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.553+0000 7f20ed485700 1 --2- 172.21.15.39:0/232479507 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20e80ab510 0x7f20e80ab9b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:15.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.553+0000 7f20ed485700 1 --2- 172.21.15.39:0/232479507 >> v2:172.21.15.184:3300/0 conn(0x7f20e80cb640 0x7f20e80ad6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:15.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.553+0000 7f20ed485700 1 -- 172.21.15.39:0/232479507 >> 172.21.15.39:0/232479507 conn(0x7f20e80ce5b0 msgr2=0x7f20e80ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:15.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.553+0000 7f20ed485700 1 -- 172.21.15.39:0/232479507 shutdown_connections 2023-11-28T12:00:15.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.553+0000 7f20ed485700 1 -- 172.21.15.39:0/232479507 wait complete. 2023-11-28T12:00:15.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.553+0000 7f20ed485700 1 Processor -- start 2023-11-28T12:00:15.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.553+0000 7f20ed485700 1 -- start start 2023-11-28T12:00:15.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.557+0000 7f20ed485700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20e80ab510 0x7f20e80c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:15.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.557+0000 7f20ed485700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20e80cb640 0x7f20e8070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:15.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.557+0000 7f20ed485700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20e8159150 0x7f20e80c7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:15.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.557+0000 7f20ed485700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e80c8990 con 0x7f20e80cb640 2023-11-28T12:00:15.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.557+0000 7f20ed485700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e80c7e10 con 0x7f20e80ab510 2023-11-28T12:00:15.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.557+0000 7f20ed485700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e80c80f0 con 0x7f20e8159150 2023-11-28T12:00:15.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.557+0000 7f20df7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20e80cb640 0x7f20e8070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:15.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.557+0000 7f20df7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20e80cb640 0x7f20e8070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40714/0 (socket says 172.21.15.39:40714) 2023-11-28T12:00:15.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.557+0000 7f20df7fe700 1 -- 172.21.15.39:0/551571632 learned_addr learned my addr 172.21.15.39:0/551571632 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:15.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.557+0000 7f20e7fff700 1 --2- 172.21.15.39:0/551571632 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20e80ab510 0x7f20e80c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:15.568 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.557+0000 7f20ecc84700 1 --2- 172.21.15.39:0/551571632 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20e8159150 0x7f20e80c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:15.568 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.557+0000 7f20df7fe700 1 -- 172.21.15.39:0/551571632 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20e8159150 msgr2=0x7f20e80c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:15.569 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.557+0000 7f20df7fe700 1 --2- 172.21.15.39:0/551571632 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20e8159150 0x7f20e80c7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:15.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.557+0000 7f20df7fe700 1 -- 172.21.15.39:0/551571632 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20e80ab510 msgr2=0x7f20e80c5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:15.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.557+0000 7f20df7fe700 1 --2- 172.21.15.39:0/551571632 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20e80ab510 0x7f20e80c5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:15.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.557+0000 7f20df7fe700 1 -- 172.21.15.39:0/551571632 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e0009a70 con 0x7f20e80cb640 2023-11-28T12:00:15.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.557+0000 7f20df7fe700 1 --2- 172.21.15.39:0/551571632 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20e80cb640 0x7f20e8070260 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f20d000e9a0 tx=0x7f20d000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:15.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.557+0000 7f20e57fa700 1 -- 172.21.15.39:0/551571632 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d0009720 con 0x7f20e80cb640 2023-11-28T12:00:15.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.557+0000 7f20e57fa700 1 -- 172.21.15.39:0/551571632 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d000c690 con 0x7f20e80cb640 2023-11-28T12:00:15.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.557+0000 7f20e57fa700 1 -- 172.21.15.39:0/551571632 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d000ca20 con 0x7f20e80cb640 2023-11-28T12:00:15.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.557+0000 7f20ed485700 1 -- 172.21.15.39:0/551571632 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e80c90f0 con 0x7f20e80cb640 2023-11-28T12:00:15.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.557+0000 7f20ed485700 1 -- 172.21.15.39:0/551571632 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20e80c8e10 con 0x7f20e80cb640 2023-11-28T12:00:15.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.561+0000 7f20ed485700 1 -- 172.21.15.39:0/551571632 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f20e806b5e0 con 0x7f20e80cb640 2023-11-28T12:00:15.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.561+0000 7f20e57fa700 1 -- 172.21.15.39:0/551571632 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f20d0019030 con 0x7f20e80cb640 2023-11-28T12:00:15.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.561+0000 7f20e57fa700 1 --2- 172.21.15.39:0/551571632 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f20c8064ee0 0x7f20c8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:15.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.565+0000 7f20e57fa700 1 -- 172.21.15.39:0/551571632 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f20d0081c20 con 0x7f20e80cb640 2023-11-28T12:00:15.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.565+0000 7f20e57fa700 1 --2- 172.21.15.39:0/551571632 >> [v2:172.21.15.39:6808/36183,v1:172.21.15.39:6810/36183] conn(0x7f20c806b7f0 0x7f20c806dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:15.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.565+0000 7f20e57fa700 1 -- 172.21.15.39:0/551571632 --> [v2:172.21.15.39:6808/36183,v1:172.21.15.39:6810/36183] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f20c806e2f0 con 0x7f20c806b7f0 2023-11-28T12:00:15.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.565+0000 7f20e7fff700 1 --2- 172.21.15.39:0/551571632 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f20c8064ee0 0x7f20c8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:15.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.565+0000 7f20e57fa700 1 -- 172.21.15.39:0/551571632 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f20d0086220 con 0x7f20e80cb640 2023-11-28T12:00:15.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.565+0000 7f20ecc84700 1 --2- 172.21.15.39:0/551571632 >> [v2:172.21.15.39:6808/36183,v1:172.21.15.39:6810/36183] conn(0x7f20c806b7f0 0x7f20c806dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:15.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.565+0000 7f20e7fff700 1 --2- 172.21.15.39:0/551571632 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f20c8064ee0 0x7f20c8067390 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f20d80010e0 tx=0x7f20d8007c90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:15.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.565+0000 7f20ecc84700 1 --2- 172.21.15.39:0/551571632 >> [v2:172.21.15.39:6808/36183,v1:172.21.15.39:6810/36183] conn(0x7f20c806b7f0 0x7f20c806dc20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:15.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.565+0000 7f20e57fa700 1 -- 172.21.15.39:0/551571632 <== osd.2 v2:172.21.15.39:6808/36183 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f20c806e2f0 con 0x7f20c806b7f0 2023-11-28T12:00:15.590 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.585+0000 7f20ed485700 1 -- 172.21.15.39:0/551571632 --> [v2:172.21.15.39:6808/36183,v1:172.21.15.39:6810/36183] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f20e8069bf0 con 0x7f20c806b7f0 2023-11-28T12:00:15.591 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.585+0000 7f20e57fa700 1 -- 172.21.15.39:0/551571632 <== osd.2 v2:172.21.15.39:6808/36183 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f20e8069bf0 con 0x7f20c806b7f0 2023-11-28T12:00:15.591 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2023-11-28T12:00:15.591 INFO:teuthology.orchestra.run.smithi039.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-28T12:00:15.592 INFO:teuthology.orchestra.run.smithi039.stdout:} 2023-11-28T12:00:15.593 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.585+0000 7f20ed485700 1 -- 172.21.15.39:0/551571632 >> [v2:172.21.15.39:6808/36183,v1:172.21.15.39:6810/36183] conn(0x7f20c806b7f0 msgr2=0x7f20c806dc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:15.593 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.585+0000 7f20ed485700 1 --2- 172.21.15.39:0/551571632 >> [v2:172.21.15.39:6808/36183,v1:172.21.15.39:6810/36183] conn(0x7f20c806b7f0 0x7f20c806dc20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:15.593 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.585+0000 7f20ed485700 1 -- 172.21.15.39:0/551571632 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f20c8064ee0 msgr2=0x7f20c8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:15.593 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.585+0000 7f20ed485700 1 --2- 172.21.15.39:0/551571632 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f20c8064ee0 0x7f20c8067390 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f20d80010e0 tx=0x7f20d8007c90 comp rx=0 tx=0).stop 2023-11-28T12:00:15.593 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.585+0000 7f20ed485700 1 -- 172.21.15.39:0/551571632 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20e80cb640 msgr2=0x7f20e8070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:15.593 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.585+0000 7f20ed485700 1 --2- 172.21.15.39:0/551571632 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20e80cb640 0x7f20e8070260 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f20d000e9a0 tx=0x7f20d000ecb0 comp rx=0 tx=0).stop 2023-11-28T12:00:15.593 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.585+0000 7f20ecc84700 1 -- 172.21.15.39:0/551571632 reap_dead start 2023-11-28T12:00:15.594 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.589+0000 7f20ed485700 1 -- 172.21.15.39:0/551571632 shutdown_connections 2023-11-28T12:00:15.594 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.589+0000 7f20ed485700 1 -- 172.21.15.39:0/551571632 >> 172.21.15.39:0/551571632 conn(0x7f20e80ce5b0 msgr2=0x7f20e806ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:15.594 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.589+0000 7f20ed485700 1 -- 172.21.15.39:0/551571632 shutdown_connections 2023-11-28T12:00:15.594 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.589+0000 7f20ed485700 1 -- 172.21.15.39:0/551571632 wait complete. 2023-11-28T12:00:15.615 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-28T12:00:15.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.801+0000 7f2813ecf700 1 Processor -- start 2023-11-28T12:00:15.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.801+0000 7f2813ecf700 1 -- start start 2023-11-28T12:00:15.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.805+0000 7f2813ecf700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f280c163cb0 0x7f280c164cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:15.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.805+0000 7f2813ecf700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f280c0cdfb0 0x7f280c06cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:15.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.805+0000 7f2813ecf700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f280c164080 con 0x7f280c06d2f0 2023-11-28T12:00:15.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.805+0000 7f2813ecf700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f280c0cc290 con 0x7f280c163cb0 2023-11-28T12:00:15.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.805+0000 7f2813ecf700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f280c06d770 con 0x7f280c0cdfb0 2023-11-28T12:00:15.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.805+0000 7f2811c6b700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f280c163cb0 0x7f280c164cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:15.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.805+0000 7f2811c6b700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f280c163cb0 0x7f280c164cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40720/0 (socket says 172.21.15.39:40720) 2023-11-28T12:00:15.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.805+0000 7f2811c6b700 1 -- 172.21.15.39:0/702747126 learned_addr learned my addr 172.21.15.39:0/702747126 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:15.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.805+0000 7f281146a700 1 --2- 172.21.15.39:0/702747126 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f280c0cdfb0 0x7f280c06cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:15.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.805+0000 7f2810c69700 1 -- 172.21.15.39:0/702747126 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2523955099 0 0) 0x7f280c164080 con 0x7f280c06d2f0 2023-11-28T12:00:15.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.805+0000 7f2810c69700 1 -- 172.21.15.39:0/702747126 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27f80035d0 con 0x7f280c06d2f0 2023-11-28T12:00:15.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.805+0000 7f2811c6b700 1 -- 172.21.15.39:0/702747126 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f280c0cdfb0 msgr2=0x7f280c06cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:15.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.805+0000 7f2811c6b700 1 --2- 172.21.15.39:0/702747126 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f280c0cdfb0 0x7f280c06cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:15.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.805+0000 7f2811c6b700 1 -- 172.21.15.39:0/702747126 >> v1:172.21.15.39:6789/0 conn(0x7f280c06d2f0 legacy=0x7f280c06bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:15.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.805+0000 7f2811c6b700 1 -- 172.21.15.39:0/702747126 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280c069bf0 con 0x7f280c163cb0 2023-11-28T12:00:15.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.805+0000 7f2811c6b700 1 --2- 172.21.15.39:0/702747126 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f280c163cb0 0x7f280c164cb0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f2808009910 tx=0x7f2808009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edc8af496db90dca server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:15.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.805+0000 7f2810c69700 1 -- 172.21.15.39:0/702747126 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2808011830 con 0x7f280c163cb0 2023-11-28T12:00:15.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.805+0000 7f2810c69700 1 -- 172.21.15.39:0/702747126 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2808011990 con 0x7f280c163cb0 2023-11-28T12:00:15.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.805+0000 7f2810c69700 1 -- 172.21.15.39:0/702747126 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2808011d40 con 0x7f280c163cb0 2023-11-28T12:00:15.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.805+0000 7f2813ecf700 1 -- 172.21.15.39:0/702747126 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f280c163cb0 msgr2=0x7f280c164cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:15.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.805+0000 7f2813ecf700 1 --2- 172.21.15.39:0/702747126 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f280c163cb0 0x7f280c164cb0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f2808009910 tx=0x7f2808009c20 comp rx=0 tx=0).stop 2023-11-28T12:00:15.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.805+0000 7f2813ecf700 1 -- 172.21.15.39:0/702747126 shutdown_connections 2023-11-28T12:00:15.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.809+0000 7f2813ecf700 1 --2- 172.21.15.39:0/702747126 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f280c0cdfb0 0x7f280c06cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:15.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.809+0000 7f2813ecf700 1 --2- 172.21.15.39:0/702747126 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f280c163cb0 0x7f280c164cb0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:15.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.809+0000 7f2813ecf700 1 -- 172.21.15.39:0/702747126 >> 172.21.15.39:0/702747126 conn(0x7f280c0cf350 msgr2=0x7f280c0b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:15.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.809+0000 7f2813ecf700 1 -- 172.21.15.39:0/702747126 shutdown_connections 2023-11-28T12:00:15.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.809+0000 7f2813ecf700 1 -- 172.21.15.39:0/702747126 wait complete. 2023-11-28T12:00:15.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.809+0000 7f2813ecf700 1 Processor -- start 2023-11-28T12:00:15.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.809+0000 7f2813ecf700 1 -- start start 2023-11-28T12:00:15.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.813+0000 7f2813ecf700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f280c06d2f0 0x7f280c15c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:15.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.813+0000 7f2813ecf700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f280c0cdfb0 0x7f280c0c36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:15.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.813+0000 7f2813ecf700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f280c163cb0 0x7f280c0b3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:15.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.813+0000 7f2813ecf700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280c15c590 con 0x7f280c0cdfb0 2023-11-28T12:00:15.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.813+0000 7f2813ecf700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280c0c5990 con 0x7f280c06d2f0 2023-11-28T12:00:15.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.813+0000 7f2813ecf700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f280c0b1a00 con 0x7f280c163cb0 2023-11-28T12:00:15.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.813+0000 7f281146a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f280c0cdfb0 0x7f280c0c36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:15.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.813+0000 7f281146a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f280c0cdfb0 0x7f280c0c36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40724/0 (socket says 172.21.15.39:40724) 2023-11-28T12:00:15.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.813+0000 7f281146a700 1 -- 172.21.15.39:0/1268495457 learned_addr learned my addr 172.21.15.39:0/1268495457 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:15.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.813+0000 7f2811c6b700 1 --2- 172.21.15.39:0/1268495457 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f280c06d2f0 0x7f280c15c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:15.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.813+0000 7f281246c700 1 --2- 172.21.15.39:0/1268495457 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f280c163cb0 0x7f280c0b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:15.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.813+0000 7f281146a700 1 -- 172.21.15.39:0/1268495457 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f280c163cb0 msgr2=0x7f280c0b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:15.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.813+0000 7f281146a700 1 --2- 172.21.15.39:0/1268495457 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f280c163cb0 0x7f280c0b3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:15.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.813+0000 7f281146a700 1 -- 172.21.15.39:0/1268495457 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f280c06d2f0 msgr2=0x7f280c15c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:15.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.813+0000 7f281146a700 1 --2- 172.21.15.39:0/1268495457 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f280c06d2f0 0x7f280c15c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:15.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.813+0000 7f281146a700 1 -- 172.21.15.39:0/1268495457 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2808009570 con 0x7f280c0cdfb0 2023-11-28T12:00:15.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.813+0000 7f281246c700 1 --2- 172.21.15.39:0/1268495457 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f280c163cb0 0x7f280c0b3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:00:15.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.813+0000 7f281146a700 1 --2- 172.21.15.39:0/1268495457 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f280c0cdfb0 0x7f280c0c36f0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f27fc00e9d0 tx=0x7f27fc00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:15.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.813+0000 7f28027fc700 1 -- 172.21.15.39:0/1268495457 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc009720 con 0x7f280c0cdfb0 2023-11-28T12:00:15.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.813+0000 7f2813ecf700 1 -- 172.21.15.39:0/1268495457 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f280c0cc4a0 con 0x7f280c0cdfb0 2023-11-28T12:00:15.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.813+0000 7f28027fc700 1 -- 172.21.15.39:0/1268495457 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27fc00c850 con 0x7f280c0cdfb0 2023-11-28T12:00:15.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.813+0000 7f28027fc700 1 -- 172.21.15.39:0/1268495457 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc00cbc0 con 0x7f280c0cdfb0 2023-11-28T12:00:15.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.813+0000 7f2813ecf700 1 -- 172.21.15.39:0/1268495457 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f280c1651f0 con 0x7f280c0cdfb0 2023-11-28T12:00:15.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.817+0000 7f2813ecf700 1 -- 172.21.15.39:0/1268495457 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f280c0cc780 con 0x7f280c0cdfb0 2023-11-28T12:00:15.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.817+0000 7f28027fc700 1 -- 172.21.15.39:0/1268495457 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f27fc019030 con 0x7f280c0cdfb0 2023-11-28T12:00:15.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.817+0000 7f28027fc700 1 --2- 172.21.15.39:0/1268495457 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f27f0064ee0 0x7f27f0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:15.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.817+0000 7f28027fc700 1 -- 172.21.15.39:0/1268495457 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f27fc081e00 con 0x7f280c0cdfb0 2023-11-28T12:00:15.824 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.817+0000 7f2811c6b700 1 --2- 172.21.15.39:0/1268495457 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f27f0064ee0 0x7f27f0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:15.825 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.821+0000 7f2811c6b700 1 --2- 172.21.15.39:0/1268495457 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f27f0064ee0 0x7f27f0067390 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2808000c00 tx=0x7f2808008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:15.830 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:15.825+0000 7f28027fc700 1 -- 172.21.15.39:0/1268495457 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f27fc050010 con 0x7f280c0cdfb0 2023-11-28T12:00:16.005 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.001+0000 7f2813ecf700 1 -- 172.21.15.39:0/1268495457 --> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f280c0b1b70 con 0x7f27f0064ee0 2023-11-28T12:00:16.006 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.001+0000 7f28027fc700 1 -- 172.21.15.39:0/1268495457 <== mgr.4104 v2:172.21.15.184:6832/36166 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f280c0b1b70 con 0x7f27f0064ee0 2023-11-28T12:00:16.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.005+0000 7f2813ecf700 1 -- 172.21.15.39:0/1268495457 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f27f0064ee0 msgr2=0x7f27f0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:16.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.005+0000 7f2813ecf700 1 --2- 172.21.15.39:0/1268495457 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f27f0064ee0 0x7f27f0067390 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2808000c00 tx=0x7f2808008030 comp rx=0 tx=0).stop 2023-11-28T12:00:16.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.005+0000 7f2813ecf700 1 -- 172.21.15.39:0/1268495457 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f280c0cdfb0 msgr2=0x7f280c0c36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:16.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.005+0000 7f2813ecf700 1 --2- 172.21.15.39:0/1268495457 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f280c0cdfb0 0x7f280c0c36f0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f27fc00e9d0 tx=0x7f27fc00ed90 comp rx=0 tx=0).stop 2023-11-28T12:00:16.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.005+0000 7f2813ecf700 1 -- 172.21.15.39:0/1268495457 shutdown_connections 2023-11-28T12:00:16.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.005+0000 7f2813ecf700 1 --2- 172.21.15.39:0/1268495457 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f280c163cb0 0x7f280c0b3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:16.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.005+0000 7f2813ecf700 1 --2- 172.21.15.39:0/1268495457 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f280c0cdfb0 0x7f280c0c36f0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:16.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.005+0000 7f2813ecf700 1 --2- 172.21.15.39:0/1268495457 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f27f0064ee0 0x7f27f0067390 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:16.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.005+0000 7f2813ecf700 1 --2- 172.21.15.39:0/1268495457 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f280c06d2f0 0x7f280c15c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:16.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.005+0000 7f2813ecf700 1 -- 172.21.15.39:0/1268495457 >> 172.21.15.39:0/1268495457 conn(0x7f280c0cf350 msgr2=0x7f280c070030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:16.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.005+0000 7f2813ecf700 1 -- 172.21.15.39:0/1268495457 shutdown_connections 2023-11-28T12:00:16.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.005+0000 7f2813ecf700 1 -- 172.21.15.39:0/1268495457 wait complete. 2023-11-28T12:00:16.014 INFO:teuthology.orchestra.run.smithi039.stderr:instructed osd(s) 2 to deep-scrub 2023-11-28T12:00:16.033 INFO:tasks.ceph:Scrubbing osd.3 2023-11-28T12:00:16.034 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-28T12:00:16.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.213+0000 7f792d101700 1 Processor -- start 2023-11-28T12:00:16.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.213+0000 7f792d101700 1 -- start start 2023-11-28T12:00:16.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.217+0000 7f792d101700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f792806a380 0x7f79280b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:16.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.217+0000 7f792d101700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79280cb0b0 0x7f79280cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:16.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.217+0000 7f792d101700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7928070490 con 0x7f792814a370 2023-11-28T12:00:16.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.217+0000 7f792d101700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79280cba70 con 0x7f792806a380 2023-11-28T12:00:16.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.217+0000 7f792d101700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792814a740 con 0x7f79280cb0b0 2023-11-28T12:00:16.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.217+0000 7f792659c700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f792806a380 0x7f79280b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:16.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.217+0000 7f792659c700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f792806a380 0x7f79280b2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40728/0 (socket says 172.21.15.39:40728) 2023-11-28T12:00:16.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.217+0000 7f792659c700 1 -- 172.21.15.39:0/4246915621 learned_addr learned my addr 172.21.15.39:0/4246915621 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:16.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.217+0000 7f7926d9d700 1 --1- 172.21.15.39:0/4246915621 >> v1:172.21.15.39:6789/0 conn(0x7f792814a370 0x7f7928164370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56108/0 (socket says 172.21.15.39:56108) 2023-11-28T12:00:16.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.217+0000 7f792759e700 1 --2- 172.21.15.39:0/4246915621 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79280cb0b0 0x7f79280cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:16.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.217+0000 7f792659c700 1 -- 172.21.15.39:0/4246915621 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79280cb0b0 msgr2=0x7f79280cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:16.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.217+0000 7f792659c700 1 --2- 172.21.15.39:0/4246915621 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79280cb0b0 0x7f79280cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:16.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.217+0000 7f792659c700 1 -- 172.21.15.39:0/4246915621 >> v1:172.21.15.39:6789/0 conn(0x7f792814a370 legacy=0x7f7928164370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:16.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.217+0000 7f792659c700 1 -- 172.21.15.39:0/4246915621 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7928070160 con 0x7f792806a380 2023-11-28T12:00:16.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.217+0000 7f792659c700 1 --2- 172.21.15.39:0/4246915621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f792806a380 0x7f79280b2060 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f791c009910 tx=0x7f791c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acc17543eef0700d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:16.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.217+0000 7f7925d9b700 1 -- 172.21.15.39:0/4246915621 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c00ba60 con 0x7f792806a380 2023-11-28T12:00:16.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.217+0000 7f7925d9b700 1 -- 172.21.15.39:0/4246915621 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791c00bbc0 con 0x7f792806a380 2023-11-28T12:00:16.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.217+0000 7f7925d9b700 1 -- 172.21.15.39:0/4246915621 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c009e60 con 0x7f792806a380 2023-11-28T12:00:16.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.217+0000 7f792d101700 1 -- 172.21.15.39:0/4246915621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f792806a380 msgr2=0x7f79280b2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:16.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.217+0000 7f792d101700 1 --2- 172.21.15.39:0/4246915621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f792806a380 0x7f79280b2060 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f791c009910 tx=0x7f791c009c20 comp rx=0 tx=0).stop 2023-11-28T12:00:16.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.221+0000 7f792d101700 1 -- 172.21.15.39:0/4246915621 shutdown_connections 2023-11-28T12:00:16.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.221+0000 7f792d101700 1 --2- 172.21.15.39:0/4246915621 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79280cb0b0 0x7f79280cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:16.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.221+0000 7f792d101700 1 --2- 172.21.15.39:0/4246915621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f792806a380 0x7f79280b2060 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:16.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.221+0000 7f792d101700 1 -- 172.21.15.39:0/4246915621 >> 172.21.15.39:0/4246915621 conn(0x7f792806bfc0 msgr2=0x7f792806c390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:16.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.221+0000 7f792d101700 1 -- 172.21.15.39:0/4246915621 shutdown_connections 2023-11-28T12:00:16.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.221+0000 7f792d101700 1 -- 172.21.15.39:0/4246915621 wait complete. 2023-11-28T12:00:16.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.225+0000 7f792d101700 1 Processor -- start 2023-11-28T12:00:16.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.225+0000 7f792d101700 1 -- start start 2023-11-28T12:00:16.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.225+0000 7f792d101700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f792806a380 0x7f7928148ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:16.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.225+0000 7f792d101700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79280cb0b0 0x7f7928134c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:16.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.225+0000 7f792d101700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f792814a370 0x7f79280c3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:16.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.225+0000 7f792d101700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7928131770 con 0x7f792814a370 2023-11-28T12:00:16.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.225+0000 7f792d101700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79281319c0 con 0x7f79280cb0b0 2023-11-28T12:00:16.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.225+0000 7f792d101700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7928131ca0 con 0x7f792806a380 2023-11-28T12:00:16.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.225+0000 7f792759e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f792814a370 0x7f79280c3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:16.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.225+0000 7f792759e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f792814a370 0x7f79280c3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40734/0 (socket says 172.21.15.39:40734) 2023-11-28T12:00:16.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.225+0000 7f7926d9d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f792806a380 0x7f7928148ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:16.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.225+0000 7f792759e700 1 -- 172.21.15.39:0/2353603523 learned_addr learned my addr 172.21.15.39:0/2353603523 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:16.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.225+0000 7f792659c700 1 --2- 172.21.15.39:0/2353603523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79280cb0b0 0x7f7928134c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:16.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.225+0000 7f792759e700 1 -- 172.21.15.39:0/2353603523 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f792806a380 msgr2=0x7f7928148ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:16.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.225+0000 7f792759e700 1 --2- 172.21.15.39:0/2353603523 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f792806a380 0x7f7928148ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:16.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.225+0000 7f792759e700 1 -- 172.21.15.39:0/2353603523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79280cb0b0 msgr2=0x7f7928134c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:16.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.225+0000 7f792759e700 1 --2- 172.21.15.39:0/2353603523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79280cb0b0 0x7f7928134c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:16.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.225+0000 7f792759e700 1 -- 172.21.15.39:0/2353603523 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f791c009570 con 0x7f792814a370 2023-11-28T12:00:16.234 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.229+0000 7f792759e700 1 --2- 172.21.15.39:0/2353603523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f792814a370 0x7f79280c3650 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f7920007e60 tx=0x7f792000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:16.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.229+0000 7f790f7fe700 1 -- 172.21.15.39:0/2353603523 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792000ed30 con 0x7f792814a370 2023-11-28T12:00:16.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.229+0000 7f790f7fe700 1 -- 172.21.15.39:0/2353603523 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7920014420 con 0x7f792814a370 2023-11-28T12:00:16.236 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.229+0000 7f792d101700 1 -- 172.21.15.39:0/2353603523 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7928164ea0 con 0x7f792814a370 2023-11-28T12:00:16.236 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.229+0000 7f790f7fe700 1 -- 172.21.15.39:0/2353603523 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79200147d0 con 0x7f792814a370 2023-11-28T12:00:16.236 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.229+0000 7f792d101700 1 -- 172.21.15.39:0/2353603523 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7928164bc0 con 0x7f792814a370 2023-11-28T12:00:16.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.229+0000 7f792d101700 1 -- 172.21.15.39:0/2353603523 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7928165180 con 0x7f792814a370 2023-11-28T12:00:16.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.229+0000 7f790f7fe700 1 -- 172.21.15.39:0/2353603523 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7920012050 con 0x7f792814a370 2023-11-28T12:00:16.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.233+0000 7f790f7fe700 1 --2- 172.21.15.39:0/2353603523 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7914064ee0 0x7f7914067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:16.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.233+0000 7f790f7fe700 1 -- 172.21.15.39:0/2353603523 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f7920082250 con 0x7f792814a370 2023-11-28T12:00:16.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.233+0000 7f790f7fe700 1 --2- 172.21.15.39:0/2353603523 >> [v2:172.21.15.39:6809/36181,v1:172.21.15.39:6811/36181] conn(0x7f791406b7f0 0x7f791406dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:16.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.233+0000 7f790f7fe700 1 -- 172.21.15.39:0/2353603523 --> [v2:172.21.15.39:6809/36181,v1:172.21.15.39:6811/36181] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f791406e2f0 con 0x7f791406b7f0 2023-11-28T12:00:16.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.233+0000 7f7926d9d700 1 --2- 172.21.15.39:0/2353603523 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7914064ee0 0x7f7914067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:16.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.233+0000 7f790f7fe700 1 -- 172.21.15.39:0/2353603523 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7920084830 con 0x7f792814a370 2023-11-28T12:00:16.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.233+0000 7f792659c700 1 --2- 172.21.15.39:0/2353603523 >> [v2:172.21.15.39:6809/36181,v1:172.21.15.39:6811/36181] conn(0x7f791406b7f0 0x7f791406dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:16.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.233+0000 7f7926d9d700 1 --2- 172.21.15.39:0/2353603523 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7914064ee0 0x7f7914067390 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7918000f60 tx=0x7f7918007ef0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:16.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.233+0000 7f792659c700 1 --2- 172.21.15.39:0/2353603523 >> [v2:172.21.15.39:6809/36181,v1:172.21.15.39:6811/36181] conn(0x7f791406b7f0 0x7f791406dc20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:16.241 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.237+0000 7f790f7fe700 1 -- 172.21.15.39:0/2353603523 <== osd.3 v2:172.21.15.39:6809/36181 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f791406e2f0 con 0x7f791406b7f0 2023-11-28T12:00:16.258 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.253+0000 7f792d101700 1 -- 172.21.15.39:0/2353603523 --> [v2:172.21.15.39:6809/36181,v1:172.21.15.39:6811/36181] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f79280726c0 con 0x7f791406b7f0 2023-11-28T12:00:16.258 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.253+0000 7f790f7fe700 1 -- 172.21.15.39:0/2353603523 <== osd.3 v2:172.21.15.39:6809/36181 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f79280726c0 con 0x7f791406b7f0 2023-11-28T12:00:16.259 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2023-11-28T12:00:16.259 INFO:teuthology.orchestra.run.smithi039.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-28T12:00:16.259 INFO:teuthology.orchestra.run.smithi039.stdout:} 2023-11-28T12:00:16.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.253+0000 7f792d101700 1 -- 172.21.15.39:0/2353603523 >> [v2:172.21.15.39:6809/36181,v1:172.21.15.39:6811/36181] conn(0x7f791406b7f0 msgr2=0x7f791406dc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:16.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.253+0000 7f792d101700 1 --2- 172.21.15.39:0/2353603523 >> [v2:172.21.15.39:6809/36181,v1:172.21.15.39:6811/36181] conn(0x7f791406b7f0 0x7f791406dc20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:16.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.253+0000 7f792d101700 1 -- 172.21.15.39:0/2353603523 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7914064ee0 msgr2=0x7f7914067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:16.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.253+0000 7f792d101700 1 --2- 172.21.15.39:0/2353603523 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f7914064ee0 0x7f7914067390 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7918000f60 tx=0x7f7918007ef0 comp rx=0 tx=0).stop 2023-11-28T12:00:16.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.253+0000 7f792d101700 1 -- 172.21.15.39:0/2353603523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f792814a370 msgr2=0x7f79280c3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:16.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.253+0000 7f792d101700 1 --2- 172.21.15.39:0/2353603523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f792814a370 0x7f79280c3650 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f7920007e60 tx=0x7f792000e3c0 comp rx=0 tx=0).stop 2023-11-28T12:00:16.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.253+0000 7f792759e700 1 -- 172.21.15.39:0/2353603523 reap_dead start 2023-11-28T12:00:16.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.253+0000 7f792d101700 1 -- 172.21.15.39:0/2353603523 shutdown_connections 2023-11-28T12:00:16.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.253+0000 7f792d101700 1 -- 172.21.15.39:0/2353603523 >> 172.21.15.39:0/2353603523 conn(0x7f792806bfc0 msgr2=0x7f79280cc690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:16.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.253+0000 7f792d101700 1 -- 172.21.15.39:0/2353603523 shutdown_connections 2023-11-28T12:00:16.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.253+0000 7f792d101700 1 -- 172.21.15.39:0/2353603523 wait complete. 2023-11-28T12:00:16.281 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-28T12:00:16.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.461+0000 7f2cdf59e700 1 Processor -- start 2023-11-28T12:00:16.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.461+0000 7f2cdf59e700 1 -- start start 2023-11-28T12:00:16.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.465+0000 7f2cdf59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ce015c640 0x7f2ce00d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:16.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.465+0000 7f2cdf59e700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f2ce0069e00 0x7f2ce006a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:16.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.465+0000 7f2cdf59e700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce006c600 con 0x7f2ce0071aa0 2023-11-28T12:00:16.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.465+0000 7f2cdf59e700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ce006cef0 con 0x7f2ce0069e00 2023-11-28T12:00:16.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.465+0000 7f2cdf59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce006a7c0 con 0x7f2ce015c640 2023-11-28T12:00:16.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.465+0000 7f2cded9d700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f2ce0069e00 0x7f2ce006a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:16.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.465+0000 7f2cde59c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ce015c640 0x7f2ce00d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:16.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.465+0000 7f2cde59c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ce015c640 0x7f2ce00d31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:39974/0 (socket says 172.21.15.39:39974) 2023-11-28T12:00:16.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.465+0000 7f2cde59c700 1 -- 172.21.15.39:0/3773772103 learned_addr learned my addr 172.21.15.39:0/3773772103 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:16.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.465+0000 7f2cddd9b700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f2ce0071aa0 0x7f2ce006d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56116/0 (socket says 172.21.15.39:56116) 2023-11-28T12:00:16.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.465+0000 7f2cde59c700 1 -- 172.21.15.39:0/3773772103 >> v2:172.21.15.39:3300/0 conn(0x7f2ce0069e00 msgr2=0x7f2ce006a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:16.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.465+0000 7f2cde59c700 1 --2- 172.21.15.39:0/3773772103 >> v2:172.21.15.39:3300/0 conn(0x7f2ce0069e00 0x7f2ce006a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:16.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.465+0000 7f2cde59c700 1 -- 172.21.15.39:0/3773772103 >> v1:172.21.15.39:6789/0 conn(0x7f2ce0071aa0 legacy=0x7f2ce006d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:16.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.465+0000 7f2cde59c700 1 -- 172.21.15.39:0/3773772103 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce00722f0 con 0x7f2ce015c640 2023-11-28T12:00:16.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.465+0000 7f2cded9d700 1 --2- 172.21.15.39:0/3773772103 >> v2:172.21.15.39:3300/0 conn(0x7f2ce0069e00 0x7f2ce006a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:00:16.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.465+0000 7f2cde59c700 1 --2- 172.21.15.39:0/3773772103 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ce015c640 0x7f2ce00d31e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0009910 tx=0x7f2cd0009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1678f097e213aca4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:16.473 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.465+0000 7f2cdd59a700 1 -- 172.21.15.39:0/3773772103 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd0011830 con 0x7f2ce015c640 2023-11-28T12:00:16.473 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.465+0000 7f2cdd59a700 1 -- 172.21.15.39:0/3773772103 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd0011990 con 0x7f2ce015c640 2023-11-28T12:00:16.473 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.465+0000 7f2cdd59a700 1 -- 172.21.15.39:0/3773772103 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd0011d40 con 0x7f2ce015c640 2023-11-28T12:00:16.473 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.469+0000 7f2cdf59e700 1 -- 172.21.15.39:0/3773772103 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ce015c640 msgr2=0x7f2ce00d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:16.473 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.469+0000 7f2cdf59e700 1 --2- 172.21.15.39:0/3773772103 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ce015c640 0x7f2ce00d31e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0009910 tx=0x7f2cd0009c20 comp rx=0 tx=0).stop 2023-11-28T12:00:16.475 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.469+0000 7f2cdf59e700 1 -- 172.21.15.39:0/3773772103 shutdown_connections 2023-11-28T12:00:16.475 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.469+0000 7f2cdf59e700 1 --2- 172.21.15.39:0/3773772103 >> v2:172.21.15.39:3300/0 conn(0x7f2ce0069e00 0x7f2ce006a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:16.475 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.469+0000 7f2cdf59e700 1 --2- 172.21.15.39:0/3773772103 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ce015c640 0x7f2ce00d31e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:16.475 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.469+0000 7f2cdf59e700 1 -- 172.21.15.39:0/3773772103 >> 172.21.15.39:0/3773772103 conn(0x7f2ce00b6520 msgr2=0x7f2ce0071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:16.475 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.469+0000 7f2cdf59e700 1 -- 172.21.15.39:0/3773772103 shutdown_connections 2023-11-28T12:00:16.476 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.469+0000 7f2cdf59e700 1 -- 172.21.15.39:0/3773772103 wait complete. 2023-11-28T12:00:16.477 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.473+0000 7f2cdf59e700 1 Processor -- start 2023-11-28T12:00:16.477 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.473+0000 7f2cdf59e700 1 -- start start 2023-11-28T12:00:16.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.473+0000 7f2cdf59e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ce0069e00 0x7f2ce009bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:16.480 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.473+0000 7f2cdf59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ce0071aa0 0x7f2ce00ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:16.480 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.473+0000 7f2cdf59e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ce015c640 0x7f2ce00cd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:16.480 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.473+0000 7f2cdf59e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce015e6a0 con 0x7f2ce015c640 2023-11-28T12:00:16.480 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.473+0000 7f2cdf59e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce015e980 con 0x7f2ce0069e00 2023-11-28T12:00:16.480 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.473+0000 7f2cdf59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce015ec60 con 0x7f2ce0071aa0 2023-11-28T12:00:16.480 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.473+0000 7f2cded9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ce015c640 0x7f2ce00cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:16.480 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.473+0000 7f2cded9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ce015c640 0x7f2ce00cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40748/0 (socket says 172.21.15.39:40748) 2023-11-28T12:00:16.481 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.473+0000 7f2cded9d700 1 -- 172.21.15.39:0/3148822159 learned_addr learned my addr 172.21.15.39:0/3148822159 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:16.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.473+0000 7f2cde59c700 1 --2- 172.21.15.39:0/3148822159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ce0069e00 0x7f2ce009bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:16.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.473+0000 7f2cddd9b700 1 --2- 172.21.15.39:0/3148822159 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ce0071aa0 0x7f2ce00ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:16.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.477+0000 7f2cded9d700 1 -- 172.21.15.39:0/3148822159 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ce0071aa0 msgr2=0x7f2ce00ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:16.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.477+0000 7f2cded9d700 1 --2- 172.21.15.39:0/3148822159 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ce0071aa0 0x7f2ce00ccde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:16.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.477+0000 7f2cded9d700 1 -- 172.21.15.39:0/3148822159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ce0069e00 msgr2=0x7f2ce009bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:16.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.477+0000 7f2cded9d700 1 --2- 172.21.15.39:0/3148822159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ce0069e00 0x7f2ce009bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:16.483 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.477+0000 7f2cded9d700 1 -- 172.21.15.39:0/3148822159 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd8009a70 con 0x7f2ce015c640 2023-11-28T12:00:16.483 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.477+0000 7f2cded9d700 1 --2- 172.21.15.39:0/3148822159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ce015c640 0x7f2ce00cd320 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f2cd800efc0 tx=0x7f2cd800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:16.483 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.477+0000 7f2cceffd700 1 -- 172.21.15.39:0/3148822159 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd800ca90 con 0x7f2ce015c640 2023-11-28T12:00:16.483 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.477+0000 7f2cceffd700 1 -- 172.21.15.39:0/3148822159 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd800f040 con 0x7f2ce015c640 2023-11-28T12:00:16.483 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.477+0000 7f2cdf59e700 1 -- 172.21.15.39:0/3148822159 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cd0009570 con 0x7f2ce015c640 2023-11-28T12:00:16.483 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.477+0000 7f2cceffd700 1 -- 172.21.15.39:0/3148822159 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd800ce30 con 0x7f2ce015c640 2023-11-28T12:00:16.483 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.477+0000 7f2cdf59e700 1 -- 172.21.15.39:0/3148822159 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce015ca10 con 0x7f2ce015c640 2023-11-28T12:00:16.484 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.477+0000 7f2cdf59e700 1 -- 172.21.15.39:0/3148822159 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ce006da20 con 0x7f2ce015c640 2023-11-28T12:00:16.484 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.481+0000 7f2cceffd700 1 -- 172.21.15.39:0/3148822159 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2cd8014480 con 0x7f2ce015c640 2023-11-28T12:00:16.485 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.481+0000 7f2cceffd700 1 --2- 172.21.15.39:0/3148822159 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2cc0064ee0 0x7f2cc0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:16.486 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.481+0000 7f2cceffd700 1 -- 172.21.15.39:0/3148822159 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f2cd8082530 con 0x7f2ce015c640 2023-11-28T12:00:16.486 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.481+0000 7f2cde59c700 1 --2- 172.21.15.39:0/3148822159 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2cc0064ee0 0x7f2cc0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:16.487 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.481+0000 7f2cde59c700 1 --2- 172.21.15.39:0/3148822159 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2cc0064ee0 0x7f2cc0067390 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0000c00 tx=0x7f2cd0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:16.492 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.485+0000 7f2cceffd700 1 -- 172.21.15.39:0/3148822159 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2cd8050760 con 0x7f2ce015c640 2023-11-28T12:00:16.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.661+0000 7f2cdf59e700 1 -- 172.21.15.39:0/3148822159 --> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ce0072010 con 0x7f2cc0064ee0 2023-11-28T12:00:16.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.661+0000 7f2cceffd700 1 -- 172.21.15.39:0/3148822159 <== mgr.4104 v2:172.21.15.184:6832/36166 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2ce0072010 con 0x7f2cc0064ee0 2023-11-28T12:00:16.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.665+0000 7f2cdf59e700 1 -- 172.21.15.39:0/3148822159 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2cc0064ee0 msgr2=0x7f2cc0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:16.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.665+0000 7f2cdf59e700 1 --2- 172.21.15.39:0/3148822159 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2cc0064ee0 0x7f2cc0067390 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0000c00 tx=0x7f2cd0008030 comp rx=0 tx=0).stop 2023-11-28T12:00:16.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.665+0000 7f2cdf59e700 1 -- 172.21.15.39:0/3148822159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ce015c640 msgr2=0x7f2ce00cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:16.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.665+0000 7f2cdf59e700 1 --2- 172.21.15.39:0/3148822159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ce015c640 0x7f2ce00cd320 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f2cd800efc0 tx=0x7f2cd800c3a0 comp rx=0 tx=0).stop 2023-11-28T12:00:16.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.665+0000 7f2cdf59e700 1 -- 172.21.15.39:0/3148822159 shutdown_connections 2023-11-28T12:00:16.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.665+0000 7f2cdf59e700 1 --2- 172.21.15.39:0/3148822159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ce015c640 0x7f2ce00cd320 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:16.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.665+0000 7f2cdf59e700 1 --2- 172.21.15.39:0/3148822159 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ce0071aa0 0x7f2ce00ccde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:16.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.665+0000 7f2cdf59e700 1 --2- 172.21.15.39:0/3148822159 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2cc0064ee0 0x7f2cc0067390 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:16.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.665+0000 7f2cdf59e700 1 --2- 172.21.15.39:0/3148822159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ce0069e00 0x7f2ce009bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:16.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.665+0000 7f2cdf59e700 1 -- 172.21.15.39:0/3148822159 >> 172.21.15.39:0/3148822159 conn(0x7f2ce00b6520 msgr2=0x7f2ce0071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:16.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.665+0000 7f2cdf59e700 1 -- 172.21.15.39:0/3148822159 shutdown_connections 2023-11-28T12:00:16.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.665+0000 7f2cdf59e700 1 -- 172.21.15.39:0/3148822159 wait complete. 2023-11-28T12:00:16.672 INFO:teuthology.orchestra.run.smithi039.stderr:instructed osd(s) 3 to deep-scrub 2023-11-28T12:00:16.694 INFO:tasks.ceph:Scrubbing osd.4 2023-11-28T12:00:16.694 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-28T12:00:16.886 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.881+0000 7fd12eba7700 1 Processor -- start 2023-11-28T12:00:16.886 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.881+0000 7fd12eba7700 1 -- start start 2023-11-28T12:00:16.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.885+0000 7fd12eba7700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd128142650 0x7fd128142fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:16.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.885+0000 7fd12eba7700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd12806b1c0 0x7fd1280b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:16.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.885+0000 7fd12eba7700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1280b63a0 con 0x7fd1280b5a00 2023-11-28T12:00:16.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.885+0000 7fd12eba7700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd12806b8d0 con 0x7fd128142650 2023-11-28T12:00:16.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.885+0000 7fd12eba7700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd12806bb70 con 0x7fd12806b1c0 2023-11-28T12:00:16.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.885+0000 7fd12c943700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd128142650 0x7fd128142fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:16.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.885+0000 7fd12c943700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd128142650 0x7fd128142fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40764/0 (socket says 172.21.15.39:40764) 2023-11-28T12:00:16.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.885+0000 7fd127fff700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fd1280b5a00 0x7fd12806aab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56130/0 (socket says 172.21.15.39:56130) 2023-11-28T12:00:16.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.885+0000 7fd12c943700 1 -- 172.21.15.39:0/4177498973 learned_addr learned my addr 172.21.15.39:0/4177498973 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:16.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.885+0000 7fd12d144700 1 --2- 172.21.15.39:0/4177498973 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd12806b1c0 0x7fd1280b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:16.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.885+0000 7fd12c943700 1 -- 172.21.15.39:0/4177498973 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd12806b1c0 msgr2=0x7fd1280b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:16.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.885+0000 7fd12c943700 1 --2- 172.21.15.39:0/4177498973 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd12806b1c0 0x7fd1280b5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:16.893 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.885+0000 7fd12c943700 1 -- 172.21.15.39:0/4177498973 >> v1:172.21.15.39:6789/0 conn(0x7fd1280b5a00 legacy=0x7fd12806aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:16.893 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.885+0000 7fd12c943700 1 -- 172.21.15.39:0/4177498973 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd12806be50 con 0x7fd128142650 2023-11-28T12:00:16.893 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.885+0000 7fd12c943700 1 --2- 172.21.15.39:0/4177498973 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd128142650 0x7fd128142fa0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fd11c009910 tx=0x7fd11c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3079f4be6b7eef97 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:16.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.889+0000 7fd1277fe700 1 -- 172.21.15.39:0/4177498973 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c00ba60 con 0x7fd128142650 2023-11-28T12:00:16.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.889+0000 7fd1277fe700 1 -- 172.21.15.39:0/4177498973 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11c00bbc0 con 0x7fd128142650 2023-11-28T12:00:16.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.889+0000 7fd1277fe700 1 -- 172.21.15.39:0/4177498973 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c009e60 con 0x7fd128142650 2023-11-28T12:00:16.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.889+0000 7fd12eba7700 1 -- 172.21.15.39:0/4177498973 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd128142650 msgr2=0x7fd128142fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:16.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.889+0000 7fd12eba7700 1 --2- 172.21.15.39:0/4177498973 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd128142650 0x7fd128142fa0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fd11c009910 tx=0x7fd11c009c20 comp rx=0 tx=0).stop 2023-11-28T12:00:16.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.889+0000 7fd12eba7700 1 -- 172.21.15.39:0/4177498973 shutdown_connections 2023-11-28T12:00:16.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.889+0000 7fd12eba7700 1 --2- 172.21.15.39:0/4177498973 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd12806b1c0 0x7fd1280b5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:16.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.889+0000 7fd12eba7700 1 --2- 172.21.15.39:0/4177498973 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd128142650 0x7fd128142fa0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:16.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.889+0000 7fd12eba7700 1 -- 172.21.15.39:0/4177498973 >> 172.21.15.39:0/4177498973 conn(0x7fd1280b5390 msgr2=0x7fd1280d2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:16.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.889+0000 7fd12eba7700 1 -- 172.21.15.39:0/4177498973 shutdown_connections 2023-11-28T12:00:16.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.889+0000 7fd12eba7700 1 -- 172.21.15.39:0/4177498973 wait complete. 2023-11-28T12:00:16.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.893+0000 7fd12eba7700 1 Processor -- start 2023-11-28T12:00:16.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.893+0000 7fd12eba7700 1 -- start start 2023-11-28T12:00:16.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.893+0000 7fd12eba7700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd12806b1c0 0x7fd12813deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:16.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.893+0000 7fd12eba7700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1280b5a00 0x7fd128158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:16.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.893+0000 7fd12eba7700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd128142650 0x7fd1281f1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:16.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.893+0000 7fd12eba7700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12815b7a0 con 0x7fd12806b1c0 2023-11-28T12:00:16.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.893+0000 7fd12eba7700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd128156e30 con 0x7fd1280b5a00 2023-11-28T12:00:16.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.893+0000 7fd12eba7700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd128157110 con 0x7fd128142650 2023-11-28T12:00:16.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.893+0000 7fd12c943700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd12806b1c0 0x7fd12813deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:16.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.893+0000 7fd12c943700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd12806b1c0 0x7fd12813deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40770/0 (socket says 172.21.15.39:40770) 2023-11-28T12:00:16.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.893+0000 7fd12c943700 1 -- 172.21.15.39:0/946319006 learned_addr learned my addr 172.21.15.39:0/946319006 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:16.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.893+0000 7fd127fff700 1 --2- 172.21.15.39:0/946319006 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1280b5a00 0x7fd128158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:16.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.893+0000 7fd12d144700 1 --2- 172.21.15.39:0/946319006 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd128142650 0x7fd1281f1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:16.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.893+0000 7fd12c943700 1 -- 172.21.15.39:0/946319006 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd128142650 msgr2=0x7fd1281f1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:16.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.893+0000 7fd12c943700 1 --2- 172.21.15.39:0/946319006 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd128142650 0x7fd1281f1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:16.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.893+0000 7fd12c943700 1 -- 172.21.15.39:0/946319006 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1280b5a00 msgr2=0x7fd128158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:16.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.893+0000 7fd12c943700 1 --2- 172.21.15.39:0/946319006 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1280b5a00 0x7fd128158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:16.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.893+0000 7fd12c943700 1 -- 172.21.15.39:0/946319006 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd11c009570 con 0x7fd12806b1c0 2023-11-28T12:00:16.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.893+0000 7fd12d144700 1 --2- 172.21.15.39:0/946319006 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd128142650 0x7fd1281f1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:00:16.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.893+0000 7fd127fff700 1 --2- 172.21.15.39:0/946319006 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1280b5a00 0x7fd128158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:00:16.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.893+0000 7fd12c943700 1 --2- 172.21.15.39:0/946319006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd12806b1c0 0x7fd12813deb0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fd128071ae0 tx=0x7fd11c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:16.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.897+0000 7fd1257fa700 1 -- 172.21.15.39:0/946319006 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c004610 con 0x7fd12806b1c0 2023-11-28T12:00:16.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.897+0000 7fd1257fa700 1 -- 172.21.15.39:0/946319006 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11c01f070 con 0x7fd12806b1c0 2023-11-28T12:00:16.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.897+0000 7fd1257fa700 1 -- 172.21.15.39:0/946319006 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c003900 con 0x7fd12806b1c0 2023-11-28T12:00:16.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.897+0000 7fd12eba7700 1 -- 172.21.15.39:0/946319006 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd12806c410 con 0x7fd12806b1c0 2023-11-28T12:00:16.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.897+0000 7fd12eba7700 1 -- 172.21.15.39:0/946319006 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd12806c130 con 0x7fd12806b1c0 2023-11-28T12:00:16.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.897+0000 7fd12eba7700 1 -- 172.21.15.39:0/946319006 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd128142a20 con 0x7fd12806b1c0 2023-11-28T12:00:16.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.901+0000 7fd1257fa700 1 -- 172.21.15.39:0/946319006 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd11c00f050 con 0x7fd12806b1c0 2023-11-28T12:00:16.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.901+0000 7fd1257fa700 1 --2- 172.21.15.39:0/946319006 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd10c064ee0 0x7fd10c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:16.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.901+0000 7fd1257fa700 1 -- 172.21.15.39:0/946319006 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fd11c021070 con 0x7fd12806b1c0 2023-11-28T12:00:16.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.901+0000 7fd1257fa700 1 --2- 172.21.15.39:0/946319006 >> [v2:172.21.15.184:6800/36504,v1:172.21.15.184:6801/36504] conn(0x7fd10c06b7f0 0x7fd10c06dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:16.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.901+0000 7fd1257fa700 1 -- 172.21.15.39:0/946319006 --> [v2:172.21.15.184:6800/36504,v1:172.21.15.184:6801/36504] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd10c06e2f0 con 0x7fd10c06b7f0 2023-11-28T12:00:16.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.901+0000 7fd1257fa700 1 -- 172.21.15.39:0/946319006 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd11c085aa0 con 0x7fd12806b1c0 2023-11-28T12:00:16.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.901+0000 7fd127fff700 1 --2- 172.21.15.39:0/946319006 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd10c064ee0 0x7fd10c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:16.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.901+0000 7fd12d144700 1 --2- 172.21.15.39:0/946319006 >> [v2:172.21.15.184:6800/36504,v1:172.21.15.184:6801/36504] conn(0x7fd10c06b7f0 0x7fd10c06dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:16.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.901+0000 7fd127fff700 1 --2- 172.21.15.39:0/946319006 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd10c064ee0 0x7fd10c067390 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd1280b3ea0 tx=0x7fd114007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:16.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.901+0000 7fd12d144700 1 --2- 172.21.15.39:0/946319006 >> [v2:172.21.15.184:6800/36504,v1:172.21.15.184:6801/36504] conn(0x7fd10c06b7f0 0x7fd10c06dc20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:16.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.905+0000 7fd1257fa700 1 -- 172.21.15.39:0/946319006 <== osd.4 v2:172.21.15.184:6800/36504 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd10c06e2f0 con 0x7fd10c06b7f0 2023-11-28T12:00:16.930 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.925+0000 7fd12eba7700 1 -- 172.21.15.39:0/946319006 --> [v2:172.21.15.184:6800/36504,v1:172.21.15.184:6801/36504] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd128159630 con 0x7fd10c06b7f0 2023-11-28T12:00:16.931 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.925+0000 7fd1257fa700 1 -- 172.21.15.39:0/946319006 <== osd.4 v2:172.21.15.184:6800/36504 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd128159630 con 0x7fd10c06b7f0 2023-11-28T12:00:16.932 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2023-11-28T12:00:16.932 INFO:teuthology.orchestra.run.smithi039.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-28T12:00:16.933 INFO:teuthology.orchestra.run.smithi039.stdout:} 2023-11-28T12:00:16.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.925+0000 7fd12eba7700 1 -- 172.21.15.39:0/946319006 >> [v2:172.21.15.184:6800/36504,v1:172.21.15.184:6801/36504] conn(0x7fd10c06b7f0 msgr2=0x7fd10c06dc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:16.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.925+0000 7fd12eba7700 1 --2- 172.21.15.39:0/946319006 >> [v2:172.21.15.184:6800/36504,v1:172.21.15.184:6801/36504] conn(0x7fd10c06b7f0 0x7fd10c06dc20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:16.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.925+0000 7fd12eba7700 1 -- 172.21.15.39:0/946319006 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd10c064ee0 msgr2=0x7fd10c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:16.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.929+0000 7fd12eba7700 1 --2- 172.21.15.39:0/946319006 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fd10c064ee0 0x7fd10c067390 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd1280b3ea0 tx=0x7fd114007d50 comp rx=0 tx=0).stop 2023-11-28T12:00:16.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.929+0000 7fd12eba7700 1 -- 172.21.15.39:0/946319006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd12806b1c0 msgr2=0x7fd12813deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:16.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.929+0000 7fd12eba7700 1 --2- 172.21.15.39:0/946319006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd12806b1c0 0x7fd12813deb0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fd128071ae0 tx=0x7fd11c004770 comp rx=0 tx=0).stop 2023-11-28T12:00:16.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.929+0000 7fd12d144700 1 -- 172.21.15.39:0/946319006 reap_dead start 2023-11-28T12:00:16.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.929+0000 7fd12eba7700 1 -- 172.21.15.39:0/946319006 shutdown_connections 2023-11-28T12:00:16.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.929+0000 7fd12eba7700 1 -- 172.21.15.39:0/946319006 >> 172.21.15.39:0/946319006 conn(0x7fd1280b5390 msgr2=0x7fd1281441b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:16.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.929+0000 7fd12eba7700 1 -- 172.21.15.39:0/946319006 shutdown_connections 2023-11-28T12:00:16.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:16.929+0000 7fd12eba7700 1 -- 172.21.15.39:0/946319006 wait complete. 2023-11-28T12:00:16.955 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-28T12:00:17.132 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.129+0000 7f339931a700 1 Processor -- start 2023-11-28T12:00:17.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.129+0000 7f339931a700 1 -- start start 2023-11-28T12:00:17.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.129+0000 7f339931a700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f33940b43a0 0x7f339415e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:17.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.129+0000 7f339931a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3394070790 0x7f339406bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:17.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.129+0000 7f339931a700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f339415a550 con 0x7f33940b1640 2023-11-28T12:00:17.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.129+0000 7f339931a700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f339406b0a0 con 0x7f33940b43a0 2023-11-28T12:00:17.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.129+0000 7f339931a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33940caac0 con 0x7f3394070790 2023-11-28T12:00:17.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.129+0000 7f3392ffd700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f33940b43a0 0x7f339415e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:17.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.129+0000 7f338bfff700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f33940b1640 0x7f3394070080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:37992/0 (socket says 172.21.15.39:37992) 2023-11-28T12:00:17.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.129+0000 7f338bfff700 1 -- 172.21.15.39:0/4031192657 learned_addr learned my addr 172.21.15.39:0/4031192657 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T12:00:17.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.129+0000 7f33937fe700 1 --2- 172.21.15.39:0/4031192657 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3394070790 0x7f339406bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:17.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.129+0000 7f33927fc700 1 -- 172.21.15.39:0/4031192657 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 874739980 0 0) 0x7f337c001110 con 0x7f33940b1640 2023-11-28T12:00:17.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.129+0000 7f33927fc700 1 -- 172.21.15.39:0/4031192657 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33740035d0 con 0x7f33940b1640 2023-11-28T12:00:17.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.129+0000 7f33937fe700 1 -- 172.21.15.39:0/4031192657 >> v2:172.21.15.39:3300/0 conn(0x7f33940b43a0 msgr2=0x7f339415e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:17.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.129+0000 7f33937fe700 1 --2- 172.21.15.39:0/4031192657 >> v2:172.21.15.39:3300/0 conn(0x7f33940b43a0 0x7f339415e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:17.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.129+0000 7f33937fe700 1 -- 172.21.15.39:0/4031192657 >> v1:172.21.15.184:6789/0 conn(0x7f33940b1640 legacy=0x7f3394070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:17.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.129+0000 7f33937fe700 1 -- 172.21.15.39:0/4031192657 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33940cada0 con 0x7f3394070790 2023-11-28T12:00:17.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.133+0000 7f33937fe700 1 --2- 172.21.15.39:0/4031192657 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3394070790 0x7f339406bfd0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f338c009d90 tx=0x7f338c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84ebe6a323386801 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:17.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.133+0000 7f33927fc700 1 -- 172.21.15.39:0/4031192657 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c00e070 con 0x7f3394070790 2023-11-28T12:00:17.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.133+0000 7f33927fc700 1 -- 172.21.15.39:0/4031192657 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338c00bb20 con 0x7f3394070790 2023-11-28T12:00:17.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.133+0000 7f33927fc700 1 -- 172.21.15.39:0/4031192657 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c012430 con 0x7f3394070790 2023-11-28T12:00:17.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.133+0000 7f339931a700 1 -- 172.21.15.39:0/4031192657 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3394070790 msgr2=0x7f339406bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:17.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.133+0000 7f339931a700 1 --2- 172.21.15.39:0/4031192657 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3394070790 0x7f339406bfd0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f338c009d90 tx=0x7f338c00b330 comp rx=0 tx=0).stop 2023-11-28T12:00:17.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.133+0000 7f339931a700 1 -- 172.21.15.39:0/4031192657 shutdown_connections 2023-11-28T12:00:17.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.133+0000 7f339931a700 1 --2- 172.21.15.39:0/4031192657 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3394070790 0x7f339406bfd0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:17.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.133+0000 7f339931a700 1 --2- 172.21.15.39:0/4031192657 >> v2:172.21.15.39:3300/0 conn(0x7f33940b43a0 0x7f339415e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:17.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.133+0000 7f339931a700 1 -- 172.21.15.39:0/4031192657 >> 172.21.15.39:0/4031192657 conn(0x7f33940b0f80 msgr2=0x7f33940ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:17.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.133+0000 7f339931a700 1 -- 172.21.15.39:0/4031192657 shutdown_connections 2023-11-28T12:00:17.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.133+0000 7f339931a700 1 -- 172.21.15.39:0/4031192657 wait complete. 2023-11-28T12:00:17.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.137+0000 7f339931a700 1 Processor -- start 2023-11-28T12:00:17.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.137+0000 7f339931a700 1 -- start start 2023-11-28T12:00:17.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.137+0000 7f339931a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3394070790 0x7f33940c4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:17.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.137+0000 7f339931a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33940b1640 0x7f339414fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:17.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.137+0000 7f339931a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f33940b43a0 0x7f33940c2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:17.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.137+0000 7f339931a700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33940c3d10 con 0x7f33940b43a0 2023-11-28T12:00:17.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.137+0000 7f339931a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33940c3f40 con 0x7f3394070790 2023-11-28T12:00:17.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.137+0000 7f339931a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33940c41e0 con 0x7f33940b1640 2023-11-28T12:00:17.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.141+0000 7f33937fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f33940b43a0 0x7f33940c2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:17.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.141+0000 7f33937fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f33940b43a0 0x7f33940c2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40792/0 (socket says 172.21.15.39:40792) 2023-11-28T12:00:17.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.141+0000 7f33937fe700 1 -- 172.21.15.39:0/334838015 learned_addr learned my addr 172.21.15.39:0/334838015 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:17.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.141+0000 7f3392ffd700 1 --2- 172.21.15.39:0/334838015 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3394070790 0x7f33940c4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:17.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.141+0000 7f338bfff700 1 --2- 172.21.15.39:0/334838015 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33940b1640 0x7f339414fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:17.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.141+0000 7f33937fe700 1 -- 172.21.15.39:0/334838015 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33940b1640 msgr2=0x7f339414fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:17.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.141+0000 7f33937fe700 1 --2- 172.21.15.39:0/334838015 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33940b1640 0x7f339414fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:17.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.141+0000 7f33937fe700 1 -- 172.21.15.39:0/334838015 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3394070790 msgr2=0x7f33940c4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:17.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.141+0000 7f33937fe700 1 --2- 172.21.15.39:0/334838015 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3394070790 0x7f33940c4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:17.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.141+0000 7f33937fe700 1 -- 172.21.15.39:0/334838015 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f338c009a70 con 0x7f33940b43a0 2023-11-28T12:00:17.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.141+0000 7f33937fe700 1 --2- 172.21.15.39:0/334838015 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f33940b43a0 0x7f33940c2220 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f338c014040 tx=0x7f338c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:17.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.141+0000 7f338b7fe700 1 -- 172.21.15.39:0/334838015 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c012430 con 0x7f33940b43a0 2023-11-28T12:00:17.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.141+0000 7f338b7fe700 1 -- 172.21.15.39:0/334838015 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338c020070 con 0x7f33940b43a0 2023-11-28T12:00:17.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.141+0000 7f339931a700 1 -- 172.21.15.39:0/334838015 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f339406b5d0 con 0x7f33940b43a0 2023-11-28T12:00:17.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.141+0000 7f338b7fe700 1 -- 172.21.15.39:0/334838015 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c003e30 con 0x7f33940b43a0 2023-11-28T12:00:17.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.141+0000 7f339931a700 1 -- 172.21.15.39:0/334838015 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f339406b2f0 con 0x7f33940b43a0 2023-11-28T12:00:17.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.141+0000 7f339931a700 1 -- 172.21.15.39:0/334838015 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f339415eb10 con 0x7f33940b43a0 2023-11-28T12:00:17.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.145+0000 7f338b7fe700 1 -- 172.21.15.39:0/334838015 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f338c004040 con 0x7f33940b43a0 2023-11-28T12:00:17.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.145+0000 7f338b7fe700 1 --2- 172.21.15.39:0/334838015 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3378064ee0 0x7f3378067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:17.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.145+0000 7f338b7fe700 1 -- 172.21.15.39:0/334838015 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f338c022070 con 0x7f33940b43a0 2023-11-28T12:00:17.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.145+0000 7f3392ffd700 1 --2- 172.21.15.39:0/334838015 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3378064ee0 0x7f3378067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:17.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.149+0000 7f3392ffd700 1 --2- 172.21.15.39:0/334838015 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3378064ee0 0x7f3378067390 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f339415a810 tx=0x7f3384009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:17.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.149+0000 7f338b7fe700 1 -- 172.21.15.39:0/334838015 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f338c0525a0 con 0x7f33940b43a0 2023-11-28T12:00:17.327 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.321+0000 7f339931a700 1 -- 172.21.15.39:0/334838015 --> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f3394073cb0 con 0x7f3378064ee0 2023-11-28T12:00:17.328 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.321+0000 7f338b7fe700 1 -- 172.21.15.39:0/334838015 <== mgr.4104 v2:172.21.15.184:6832/36166 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3394073cb0 con 0x7f3378064ee0 2023-11-28T12:00:17.330 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.325+0000 7f339931a700 1 -- 172.21.15.39:0/334838015 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3378064ee0 msgr2=0x7f3378067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:17.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.325+0000 7f339931a700 1 --2- 172.21.15.39:0/334838015 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3378064ee0 0x7f3378067390 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f339415a810 tx=0x7f3384009240 comp rx=0 tx=0).stop 2023-11-28T12:00:17.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.325+0000 7f339931a700 1 -- 172.21.15.39:0/334838015 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f33940b43a0 msgr2=0x7f33940c2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:17.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.325+0000 7f339931a700 1 --2- 172.21.15.39:0/334838015 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f33940b43a0 0x7f33940c2220 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f338c014040 tx=0x7f338c004af0 comp rx=0 tx=0).stop 2023-11-28T12:00:17.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.325+0000 7f339931a700 1 -- 172.21.15.39:0/334838015 shutdown_connections 2023-11-28T12:00:17.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.325+0000 7f339931a700 1 --2- 172.21.15.39:0/334838015 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f33940b43a0 0x7f33940c2220 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:17.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.325+0000 7f339931a700 1 --2- 172.21.15.39:0/334838015 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33940b1640 0x7f339414fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:17.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.325+0000 7f339931a700 1 --2- 172.21.15.39:0/334838015 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3378064ee0 0x7f3378067390 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:17.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.325+0000 7f339931a700 1 --2- 172.21.15.39:0/334838015 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3394070790 0x7f33940c4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:17.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.325+0000 7f339931a700 1 -- 172.21.15.39:0/334838015 >> 172.21.15.39:0/334838015 conn(0x7f33940b0f80 msgr2=0x7f3394070060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:17.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.325+0000 7f339931a700 1 -- 172.21.15.39:0/334838015 shutdown_connections 2023-11-28T12:00:17.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.325+0000 7f339931a700 1 -- 172.21.15.39:0/334838015 wait complete. 2023-11-28T12:00:17.334 INFO:teuthology.orchestra.run.smithi039.stderr:instructed osd(s) 4 to deep-scrub 2023-11-28T12:00:17.354 INFO:tasks.ceph:Scrubbing osd.5 2023-11-28T12:00:17.354 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-28T12:00:17.538 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.533+0000 7f6703fff700 1 Processor -- start 2023-11-28T12:00:17.538 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.533+0000 7f6703fff700 1 -- start start 2023-11-28T12:00:17.540 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.533+0000 7f6703fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6704159e10 0x7f670415a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:17.540 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.533+0000 7f6703fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f670406a1f0 0x7f670406a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:17.540 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.533+0000 7f6703fff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f670406c2a0 con 0x7f670406ccd0 2023-11-28T12:00:17.540 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.533+0000 7f6703fff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f670406ab80 con 0x7f670406a1f0 2023-11-28T12:00:17.541 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.533+0000 7f6703fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f670406b320 con 0x7f6704159e10 2023-11-28T12:00:17.541 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.537+0000 7f67027fc700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f670406a1f0 0x7f670406a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:17.541 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.537+0000 7f6702ffd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6704159e10 0x7f670415a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:17.541 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.537+0000 7f67027fc700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f670406a1f0 0x7f670406a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:43538/0 (socket says 172.21.15.39:43538) 2023-11-28T12:00:17.542 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.537+0000 7f67027fc700 1 -- 172.21.15.39:0/2226681007 learned_addr learned my addr 172.21.15.39:0/2226681007 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:17.542 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.537+0000 7f6702ffd700 1 -- 172.21.15.39:0/2226681007 >> v2:172.21.15.184:3300/0 conn(0x7f670406a1f0 msgr2=0x7f670406a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:17.542 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.537+0000 7f6702ffd700 1 --2- 172.21.15.39:0/2226681007 >> v2:172.21.15.184:3300/0 conn(0x7f670406a1f0 0x7f670406a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:17.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.537+0000 7f6702ffd700 1 -- 172.21.15.39:0/2226681007 >> v1:172.21.15.184:6789/0 conn(0x7f670406ccd0 legacy=0x7f670406d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:17.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.537+0000 7f6702ffd700 1 -- 172.21.15.39:0/2226681007 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f670415df60 con 0x7f6704159e10 2023-11-28T12:00:17.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.537+0000 7f6702ffd700 1 --2- 172.21.15.39:0/2226681007 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6704159e10 0x7f670415a1e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f66f4009840 tx=0x7f66f4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b893c7bcfa064bf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:17.544 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.537+0000 7f6701ffb700 1 -- 172.21.15.39:0/2226681007 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f4005e50 con 0x7f6704159e10 2023-11-28T12:00:17.544 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.537+0000 7f6701ffb700 1 -- 172.21.15.39:0/2226681007 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f4006030 con 0x7f6704159e10 2023-11-28T12:00:17.544 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.537+0000 7f6701ffb700 1 -- 172.21.15.39:0/2226681007 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f40063c0 con 0x7f6704159e10 2023-11-28T12:00:17.545 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.541+0000 7f6703fff700 1 -- 172.21.15.39:0/2226681007 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6704159e10 msgr2=0x7f670415a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:17.545 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.541+0000 7f6703fff700 1 --2- 172.21.15.39:0/2226681007 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6704159e10 0x7f670415a1e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f66f4009840 tx=0x7f66f4009b50 comp rx=0 tx=0).stop 2023-11-28T12:00:17.545 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.541+0000 7f6703fff700 1 -- 172.21.15.39:0/2226681007 shutdown_connections 2023-11-28T12:00:17.545 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.541+0000 7f6703fff700 1 --2- 172.21.15.39:0/2226681007 >> v2:172.21.15.184:3300/0 conn(0x7f670406a1f0 0x7f670406a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:17.545 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.541+0000 7f6703fff700 1 --2- 172.21.15.39:0/2226681007 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6704159e10 0x7f670415a1e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:17.546 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.541+0000 7f6703fff700 1 -- 172.21.15.39:0/2226681007 >> 172.21.15.39:0/2226681007 conn(0x7f67040ce5b0 msgr2=0x7f67040ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:17.546 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.541+0000 7f6703fff700 1 -- 172.21.15.39:0/2226681007 shutdown_connections 2023-11-28T12:00:17.547 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.541+0000 7f6703fff700 1 -- 172.21.15.39:0/2226681007 wait complete. 2023-11-28T12:00:17.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.545+0000 7f6703fff700 1 Processor -- start 2023-11-28T12:00:17.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.545+0000 7f6703fff700 1 -- start start 2023-11-28T12:00:17.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.545+0000 7f6703fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f670406a1f0 0x7f670415d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:17.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.545+0000 7f6703fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f670406ccd0 0x7f67040c6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:17.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.545+0000 7f6703fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6704159e10 0x7f670415a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:17.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.545+0000 7f6703fff700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67040c65d0 con 0x7f670406ccd0 2023-11-28T12:00:17.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.545+0000 7f6703fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67041593f0 con 0x7f6704159e10 2023-11-28T12:00:17.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.545+0000 7f6703fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67040c6800 con 0x7f670406a1f0 2023-11-28T12:00:17.552 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.545+0000 7f67027fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f670406ccd0 0x7f67040c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:17.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.545+0000 7f67027fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f670406ccd0 0x7f67040c6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40794/0 (socket says 172.21.15.39:40794) 2023-11-28T12:00:17.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.545+0000 7f67027fc700 1 -- 172.21.15.39:0/3023952245 learned_addr learned my addr 172.21.15.39:0/3023952245 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:17.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.545+0000 7f6702ffd700 1 --2- 172.21.15.39:0/3023952245 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f670406a1f0 0x7f670415d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:17.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.545+0000 7f67037fe700 1 --2- 172.21.15.39:0/3023952245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6704159e10 0x7f670415a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:17.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.545+0000 7f67027fc700 1 -- 172.21.15.39:0/3023952245 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f670406a1f0 msgr2=0x7f670415d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:17.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.545+0000 7f67027fc700 1 --2- 172.21.15.39:0/3023952245 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f670406a1f0 0x7f670415d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:17.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.545+0000 7f67027fc700 1 -- 172.21.15.39:0/3023952245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6704159e10 msgr2=0x7f670415a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:17.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.545+0000 7f67027fc700 1 --2- 172.21.15.39:0/3023952245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6704159e10 0x7f670415a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:17.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.545+0000 7f67027fc700 1 -- 172.21.15.39:0/3023952245 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f4009450 con 0x7f670406ccd0 2023-11-28T12:00:17.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.549+0000 7f67027fc700 1 --2- 172.21.15.39:0/3023952245 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f670406ccd0 0x7f67040c6090 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f66f800e930 tx=0x7f66f800ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:17.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.549+0000 7f66eb7fe700 1 -- 172.21.15.39:0/3023952245 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f80096c0 con 0x7f670406ccd0 2023-11-28T12:00:17.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.549+0000 7f66eb7fe700 1 -- 172.21.15.39:0/3023952245 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f8013680 con 0x7f670406ccd0 2023-11-28T12:00:17.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.549+0000 7f6703fff700 1 -- 172.21.15.39:0/3023952245 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f670406b040 con 0x7f670406ccd0 2023-11-28T12:00:17.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.549+0000 7f66eb7fe700 1 -- 172.21.15.39:0/3023952245 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f8013a30 con 0x7f670406ccd0 2023-11-28T12:00:17.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.549+0000 7f6703fff700 1 -- 172.21.15.39:0/3023952245 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f670406ad60 con 0x7f670406ccd0 2023-11-28T12:00:17.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.549+0000 7f6703fff700 1 -- 172.21.15.39:0/3023952245 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f670406c4d0 con 0x7f670406ccd0 2023-11-28T12:00:17.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.553+0000 7f66eb7fe700 1 -- 172.21.15.39:0/3023952245 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f66f8019030 con 0x7f670406ccd0 2023-11-28T12:00:17.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.553+0000 7f66eb7fe700 1 --2- 172.21.15.39:0/3023952245 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f66f0064ee0 0x7f66f0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:17.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.553+0000 7f66eb7fe700 1 -- 172.21.15.39:0/3023952245 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f66f8081eb0 con 0x7f670406ccd0 2023-11-28T12:00:17.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.553+0000 7f66eb7fe700 1 --2- 172.21.15.39:0/3023952245 >> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] conn(0x7f66f006b7f0 0x7f66f006dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:17.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.553+0000 7f66eb7fe700 1 -- 172.21.15.39:0/3023952245 --> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f66f006e2f0 con 0x7f66f006b7f0 2023-11-28T12:00:17.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.553+0000 7f66eb7fe700 1 -- 172.21.15.39:0/3023952245 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66f80822f0 con 0x7f670406ccd0 2023-11-28T12:00:17.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.553+0000 7f6702ffd700 1 --2- 172.21.15.39:0/3023952245 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f66f0064ee0 0x7f66f0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:17.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.553+0000 7f67037fe700 1 --2- 172.21.15.39:0/3023952245 >> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] conn(0x7f66f006b7f0 0x7f66f006dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:17.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.553+0000 7f6702ffd700 1 --2- 172.21.15.39:0/3023952245 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f66f0064ee0 0x7f66f0067390 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f66f4009b90 tx=0x7f66f4008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:17.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.553+0000 7f67037fe700 1 --2- 172.21.15.39:0/3023952245 >> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] conn(0x7f66f006b7f0 0x7f66f006dc20 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:17.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.557+0000 7f66eb7fe700 1 -- 172.21.15.39:0/3023952245 <== osd.5 v2:172.21.15.184:6808/36505 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f66f006e2f0 con 0x7f66f006b7f0 2023-11-28T12:00:17.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.577+0000 7f6703fff700 1 -- 172.21.15.39:0/3023952245 --> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6704073cb0 con 0x7f66f006b7f0 2023-11-28T12:00:17.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.577+0000 7f66eb7fe700 1 -- 172.21.15.39:0/3023952245 <== osd.5 v2:172.21.15.184:6808/36505 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6704073cb0 con 0x7f66f006b7f0 2023-11-28T12:00:17.582 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2023-11-28T12:00:17.583 INFO:teuthology.orchestra.run.smithi039.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-28T12:00:17.583 INFO:teuthology.orchestra.run.smithi039.stdout:} 2023-11-28T12:00:17.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.577+0000 7f6703fff700 1 -- 172.21.15.39:0/3023952245 >> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] conn(0x7f66f006b7f0 msgr2=0x7f66f006dc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:17.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.577+0000 7f6703fff700 1 --2- 172.21.15.39:0/3023952245 >> [v2:172.21.15.184:6808/36505,v1:172.21.15.184:6810/36505] conn(0x7f66f006b7f0 0x7f66f006dc20 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:17.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.577+0000 7f6703fff700 1 -- 172.21.15.39:0/3023952245 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f66f0064ee0 msgr2=0x7f66f0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:17.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.577+0000 7f6703fff700 1 --2- 172.21.15.39:0/3023952245 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f66f0064ee0 0x7f66f0067390 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f66f4009b90 tx=0x7f66f4008070 comp rx=0 tx=0).stop 2023-11-28T12:00:17.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.577+0000 7f6703fff700 1 -- 172.21.15.39:0/3023952245 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f670406ccd0 msgr2=0x7f67040c6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:17.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.577+0000 7f6703fff700 1 --2- 172.21.15.39:0/3023952245 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f670406ccd0 0x7f67040c6090 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f66f800e930 tx=0x7f66f800ec40 comp rx=0 tx=0).stop 2023-11-28T12:00:17.585 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.577+0000 7f67037fe700 1 -- 172.21.15.39:0/3023952245 reap_dead start 2023-11-28T12:00:17.585 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.577+0000 7f6703fff700 1 -- 172.21.15.39:0/3023952245 shutdown_connections 2023-11-28T12:00:17.585 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.577+0000 7f6703fff700 1 -- 172.21.15.39:0/3023952245 >> 172.21.15.39:0/3023952245 conn(0x7f67040ce5b0 msgr2=0x7f67040c13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:17.585 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.577+0000 7f6703fff700 1 -- 172.21.15.39:0/3023952245 shutdown_connections 2023-11-28T12:00:17.585 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.577+0000 7f6703fff700 1 -- 172.21.15.39:0/3023952245 wait complete. 2023-11-28T12:00:17.606 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-28T12:00:17.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.793+0000 7f2e806e7700 1 Processor -- start 2023-11-28T12:00:17.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.793+0000 7f2e806e7700 1 -- start start 2023-11-28T12:00:17.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.797+0000 7f2e806e7700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f2e7815a230 0x7f2e780cb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:17.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.797+0000 7f2e806e7700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2e7815e8b0 0x7f2e780b23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:17.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.797+0000 7f2e806e7700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e780b2920 0x7f2e7806e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:17.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.797+0000 7f2e806e7700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e780b2da0 con 0x7f2e7815a230 2023-11-28T12:00:17.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.797+0000 7f2e806e7700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e78070490 con 0x7f2e7815e8b0 2023-11-28T12:00:17.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.797+0000 7f2e806e7700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e78070770 con 0x7f2e780b2920 2023-11-28T12:00:17.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.797+0000 7f2e7e483700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f2e7815a230 0x7f2e780cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:17.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.797+0000 7f2e7dc82700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2e7815e8b0 0x7f2e780b23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:17.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.797+0000 7f2e7e483700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f2e7815a230 0x7f2e780cb000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40808/0 (socket says 172.21.15.39:40808) 2023-11-28T12:00:17.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.797+0000 7f2e7ec84700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e780b2920 0x7f2e7806e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:17.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.797+0000 7f2e7e483700 1 -- 172.21.15.39:0/1085971181 learned_addr learned my addr 172.21.15.39:0/1085971181 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:17.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.797+0000 7f2e7e483700 1 -- 172.21.15.39:0/1085971181 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e780b2920 msgr2=0x7f2e7806e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:17.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.797+0000 7f2e7e483700 1 --2- 172.21.15.39:0/1085971181 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e780b2920 0x7f2e7806e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:17.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.797+0000 7f2e7e483700 1 -- 172.21.15.39:0/1085971181 >> v2:172.21.15.184:3300/0 conn(0x7f2e7815e8b0 msgr2=0x7f2e780b23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:17.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.797+0000 7f2e7e483700 1 --2- 172.21.15.39:0/1085971181 >> v2:172.21.15.184:3300/0 conn(0x7f2e7815e8b0 0x7f2e780b23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:17.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.797+0000 7f2e7e483700 1 -- 172.21.15.39:0/1085971181 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e780ccc40 con 0x7f2e7815a230 2023-11-28T12:00:17.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.797+0000 7f2e7dc82700 1 --2- 172.21.15.39:0/1085971181 >> v2:172.21.15.184:3300/0 conn(0x7f2e7815e8b0 0x7f2e780b23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:00:17.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.797+0000 7f2e7e483700 1 --2- 172.21.15.39:0/1085971181 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e7815a230 0x7f2e780cb000 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f2e78071290 tx=0x7f2e74009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef1bac76c74486cd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:17.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.801+0000 7f2e7d481700 1 -- 172.21.15.39:0/1085971181 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e74011830 con 0x7f2e7815a230 2023-11-28T12:00:17.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.801+0000 7f2e7d481700 1 -- 172.21.15.39:0/1085971181 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e74011990 con 0x7f2e7815a230 2023-11-28T12:00:17.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.801+0000 7f2e7d481700 1 -- 172.21.15.39:0/1085971181 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e74011d20 con 0x7f2e7815a230 2023-11-28T12:00:17.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.801+0000 7f2e806e7700 1 -- 172.21.15.39:0/1085971181 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e7815a230 msgr2=0x7f2e780cb000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:17.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.801+0000 7f2e806e7700 1 --2- 172.21.15.39:0/1085971181 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e7815a230 0x7f2e780cb000 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f2e78071290 tx=0x7f2e74009bf0 comp rx=0 tx=0).stop 2023-11-28T12:00:17.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.801+0000 7f2e806e7700 1 -- 172.21.15.39:0/1085971181 shutdown_connections 2023-11-28T12:00:17.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.801+0000 7f2e806e7700 1 --2- 172.21.15.39:0/1085971181 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e780b2920 0x7f2e7806e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:17.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.801+0000 7f2e806e7700 1 --2- 172.21.15.39:0/1085971181 >> v2:172.21.15.184:3300/0 conn(0x7f2e7815e8b0 0x7f2e780b23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:17.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.801+0000 7f2e806e7700 1 --2- 172.21.15.39:0/1085971181 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e7815a230 0x7f2e780cb000 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:17.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.801+0000 7f2e806e7700 1 -- 172.21.15.39:0/1085971181 >> 172.21.15.39:0/1085971181 conn(0x7f2e780d0960 msgr2=0x7f2e780d0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:17.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.801+0000 7f2e806e7700 1 -- 172.21.15.39:0/1085971181 shutdown_connections 2023-11-28T12:00:17.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.801+0000 7f2e806e7700 1 -- 172.21.15.39:0/1085971181 wait complete. 2023-11-28T12:00:17.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.801+0000 7f2e806e7700 1 Processor -- start 2023-11-28T12:00:17.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.805+0000 7f2e806e7700 1 -- start start 2023-11-28T12:00:17.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.805+0000 7f2e806e7700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e780b2920 0x7f2e780ca280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:17.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.805+0000 7f2e806e7700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e7815a230 0x7f2e7815af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:17.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.805+0000 7f2e806e7700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e7815e8b0 0x7f2e7815b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:17.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.805+0000 7f2e806e7700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e780b1d30 con 0x7f2e780b2920 2023-11-28T12:00:17.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.805+0000 7f2e806e7700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7815aaa0 con 0x7f2e7815e8b0 2023-11-28T12:00:17.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.805+0000 7f2e806e7700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e780ca7c0 con 0x7f2e7815a230 2023-11-28T12:00:17.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.805+0000 7f2e7dc82700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e7815a230 0x7f2e7815af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:17.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.805+0000 7f2e7e483700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e780b2920 0x7f2e780ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:17.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.805+0000 7f2e7dc82700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e7815a230 0x7f2e7815af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:40048/0 (socket says 172.21.15.39:40048) 2023-11-28T12:00:17.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.805+0000 7f2e7dc82700 1 -- 172.21.15.39:0/2060920914 learned_addr learned my addr 172.21.15.39:0/2060920914 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:17.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.805+0000 7f2e7ec84700 1 --2- 172.21.15.39:0/2060920914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e7815e8b0 0x7f2e7815b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:17.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.805+0000 7f2e7dc82700 1 -- 172.21.15.39:0/2060920914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e7815e8b0 msgr2=0x7f2e7815b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:17.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.805+0000 7f2e7dc82700 1 --2- 172.21.15.39:0/2060920914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e7815e8b0 0x7f2e7815b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:17.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.805+0000 7f2e7dc82700 1 -- 172.21.15.39:0/2060920914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e780b2920 msgr2=0x7f2e780ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:17.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.805+0000 7f2e7dc82700 1 --2- 172.21.15.39:0/2060920914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e780b2920 0x7f2e780ca280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:17.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.805+0000 7f2e7dc82700 1 -- 172.21.15.39:0/2060920914 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e680094b0 con 0x7f2e7815a230 2023-11-28T12:00:17.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.805+0000 7f2e7dc82700 1 --2- 172.21.15.39:0/2060920914 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e7815a230 0x7f2e7815af30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2e6800ebe0 tx=0x7f2e6800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:17.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.805+0000 7f2e6effd700 1 -- 172.21.15.39:0/2060920914 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68009770 con 0x7f2e7815a230 2023-11-28T12:00:17.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.805+0000 7f2e6effd700 1 -- 172.21.15.39:0/2060920914 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6800c850 con 0x7f2e7815a230 2023-11-28T12:00:17.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.805+0000 7f2e6effd700 1 -- 172.21.15.39:0/2060920914 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6800cbe0 con 0x7f2e7815a230 2023-11-28T12:00:17.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.805+0000 7f2e806e7700 1 -- 172.21.15.39:0/2060920914 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e74009570 con 0x7f2e7815a230 2023-11-28T12:00:17.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.805+0000 7f2e806e7700 1 -- 172.21.15.39:0/2060920914 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e7815ed00 con 0x7f2e7815a230 2023-11-28T12:00:17.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.809+0000 7f2e806e7700 1 -- 172.21.15.39:0/2060920914 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e780ccf20 con 0x7f2e7815a230 2023-11-28T12:00:17.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.809+0000 7f2e6effd700 1 -- 172.21.15.39:0/2060920914 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2e68019030 con 0x7f2e7815a230 2023-11-28T12:00:17.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.813+0000 7f2e6effd700 1 --2- 172.21.15.39:0/2060920914 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2e5c064ee0 0x7f2e5c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:17.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.813+0000 7f2e6effd700 1 -- 172.21.15.39:0/2060920914 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f2e68081c30 con 0x7f2e7815a230 2023-11-28T12:00:17.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.813+0000 7f2e7e483700 1 --2- 172.21.15.39:0/2060920914 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2e5c064ee0 0x7f2e5c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:17.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.813+0000 7f2e7e483700 1 --2- 172.21.15.39:0/2060920914 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2e5c064ee0 0x7f2e5c067390 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2e74000c00 tx=0x7f2e74008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:17.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.817+0000 7f2e6effd700 1 -- 172.21.15.39:0/2060920914 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2e6804fe60 con 0x7f2e7815a230 2023-11-28T12:00:17.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.993+0000 7f2e806e7700 1 -- 172.21.15.39:0/2060920914 --> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f2e780cc8f0 con 0x7f2e5c064ee0 2023-11-28T12:00:17.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:17.993+0000 7f2e6effd700 1 -- 172.21.15.39:0/2060920914 <== mgr.4104 v2:172.21.15.184:6832/36166 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2e780cc8f0 con 0x7f2e5c064ee0 2023-11-28T12:00:18.005 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.001+0000 7f2e806e7700 1 -- 172.21.15.39:0/2060920914 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2e5c064ee0 msgr2=0x7f2e5c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:18.005 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.001+0000 7f2e806e7700 1 --2- 172.21.15.39:0/2060920914 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2e5c064ee0 0x7f2e5c067390 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2e74000c00 tx=0x7f2e74008030 comp rx=0 tx=0).stop 2023-11-28T12:00:18.005 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.001+0000 7f2e806e7700 1 -- 172.21.15.39:0/2060920914 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e7815a230 msgr2=0x7f2e7815af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:18.005 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.001+0000 7f2e806e7700 1 --2- 172.21.15.39:0/2060920914 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e7815a230 0x7f2e7815af30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2e6800ebe0 tx=0x7f2e6800eef0 comp rx=0 tx=0).stop 2023-11-28T12:00:18.005 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.001+0000 7f2e806e7700 1 -- 172.21.15.39:0/2060920914 shutdown_connections 2023-11-28T12:00:18.006 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.001+0000 7f2e806e7700 1 --2- 172.21.15.39:0/2060920914 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f2e5c064ee0 0x7f2e5c067390 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:18.006 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.001+0000 7f2e806e7700 1 --2- 172.21.15.39:0/2060920914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e7815e8b0 0x7f2e7815b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:18.006 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.001+0000 7f2e806e7700 1 --2- 172.21.15.39:0/2060920914 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e7815a230 0x7f2e7815af30 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:18.006 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.001+0000 7f2e806e7700 1 --2- 172.21.15.39:0/2060920914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e780b2920 0x7f2e780ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:18.006 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.001+0000 7f2e806e7700 1 -- 172.21.15.39:0/2060920914 >> 172.21.15.39:0/2060920914 conn(0x7f2e780d0960 msgr2=0x7f2e780caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:18.006 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.001+0000 7f2e806e7700 1 -- 172.21.15.39:0/2060920914 shutdown_connections 2023-11-28T12:00:18.006 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.001+0000 7f2e806e7700 1 -- 172.21.15.39:0/2060920914 wait complete. 2023-11-28T12:00:18.007 INFO:teuthology.orchestra.run.smithi039.stderr:instructed osd(s) 5 to deep-scrub 2023-11-28T12:00:18.026 INFO:tasks.ceph:Scrubbing osd.6 2023-11-28T12:00:18.026 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-28T12:00:18.207 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.201+0000 7fbc7d108700 1 Processor -- start 2023-11-28T12:00:18.208 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.201+0000 7fbc7d108700 1 -- start start 2023-11-28T12:00:18.210 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.205+0000 7fbc7d108700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc7815c6e0 0x7fbc78071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:18.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.205+0000 7fbc7d108700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fbc78071fe0 0x7fbc78069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:18.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.205+0000 7fbc7d108700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbc7806a340 0x7fbc780b79a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:18.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.205+0000 7fbc7d108700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc780d2800 con 0x7fbc7806a340 2023-11-28T12:00:18.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.205+0000 7fbc7d108700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc7806a790 con 0x7fbc78071fe0 2023-11-28T12:00:18.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.205+0000 7fbc7d108700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7815cab0 con 0x7fbc7815c6e0 2023-11-28T12:00:18.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.205+0000 7fbc7c907700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbc7806a340 0x7fbc780b79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:18.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.205+0000 7fbc77fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc7815c6e0 0x7fbc78071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:18.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.205+0000 7fbc777fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fbc78071fe0 0x7fbc78069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:18.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.205+0000 7fbc777fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fbc78071fe0 0x7fbc78069e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.39:41006/0 (socket says 172.21.15.39:41006) 2023-11-28T12:00:18.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.205+0000 7fbc777fe700 1 -- 172.21.15.39:0/2123049005 learned_addr learned my addr 172.21.15.39:0/2123049005 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:18.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.205+0000 7fbc7c907700 1 -- 172.21.15.39:0/2123049005 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc7815c6e0 msgr2=0x7fbc78071aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:18.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.205+0000 7fbc7c907700 1 --2- 172.21.15.39:0/2123049005 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc7815c6e0 0x7fbc78071aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:18.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.205+0000 7fbc7c907700 1 -- 172.21.15.39:0/2123049005 >> v2:172.21.15.184:3300/0 conn(0x7fbc78071fe0 msgr2=0x7fbc78069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:18.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.205+0000 7fbc7c907700 1 --2- 172.21.15.39:0/2123049005 >> v2:172.21.15.184:3300/0 conn(0x7fbc78071fe0 0x7fbc78069e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:18.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.205+0000 7fbc7c907700 1 -- 172.21.15.39:0/2123049005 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc780702d0 con 0x7fbc7806a340 2023-11-28T12:00:18.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.205+0000 7fbc777fe700 1 --2- 172.21.15.39:0/2123049005 >> v2:172.21.15.184:3300/0 conn(0x7fbc78071fe0 0x7fbc78069e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:00:18.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.209+0000 7fbc7c907700 1 --2- 172.21.15.39:0/2123049005 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc7806a340 0x7fbc780b79a0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fbc7806ea10 tx=0x7fbc7000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63c04cc8bce27a05 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:18.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.209+0000 7fbc76ffd700 1 -- 172.21.15.39:0/2123049005 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7000e070 con 0x7fbc7806a340 2023-11-28T12:00:18.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.209+0000 7fbc76ffd700 1 -- 172.21.15.39:0/2123049005 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7000bb20 con 0x7fbc7806a340 2023-11-28T12:00:18.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.209+0000 7fbc76ffd700 1 -- 172.21.15.39:0/2123049005 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc70012430 con 0x7fbc7806a340 2023-11-28T12:00:18.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.209+0000 7fbc7d108700 1 -- 172.21.15.39:0/2123049005 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc7806a340 msgr2=0x7fbc780b79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:18.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.209+0000 7fbc7d108700 1 --2- 172.21.15.39:0/2123049005 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc7806a340 0x7fbc780b79a0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fbc7806ea10 tx=0x7fbc7000b330 comp rx=0 tx=0).stop 2023-11-28T12:00:18.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.209+0000 7fbc7d108700 1 -- 172.21.15.39:0/2123049005 shutdown_connections 2023-11-28T12:00:18.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.209+0000 7fbc7d108700 1 --2- 172.21.15.39:0/2123049005 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc7806a340 0x7fbc780b79a0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:18.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.209+0000 7fbc7d108700 1 --2- 172.21.15.39:0/2123049005 >> v2:172.21.15.184:3300/0 conn(0x7fbc78071fe0 0x7fbc78069e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:18.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.209+0000 7fbc7d108700 1 --2- 172.21.15.39:0/2123049005 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc7815c6e0 0x7fbc78071aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:18.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.209+0000 7fbc7d108700 1 -- 172.21.15.39:0/2123049005 >> 172.21.15.39:0/2123049005 conn(0x7fbc780b65b0 msgr2=0x7fbc78071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:18.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.209+0000 7fbc7d108700 1 -- 172.21.15.39:0/2123049005 shutdown_connections 2023-11-28T12:00:18.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.209+0000 7fbc7d108700 1 -- 172.21.15.39:0/2123049005 wait complete. 2023-11-28T12:00:18.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.213+0000 7fbc7d108700 1 Processor -- start 2023-11-28T12:00:18.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.213+0000 7fbc7d108700 1 -- start start 2023-11-28T12:00:18.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.213+0000 7fbc7d108700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc7806a340 0x7fbc78152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:18.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.213+0000 7fbc7d108700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc78071fe0 0x7fbc7809bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:18.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.213+0000 7fbc7d108700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc7815c6e0 0x7fbc7815a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:18.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.213+0000 7fbc7d108700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc78153330 con 0x7fbc7806a340 2023-11-28T12:00:18.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.213+0000 7fbc7d108700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc78153610 con 0x7fbc7815c6e0 2023-11-28T12:00:18.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.213+0000 7fbc7d108700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc781516b0 con 0x7fbc78071fe0 2023-11-28T12:00:18.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.213+0000 7fbc77fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc7806a340 0x7fbc78152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:18.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.213+0000 7fbc77fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc7806a340 0x7fbc78152d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34460/0 (socket says 172.21.15.39:34460) 2023-11-28T12:00:18.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.213+0000 7fbc77fff700 1 -- 172.21.15.39:0/2035082351 learned_addr learned my addr 172.21.15.39:0/2035082351 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:18.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.213+0000 7fbc7c907700 1 --2- 172.21.15.39:0/2035082351 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc7815c6e0 0x7fbc7815a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:18.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.213+0000 7fbc777fe700 1 --2- 172.21.15.39:0/2035082351 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc78071fe0 0x7fbc7809bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:18.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.213+0000 7fbc77fff700 1 -- 172.21.15.39:0/2035082351 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc78071fe0 msgr2=0x7fbc7809bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:18.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.213+0000 7fbc77fff700 1 --2- 172.21.15.39:0/2035082351 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc78071fe0 0x7fbc7809bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:18.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.213+0000 7fbc77fff700 1 -- 172.21.15.39:0/2035082351 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc7815c6e0 msgr2=0x7fbc7815a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:18.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.213+0000 7fbc77fff700 1 --2- 172.21.15.39:0/2035082351 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc7815c6e0 0x7fbc7815a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:18.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.213+0000 7fbc77fff700 1 -- 172.21.15.39:0/2035082351 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6c009570 con 0x7fbc7806a340 2023-11-28T12:00:18.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.217+0000 7fbc77fff700 1 --2- 172.21.15.39:0/2035082351 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc7806a340 0x7fbc78152d50 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fbc6800e870 tx=0x7fbc6800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:18.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.217+0000 7fbc74ff9700 1 -- 172.21.15.39:0/2035082351 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc680095c0 con 0x7fbc7806a340 2023-11-28T12:00:18.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.217+0000 7fbc74ff9700 1 -- 172.21.15.39:0/2035082351 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc68013680 con 0x7fbc7806a340 2023-11-28T12:00:18.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.217+0000 7fbc74ff9700 1 -- 172.21.15.39:0/2035082351 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc68013a10 con 0x7fbc7806a340 2023-11-28T12:00:18.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.217+0000 7fbc7d108700 1 -- 172.21.15.39:0/2035082351 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc70009a70 con 0x7fbc7806a340 2023-11-28T12:00:18.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.217+0000 7fbc7d108700 1 -- 172.21.15.39:0/2035082351 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc780d2cf0 con 0x7fbc7806a340 2023-11-28T12:00:18.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.217+0000 7fbc7d108700 1 -- 172.21.15.39:0/2035082351 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbc780d2a10 con 0x7fbc7806a340 2023-11-28T12:00:18.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.221+0000 7fbc74ff9700 1 -- 172.21.15.39:0/2035082351 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbc68019030 con 0x7fbc7806a340 2023-11-28T12:00:18.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.221+0000 7fbc74ff9700 1 --2- 172.21.15.39:0/2035082351 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fbc64064f10 0x7fbc640673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:18.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.221+0000 7fbc74ff9700 1 -- 172.21.15.39:0/2035082351 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fbc68081a80 con 0x7fbc7806a340 2023-11-28T12:00:18.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.221+0000 7fbc74ff9700 1 --2- 172.21.15.39:0/2035082351 >> [v2:172.21.15.184:6821/36507,v1:172.21.15.184:6824/36507] conn(0x7fbc6406b820 0x7fbc6406dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:18.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.221+0000 7fbc74ff9700 1 -- 172.21.15.39:0/2035082351 --> [v2:172.21.15.184:6821/36507,v1:172.21.15.184:6824/36507] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbc6406e320 con 0x7fbc6406b820 2023-11-28T12:00:18.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.221+0000 7fbc74ff9700 1 -- 172.21.15.39:0/2035082351 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc680862a0 con 0x7fbc7806a340 2023-11-28T12:00:18.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.221+0000 7fbc777fe700 1 --2- 172.21.15.39:0/2035082351 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fbc64064f10 0x7fbc640673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:18.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.221+0000 7fbc7c907700 1 --2- 172.21.15.39:0/2035082351 >> [v2:172.21.15.184:6821/36507,v1:172.21.15.184:6824/36507] conn(0x7fbc6406b820 0x7fbc6406dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:18.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.221+0000 7fbc777fe700 1 --2- 172.21.15.39:0/2035082351 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fbc64064f10 0x7fbc640673c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fbc7815b380 tx=0x7fbc6c0092e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:18.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.225+0000 7fbc7c907700 1 --2- 172.21.15.39:0/2035082351 >> [v2:172.21.15.184:6821/36507,v1:172.21.15.184:6824/36507] conn(0x7fbc6406b820 0x7fbc6406dc50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:18.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.225+0000 7fbc74ff9700 1 -- 172.21.15.39:0/2035082351 <== osd.6 v2:172.21.15.184:6821/36507 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fbc6406e320 con 0x7fbc6406b820 2023-11-28T12:00:18.250 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.245+0000 7fbc7d108700 1 -- 172.21.15.39:0/2035082351 --> [v2:172.21.15.184:6821/36507,v1:172.21.15.184:6824/36507] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbc780d2fd0 con 0x7fbc6406b820 2023-11-28T12:00:18.251 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.245+0000 7fbc74ff9700 1 -- 172.21.15.39:0/2035082351 <== osd.6 v2:172.21.15.184:6821/36507 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fbc780d2fd0 con 0x7fbc6406b820 2023-11-28T12:00:18.252 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2023-11-28T12:00:18.252 INFO:teuthology.orchestra.run.smithi039.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-28T12:00:18.252 INFO:teuthology.orchestra.run.smithi039.stdout:} 2023-11-28T12:00:18.253 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.245+0000 7fbc7d108700 1 -- 172.21.15.39:0/2035082351 >> [v2:172.21.15.184:6821/36507,v1:172.21.15.184:6824/36507] conn(0x7fbc6406b820 msgr2=0x7fbc6406dc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:18.253 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.245+0000 7fbc7d108700 1 --2- 172.21.15.39:0/2035082351 >> [v2:172.21.15.184:6821/36507,v1:172.21.15.184:6824/36507] conn(0x7fbc6406b820 0x7fbc6406dc50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:18.253 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.249+0000 7fbc7d108700 1 -- 172.21.15.39:0/2035082351 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fbc64064f10 msgr2=0x7fbc640673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:18.254 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.249+0000 7fbc7d108700 1 --2- 172.21.15.39:0/2035082351 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fbc64064f10 0x7fbc640673c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fbc7815b380 tx=0x7fbc6c0092e0 comp rx=0 tx=0).stop 2023-11-28T12:00:18.254 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.249+0000 7fbc7d108700 1 -- 172.21.15.39:0/2035082351 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc7806a340 msgr2=0x7fbc78152d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:18.254 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.249+0000 7fbc7d108700 1 --2- 172.21.15.39:0/2035082351 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc7806a340 0x7fbc78152d50 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fbc6800e870 tx=0x7fbc6800eb80 comp rx=0 tx=0).stop 2023-11-28T12:00:18.254 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.249+0000 7fbc7c907700 1 -- 172.21.15.39:0/2035082351 reap_dead start 2023-11-28T12:00:18.254 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.249+0000 7fbc7d108700 1 -- 172.21.15.39:0/2035082351 shutdown_connections 2023-11-28T12:00:18.254 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.249+0000 7fbc7d108700 1 -- 172.21.15.39:0/2035082351 >> 172.21.15.39:0/2035082351 conn(0x7fbc780b65b0 msgr2=0x7fbc78157840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:18.254 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.249+0000 7fbc7d108700 1 -- 172.21.15.39:0/2035082351 shutdown_connections 2023-11-28T12:00:18.255 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.249+0000 7fbc7d108700 1 -- 172.21.15.39:0/2035082351 wait complete. 2023-11-28T12:00:18.275 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-28T12:00:18.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.457+0000 7f4e6ea66700 1 Processor -- start 2023-11-28T12:00:18.464 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.457+0000 7f4e6ea66700 1 -- start start 2023-11-28T12:00:18.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.461+0000 7f4e6ea66700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e68160710 0x7f4e680cc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:18.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.461+0000 7f4e6ea66700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4e680cc860 0x7f4e68070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:18.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.461+0000 7f4e6ea66700 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e680ad6c0 con 0x7f4e680705c0 2023-11-28T12:00:18.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.461+0000 7f4e6ea66700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e68070a60 con 0x7f4e680cc860 2023-11-28T12:00:18.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.461+0000 7f4e6ea66700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6806b1c0 con 0x7f4e68160710 2023-11-28T12:00:18.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.461+0000 7f4e6d263700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4e680cc860 0x7f4e68070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:18.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.461+0000 7f4e6e265700 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f4e680705c0 0x7f4e68069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:55762/0 (socket says 172.21.15.39:55762) 2023-11-28T12:00:18.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.461+0000 7f4e6e265700 1 -- 172.21.15.39:0/3414288863 learned_addr learned my addr 172.21.15.39:0/3414288863 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T12:00:18.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.461+0000 7f4e6da64700 1 --2- 172.21.15.39:0/3414288863 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e68160710 0x7f4e680cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:18.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.461+0000 7f4e6d263700 1 -- 172.21.15.39:0/3414288863 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e68160710 msgr2=0x7f4e680cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:18.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.461+0000 7f4e6d263700 1 --2- 172.21.15.39:0/3414288863 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e68160710 0x7f4e680cc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:18.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.461+0000 7f4e6d263700 1 -- 172.21.15.39:0/3414288863 >> v1:172.21.15.39:6789/0 conn(0x7f4e680705c0 legacy=0x7f4e68069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:18.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.461+0000 7f4e6d263700 1 -- 172.21.15.39:0/3414288863 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e680adc60 con 0x7f4e680cc860 2023-11-28T12:00:18.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.461+0000 7f4e6ca62700 1 -- 172.21.15.39:0/3414288863 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 167422431 0 0) 0x7f4e680ad6c0 con 0x7f4e680705c0 2023-11-28T12:00:18.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.465+0000 7f4e6d263700 1 --2- 172.21.15.39:0/3414288863 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e680cc860 0x7f4e68070080 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f4e58009850 tx=0x7f4e58009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae11bf6be61858f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:18.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.465+0000 7f4e6ca62700 1 -- 172.21.15.39:0/3414288863 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e58011830 con 0x7f4e680cc860 2023-11-28T12:00:18.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.465+0000 7f4e6ca62700 1 -- 172.21.15.39:0/3414288863 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e58011990 con 0x7f4e680cc860 2023-11-28T12:00:18.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.465+0000 7f4e6ca62700 1 -- 172.21.15.39:0/3414288863 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e58011d40 con 0x7f4e680cc860 2023-11-28T12:00:18.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.465+0000 7f4e6ea66700 1 -- 172.21.15.39:0/3414288863 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e680cc860 msgr2=0x7f4e68070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:18.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.465+0000 7f4e6ea66700 1 --2- 172.21.15.39:0/3414288863 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e680cc860 0x7f4e68070080 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f4e58009850 tx=0x7f4e58009b60 comp rx=0 tx=0).stop 2023-11-28T12:00:18.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.465+0000 7f4e6ea66700 1 -- 172.21.15.39:0/3414288863 shutdown_connections 2023-11-28T12:00:18.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.465+0000 7f4e6ea66700 1 --2- 172.21.15.39:0/3414288863 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e680cc860 0x7f4e68070080 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:18.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.465+0000 7f4e6ea66700 1 --2- 172.21.15.39:0/3414288863 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e68160710 0x7f4e680cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:18.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.465+0000 7f4e6ea66700 1 -- 172.21.15.39:0/3414288863 >> 172.21.15.39:0/3414288863 conn(0x7f4e680b0f80 msgr2=0x7f4e680ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:18.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.465+0000 7f4e6ea66700 1 -- 172.21.15.39:0/3414288863 shutdown_connections 2023-11-28T12:00:18.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.465+0000 7f4e6ea66700 1 -- 172.21.15.39:0/3414288863 wait complete. 2023-11-28T12:00:18.473 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.469+0000 7f4e6ea66700 1 Processor -- start 2023-11-28T12:00:18.473 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.469+0000 7f4e6ea66700 1 -- start start 2023-11-28T12:00:18.474 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.469+0000 7f4e6ea66700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e680705c0 0x7f4e680b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:18.474 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.469+0000 7f4e6ea66700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e680cc860 0x7f4e6815b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:18.475 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.469+0000 7f4e6ea66700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e68160710 0x7f4e6815f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:18.475 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.469+0000 7f4e6ea66700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e681f9e80 con 0x7f4e680705c0 2023-11-28T12:00:18.475 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.469+0000 7f4e6ea66700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6815b560 con 0x7f4e680cc860 2023-11-28T12:00:18.475 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.469+0000 7f4e6ea66700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e681f8f20 con 0x7f4e68160710 2023-11-28T12:00:18.476 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.469+0000 7f4e6da64700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e680705c0 0x7f4e680b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:18.476 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.469+0000 7f4e6da64700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e680705c0 0x7f4e680b2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34468/0 (socket says 172.21.15.39:34468) 2023-11-28T12:00:18.476 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.469+0000 7f4e6da64700 1 -- 172.21.15.39:0/128739143 learned_addr learned my addr 172.21.15.39:0/128739143 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:18.476 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.469+0000 7f4e6d263700 1 --2- 172.21.15.39:0/128739143 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e680cc860 0x7f4e6815b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:18.476 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.469+0000 7f4e6e265700 1 --2- 172.21.15.39:0/128739143 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e68160710 0x7f4e6815f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:18.477 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.469+0000 7f4e6da64700 1 -- 172.21.15.39:0/128739143 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e68160710 msgr2=0x7f4e6815f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:18.477 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.469+0000 7f4e6da64700 1 --2- 172.21.15.39:0/128739143 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e68160710 0x7f4e6815f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:18.477 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.469+0000 7f4e6da64700 1 -- 172.21.15.39:0/128739143 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e680cc860 msgr2=0x7f4e6815b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:18.477 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.469+0000 7f4e6da64700 1 --2- 172.21.15.39:0/128739143 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e680cc860 0x7f4e6815b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:18.477 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.469+0000 7f4e6da64700 1 -- 172.21.15.39:0/128739143 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e580094b0 con 0x7f4e680705c0 2023-11-28T12:00:18.478 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.473+0000 7f4e6da64700 1 --2- 172.21.15.39:0/128739143 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e680705c0 0x7f4e680b2e70 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f4e6400e870 tx=0x7f4e6400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:18.478 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.473+0000 7f4e5e7fc700 1 -- 172.21.15.39:0/128739143 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e640095a0 con 0x7f4e680705c0 2023-11-28T12:00:18.478 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.473+0000 7f4e6ea66700 1 -- 172.21.15.39:0/128739143 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e6806b6b0 con 0x7f4e680705c0 2023-11-28T12:00:18.478 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.473+0000 7f4e5e7fc700 1 -- 172.21.15.39:0/128739143 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e64013680 con 0x7f4e680705c0 2023-11-28T12:00:18.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.473+0000 7f4e5e7fc700 1 -- 172.21.15.39:0/128739143 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e640139f0 con 0x7f4e680705c0 2023-11-28T12:00:18.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.473+0000 7f4e6ea66700 1 -- 172.21.15.39:0/128739143 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e6806b3d0 con 0x7f4e680705c0 2023-11-28T12:00:18.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.473+0000 7f4e6ea66700 1 -- 172.21.15.39:0/128739143 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e680ad8f0 con 0x7f4e680705c0 2023-11-28T12:00:18.480 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.477+0000 7f4e5e7fc700 1 -- 172.21.15.39:0/128739143 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4e64019030 con 0x7f4e680705c0 2023-11-28T12:00:18.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.477+0000 7f4e5e7fc700 1 --2- 172.21.15.39:0/128739143 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4e4c064ee0 0x7f4e4c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:18.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.477+0000 7f4e5e7fc700 1 -- 172.21.15.39:0/128739143 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f4e64081b90 con 0x7f4e680705c0 2023-11-28T12:00:18.483 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.477+0000 7f4e6d263700 1 --2- 172.21.15.39:0/128739143 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4e4c064ee0 0x7f4e4c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:18.484 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.481+0000 7f4e6d263700 1 --2- 172.21.15.39:0/128739143 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4e4c064ee0 0x7f4e4c067390 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f4e580090b0 tx=0x7f4e58008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:18.487 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.481+0000 7f4e5e7fc700 1 -- 172.21.15.39:0/128739143 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4e6404fd40 con 0x7f4e680705c0 2023-11-28T12:00:18.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.653+0000 7f4e6ea66700 1 -- 172.21.15.39:0/128739143 --> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e68073cb0 con 0x7f4e4c064ee0 2023-11-28T12:00:18.660 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.653+0000 7f4e5e7fc700 1 -- 172.21.15.39:0/128739143 <== mgr.4104 v2:172.21.15.184:6832/36166 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4e68073cb0 con 0x7f4e4c064ee0 2023-11-28T12:00:18.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.657+0000 7f4e6ea66700 1 -- 172.21.15.39:0/128739143 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4e4c064ee0 msgr2=0x7f4e4c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:18.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.657+0000 7f4e6ea66700 1 --2- 172.21.15.39:0/128739143 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4e4c064ee0 0x7f4e4c067390 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f4e580090b0 tx=0x7f4e58008030 comp rx=0 tx=0).stop 2023-11-28T12:00:18.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.657+0000 7f4e6ea66700 1 -- 172.21.15.39:0/128739143 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e680705c0 msgr2=0x7f4e680b2e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:18.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.657+0000 7f4e6ea66700 1 --2- 172.21.15.39:0/128739143 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e680705c0 0x7f4e680b2e70 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f4e6400e870 tx=0x7f4e6400eb80 comp rx=0 tx=0).stop 2023-11-28T12:00:18.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.657+0000 7f4e6ea66700 1 -- 172.21.15.39:0/128739143 shutdown_connections 2023-11-28T12:00:18.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.657+0000 7f4e6ea66700 1 --2- 172.21.15.39:0/128739143 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e68160710 0x7f4e6815f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:18.664 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.657+0000 7f4e6ea66700 1 --2- 172.21.15.39:0/128739143 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f4e4c064ee0 0x7f4e4c067390 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:18.664 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.657+0000 7f4e6ea66700 1 --2- 172.21.15.39:0/128739143 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e680cc860 0x7f4e6815b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:18.664 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.657+0000 7f4e6ea66700 1 --2- 172.21.15.39:0/128739143 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e680705c0 0x7f4e680b2e70 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:18.664 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.657+0000 7f4e6ea66700 1 -- 172.21.15.39:0/128739143 >> 172.21.15.39:0/128739143 conn(0x7f4e680b0f80 msgr2=0x7f4e68160ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:18.664 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.657+0000 7f4e6ea66700 1 -- 172.21.15.39:0/128739143 shutdown_connections 2023-11-28T12:00:18.664 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.657+0000 7f4e6ea66700 1 -- 172.21.15.39:0/128739143 wait complete. 2023-11-28T12:00:18.665 INFO:teuthology.orchestra.run.smithi039.stderr:instructed osd(s) 6 to deep-scrub 2023-11-28T12:00:18.685 INFO:tasks.ceph:Scrubbing osd.7 2023-11-28T12:00:18.685 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-28T12:00:18.882 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.877+0000 7fbea11b7700 1 Processor -- start 2023-11-28T12:00:18.883 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.877+0000 7fbea11b7700 1 -- start start 2023-11-28T12:00:18.885 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.881+0000 7fbea11b7700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fbe9c15c6e0 0x7fbe9c071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:18.886 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.881+0000 7fbea11b7700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbe9c071fe0 0x7fbe9c069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:18.886 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.881+0000 7fbea11b7700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe9c06a340 0x7fbe9c0b79a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:18.886 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.881+0000 7fbea11b7700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe9c0d2800 con 0x7fbe9c071fe0 2023-11-28T12:00:18.886 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.881+0000 7fbea11b7700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe9c06a7c0 con 0x7fbe9c15c6e0 2023-11-28T12:00:18.886 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.881+0000 7fbea11b7700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c15cab0 con 0x7fbe9c06a340 2023-11-28T12:00:18.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.881+0000 7fbe9b7fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbe9c071fe0 0x7fbe9c069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:18.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.881+0000 7fbe9b7fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbe9c071fe0 0x7fbe9c069e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34480/0 (socket says 172.21.15.39:34480) 2023-11-28T12:00:18.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.881+0000 7fbe9b7fe700 1 -- 172.21.15.39:0/1742144052 learned_addr learned my addr 172.21.15.39:0/1742144052 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:18.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.881+0000 7fbe9bfff700 1 --2- 172.21.15.39:0/1742144052 >> v2:172.21.15.184:3300/0 conn(0x7fbe9c15c6e0 0x7fbe9c071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:18.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.881+0000 7fbea09b6700 1 --2- 172.21.15.39:0/1742144052 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe9c06a340 0x7fbe9c0b79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:18.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.881+0000 7fbe9b7fe700 1 -- 172.21.15.39:0/1742144052 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe9c06a340 msgr2=0x7fbe9c0b79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:18.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.881+0000 7fbe9b7fe700 1 --2- 172.21.15.39:0/1742144052 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe9c06a340 0x7fbe9c0b79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:18.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.881+0000 7fbe9b7fe700 1 -- 172.21.15.39:0/1742144052 >> v2:172.21.15.184:3300/0 conn(0x7fbe9c15c6e0 msgr2=0x7fbe9c071aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:18.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.881+0000 7fbe9b7fe700 1 --2- 172.21.15.39:0/1742144052 >> v2:172.21.15.184:3300/0 conn(0x7fbe9c15c6e0 0x7fbe9c071aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:18.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.881+0000 7fbe9b7fe700 1 -- 172.21.15.39:0/1742144052 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe9c0702d0 con 0x7fbe9c071fe0 2023-11-28T12:00:18.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.881+0000 7fbe9b7fe700 1 --2- 172.21.15.39:0/1742144052 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe9c071fe0 0x7fbe9c069e00 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c06e290 tx=0x7fbe90009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13cf5d86d6cd73ff server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:18.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.881+0000 7fbe9affd700 1 -- 172.21.15.39:0/1742144052 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe90011830 con 0x7fbe9c071fe0 2023-11-28T12:00:18.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.885+0000 7fbe9affd700 1 -- 172.21.15.39:0/1742144052 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe90011990 con 0x7fbe9c071fe0 2023-11-28T12:00:18.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.885+0000 7fbe9affd700 1 -- 172.21.15.39:0/1742144052 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe90011d20 con 0x7fbe9c071fe0 2023-11-28T12:00:18.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.885+0000 7fbea11b7700 1 -- 172.21.15.39:0/1742144052 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe9c071fe0 msgr2=0x7fbe9c069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:18.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.885+0000 7fbea11b7700 1 --2- 172.21.15.39:0/1742144052 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe9c071fe0 0x7fbe9c069e00 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c06e290 tx=0x7fbe90009bf0 comp rx=0 tx=0).stop 2023-11-28T12:00:18.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.885+0000 7fbea11b7700 1 -- 172.21.15.39:0/1742144052 shutdown_connections 2023-11-28T12:00:18.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.885+0000 7fbea11b7700 1 --2- 172.21.15.39:0/1742144052 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe9c06a340 0x7fbe9c0b79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:18.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.885+0000 7fbea11b7700 1 --2- 172.21.15.39:0/1742144052 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe9c071fe0 0x7fbe9c069e00 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:18.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.885+0000 7fbea11b7700 1 --2- 172.21.15.39:0/1742144052 >> v2:172.21.15.184:3300/0 conn(0x7fbe9c15c6e0 0x7fbe9c071aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:18.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.885+0000 7fbea11b7700 1 -- 172.21.15.39:0/1742144052 >> 172.21.15.39:0/1742144052 conn(0x7fbe9c0b65b0 msgr2=0x7fbe9c071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:18.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.885+0000 7fbea11b7700 1 -- 172.21.15.39:0/1742144052 shutdown_connections 2023-11-28T12:00:18.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.885+0000 7fbea11b7700 1 -- 172.21.15.39:0/1742144052 wait complete. 2023-11-28T12:00:18.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.885+0000 7fbea11b7700 1 Processor -- start 2023-11-28T12:00:18.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.885+0000 7fbea11b7700 1 -- start start 2023-11-28T12:00:18.893 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.889+0000 7fbea11b7700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe9c06a340 0x7fbe9c0c8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:18.893 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.889+0000 7fbea11b7700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe9c071fe0 0x7fbe9c0b2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:18.893 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.889+0000 7fbea11b7700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe9c15c6e0 0x7fbe9c0b3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:18.893 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.889+0000 7fbea11b7700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c154ba0 con 0x7fbe9c06a340 2023-11-28T12:00:18.893 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.889+0000 7fbea11b7700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c0caf80 con 0x7fbe9c071fe0 2023-11-28T12:00:18.893 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.889+0000 7fbea11b7700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c154e00 con 0x7fbe9c15c6e0 2023-11-28T12:00:18.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.889+0000 7fbe9bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe9c06a340 0x7fbe9c0c8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:18.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.889+0000 7fbe9b7fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe9c071fe0 0x7fbe9c0b2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:18.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.889+0000 7fbe9bfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe9c06a340 0x7fbe9c0c8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34490/0 (socket says 172.21.15.39:34490) 2023-11-28T12:00:18.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.889+0000 7fbe9bfff700 1 -- 172.21.15.39:0/3076020075 learned_addr learned my addr 172.21.15.39:0/3076020075 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:18.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.889+0000 7fbea09b6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe9c15c6e0 0x7fbe9c0b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:18.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.889+0000 7fbe9bfff700 1 -- 172.21.15.39:0/3076020075 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe9c15c6e0 msgr2=0x7fbe9c0b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:18.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.889+0000 7fbe9bfff700 1 --2- 172.21.15.39:0/3076020075 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe9c15c6e0 0x7fbe9c0b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:18.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.889+0000 7fbe9bfff700 1 -- 172.21.15.39:0/3076020075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe9c071fe0 msgr2=0x7fbe9c0b2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:18.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.889+0000 7fbe9bfff700 1 --2- 172.21.15.39:0/3076020075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe9c071fe0 0x7fbe9c0b2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:18.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.889+0000 7fbe9bfff700 1 -- 172.21.15.39:0/3076020075 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe90009570 con 0x7fbe9c06a340 2023-11-28T12:00:18.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.889+0000 7fbe9bfff700 1 --2- 172.21.15.39:0/3076020075 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe9c06a340 0x7fbe9c0c8890 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c00e840 tx=0x7fbe8c00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:18.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.889+0000 7fbe98ff9700 1 -- 172.21.15.39:0/3076020075 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c0095a0 con 0x7fbe9c06a340 2023-11-28T12:00:18.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.889+0000 7fbe98ff9700 1 -- 172.21.15.39:0/3076020075 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8c013680 con 0x7fbe9c06a340 2023-11-28T12:00:18.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.889+0000 7fbe98ff9700 1 -- 172.21.15.39:0/3076020075 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c0139f0 con 0x7fbe9c06a340 2023-11-28T12:00:18.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.889+0000 7fbea11b7700 1 -- 172.21.15.39:0/3076020075 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe9c0d2cf0 con 0x7fbe9c06a340 2023-11-28T12:00:18.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.889+0000 7fbea11b7700 1 -- 172.21.15.39:0/3076020075 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe9c0d2a10 con 0x7fbe9c06a340 2023-11-28T12:00:18.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.893+0000 7fbea11b7700 1 -- 172.21.15.39:0/3076020075 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbe9c0d2fd0 con 0x7fbe9c06a340 2023-11-28T12:00:18.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.893+0000 7fbe98ff9700 1 -- 172.21.15.39:0/3076020075 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbe8c019030 con 0x7fbe9c06a340 2023-11-28T12:00:18.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.893+0000 7fbe98ff9700 1 --2- 172.21.15.39:0/3076020075 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fbe88064ee0 0x7fbe88067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:18.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.897+0000 7fbe98ff9700 1 -- 172.21.15.39:0/3076020075 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fbe8c081bb0 con 0x7fbe9c06a340 2023-11-28T12:00:18.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.897+0000 7fbe98ff9700 1 --2- 172.21.15.39:0/3076020075 >> [v2:172.21.15.184:6809/36506,v1:172.21.15.184:6811/36506] conn(0x7fbe8806b7f0 0x7fbe8806dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:18.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.897+0000 7fbe98ff9700 1 -- 172.21.15.39:0/3076020075 --> [v2:172.21.15.184:6809/36506,v1:172.21.15.184:6811/36506] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbe8806e2f0 con 0x7fbe8806b7f0 2023-11-28T12:00:18.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.897+0000 7fbe98ff9700 1 -- 172.21.15.39:0/3076020075 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe8c0862a0 con 0x7fbe9c06a340 2023-11-28T12:00:18.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.897+0000 7fbe9b7fe700 1 --2- 172.21.15.39:0/3076020075 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fbe88064ee0 0x7fbe88067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:18.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.897+0000 7fbea09b6700 1 --2- 172.21.15.39:0/3076020075 >> [v2:172.21.15.184:6809/36506,v1:172.21.15.184:6811/36506] conn(0x7fbe8806b7f0 0x7fbe8806dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:18.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.897+0000 7fbe9b7fe700 1 --2- 172.21.15.39:0/3076020075 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fbe88064ee0 0x7fbe88067390 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fbe90009860 tx=0x7fbe90008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:18.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.897+0000 7fbea09b6700 1 --2- 172.21.15.39:0/3076020075 >> [v2:172.21.15.184:6809/36506,v1:172.21.15.184:6811/36506] conn(0x7fbe8806b7f0 0x7fbe8806dc20 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:18.904 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.901+0000 7fbe98ff9700 1 -- 172.21.15.39:0/3076020075 <== osd.7 v2:172.21.15.184:6809/36506 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fbe8806e2f0 con 0x7fbe8806b7f0 2023-11-28T12:00:18.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.921+0000 7fbea11b7700 1 -- 172.21.15.39:0/3076020075 --> [v2:172.21.15.184:6809/36506,v1:172.21.15.184:6811/36506] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbe9c0cb0f0 con 0x7fbe8806b7f0 2023-11-28T12:00:18.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.921+0000 7fbe98ff9700 1 -- 172.21.15.39:0/3076020075 <== osd.7 v2:172.21.15.184:6809/36506 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fbe94011400 con 0x7fbe8806b7f0 2023-11-28T12:00:18.928 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2023-11-28T12:00:18.928 INFO:teuthology.orchestra.run.smithi039.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-28T12:00:18.928 INFO:teuthology.orchestra.run.smithi039.stdout:} 2023-11-28T12:00:18.930 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.921+0000 7fbea11b7700 1 -- 172.21.15.39:0/3076020075 >> [v2:172.21.15.184:6809/36506,v1:172.21.15.184:6811/36506] conn(0x7fbe8806b7f0 msgr2=0x7fbe8806dc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:18.931 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.921+0000 7fbea11b7700 1 --2- 172.21.15.39:0/3076020075 >> [v2:172.21.15.184:6809/36506,v1:172.21.15.184:6811/36506] conn(0x7fbe8806b7f0 0x7fbe8806dc20 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:18.931 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.921+0000 7fbea11b7700 1 -- 172.21.15.39:0/3076020075 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fbe88064ee0 msgr2=0x7fbe88067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:18.931 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.921+0000 7fbea11b7700 1 --2- 172.21.15.39:0/3076020075 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fbe88064ee0 0x7fbe88067390 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fbe90009860 tx=0x7fbe90008030 comp rx=0 tx=0).stop 2023-11-28T12:00:18.931 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.921+0000 7fbea11b7700 1 -- 172.21.15.39:0/3076020075 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe9c06a340 msgr2=0x7fbe9c0c8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:18.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.921+0000 7fbea11b7700 1 --2- 172.21.15.39:0/3076020075 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe9c06a340 0x7fbe9c0c8890 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c00e840 tx=0x7fbe8c00eb50 comp rx=0 tx=0).stop 2023-11-28T12:00:18.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.925+0000 7fbea09b6700 1 -- 172.21.15.39:0/3076020075 reap_dead start 2023-11-28T12:00:18.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.925+0000 7fbea11b7700 1 -- 172.21.15.39:0/3076020075 shutdown_connections 2023-11-28T12:00:18.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.925+0000 7fbea11b7700 1 -- 172.21.15.39:0/3076020075 >> 172.21.15.39:0/3076020075 conn(0x7fbe9c0b65b0 msgr2=0x7fbe9c0c9300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:18.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.925+0000 7fbea11b7700 1 -- 172.21.15.39:0/3076020075 shutdown_connections 2023-11-28T12:00:18.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:18.925+0000 7fbea11b7700 1 -- 172.21.15.39:0/3076020075 wait complete. 2023-11-28T12:00:18.954 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-28T12:00:19.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.129+0000 7f3519e51700 1 Processor -- start 2023-11-28T12:00:19.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.129+0000 7f3519e51700 1 -- start start 2023-11-28T12:00:19.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.129+0000 7f3519e51700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3514163cb0 0x7f3514164cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:19.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.129+0000 7f3519e51700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f35140cdfb0 0x7f351406cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:19.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.129+0000 7f3519e51700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f351406d2f0 0x7f351406bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:19.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.129+0000 7f3519e51700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35140cc290 con 0x7f3514163cb0 2023-11-28T12:00:19.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.129+0000 7f3519e51700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f351406d770 con 0x7f35140cdfb0 2023-11-28T12:00:19.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.129+0000 7f3519e51700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3514164080 con 0x7f351406d2f0 2023-11-28T12:00:19.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.133+0000 7f35137fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3514163cb0 0x7f3514164cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:19.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.133+0000 7f3512ffd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f35140cdfb0 0x7f351406cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:19.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.133+0000 7f35137fe700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3514163cb0 0x7f3514164cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34494/0 (socket says 172.21.15.39:34494) 2023-11-28T12:00:19.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.133+0000 7f35137fe700 1 -- 172.21.15.39:0/2683232048 learned_addr learned my addr 172.21.15.39:0/2683232048 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:19.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.133+0000 7f3513fff700 1 --2- 172.21.15.39:0/2683232048 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f351406d2f0 0x7f351406bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:19.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.133+0000 7f35137fe700 1 -- 172.21.15.39:0/2683232048 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f351406d2f0 msgr2=0x7f351406bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:19.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.133+0000 7f35137fe700 1 --2- 172.21.15.39:0/2683232048 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f351406d2f0 0x7f351406bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:19.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.133+0000 7f35137fe700 1 -- 172.21.15.39:0/2683232048 >> v2:172.21.15.184:3300/0 conn(0x7f35140cdfb0 msgr2=0x7f351406cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:19.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.133+0000 7f35137fe700 1 --2- 172.21.15.39:0/2683232048 >> v2:172.21.15.184:3300/0 conn(0x7f35140cdfb0 0x7f351406cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:19.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.133+0000 7f35137fe700 1 -- 172.21.15.39:0/2683232048 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3514069bf0 con 0x7f3514163cb0 2023-11-28T12:00:19.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.133+0000 7f35137fe700 1 --2- 172.21.15.39:0/2683232048 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3514163cb0 0x7f3514164cb0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f351406f480 tx=0x7f3504009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d077488b4ca2a08 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:19.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.133+0000 7f35127fc700 1 -- 172.21.15.39:0/2683232048 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3504011830 con 0x7f3514163cb0 2023-11-28T12:00:19.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.133+0000 7f35127fc700 1 -- 172.21.15.39:0/2683232048 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3504011990 con 0x7f3514163cb0 2023-11-28T12:00:19.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.133+0000 7f35127fc700 1 -- 172.21.15.39:0/2683232048 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3504011d20 con 0x7f3514163cb0 2023-11-28T12:00:19.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.133+0000 7f3519e51700 1 -- 172.21.15.39:0/2683232048 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3514163cb0 msgr2=0x7f3514164cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:19.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.133+0000 7f3519e51700 1 --2- 172.21.15.39:0/2683232048 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3514163cb0 0x7f3514164cb0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f351406f480 tx=0x7f3504009bf0 comp rx=0 tx=0).stop 2023-11-28T12:00:19.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.133+0000 7f3519e51700 1 -- 172.21.15.39:0/2683232048 shutdown_connections 2023-11-28T12:00:19.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.133+0000 7f3519e51700 1 --2- 172.21.15.39:0/2683232048 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f351406d2f0 0x7f351406bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:19.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.133+0000 7f3519e51700 1 --2- 172.21.15.39:0/2683232048 >> v2:172.21.15.184:3300/0 conn(0x7f35140cdfb0 0x7f351406cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:19.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.133+0000 7f3519e51700 1 --2- 172.21.15.39:0/2683232048 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3514163cb0 0x7f3514164cb0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:19.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.133+0000 7f3519e51700 1 -- 172.21.15.39:0/2683232048 >> 172.21.15.39:0/2683232048 conn(0x7f35140cf350 msgr2=0x7f35140b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:19.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.133+0000 7f3519e51700 1 -- 172.21.15.39:0/2683232048 shutdown_connections 2023-11-28T12:00:19.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.133+0000 7f3519e51700 1 -- 172.21.15.39:0/2683232048 wait complete. 2023-11-28T12:00:19.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.137+0000 7f3519e51700 1 Processor -- start 2023-11-28T12:00:19.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.137+0000 7f3519e51700 1 -- start start 2023-11-28T12:00:19.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.137+0000 7f3519e51700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f351406d2f0 0x7f35140c21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:19.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.137+0000 7f3519e51700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35140cdfb0 0x7f35140b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:19.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.137+0000 7f3519e51700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3514163cb0 0x7f3514153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:19.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.137+0000 7f3519e51700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35141f74e0 con 0x7f3514163cb0 2023-11-28T12:00:19.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.137+0000 7f3519e51700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35141f77c0 con 0x7f35140cdfb0 2023-11-28T12:00:19.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.137+0000 7f3519e51700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35141f7aa0 con 0x7f351406d2f0 2023-11-28T12:00:19.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.137+0000 7f3513fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3514163cb0 0x7f3514153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:19.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.137+0000 7f3513fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3514163cb0 0x7f3514153f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34510/0 (socket says 172.21.15.39:34510) 2023-11-28T12:00:19.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.137+0000 7f3513fff700 1 -- 172.21.15.39:0/2379919300 learned_addr learned my addr 172.21.15.39:0/2379919300 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:19.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.137+0000 7f3512ffd700 1 --2- 172.21.15.39:0/2379919300 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35140cdfb0 0x7f35140b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:19.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.137+0000 7f35137fe700 1 --2- 172.21.15.39:0/2379919300 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f351406d2f0 0x7f35140c21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:19.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.141+0000 7f35137fe700 1 -- 172.21.15.39:0/2379919300 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35140cdfb0 msgr2=0x7f35140b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:19.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.141+0000 7f35137fe700 1 --2- 172.21.15.39:0/2379919300 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35140cdfb0 0x7f35140b3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:19.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.141+0000 7f35137fe700 1 -- 172.21.15.39:0/2379919300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3514163cb0 msgr2=0x7f3514153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:19.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.141+0000 7f35137fe700 1 --2- 172.21.15.39:0/2379919300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3514163cb0 0x7f3514153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:19.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.141+0000 7f35137fe700 1 -- 172.21.15.39:0/2379919300 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3504009570 con 0x7f351406d2f0 2023-11-28T12:00:19.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.141+0000 7f35137fe700 1 --2- 172.21.15.39:0/2379919300 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f351406d2f0 0x7f35140c21b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3504016000 tx=0x7f3504004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:19.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.141+0000 7f34fbfff700 1 -- 172.21.15.39:0/2379919300 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3504004240 con 0x7f351406d2f0 2023-11-28T12:00:19.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.141+0000 7f34fbfff700 1 -- 172.21.15.39:0/2379919300 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350401f070 con 0x7f351406d2f0 2023-11-28T12:00:19.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.141+0000 7f34fbfff700 1 -- 172.21.15.39:0/2379919300 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3504004600 con 0x7f351406d2f0 2023-11-28T12:00:19.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.141+0000 7f3519e51700 1 -- 172.21.15.39:0/2379919300 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35140cc4a0 con 0x7f351406d2f0 2023-11-28T12:00:19.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.141+0000 7f3519e51700 1 -- 172.21.15.39:0/2379919300 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35141651f0 con 0x7f351406d2f0 2023-11-28T12:00:19.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.141+0000 7f3519e51700 1 -- 172.21.15.39:0/2379919300 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35140cc780 con 0x7f351406d2f0 2023-11-28T12:00:19.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.145+0000 7f34fbfff700 1 -- 172.21.15.39:0/2379919300 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f350400f050 con 0x7f351406d2f0 2023-11-28T12:00:19.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.145+0000 7f34fbfff700 1 --2- 172.21.15.39:0/2379919300 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3500064ee0 0x7f3500067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:19.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.145+0000 7f34fbfff700 1 -- 172.21.15.39:0/2379919300 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f3504083490 con 0x7f351406d2f0 2023-11-28T12:00:19.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.149+0000 7f3512ffd700 1 --2- 172.21.15.39:0/2379919300 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3500064ee0 0x7f3500067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:19.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.149+0000 7f3512ffd700 1 --2- 172.21.15.39:0/2379919300 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3500064ee0 0x7f3500067390 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f35140ca610 tx=0x7f3508009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:19.158 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.153+0000 7f34fbfff700 1 -- 172.21.15.39:0/2379919300 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3504051860 con 0x7f351406d2f0 2023-11-28T12:00:19.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.325+0000 7f3519e51700 1 -- 172.21.15.39:0/2379919300 --> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f35141f7be0 con 0x7f3500064ee0 2023-11-28T12:00:19.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.329+0000 7f34fbfff700 1 -- 172.21.15.39:0/2379919300 <== mgr.4104 v2:172.21.15.184:6832/36166 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f35141f7be0 con 0x7f3500064ee0 2023-11-28T12:00:19.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.329+0000 7f3519e51700 1 -- 172.21.15.39:0/2379919300 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3500064ee0 msgr2=0x7f3500067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:19.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.329+0000 7f3519e51700 1 --2- 172.21.15.39:0/2379919300 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3500064ee0 0x7f3500067390 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f35140ca610 tx=0x7f3508009240 comp rx=0 tx=0).stop 2023-11-28T12:00:19.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.329+0000 7f3519e51700 1 -- 172.21.15.39:0/2379919300 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f351406d2f0 msgr2=0x7f35140c21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:19.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.329+0000 7f3519e51700 1 --2- 172.21.15.39:0/2379919300 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f351406d2f0 0x7f35140c21b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3504016000 tx=0x7f3504004770 comp rx=0 tx=0).stop 2023-11-28T12:00:19.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.329+0000 7f3519e51700 1 -- 172.21.15.39:0/2379919300 shutdown_connections 2023-11-28T12:00:19.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.329+0000 7f3519e51700 1 --2- 172.21.15.39:0/2379919300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3514163cb0 0x7f3514153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:19.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.329+0000 7f3519e51700 1 --2- 172.21.15.39:0/2379919300 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f3500064ee0 0x7f3500067390 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:19.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.329+0000 7f3519e51700 1 --2- 172.21.15.39:0/2379919300 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35140cdfb0 0x7f35140b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:19.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.329+0000 7f3519e51700 1 --2- 172.21.15.39:0/2379919300 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f351406d2f0 0x7f35140c21b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:19.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.329+0000 7f3519e51700 1 -- 172.21.15.39:0/2379919300 >> 172.21.15.39:0/2379919300 conn(0x7f35140cf350 msgr2=0x7f351406a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:19.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.329+0000 7f3519e51700 1 -- 172.21.15.39:0/2379919300 shutdown_connections 2023-11-28T12:00:19.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.329+0000 7f3519e51700 1 -- 172.21.15.39:0/2379919300 wait complete. 2023-11-28T12:00:19.338 INFO:teuthology.orchestra.run.smithi039.stderr:instructed osd(s) 7 to deep-scrub 2023-11-28T12:00:19.358 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T12:00:19.534 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.529+0000 7fbc7d57a700 1 Processor -- start 2023-11-28T12:00:19.535 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.529+0000 7fbc7d57a700 1 -- start start 2023-11-28T12:00:19.536 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.529+0000 7fbc7d57a700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbc781603c0 0x7fbc780d0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:19.536 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.533+0000 7fbc7d57a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc780b2ac0 0x7fbc780b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:19.536 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.533+0000 7fbc7d57a700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc7806c060 con 0x7fbc7815c1f0 2023-11-28T12:00:19.537 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.533+0000 7fbc7d57a700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc780d0e80 con 0x7fbc781603c0 2023-11-28T12:00:19.537 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.533+0000 7fbc7d57a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc780b3470 con 0x7fbc780b2ac0 2023-11-28T12:00:19.538 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.533+0000 7fbc767fc700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbc781603c0 0x7fbc780d0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:19.538 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.533+0000 7fbc767fc700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbc781603c0 0x7fbc780d0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34514/0 (socket says 172.21.15.39:34514) 2023-11-28T12:00:19.538 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.533+0000 7fbc767fc700 1 -- 172.21.15.39:0/2558969768 learned_addr learned my addr 172.21.15.39:0/2558969768 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:19.538 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.533+0000 7fbc77fff700 1 --2- 172.21.15.39:0/2558969768 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc780b2ac0 0x7fbc780b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:19.538 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.533+0000 7fbc767fc700 1 -- 172.21.15.39:0/2558969768 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc780b2ac0 msgr2=0x7fbc780b2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:19.539 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.533+0000 7fbc767fc700 1 --2- 172.21.15.39:0/2558969768 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc780b2ac0 0x7fbc780b2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:19.539 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.533+0000 7fbc767fc700 1 -- 172.21.15.39:0/2558969768 >> v1:172.21.15.184:6789/0 conn(0x7fbc7815c1f0 legacy=0x7fbc7815fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:19.539 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.533+0000 7fbc767fc700 1 -- 172.21.15.39:0/2558969768 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc7815c5c0 con 0x7fbc781603c0 2023-11-28T12:00:19.539 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.533+0000 7fbc767fc700 1 --2- 172.21.15.39:0/2558969768 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc781603c0 0x7fbc780d0940 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c009940 tx=0x7fbc6c009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e55d46e0883f1bcd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:19.540 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.533+0000 7fbc75ffb700 1 -- 172.21.15.39:0/2558969768 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c00ba20 con 0x7fbc781603c0 2023-11-28T12:00:19.540 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.533+0000 7fbc75ffb700 1 -- 172.21.15.39:0/2558969768 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6c009e90 con 0x7fbc781603c0 2023-11-28T12:00:19.540 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.533+0000 7fbc75ffb700 1 -- 172.21.15.39:0/2558969768 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c00bda0 con 0x7fbc781603c0 2023-11-28T12:00:19.540 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.533+0000 7fbc7d57a700 1 -- 172.21.15.39:0/2558969768 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc781603c0 msgr2=0x7fbc780d0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:19.541 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.533+0000 7fbc7d57a700 1 --2- 172.21.15.39:0/2558969768 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc781603c0 0x7fbc780d0940 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c009940 tx=0x7fbc6c009c50 comp rx=0 tx=0).stop 2023-11-28T12:00:19.541 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.533+0000 7fbc7d57a700 1 -- 172.21.15.39:0/2558969768 shutdown_connections 2023-11-28T12:00:19.541 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.533+0000 7fbc7d57a700 1 --2- 172.21.15.39:0/2558969768 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc780b2ac0 0x7fbc780b2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:19.541 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.533+0000 7fbc7d57a700 1 --2- 172.21.15.39:0/2558969768 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc781603c0 0x7fbc780d0940 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:19.541 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.533+0000 7fbc7d57a700 1 -- 172.21.15.39:0/2558969768 >> 172.21.15.39:0/2558969768 conn(0x7fbc780d0fd0 msgr2=0x7fbc780d13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:19.541 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.533+0000 7fbc7d57a700 1 -- 172.21.15.39:0/2558969768 shutdown_connections 2023-11-28T12:00:19.541 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.533+0000 7fbc7d57a700 1 -- 172.21.15.39:0/2558969768 wait complete. 2023-11-28T12:00:19.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.537+0000 7fbc7d57a700 1 Processor -- start 2023-11-28T12:00:19.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.537+0000 7fbc7d57a700 1 -- start start 2023-11-28T12:00:19.545 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.541+0000 7fbc7d57a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc780b2ac0 0x7fbc781f6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:19.545 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.541+0000 7fbc7d57a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc7815c1f0 0x7fbc7815a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:19.546 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.541+0000 7fbc7d57a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc781603c0 0x7fbc78156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:19.546 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.541+0000 7fbc7d57a700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc780b6100 con 0x7fbc780b2ac0 2023-11-28T12:00:19.546 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.541+0000 7fbc7d57a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc780b3e00 con 0x7fbc7815c1f0 2023-11-28T12:00:19.546 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.541+0000 7fbc7d57a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc781f6d70 con 0x7fbc781603c0 2023-11-28T12:00:19.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.541+0000 7fbc76ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc780b2ac0 0x7fbc781f6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:19.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.541+0000 7fbc76ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc780b2ac0 0x7fbc781f6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34530/0 (socket says 172.21.15.39:34530) 2023-11-28T12:00:19.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.541+0000 7fbc76ffd700 1 -- 172.21.15.39:0/1557636226 learned_addr learned my addr 172.21.15.39:0/1557636226 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:19.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.541+0000 7fbc767fc700 1 --2- 172.21.15.39:0/1557636226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc7815c1f0 0x7fbc7815a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:19.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.541+0000 7fbc77fff700 1 --2- 172.21.15.39:0/1557636226 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc781603c0 0x7fbc78156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:19.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.541+0000 7fbc76ffd700 1 -- 172.21.15.39:0/1557636226 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc781603c0 msgr2=0x7fbc78156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:19.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.541+0000 7fbc76ffd700 1 --2- 172.21.15.39:0/1557636226 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc781603c0 0x7fbc78156f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:19.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.541+0000 7fbc76ffd700 1 -- 172.21.15.39:0/1557636226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc7815c1f0 msgr2=0x7fbc7815a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:19.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.541+0000 7fbc76ffd700 1 --2- 172.21.15.39:0/1557636226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc7815c1f0 0x7fbc7815a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:19.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.541+0000 7fbc76ffd700 1 -- 172.21.15.39:0/1557636226 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6c009570 con 0x7fbc780b2ac0 2023-11-28T12:00:19.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.541+0000 7fbc76ffd700 1 --2- 172.21.15.39:0/1557636226 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc780b2ac0 0x7fbc781f6830 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fbc6800c500 tx=0x7fbc6800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:19.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.541+0000 7fbc5f7fe700 1 -- 172.21.15.39:0/1557636226 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc680052d0 con 0x7fbc780b2ac0 2023-11-28T12:00:19.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.541+0000 7fbc5f7fe700 1 -- 172.21.15.39:0/1557636226 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc68005430 con 0x7fbc780b2ac0 2023-11-28T12:00:19.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.541+0000 7fbc5f7fe700 1 -- 172.21.15.39:0/1557636226 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc680055a0 con 0x7fbc780b2ac0 2023-11-28T12:00:19.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.541+0000 7fbc7d57a700 1 -- 172.21.15.39:0/1557636226 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc78160b30 con 0x7fbc780b2ac0 2023-11-28T12:00:19.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.541+0000 7fbc7d57a700 1 -- 172.21.15.39:0/1557636226 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc78160850 con 0x7fbc780b2ac0 2023-11-28T12:00:19.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.545+0000 7fbc7d57a700 1 -- 172.21.15.39:0/1557636226 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc780cfe60 con 0x7fbc780b2ac0 2023-11-28T12:00:19.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.545+0000 7fbc5f7fe700 1 -- 172.21.15.39:0/1557636226 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbc68019030 con 0x7fbc780b2ac0 2023-11-28T12:00:19.552 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.549+0000 7fbc5f7fe700 1 --2- 172.21.15.39:0/1557636226 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fbc64064ee0 0x7fbc64067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:19.552 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.549+0000 7fbc5f7fe700 1 -- 172.21.15.39:0/1557636226 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fbc68081090 con 0x7fbc780b2ac0 2023-11-28T12:00:19.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.549+0000 7fbc767fc700 1 --2- 172.21.15.39:0/1557636226 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fbc64064ee0 0x7fbc64067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:19.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.549+0000 7fbc767fc700 1 --2- 172.21.15.39:0/1557636226 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fbc64064ee0 0x7fbc64067390 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbc780b3ae0 tx=0x7fbc6c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:19.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.557+0000 7fbc5f7fe700 1 -- 172.21.15.39:0/1557636226 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbc6804f320 con 0x7fbc780b2ac0 2023-11-28T12:00:19.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.725+0000 7fbc7d57a700 1 -- 172.21.15.39:0/1557636226 --> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbc780b3f70 con 0x7fbc64064ee0 2023-11-28T12:00:19.737 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.733+0000 7fbc5f7fe700 1 -- 172.21.15.39:0/1557636226 <== mgr.4104 v2:172.21.15.184:6832/36166 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+69996 (secure 0 0 0) 0x7fbc780b3f70 con 0x7fbc64064ee0 2023-11-28T12:00:19.738 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T12:00:19.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.733+0000 7fbc7d57a700 1 -- 172.21.15.39:0/1557636226 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fbc64064ee0 msgr2=0x7fbc64067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:19.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.733+0000 7fbc7d57a700 1 --2- 172.21.15.39:0/1557636226 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fbc64064ee0 0x7fbc64067390 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbc780b3ae0 tx=0x7fbc6c008030 comp rx=0 tx=0).stop 2023-11-28T12:00:19.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.733+0000 7fbc7d57a700 1 -- 172.21.15.39:0/1557636226 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc780b2ac0 msgr2=0x7fbc781f6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:19.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.733+0000 7fbc7d57a700 1 --2- 172.21.15.39:0/1557636226 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc780b2ac0 0x7fbc781f6830 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fbc6800c500 tx=0x7fbc6800c810 comp rx=0 tx=0).stop 2023-11-28T12:00:19.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.737+0000 7fbc7d57a700 1 -- 172.21.15.39:0/1557636226 shutdown_connections 2023-11-28T12:00:19.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.737+0000 7fbc7d57a700 1 --2- 172.21.15.39:0/1557636226 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc781603c0 0x7fbc78156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:19.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.737+0000 7fbc7d57a700 1 --2- 172.21.15.39:0/1557636226 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7fbc64064ee0 0x7fbc64067390 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:19.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.737+0000 7fbc7d57a700 1 --2- 172.21.15.39:0/1557636226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc7815c1f0 0x7fbc7815a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:19.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.737+0000 7fbc7d57a700 1 --2- 172.21.15.39:0/1557636226 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc780b2ac0 0x7fbc781f6830 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:19.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.737+0000 7fbc7d57a700 1 -- 172.21.15.39:0/1557636226 >> 172.21.15.39:0/1557636226 conn(0x7fbc780d0fd0 msgr2=0x7fbc7806e100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:19.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.737+0000 7fbc7d57a700 1 -- 172.21.15.39:0/1557636226 shutdown_connections 2023-11-28T12:00:19.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:19.737+0000 7fbc7d57a700 1 -- 172.21.15.39:0/1557636226 wait complete. 2023-11-28T12:00:19.743 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2023-11-28T12:00:19.763 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":183,"stamp":"2023-11-28T12:00:18.630068+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":98756,"kb_used_data":8068,"kb_used_omap":0,"kb_used_meta":90624,"kb_avail":754875964,"statfs":{"total":773094113280,"available":772992987136,"internally_reserved":0,"allocated":8261632,"data_stored":4467753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":92798976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":-2,"num_read_kb":-2,"num_write":-3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002681"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T12:00:08.005550+0000","last_change":"2023-11-28T11:56:34.384408+0000","last_active":"2023-11-28T12:00:08.005550+0000","last_peered":"2023-11-28T12:00:08.005550+0000","last_clean":"2023-11-28T12:00:08.005550+0000","last_became_active":"2023-11-28T11:56:34.384036+0000","last_became_peered":"2023-11-28T11:56:34.384036+0000","last_unstale":"2023-11-28T12:00:08.005550+0000","last_undegraded":"2023-11-28T12:00:08.005550+0000","last_fullsized":"2023-11-28T12:00:08.005550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:58:55.003786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T12:00:09.015296+0000","last_change":"2023-11-28T11:56:34.384088+0000","last_active":"2023-11-28T12:00:09.015296+0000","last_peered":"2023-11-28T12:00:09.015296+0000","last_clean":"2023-11-28T12:00:09.015296+0000","last_became_active":"2023-11-28T11:56:34.383631+0000","last_became_peered":"2023-11-28T11:56:34.383631+0000","last_unstale":"2023-11-28T12:00:09.015296+0000","last_undegraded":"2023-11-28T12:00:09.015296+0000","last_fullsized":"2023-11-28T12:00:09.015296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T12:00:08.083626+0000","last_change":"2023-11-28T11:56:34.386399+0000","last_active":"2023-11-28T12:00:08.083626+0000","last_peered":"2023-11-28T12:00:08.083626+0000","last_clean":"2023-11-28T12:00:08.083626+0000","last_became_active":"2023-11-28T11:56:34.385994+0000","last_became_peered":"2023-11-28T11:56:34.385994+0000","last_unstale":"2023-11-28T12:00:08.083626+0000","last_undegraded":"2023-11-28T12:00:08.083626+0000","last_fullsized":"2023-11-28T12:00:08.083626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:58:02.172295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T12:00:09.017460+0000","last_change":"2023-11-28T11:56:34.384999+0000","last_active":"2023-11-28T12:00:09.017460+0000","last_peered":"2023-11-28T12:00:09.017460+0000","last_clean":"2023-11-28T12:00:09.017460+0000","last_became_active":"2023-11-28T11:56:34.384531+0000","last_became_peered":"2023-11-28T11:56:34.384531+0000","last_unstale":"2023-11-28T12:00:09.017460+0000","last_undegraded":"2023-11-28T12:00:09.017460+0000","last_fullsized":"2023-11-28T12:00:09.017460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":53,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-28T12:00:06.184278+0000","last_change":"2023-11-28T11:56:34.389076+0000","last_active":"2023-11-28T12:00:06.184278+0000","last_peered":"2023-11-28T12:00:06.184278+0000","last_clean":"2023-11-28T12:00:06.184278+0000","last_became_active":"2023-11-28T11:56:34.388689+0000","last_became_peered":"2023-11-28T11:56:34.388689+0000","last_unstale":"2023-11-28T12:00:06.184278+0000","last_undegraded":"2023-11-28T12:00:06.184278+0000","last_fullsized":"2023-11-28T12:00:06.184278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:20.936349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":57,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T12:00:08.007415+0000","last_change":"2023-11-28T11:56:34.486178+0000","last_active":"2023-11-28T12:00:08.007415+0000","last_peered":"2023-11-28T12:00:08.007415+0000","last_clean":"2023-11-28T12:00:08.007415+0000","last_became_active":"2023-11-28T11:56:34.485702+0000","last_became_peered":"2023-11-28T11:56:34.485702+0000","last_unstale":"2023-11-28T12:00:08.007415+0000","last_undegraded":"2023-11-28T12:00:08.007415+0000","last_fullsized":"2023-11-28T12:00:08.007415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:01:06.323407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T12:00:08.082076+0000","last_change":"2023-11-28T11:56:34.387293+0000","last_active":"2023-11-28T12:00:08.082076+0000","last_peered":"2023-11-28T12:00:08.082076+0000","last_clean":"2023-11-28T12:00:08.082076+0000","last_became_active":"2023-11-28T11:56:34.386976+0000","last_became_peered":"2023-11-28T11:56:34.386976+0000","last_unstale":"2023-11-28T12:00:08.082076+0000","last_undegraded":"2023-11-28T12:00:08.082076+0000","last_fullsized":"2023-11-28T12:00:08.082076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:32.704729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":53,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-28T12:00:06.184427+0000","last_change":"2023-11-28T11:56:34.389222+0000","last_active":"2023-11-28T12:00:06.184427+0000","last_peered":"2023-11-28T12:00:06.184427+0000","last_clean":"2023-11-28T12:00:06.184427+0000","last_became_active":"2023-11-28T11:56:34.388671+0000","last_became_peered":"2023-11-28T11:56:34.388671+0000","last_unstale":"2023-11-28T12:00:06.184427+0000","last_undegraded":"2023-11-28T12:00:06.184427+0000","last_fullsized":"2023-11-28T12:00:06.184427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:33.351098+0000","last_clean_scrub_stamp":"2023-11-28T11:56:33.351098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:32.704729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":208,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-28T12:00:08.082305+0000","last_change":"2023-11-28T11:56:28.472008+0000","last_active":"2023-11-28T12:00:08.082305+0000","last_peered":"2023-11-28T12:00:08.082305+0000","last_clean":"2023-11-28T12:00:08.082305+0000","last_became_active":"2023-11-28T11:56:28.469273+0000","last_became_peered":"2023-11-28T11:56:28.469273+0000","last_unstale":"2023-11-28T12:00:08.082305+0000","last_undegraded":"2023-11-28T12:00:08.082305+0000","last_fullsized":"2023-11-28T12:00:08.082305+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:27.291192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:27.291192+0000","last_clean_scrub_stamp":"2023-11-28T11:56:27.291192+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:14:48.860420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509489,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15276,"kb_used_data":1444,"kb_used_omap":0,"kb_used_meta":13824,"kb_avail":94356564,"statfs":{"total":96636764160,"available":96621121536,"internally_reserved":0,"allocated":1478656,"data_stored":1001360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14155776},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.0880000000000001,"15min":1.0960000000000001},"min":{"1min":0.77000000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4379999999999999,"5min":1.468,"15min":1.468},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.101,"5min":1.083,"15min":1.079},"min":{"1min":0.81699999999999995,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.615,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.0109999999999999}]},{"osd":1,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.1950000000000001,"15min":1.204},"min":{"1min":0.83999999999999997,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.542,"5min":1.71,"15min":1.71},"last":1.081},{"interface":"front","average":{"1min":1.143,"5min":1.1659999999999999,"15min":1.177},"min":{"1min":0.79500000000000004,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.502,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.21}]},{"osd":2,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.165,"15min":1.181},"min":{"1min":0.73099999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.579,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.2629999999999999,"15min":1.2789999999999999},"min":{"1min":0.82399999999999995,"5min":0.749,"15min":0.749},"max":{"1min":1.5209999999999999,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.161}]},{"osd":3,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2869999999999999,"15min":1.3109999999999999},"min":{"1min":0.872,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.4610000000000001,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.415},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.337,"15min":1.355},"min":{"1min":1.006,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.5629999999999999,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.2749999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.244,"15min":1.294},"min":{"1min":0.90000000000000002,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.278,"15min":1.3300000000000001},"min":{"1min":0.92700000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.5129999999999999,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.3440000000000001}]},{"osd":5,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.377,"15min":1.429},"min":{"1min":0.91900000000000004,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.5549999999999999,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.387},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.353,"15min":1.391},"min":{"1min":1.145,"5min":0.872,"15min":0.872},"max":{"1min":1.603,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":1.3100000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.494,"15min":1.548},"min":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"max":{"1min":1.706,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.319,"5min":1.401,"15min":1.4470000000000001},"min":{"1min":1.0760000000000001,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.5920000000000001,"5min":2.468,"15min":2.468},"last":1.47}]}]},{"osd":6,"up_from":15,"seq":64424509489,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10024,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":9152,"kb_avail":94361816,"statfs":{"total":96636764160,"available":96626499584,"internally_reserved":0,"allocated":884736,"data_stored":410992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9371648},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.004,"15min":0.99399999999999999},"min":{"1min":0.59899999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.5149999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.044,"5min":1.1539999999999999,"15min":1.1899999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.5049999999999999,"5min":2.347,"15min":2.347},"last":1.042}]},{"osd":1,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1699999999999999,"15min":1.1739999999999999},"min":{"1min":0.79900000000000004,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":1.375},{"interface":"front","average":{"1min":1.137,"5min":1.157,"15min":1.171},"min":{"1min":0.72699999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.454,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":1.0960000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.198,"15min":1.242},"min":{"1min":0.754,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4410000000000001,"5min":3.9620000000000002,"15min":3.9620000000000002},"last":1.125},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1639999999999999,"15min":1.1679999999999999},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.2729999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.258,"15min":1.26},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.496,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.2},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.258,"15min":1.268},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.5209999999999999,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.96899999999999997}]},{"osd":4,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.2050000000000001,"15min":1.232},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.4179999999999999,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.4159999999999999,"15min":1.4670000000000001},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.8540000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.83699999999999997}]},{"osd":5,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.2250000000000001,"15min":1.266},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.175,"5min":1.244,"15min":1.27},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":1.181}]},{"osd":7,"last update":"Tue Nov 28 11:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.3200000000000001,"15min":1.3360000000000001},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.24},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.343,"15min":1.355},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.978,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.325}]}]},{"osd":5,"up_from":15,"seq":64424509489,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9832,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94362008,"statfs":{"total":96636764160,"available":96626696192,"internally_reserved":0,"allocated":884736,"data_stored":410992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.0840000000000001,"15min":1.089},"min":{"1min":0.73899999999999999,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.3500000000000001,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.105},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.0900000000000001,"15min":1.0820000000000001},"min":{"1min":0.90400000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.359,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.409}]},{"osd":1,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1479999999999999,"15min":1.1519999999999999},"min":{"1min":0.77500000000000002,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.48,"5min":1.843,"15min":1.843},"last":1.139},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.0920000000000001,"15min":1.0900000000000001},"min":{"1min":0.77300000000000002,"5min":0.752,"15min":0.752},"max":{"1min":1.4870000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.1819999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.171,"15min":1.167},"min":{"1min":0.77600000000000002,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":1.054},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.1930000000000001,"15min":1.198},"min":{"1min":0.86899999999999999,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.4990000000000001,"5min":1.79,"15min":1.79},"last":0.97499999999999998}]},{"osd":3,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.252,"15min":1.2729999999999999},"min":{"1min":0.84099999999999997,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.5649999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.252},{"interface":"front","average":{"1min":1.353,"5min":1.365,"15min":1.3919999999999999},"min":{"1min":1.0069999999999999,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.712,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.218}]},{"osd":4,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.1739999999999999,"15min":1.2090000000000001},"min":{"1min":0.77900000000000003,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.431,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.228,"15min":1.234},"min":{"1min":0.876,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.4770000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.159}]},{"osd":6,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.2689999999999999,"15min":1.276},"min":{"1min":0.91800000000000004,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.6259999999999999,"5min":1.732,"15min":1.732},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.2829999999999999,"15min":1.2849999999999999},"min":{"1min":0.99399999999999999,"5min":0.874,"15min":0.874},"max":{"1min":1.4550000000000001,"5min":1.704,"15min":1.704},"last":1.286}]},{"osd":7,"last update":"Tue Nov 28 11:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3520000000000001,"15min":1.3620000000000001},"min":{"1min":0.97499999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.6859999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.337},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.446,"15min":1.472},"min":{"1min":1.05,"5min":1.002,"15min":1.002},"max":{"1min":1.762,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.0289999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":14248,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":13376,"kb_avail":94357592,"statfs":{"total":96636764160,"available":96622174208,"internally_reserved":0,"allocated":884736,"data_stored":410992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13697024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.109,"15min":1.1100000000000001},"min":{"1min":0.76100000000000001,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5429999999999999,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.1279999999999999,"15min":1.1519999999999999},"min":{"1min":0.71699999999999997,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.554,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.89700000000000002}]},{"osd":1,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.173,"15min":1.2090000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.496,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.01},{"interface":"front","average":{"1min":1.171,"5min":1.1819999999999999,"15min":1.202},"min":{"1min":0.70999999999999996,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.7190000000000001,"5min":2.8860000000000001,"15min":2.8860000000000001},"last":1.4419999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.208,"15min":1.238},"min":{"1min":0.81999999999999995,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.589,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.135},{"interface":"front","average":{"1min":1.236,"5min":1.3520000000000001,"15min":1.403},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.5389999999999999,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":1.3100000000000001}]},{"osd":3,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.282,"15min":1.3160000000000001},"min":{"1min":0.89700000000000002,"5min":0.746,"15min":0.746},"max":{"1min":1.4790000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.075},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3560000000000001,"15min":1.3740000000000001},"min":{"1min":1.004,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.877,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.2010000000000001}]},{"osd":5,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.3640000000000001,"15min":1.431},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.0139999999999998,"5min":2.972,"15min":2.972},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.296,"15min":1.353},"min":{"1min":0.78600000000000003,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.2389999999999999,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.151}]},{"osd":6,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3580000000000001,"15min":1.4059999999999999},"min":{"1min":0.96699999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.919,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.49,"15min":1.542},"min":{"1min":1.0189999999999999,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":2.0790000000000002,"5min":3.133,"15min":3.133},"last":1.611}]},{"osd":7,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.4570000000000001,"15min":1.5169999999999999},"min":{"1min":0.95199999999999996,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.992,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.242},{"interface":"front","average":{"1min":1.474,"5min":1.5369999999999999,"15min":1.5880000000000001},"min":{"1min":1.145,"5min":1.0760000000000001,"15min":1.0760000000000001},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.361}]}]},{"osd":3,"up_from":15,"seq":64424509489,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14184,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":13312,"kb_avail":94357656,"statfs":{"total":96636764160,"available":96622239744,"internally_reserved":0,"allocated":884736,"data_stored":410992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13631488},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.82999999999999996,"15min":0.84199999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.292,"5min":1.478,"15min":1.478},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.91900000000000004,"15min":0.91800000000000004},"min":{"1min":0.64200000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.276,"5min":2.177,"15min":2.177},"last":0.40200000000000002}]},{"osd":1,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.86699999999999999,"15min":0.86599999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.468,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.006,"5min":1.044,"15min":1.0600000000000001},"min":{"1min":0.59099999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4179999999999999,"5min":1.968,"15min":1.968},"last":0.66800000000000004}]},{"osd":2,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.109,"15min":1.139},"min":{"1min":0.63700000000000001,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.548,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.171,"15min":1.2070000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.5389999999999999,"5min":2.093,"15min":2.093},"last":0.80700000000000005}]},{"osd":4,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.1719999999999999,"15min":1.1779999999999999},"min":{"1min":0.84199999999999997,"5min":0.75,"15min":0.75},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.294,"15min":1.3320000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.837,"5min":2.8439999999999999,"15min":2.8439999999999999},"last":1.0169999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.325,"15min":1.359},"min":{"1min":0.85699999999999998,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.6040000000000001,"5min":2.9670000000000001,"15min":2.9670000000000001},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3999999999999999,"15min":1.444},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.655,"5min":3.7429999999999999,"15min":3.7429999999999999},"last":1.141}]},{"osd":6,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3360000000000001,"15min":1.3520000000000001},"min":{"1min":0.91700000000000004,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.077,"5min":2.323,"15min":2.323},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.407,"15min":1.444},"min":{"1min":0.93899999999999995,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.7210000000000001,"5min":2.927,"15min":2.927},"last":1.2250000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:59:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.4570000000000001,"15min":1.498},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.794,"5min":3.5030000000000001,"15min":3.5030000000000001},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.369,"5min":1.4430000000000001,"15min":1.4750000000000001},"min":{"1min":1.0720000000000001,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.1549999999999998,"5min":2.6320000000000001,"15min":2.6320000000000001},"last":0.89900000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509489,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14120,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":13248,"kb_avail":94357720,"statfs":{"total":96636764160,"available":96622305280,"internally_reserved":0,"allocated":884736,"data_stored":410992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13565952},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.89300000000000002,"15min":0.93400000000000005},"min":{"1min":0.495,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.3919999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.018,"15min":1.0089999999999999},"min":{"1min":0.67700000000000005,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.5429999999999999,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.90600000000000003}]},{"osd":2,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.069,"15min":1.083},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.6160000000000001,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0860000000000001,"15min":1.1000000000000001},"min":{"1min":0.72599999999999998,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.7769999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.64400000000000002}]},{"osd":3,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.1859999999999999,"15min":1.2030000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.635,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.137},{"interface":"front","average":{"1min":1.103,"5min":1.1339999999999999,"15min":1.171},"min":{"1min":0.65600000000000003,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.4670000000000001,"5min":1.8,"15min":1.8},"last":1.0660000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.353,"15min":1.3720000000000001},"min":{"1min":1.002,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.6890000000000001,"5min":3.411,"15min":3.411},"last":0.999},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.3009999999999999,"15min":1.339},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.7969999999999999,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":1.1719999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.3799999999999999,"15min":1.423},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.9039999999999999,"5min":3.6869999999999998,"15min":3.6869999999999998},"last":1.083},{"interface":"front","average":{"1min":1.284,"5min":1.306,"15min":1.3260000000000001},"min":{"1min":0.97699999999999998,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.736,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.4039999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.4239999999999999,"15min":1.4550000000000001},"min":{"1min":0.99399999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.8899999999999999,"5min":3.5379999999999998,"15min":3.5379999999999998},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.4470000000000001,"15min":1.49},"min":{"1min":0.84099999999999997,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.0259999999999998,"5min":2.5739999999999998,"15min":2.5739999999999998},"last":1.296}]},{"osd":7,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.4510000000000001,"15min":1.4770000000000001},"min":{"1min":1.1040000000000001,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.9490000000000001,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.468},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.492,"15min":1.52},"min":{"1min":1.1870000000000001,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.986,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.3129999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542193,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9896,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":9024,"kb_avail":94361944,"statfs":{"total":96636764160,"available":96626630656,"internally_reserved":0,"allocated":884736,"data_stored":410992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9240576},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:27 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85499999999999998,"15min":0.86699999999999999},"min":{"1min":0.59999999999999998,"5min":0.497,"15min":0.497},"max":{"1min":1.28,"5min":1.722,"15min":1.722},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.98199999999999998,"15min":1.002},"min":{"1min":0.55800000000000005,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.389,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":1.1200000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.01,"15min":1.028},"min":{"1min":0.58699999999999997,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.276,"5min":1.754,"15min":1.754},"last":1.302},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.92800000000000005,"15min":0.93999999999999995},"min":{"1min":0.627,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2729999999999999,"5min":1.484,"15min":1.484},"last":0.86599999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.105,"15min":1.127},"min":{"1min":0.74299999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.5109999999999999,"5min":2.048,"15min":2.048},"last":1.268},{"interface":"front","average":{"1min":1.214,"5min":1.2629999999999999,"15min":1.2869999999999999},"min":{"1min":0.81399999999999995,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.6699999999999999,"5min":2.617,"15min":2.617},"last":1.1759999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3460000000000001,"15min":1.3799999999999999},"min":{"1min":1.0580000000000001,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.6619999999999999,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2370000000000001,"15min":1.2509999999999999},"min":{"1min":0.86199999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.6830000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":1.2230000000000001}]},{"osd":5,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.3129999999999999,"15min":1.343},"min":{"1min":0.93999999999999995,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.6759999999999999,"5min":2.738,"15min":2.738},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.288,"5min":1.4570000000000001,"15min":1.5349999999999999},"min":{"1min":0.92100000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.7350000000000001,"5min":4.0309999999999997,"15min":4.0309999999999997},"last":1.446}]},{"osd":6,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.5289999999999999,"15min":1.593},"min":{"1min":1.0529999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.8,"5min":4.2240000000000002,"15min":4.2240000000000002},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.363,"5min":1.4770000000000001,"15min":1.534},"min":{"1min":1.0600000000000001,"5min":0.755,"15min":0.755},"max":{"1min":1.7430000000000001,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":1.508}]},{"osd":7,"last update":"Tue Nov 28 11:59:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.413,"15min":1.4490000000000001},"min":{"1min":0.90200000000000002,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.776,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.345},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.591,"15min":1.653},"min":{"1min":1.01,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.8460000000000001,"5min":4.3570000000000002,"15min":4.3570000000000002},"last":1.484}]}]},{"osd":0,"up_from":14,"seq":60129542193,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11176,"kb_used_data":1440,"kb_used_omap":0,"kb_used_meta":9728,"kb_avail":94360664,"statfs":{"total":96636764160,"available":96625319936,"internally_reserved":0,"allocated":1474560,"data_stored":1000441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9961472},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.85999999999999999,"15min":0.875},"min":{"1min":0.54500000000000004,"5min":0.439,"15min":0.439},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.997,"5min":0.99299999999999999,"15min":1.0089999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.5569999999999999,"5min":1.7,"15min":1.7},"last":0.81999999999999995}]},{"osd":2,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":1.0109999999999999,"15min":1.0409999999999999},"min":{"1min":0.61899999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2929999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.4650000000000001},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.91800000000000004,"15min":0.92200000000000004},"min":{"1min":0.59399999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.444,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.87}]},{"osd":3,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.046,"15min":1.0700000000000001},"min":{"1min":0.68000000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.5940000000000001,"5min":1.645,"15min":1.645},"last":1.349},{"interface":"front","average":{"1min":1.093,"5min":1.208,"15min":1.2310000000000001},"min":{"1min":0.77100000000000002,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.403,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.373}]},{"osd":4,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.294,"15min":1.3320000000000001},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.5,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.071},{"interface":"front","average":{"1min":1.149,"5min":1.3240000000000001,"15min":1.383},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.3899999999999999,"5min":3.1629999999999998,"15min":3.1629999999999998},"last":1.097}]},{"osd":5,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.331,"15min":1.353},"min":{"1min":0.91300000000000003,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.583,"5min":2.23,"15min":2.23},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.363,"15min":1.407},"min":{"1min":0.97199999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.494,"5min":2.266,"15min":2.266},"last":1.27}]},{"osd":6,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.4530000000000001,"15min":1.5009999999999999},"min":{"1min":0.99299999999999999,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.7629999999999999,"5min":2.4060000000000001,"15min":2.4060000000000001},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.4470000000000001,"15min":1.488},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.752,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":1.3149999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:59:31 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.4810000000000001,"15min":1.5109999999999999},"min":{"1min":1.0800000000000001,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.869,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.514},{"interface":"front","average":{"1min":1.331,"5min":1.5029999999999999,"15min":1.556},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":1.663,"5min":2.6040000000000001,"15min":2.6040000000000001},"last":1.4219999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T12:00:19.767 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-28T11:56:33.351098+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=11, tm_min=56, tm_sec=33, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=12, tm_min=0, tm_sec=13, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T12:00:19.767 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-28T11:56:33.351098+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=11, tm_min=56, tm_sec=33, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=12, tm_min=0, tm_sec=13, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T12:00:19.767 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-28T11:56:33.351098+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=11, tm_min=56, tm_sec=33, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=12, tm_min=0, tm_sec=13, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T12:00:19.768 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-28T11:56:33.351098+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=11, tm_min=56, tm_sec=33, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=12, tm_min=0, tm_sec=13, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T12:00:19.768 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-28T11:56:33.351098+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=11, tm_min=56, tm_sec=33, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=12, tm_min=0, tm_sec=13, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T12:00:19.768 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-28T11:56:33.351098+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=11, tm_min=56, tm_sec=33, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=12, tm_min=0, tm_sec=13, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T12:00:19.768 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-28T11:56:33.351098+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=11, tm_min=56, tm_sec=33, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=12, tm_min=0, tm_sec=13, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T12:00:19.768 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-28T11:56:33.351098+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=11, tm_min=56, tm_sec=33, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=12, tm_min=0, tm_sec=13, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T12:00:19.768 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-28T11:56:27.291192+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=11, tm_min=56, tm_sec=27, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=12, tm_min=0, tm_sec=13, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T12:00:19.769 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-28T12:00:30.291 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:00:30.304 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:00:39.770 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T12:00:39.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.952+0000 7f489f577700 1 Processor -- start 2023-11-28T12:00:39.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.952+0000 7f489f577700 1 -- start start 2023-11-28T12:00:39.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.956+0000 7f489f577700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f489815a230 0x7f48980c3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:39.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.956+0000 7f489f577700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48980aee40 0x7f48980cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:39.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.956+0000 7f489f577700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f489806c240 con 0x7f489815a600 2023-11-28T12:00:39.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.956+0000 7f489f577700 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48980ca4e0 con 0x7f489815a230 2023-11-28T12:00:39.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.956+0000 7f489f577700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48980ca7c0 con 0x7f48980aee40 2023-11-28T12:00:39.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.956+0000 7f489e575700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f489815a230 0x7f48980c3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:39.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.956+0000 7f489ed76700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48980aee40 0x7f48980cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:39.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.956+0000 7f489e575700 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f489815a230 0x7f48980c3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58314/0 (socket says 172.21.15.39:58314) 2023-11-28T12:00:39.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.956+0000 7f489dd74700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f489815a600 0x7f48980b1240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:42274/0 (socket says 172.21.15.39:42274) 2023-11-28T12:00:39.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.956+0000 7f489e575700 1 -- 172.21.15.39:0/349127367 learned_addr learned my addr 172.21.15.39:0/349127367 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:39.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.956+0000 7f489d573700 1 -- 172.21.15.39:0/349127367 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 798389966 0 0) 0x7f489806c240 con 0x7f489815a600 2023-11-28T12:00:39.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.956+0000 7f489d573700 1 -- 172.21.15.39:0/349127367 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48840035d0 con 0x7f489815a600 2023-11-28T12:00:39.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.956+0000 7f489e575700 1 -- 172.21.15.39:0/349127367 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48980aee40 msgr2=0x7f48980cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:39.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.956+0000 7f489e575700 1 --2- 172.21.15.39:0/349127367 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48980aee40 0x7f48980cb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:39.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.956+0000 7f489e575700 1 -- 172.21.15.39:0/349127367 >> v1:172.21.15.184:6789/0 conn(0x7f489815a600 legacy=0x7f48980b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:39.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.956+0000 7f489e575700 1 -- 172.21.15.39:0/349127367 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48980caaa0 con 0x7f489815a230 2023-11-28T12:00:39.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.960+0000 7f489e575700 1 --2- 172.21.15.39:0/349127367 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f489815a230 0x7f48980c3310 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f4894009910 tx=0x7f4894009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2bfa46e1c8c85ed server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:39.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.960+0000 7f489d573700 1 -- 172.21.15.39:0/349127367 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4894011830 con 0x7f489815a230 2023-11-28T12:00:39.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.960+0000 7f489d573700 1 -- 172.21.15.39:0/349127367 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4894011990 con 0x7f489815a230 2023-11-28T12:00:39.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.960+0000 7f489d573700 1 -- 172.21.15.39:0/349127367 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4894011d00 con 0x7f489815a230 2023-11-28T12:00:39.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.960+0000 7f489f577700 1 -- 172.21.15.39:0/349127367 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f489815a230 msgr2=0x7f48980c3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:39.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.960+0000 7f489f577700 1 --2- 172.21.15.39:0/349127367 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f489815a230 0x7f48980c3310 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f4894009910 tx=0x7f4894009c20 comp rx=0 tx=0).stop 2023-11-28T12:00:39.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.960+0000 7f489f577700 1 -- 172.21.15.39:0/349127367 shutdown_connections 2023-11-28T12:00:39.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.960+0000 7f489f577700 1 --2- 172.21.15.39:0/349127367 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48980aee40 0x7f48980cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:39.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.960+0000 7f489f577700 1 --2- 172.21.15.39:0/349127367 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f489815a230 0x7f48980c3310 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:39.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.960+0000 7f489f577700 1 -- 172.21.15.39:0/349127367 >> 172.21.15.39:0/349127367 conn(0x7f48980cc240 msgr2=0x7f48980cc610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:39.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.960+0000 7f489f577700 1 -- 172.21.15.39:0/349127367 shutdown_connections 2023-11-28T12:00:39.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.960+0000 7f489f577700 1 -- 172.21.15.39:0/349127367 wait complete. 2023-11-28T12:00:39.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.964+0000 7f489f577700 1 Processor -- start 2023-11-28T12:00:39.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.964+0000 7f489f577700 1 -- start start 2023-11-28T12:00:39.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.968+0000 7f489f577700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f489815a230 0x7f48980c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:39.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.968+0000 7f489f577700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f489815a600 0x7f48981efe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:39.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.968+0000 7f489f577700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48981f03b0 0x7f48980c6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:39.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.968+0000 7f489f577700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489814c800 con 0x7f489815a600 2023-11-28T12:00:39.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.968+0000 7f489f577700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489814c650 con 0x7f48981f03b0 2023-11-28T12:00:39.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.968+0000 7f489f577700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f489814cd80 con 0x7f489815a230 2023-11-28T12:00:39.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.968+0000 7f489dd74700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f489815a600 0x7f48981efe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:39.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.968+0000 7f489e575700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f489815a230 0x7f48980c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:39.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.968+0000 7f489e575700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f489815a230 0x7f48980c9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.39:33150/0 (socket says 172.21.15.39:33150) 2023-11-28T12:00:39.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.968+0000 7f489e575700 1 -- 172.21.15.39:0/729932614 learned_addr learned my addr 172.21.15.39:0/729932614 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:39.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.968+0000 7f489ed76700 1 --2- 172.21.15.39:0/729932614 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48981f03b0 0x7f48980c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:39.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.968+0000 7f489e575700 1 -- 172.21.15.39:0/729932614 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48981f03b0 msgr2=0x7f48980c6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:39.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.968+0000 7f489e575700 1 --2- 172.21.15.39:0/729932614 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48981f03b0 0x7f48980c6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:39.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.968+0000 7f489e575700 1 -- 172.21.15.39:0/729932614 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f489815a600 msgr2=0x7f48981efe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:39.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.968+0000 7f489e575700 1 --2- 172.21.15.39:0/729932614 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f489815a600 0x7f48981efe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:39.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.968+0000 7f489e575700 1 -- 172.21.15.39:0/729932614 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4894009570 con 0x7f489815a230 2023-11-28T12:00:39.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.968+0000 7f489e575700 1 --2- 172.21.15.39:0/729932614 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f489815a230 0x7f48980c9390 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4894009c60 tx=0x7f4894004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:39.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.968+0000 7f488effd700 1 -- 172.21.15.39:0/729932614 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4894004300 con 0x7f489815a230 2023-11-28T12:00:39.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.968+0000 7f488effd700 1 -- 172.21.15.39:0/729932614 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489401f070 con 0x7f489815a230 2023-11-28T12:00:39.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.968+0000 7f488effd700 1 -- 172.21.15.39:0/729932614 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48940036c0 con 0x7f489815a230 2023-11-28T12:00:39.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.968+0000 7f489f577700 1 -- 172.21.15.39:0/729932614 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48980c9ac0 con 0x7f489815a230 2023-11-28T12:00:39.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.968+0000 7f489f577700 1 -- 172.21.15.39:0/729932614 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48980cad80 con 0x7f489815a230 2023-11-28T12:00:39.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.972+0000 7f489f577700 1 -- 172.21.15.39:0/729932614 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f489806bef0 con 0x7f489815a230 2023-11-28T12:00:39.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.972+0000 7f488effd700 1 -- 172.21.15.39:0/729932614 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f489402a020 con 0x7f489815a230 2023-11-28T12:00:39.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.976+0000 7f488effd700 1 --2- 172.21.15.39:0/729932614 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f487c064ee0 0x7f487c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:39.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.976+0000 7f488effd700 1 -- 172.21.15.39:0/729932614 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f4894083170 con 0x7f489815a230 2023-11-28T12:00:39.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.976+0000 7f489dd74700 1 --2- 172.21.15.39:0/729932614 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f487c064ee0 0x7f487c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:39.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.976+0000 7f489dd74700 1 --2- 172.21.15.39:0/729932614 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f487c064ee0 0x7f487c067390 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f48981e45e0 tx=0x7f4888007da0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:39.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:39.984+0000 7f488effd700 1 -- 172.21.15.39:0/729932614 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f48940514d0 con 0x7f489815a230 2023-11-28T12:00:40.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.152+0000 7f489f577700 1 -- 172.21.15.39:0/729932614 --> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f489814cec0 con 0x7f487c064ee0 2023-11-28T12:00:40.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.164+0000 7f488effd700 1 -- 172.21.15.39:0/729932614 <== mgr.4104 v2:172.21.15.184:6832/36166 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70125 (secure 0 0 0) 0x7f4888001330 con 0x7f487c064ee0 2023-11-28T12:00:40.168 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T12:00:40.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.164+0000 7f489f577700 1 -- 172.21.15.39:0/729932614 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f487c064ee0 msgr2=0x7f487c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:40.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.164+0000 7f489f577700 1 --2- 172.21.15.39:0/729932614 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f487c064ee0 0x7f487c067390 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f48981e45e0 tx=0x7f4888007da0 comp rx=0 tx=0).stop 2023-11-28T12:00:40.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.164+0000 7f489f577700 1 -- 172.21.15.39:0/729932614 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f489815a230 msgr2=0x7f48980c9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:40.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.164+0000 7f489f577700 1 --2- 172.21.15.39:0/729932614 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f489815a230 0x7f48980c9390 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4894009c60 tx=0x7f4894004770 comp rx=0 tx=0).stop 2023-11-28T12:00:40.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.164+0000 7f489f577700 1 -- 172.21.15.39:0/729932614 shutdown_connections 2023-11-28T12:00:40.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.164+0000 7f489f577700 1 --2- 172.21.15.39:0/729932614 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f487c064ee0 0x7f487c067390 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:40.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.164+0000 7f489f577700 1 --2- 172.21.15.39:0/729932614 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48981f03b0 0x7f48980c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:40.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.164+0000 7f489f577700 1 --2- 172.21.15.39:0/729932614 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f489815a600 0x7f48981efe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:40.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.164+0000 7f489f577700 1 --2- 172.21.15.39:0/729932614 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f489815a230 0x7f48980c9390 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:40.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.164+0000 7f489f577700 1 -- 172.21.15.39:0/729932614 >> 172.21.15.39:0/729932614 conn(0x7f48980cc240 msgr2=0x7f48981502d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:40.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.164+0000 7f489f577700 1 -- 172.21.15.39:0/729932614 shutdown_connections 2023-11-28T12:00:40.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.168+0000 7f489f577700 1 -- 172.21.15.39:0/729932614 wait complete. 2023-11-28T12:00:40.175 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2023-11-28T12:00:40.197 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":193,"stamp":"2023-11-28T12:00:38.636194+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":98820,"kb_used_data":8068,"kb_used_omap":0,"kb_used_meta":90688,"kb_avail":754875900,"statfs":{"total":773094113280,"available":772992921600,"internally_reserved":0,"allocated":8261632,"data_stored":4467753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":92864512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003686"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":78,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T12:00:19.778387+0000","last_change":"2023-11-28T12:00:19.778320+0000","last_active":"2023-11-28T12:00:19.778387+0000","last_peered":"2023-11-28T12:00:19.778387+0000","last_clean":"2023-11-28T12:00:19.778387+0000","last_became_active":"2023-11-28T11:56:34.384036+0000","last_became_peered":"2023-11-28T11:56:34.384036+0000","last_unstale":"2023-11-28T12:00:19.778387+0000","last_undegraded":"2023-11-28T12:00:19.778387+0000","last_fullsized":"2023-11-28T12:00:19.778387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:00:19.778099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:00:19.778099+0000","last_clean_scrub_stamp":"2023-11-28T12:00:19.778099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:10:30.116292+0000","scrub_duration":0.0059658289999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":70,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T12:00:21.165837+0000","last_change":"2023-11-28T12:00:21.165755+0000","last_active":"2023-11-28T12:00:21.165837+0000","last_peered":"2023-11-28T12:00:21.165837+0000","last_clean":"2023-11-28T12:00:21.165837+0000","last_became_active":"2023-11-28T11:56:34.383631+0000","last_became_peered":"2023-11-28T11:56:34.383631+0000","last_unstale":"2023-11-28T12:00:21.165837+0000","last_undegraded":"2023-11-28T12:00:21.165837+0000","last_fullsized":"2023-11-28T12:00:21.165837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:00:21.165538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:00:21.165538+0000","last_clean_scrub_stamp":"2023-11-28T12:00:21.165538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:21:41.555287+0000","scrub_duration":0.0067435180000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":70,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T12:00:23.371700+0000","last_change":"2023-11-28T12:00:23.371653+0000","last_active":"2023-11-28T12:00:23.371700+0000","last_peered":"2023-11-28T12:00:23.371700+0000","last_clean":"2023-11-28T12:00:23.371700+0000","last_became_active":"2023-11-28T11:56:34.385994+0000","last_became_peered":"2023-11-28T11:56:34.385994+0000","last_unstale":"2023-11-28T12:00:23.371700+0000","last_undegraded":"2023-11-28T12:00:23.371700+0000","last_fullsized":"2023-11-28T12:00:23.371700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:00:23.371456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:00:23.371456+0000","last_clean_scrub_stamp":"2023-11-28T12:00:23.371456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:26:30.413712+0000","scrub_duration":0.0065025040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":70,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T12:00:18.156784+0000","last_change":"2023-11-28T12:00:18.156715+0000","last_active":"2023-11-28T12:00:18.156784+0000","last_peered":"2023-11-28T12:00:18.156784+0000","last_clean":"2023-11-28T12:00:18.156784+0000","last_became_active":"2023-11-28T11:56:34.384531+0000","last_became_peered":"2023-11-28T11:56:34.384531+0000","last_unstale":"2023-11-28T12:00:18.156784+0000","last_undegraded":"2023-11-28T12:00:18.156784+0000","last_fullsized":"2023-11-28T12:00:18.156784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:00:18.156509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:00:18.156509+0000","last_clean_scrub_stamp":"2023-11-28T12:00:18.156509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:09:31.877329+0000","scrub_duration":0.0060229819999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":68,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T12:00:22.274507+0000","last_change":"2023-11-28T12:00:22.274440+0000","last_active":"2023-11-28T12:00:22.274507+0000","last_peered":"2023-11-28T12:00:22.274507+0000","last_clean":"2023-11-28T12:00:22.274507+0000","last_became_active":"2023-11-28T11:56:34.388689+0000","last_became_peered":"2023-11-28T11:56:34.388689+0000","last_unstale":"2023-11-28T12:00:22.274507+0000","last_undegraded":"2023-11-28T12:00:22.274507+0000","last_fullsized":"2023-11-28T12:00:22.274507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:00:22.274226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:00:22.274226+0000","last_clean_scrub_stamp":"2023-11-28T12:00:22.274226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:19:03.753491+0000","scrub_duration":0.0063175260000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":72,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T12:00:16.920833+0000","last_change":"2023-11-28T12:00:16.920775+0000","last_active":"2023-11-28T12:00:16.920833+0000","last_peered":"2023-11-28T12:00:16.920833+0000","last_clean":"2023-11-28T12:00:16.920833+0000","last_became_active":"2023-11-28T11:56:34.485702+0000","last_became_peered":"2023-11-28T11:56:34.485702+0000","last_unstale":"2023-11-28T12:00:16.920833+0000","last_undegraded":"2023-11-28T12:00:16.920833+0000","last_fullsized":"2023-11-28T12:00:16.920833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:00:16.920578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:00:16.920578+0000","last_clean_scrub_stamp":"2023-11-28T12:00:16.920578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:30:32.378833+0000","scrub_duration":0.00535682,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":71,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T12:00:20.436144+0000","last_change":"2023-11-28T12:00:20.436061+0000","last_active":"2023-11-28T12:00:20.436144+0000","last_peered":"2023-11-28T12:00:20.436144+0000","last_clean":"2023-11-28T12:00:20.436144+0000","last_became_active":"2023-11-28T11:56:34.386976+0000","last_became_peered":"2023-11-28T11:56:34.386976+0000","last_unstale":"2023-11-28T12:00:20.436144+0000","last_undegraded":"2023-11-28T12:00:20.436144+0000","last_fullsized":"2023-11-28T12:00:20.436144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:00:20.435841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:00:20.435841+0000","last_clean_scrub_stamp":"2023-11-28T12:00:20.435841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:19:01.915107+0000","scrub_duration":0.0067397840000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":68,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T12:00:21.303837+0000","last_change":"2023-11-28T12:00:21.303788+0000","last_active":"2023-11-28T12:00:21.303837+0000","last_peered":"2023-11-28T12:00:21.303837+0000","last_clean":"2023-11-28T12:00:21.303837+0000","last_became_active":"2023-11-28T11:56:34.388671+0000","last_became_peered":"2023-11-28T11:56:34.388671+0000","last_unstale":"2023-11-28T12:00:21.303837+0000","last_undegraded":"2023-11-28T12:00:21.303837+0000","last_fullsized":"2023-11-28T12:00:21.303837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:00:21.303583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:00:21.303583+0000","last_clean_scrub_stamp":"2023-11-28T12:00:21.303583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:08:40.120306+0000","scrub_duration":0.0064378329999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"73'119","reported_seq":226,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-28T12:00:19.405240+0000","last_change":"2023-11-28T12:00:19.405144+0000","last_active":"2023-11-28T12:00:19.405240+0000","last_peered":"2023-11-28T12:00:19.405240+0000","last_clean":"2023-11-28T12:00:19.405240+0000","last_became_active":"2023-11-28T11:56:28.469273+0000","last_became_peered":"2023-11-28T11:56:28.469273+0000","last_unstale":"2023-11-28T12:00:19.405240+0000","last_undegraded":"2023-11-28T12:00:19.405240+0000","last_fullsized":"2023-11-28T12:00:19.405240+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'119","last_scrub_stamp":"2023-11-28T12:00:19.404925+0000","last_deep_scrub":"73'119","last_deep_scrub_stamp":"2023-11-28T12:00:19.404925+0000","last_clean_scrub_stamp":"2023-11-28T12:00:19.404925+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:19:22.590036+0000","scrub_duration":0.011565638,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509493,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15276,"kb_used_data":1444,"kb_used_omap":0,"kb_used_meta":13824,"kb_avail":94356564,"statfs":{"total":96636764160,"available":96621121536,"internally_reserved":0,"allocated":1478656,"data_stored":1001360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14155776},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:00:30 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.087,"15min":1.0960000000000001},"min":{"1min":0.74399999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.335,"5min":1.468,"15min":1.468},"last":1.357},{"interface":"front","average":{"1min":1.095,"5min":1.087,"15min":1.081},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.53,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.135}]},{"osd":1,"last update":"Tue Nov 28 12:00:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.1699999999999999,"15min":1.196},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.776,"5min":1.776,"15min":1.776},"last":1.421},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.1419999999999999,"15min":1.169},"min":{"1min":0.753,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.464,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.0389999999999999}]},{"osd":2,"last update":"Tue Nov 28 12:00:30 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.149,"15min":1.1759999999999999},"min":{"1min":0.88100000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.4830000000000001,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.002},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.244,"15min":1.272},"min":{"1min":0.90100000000000002,"5min":0.749,"15min":0.749},"max":{"1min":1.6419999999999999,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.2210000000000001}]},{"osd":3,"last update":"Tue Nov 28 12:00:30 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.278,"15min":1.3080000000000001},"min":{"1min":0.96899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.7350000000000001,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.327,"15min":1.351},"min":{"1min":0.98199999999999998,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.8740000000000001,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.472}]},{"osd":4,"last update":"Tue Nov 28 12:00:30 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.1990000000000001,"15min":1.2789999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.661,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.242,"15min":1.3180000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.6100000000000001,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.163}]},{"osd":5,"last update":"Tue Nov 28 12:00:30 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.339,"15min":1.4159999999999999},"min":{"1min":0.86899999999999999,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.5680000000000001,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.3160000000000001,"15min":1.379},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.911,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":0.92500000000000004}]},{"osd":6,"last update":"Tue Nov 28 12:00:30 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.4490000000000001,"15min":1.5329999999999999},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.377,"15min":1.4390000000000001},"min":{"1min":0.91300000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.8340000000000001,"5min":2.468,"15min":2.468},"last":1.0660000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509493,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10024,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":9152,"kb_avail":94361816,"statfs":{"total":96636764160,"available":96626499584,"internally_reserved":0,"allocated":884736,"data_stored":410992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9371648},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:00:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.018,"15min":0.998},"min":{"1min":0.60899999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.55,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.3899999999999999},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.1080000000000001,"15min":1.175},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3380000000000001,"5min":2.347,"15min":2.347},"last":1.2310000000000001}]},{"osd":1,"last update":"Tue Nov 28 12:00:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.169,"15min":1.1739999999999999},"min":{"1min":0.751,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.5580000000000001,"5min":1.8,"15min":1.8},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.161,"15min":1.1719999999999999},"min":{"1min":0.78900000000000003,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.516,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":1.266}]},{"osd":2,"last update":"Tue Nov 28 12:00:33 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.1759999999999999,"15min":1.234},"min":{"1min":0.93999999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4470000000000001,"5min":3.9620000000000002,"15min":3.9620000000000002},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1659999999999999,"15min":1.1679999999999999},"min":{"1min":0.89400000000000002,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.51,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.3029999999999999}]},{"osd":3,"last update":"Tue Nov 28 12:00:33 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.26,"15min":1.2609999999999999},"min":{"1min":0.91000000000000003,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.6870000000000001,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.248,"15min":1.264},"min":{"1min":0.96899999999999997,"5min":0.749,"15min":0.749},"max":{"1min":1.508,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.355}]},{"osd":4,"last update":"Tue Nov 28 12:00:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.1839999999999999,"15min":1.2250000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.5820000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.5820000000000001},{"interface":"front","average":{"1min":1.264,"5min":1.3700000000000001,"15min":1.452},"min":{"1min":0.83699999999999997,"5min":0.745,"15min":0.745},"max":{"1min":1.6399999999999999,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.4750000000000001}]},{"osd":5,"last update":"Tue Nov 28 12:00:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.224,"15min":1.266},"min":{"1min":0.84999999999999998,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.615,"5min":1.724,"15min":1.724},"last":1.526},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2350000000000001,"15min":1.2669999999999999},"min":{"1min":0.88,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.593,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":1.4990000000000001}]},{"osd":7,"last update":"Tue Nov 28 12:00:33 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.3100000000000001,"15min":1.3320000000000001},"min":{"1min":0.93999999999999995,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.6479999999999999,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.3520000000000001,"15min":1.3580000000000001},"min":{"1min":0.99199999999999999,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.742,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.609}]}]},{"osd":5,"up_from":15,"seq":64424509493,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9832,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94362008,"statfs":{"total":96636764160,"available":96626696192,"internally_reserved":0,"allocated":884736,"data_stored":410992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:00:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.077,"15min":1.087},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.4219999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.167},{"interface":"front","average":{"1min":1.008,"5min":1.075,"15min":1.077},"min":{"1min":0.74399999999999999,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.409,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.84599999999999997}]},{"osd":1,"last update":"Tue Nov 28 12:00:35 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.1359999999999999,"15min":1.1479999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.3899999999999999,"5min":1.843,"15min":1.843},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.115,"5min":1.097,"15min":1.0920000000000001},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.403,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.403}]},{"osd":2,"last update":"Tue Nov 28 12:00:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.177,"15min":1.169},"min":{"1min":0.89100000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.458,"5min":1.591,"15min":1.591},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.194,"5min":1.1919999999999999,"15min":1.198},"min":{"1min":0.876,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.5289999999999999,"5min":1.79,"15min":1.79},"last":1.2230000000000001}]},{"osd":3,"last update":"Tue Nov 28 12:00:35 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.2430000000000001,"15min":1.27},"min":{"1min":0.93999999999999995,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.4650000000000001,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.341,"5min":1.3520000000000001,"15min":1.3879999999999999},"min":{"1min":0.96299999999999997,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.617,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.298}]},{"osd":4,"last update":"Tue Nov 28 12:00:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.169,"15min":1.2070000000000001},"min":{"1min":0.79500000000000004,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.5469999999999999,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.23,"15min":1.2350000000000001},"min":{"1min":0.86699999999999999,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.5109999999999999,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.98299999999999998}]},{"osd":6,"last update":"Tue Nov 28 12:00:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2729999999999999,"15min":1.2769999999999999},"min":{"1min":0.91300000000000003,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.583,"5min":1.732,"15min":1.732},"last":1.391},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.2949999999999999,"15min":1.2889999999999999},"min":{"1min":1.0980000000000001,"5min":0.874,"15min":0.874},"max":{"1min":1.502,"5min":1.704,"15min":1.704},"last":1.484}]},{"osd":7,"last update":"Tue Nov 28 12:00:35 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.3620000000000001,"15min":1.3660000000000001},"min":{"1min":1.0680000000000001,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.7410000000000001,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.246},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.4419999999999999,"15min":1.47},"min":{"1min":1.0289999999999999,"5min":1.002,"15min":1.002},"max":{"1min":1.7050000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.4370000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509493,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":14248,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":13376,"kb_avail":94357592,"statfs":{"total":96636764160,"available":96622174208,"internally_reserved":0,"allocated":884736,"data_stored":410992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13697024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.109,"15min":1.1100000000000001},"min":{"1min":0.76100000000000001,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5429999999999999,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.1279999999999999,"15min":1.1519999999999999},"min":{"1min":0.71699999999999997,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.554,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.256}]},{"osd":1,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.173,"15min":1.2090000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.496,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.202},{"interface":"front","average":{"1min":1.171,"5min":1.1819999999999999,"15min":1.202},"min":{"1min":0.70999999999999996,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.7190000000000001,"5min":2.8860000000000001,"15min":2.8860000000000001},"last":1.325}]},{"osd":2,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.208,"15min":1.238},"min":{"1min":0.81999999999999995,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.589,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.236,"5min":1.3520000000000001,"15min":1.403},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.5389999999999999,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":1.228}]},{"osd":3,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.282,"15min":1.3160000000000001},"min":{"1min":0.89700000000000002,"5min":0.746,"15min":0.746},"max":{"1min":1.4790000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3560000000000001,"15min":1.3740000000000001},"min":{"1min":1.004,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.877,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.4079999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.3640000000000001,"15min":1.431},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.0139999999999998,"5min":2.972,"15min":2.972},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.296,"15min":1.353},"min":{"1min":0.78600000000000003,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.2389999999999999,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.111}]},{"osd":6,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3580000000000001,"15min":1.4059999999999999},"min":{"1min":0.96699999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.919,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.49,"15min":1.542},"min":{"1min":1.0189999999999999,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":2.0790000000000002,"5min":3.133,"15min":3.133},"last":1.379}]},{"osd":7,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.4570000000000001,"15min":1.5169999999999999},"min":{"1min":0.95199999999999996,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.992,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.5},{"interface":"front","average":{"1min":1.474,"5min":1.5369999999999999,"15min":1.5880000000000001},"min":{"1min":1.145,"5min":1.0760000000000001,"15min":1.0760000000000001},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.583}]}]},{"osd":3,"up_from":15,"seq":64424509493,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14184,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":13312,"kb_avail":94357656,"statfs":{"total":96636764160,"available":96622239744,"internally_reserved":0,"allocated":884736,"data_stored":410992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13631488},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82599999999999996,"15min":0.84099999999999997},"min":{"1min":0.54300000000000004,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1459999999999999,"5min":1.478,"15min":1.478},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.90900000000000003,"15min":0.91500000000000004},"min":{"1min":0.40200000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.2310000000000001,"5min":2.177,"15min":2.177},"last":0.81200000000000006}]},{"osd":1,"last update":"Tue Nov 28 12:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.86899999999999999,"15min":0.86699999999999999},"min":{"1min":0.55600000000000005,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.167,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.026,"5min":1.0349999999999999,"15min":1.0569999999999999},"min":{"1min":0.626,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4279999999999999,"5min":1.968,"15min":1.968},"last":1.01}]},{"osd":2,"last update":"Tue Nov 28 12:00:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.091,"15min":1.133},"min":{"1min":0.751,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.496,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.181},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.171,"15min":1.2070000000000001},"min":{"1min":0.80700000000000005,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.6479999999999999,"5min":2.093,"15min":2.093},"last":1.1479999999999999}]},{"osd":4,"last update":"Tue Nov 28 12:00:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.1830000000000001,"15min":1.181},"min":{"1min":0.85799999999999998,"5min":0.75,"15min":0.75},"max":{"1min":1.5369999999999999,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":1.397},{"interface":"front","average":{"1min":1.262,"5min":1.276,"15min":1.3260000000000001},"min":{"1min":0.86099999999999999,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.5880000000000001,"5min":2.8439999999999999,"15min":2.8439999999999999},"last":1.5580000000000001}]},{"osd":5,"last update":"Tue Nov 28 12:00:31 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.3200000000000001,"15min":1.3580000000000001},"min":{"1min":0.93799999999999994,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.821,"5min":2.9670000000000001,"15min":2.9670000000000001},"last":1.375},{"interface":"front","average":{"1min":1.363,"5min":1.379,"15min":1.4370000000000001},"min":{"1min":1.006,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.6259999999999999,"5min":3.7429999999999999,"15min":3.7429999999999999},"last":1.4179999999999999}]},{"osd":6,"last update":"Tue Nov 28 12:00:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.333,"15min":1.351},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.8680000000000001,"5min":2.323,"15min":2.323},"last":1.5149999999999999},{"interface":"front","average":{"1min":1.403,"5min":1.395,"15min":1.4399999999999999},"min":{"1min":1.002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.873,"5min":2.927,"15min":2.927},"last":1.4650000000000001}]},{"osd":7,"last update":"Tue Nov 28 12:00:31 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.452,"15min":1.496},"min":{"1min":1.0669999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.8560000000000001,"5min":3.5030000000000001,"15min":3.5030000000000001},"last":1.601},{"interface":"front","average":{"1min":1.405,"5min":1.4259999999999999,"15min":1.4690000000000001},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.8080000000000001,"5min":2.6320000000000001,"15min":2.6320000000000001},"last":1.6479999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509493,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14120,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":13248,"kb_avail":94357720,"statfs":{"total":96636764160,"available":96622305280,"internally_reserved":0,"allocated":884736,"data_stored":410992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13565952},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.89300000000000002,"15min":0.93400000000000005},"min":{"1min":0.495,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.3919999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":1.167},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.018,"15min":1.0089999999999999},"min":{"1min":0.67700000000000005,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.5429999999999999,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.95899999999999996}]},{"osd":2,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.069,"15min":1.083},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.6160000000000001,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0860000000000001,"15min":1.1000000000000001},"min":{"1min":0.72599999999999998,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.7769999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.90500000000000003}]},{"osd":3,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.1859999999999999,"15min":1.2030000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.635,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.216},{"interface":"front","average":{"1min":1.103,"5min":1.1339999999999999,"15min":1.171},"min":{"1min":0.65600000000000003,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.4670000000000001,"5min":1.8,"15min":1.8},"last":1.25}]},{"osd":4,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.353,"15min":1.3720000000000001},"min":{"1min":1.002,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.6890000000000001,"5min":3.411,"15min":3.411},"last":1.454},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.3009999999999999,"15min":1.339},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.7969999999999999,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":1.482}]},{"osd":5,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.3799999999999999,"15min":1.423},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.9039999999999999,"5min":3.6869999999999998,"15min":3.6869999999999998},"last":1.415},{"interface":"front","average":{"1min":1.284,"5min":1.306,"15min":1.3260000000000001},"min":{"1min":0.97699999999999998,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.736,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.113}]},{"osd":6,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.4239999999999999,"15min":1.4550000000000001},"min":{"1min":0.99399999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.8899999999999999,"5min":3.5379999999999998,"15min":3.5379999999999998},"last":1.5289999999999999},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.4470000000000001,"15min":1.49},"min":{"1min":0.84099999999999997,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.0259999999999998,"5min":2.5739999999999998,"15min":2.5739999999999998},"last":1.333}]},{"osd":7,"last update":"Tue Nov 28 11:59:33 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.4510000000000001,"15min":1.4770000000000001},"min":{"1min":1.1040000000000001,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.9490000000000001,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.492,"15min":1.52},"min":{"1min":1.1870000000000001,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.986,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.371}]}]},{"osd":2,"up_from":14,"seq":60129542197,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9960,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361880,"statfs":{"total":96636764160,"available":96626565120,"internally_reserved":0,"allocated":884736,"data_stored":410992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:00:28 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.84499999999999997,"15min":0.86399999999999999},"min":{"1min":0.64000000000000001,"5min":0.497,"15min":0.497},"max":{"1min":1.165,"5min":1.722,"15min":1.722},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.877,"5min":0.95399999999999996,"15min":0.99299999999999999},"min":{"1min":0.64500000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.177,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":1.006}]},{"osd":1,"last update":"Tue Nov 28 12:00:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0049999999999999,"15min":1.026},"min":{"1min":0.70899999999999996,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.5449999999999999,"5min":1.754,"15min":1.754},"last":1.2070000000000001},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.91900000000000004,"15min":0.93700000000000006},"min":{"1min":0.58299999999999996,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.252,"5min":1.484,"15min":1.484},"last":0.78800000000000003}]},{"osd":3,"last update":"Tue Nov 28 12:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":1.0760000000000001,"15min":1.117},"min":{"1min":0.66600000000000004,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.454,"5min":2.048,"15min":2.048},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.2350000000000001,"15min":1.278},"min":{"1min":0.623,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.466,"5min":2.617,"15min":2.617},"last":1.3100000000000001}]},{"osd":4,"last update":"Tue Nov 28 12:00:33 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.3180000000000001,"15min":1.3700000000000001},"min":{"1min":0.97799999999999998,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.5409999999999999,"5min":2.9620000000000002,"15min":2.9620000000000002},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.228,"5min":1.2310000000000001,"15min":1.2490000000000001},"min":{"1min":0.99199999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.5609999999999999,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":1.163}]},{"osd":5,"last update":"Tue Nov 28 12:00:33 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.284,"15min":1.3340000000000001},"min":{"1min":0.86599999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.5800000000000001,"5min":2.738,"15min":2.738},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.401,"15min":1.5169999999999999},"min":{"1min":1.02,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.552,"5min":4.0309999999999997,"15min":4.0309999999999997},"last":1.3380000000000001}]},{"osd":6,"last update":"Tue Nov 28 12:00:33 2023","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.474,"15min":1.575},"min":{"1min":1.046,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.881,"5min":4.2240000000000002,"15min":4.2240000000000002},"last":1.296},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.4350000000000001,"15min":1.52},"min":{"1min":1.1319999999999999,"5min":0.755,"15min":0.755},"max":{"1min":1.7509999999999999,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":1.3939999999999999}]},{"osd":7,"last update":"Tue Nov 28 12:00:33 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.377,"15min":1.4370000000000001},"min":{"1min":0.98199999999999998,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.6950000000000001,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.367},{"interface":"front","average":{"1min":1.393,"5min":1.5329999999999999,"15min":1.633},"min":{"1min":1.0600000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.8160000000000001,"5min":4.3570000000000002,"15min":4.3570000000000002},"last":1.24}]}]},{"osd":0,"up_from":14,"seq":60129542197,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11176,"kb_used_data":1440,"kb_used_omap":0,"kb_used_meta":9728,"kb_avail":94360664,"statfs":{"total":96636764160,"available":96625319936,"internally_reserved":0,"allocated":1474560,"data_stored":1000441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9961472},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 12:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85499999999999998,"15min":0.873},"min":{"1min":0.56999999999999995,"5min":0.439,"15min":0.439},"max":{"1min":1.2410000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.97499999999999998,"15min":1.0029999999999999},"min":{"1min":0.59399999999999997,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":0.79700000000000004}]},{"osd":2,"last update":"Tue Nov 28 12:00:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.018,"15min":1.044},"min":{"1min":0.55200000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.4670000000000001,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.0189999999999999,"5min":0.93700000000000006,"15min":0.92900000000000005},"min":{"1min":0.69199999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.0449999999999999}]},{"osd":3,"last update":"Tue Nov 28 12:00:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.036,"15min":1.0660000000000001},"min":{"1min":0.624,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.49,"5min":1.645,"15min":1.645},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.198,"15min":1.228},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.8149999999999999,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.157}]},{"osd":4,"last update":"Tue Nov 28 12:00:35 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.28,"15min":1.3280000000000001},"min":{"1min":0.88200000000000001,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.6719999999999999,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.542},{"interface":"front","average":{"1min":1.24,"5min":1.2889999999999999,"15min":1.371},"min":{"1min":0.96899999999999997,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.4550000000000001,"5min":3.1629999999999998,"15min":3.1629999999999998},"last":1.3999999999999999}]},{"osd":5,"last update":"Tue Nov 28 12:00:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.325,"15min":1.351},"min":{"1min":1.091,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.5700000000000001,"5min":2.23,"15min":2.23},"last":1.276},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.3340000000000001,"15min":1.397},"min":{"1min":1.04,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.5669999999999999,"5min":2.266,"15min":2.266},"last":1.482}]},{"osd":6,"last update":"Tue Nov 28 12:00:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.4159999999999999,"15min":1.488},"min":{"1min":1.115,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.0369999999999999,"5min":2.4060000000000001,"15min":2.4060000000000001},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.4339999999999999,"15min":1.484},"min":{"1min":1.103,"5min":0.877,"15min":0.877},"max":{"1min":1.885,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":1.613}]},{"osd":7,"last update":"Tue Nov 28 12:00:35 2023","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.468,"15min":1.5069999999999999},"min":{"1min":1.214,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.944,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.512},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.488,"15min":1.5509999999999999},"min":{"1min":1.0760000000000001,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":1.9730000000000001,"5min":2.6040000000000001,"15min":2.6040000000000001},"last":1.4359999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T12:00:40.200 DEBUG:teuthology.orchestra.run.smithi039:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-28T12:00:40.371 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.364+0000 7f047dd1d700 1 Processor -- start 2023-11-28T12:00:40.371 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.364+0000 7f047dd1d700 1 -- start start 2023-11-28T12:00:40.377 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.368+0000 7f047dd1d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f047815c150 0x7f04780b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:40.377 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.368+0000 7f047dd1d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f0478070360 0x7f0478160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:40.378 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.368+0000 7f047dd1d700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f047815c520 con 0x7f047806ff10 2023-11-28T12:00:40.378 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.368+0000 7f047dd1d700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04780b4240 con 0x7f0478070360 2023-11-28T12:00:40.378 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.368+0000 7f047dd1d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f047806ac00 con 0x7f047815c150 2023-11-28T12:00:40.378 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.368+0000 7f047d51c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f0478070360 0x7f0478160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:40.378 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.368+0000 7f047cd1b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f047815c150 0x7f04780b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:40.378 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.368+0000 7f0477fff700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f047806ff10 0x7f047815fc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:42280/0 (socket says 172.21.15.39:42280) 2023-11-28T12:00:40.378 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.368+0000 7f0477fff700 1 -- 172.21.15.39:0/4208376570 learned_addr learned my addr 172.21.15.39:0/4208376570 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T12:00:40.379 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.372+0000 7f04777fe700 1 -- 172.21.15.39:0/4208376570 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1914817444 0 0) 0x7f047815c520 con 0x7f047806ff10 2023-11-28T12:00:40.379 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.372+0000 7f047d51c700 1 -- 172.21.15.39:0/4208376570 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f047815c150 msgr2=0x7f04780b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:40.379 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.372+0000 7f047d51c700 1 --2- 172.21.15.39:0/4208376570 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f047815c150 0x7f04780b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:40.379 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.372+0000 7f047d51c700 1 -- 172.21.15.39:0/4208376570 >> v1:172.21.15.184:6789/0 conn(0x7f047806ff10 legacy=0x7f047815fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:40.379 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.372+0000 7f047d51c700 1 -- 172.21.15.39:0/4208376570 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f047806cc50 con 0x7f0478070360 2023-11-28T12:00:40.379 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.372+0000 7f047d51c700 1 --2- 172.21.15.39:0/4208376570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0478070360 0x7f0478160340 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0470009d90 tx=0x7f047000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dcce3bd75c63aaf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:40.380 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.372+0000 7f04777fe700 1 -- 172.21.15.39:0/4208376570 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047000e070 con 0x7f0478070360 2023-11-28T12:00:40.380 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.372+0000 7f04777fe700 1 -- 172.21.15.39:0/4208376570 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f047000bb20 con 0x7f0478070360 2023-11-28T12:00:40.380 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.372+0000 7f04777fe700 1 -- 172.21.15.39:0/4208376570 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0470012430 con 0x7f0478070360 2023-11-28T12:00:40.381 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.372+0000 7f047dd1d700 1 -- 172.21.15.39:0/4208376570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0478070360 msgr2=0x7f0478160340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:40.381 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.372+0000 7f047dd1d700 1 --2- 172.21.15.39:0/4208376570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0478070360 0x7f0478160340 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0470009d90 tx=0x7f047000b330 comp rx=0 tx=0).stop 2023-11-28T12:00:40.381 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.372+0000 7f047dd1d700 1 -- 172.21.15.39:0/4208376570 shutdown_connections 2023-11-28T12:00:40.381 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.372+0000 7f047dd1d700 1 --2- 172.21.15.39:0/4208376570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0478070360 0x7f0478160340 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:40.381 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.372+0000 7f047dd1d700 1 --2- 172.21.15.39:0/4208376570 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f047815c150 0x7f04780b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:40.381 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.372+0000 7f047dd1d700 1 -- 172.21.15.39:0/4208376570 >> 172.21.15.39:0/4208376570 conn(0x7f04780d3680 msgr2=0x7f04780cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:40.382 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.372+0000 7f047dd1d700 1 -- 172.21.15.39:0/4208376570 shutdown_connections 2023-11-28T12:00:40.382 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.372+0000 7f047dd1d700 1 -- 172.21.15.39:0/4208376570 wait complete. 2023-11-28T12:00:40.383 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.376+0000 7f047dd1d700 1 Processor -- start 2023-11-28T12:00:40.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.376+0000 7f047dd1d700 1 -- start start 2023-11-28T12:00:40.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.376+0000 7f047dd1d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f047806ff10 0x7f047814ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:40.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.376+0000 7f047dd1d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0478070360 0x7f04780cd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:40.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.376+0000 7f047dd1d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f047815c150 0x7f04780b7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:40.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.376+0000 7f047dd1d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04781f28c0 con 0x7f0478070360 2023-11-28T12:00:40.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.376+0000 7f047dd1d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04780cdd20 con 0x7f047815c150 2023-11-28T12:00:40.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.376+0000 7f047dd1d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04780ce000 con 0x7f047806ff10 2023-11-28T12:00:40.385 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.376+0000 7f0477fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0478070360 0x7f04780cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:40.385 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.376+0000 7f0477fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0478070360 0x7f04780cd340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58332/0 (socket says 172.21.15.39:58332) 2023-11-28T12:00:40.385 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.376+0000 7f0477fff700 1 -- 172.21.15.39:0/103157012 learned_addr learned my addr 172.21.15.39:0/103157012 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:40.385 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.376+0000 7f047cd1b700 1 --2- 172.21.15.39:0/103157012 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f047806ff10 0x7f047814ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:40.385 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.376+0000 7f047d51c700 1 --2- 172.21.15.39:0/103157012 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f047815c150 0x7f04780b7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:40.385 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.376+0000 7f0477fff700 1 -- 172.21.15.39:0/103157012 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f047806ff10 msgr2=0x7f047814ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:40.385 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.376+0000 7f0477fff700 1 --2- 172.21.15.39:0/103157012 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f047806ff10 0x7f047814ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:40.385 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.376+0000 7f0477fff700 1 -- 172.21.15.39:0/103157012 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f047815c150 msgr2=0x7f04780b7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:40.386 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.376+0000 7f0477fff700 1 --2- 172.21.15.39:0/103157012 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f047815c150 0x7f04780b7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:40.386 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.376+0000 7f0477fff700 1 -- 172.21.15.39:0/103157012 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0470009a70 con 0x7f0478070360 2023-11-28T12:00:40.386 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.376+0000 7f047d51c700 1 --2- 172.21.15.39:0/103157012 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f047815c150 0x7f04780b7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:00:40.386 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.376+0000 7f0477fff700 1 --2- 172.21.15.39:0/103157012 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0478070360 0x7f04780cd340 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f046800c550 tx=0x7f046800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:40.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.376+0000 7f04757fa700 1 -- 172.21.15.39:0/103157012 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0468004cf0 con 0x7f0478070360 2023-11-28T12:00:40.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.376+0000 7f04757fa700 1 -- 172.21.15.39:0/103157012 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0468004e50 con 0x7f0478070360 2023-11-28T12:00:40.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.380+0000 7f047dd1d700 1 -- 172.21.15.39:0/103157012 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04780d2730 con 0x7f0478070360 2023-11-28T12:00:40.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.380+0000 7f04757fa700 1 -- 172.21.15.39:0/103157012 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0468007310 con 0x7f0478070360 2023-11-28T12:00:40.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.380+0000 7f047dd1d700 1 -- 172.21.15.39:0/103157012 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04780d2450 con 0x7f0478070360 2023-11-28T12:00:40.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.380+0000 7f047dd1d700 1 -- 172.21.15.39:0/103157012 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04780d05e0 con 0x7f0478070360 2023-11-28T12:00:40.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.380+0000 7f04757fa700 1 -- 172.21.15.39:0/103157012 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f046801a020 con 0x7f0478070360 2023-11-28T12:00:40.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.380+0000 7f04757fa700 1 --2- 172.21.15.39:0/103157012 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0464064ee0 0x7f0464067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:40.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.380+0000 7f04757fa700 1 -- 172.21.15.39:0/103157012 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f0468081960 con 0x7f0478070360 2023-11-28T12:00:40.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.384+0000 7f047cd1b700 1 --2- 172.21.15.39:0/103157012 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0464064ee0 0x7f0464067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:40.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.384+0000 7f047cd1b700 1 --2- 172.21.15.39:0/103157012 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0464064ee0 0x7f0464067390 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f046c009ae0 tx=0x7f046c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:40.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.384+0000 7f04757fa700 1 -- 172.21.15.39:0/103157012 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f046804fcc0 con 0x7f0478070360 2023-11-28T12:00:40.568 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.560+0000 7f047dd1d700 1 -- 172.21.15.39:0/103157012 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f0478073d20 con 0x7f0478070360 2023-11-28T12:00:40.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.572+0000 7f04757fa700 1 -- 172.21.15.39:0/103157012 <== mon.0 v2:172.21.15.39:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f046804fcc0 con 0x7f0478070360 2023-11-28T12:00:40.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.572+0000 7f04757fa700 1 -- 172.21.15.39:0/103157012 <== mon.0 v2:172.21.15.39:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v16)=0 v16) v1 ==== 123+0+0 (secure 0 0 0) 0x7f04680532e0 con 0x7f0478070360 2023-11-28T12:00:40.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.576+0000 7f047dd1d700 1 -- 172.21.15.39:0/103157012 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0464064ee0 msgr2=0x7f0464067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:40.583 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.576+0000 7f047dd1d700 1 --2- 172.21.15.39:0/103157012 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0464064ee0 0x7f0464067390 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f046c009ae0 tx=0x7f046c008040 comp rx=0 tx=0).stop 2023-11-28T12:00:40.583 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.576+0000 7f047dd1d700 1 -- 172.21.15.39:0/103157012 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0478070360 msgr2=0x7f04780cd340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:40.583 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.576+0000 7f047dd1d700 1 --2- 172.21.15.39:0/103157012 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0478070360 0x7f04780cd340 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f046800c550 tx=0x7f046800c910 comp rx=0 tx=0).stop 2023-11-28T12:00:40.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.576+0000 7f047dd1d700 1 -- 172.21.15.39:0/103157012 shutdown_connections 2023-11-28T12:00:40.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.576+0000 7f047dd1d700 1 --2- 172.21.15.39:0/103157012 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f0464064ee0 0x7f0464067390 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:40.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.576+0000 7f047dd1d700 1 --2- 172.21.15.39:0/103157012 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f047815c150 0x7f04780b7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:40.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.576+0000 7f047dd1d700 1 --2- 172.21.15.39:0/103157012 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0478070360 0x7f04780cd340 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:40.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.576+0000 7f047dd1d700 1 --2- 172.21.15.39:0/103157012 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f047806ff10 0x7f047814ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:40.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.576+0000 7f047dd1d700 1 -- 172.21.15.39:0/103157012 >> 172.21.15.39:0/103157012 conn(0x7f04780d3680 msgr2=0x7f04780b4630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:40.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.576+0000 7f047dd1d700 1 -- 172.21.15.39:0/103157012 shutdown_connections 2023-11-28T12:00:40.585 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.576+0000 7f047dd1d700 1 -- 172.21.15.39:0/103157012 wait complete. 2023-11-28T12:00:40.607 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T12:00:40.607 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T12:00:40.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.772+0000 7f51e5e46700 1 Processor -- start 2023-11-28T12:00:40.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.772+0000 7f51e5e46700 1 -- start start 2023-11-28T12:00:40.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.776+0000 7f51e5e46700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f51e0160710 0x7f51e00cc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:40.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.776+0000 7f51e5e46700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51e0070790 0x7f51e0164250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:40.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.776+0000 7f51e5e46700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51e00ad6c0 con 0x7f51e00cc860 2023-11-28T12:00:40.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.776+0000 7f51e5e46700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e006b1c0 con 0x7f51e0160710 2023-11-28T12:00:40.782 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.776+0000 7f51e5e46700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e00adc60 con 0x7f51e0070790 2023-11-28T12:00:40.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.776+0000 7f51e4e44700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f51e0160710 0x7f51e00cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:40.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.776+0000 7f51e5645700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51e0070790 0x7f51e0164250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:40.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.776+0000 7f51d7fff700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f51e00cc860 0x7f51e0070080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.39:42296/0 (socket says 172.21.15.39:42296) 2023-11-28T12:00:40.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.776+0000 7f51d7fff700 1 -- 172.21.15.39:0/4111180653 learned_addr learned my addr 172.21.15.39:0/4111180653 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-11-28T12:00:40.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.776+0000 7f51e4e44700 1 -- 172.21.15.39:0/4111180653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51e0070790 msgr2=0x7f51e0164250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:40.785 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.776+0000 7f51e4e44700 1 --2- 172.21.15.39:0/4111180653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51e0070790 0x7f51e0164250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:40.785 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.776+0000 7f51e4e44700 1 -- 172.21.15.39:0/4111180653 >> v1:172.21.15.184:6789/0 conn(0x7f51e00cc860 legacy=0x7f51e0070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:40.785 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.776+0000 7f51e4e44700 1 -- 172.21.15.39:0/4111180653 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e006b3d0 con 0x7f51e0160710 2023-11-28T12:00:40.785 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.776+0000 7f51e4e44700 1 --2- 172.21.15.39:0/4111180653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51e0160710 0x7f51e00cc320 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f51dc009850 tx=0x7f51dc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef5e22cd5d08ff92 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:40.785 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.776+0000 7f51d77fe700 1 -- 172.21.15.39:0/4111180653 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc011830 con 0x7f51e0160710 2023-11-28T12:00:40.785 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.776+0000 7f51d77fe700 1 -- 172.21.15.39:0/4111180653 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f51dc011990 con 0x7f51e0160710 2023-11-28T12:00:40.786 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.776+0000 7f51d77fe700 1 -- 172.21.15.39:0/4111180653 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc011d60 con 0x7f51e0160710 2023-11-28T12:00:40.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.780+0000 7f51e5e46700 1 -- 172.21.15.39:0/4111180653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51e0160710 msgr2=0x7f51e00cc320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:40.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.780+0000 7f51e5e46700 1 --2- 172.21.15.39:0/4111180653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51e0160710 0x7f51e00cc320 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f51dc009850 tx=0x7f51dc009b60 comp rx=0 tx=0).stop 2023-11-28T12:00:40.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.780+0000 7f51e5e46700 1 -- 172.21.15.39:0/4111180653 shutdown_connections 2023-11-28T12:00:40.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.780+0000 7f51e5e46700 1 --2- 172.21.15.39:0/4111180653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51e0070790 0x7f51e0164250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:40.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.780+0000 7f51e5e46700 1 --2- 172.21.15.39:0/4111180653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51e0160710 0x7f51e00cc320 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:40.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.780+0000 7f51e5e46700 1 -- 172.21.15.39:0/4111180653 >> 172.21.15.39:0/4111180653 conn(0x7f51e00b0f80 msgr2=0x7f51e00ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:40.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.780+0000 7f51e5e46700 1 -- 172.21.15.39:0/4111180653 shutdown_connections 2023-11-28T12:00:40.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.780+0000 7f51e5e46700 1 -- 172.21.15.39:0/4111180653 wait complete. 2023-11-28T12:00:40.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.780+0000 7f51e5e46700 1 Processor -- start 2023-11-28T12:00:40.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.780+0000 7f51e5e46700 1 -- start start 2023-11-28T12:00:40.792 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.784+0000 7f51e5e46700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51e0070790 0x7f51e015bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:40.792 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.784+0000 7f51e5e46700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51e00cc860 0x7f51e015d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:40.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.784+0000 7f51e5e46700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51e0160710 0x7f51e00c38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:40.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.784+0000 7f51e5e46700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e00bd5d0 con 0x7f51e0070790 2023-11-28T12:00:40.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.784+0000 7f51e5e46700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e00c4460 con 0x7f51e0160710 2023-11-28T12:00:40.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.784+0000 7f51e5e46700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e00c4740 con 0x7f51e00cc860 2023-11-28T12:00:40.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.784+0000 7f51e4e44700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51e0070790 0x7f51e015bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:40.794 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.784+0000 7f51e4e44700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51e0070790 0x7f51e015bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58336/0 (socket says 172.21.15.39:58336) 2023-11-28T12:00:40.794 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.784+0000 7f51e4e44700 1 -- 172.21.15.39:0/4057951266 learned_addr learned my addr 172.21.15.39:0/4057951266 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-11-28T12:00:40.794 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.784+0000 7f51d7fff700 1 --2- 172.21.15.39:0/4057951266 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51e00cc860 0x7f51e015d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:40.794 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.784+0000 7f51e5645700 1 --2- 172.21.15.39:0/4057951266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51e0160710 0x7f51e00c38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:40.794 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.784+0000 7f51e4e44700 1 -- 172.21.15.39:0/4057951266 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51e00cc860 msgr2=0x7f51e015d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:40.795 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.784+0000 7f51e4e44700 1 --2- 172.21.15.39:0/4057951266 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51e00cc860 0x7f51e015d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:40.795 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.784+0000 7f51e4e44700 1 -- 172.21.15.39:0/4057951266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51e0160710 msgr2=0x7f51e00c38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:40.795 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.784+0000 7f51e4e44700 1 --2- 172.21.15.39:0/4057951266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51e0160710 0x7f51e00c38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:40.795 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.784+0000 7f51e4e44700 1 -- 172.21.15.39:0/4057951266 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51dc0094b0 con 0x7f51e0070790 2023-11-28T12:00:40.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.784+0000 7f51e5645700 1 --2- 172.21.15.39:0/4057951266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51e0160710 0x7f51e00c38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:00:40.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.784+0000 7f51e4e44700 1 --2- 172.21.15.39:0/4057951266 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51e0070790 0x7f51e015bc50 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f51dc0097a0 tx=0x7f51dc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:40.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.784+0000 7f51d57fa700 1 -- 172.21.15.39:0/4057951266 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc0036c0 con 0x7f51e0070790 2023-11-28T12:00:40.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.784+0000 7f51d57fa700 1 -- 172.21.15.39:0/4057951266 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f51dc003840 con 0x7f51e0070790 2023-11-28T12:00:40.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.784+0000 7f51d57fa700 1 -- 172.21.15.39:0/4057951266 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc003c10 con 0x7f51e0070790 2023-11-28T12:00:40.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.784+0000 7f51e5e46700 1 -- 172.21.15.39:0/4057951266 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e00ad8f0 con 0x7f51e0070790 2023-11-28T12:00:40.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.784+0000 7f51e5e46700 1 -- 172.21.15.39:0/4057951266 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e006b6b0 con 0x7f51e0070790 2023-11-28T12:00:40.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.788+0000 7f51e5e46700 1 -- 172.21.15.39:0/4057951266 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51e0160ae0 con 0x7f51e0070790 2023-11-28T12:00:40.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.788+0000 7f51d57fa700 1 -- 172.21.15.39:0/4057951266 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f51dc00f050 con 0x7f51e0070790 2023-11-28T12:00:40.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.792+0000 7f51d57fa700 1 --2- 172.21.15.39:0/4057951266 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f51cc064ee0 0x7f51cc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:40.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.792+0000 7f51d57fa700 1 -- 172.21.15.39:0/4057951266 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f51dc0832a0 con 0x7f51e0070790 2023-11-28T12:00:40.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.792+0000 7f51d7fff700 1 --2- 172.21.15.39:0/4057951266 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f51cc064ee0 0x7f51cc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:40.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.792+0000 7f51d7fff700 1 --2- 172.21.15.39:0/4057951266 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f51cc064ee0 0x7f51cc067390 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f51e015f850 tx=0x7f51d0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:40.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:40.796+0000 7f51d57fa700 1 -- 172.21.15.39:0/4057951266 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f51dc0514a0 con 0x7f51e0070790 2023-11-28T12:00:41.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:41.004+0000 7f51e5e46700 1 -- 172.21.15.39:0/4057951266 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51e0073cb0 con 0x7f51e0070790 2023-11-28T12:00:41.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:41.008+0000 7f51d57fa700 1 -- 172.21.15.39:0/4057951266 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f51dc02ade0 con 0x7f51e0070790 2023-11-28T12:00:41.014 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-11-28T12:00:41.014 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":35,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5645,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/3875262459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3875262459},{"type":"v1","addr":"172.21.15.184:6835","nonce":3875262459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5648,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/3845363738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3845363738},{"type":"v1","addr":"172.21.15.184:6837","nonce":3845363738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6225,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6834/2646905389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6833","nonce":2646905389},{"type":"v1","addr":"172.21.15.39:6834","nonce":2646905389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6618,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2614222372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":2614222372},{"type":"v1","addr":"172.21.15.39:6835","nonce":2614222372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[]} 2023-11-28T12:00:41.018 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:41.012+0000 7f51e5e46700 1 -- 172.21.15.39:0/4057951266 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f51cc064ee0 msgr2=0x7f51cc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:41.018 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:41.012+0000 7f51e5e46700 1 --2- 172.21.15.39:0/4057951266 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f51cc064ee0 0x7f51cc067390 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f51e015f850 tx=0x7f51d0009040 comp rx=0 tx=0).stop 2023-11-28T12:00:41.018 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:41.012+0000 7f51e5e46700 1 -- 172.21.15.39:0/4057951266 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51e0070790 msgr2=0x7f51e015bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:41.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:41.012+0000 7f51e5e46700 1 --2- 172.21.15.39:0/4057951266 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51e0070790 0x7f51e015bc50 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f51dc0097a0 tx=0x7f51dc004770 comp rx=0 tx=0).stop 2023-11-28T12:00:41.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:41.012+0000 7f51e5e46700 1 -- 172.21.15.39:0/4057951266 shutdown_connections 2023-11-28T12:00:41.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:41.012+0000 7f51e5e46700 1 --2- 172.21.15.39:0/4057951266 >> [v2:172.21.15.184:6832/36166,v1:172.21.15.184:6833/36166] conn(0x7f51cc064ee0 0x7f51cc067390 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:41.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:41.012+0000 7f51e5e46700 1 --2- 172.21.15.39:0/4057951266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51e0160710 0x7f51e00c38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:41.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:41.012+0000 7f51e5e46700 1 --2- 172.21.15.39:0/4057951266 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51e00cc860 0x7f51e015d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:41.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:41.012+0000 7f51e5e46700 1 --2- 172.21.15.39:0/4057951266 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51e0070790 0x7f51e015bc50 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:41.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:41.012+0000 7f51e5e46700 1 -- 172.21.15.39:0/4057951266 >> 172.21.15.39:0/4057951266 conn(0x7f51e00b0f80 msgr2=0x7f51e00af810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:41.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:41.012+0000 7f51e5e46700 1 -- 172.21.15.39:0/4057951266 shutdown_connections 2023-11-28T12:00:41.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-11-28T12:00:41.012+0000 7f51e5e46700 1 -- 172.21.15.39:0/4057951266 wait complete. 2023-11-28T12:00:41.024 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 35 2023-11-28T12:00:41.048 DEBUG:tasks.cephfs.filesystem:already dead... 2023-11-28T12:00:41.048 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-28T12:00:41.049 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-28T12:00:41.049 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:00:41.070 INFO:tasks.ceph.mds.a:Stopped 2023-11-28T12:00:41.070 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-28T12:00:41.070 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:00:41.138 INFO:tasks.ceph.mds.c:Stopped 2023-11-28T12:00:41.139 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-28T12:00:41.139 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:00:41.165 INFO:tasks.ceph.mds.b:Stopped 2023-11-28T12:00:41.166 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-28T12:00:41.166 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:00:41.233 INFO:tasks.ceph.mds.d:Stopped 2023-11-28T12:00:41.234 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-28T12:00:41.234 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-28T12:00:41.234 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:00:41.334 INFO:tasks.ceph.osd.0:Stopped 2023-11-28T12:00:41.335 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-28T12:00:41.335 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:00:45.076 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-11-28T12:00:47.437 INFO:tasks.ceph.osd.1:Stopped 2023-11-28T12:00:47.437 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-28T12:00:47.437 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:00:47.512 INFO:tasks.ceph.osd.2:Stopped 2023-11-28T12:00:47.513 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-28T12:00:47.513 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:00:50.985 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-11-28T12:00:50.985 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-11-28T12:00:53.614 INFO:tasks.ceph.osd.3:Stopped 2023-11-28T12:00:53.615 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-28T12:00:53.615 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:00:53.703 INFO:tasks.ceph.osd.4:Stopped 2023-11-28T12:00:53.704 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-28T12:00:53.704 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:00:53.796 INFO:tasks.ceph.osd.5:Stopped 2023-11-28T12:00:53.796 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-28T12:00:53.797 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:00:53.874 INFO:tasks.ceph.osd.6:Stopped 2023-11-28T12:00:53.874 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-28T12:00:53.875 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:00:56.489 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-11-28T12:00:56.490 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-11-28T12:00:59.976 INFO:tasks.ceph.osd.7:Stopped 2023-11-28T12:00:59.977 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-28T12:00:59.977 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-28T12:00:59.977 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:01:00.041 INFO:tasks.ceph.mgr.y:Stopped 2023-11-28T12:01:00.042 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-28T12:01:00.042 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:01:00.105 INFO:tasks.ceph.mgr.x:Stopped 2023-11-28T12:01:00.105 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-28T12:01:00.106 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-28T12:01:00.106 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:01:00.138 INFO:tasks.ceph.mon.a:Stopped 2023-11-28T12:01:00.138 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-28T12:01:00.138 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:01:00.171 INFO:tasks.ceph.mon.b:Stopped 2023-11-28T12:01:00.171 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-28T12:01:00.172 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:01:00.247 INFO:tasks.ceph.mon.c:Stopped 2023-11-28T12:01:00.247 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-28T12:01:00.248 DEBUG:teuthology.orchestra.run.smithi039:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | head -n 1 2023-11-28T12:01:00.299 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi039.front.sepia.ceph.com 2023-11-28T12:01:00.299 DEBUG:teuthology.orchestra.run.smithi039:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-28T12:01:00.375 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:01:00.383 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:01:00.564 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi039.front.sepia.ceph.com 2023-11-28T12:01:00.565 DEBUG:teuthology.orchestra.run.smithi039:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-28T12:01:00.825 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi039.front.sepia.ceph.com 2023-11-28T12:01:00.826 DEBUG:teuthology.orchestra.run.smithi039:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-28T12:01:01.062 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi039.front.sepia.ceph.com 2023-11-28T12:01:01.062 DEBUG:teuthology.orchestra.run.smithi039:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-28T12:01:01.307 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi184.front.sepia.ceph.com 2023-11-28T12:01:01.307 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-28T12:01:01.490 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-11-28T12:01:01.559 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi184.front.sepia.ceph.com 2023-11-28T12:01:01.559 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-28T12:01:01.794 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi184.front.sepia.ceph.com 2023-11-28T12:01:01.795 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-28T12:01:01.979 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi184.front.sepia.ceph.com 2023-11-28T12:01:01.980 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-28T12:01:02.203 INFO:tasks.ceph:Archiving mon data... 2023-11-28T12:01:02.204 DEBUG:teuthology.misc:Transferring archived files from smithi039:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469963/data/mon.a.tgz 2023-11-28T12:01:02.204 DEBUG:teuthology.orchestra.run.smithi039:> mktemp 2023-11-28T12:01:02.223 INFO:teuthology.orchestra.run.smithi039.stdout:/tmp/tmp.2m3cNOVHSr 2023-11-28T12:01:02.223 DEBUG:teuthology.orchestra.run.smithi039:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.2m3cNOVHSr 2023-11-28T12:01:02.404 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 0666 /tmp/tmp.2m3cNOVHSr 2023-11-28T12:01:02.502 DEBUG:teuthology.orchestra.remote:smithi039:/tmp/tmp.2m3cNOVHSr is 416KB 2023-11-28T12:01:02.579 DEBUG:teuthology.orchestra.run.smithi039:> rm -fr /tmp/tmp.2m3cNOVHSr 2023-11-28T12:01:02.600 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469963/data/mon.b.tgz 2023-11-28T12:01:02.600 DEBUG:teuthology.orchestra.run.smithi184:> mktemp 2023-11-28T12:01:02.618 INFO:teuthology.orchestra.run.smithi184.stdout:/tmp/tmp.kcNvIDD0fT 2023-11-28T12:01:02.619 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.kcNvIDD0fT 2023-11-28T12:01:02.822 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0666 /tmp/tmp.kcNvIDD0fT 2023-11-28T12:01:02.922 DEBUG:teuthology.orchestra.remote:smithi184:/tmp/tmp.kcNvIDD0fT is 533KB 2023-11-28T12:01:03.004 DEBUG:teuthology.orchestra.run.smithi184:> rm -fr /tmp/tmp.kcNvIDD0fT 2023-11-28T12:01:03.020 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469963/data/mon.c.tgz 2023-11-28T12:01:03.021 DEBUG:teuthology.orchestra.run.smithi184:> mktemp 2023-11-28T12:01:03.080 INFO:teuthology.orchestra.run.smithi184.stdout:/tmp/tmp.44FU3A2JWx 2023-11-28T12:01:03.081 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.44FU3A2JWx 2023-11-28T12:01:03.291 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0666 /tmp/tmp.44FU3A2JWx 2023-11-28T12:01:03.390 DEBUG:teuthology.orchestra.remote:smithi184:/tmp/tmp.44FU3A2JWx is 533KB 2023-11-28T12:01:03.463 DEBUG:teuthology.orchestra.run.smithi184:> rm -fr /tmp/tmp.44FU3A2JWx 2023-11-28T12:01:03.483 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-28T12:01:03.483 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-28T12:01:03.493 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-28T12:01:03.559 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-28T12:01:03.559 DEBUG:teuthology.orchestra.run.smithi039:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-28T12:01:03.578 DEBUG:teuthology.orchestra.run.smithi184:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-28T12:01:03.627 INFO:teuthology.orchestra.run.smithi039.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-28T12:01:03.654 INFO:teuthology.orchestra.run.smithi184.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-28T12:01:03.667 INFO:tasks.ceph:Archiving crash dumps... 2023-11-28T12:01:03.668 DEBUG:teuthology.misc:Transferring archived files from smithi039:/var/lib/ceph/crash to /home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469963/remote/smithi039/crash 2023-11-28T12:01:03.669 DEBUG:teuthology.orchestra.run.smithi039:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-28T12:01:03.710 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/lib/ceph/crash to /home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469963/remote/smithi184/crash 2023-11-28T12:01:03.711 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-28T12:01:03.747 INFO:tasks.ceph:Shutting down logrotate 2023-11-28T12:01:03.747 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:01:03.762 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:01:03.862 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-28T12:01:03.902 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-28T12:01:03.938 INFO:tasks.ceph:Compressing logs... 2023-11-28T12:01:03.938 DEBUG:teuthology.orchestra.run.smithi039:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-28T12:01:03.951 DEBUG:teuthology.orchestra.run.smithi184:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-28T12:01:08.574 INFO:tasks.ceph:Archiving logs... 2023-11-28T12:01:08.575 DEBUG:teuthology.misc:Transferring archived files from smithi039:/var/log/ceph to /home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469963/remote/smithi039/log 2023-11-28T12:01:08.580 DEBUG:teuthology.orchestra.run.smithi039:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-28T12:01:09.431 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/log/ceph to /home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469963/remote/smithi184/log 2023-11-28T12:01:09.432 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-28T12:01:09.999 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-28T12:01:10.008 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-28T12:01:10.009 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-28T12:01:10.016 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-28T12:01:10.115 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-28T12:01:10.124 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-28T12:01:10.125 DEBUG:teuthology.orchestra.run.smithi039:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T12:01:10.132 DEBUG:teuthology.orchestra.run.smithi184:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T12:01:10.169 INFO:teuthology.orchestra.run.smithi039.stdout: remote refid st t when poll reach delay offset jitter 2023-11-28T12:01:10.170 INFO:teuthology.orchestra.run.smithi039.stdout:============================================================================== 2023-11-28T12:01:10.170 INFO:teuthology.orchestra.run.smithi039.stdout: hv01.front.sepi 44.4.53.2 2 u 36 64 377 0.080 -0.513 0.210 2023-11-28T12:01:10.170 INFO:teuthology.orchestra.run.smithi039.stdout: hv02.front.sepi 63.231.80.2 3 u 32 64 377 0.092 1.211 0.295 2023-11-28T12:01:10.170 INFO:teuthology.orchestra.run.smithi039.stdout:*hv03.front.sepi 74.6.168.72 3 u 37 64 377 0.095 0.653 0.276 2023-11-28T12:01:10.170 INFO:teuthology.orchestra.run.smithi039.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-28T12:01:10.173 INFO:teuthology.orchestra.run.smithi184.stdout: remote refid st t when poll reach delay offset jitter 2023-11-28T12:01:10.173 INFO:teuthology.orchestra.run.smithi184.stdout:============================================================================== 2023-11-28T12:01:10.174 INFO:teuthology.orchestra.run.smithi184.stdout:*hv01.front.sepi 44.4.53.2 2 u 38 64 377 0.121 -0.489 0.276 2023-11-28T12:01:10.174 INFO:teuthology.orchestra.run.smithi184.stdout:+hv02.front.sepi 63.231.80.2 3 u 32 64 377 0.122 0.799 0.400 2023-11-28T12:01:10.174 INFO:teuthology.orchestra.run.smithi184.stdout:+hv03.front.sepi 74.6.168.72 3 u 27 64 377 0.123 0.513 0.307 2023-11-28T12:01:10.174 INFO:teuthology.orchestra.run.smithi184.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-28T12:01:10.175 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-28T12:01:10.185 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-28T12:01:10.185 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-28T12:01:10.217 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-28T12:01:10.267 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-28T12:01:10.363 INFO:teuthology.task.internal:Duration was 1064.025504 seconds 2023-11-28T12:01:10.364 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-28T12:01:10.401 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-28T12:01:10.401 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-28T12:01:10.408 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-28T12:01:10.567 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-28T12:01:10.567 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi039.front.sepia.ceph.com 2023-11-28T12:01:10.567 DEBUG:teuthology.orchestra.run.smithi039:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-28T12:01:10.603 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi184.front.sepia.ceph.com 2023-11-28T12:01:10.603 DEBUG:teuthology.orchestra.run.smithi184:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-28T12:01:10.640 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-28T12:01:10.641 DEBUG:teuthology.orchestra.run.smithi039:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-28T12:01:10.655 DEBUG:teuthology.orchestra.run.smithi184:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-28T12:01:10.749 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-28T12:01:10.750 DEBUG:teuthology.orchestra.run.smithi039:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-28T12:01:10.758 DEBUG:teuthology.orchestra.run.smithi184:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-28T12:01:10.859 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-28T12:01:10.872 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-28T12:01:10.873 DEBUG:teuthology.orchestra.run.smithi039:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-28T12:01:10.915 DEBUG:teuthology.orchestra.run.smithi184:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-28T12:01:10.953 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-28T12:01:10.964 DEBUG:teuthology.orchestra.run.smithi039:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-28T12:01:10.971 DEBUG:teuthology.orchestra.run.smithi184:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-28T12:01:11.002 INFO:teuthology.orchestra.run.smithi039.stdout:kernel.core_pattern = core 2023-11-28T12:01:11.033 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = core 2023-11-28T12:01:11.071 DEBUG:teuthology.orchestra.run.smithi039:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-28T12:01:11.104 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T12:01:11.105 DEBUG:teuthology.orchestra.run.smithi184:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-28T12:01:11.134 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T12:01:11.135 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-28T12:01:11.146 INFO:teuthology.task.internal:Transferring archived files... 2023-11-28T12:01:11.146 DEBUG:teuthology.misc:Transferring archived files from smithi039:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469963/remote/smithi039 2023-11-28T12:01:11.147 DEBUG:teuthology.orchestra.run.smithi039:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-28T12:01:11.190 DEBUG:teuthology.misc:Transferring archived files from smithi184:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469963/remote/smithi184 2023-11-28T12:01:11.190 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-28T12:01:11.231 INFO:teuthology.task.internal:Removing archive directory... 2023-11-28T12:01:11.232 DEBUG:teuthology.orchestra.run.smithi039:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-28T12:01:11.239 DEBUG:teuthology.orchestra.run.smithi184:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-28T12:01:11.294 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-28T12:01:11.305 INFO:teuthology.task.internal:Not uploading archives. 2023-11-28T12:01:11.305 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-28T12:01:11.334 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-28T12:01:11.334 DEBUG:teuthology.orchestra.run.smithi039:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-28T12:01:11.342 DEBUG:teuthology.orchestra.run.smithi184:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-28T12:01:11.358 INFO:teuthology.orchestra.run.smithi039.stdout: 1048609 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 28 12:01 /home/ubuntu/cephtest 2023-11-28T12:01:11.365 INFO:teuthology.orchestra.run.smithi184.stdout: 1048600 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 28 12:01 /home/ubuntu/cephtest 2023-11-28T12:01:11.371 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-28T12:01:11.382 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-28T12:01:11.485 INFO:teuthology.nuke:Checking targets against current locks 2023-11-28T12:01:11.513 DEBUG:teuthology.nuke:shortname: smithi039 2023-11-28T12:01:11.513 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T12:01:11.536 DEBUG:teuthology.nuke:shortname: smithi184 2023-11-28T12:01:11.536 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T12:01:11.540 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi039.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469963', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 11:31:58.296412', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-11-28T12:01:11.560 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469963', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 11:31:58.294434', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-11-28T12:01:11.592 INFO:teuthology.orchestra.console.smithi039:Power off 2023-11-28T12:01:11.593 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T12:01:11.612 INFO:teuthology.orchestra.console.smithi184:Power off 2023-11-28T12:01:11.613 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T12:01:11.623 DEBUG:teuthology.orchestra.console.smithi039:power off output: Chassis Power Control: Down/Off 2023-11-28T12:01:11.623 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T12:01:11.636 DEBUG:teuthology.orchestra.console.smithi184:power off output: Chassis Power Control: Down/Off 2023-11-28T12:01:11.637 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T12:01:11.655 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on 2023-11-28T12:01:11.665 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2023-11-28T12:01:15.656 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T12:01:15.666 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T12:01:15.769 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on 2023-11-28T12:01:15.776 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2023-11-28T12:01:19.772 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T12:01:19.781 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T12:01:19.884 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off 2023-11-28T12:01:19.892 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2023-11-28T12:01:19.985 INFO:teuthology.orchestra.console.smithi039:Power off completed 2023-11-28T12:01:19.993 INFO:teuthology.orchestra.console.smithi184:Power off completed 2023-11-28T12:01:20.101 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 client.1-kernel-sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} duration: 1064.0255043506622 failure_reason: 'Test failure: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub)' flavor: default owner: scheduled_neesingh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=428dbe41923e490cb793aa43fee9b553 status: fail success: false 2023-11-28T12:01:20.102 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T12:01:20.188 INFO:teuthology.run:FAIL